-- Logs begin at Mon 2022-08-29 04:07:03 UTC, end at Mon 2022-08-29 06:46:56 UTC. -- Aug 29 04:39:45.274554 n-d-854119-9 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 04:39:45.283545 n-d-854119-9 devstack@n-api.service[113009]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 04:39:45 2022] *** Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: nodename: n-d-854119-9 Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: machine: x86_64 Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: clock source: unix Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: pcre jit disabled Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: detected number of CPU cores: 4 Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: current working directory: / Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: detected binary path: /usr/bin/uwsgi-core Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: your processes number limit is 47680 Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: your memory page size is 4096 bytes Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: detected max file descriptor number: 2048 Aug 29 04:39:45.285562 n-d-854119-9 devstack@n-api.service[113009]: lock engine: pthread robust mutexes Aug 29 04:39:45.286454 n-d-854119-9 devstack@n-api.service[113009]: thunder lock: enabled Aug 29 04:39:45.286454 n-d-854119-9 devstack@n-api.service[113009]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 04:39:45.286454 n-d-854119-9 devstack@n-api.service[113009]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 04:39:45.323994 n-d-854119-9 devstack@n-api.service[113009]: Python main interpreter initialized at 0x558cd91e59c0 Aug 29 04:39:45.323994 n-d-854119-9 devstack@n-api.service[113009]: python threads support enabled Aug 29 04:39:45.323994 n-d-854119-9 devstack@n-api.service[113009]: your server socket listen backlog is limited to 100 connections Aug 29 04:39:45.323994 n-d-854119-9 devstack@n-api.service[113009]: your mercy for graceful operations on workers is 90 seconds Aug 29 04:39:45.324388 n-d-854119-9 devstack@n-api.service[113009]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 04:39:45.324388 n-d-854119-9 devstack@n-api.service[113009]: *** Operational MODE: preforking *** Aug 29 04:39:45.324665 n-d-854119-9 devstack@n-api.service[113009]: *** uWSGI is running in multiple interpreter mode *** Aug 29 04:39:45.324665 n-d-854119-9 devstack@n-api.service[113009]: spawned uWSGI master process (pid: 113009) Aug 29 04:39:45.324869 n-d-854119-9 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 04:39:45.325663 n-d-854119-9 devstack@n-api.service[113009]: spawned uWSGI worker 1 (pid: 113010, cores: 1) Aug 29 04:39:45.325663 n-d-854119-9 devstack@n-api.service[113009]: spawned uWSGI worker 2 (pid: 113011, cores: 1) Aug 29 04:39:45.325834 n-d-854119-9 devstack@n-api.service[113009]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 04:39:45.969074 n-d-854119-9 devstack@n-api.service[113011]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 04:39:45.971233 n-d-854119-9 devstack@n-api.service[113010]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 04:39:47.027629 n-d-854119-9 devstack@n-api.service[113011]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 04:39:47.027629 n-d-854119-9 devstack@n-api.service[113011]: from cryptography.utils import int_from_bytes Aug 29 04:39:47.028295 n-d-854119-9 devstack@n-api.service[113011]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 04:39:47.028295 n-d-854119-9 devstack@n-api.service[113011]: from cryptography.utils import int_from_bytes Aug 29 04:39:47.030115 n-d-854119-9 devstack@n-api.service[113010]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 04:39:47.030115 n-d-854119-9 devstack@n-api.service[113010]: from cryptography.utils import int_from_bytes Aug 29 04:39:47.030567 n-d-854119-9 devstack@n-api.service[113010]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 04:39:47.030567 n-d-854119-9 devstack@n-api.service[113010]: from cryptography.utils import int_from_bytes Aug 29 04:39:49.464270 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 04:39:49.464947 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 04:39:49.465298 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 04:39:49.465412 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 04:39:49.465494 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 04:39:49.465562 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 04:39:49.465646 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 04:39:49.465735 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 04:39:49.465825 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 04:39:49.465915 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 04:39:49.466000 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.466081 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.466249 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.466414 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.466513 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.466599 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.466851 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.466994 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.467161 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.467259 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.467462 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.467594 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.467743 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.467854 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.468078 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.468236 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.468389 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.468487 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.468653 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.468770 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.468969 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.469112 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.469284 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854119-9 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.469427 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854119-9 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.469565 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.469668 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.469863 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.469959 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.470158 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.470248 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.470463 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.470562 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.470754 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.470860 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.471058 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.471155 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.471348 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.471441 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.471830 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.472264 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.472264 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.472515 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.472623 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.472724 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.472824 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.472924 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.473139 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.473370 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.473466 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.473684 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.473775 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.473982 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.474070 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.474287 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.474383 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.474584 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.474672 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.474891 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.474980 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.475182 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.475272 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854119-9 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.475562 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.475656 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854119-9 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.475862 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.475950 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.476181 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.476326 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.476472 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.476668 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.476924 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.477023 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.477223 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.477310 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.477515 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.477603 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.477821 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.477998 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.478093 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.478171 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.478426 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.478517 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.478724 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.478825 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.479035 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.479122 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.479336 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.479426 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.479624 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.479720 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.479904 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.479995 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.480231 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.480328 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.480542 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.480628 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.480835 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.480924 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.481128 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.481212 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.481376 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.481460 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.481650 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.481741 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.481945 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.482038 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.482252 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.482336 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.482556 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.482655 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.482797 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.482891 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.483040 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.483135 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.483316 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.483516 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.483613 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.483693 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.483919 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.484013 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.484239 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.484341 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.484535 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.484620 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.484827 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.484919 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.485119 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.485202 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.485412 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.485496 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.485703 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.485799 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.485998 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.486092 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.486291 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.486375 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.486593 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.486677 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.486892 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.486986 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.487185 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.487268 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.487483 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.487565 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.487788 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.487890 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.488092 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.488214 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.488421 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.488551 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.488718 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.488818 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.489039 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.489123 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.489336 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.489464 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.489632 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.489726 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.489938 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.490026 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.490232 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.490321 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.490537 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.490650 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.490816 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.490921 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.491110 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.491197 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.491416 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.491506 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.491706 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.491799 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.491947 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.492039 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.492280 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.492367 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.492573 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.492657 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.492865 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.492959 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.493159 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.493251 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.493450 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.493533 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.493745 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.493844 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.494036 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.494121 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.494320 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.494402 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.494611 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.494708 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.494900 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.494983 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.495192 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.495278 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.495482 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.495581 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.495772 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.495861 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.496061 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.496187 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.496380 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.496477 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.496668 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.496757 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.496958 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.497042 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.497263 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.497357 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.497555 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.497648 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.497847 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.497929 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.498138 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.498223 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.498430 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.498524 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.498723 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.498811 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.499019 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.499110 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.499311 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.499394 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.499607 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.499699 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.499908 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.500000 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.500222 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.500310 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.500514 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.500599 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.500812 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.500897 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.501105 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.501189 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.501398 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.501482 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.501687 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.501771 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.501975 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.502057 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.502266 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.502350 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.502562 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.502645 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.502851 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.502937 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.503142 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.503224 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.503430 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.503515 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.503720 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.503802 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.504007 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.504090 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.504322 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.504443 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.504609 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.504727 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.504896 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.504995 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.505179 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.505262 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.505484 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.505569 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.505781 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.505873 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.506073 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.506163 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.506365 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.506449 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.506657 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.506785 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.506959 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:39:49.507045 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.507280 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.507364 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.507599 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.507685 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.507952 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.508034 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.508292 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.508378 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.508614 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.508741 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.508925 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.509009 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.509229 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.509320 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.509526 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.509617 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.509829 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.509915 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.510134 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.510226 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.510433 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.510517 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.510732 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.510824 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.511031 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.511124 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.511336 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.511422 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.511643 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.511737 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.511950 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.512033 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.512277 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.512396 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.512582 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.512679 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.512886 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.512980 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.513182 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.513267 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.513489 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.513574 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.513802 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.513894 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.514104 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.514202 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.514400 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.514484 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.514728 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.514822 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.515049 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.515140 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.515351 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.515500 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.515660 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.515757 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.515960 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.516044 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.516284 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.516372 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.516584 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.516671 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.516882 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.516967 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.517192 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.517277 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.517494 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.517578 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.517797 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.517879 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.518099 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.518189 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.518399 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.518486 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.518700 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.518783 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.518998 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.519085 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.519295 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.519381 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.519594 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.519678 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.519893 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.519992 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.520213 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.520303 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.520531 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.520614 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.520831 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.520931 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.521139 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.521224 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.521444 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.521537 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.521741 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.521840 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.522044 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.522135 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.522339 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.522422 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.522637 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.522732 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.522932 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.523015 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.523222 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.523304 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.523558 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.523669 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.523833 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.523954 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.524148 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.524234 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.524441 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.524534 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.524748 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.524833 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.525047 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.525138 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.525344 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.525429 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.525655 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.525738 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.525945 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.526029 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.526245 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.526329 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.526543 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.526626 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.526839 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.526921 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.527153 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.527314 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.527434 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.527519 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.527729 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.527823 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.528023 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.528109 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.528352 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.528435 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.528648 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.528796 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.528942 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.529036 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.529262 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.529351 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.529533 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.529630 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.529827 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.529921 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.530128 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.530219 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.530424 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.530522 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.530720 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.530805 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.531017 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.531113 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.531317 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.531445 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.531617 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.531707 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.531914 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.531997 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.532234 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.532326 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.532555 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.532694 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.532857 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.532959 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.533152 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.533236 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.533464 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.533552 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.533769 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.533852 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.534065 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.534149 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.534352 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.534443 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.534646 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.534738 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.534936 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.535021 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.535230 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.535312 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.535518 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.535610 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.535811 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.535901 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.536098 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.536237 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.536412 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.536510 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.536702 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.536788 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.536994 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.537119 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.537284 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.537381 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.537593 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.537675 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.537886 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.537970 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.538181 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.538265 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.538471 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.538554 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.538762 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.538855 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.539136 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.539221 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.539430 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.539514 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.539758 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.539850 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.540077 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.540176 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.540406 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.540489 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.540713 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.540797 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.541010 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.541103 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.541309 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.541394 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.541605 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.541707 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.541903 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.541996 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.542197 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.542280 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.542494 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.542593 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.542792 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.542926 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.543084 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.543211 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.543386 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.543522 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.543688 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.543815 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.543985 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.544111 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.544313 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.544412 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.544605 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.544689 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.544901 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.544985 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.545202 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.545297 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.545526 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.545613 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.545829 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.545921 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.546136 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.546221 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.546433 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.546518 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.546729 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.546813 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.547027 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.547112 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.547322 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.547453 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.547617 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.547750 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.547919 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.548173 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.548328 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.548480 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.548622 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.548787 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.548927 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.549085 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.549212 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.549388 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.549516 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.549685 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.549816 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.549994 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.550083 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.550284 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.550368 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.550587 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.550673 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.550874 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.550957 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.551174 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.551260 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.551489 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.551575 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.551790 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.551921 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.552092 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.552268 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.552416 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.552561 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.552712 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.552804 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.552991 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.553194 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.553335 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.553473 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.553557 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.553641 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.553854 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.553948 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.554147 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.554267 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.554443 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.554528 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.554763 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.554854 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.555058 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.555141 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.555354 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.555439 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.555644 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.555742 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.555936 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.556028 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.556254 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.556342 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.556548 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.556635 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.556841 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.556927 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.557138 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.557224 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.557447 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.557538 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.557741 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.557824 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.558042 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.558127 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.558335 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.558421 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.558624 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.558731 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.558915 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.558999 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.559214 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.559307 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.559508 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.559591 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.559800 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.559894 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.560091 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.560219 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.560404 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.560490 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.560726 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.560818 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.561023 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.561107 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.561315 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.561399 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.561615 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.561702 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.561919 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.562004 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.562217 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.562310 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.562512 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.562604 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.562808 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.562901 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.563109 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.563244 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.563406 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.563542 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.563710 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.563841 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.564004 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.564168 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.564329 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.564459 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.564627 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.564761 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.564928 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.565057 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.565216 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.565344 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.565515 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.565644 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.565810 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.565938 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.566105 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.566266 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.566393 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.566519 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.566679 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.566820 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.566982 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.567249 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.567336 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.567573 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.567827 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.567984 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.568181 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.568312 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.568489 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.568619 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.568796 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.568940 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.569106 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.569253 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.569434 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.569579 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.569721 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.569857 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.570022 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.570152 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.570366 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.570511 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.570666 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.570801 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.570962 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.571111 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.571251 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.571383 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.571537 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.571670 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.571819 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.571954 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.572108 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.572251 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.572424 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.572561 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.572717 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.572852 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.573002 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.573143 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.573292 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.573427 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.573583 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.573729 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.573872 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.574004 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.574157 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.574286 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.574454 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.574582 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.574741 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.574869 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.575038 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.575166 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.575329 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.575458 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.575620 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.575748 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.575916 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.576046 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.576302 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.576434 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.576566 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.576698 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.576831 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.576964 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.577148 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.577283 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.577422 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.577559 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.577749 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.577891 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.578063 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.578196 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.578357 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.578492 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.578669 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.578804 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.578961 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.579088 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.579257 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.579402 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.579533 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.579671 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.579826 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.579954 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.580136 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.580271 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.580415 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.580547 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.580714 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.580851 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.581004 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.581134 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.581302 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.581430 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.581901 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.582029 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.582191 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.582320 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.582469 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.582601 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.582760 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.582897 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.583056 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.583190 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.583348 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.583434 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.583639 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.583723 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.583930 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.584022 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.584242 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.584330 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.584535 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.584619 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.584825 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.584919 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.585117 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.585202 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.585406 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.585490 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.585697 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.585791 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.586009 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.586098 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.586301 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.586385 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.586595 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.586687 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.586886 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.586971 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.587175 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.587259 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.587467 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.587597 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.587759 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.587843 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.588046 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.588149 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.588377 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.588462 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.588673 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.588758 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.588963 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.589054 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.589254 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.589338 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.589549 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.589643 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.589837 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.589920 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.590126 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.590212 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.590421 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.590513 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.590723 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.590814 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.591021 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.591106 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.591308 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.591392 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.591599 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.591692 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.591889 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.591972 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.592202 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.592292 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.592494 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.592588 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.592788 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.592879 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.593076 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.593160 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.593363 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.593458 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.593652 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.593744 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.593941 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.594024 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.594231 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.594328 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.594531 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.594650 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.594824 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.594907 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.595118 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.595201 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.595405 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.595496 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.595697 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.595782 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.596025 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.596111 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.596341 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.596438 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.596668 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.596752 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.596968 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.597053 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.597269 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.597351 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.597570 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.597691 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.597868 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.597960 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.598162 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.598247 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.598461 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.598553 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.598752 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.598844 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.599057 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.599140 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.599352 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.599444 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.599646 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.599731 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.599935 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.600020 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.600249 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.600352 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.600557 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.600641 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.600855 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.600939 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.601153 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.601248 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.601459 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.601584 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.601801 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.601885 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.602104 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.602197 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.602392 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.602475 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.602688 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.602781 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.602985 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.603083 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.603278 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.603407 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.603579 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.603672 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.603874 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.603959 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.604195 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.604282 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.604497 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.604581 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.604797 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.604882 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.605092 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.605177 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.605388 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.605473 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.605680 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.605766 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.605974 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.606057 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.606266 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.606360 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.606556 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.606641 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.606858 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.606942 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.607149 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.607244 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.607438 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.607524 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.607734 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.607827 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.608027 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.608137 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.608349 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.608465 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.608641 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.608768 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.609050 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.609136 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.609347 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.609432 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.609643 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.609728 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.609937 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.610029 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.610236 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.610320 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.610533 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.610621 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.610826 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.610910 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.611128 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.611231 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.611418 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.611538 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.611820 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.611905 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.612166 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.612249 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.612436 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.612532 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.612730 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.612823 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.613021 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.613105 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.613312 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.613406 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.613616 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.613701 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.613910 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.613993 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.614207 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.614307 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.614497 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.614588 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.614789 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.614874 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.615098 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.615192 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.615392 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.615500 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.615700 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.615807 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.616101 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.616208 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.616424 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.616536 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.616719 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.616840 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.617116 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.617248 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.617463 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.617548 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.617762 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.617934 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.618073 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.618159 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.618379 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.618464 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.618688 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.618772 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.618990 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.619304 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.619397 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.619618 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.619703 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.619920 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.620006 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.620251 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.620353 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.620548 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.620635 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.620852 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.620935 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.621156 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.621251 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.621448 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.621534 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.621757 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.621840 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.622064 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.622149 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.622367 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.622468 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.622676 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.622771 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.623042 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.623128 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.623358 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.623443 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.623653 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.623788 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.623949 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.624035 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.624273 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.624366 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.624569 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.624666 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.624863 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.624999 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.625162 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.625248 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.625458 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.625552 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.625755 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.625841 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.626054 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.626139 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.626347 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.626439 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.626640 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.626731 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.626932 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.627017 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.627225 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.627324 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.627522 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.627608 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.627813 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.627907 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.628159 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.628255 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.628439 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.628523 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.628747 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.628832 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.629041 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.629135 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.629351 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.629436 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.629649 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.629734 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.629942 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.630027 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.630234 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.630319 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.630528 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.630612 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.630819 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.630904 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.631113 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.631199 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.631407 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.631505 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.631737 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.631823 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.632029 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.632144 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.632360 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.632503 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.632679 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.632801 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.633017 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.633102 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.633314 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.633407 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.633618 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.633703 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.633926 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.634012 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.634235 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.634328 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.634530 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.634615 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.634824 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.634909 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.635125 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.635220 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.635414 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.635498 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.635705 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.635790 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.635996 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.636081 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.636309 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.636396 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.636598 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.636682 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.636888 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.636973 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.637179 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.637263 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.637465 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.637549 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.637755 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.637848 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.638044 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.638129 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.638353 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.638448 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.638643 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.638738 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.638937 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.639021 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.639233 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.639326 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.639524 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.639608 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.639818 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.639903 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.640110 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.640228 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.640461 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.640547 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.640755 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.640848 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.641069 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.641162 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.641368 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.641452 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.641672 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.641755 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.641978 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.642065 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.642281 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.642364 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.642582 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.642678 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.642884 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.642969 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.643182 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.643274 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.643487 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.643571 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.643786 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.643870 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.644083 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.644253 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.644411 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.644624 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.644725 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.644945 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.645039 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.645251 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.645492 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.645587 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.645808 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.645893 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.646112 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.646206 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.646413 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.646508 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.646712 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.646805 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.647013 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.647108 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.647311 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.647404 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.647609 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.647692 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.647906 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.647991 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.648227 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.648318 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.648580 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.648671 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.648907 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.649122 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.649217 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.649446 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.649532 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.649760 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.649846 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.650083 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.650177 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.650390 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.650477 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.650695 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.650779 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.650999 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.651092 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.651301 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.651386 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.651609 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.651694 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.651917 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.652004 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.652236 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.652322 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.652538 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.652669 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.652842 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.652928 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.653145 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.653237 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.653448 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.653543 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.653744 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.653863 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.654045 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.654139 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.654346 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.654440 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.654643 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.654729 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.654941 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.655028 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.655242 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.655329 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.655544 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.655630 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.655850 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.655941 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.656182 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.656272 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.656488 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.656692 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.656778 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.657001 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.657098 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.657324 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.657418 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.657640 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.657860 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.657954 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.658164 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.658251 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.658483 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.658578 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.658794 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.658893 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.659105 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.659190 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.659406 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.659490 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.659706 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.659802 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.660009 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.660101 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.660325 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.660421 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.660620 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.660720 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.660919 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.661005 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.661212 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.661296 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.661501 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.661586 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.661807 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.661892 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.662106 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.662332 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.662434 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.662671 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.662799 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.662975 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.663059 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.663291 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.663498 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.663611 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.663831 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.663925 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.664182 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.664279 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.664500 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.664594 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.664815 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.664901 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.665120 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.665219 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.665424 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.665560 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.665724 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.665816 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.666016 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.666119 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.666311 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.666399 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.666612 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.666697 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.666912 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.667022 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.667204 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.667291 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.667497 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.667582 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.667791 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.667889 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.668084 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.668188 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.668402 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.668510 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.668701 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.668800 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.668991 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.669087 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.669294 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.669389 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.669586 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.669681 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.669880 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.669975 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.670173 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.670276 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.670473 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.670574 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.670761 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.670846 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.671054 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.671139 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.671347 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.671434 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.671639 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.671724 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.671936 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.672034 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.672250 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.672352 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.672546 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.672640 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.672840 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.672940 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.673139 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.673226 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.673437 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.673524 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.673743 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.673837 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.674053 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.674139 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.674357 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.674449 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.674646 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.674741 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.674939 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.675024 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.675241 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.675326 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.675540 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.675635 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.675849 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.675934 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.676170 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.676402 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.676502 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.676728 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.676814 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.677041 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.677126 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.677368 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.677585 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.677693 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.677903 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.677988 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.678214 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.678299 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.678538 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.678636 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.678854 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.678949 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.679152 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.679247 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.679446 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.679532 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.679788 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.679885 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.680093 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.680204 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.680416 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.680501 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.680714 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.680799 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.681014 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.681114 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.681313 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.681405 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.681610 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.681694 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.681905 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.681990 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.682202 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.682285 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.682497 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.682590 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.682794 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.682879 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.683089 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.683173 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.683390 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.683474 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.683687 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.683774 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.683983 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.684068 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.684305 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.684418 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.684610 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.684705 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.684917 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.685002 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.685218 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.685312 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.685520 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.685607 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.685819 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.685906 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.686119 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.686213 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.686417 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.686502 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.686719 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.686804 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.687019 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.687106 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.687313 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.687404 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.687612 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.687697 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.687932 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.688020 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.688258 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.688350 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.688559 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.688673 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.688916 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.689014 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.689229 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.689326 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.689541 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.689652 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.689851 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.689946 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.690152 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.690257 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.690469 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.690570 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.690766 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.690865 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.691058 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.691156 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.691366 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.691464 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.691668 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.691754 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.691967 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.692054 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.692286 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.692390 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.692584 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.692671 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.692885 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.692971 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.693194 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.693289 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.693492 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.693577 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.693785 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.693872 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.694079 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.694167 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.694384 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.694492 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.694677 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.694771 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.694970 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.695056 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.695280 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.695367 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.695592 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.695688 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.695871 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.695973 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.696179 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.696283 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.696473 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.696570 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.696767 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.696852 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.697060 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.697145 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.697351 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.697453 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.697641 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.697727 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.697935 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.698023 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.698227 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.698399 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.698518 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.698614 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.698811 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.698904 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.699104 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.699191 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.699397 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.699484 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.699692 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.699788 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.699983 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.700071 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.700317 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.700406 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.700610 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.700697 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.700929 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.701027 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.701240 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.701335 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.701540 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.701627 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.701849 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.701936 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.702148 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.702236 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.702449 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.702549 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.702746 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.702833 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.703058 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.703152 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.703357 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.703452 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.703656 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.703744 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.703954 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.704039 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.704276 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.704397 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.704578 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.704678 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.704874 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.704962 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.705175 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.705278 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.705476 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.705564 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.705774 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.705863 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.706072 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.706168 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.706380 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.706775 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.707006 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.707094 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.707296 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.707426 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.707601 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.707688 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.707903 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.707989 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.708237 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.708329 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.708542 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.708639 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.708839 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.708933 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.709143 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.709237 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.709438 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.709524 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.709738 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.709838 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.710035 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.710122 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.710330 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.710415 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.710625 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.710724 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.710973 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.711058 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.711274 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.711367 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.711573 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.711661 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.711875 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.711967 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.712201 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.712291 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.712517 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.712604 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.712828 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.712913 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.713124 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.713211 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.713442 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.713533 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.713755 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.713849 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.714057 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.714151 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.714405 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.714507 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.714657 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.714773 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.714895 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 04:39:49.715005 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.715274 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.715571 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.715860 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:39:49.716092 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 04:39:49.866873 n-d-854119-9 devstack@n-api.service[113011]: INFO dbcounter [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Registered counter for database nova_api Aug 29 04:39:49.867597 n-d-854119-9 devstack@n-api.service[113010]: INFO dbcounter [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Registered counter for database nova_api Aug 29 04:39:49.887683 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_db.sqlalchemy.engines [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:39:49.889416 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_db.sqlalchemy.engines [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:39:49.896406 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writer thread running {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:39:49.896849 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writer thread running {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:39:49.951772 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.context [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) {{(pid=113010) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 04:39:49.951980 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.context [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) {{(pid=113011) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 04:39:49.955635 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:39:49.955813 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_concurrency.lockutils [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:39:49.956109 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:39:49.956288 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_concurrency.lockutils [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:39:49.958016 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:39:49.958152 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_concurrency.lockutils [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:39:49.958713 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:39:49.958862 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_concurrency.lockutils [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:39:49.959141 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:39:49.959275 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_concurrency.lockutils [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:39:49.961171 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:39:49.961306 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_concurrency.lockutils [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:39:49.963122 n-d-854119-9 devstack@n-api.service[113011]: INFO dbcounter [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Registered counter for database nova_cell0 Aug 29 04:39:49.963249 n-d-854119-9 devstack@n-api.service[113010]: INFO dbcounter [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Registered counter for database nova_cell0 Aug 29 04:39:49.967213 n-d-854119-9 devstack@n-api.service[113010]: INFO dbcounter [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Registered counter for database nova_cell1 Aug 29 04:39:49.967343 n-d-854119-9 devstack@n-api.service[113011]: INFO dbcounter [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Registered counter for database nova_cell1 Aug 29 04:39:49.974455 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_db.sqlalchemy.engines [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:39:49.976930 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_db.sqlalchemy.engines [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:39:49.978723 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_db.sqlalchemy.engines [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:39:49.981983 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writer thread running {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:39:49.982603 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_db.sqlalchemy.engines [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:39:49.983782 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writer thread running {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:39:49.987002 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writer thread running {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:39:50.118509 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writer thread running {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:39:50.127411 n-d-854119-9 devstack@n-api.service[113011]: INFO dbcounter [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Registered counter for database nova_cell0 Aug 29 04:39:50.127549 n-d-854119-9 devstack@n-api.service[113010]: INFO dbcounter [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Registered counter for database nova_cell0 Aug 29 04:39:50.135685 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_db.sqlalchemy.engines [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:39:50.139194 n-d-854119-9 devstack@n-api.service[113010]: DEBUG oslo_db.sqlalchemy.engines [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:39:50.140440 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writer thread running {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:39:50.146640 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writer thread running {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:39:50.473437 n-d-854119-9 devstack@n-api.service[113010]: WARNING keystonemiddleware.auth_token [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 04:39:50.474775 n-d-854119-9 devstack@n-api.service[113011]: WARNING keystonemiddleware.auth_token [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 04:39:50.480878 n-d-854119-9 devstack@n-api.service[113010]: WARNING keystonemiddleware.auth_token [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 04:39:50.481995 n-d-854119-9 devstack@n-api.service[113011]: WARNING keystonemiddleware.auth_token [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 04:39:50.817920 n-d-854119-9 devstack@n-api.service[113011]: WARNING keystonemiddleware.auth_token [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 04:39:50.818128 n-d-854119-9 devstack@n-api.service[113010]: WARNING keystonemiddleware.auth_token [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 04:39:50.823787 n-d-854119-9 devstack@n-api.service[113010]: WARNING keystonemiddleware.auth_token [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 04:39:50.823919 n-d-854119-9 devstack@n-api.service[113011]: WARNING keystonemiddleware.auth_token [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 04:39:50.829059 n-d-854119-9 devstack@n-api.service[113010]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558cd91e59c0 pid: 113010 (default app) Aug 29 04:39:50.829215 n-d-854119-9 devstack@n-api.service[113011]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558cd91e59c0 pid: 113011 (default app) Aug 29 04:39:50.831163 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:39:50.832706 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-bc1d98b7-76e0-4812-acc9-005469911d3a None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002095 Aug 29 04:39:50.833111 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Aug 29 04:39:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:08.558463 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:08.560616 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002896 Aug 29 04:41:08.561519 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:08.573611 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writing DB stats nova_api:SELECT=3 {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:41:08.574762 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writing DB stats nova_cell1:SELECT=3 {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:41:08.575709 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writing DB stats nova_cell0:SELECT=3 {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:41:08.576760 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:41:09.436778 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-bf0a3a19-8ab3-4029-a1c6-99ed99298e73 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:09.476361 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-bf0a3a19-8ab3-4029-a1c6-99ed99298e73 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.908241 Aug 29 04:41:09.477262 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 04:41:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:41:11.808016 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:11.809017 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-e13093f1-8b52-4075-987d-3fa889c35c01 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 29 04:41:11.809614 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:12.257713 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-1ce4f286-4346-4884-8ccb-83fa1574ea60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "swap": 0, "disk": 1}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:12.306073 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-1ce4f286-4346-4884-8ccb-83fa1574ea60 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490481 Aug 29 04:41:12.306630 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 04:41:12.320830 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writing DB stats nova_api:SELECT=3 {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:41:12.321666 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writing DB stats nova_cell0:SELECT=3 {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:41:12.322930 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writing DB stats nova_cell1:SELECT=3 {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:41:12.324206 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:41:12.525517 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-65b4e99a-d137-45f9-901d-32e7488a228e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:12.590845 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-65b4e99a-d137-45f9-901d-32e7488a228e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.275572 Aug 29 04:41:12.591730 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 04:41:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:41:14.969998 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-1ce4f286-4346-4884-8ccb-83fa1574ea60 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:14.971676 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-1ce4f286-4346-4884-8ccb-83fa1574ea60 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002211 Aug 29 04:41:14.972264 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:41:15.682897 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-69c0afdd-7504-464e-b091-3a8f152230fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "name": "ds512M"}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:15.722933 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-69c0afdd-7504-464e-b091-3a8f152230fe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.744178 Aug 29 04:41:15.724515 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:41:15.736550 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-265e1d57-3226-4e77-93df-c6db3c0bdc03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:15.795288 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-265e1d57-3226-4e77-93df-c6db3c0bdc03 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062373 Aug 29 04:41:15.803275 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 04:41:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:41:18.472045 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-69c0afdd-7504-464e-b091-3a8f152230fe admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:18.473903 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-69c0afdd-7504-464e-b091-3a8f152230fe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002376 Aug 29 04:41:18.475969 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:18.971955 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-52b36a3b-0619-46c3-aeba-26a2be725471 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:18.996388 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-52b36a3b-0619-46c3-aeba-26a2be725471 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514374 Aug 29 04:41:19.006162 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 04:41:19.012048 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-06c6856d-f46c-43fc-b9ed-f775dc0d381e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:19.049658 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-06c6856d-f46c-43fc-b9ed-f775dc0d381e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041413 Aug 29 04:41:19.061278 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 04:41:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:41:21.531788 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-52b36a3b-0619-46c3-aeba-26a2be725471 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:21.533851 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-52b36a3b-0619-46c3-aeba-26a2be725471 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002521 Aug 29 04:41:21.545772 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:21 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:21.953694 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-ab3fa011-9b58-45ac-9f59-5b1e913d0aaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "d3"}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:21.975792 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-ab3fa011-9b58-45ac-9f59-5b1e913d0aaf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434522 Aug 29 04:41:21.976365 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:41:21.988699 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-140f5405-eb5f-4595-b6a7-3c4c84e74459 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:22.013878 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-140f5405-eb5f-4595-b6a7-3c4c84e74459 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028875 Aug 29 04:41:22.014441 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 04:41:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:41:24.381069 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-ab3fa011-9b58-45ac-9f59-5b1e913d0aaf admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:24.382071 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-ab3fa011-9b58-45ac-9f59-5b1e913d0aaf admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Aug 29 04:41:24.382630 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:24.934883 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-c45580ac-42e3-4f82-be91-e68f04f4a4cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "swap": 0, "id": "d4", "name": "ds4G"}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:24.961396 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-c45580ac-42e3-4f82-be91-e68f04f4a4cc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.572550 Aug 29 04:41:24.962643 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:41:24.975718 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-1257d42c-577d-4e1b-8e30-3b0f8e27fcaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:25.007894 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-1257d42c-577d-4e1b-8e30-3b0f8e27fcaf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036017 Aug 29 04:41:25.009303 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 29 04:41:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:41:27.390512 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-c45580ac-42e3-4f82-be91-e68f04f4a4cc admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:27.391511 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-c45580ac-42e3-4f82-be91-e68f04f4a4cc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 29 04:41:27.404310 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:27.846515 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-2937d248-beed-424b-9036-a5165fa44950 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:27.876870 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-2937d248-beed-424b-9036-a5165fa44950 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.478163 Aug 29 04:41:27.877604 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 04:41:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:41:30.405735 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-c45580ac-42e3-4f82-be91-e68f04f4a4cc admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:30.406729 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-c45580ac-42e3-4f82-be91-e68f04f4a4cc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 29 04:41:30.407130 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:30.850690 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-ea592e75-c53d-4fe2-93a6-004fece0cf1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "name": "m1.tiny", "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:30.871720 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-ea592e75-c53d-4fe2-93a6-004fece0cf1c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.457783 Aug 29 04:41:30.872318 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:41:30.887651 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-f338b897-6aaf-4cd2-bf25-ffd297d04081 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:30.919087 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-f338b897-6aaf-4cd2-bf25-ffd297d04081 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036305 Aug 29 04:41:30.919938 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 04:41:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:41:33.353086 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-ea592e75-c53d-4fe2-93a6-004fece0cf1c admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:33.354134 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-ea592e75-c53d-4fe2-93a6-004fece0cf1c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 29 04:41:33.354538 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:33.760632 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-942b6f8e-8981-4ab6-bc0f-2cc8dd3cffa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "vcpus": 1, "id": "2"}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:33.780541 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-942b6f8e-8981-4ab6-bc0f-2cc8dd3cffa5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419418 Aug 29 04:41:33.781201 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:41:33.793250 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-9cbda4a4-ee52-4c81-8bc5-c1de70037114 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:33.818611 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-9cbda4a4-ee52-4c81-8bc5-c1de70037114 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029030 Aug 29 04:41:33.819195 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 04:41:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:41:36.196433 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-942b6f8e-8981-4ab6-bc0f-2cc8dd3cffa5 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:36.197448 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-942b6f8e-8981-4ab6-bc0f-2cc8dd3cffa5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 29 04:41:36.197869 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:36.626085 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-916d7300-9366-4a2d-bf01-d0f0903eaf4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:36.646827 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-916d7300-9366-4a2d-bf01-d0f0903eaf4e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.442719 Aug 29 04:41:36.647461 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:41:36.659588 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-19f19d2e-90b1-4846-8a59-273f2260c630 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:36.685618 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-19f19d2e-90b1-4846-8a59-273f2260c630 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029883 Aug 29 04:41:36.686188 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 04:41:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:41:39.018621 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-916d7300-9366-4a2d-bf01-d0f0903eaf4e admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:39.020468 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-916d7300-9366-4a2d-bf01-d0f0903eaf4e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002260 Aug 29 04:41:39.020959 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:39.426078 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-60e6d7de-f893-4b39-b8a6-c6eca65e7ab9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "id": "4", "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:39.433090 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:41:39.453764 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-60e6d7de-f893-4b39-b8a6-c6eca65e7ab9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.426682 Aug 29 04:41:39.454676 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 04:41:39.466710 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-cedecea8-e4de-426c-8c04-40a9c5f962c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:39.491107 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-cedecea8-e4de-426c-8c04-40a9c5f962c1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028065 Aug 29 04:41:39.491670 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 04:41:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:41:41.822820 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-60e6d7de-f893-4b39-b8a6-c6eca65e7ab9 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:41:41.823854 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-60e6d7de-f893-4b39-b8a6-c6eca65e7ab9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 29 04:41:41.824291 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:41:42.262229 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-bd0d7418-8013-404a-a614-72b4186f6507 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "disk": 160, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:42.283477 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-bd0d7418-8013-404a-a614-72b4186f6507 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.450039 Aug 29 04:41:42.284402 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 29 04:41:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 04:41:42.297713 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-93ab078a-0c33-4e9f-9b00-f54fc5b58516 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:41:42.325481 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-93ab078a-0c33-4e9f-9b00-f54fc5b58516 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032219 Aug 29 04:41:42.326038 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 29 04:41:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:42:04.746936 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-bd0d7418-8013-404a-a614-72b4186f6507 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:04.748494 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-bd0d7418-8013-404a-a614-72b4186f6507 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 Aug 29 04:42:04.749020 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:42:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:42:04.765221 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:42:05.172608 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-d80c7cbf-59c5-45c1-95fc-fba81e41c2bd admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:05.190627 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-d80c7cbf-59c5-45c1-95fc-fba81e41c2bd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.432053 Aug 29 04:42:05.191186 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 04:42:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:42:06.270157 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-bd0d7418-8013-404a-a614-72b4186f6507 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:06.271669 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-bd0d7418-8013-404a-a614-72b4186f6507 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002403 Aug 29 04:42:06.272232 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:42:06.863388 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-a4dc8002-3dbb-4eba-8e29-a067635c92d0 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:06.869371 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.wsgi [None req-a4dc8002-3dbb-4eba-8e29-a067635c92d0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-a4dc8002-3dbb-4eba-8e29-a067635c92d0 admin admin] Request method failure captured: Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: Accept: application/json Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: Accept-Encoding: gzip, deflate Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: Connection: keep-alive Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: Content-Length: 0 Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: Host: 10.222.0.20 Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: Openstack-Api-Version: compute 2.90 Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: Openstack-System-Scope: None Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: User-Agent: python-novaclient Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Auth-Token: gAAAAABjDEOeyQgJk9ZfCZnXO3saf97_9gRAjiTZqm_SBAMdAIpKTXpWRzjQXgDl1Y0hgWd76rqB0A2RNisK_i9yi_FBFdzg_jAmRXjfnHZb3YIn3kJf8_gFwDGSsZH0HdDLyPNtjuy3JZ-lyMyMqhQdfsHZR1rXNwhUPx_ospd_MiQUD5xk2HY Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Domain-Id: None Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Domain-Name: None Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Identity-Status: Confirmed Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Is-Admin-Project: True Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Domain-Id: default Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Domain-Name: Default Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Name: admin Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Role: admin,member,reader Aug 29 04:42:06.872661 n-d-854119-9 devstack@n-api.service[113010]: X-Roles: admin,member,reader Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_643a5aac6eae4cc88aa00e62d3b10d35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: X-Tenant: admin Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: X-Tenant-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: X-Tenant-Name: admin Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: X-User: admin Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: X-User-Domain-Id: default Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: X-User-Domain-Name: Default Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: X-User-Id: be42dc73ca814646a4084da41b25871b Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: X-User-Name: admin Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: method: > Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: exception: Flavor 42 could not be found. Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: action_args: {'id': '42'} Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:42:06.874335 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:06.875284 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.876424 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-a4dc8002-3dbb-4eba-8e29-a067635c92d0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:42:06.877464 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-a4dc8002-3dbb-4eba-8e29-a067635c92d0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.437586 Aug 29 04:42:06.877464 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 29 04:42:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:42:06.884217 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-4a274e15-f220-4e73-b1e6-1d270f6cb5a5 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:06.888664 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:42:06.909350 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-4a274e15-f220-4e73-b1e6-1d270f6cb5a5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028654 Aug 29 04:42:06.909938 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 04:42:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:42:06.936478 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-d1133b57-3c24-4bf7-a59f-3a3e3c2fecfd admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:06.959706 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-d1133b57-3c24-4bf7-a59f-3a3e3c2fecfd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026908 Aug 29 04:42:06.960256 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 04:42:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:42:06.970846 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-64a39d79-0bf3-4c79-84d9-c3721a62f1b3 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:06.977258 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.wsgi [None req-64a39d79-0bf3-4c79-84d9-c3721a62f1b3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-64a39d79-0bf3-4c79-84d9-c3721a62f1b3 admin admin] Request method failure captured: Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: Accept: application/json Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: Accept-Encoding: gzip, deflate Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: Connection: keep-alive Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: Content-Length: 0 Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: Host: 10.222.0.20 Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: Openstack-Api-Version: compute 2.90 Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: Openstack-System-Scope: None Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: User-Agent: python-novaclient Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Auth-Token: gAAAAABjDEOeyQgJk9ZfCZnXO3saf97_9gRAjiTZqm_SBAMdAIpKTXpWRzjQXgDl1Y0hgWd76rqB0A2RNisK_i9yi_FBFdzg_jAmRXjfnHZb3YIn3kJf8_gFwDGSsZH0HdDLyPNtjuy3JZ-lyMyMqhQdfsHZR1rXNwhUPx_ospd_MiQUD5xk2HY Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Domain-Id: None Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Domain-Name: None Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Identity-Status: Confirmed Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Is-Admin-Project: True Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Domain-Id: default Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Domain-Name: Default Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Name: admin Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Role: admin,member,reader Aug 29 04:42:06.980612 n-d-854119-9 devstack@n-api.service[113011]: X-Roles: admin,member,reader Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_643a5aac6eae4cc88aa00e62d3b10d35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: X-Tenant: admin Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: X-Tenant-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: X-Tenant-Name: admin Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: X-User: admin Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: X-User-Domain-Id: default Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: X-User-Domain-Name: Default Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: X-User-Id: be42dc73ca814646a4084da41b25871b Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: X-User-Name: admin Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: method: > Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: exception: Flavor 42 could not be found. Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: action_args: {'id': '42'} Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:42:06.982069 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:06.983077 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:06.984407 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-64a39d79-0bf3-4c79-84d9-c3721a62f1b3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:42:06.985421 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-64a39d79-0bf3-4c79-84d9-c3721a62f1b3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015318 Aug 29 04:42:06.985421 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 29 04:42:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:42:07.951486 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-d1133b57-3c24-4bf7-a59f-3a3e3c2fecfd admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:07.952562 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-d1133b57-3c24-4bf7-a59f-3a3e3c2fecfd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 29 04:42:07.952955 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:42:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:42:08.506378 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-b179b88e-e39d-4d6c-811a-9ce104ce6cc3 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:08.512562 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.wsgi [None req-b179b88e-e39d-4d6c-811a-9ce104ce6cc3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-b179b88e-e39d-4d6c-811a-9ce104ce6cc3 admin admin] Request method failure captured: Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: Accept: application/json Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: Accept-Encoding: gzip, deflate Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: Connection: keep-alive Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: Content-Length: 0 Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: Host: 10.222.0.20 Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: Openstack-Api-Version: compute 2.90 Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: Openstack-System-Scope: None Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: User-Agent: python-novaclient Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Auth-Token: gAAAAABjDEOfK1ivGPIroPUXvHgxfNxjpdBPK3EAT3eCPObrqlSepJS4zlF9M2WNVNS_x68EYodGngfq-u7e_iRDEtdRu87AKrB3vs03uCjcZe9k0-R83qDwie2SmMb_C5TkLLpm2Dhkdrkaj2wjxLe6hG5VxZOfXjL7piUL2KcHaJ-Hr0Ele3Q Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Domain-Id: None Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Domain-Name: None Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Identity-Status: Confirmed Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Is-Admin-Project: True Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Domain-Id: default Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Domain-Name: Default Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Name: admin Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Role: admin,member,reader Aug 29 04:42:08.514083 n-d-854119-9 devstack@n-api.service[113011]: X-Roles: admin,member,reader Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_643a5aac6eae4cc88aa00e62d3b10d35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: X-Tenant: admin Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: X-Tenant-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: X-Tenant-Name: admin Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: X-User: admin Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: X-User-Domain-Id: default Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: X-User-Domain-Name: Default Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: X-User-Id: be42dc73ca814646a4084da41b25871b Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: X-User-Name: admin Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: method: > Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: exception: Flavor 84 could not be found. Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: action_args: {'id': '84'} Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:42:08.515607 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:08.516536 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.517562 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-b179b88e-e39d-4d6c-811a-9ce104ce6cc3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:42:08.518584 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-b179b88e-e39d-4d6c-811a-9ce104ce6cc3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.424225 Aug 29 04:42:08.518584 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 29 04:42:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:42:08.525702 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-0d5a0fe2-2473-4087-8b11-fa31bb1f65d3 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:08.541287 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-0d5a0fe2-2473-4087-8b11-fa31bb1f65d3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019342 Aug 29 04:42:08.541809 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 04:42:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:42:08.551753 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-f1f8449f-9c79-42f9-a3ec-62091a32c06e admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:08.566562 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-f1f8449f-9c79-42f9-a3ec-62091a32c06e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018367 Aug 29 04:42:08.567074 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 04:42:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:42:08.576515 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-524ee5bf-3273-4380-81d9-d76261a04c9b admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:08.582370 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.wsgi [None req-524ee5bf-3273-4380-81d9-d76261a04c9b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-524ee5bf-3273-4380-81d9-d76261a04c9b admin admin] Request method failure captured: Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: Accept: application/json Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: Accept-Encoding: gzip, deflate Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: Connection: keep-alive Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: Content-Length: 0 Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: Host: 10.222.0.20 Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: Openstack-Api-Version: compute 2.90 Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: Openstack-System-Scope: None Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: User-Agent: python-novaclient Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Auth-Token: gAAAAABjDEOfK1ivGPIroPUXvHgxfNxjpdBPK3EAT3eCPObrqlSepJS4zlF9M2WNVNS_x68EYodGngfq-u7e_iRDEtdRu87AKrB3vs03uCjcZe9k0-R83qDwie2SmMb_C5TkLLpm2Dhkdrkaj2wjxLe6hG5VxZOfXjL7piUL2KcHaJ-Hr0Ele3Q Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Domain-Id: None Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Domain-Name: None Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Identity-Status: Confirmed Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Is-Admin-Project: True Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Domain-Id: default Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Domain-Name: Default Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Name: admin Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Role: admin,member,reader Aug 29 04:42:08.583869 n-d-854119-9 devstack@n-api.service[113010]: X-Roles: admin,member,reader Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_643a5aac6eae4cc88aa00e62d3b10d35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: X-Tenant: admin Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: X-Tenant-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: X-Tenant-Name: admin Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: X-User: admin Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: X-User-Domain-Id: default Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: X-User-Domain-Name: Default Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: X-User-Id: be42dc73ca814646a4084da41b25871b Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: X-User-Name: admin Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: method: > Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: exception: Flavor 84 could not be found. Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: action_args: {'id': '84'} Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:42:08.585397 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:08.586269 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:08.587468 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-524ee5bf-3273-4380-81d9-d76261a04c9b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:42:08.588690 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-524ee5bf-3273-4380-81d9-d76261a04c9b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012389 Aug 29 04:42:08.588690 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 29 04:42:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 04:42:09.567985 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-f1f8449f-9c79-42f9-a3ec-62091a32c06e admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:09.569018 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-f1f8449f-9c79-42f9-a3ec-62091a32c06e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 29 04:42:09.569414 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:42:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:42:10.119354 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-19a1acaa-b321-4c69-b516-7002a3ab9505 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:10.125534 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.wsgi [None req-19a1acaa-b321-4c69-b516-7002a3ab9505 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-19a1acaa-b321-4c69-b516-7002a3ab9505 admin admin] Request method failure captured: Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: Accept: application/json Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: Accept-Encoding: gzip, deflate Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: Connection: keep-alive Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: Content-Length: 0 Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: Host: 10.222.0.20 Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: Openstack-Api-Version: compute 2.90 Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: Openstack-System-Scope: None Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: User-Agent: python-novaclient Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Auth-Token: gAAAAABjDEOhNKK3GLBtRscNRIhK-YvfmAFbdJrgmyqo60WaczKDQK4EZGVad24PhBj44Q29M39qYeEwhG9ji8hku5EJIyBgnJXSwUVSTSCSwijyD2S_Yxx5o2qXbxzMsoIR7hPDySyzjDwuMne9aJ1AiyFO0gyIFKXG5mK_wSLGDOsDAk3hUN8 Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Domain-Id: None Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Domain-Name: None Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Identity-Status: Confirmed Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Is-Admin-Project: True Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Domain-Id: default Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Domain-Name: Default Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Project-Name: admin Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Role: admin,member,reader Aug 29 04:42:10.127032 n-d-854119-9 devstack@n-api.service[113010]: X-Roles: admin,member,reader Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_643a5aac6eae4cc88aa00e62d3b10d35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: X-Tenant: admin Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: X-Tenant-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: X-Tenant-Name: admin Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: X-User: admin Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: X-User-Domain-Id: default Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: X-User-Domain-Name: Default Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: X-User-Id: be42dc73ca814646a4084da41b25871b Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: X-User-Name: admin Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: method: > Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: exception: Flavor 451 could not be found. Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: action_args: {'id': '451'} Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:42:10.128679 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:10.129496 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.130706 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-19a1acaa-b321-4c69-b516-7002a3ab9505 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:42:10.131852 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-19a1acaa-b321-4c69-b516-7002a3ab9505 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.423701 Aug 29 04:42:10.131852 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 04:42:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:42:10.138318 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-4cbdf578-d195-483f-b398-6a0295025f94 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:10.153460 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-4cbdf578-d195-483f-b398-6a0295025f94 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018800 Aug 29 04:42:10.153982 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 04:42:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:42:10.164734 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:10.179811 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018656 Aug 29 04:42:10.180376 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 29 04:42:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:42:10.189878 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-a2a6c2de-b634-4cec-b367-fa385ef0d4c6 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:10.195503 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.wsgi [None req-a2a6c2de-b634-4cec-b367-fa385ef0d4c6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-a2a6c2de-b634-4cec-b367-fa385ef0d4c6 admin admin] Request method failure captured: Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: Accept: application/json Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: Accept-Encoding: gzip, deflate Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: Connection: keep-alive Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: Content-Length: 0 Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: Host: 10.222.0.20 Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: Openstack-Api-Version: compute 2.90 Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: Openstack-System-Scope: None Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: User-Agent: python-novaclient Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Auth-Token: gAAAAABjDEOhNKK3GLBtRscNRIhK-YvfmAFbdJrgmyqo60WaczKDQK4EZGVad24PhBj44Q29M39qYeEwhG9ji8hku5EJIyBgnJXSwUVSTSCSwijyD2S_Yxx5o2qXbxzMsoIR7hPDySyzjDwuMne9aJ1AiyFO0gyIFKXG5mK_wSLGDOsDAk3hUN8 Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Domain-Id: None Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Domain-Name: None Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Identity-Status: Confirmed Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Is-Admin-Project: True Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Domain-Id: default Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Domain-Name: Default Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Project-Name: admin Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Role: admin,member,reader Aug 29 04:42:10.197028 n-d-854119-9 devstack@n-api.service[113011]: X-Roles: admin,member,reader Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_643a5aac6eae4cc88aa00e62d3b10d35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/643a5aac6eae4cc88aa00e62d3b10d35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: X-Tenant: admin Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: X-Tenant-Id: 643a5aac6eae4cc88aa00e62d3b10d35 Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: X-Tenant-Name: admin Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: X-User: admin Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: X-User-Domain-Id: default Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: X-User-Domain-Name: Default Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: X-User-Id: be42dc73ca814646a4084da41b25871b Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: X-User-Name: admin Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: method: > Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: exception: Flavor 451 could not be found. Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: action_args: {'id': '451'} Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:42:10.198465 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:10.199654 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: ERROR nova.api.openstack.wsgi Aug 29 04:42:10.200899 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-a2a6c2de-b634-4cec-b367-fa385ef0d4c6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:42:10.202077 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-a2a6c2de-b634-4cec-b367-fa385ef0d4c6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012154 Aug 29 04:42:10.202077 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 04:42:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:42:11.190657 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:11.191667 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 29 04:42:11.192062 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:42:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:42:11.759539 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-5ab87299-8a9a-4d74-8007-098be5aae914 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:42:11.781363 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-5ab87299-8a9a-4d74-8007-098be5aae914 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.453970 Aug 29 04:42:11.781919 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 29 04:42:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:42:12.757608 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:12.758610 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 29 04:42:12.759043 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:42:13.427462 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-8bc3360c-9d3c-4a26-a5fb-1cf9192c829d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:42:13.447856 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-8bc3360c-9d3c-4a26-a5fb-1cf9192c829d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.548836 Aug 29 04:42:13.448421 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 29 04:42:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:42:14.425401 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:14.426431 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 29 04:42:14.426831 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:42:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:42:14.983996 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-146ef348-6343-448e-bc3b-62d65c94b6e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:42:15.009702 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-146ef348-6343-448e-bc3b-62d65c94b6e9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.446705 Aug 29 04:42:15.010438 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 29 04:42:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:42:15.998588 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:15.999614 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 29 04:42:15.999994 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:42:16.565822 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-20586b41-c9f9-4ea6-896e-505dbe0508a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:42:16.586072 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-20586b41-c9f9-4ea6-896e-505dbe0508a8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.447634 Aug 29 04:42:16.586633 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 29 04:42:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:42:17.575444 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:17.576520 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 29 04:42:17.576907 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:42:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:42:18.158547 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-9ec42264-a10c-4f44-a270-1e40b14317e8 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:42:18.179802 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-9ec42264-a10c-4f44-a270-1e40b14317e8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.464538 Aug 29 04:42:18.180353 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Aug 29 04:42:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:43:11.823701 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:43:11.825288 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-27c6c1c3-da2d-496e-88e9-7fa2aa0f64c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002331 Aug 29 04:43:11.826010 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 29 04:43:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:43:11.842714 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:43:12.273012 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-c13f7790-59d1-401c-b29d-2f3c75f53320 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:43:12.299440 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-c13f7790-59d1-401c-b29d-2f3c75f53320 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.463703 Aug 29 04:43:12.299981 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 04:43:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:43:12.322810 n-d-854119-9 devstack@n-api.service[113010]: DEBUG dbcounter [-] [113010] Writing DB stats nova_api:SELECT=14 {{(pid=113010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:43:12.329160 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-d331e683-f1d4-4f56-9e2f-1ba366ad8499 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:43:12.341236 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-d331e683-f1d4-4f56-9e2f-1ba366ad8499 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020535 Aug 29 04:43:12.342013 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Aug 29 04:43:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:43:12.354343 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-31822e02-2158-4e9e-8828-cfd9a4c0c029 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:43:12.362304 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-31822e02-2158-4e9e-8828-cfd9a4c0c029 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011540 Aug 29 04:43:12.362746 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Aug 29 04:43:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:43:12.374570 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-6f7b2531-bf71-43b9-b738-2ee12475cf12 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:43:12.382586 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-6f7b2531-bf71-43b9-b738-2ee12475cf12 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011625 Aug 29 04:43:12.383144 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Aug 29 04:43:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:43:12.394917 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-3ad46ff5-b825-456c-bb8d-3d6b12e14911 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:43:12.402964 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-3ad46ff5-b825-456c-bb8d-3d6b12e14911 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011734 Aug 29 04:43:12.403478 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Aug 29 04:43:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:48:38.840148 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-6f7b2531-bf71-43b9-b738-2ee12475cf12 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:48:38.840818 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-6f7b2531-bf71-43b9-b738-2ee12475cf12 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 29 04:48:38.841262 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:48:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:48:38.979582 n-d-854119-9 devstack@n-api.service[113011]: DEBUG dbcounter [-] [113011] Writing DB stats nova_api:SELECT=6 {{(pid=113011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:48:39.134361 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-77fcf245-f7da-4872-b2e1-759b5ae252ce admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:48:39.137792 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-77fcf245-f7da-4872-b2e1-759b5ae252ce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:48:39.138258 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-77fcf245-f7da-4872-b2e1-759b5ae252ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:48:39.138669 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-77fcf245-f7da-4872-b2e1-759b5ae252ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:48:39.139372 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-77fcf245-f7da-4872-b2e1-759b5ae252ce admin admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:48:39.139801 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-77fcf245-f7da-4872-b2e1-759b5ae252ce admin admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:48:39.140217 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-77fcf245-f7da-4872-b2e1-759b5ae252ce admin admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:48:39.181372 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-77fcf245-f7da-4872-b2e1-759b5ae252ce admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.203294 Aug 29 04:48:39.181939 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 04:48:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:48:40.025090 n-d-854119-9 devstack@n-api.service[113010]: DEBUG nova.api.openstack.wsgi [None req-6f7b2531-bf71-43b9-b738-2ee12475cf12 admin admin] Calling method '>' {{(pid=113010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:48:40.026113 n-d-854119-9 devstack@n-api.service[113010]: INFO nova.api.openstack.requestlog [None req-6f7b2531-bf71-43b9-b738-2ee12475cf12 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 29 04:48:40.026577 n-d-854119-9 devstack@n-api.service[113010]: [pid: 113010|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 29 04:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:48:40.237590 n-d-854119-9 devstack@n-api.service[113011]: DEBUG nova.api.openstack.wsgi [None req-0ceb9969-270f-4636-ae48-02cb755e1a78 admin admin] Calling method '>' {{(pid=113011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:48:40.241109 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-0ceb9969-270f-4636-ae48-02cb755e1a78 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:48:40.241589 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-0ceb9969-270f-4636-ae48-02cb755e1a78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:48:40.242023 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-0ceb9969-270f-4636-ae48-02cb755e1a78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:48:40.243264 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-0ceb9969-270f-4636-ae48-02cb755e1a78 admin admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:48:40.243804 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-0ceb9969-270f-4636-ae48-02cb755e1a78 admin admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:48:40.244255 n-d-854119-9 devstack@n-api.service[113011]: DEBUG oslo_concurrency.lockutils [None req-0ceb9969-270f-4636-ae48-02cb755e1a78 admin admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:48:40.266766 n-d-854119-9 devstack@n-api.service[113011]: INFO nova.api.openstack.requestlog [None req-0ceb9969-270f-4636-ae48-02cb755e1a78 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.101859 Aug 29 04:48:40.267313 n-d-854119-9 devstack@n-api.service[113011]: [pid: 113011|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 04:48:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:49:24.540745 n-d-854119-9 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 04:49:24.541304 n-d-854119-9 devstack@n-api.service[113009]: Mon Aug 29 04:49:24 2022 - graceful shutdown triggered... Aug 29 04:49:24.541788 n-d-854119-9 devstack@n-api.service[113010]: Gracefully killing worker 1 (pid: 113010)... Aug 29 04:49:24.542251 n-d-854119-9 devstack@n-api.service[113011]: Gracefully killing worker 2 (pid: 113011)... Aug 29 04:49:25.542552 n-d-854119-9 devstack@n-api.service[113009]: worker 1 buried after 1 seconds Aug 29 04:49:25.542552 n-d-854119-9 devstack@n-api.service[113009]: worker 2 buried after 1 seconds Aug 29 04:49:25.542552 n-d-854119-9 devstack@n-api.service[113009]: goodbye to uWSGI. Aug 29 04:49:25.545375 n-d-854119-9 systemd[1]: devstack@n-api.service: Succeeded. Aug 29 04:49:25.546852 n-d-854119-9 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 04:49:25.552006 n-d-854119-9 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 04:49:25.576835 n-d-854119-9 devstack@n-api.service[128864]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 04:49:25 2022] *** Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: nodename: n-d-854119-9 Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: machine: x86_64 Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: clock source: unix Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: pcre jit disabled Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: detected number of CPU cores: 4 Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: current working directory: / Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: detected binary path: /usr/bin/uwsgi-core Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: your processes number limit is 47680 Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: your memory page size is 4096 bytes Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: detected max file descriptor number: 2048 Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: lock engine: pthread robust mutexes Aug 29 04:49:25.597205 n-d-854119-9 devstack@n-api.service[128864]: thunder lock: enabled Aug 29 04:49:25.598151 n-d-854119-9 devstack@n-api.service[128864]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 04:49:25.598151 n-d-854119-9 devstack@n-api.service[128864]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 04:49:25.635956 n-d-854119-9 devstack@n-api.service[128864]: Python main interpreter initialized at 0x555ecf17d9c0 Aug 29 04:49:25.635956 n-d-854119-9 devstack@n-api.service[128864]: python threads support enabled Aug 29 04:49:25.635956 n-d-854119-9 devstack@n-api.service[128864]: your server socket listen backlog is limited to 100 connections Aug 29 04:49:25.635956 n-d-854119-9 devstack@n-api.service[128864]: your mercy for graceful operations on workers is 90 seconds Aug 29 04:49:25.636501 n-d-854119-9 devstack@n-api.service[128864]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 04:49:25.636501 n-d-854119-9 devstack@n-api.service[128864]: *** Operational MODE: preforking *** Aug 29 04:49:25.636711 n-d-854119-9 devstack@n-api.service[128864]: *** uWSGI is running in multiple interpreter mode *** Aug 29 04:49:25.636711 n-d-854119-9 devstack@n-api.service[128864]: spawned uWSGI master process (pid: 128864) Aug 29 04:49:25.636837 n-d-854119-9 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 04:49:25.640157 n-d-854119-9 devstack@n-api.service[128864]: spawned uWSGI worker 1 (pid: 128871, cores: 1) Aug 29 04:49:25.640157 n-d-854119-9 devstack@n-api.service[128864]: spawned uWSGI worker 2 (pid: 128872, cores: 1) Aug 29 04:49:25.640157 n-d-854119-9 devstack@n-api.service[128864]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 04:49:26.288485 n-d-854119-9 devstack@n-api.service[128872]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 04:49:26.289116 n-d-854119-9 devstack@n-api.service[128871]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 04:49:27.417597 n-d-854119-9 devstack@n-api.service[128872]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 04:49:27.417597 n-d-854119-9 devstack@n-api.service[128872]: from cryptography.utils import int_from_bytes Aug 29 04:49:27.418303 n-d-854119-9 devstack@n-api.service[128872]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 04:49:27.418303 n-d-854119-9 devstack@n-api.service[128872]: from cryptography.utils import int_from_bytes Aug 29 04:49:27.420060 n-d-854119-9 devstack@n-api.service[128871]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 04:49:27.420060 n-d-854119-9 devstack@n-api.service[128871]: from cryptography.utils import int_from_bytes Aug 29 04:49:27.420579 n-d-854119-9 devstack@n-api.service[128871]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 04:49:27.420579 n-d-854119-9 devstack@n-api.service[128871]: from cryptography.utils import int_from_bytes Aug 29 04:49:29.812160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 04:49:29.812757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 04:49:29.812944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 04:49:29.813051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 04:49:29.813412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 04:49:29.813501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 04:49:29.813577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 04:49:29.813732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 04:49:29.813929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.814080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 04:49:29.814246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.814387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 04:49:29.814571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.814710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.814893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.815005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.815318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.815415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.815610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.815728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.815960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.816086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.816304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.816409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.816630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.816741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.816879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.816979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.817200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.817329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.817529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854119-9 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.817642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.817824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.817921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.818149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.818246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854119-9 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.818459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.818559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.818759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.818862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.819054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.819180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.819342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.819445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.819653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.819757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.819965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.820188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.820319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.820644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.820796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.820927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.821104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.821214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.821389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.821708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.821819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.821903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.821993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.822139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.822299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.822475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.822610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.822781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.822916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.823096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.823238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.823396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.823500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.823787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.823885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854119-9 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.824149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.824257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854119-9 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.824442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.824597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.824754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.824891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.825095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.825233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.825455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.825597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.825760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.825894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.826081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.826224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.826395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.826544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.826681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.826809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.827006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.827103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.827315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.827448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.827622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.827735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.827926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.828027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.828262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.828396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.828558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.828663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.828859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.828966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.829155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.829297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.829425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.829562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.829729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.829849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.829989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.830098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.830261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.830364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.830561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.830677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.831189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.831294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.831504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.831616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.831746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.831851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.831998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.832095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.832337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.832446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.832696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.832854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.832995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.833135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.833266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.833407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.833545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.833673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.833802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.833935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.834072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.834172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.834391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.834486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.834690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.834794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.834987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.835107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.835276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.835393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.835599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.835726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.835905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.836072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.836316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.836447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.836575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.836712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.836859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.836998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.837127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.837262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.837418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.837536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.837721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.837846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.838053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.838152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.838354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.838463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.838650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.838765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.838962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.839068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.839264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.839368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.839563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.839658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.839913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.840011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.840235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.840348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.840549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.840655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.840871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.840998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.841097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.841270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.841367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.841462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.841688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.841835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.841976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.842088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.842286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.842381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.842581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.842683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.842869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.842986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.843163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.843259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.843456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.843551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.843755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.843860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.844049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.844251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.844421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.844519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.844672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.844775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.844959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.845064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.845254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.845360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.845553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.845649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.845849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.845953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.846145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.846242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.846451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.846597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.846774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.847073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.847177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.847377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.847484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.847668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.847783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.847972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.848076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.848315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.848431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.848616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.848714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.848917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.849025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.849219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.849324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.849515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.849619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.849817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.849912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.850115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.850216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.850415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.850512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.850711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.850813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.851007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.851110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.851306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.851411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.851676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.851780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.851877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.851973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.852218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.852315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.852520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.852627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.852816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.852938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.853080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.853168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.853396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.853508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.853693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.853797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.853990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.854126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.854263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.854405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.854544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.854676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.854835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.854978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.855146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.855296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.855519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.855668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.855798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.855934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.856074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.856283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.856438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.856719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.856855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 04:49:29.856983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.857120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.857256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.857381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.857492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.857621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.857757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.857902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.858176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.858319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.858456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.858585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.858720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.858863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.858993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.859120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.859255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.859415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.859562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.859726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.859914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.860042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.860182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.860342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.860487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.860648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.860789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.860960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.861103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.861272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.861411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.861595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.861727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.861910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.862061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.862199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.862315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.862517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.862649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.862821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.862951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.863131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.863272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.863444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.863581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.863755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.863892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.864059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.864259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.864422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.864562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.864835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.865085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.865085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.865341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.865341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.865614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.865909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.866133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.866279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.866498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.866498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.866950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.867162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.867277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.867388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.867512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.867623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.867731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.867848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.867958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.868075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.868433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.868563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.868676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.868813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.868953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.869098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.869229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.869365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.869493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.869630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.869795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.869795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.870068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.870224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.870362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.870501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.870629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.870733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.870819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.870976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.871109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.871281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.871453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.871565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.871779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.871958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.872145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.872278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.872423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.872602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.872735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.872917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.873083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.873226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.873384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.873528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.873651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.873852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.874078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.874212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.874350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.874480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.874661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.874793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.875006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.875347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.875473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.875627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.875718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.875852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.876041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.876223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.876324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.876473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.876578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.876784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.876940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.877093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.877243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.877401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.877501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.877711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.877806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.878012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.878106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.878335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.878495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.878623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.878715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.878923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.879016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.879240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.879332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.879545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.879647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.879844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.879948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.880287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.880413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.880511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.880611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.880802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.880931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.881877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.882061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.882210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.882371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.882525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.882669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.882812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.882955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.883112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.883270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.883414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.883564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.883720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.883864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.884015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.884210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.884377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.884522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.884664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.884812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.884964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.885118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.885306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.885454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.885613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.885758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.885917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.886060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.886203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.886354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.886548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.886548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.886838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.886981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.887084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.887235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.887364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.887505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.887635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.887731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.887818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.887909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.888048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.888232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.888334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.888495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.888625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.888713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.888805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.888909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.889003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.889095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.889180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.889271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.889365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.889589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.889693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.889910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.890011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.890208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.890308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.890831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.890977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.891092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.891203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.891323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.891444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.891564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.891688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.891808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.891929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.892040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.892195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.892351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.892480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.892671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.892799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.892980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.893109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.893292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.893431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.893597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.893729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.893901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.894040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.894202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.894326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.894507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.894640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.894862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.895002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.895131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.895259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.895415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.895554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.895721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.895854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.896035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.896214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.896355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.896499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.896642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.896780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.896967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.897109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.897277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.897418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.898072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.898210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.898339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.898437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.898437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.898663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.898806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.898902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.898990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.899076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.899176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.899267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.899351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.899441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.899627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.899726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.899937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.900037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.900262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.900369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.900574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.900666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.900878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.900980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.901193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.901293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.901496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.901587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.901806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.901912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.902107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.902222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.902435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.902537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.902744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.902835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.903044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.903136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.903348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.903455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.903651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.903749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.903962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.904054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.904291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.904397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.904596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.904689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.904897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.905041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.905193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.905337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.905492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.905633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.905795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.905886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.906098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.906200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.906406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.906496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.906713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.906814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.907014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.907115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.907324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.907427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.907641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.907814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.907960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.908261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.908581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.908886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.909061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.909216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.909377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.909522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.909666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.909826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.909969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.910121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.910274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.910418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.910560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.910701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.910851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.911003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.911144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.911285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.911434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.911585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.911727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.911877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.912031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.912490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.912654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.912811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.912955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.913112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.913255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.913405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.913557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.913708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.913865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.914008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.914158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.914311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.914453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.914603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.914762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.914913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.915064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.915213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.915356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.915504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.915663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.915815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.915958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.916107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.916291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.916434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.916725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.917044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.917630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.917968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.918131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.918288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.918440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.918591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.918744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.918887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.919053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.919211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.919305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.919531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.919638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.919863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.919964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.920205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.920430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.920570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.920771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.920887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.921060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.921171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.921366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.921461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.921670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.921773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.921980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.922282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.922384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.922586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.922693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.922891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.923015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.923199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.923342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.923502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.923663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.923807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.924007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.924108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.924368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.924688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.924830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.924999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.925517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.925674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.925815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.925955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.926095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.926225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.926354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.926492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.926631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.926768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.926898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.927026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.927229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.927369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.927499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.927628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.927756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.927938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.928095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.928328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.928634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.928783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.928926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.929182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.929344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.929527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.929667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.929836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.929978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.930137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.930281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.930458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.930589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.930763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.930903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.931065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.931206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.931372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.931513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.931678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.931811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.932018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.932198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.932334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.932512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.932654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.932835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.932979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.933147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.933302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.933490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.933623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.933811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.933952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.934131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.934272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.934447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.934589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.934805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.934948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.935077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.935212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.935383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.935525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.935671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.935801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.935973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.936104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.936324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.936456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.936632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.936766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.936938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.937078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.937244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.937384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.937547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.937681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.937853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.937995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.938138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.938281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.938451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.938757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.938899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.939038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.939181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.939405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.939537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.939676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.939806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.939936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.940179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.940336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.940522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.940655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.940819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.940958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.941135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.941277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.941436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.941568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.941736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.941869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.942035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.942167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.942350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.942484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.942656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.942798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.942943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.943085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.943259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.943391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.943565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.943706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.943850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.943980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.944212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.944359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.944498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.944638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.944787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.944917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.945046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.945174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.945332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.945480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.945653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.945785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.945967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.946100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.946275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.946422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.946582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.946721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.946881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.947011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.947179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.947327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.947465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.947602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.947769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.947988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.948153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.948298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.948430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.948558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.948695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.948938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.949126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.949287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.949509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.949650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.949788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.949928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.950125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.950259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.950436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.950578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.950756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.950887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.951079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.951213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.951383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.951514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.951698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.951827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.952015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.952168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.952346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.952486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.952662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.952810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.952975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.953106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.953292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.953434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.953625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.953763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.953910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.954037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.954236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.954367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.954550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.954686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.954993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.955122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.955298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.955432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.955599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.956047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.956265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.956395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.956571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.956690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.956877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.957004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.957192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.957442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.957568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.957764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.957893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.958084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.958219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.958383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.958509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.958686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.958944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.959079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.959294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.959420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.959624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.959764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.959886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.960013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.960186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.960328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.960488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.960664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.960923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.961077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.961220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.961358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.961489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.961651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.961798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.961949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.962093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.962237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.962380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.962531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.962695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.962851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.963003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.963148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.963290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.963440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.963593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.963737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.963882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.964022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.964279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.964438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.964582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.964774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.964976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.965128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.965286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.965431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.965575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.965717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.965934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.966095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.966254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.966420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.966576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.966721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.966874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.967028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.967187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.967330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.967495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.967653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.967798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.967995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.968275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.968427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.968571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.968721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.968872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.969121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.969279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.969434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.969733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.969901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.970046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.970200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.970344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.970487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.970630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.970815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.970965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.971197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.971361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.971598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.971758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.971913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.972072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.972265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.972419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.972574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.972725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.972960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.973123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.973269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.973429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.973573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.973723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.973894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.974052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.974220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.974385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.974544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.974709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.974867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.975021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.975173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.975327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.975488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.975643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.975786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.975927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.976077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.976270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.976415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.976528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.976707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.976855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.977049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.977235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.977363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.977539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.977780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.977987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.978122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.978261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.978532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.978680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.978833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.978977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.979234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.979383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.979530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.979713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.979927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.980059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.980220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.980421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.980577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.980733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.980878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.981049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.981183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.981359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.981501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.981698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.981843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.981983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.982121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.982291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.982434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.982603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.982744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.982916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.983046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.983215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.983346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.983522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.983661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.983831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.983961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.984140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.984291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.984438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.984576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.984730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.984864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.985048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.985190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.985347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.985491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.985663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.985807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.985981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.986111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.986274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.986421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.986586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.986799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.986940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.987076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.987207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.987335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.987473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.987616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.988752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.988893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.989026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.989165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.989311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.989521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.989655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.989655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.989915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.990115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.990115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.990387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.990517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.990517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.990693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.990775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.990883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.991256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.991360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.991564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.991880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.992520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.992656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.992962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.993128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.993306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.993648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.993750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.993995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.994330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.994418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.994658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.994918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.995007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.995299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.995511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.995617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.995962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.996211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.996350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.996703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.996792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.997952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.998061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.998137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.998137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.998286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.998359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.998359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.998913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.999061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.999061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.999257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:29.999346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.000723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.000837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.000942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.001058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.001145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.001145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.001282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.001353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.001612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.001713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.002165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.002276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.002354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.002508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.002614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.003183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.003301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.003301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.003452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.003542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.003624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.003810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.003906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.004146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.004246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.004523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.004746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.004849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.005111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.005243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.005431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.005654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.005753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.005829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.006033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.006134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.006378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.006534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.006716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.006817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.006993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.007201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.007358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.007521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.007870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.008032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.008199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.008361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.008361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.008654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.008796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.008938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.008938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.009218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.009374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.009518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.009708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.009924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.010080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.010251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.010405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.010558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.010700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.010848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.011000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.011157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.011301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.011442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.011645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.011802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.011953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.012262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.012416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.012558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.012710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.012852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.013008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.013167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.013320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.013463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.013606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.013753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.013913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.014075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.014228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.014382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.014535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.014679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.014830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.014980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.015129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.015281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.015434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.015586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.015740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.015901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.016045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.016210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.016368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.016526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.016670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.016812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.016954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.044583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.044583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.045091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.045261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.045440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.045678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.045831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.046007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.046249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.046249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.046249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.046880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.047041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.047217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.047384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.047597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.047791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.048056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.048378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.048747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.048747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.049065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.049221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.049367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.049516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.049692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.049936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.050086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.050086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.050541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.050715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.050962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.050962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.051417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.051591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.051756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.051983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.051983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.052289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.052474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.052792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.053191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.053347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.053474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.053598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.053721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.053845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.053845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.054087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.054213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.054337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.054461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.054583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.054706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.054838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.054975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.055100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.055223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.055346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.055469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.055671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.055799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.055924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.056048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.056048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.056332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.056461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.056461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.056461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.056461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.056923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.056923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.057167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.057290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.057414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.057538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.057713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.057841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.057966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.058131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.058270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.058427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.058577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.058883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.059104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.059245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.059372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.059497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.059626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.059750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.059874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.060021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.060232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.060619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.060813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.060975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.061132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.061290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.061455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.061606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.061732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.061856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.062011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.062212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.062343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.062468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.062613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.062895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.063053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.063424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.063560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.064318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.064461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.064589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.064726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.064853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.065022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.065203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.065203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.065458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.065586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.065719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.065883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.066012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.066137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.066261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.066393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.066393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.066634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.066760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.066886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.067025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.067159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.067287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.067428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.067644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.067821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.067947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.068080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.068263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.068418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.068545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.068672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.068672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.069517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.070778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.070778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.070778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.071929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.072022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.072182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.072182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.072462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.073016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.073161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.073441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.073581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.073809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.073963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.074196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.074331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.074458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.074584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.074721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.074889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.075030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.075158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.075284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.075412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.075538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.075738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.075867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.075994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.075994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.076278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.076278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.076590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.076716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.076814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.076909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.077954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.078048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.078141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.078344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.078476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.078602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.078727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.078852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.078986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.079275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.079419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.079547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.079682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.079810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.079936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.080069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.080222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.080350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.080475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.080601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.081189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.081326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.081464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.081591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.081716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.081875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.082014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.082142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.082274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.082486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.082486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.082732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.082866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.083010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.083281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.083281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.083694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.083866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.084080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.084250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.084380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.084518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.084646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.084773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.084906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.085033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.085159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.085284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.085423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.085559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.085686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.085812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.085812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.086051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.086176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.086309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.086437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.086562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.086687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.086812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.086812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.087067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.087194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.087320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.087445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.087570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.087704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.087873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.088006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.088165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.088299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.088425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.088562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.088700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.088700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.088943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.089070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.089210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.089210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.089609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.089771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.089899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.090024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.090150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.090315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.090462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.090614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.090747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.090873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.091006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.091006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.091395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.091522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.091647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.091774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.091911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.091911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.092229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.092377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.092615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.092615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.092874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.093001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.093145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.093409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.093543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.093835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.093979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.094123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.094335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.094467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.094604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.094738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.094866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.094992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.095118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.095243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.095367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.095500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.095628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.095753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.095879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.096004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.096158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.096302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.096431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.096556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.096682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.096906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.097085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.097229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.097358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.097484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.097609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.097734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.097867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.098061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.098190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.098314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.098439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.098564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.098697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.098892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.099852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 04:49:30.100530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.100530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.100530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.100530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.100530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.100530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.100530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.100530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.101622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.101622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.101622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.101622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.101622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.101622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.101622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.101622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.102577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.102577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.102577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.102577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.102577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.102577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.102577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.102577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.103941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.103941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.103941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.103941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.103941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.103941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.103941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.103941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.105078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 04:49:30.105078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 04:49:30.149954 n-d-854119-9 devstack@n-api.service[128871]: INFO dbcounter [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Registered counter for database nova_api Aug 29 04:49:30.165137 n-d-854119-9 devstack@n-api.service[128872]: INFO dbcounter [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Registered counter for database nova_api Aug 29 04:49:30.171365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_db.sqlalchemy.engines [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:49:30.178339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writer thread running {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:49:30.184630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:49:30.191882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writer thread running {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:49:30.235580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.context [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) {{(pid=128871) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 04:49:30.239663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:49:30.240208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:49:30.241759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:49:30.242493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:49:30.242938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:49:30.244969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:49:30.247118 n-d-854119-9 devstack@n-api.service[128871]: INFO dbcounter [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Registered counter for database nova_cell0 Aug 29 04:49:30.248552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.context [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) {{(pid=128872) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 04:49:30.251213 n-d-854119-9 devstack@n-api.service[128871]: INFO dbcounter [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Registered counter for database nova_cell1 Aug 29 04:49:30.252607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:49:30.253082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:49:30.254691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:49:30.256209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:49:30.256209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:49:30.257928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:49:30.259481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_db.sqlalchemy.engines [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:49:30.260001 n-d-854119-9 devstack@n-api.service[128872]: INFO dbcounter [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Registered counter for database nova_cell0 Aug 29 04:49:30.261799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_db.sqlalchemy.engines [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:49:30.264282 n-d-854119-9 devstack@n-api.service[128872]: INFO dbcounter [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Registered counter for database nova_cell1 Aug 29 04:49:30.267641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writer thread running {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:49:30.269756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writer thread running {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:49:30.271545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:49:30.273266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:49:30.278879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writer thread running {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:49:30.281391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writer thread running {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:49:30.416618 n-d-854119-9 devstack@n-api.service[128871]: INFO dbcounter [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Registered counter for database nova_cell0 Aug 29 04:49:30.423873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_db.sqlalchemy.engines [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:49:30.426074 n-d-854119-9 devstack@n-api.service[128872]: INFO dbcounter [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Registered counter for database nova_cell0 Aug 29 04:49:30.428615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writer thread running {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:49:30.432978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 04:49:30.437496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writer thread running {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 04:49:30.749737 n-d-854119-9 devstack@n-api.service[128872]: WARNING keystonemiddleware.auth_token [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 04:49:30.750393 n-d-854119-9 devstack@n-api.service[128871]: WARNING keystonemiddleware.auth_token [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 04:49:30.757061 n-d-854119-9 devstack@n-api.service[128872]: WARNING keystonemiddleware.auth_token [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 04:49:30.757718 n-d-854119-9 devstack@n-api.service[128871]: WARNING keystonemiddleware.auth_token [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 04:49:31.095130 n-d-854119-9 devstack@n-api.service[128872]: WARNING keystonemiddleware.auth_token [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 04:49:31.101200 n-d-854119-9 devstack@n-api.service[128872]: WARNING keystonemiddleware.auth_token [None req-f4a95b51-7299-40d3-ab6e-1fc111d14805 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 04:49:31.103620 n-d-854119-9 devstack@n-api.service[128871]: WARNING keystonemiddleware.auth_token [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 04:49:31.106578 n-d-854119-9 devstack@n-api.service[128872]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555ecf17d9c0 pid: 128872 (default app) Aug 29 04:49:31.109695 n-d-854119-9 devstack@n-api.service[128871]: WARNING keystonemiddleware.auth_token [None req-c0921b7a-0879-4a27-ad1b-262f876c2087 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 04:49:31.115114 n-d-854119-9 devstack@n-api.service[128871]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555ecf17d9c0 pid: 128871 (default app) Aug 29 04:50:10.220837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:10.222697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:10.225738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:10.228661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:11.675553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:11.676979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:11.677093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:11.677761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:11.761475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7eb2fbd4-c6e1-4bdc-85e4-c32f659da0be tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1451660361", "ram": 512, "vcpus": 1, "disk": 10, "id": 858463001, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:11.829608 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7eb2fbd4-c6e1-4bdc-85e4-c32f659da0be tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.617909 Aug 29 04:50:11.832256 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:10 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:12.269001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Calling method '.version_select at 0x7f1abb0f3f70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:12.333360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) {{(pid=128872) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 04:50:12.337181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:12.337745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:12.338191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:12.421391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:12.421880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:12.422314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:12.469924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:12.472386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:12.474358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:12.495529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d5e4c874-9d1a-48ac-9471-73b786696dfa tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.655862 Aug 29 04:50:12.509367 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2/2] 10.222.0.20 () {60 vars in 1208 bytes} [Mon Aug 29 04:50:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:50:12.711941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8b204b4-20df-43c3-bd42-ceb28120363b tempest-AZAdminNegativeTestJSON-950198884 tempest-AZAdminNegativeTestJSON-950198884-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:12.714380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f8b204b4-20df-43c3-bd42-ceb28120363b tempest-AZAdminNegativeTestJSON-950198884 tempest-AZAdminNegativeTestJSON-950198884-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '793fa19992fb4826ba3f2e1ea3d46fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506bf377e01948a886e203b812cc6d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8b204b4-20df-43c3-bd42-ceb28120363b tempest-AZAdminNegativeTestJSON-950198884 tempest-AZAdminNegativeTestJSON-950198884-project] Request method failure captured: Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWBoCsD0kYXdFsU4ZNyYI1bs0mfwkAWnSYjCedqU0_yM4zr_0fGv6zyw3ziUzrg-7DREOAJ8oRxWzmzpTXXFNMKqR3WZAPpXDU3y4Lgpx_E7MitNICrqu8O8ixCtRuXnts-2NnfRFmdsZcsE9r8PYVNJxP6679sbwUdN9ZgKytEFOQ Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 506bf377e01948a886e203b812cc6d6d Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AZAdminNegativeTestJSON-950198884 Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:50:12.718472 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/506bf377e01948a886e203b812cc6d6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/506bf377e01948a886e203b812cc6d6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_506bf377e01948a886e203b812cc6d6d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/506bf377e01948a886e203b812cc6d6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AZAdminNegativeTestJSON-950198884 Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 506bf377e01948a886e203b812cc6d6d Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-950198884 Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AZAdminNegativeTestJSON-950198884-project Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 793fa19992fb4826ba3f2e1ea3d46fdb Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AZAdminNegativeTestJSON-950198884-project Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 04:50:12.719805 n-d-854119-9 devstack@n-api.service[128872]: action_args: {} Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:50:12.720563 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:12.721756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8b204b4-20df-43c3-bd42-ceb28120363b tempest-AZAdminNegativeTestJSON-950198884 tempest-AZAdminNegativeTestJSON-950198884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:12.724677 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f8b204b4-20df-43c3-bd42-ceb28120363b tempest-AZAdminNegativeTestJSON-950198884 tempest-AZAdminNegativeTestJSON-950198884-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.205202 Aug 29 04:50:12.725250 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3/3] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Aug 29 04:50:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:50:12.742399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2924a96c-1de7-4a57-a4ad-2659a2aaadfe tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:12.867210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '.version_select at 0x7f1abb0f4820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:12.886873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) {{(pid=128871) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 04:50:12.888033 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2924a96c-1de7-4a57-a4ad-2659a2aaadfe tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/858463001/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.157348 Aug 29 04:50:12.894276 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4/4] 10.222.0.20 () {60 vars in 1221 bytes} [Mon Aug 29 04:50:12 2022] POST /compute/v2.1/flavors/858463001/os-extra_specs => generated 66 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:12.895430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:12.896035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:12.896515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:12.965305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:12.965800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:12.968448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:12.998974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:13.001482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:13.002071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:13.019644 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab8352d5-c9e9-4307-866e-8db763164d20 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.349216 Aug 29 04:50:13.036209 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1/5] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 29 04:50:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:13.284400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dd3cae61-c80a-4a7e-a44c-bec797485fe5 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-968204517", "id": 1946860365, "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:13.334262 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dd3cae61-c80a-4a7e-a44c-bec797485fe5 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.438503 Aug 29 04:50:13.334936 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 5/6] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:12 2022] POST /compute/v2.1/flavors => generated 429 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:13.341459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-243eb732-5dc0-4995-a3c7-77dd6300ed03 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1411904868"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:13.361370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-243eb732-5dc0-4995-a3c7-77dd6300ed03 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Generated uuid 1365da02-ed22-4823-bd1e-9c6cf9e49c07 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:50:13.415547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fcbf21ac-92c8-401d-ae4d-1a2badffc368 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-628147546", "ram": 512, "vcpus": 1, "disk": 10, "id": 2015576122, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:13.503744 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-243eb732-5dc0-4995-a3c7-77dd6300ed03 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.166189 Aug 29 04:50:13.513469 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 6/7] 10.222.0.20 () {62 vars in 1205 bytes} [Mon Aug 29 04:50:13 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:50:13.527824 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fcbf21ac-92c8-401d-ae4d-1a2badffc368 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.489265 Aug 29 04:50:13.531209 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2/8] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:13 2022] POST /compute/v2.1/flavors => generated 415 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:13.546912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06a4eb90-ccf1-4bd2-944d-a2112e1f2a97 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:13.606635 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06a4eb90-ccf1-4bd2-944d-a2112e1f2a97 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1946860365" status: 202 len: 0 microversion: 2.1 time: 0.073129 Aug 29 04:50:13.607272 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3/9] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:50:13 2022] DELETE /compute/v2.1/flavors/1946860365 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:13.612642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-450ef9f8-9992-4efc-b0ef-7045291b53b7 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-288963926"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:13.826025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-35d12cc0-ea83-4c12-bede-9321fee3e2bf tempest-FlavorsExtraSpecsTestJSON-1933457971 tempest-FlavorsExtraSpecsTestJSON-1933457971-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:13.866936 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-450ef9f8-9992-4efc-b0ef-7045291b53b7 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.258543 Aug 29 04:50:13.867650 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4/10] 10.222.0.20 () {62 vars in 1210 bytes} [Mon Aug 29 04:50:13 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:50:13.877808 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-35d12cc0-ea83-4c12-bede-9321fee3e2bf tempest-FlavorsExtraSpecsTestJSON-1933457971 tempest-FlavorsExtraSpecsTestJSON-1933457971-project] 10.222.0.20 "GET /compute/v2.1/flavors/858463001/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.362691 Aug 29 04:50:13.885911 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 7/11] 10.222.0.20 () {58 vars in 1200 bytes} [Mon Aug 29 04:50:13 2022] GET /compute/v2.1/flavors/858463001/os-extra_specs => generated 66 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:13.894165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6fbfc1be-68e8-4bc5-bbf3-1e929a93c83d tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:13.965843 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6fbfc1be-68e8-4bc5-bbf3-1e929a93c83d tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5799 microversion: 2.1 time: 0.084313 Aug 29 04:50:13.967722 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 8/12] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:13 2022] GET /compute/v2.1/flavors/detail => generated 5799 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:13.974793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d7abeaf-72aa-4255-8a19-c77720dba2c9 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:14.020624 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0d7abeaf-72aa-4255-8a19-c77720dba2c9 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.049365 Aug 29 04:50:14.029313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 9/13] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 29 04:50:13 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:50:14.047331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70684317-8a00-4917-9410-4151d0b53a7c tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:14.097837 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70684317-8a00-4917-9410-4151d0b53a7c tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/858463001/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067123 Aug 29 04:50:14.103688 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 10/14] 10.222.0.20 () {60 vars in 1221 bytes} [Mon Aug 29 04:50:14 2022] POST /compute/v2.1/flavors/858463001/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:14.113863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b0daf22-97bf-4fc3-86eb-4aa10a02dd5b tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-831155453", "id": 207190779, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:14.173242 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b0daf22-97bf-4fc3-86eb-4aa10a02dd5b tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.068113 Aug 29 04:50:14.178120 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 11/15] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:14 2022] POST /compute/v2.1/flavors => generated 413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:14.184065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0606dfd7-fa2b-493d-8dcf-ecfe4983b8b8 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:14.195694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0606dfd7-fa2b-493d-8dcf-ecfe4983b8b8 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:14.201945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0606dfd7-fa2b-493d-8dcf-ecfe4983b8b8 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:14.208174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0606dfd7-fa2b-493d-8dcf-ecfe4983b8b8 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:14.301968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9120baa8-5241-4b8b-b942-bdab279e6259 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:14.383692 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-9120baa8-5241-4b8b-b942-bdab279e6259 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] HTTP exception thrown: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9120baa8-5241-4b8b-b942-bdab279e6259 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Request method failure captured: Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/flavors/2015576122/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWBlD3_gjYXflk_vS1SZ6D3vXjryIa0AMV7f7RMYuXI7DEY2zQk1VaAbJdBJkN3_agheH0k19FlwO9jV6dckn5mVrxOHZLzDDUC5dFyteqU-CeY-f4h4bIPXWq-tuK0nF-hoR8WqhjBabx50-0g3hyZowabTYDCiYBEQ13FwJ-eJC8 Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 19f9b7d0b7d8413e8b8acc61dce1ff6e Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:50:14.391593 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_19f9b7d0b7d8413e8b8acc61dce1ff6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 19f9b7d0b7d8413e8b8acc61dce1ff6e Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 0f4d1730cd9446cca829f61db228f77e Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:50:14.392644 n-d-854119-9 devstack@n-api.service[128871]: exception: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'flavor_id': '2015576122', 'id': 'hw:cpu_thread_policy'} Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:14.393278 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.394551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:14.394551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:14.394551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:14.394551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:50:14.394551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:50:14.394551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. Aug 29 04:50:14.394551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.401106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9120baa8-5241-4b8b-b942-bdab279e6259 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Returning 404 to user: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:14.402184 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9120baa8-5241-4b8b-b942-bdab279e6259 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] 10.222.0.20 "GET /compute/v2.1/flavors/2015576122/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.533565 Aug 29 04:50:14.408388 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 5/16] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 04:50:13 2022] GET /compute/v2.1/flavors/2015576122/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 535 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:50:14.424008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-167085da-0563-4058-958b-db2ab6398ada tempest-FlavorsExtraSpecsTestJSON-1933457971 tempest-FlavorsExtraSpecsTestJSON-1933457971-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:14.440437 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-167085da-0563-4058-958b-db2ab6398ada tempest-FlavorsExtraSpecsTestJSON-1933457971 tempest-FlavorsExtraSpecsTestJSON-1933457971-project] 10.222.0.20 "GET /compute/v2.1/flavors/858463001/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.028487 Aug 29 04:50:14.441613 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 6/17] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 04:50:14 2022] GET /compute/v2.1/flavors/858463001/os-extra_specs/hw:numa_nodes => generated 22 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:14.451303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8ffc2ba-b5ae-4769-b4fb-43dd4bc744f4 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:14.515553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8ffc2ba-b5ae-4769-b4fb-43dd4bc744f4 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6202 microversion: 2.1 time: 0.072602 Aug 29 04:50:14.536782 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 7/18] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:14 2022] GET /compute/v2.1/flavors/detail => generated 6202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:14.547319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b01e67ec-de87-413c-bb61-b71d73a95e0c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:14.554325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b01e67ec-de87-413c-bb61-b71d73a95e0c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '0f4d1730cd9446cca829f61db228f77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9b7d0b7d8413e8b8acc61dce1ff6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b01e67ec-de87-413c-bb61-b71d73a95e0c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Request method failure captured: Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/flavors/2015576122/os-extra_specs HTTP/1.1 Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 66 Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWBlD3_gjYXflk_vS1SZ6D3vXjryIa0AMV7f7RMYuXI7DEY2zQk1VaAbJdBJkN3_agheH0k19FlwO9jV6dckn5mVrxOHZLzDDUC5dFyteqU-CeY-f4h4bIPXWq-tuK0nF-hoR8WqhjBabx50-0g3hyZowabTYDCiYBEQ13FwJ-eJC8 Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 19f9b7d0b7d8413e8b8acc61dce1ff6e Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:50:14.557556 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_19f9b7d0b7d8413e8b8acc61dce1ff6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 19f9b7d0b7d8413e8b8acc61dce1ff6e Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 0f4d1730cd9446cca829f61db228f77e Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 29 04:50:14.558820 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'flavor_id': '2015576122', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:50:14.559419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 04:50:14.561603 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.562654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b01e67ec-de87-413c-bb61-b71d73a95e0c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:14.562654 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b01e67ec-de87-413c-bb61-b71d73a95e0c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] 10.222.0.20 "POST /compute/v2.1/flavors/2015576122/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.021538 Aug 29 04:50:14.562654 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 8/19] 10.222.0.20 () {60 vars in 1224 bytes} [Mon Aug 29 04:50:14 2022] POST /compute/v2.1/flavors/2015576122/os-extra_specs => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:50:14.574873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0593edc5-800d-4345-aeae-b06ba1af1182 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:14.684408 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0593edc5-800d-4345-aeae-b06ba1af1182 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/858463001/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.123523 Aug 29 04:50:14.685007 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 9/20] 10.222.0.20 () {60 vars in 1221 bytes} [Mon Aug 29 04:50:14 2022] POST /compute/v2.1/flavors/858463001/os-extra_specs => generated 66 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:14.697880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b72db0e-b0e6-4f56-8c9b-206dbdf02fc0 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:14.741058 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b72db0e-b0e6-4f56-8c9b-206dbdf02fc0 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/207190779" status: 202 len: 0 microversion: 2.1 time: 0.050515 Aug 29 04:50:14.741982 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 10/21] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 04:50:14 2022] DELETE /compute/v2.1/flavors/207190779 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:14.747913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e6403e3d-2afc-4b12-ad9f-b448da17b564 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:14.825852 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e6403e3d-2afc-4b12-ad9f-b448da17b564 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/2015576122/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.082618 Aug 29 04:50:14.826781 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 11/22] 10.222.0.20 () {60 vars in 1224 bytes} [Mon Aug 29 04:50:14 2022] POST /compute/v2.1/flavors/2015576122/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:14.866436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0606dfd7-fa2b-493d-8dcf-ecfe4983b8b8 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.686588 Aug 29 04:50:14.867415 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 12/23] 10.222.0.20 () {62 vars in 1232 bytes} [Mon Aug 29 04:50:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:50:14.876508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5b125b2f-67a1-4d4e-980f-05922e58484a tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:14.901419 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5b125b2f-67a1-4d4e-980f-05922e58484a tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/858463001/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032236 Aug 29 04:50:14.902996 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1200 bytes} [Mon Aug 29 04:50:14 2022] GET /compute/v2.1/flavors/858463001/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:14.909125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b945e12-ae4a-4a0b-b5d9-39636c3b0910 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:14.941661 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b945e12-ae4a-4a0b-b5d9-39636c3b0910 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5799 microversion: 2.1 time: 0.037324 Aug 29 04:50:14.942926 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:14 2022] GET /compute/v2.1/flavors/detail => generated 5799 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:14.953896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3cb3eff-ae22-4b0e-ba1b-562ec0cdd9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:14.966433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3cb3eff-ae22-4b0e-ba1b-562ec0cdd9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '0f4d1730cd9446cca829f61db228f77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9b7d0b7d8413e8b8acc61dce1ff6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3cb3eff-ae22-4b0e-ba1b-562ec0cdd9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Request method failure captured: Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWBlD3_gjYXflk_vS1SZ6D3vXjryIa0AMV7f7RMYuXI7DEY2zQk1VaAbJdBJkN3_agheH0k19FlwO9jV6dckn5mVrxOHZLzDDUC5dFyteqU-CeY-f4h4bIPXWq-tuK0nF-hoR8WqhjBabx50-0g3hyZowabTYDCiYBEQ13FwJ-eJC8 Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 19f9b7d0b7d8413e8b8acc61dce1ff6e Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:50:14.973090 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_19f9b7d0b7d8413e8b8acc61dce1ff6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 19f9b7d0b7d8413e8b8acc61dce1ff6e Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 0f4d1730cd9446cca829f61db228f77e Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:14.974228 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'flavor_id': '2015576122', 'id': 'hw:numa_nodes'} Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:50:14.974751 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 04:50:14.975665 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:14.978992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3cb3eff-ae22-4b0e-ba1b-562ec0cdd9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:14.982351 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a3cb3eff-ae22-4b0e-ba1b-562ec0cdd9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.038213 Aug 29 04:50:14.985144 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 15/26] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 04:50:14 2022] DELETE /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:50:14.996233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-33ad3d37-52a0-403a-ba0d-b7b59d018017 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.035372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33ad3d37-52a0-403a-ba0d-b7b59d018017 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:15.035791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33ad3d37-52a0-403a-ba0d-b7b59d018017 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:15.036254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33ad3d37-52a0-403a-ba0d-b7b59d018017 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:15.217215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2438023-c0cf-4c76-9367-c85e0d7121cd tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.222510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2438023-c0cf-4c76-9367-c85e0d7121cd tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:15.223035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2438023-c0cf-4c76-9367-c85e0d7121cd tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:15.223473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2438023-c0cf-4c76-9367-c85e0d7121cd tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:15.224215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2438023-c0cf-4c76-9367-c85e0d7121cd tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:15.224664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2438023-c0cf-4c76-9367-c85e0d7121cd tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:15.225097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2438023-c0cf-4c76-9367-c85e0d7121cd tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:15.242693 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-33ad3d37-52a0-403a-ba0d-b7b59d018017 tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.255794 Aug 29 04:50:15.244517 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 16/27] 10.222.0.20 () {62 vars in 1232 bytes} [Mon Aug 29 04:50:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:50:15.255594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-00feb6f5-8359-4833-b62b-c615ac5f2ebf tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.270139 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2438023-c0cf-4c76-9367-c85e0d7121cd tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.442189 Aug 29 04:50:15.271329 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 12/28] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Aug 29 04:50:14 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:15.276373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-880a3fde-fbc8-491f-9805-8cb0951a1670 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-891380299", "id": 2115556463, "os-flavor-access:is_public": "True"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.300089 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-880a3fde-fbc8-491f-9805-8cb0951a1670 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.027443 Aug 29 04:50:15.305501 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 13/29] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:15 2022] POST /compute/v2.1/flavors => generated 428 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:15.307403 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-00feb6f5-8359-4833-b62b-c615ac5f2ebf tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/858463001/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.060496 Aug 29 04:50:15.308070 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 17/30] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:50:15 2022] PUT /compute/v2.1/flavors/858463001/os-extra_specs/hw:numa_nodes => generated 22 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:15.311015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-27de37c6-ea85-4db1-a937-7ac4fb64060e tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.319141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-63f41025-224e-421f-9c4a-cbe4929a529d tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.342641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-27de37c6-ea85-4db1-a937-7ac4fb64060e tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/2015576122/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035528 Aug 29 04:50:15.343567 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 14/31] 10.222.0.20 () {60 vars in 1224 bytes} [Mon Aug 29 04:50:15 2022] POST /compute/v2.1/flavors/2015576122/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:15.348783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a883a204-baf7-4182-9c92-d9f668bab682 tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.351321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a883a204-baf7-4182-9c92-d9f668bab682 tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:15.351971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a883a204-baf7-4182-9c92-d9f668bab682 tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:15.352677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a883a204-baf7-4182-9c92-d9f668bab682 tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:15.353851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a883a204-baf7-4182-9c92-d9f668bab682 tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:15.354458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a883a204-baf7-4182-9c92-d9f668bab682 tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:15.355159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a883a204-baf7-4182-9c92-d9f668bab682 tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:15.367539 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-63f41025-224e-421f-9c4a-cbe4929a529d tempest-AggregatesAdminTestV241-1086651053 tempest-AggregatesAdminTestV241-1086651053-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.057041 Aug 29 04:50:15.369143 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 18/32] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 04:50:15 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:15.384658 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a883a204-baf7-4182-9c92-d9f668bab682 tempest-AZAdminV2TestJSON-1554756043 tempest-AZAdminV2TestJSON-1554756043-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.039524 Aug 29 04:50:15.385594 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 15/33] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Aug 29 04:50:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:15.395750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17619386-bb76-469c-b9bd-f29e3a44ce53 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.398299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-19441934-75bd-4329-ba88-64db076ca11b tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.420065 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17619386-bb76-469c-b9bd-f29e3a44ce53 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/858463001/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041811 Aug 29 04:50:15.420694 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 19/34] 10.222.0.20 () {58 vars in 1200 bytes} [Mon Aug 29 04:50:15 2022] GET /compute/v2.1/flavors/858463001/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:15.435897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e1261af2-35b3-4594-9a5e-6294b1f77d6c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.438481 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-19441934-75bd-4329-ba88-64db076ca11b tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2115556463" status: 202 len: 0 microversion: 2.1 time: 0.051717 Aug 29 04:50:15.439196 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 16/35] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:50:15 2022] DELETE /compute/v2.1/flavors/2115556463 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:15.446169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1261af2-35b3-4594-9a5e-6294b1f77d6c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '0f4d1730cd9446cca829f61db228f77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f9b7d0b7d8413e8b8acc61dce1ff6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:15.450375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-caaf3d4b-fa0c-45f2-bff0-cd3e151224ac tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1846629757", "name": "tempest-test_aggregate-459598981"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e1261af2-35b3-4594-9a5e-6294b1f77d6c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Request method failure captured: Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 22 Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWBlD3_gjYXflk_vS1SZ6D3vXjryIa0AMV7f7RMYuXI7DEY2zQk1VaAbJdBJkN3_agheH0k19FlwO9jV6dckn5mVrxOHZLzDDUC5dFyteqU-CeY-f4h4bIPXWq-tuK0nF-hoR8WqhjBabx50-0g3hyZowabTYDCiYBEQ13FwJ-eJC8 Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 19f9b7d0b7d8413e8b8acc61dce1ff6e Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:50:15.451151 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_19f9b7d0b7d8413e8b8acc61dce1ff6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/19f9b7d0b7d8413e8b8acc61dce1ff6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 19f9b7d0b7d8413e8b8acc61dce1ff6e Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 0f4d1730cd9446cca829f61db228f77e Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: {"hw:numa_nodes": "1"} Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:15.452349 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'flavor_id': '2015576122', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:50:15.453119 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 04:50:15.454198 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.457408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e1261af2-35b3-4594-9a5e-6294b1f77d6c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:15.459520 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e1261af2-35b3-4594-9a5e-6294b1f77d6c tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162 tempest-FlavorsExtraSpecsNegativeTestJSON-1553995162-project] 10.222.0.20 "PUT /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.036693 Aug 29 04:50:15.465503 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 20/36] 10.222.0.20 () {60 vars in 1265 bytes} [Mon Aug 29 04:50:15 2022] PUT /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes => generated 124 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:50:15.471069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8390a88b-9992-4b8f-bdcd-e3ee6ff5ab94 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.495291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.aggregate [None req-caaf3d4b-fa0c-45f2-bff0-cd3e151224ac tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Generated uuid b89e47df-ae4a-479e-a8ce-23f7990a9f40 for aggregate {{(pid=128871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:50:15.530531 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8390a88b-9992-4b8f-bdcd-e3ee6ff5ab94 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/858463001/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.062986 Aug 29 04:50:15.531565 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 21/37] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 04:50:15 2022] DELETE /compute/v2.1/flavors/858463001/os-extra_specs/hw:numa_nodes => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:50:15.538545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a88d86bc-a082-4f52-892b-2d83fd28f6be tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.565528 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a88d86bc-a082-4f52-892b-2d83fd28f6be tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5799 microversion: 2.1 time: 0.032676 Aug 29 04:50:15.566475 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 22/38] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:15 2022] GET /compute/v2.1/flavors/detail => generated 5799 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:15.571627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7f3f6e2-d0b2-4856-8e56-8e43c10e8fd7 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.576476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:15.578828 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-caaf3d4b-fa0c-45f2-bff0-cd3e151224ac tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.137719 Aug 29 04:50:15.580762 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 17/39] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Aug 29 04:50:15 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:15.580876 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d7f3f6e2-d0b2-4856-8e56-8e43c10e8fd7 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] HTTP exception thrown: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7f3f6e2-d0b2-4856-8e56-8e43c10e8fd7 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Request method failure captured: Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/flavors/2015576122/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWDoOS3yZwVqfUsz31cw6FJQSaN1kkgRP5UYz58p4_Y_5HyIuWvs0dAN5s24tPlkZpiSJFmrBE9brayxT_1KXt7F4O7fV5attRMGf_JykjrS0x7ldQVwYEHGl-YU-RRcSut5zBFIpbCxmOPa9CYPTgvPy0jRKGZxcTAQwmb1rcY8os Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7452a559300a45c6a1436718f6ed7cd9 Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:50:15.582498 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7452a559300a45c6a1436718f6ed7cd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7452a559300a45c6a1436718f6ed7cd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7452a559300a45c6a1436718f6ed7cd9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7452a559300a45c6a1436718f6ed7cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7452a559300a45c6a1436718f6ed7cd9 Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d6d8cc5986bc409cbd5fc8b002cbe32b Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:15.583826 n-d-854119-9 devstack@n-api.service[128872]: exception: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'flavor_id': '2015576122', 'id': 'hw:cpu_thread_policy'} Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:15.584549 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7f3f6e2-d0b2-4856-8e56-8e43c10e8fd7 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Returning 404 to user: Flavor 2015576122 has no extra specs with key hw:cpu_thread_policy. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d7f3f6e2-d0b2-4856-8e56-8e43c10e8fd7 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2015576122/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.016419 Aug 29 04:50:15.585795 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 23/40] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 04:50:15 2022] DELETE /compute/v2.1/flavors/2015576122/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:50:15.594809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e1b0875a-45f8-4cb4-b02d-42ebd3ecdebc tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.596859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-df6b3142-5859-43cb-b8cf-7f2cf748663e tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.610680 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e1b0875a-45f8-4cb4-b02d-42ebd3ecdebc tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.019642 Aug 29 04:50:15.611864 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 24/41] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:50:15 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:15.616528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ea3b885-1238-4926-b6b5-d92743d272f1 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.621843 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-7ea3b885-1238-4926-b6b5-d92743d272f1 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ea3b885-1238-4926-b6b5-d92743d272f1 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Request method failure captured: Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 27 Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWDoOS3yZwVqfUsz31cw6FJQSaN1kkgRP5UYz58p4_Y_5HyIuWvs0dAN5s24tPlkZpiSJFmrBE9brayxT_1KXt7F4O7fV5attRMGf_JykjrS0x7ldQVwYEHGl-YU-RRcSut5zBFIpbCxmOPa9CYPTgvPy0jRKGZxcTAQwmb1rcY8os Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7452a559300a45c6a1436718f6ed7cd9 Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:50:15.623867 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7452a559300a45c6a1436718f6ed7cd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7452a559300a45c6a1436718f6ed7cd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7452a559300a45c6a1436718f6ed7cd9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7452a559300a45c6a1436718f6ed7cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7452a559300a45c6a1436718f6ed7cd9 Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d6d8cc5986bc409cbd5fc8b002cbe32b Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: {"hw:cpu_policy": "shared"} Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:15.625004 n-d-854119-9 devstack@n-api.service[128872]: exception: Request body and URI mismatch Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'flavor_id': '2015576122', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:15.625763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:15.626701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:50:15.626701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:50:15.626701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 29 04:50:15.626701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.628664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ea3b885-1238-4926-b6b5-d92743d272f1 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:15.630362 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ea3b885-1238-4926-b6b5-d92743d272f1 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016686 Aug 29 04:50:15.635653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:DELETE=10,nova_api:UPDATE=1,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:15.638173 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 25/42] 10.222.0.20 () {60 vars in 1265 bytes} [Mon Aug 29 04:50:15 2022] PUT /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes => generated 73 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:50:15.643265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a223048-124e-4246-8c52-ff85df67beff tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1542362826", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.646696 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-df6b3142-5859-43cb-b8cf-7f2cf748663e tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/858463001/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.055372 Aug 29 04:50:15.647277 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 18/43] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 04:50:15 2022] DELETE /compute/v2.1/flavors/858463001/os-extra_specs/hw:cpu_policy => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:50:15.660971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-868eac22-d509-4204-8084-8805a4a005e9 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.669199 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2a223048-124e-4246-8c52-ff85df67beff tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028683 Aug 29 04:50:15.670051 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 26/44] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:15.676103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47d370c6-19d5-4e89-8f60-bb0f77da5d63 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47d370c6-19d5-4e89-8f60-bb0f77da5d63 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Request method failure captured: Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 49 Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWDoOS3yZwVqfUsz31cw6FJQSaN1kkgRP5UYz58p4_Y_5HyIuWvs0dAN5s24tPlkZpiSJFmrBE9brayxT_1KXt7F4O7fV5attRMGf_JykjrS0x7ldQVwYEHGl-YU-RRcSut5zBFIpbCxmOPa9CYPTgvPy0jRKGZxcTAQwmb1rcY8os Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7452a559300a45c6a1436718f6ed7cd9 Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:50:15.680712 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7452a559300a45c6a1436718f6ed7cd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7452a559300a45c6a1436718f6ed7cd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7452a559300a45c6a1436718f6ed7cd9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7452a559300a45c6a1436718f6ed7cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7452a559300a45c6a1436718f6ed7cd9 Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d6d8cc5986bc409cbd5fc8b002cbe32b Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 29 04:50:15.682089 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'flavor_id': '2015576122', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance: Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 29 04:50:15.682803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.684595 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:15.685522 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:15.685522 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:15.685522 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:50:15.685522 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:50:15.685522 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 04:50:15.685522 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:15.685522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47d370c6-19d5-4e89-8f60-bb0f77da5d63 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:15.685522 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47d370c6-19d5-4e89-8f60-bb0f77da5d63 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.011432 Aug 29 04:50:15.687456 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 27/45] 10.222.0.20 () {60 vars in 1265 bytes} [Mon Aug 29 04:50:15 2022] PUT /compute/v2.1/flavors/2015576122/os-extra_specs/hw:numa_nodes => generated 117 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:50:15.688759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-868eac22-d509-4204-8084-8805a4a005e9 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:15.689305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-868eac22-d509-4204-8084-8805a4a005e9 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:15.689994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-868eac22-d509-4204-8084-8805a4a005e9 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:15.692496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f140db45-52c2-42df-9467-5007d42bac91 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.705019 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f140db45-52c2-42df-9467-5007d42bac91 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/858463001/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016495 Aug 29 04:50:15.706167 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 28/46] 10.222.0.20 () {58 vars in 1200 bytes} [Mon Aug 29 04:50:15 2022] GET /compute/v2.1/flavors/858463001/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:15.711336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-60dac2d8-8a54-41cc-8f05-3d1b7087830c tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.743286 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-60dac2d8-8a54-41cc-8f05-3d1b7087830c tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/70a24b90-c168-4e82-afae-44699dc22bdc" status: 202 len: 0 microversion: 2.1 time: 0.035670 Aug 29 04:50:15.744001 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 29/47] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:50:15 2022] DELETE /compute/v2.1/flavors/70a24b90-c168-4e82-afae-44699dc22bdc => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:15.753415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea705019-a105-4adf-b567-e0b9fc33022a tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.777351 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea705019-a105-4adf-b567-e0b9fc33022a tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2015576122" status: 202 len: 0 microversion: 2.1 time: 0.031748 Aug 29 04:50:15.778211 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 30/48] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:50:15 2022] DELETE /compute/v2.1/flavors/2015576122 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:15.785052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a6fcb28-9971-4eb9-a524-2064a3aaaa6c tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.804649 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a6fcb28-9971-4eb9-a524-2064a3aaaa6c tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/858463001" status: 202 len: 0 microversion: 2.1 time: 0.025095 Aug 29 04:50:15.805721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 31/49] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 04:50:15 2022] DELETE /compute/v2.1/flavors/858463001 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:15.810438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97fdb405-a032-451f-b14c-91a4118679de tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.830660 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-97fdb405-a032-451f-b14c-91a4118679de tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023100 Aug 29 04:50:15.831246 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 32/50] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:15.835484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d2710e8-1e97-429f-ae02-b29119af7211 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.855681 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d2710e8-1e97-429f-ae02-b29119af7211 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531 tempest-FlavorsExtraSpecsNegativeTestJSON-17661531-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023371 Aug 29 04:50:15.856283 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 33/51] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:15.860574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-551e990b-d3f9-43dc-aade-ea2d8bd47983 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.879454 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-551e990b-d3f9-43dc-aade-ea2d8bd47983 tempest-FlavorsExtraSpecsTestJSON-84709575 tempest-FlavorsExtraSpecsTestJSON-84709575-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022089 Aug 29 04:50:15.880060 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 34/52] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:15.884713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bfe9cdb1-134d-45c5-8a50-8e6976e506f4 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1754366288", "id": "246e15a4-3355-4e55-b04f-1448b1a83544", "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:15.906281 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bfe9cdb1-134d-45c5-8a50-8e6976e506f4 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.024909 Aug 29 04:50:15.907196 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 35/53] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:15.922116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1bc7c211-2df1-4621-b85f-c5a7e012ed5e tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.940476 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1bc7c211-2df1-4621-b85f-c5a7e012ed5e tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/246e15a4-3355-4e55-b04f-1448b1a83544" status: 202 len: 0 microversion: 2.1 time: 0.025269 Aug 29 04:50:15.946075 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 36/54] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:50:15 2022] DELETE /compute/v2.1/flavors/246e15a4-3355-4e55-b04f-1448b1a83544 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:50:15.952830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5448183-3c17-4bbb-acbc-22788df3605b tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:15.977670 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5448183-3c17-4bbb-acbc-22788df3605b tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030451 Aug 29 04:50:15.978861 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 37/55] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:16.000960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9eb65f8-f586-43b0-8920-440ebb137e10 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1610792071", "id": 89986695, "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:16.023623 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9eb65f8-f586-43b0-8920-440ebb137e10 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.026805 Aug 29 04:50:16.024556 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 38/56] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:16.035786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-831f5fb1-3d67-4f4d-968d-0131fe055276 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:16.042699 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-831f5fb1-3d67-4f4d-968d-0131fe055276 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/89986695" status: 200 len: 408 microversion: 2.1 time: 0.010604 Aug 29 04:50:16.051097 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 39/57] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:50:16 2022] GET /compute/v2.1/flavors/89986695 => generated 408 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:50:16.684215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8651850a-97cf-42e9-9f04-860ada33e978 tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:16.821128 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8651850a-97cf-42e9-9f04-860ada33e978 tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5389 microversion: 2.1 time: 0.753521 Aug 29 04:50:16.821815 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 40/58] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:16 2022] GET /compute/v2.1/flavors/detail => generated 5389 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:16.848577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6b076eef-5b05-4715-abd6-5b4e738dd588 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:16.907734 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6b076eef-5b05-4715-abd6-5b4e738dd588 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/89986695" status: 202 len: 0 microversion: 2.1 time: 0.071467 Aug 29 04:50:16.913969 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 41/59] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:50:16 2022] DELETE /compute/v2.1/flavors/89986695 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:50:16.932266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-035ebadb-055b-473c-9233-9e740985eb46 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.003658 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-868eac22-d509-4204-8084-8805a4a005e9 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 1.352432 Aug 29 04:50:17.004849 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-035ebadb-055b-473c-9233-9e740985eb46 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089659 Aug 29 04:50:17.020413 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 19/60] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:50:15 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:17.020702 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 42/61] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:17.030015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-278a613c-9905-45f2-b020-1b2bedbf54fa tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-828579292", "id": 2131562153, "os-flavor-access:is_public": "False"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:17.062247 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-278a613c-9905-45f2-b020-1b2bedbf54fa tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.037173 Aug 29 04:50:17.069909 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 20/62] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:17 2022] POST /compute/v2.1/flavors => generated 429 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:17.074671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb0aa944-fe05-4204-a301-c86870622037 tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "2131562153"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:17.100499 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-fb0aa944-fe05-4204-a301-c86870622037 tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] HTTP exception thrown: Flavor 2131562153 could not be found. Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb0aa944-fe05-4204-a301-c86870622037 tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] Request method failure captured: Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 107 Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWBNkLEeUJ5rjwB2PHY35vioccQWJorJvIlgfb7P5nt-Vy-O2Kj0ZM35BLbE1LYIJjSZLdh8yRFClua6d4N7OxmdTnK9gTYaTVnstG5RJ5btrWq9u78GdEyHQULBUoB4VhfB80CNZua4I5OwmJFnsyTINN05byOm2JNCHhxKNWRl-Q Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: a57071723d0b4da0a67d7ba16f8f0b27 Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsAdminTestJSON-1591965860 Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:50:17.107872 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a57071723d0b4da0a67d7ba16f8f0b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a57071723d0b4da0a67d7ba16f8f0b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a57071723d0b4da0a67d7ba16f8f0b27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a57071723d0b4da0a67d7ba16f8f0b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsAdminTestJSON-1591965860 Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: a57071723d0b4da0a67d7ba16f8f0b27 Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1591965860 Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsAdminTestJSON-1591965860-project Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4acb0196c6ba45e1a1fced505cacea0b Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsAdminTestJSON-1591965860-project Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "test", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "2131562153"}} Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:17.109258 n-d-854119-9 devstack@n-api.service[128872]: exception: Flavor 2131562153 could not be found. Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '2131562153'}}} Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2131562153 could not be found. Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:17.110033 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2131562153 could not be found. Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:17.111373 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:17.112510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:17.112510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:50:17.112510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:50:17.112510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2131562153 could not be found. Aug 29 04:50:17.112510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:17.112510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb0aa944-fe05-4204-a301-c86870622037 tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] Returning 400 to user: Flavor 2131562153 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:17.112510 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb0aa944-fe05-4204-a301-c86870622037 tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.039046 Aug 29 04:50:17.119664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a9f77eb-11d2-4c94-a4a2-e1a31f857d9b tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.126095 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 43/63] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:17 2022] POST /compute/v2.1/servers => generated 81 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:50:17.141988 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3a9f77eb-11d2-4c94-a4a2-e1a31f857d9b tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2131562153" status: 202 len: 0 microversion: 2.1 time: 0.027071 Aug 29 04:50:17.142885 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 21/64] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:50:17 2022] DELETE /compute/v2.1/flavors/2131562153 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:17.152059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad47851f-3c61-433a-b7a5-ed2a45a102d8 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.203981 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad47851f-3c61-433a-b7a5-ed2a45a102d8 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056624 Aug 29 04:50:17.205801 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 44/65] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:17.228312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f4dc5a0b-172e-4bfd-a100-92a2c9c6787c tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-108544170", "id": 282999758, "os-flavor-access:is_public": "False"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:17.260985 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f4dc5a0b-172e-4bfd-a100-92a2c9c6787c tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.036583 Aug 29 04:50:17.268030 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 45/66] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:17 2022] POST /compute/v2.1/flavors => generated 411 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:17.279474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b58be895-66c9-4538-99fd-2ced0b22a39c tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-714612849", "id": 1194138846, "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:17.311895 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b58be895-66c9-4538-99fd-2ced0b22a39c tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.036364 Aug 29 04:50:17.312522 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 46/67] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:17 2022] POST /compute/v2.1/flavors => generated 413 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:50:17.324690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-037d6b5c-7310-40ea-b520-aa39ccd87fce tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.361252 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-037d6b5c-7310-40ea-b520-aa39ccd87fce tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.040618 Aug 29 04:50:17.362485 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 47/68] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:17.383319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-abb5f1ce-b7a3-4e13-992c-17bbd65e249e tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.415470 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-abb5f1ce-b7a3-4e13-992c-17bbd65e249e tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.041791 Aug 29 04:50:17.417132 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 48/69] 10.222.0.20 () {58 vars in 1177 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:17.430874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc196148-ea76-44de-83cf-aeeff5b78a5f tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.446655 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc196148-ea76-44de-83cf-aeeff5b78a5f tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.019943 Aug 29 04:50:17.456308 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 49/70] 10.222.0.20 () {58 vars in 1171 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:17.461673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-88f45bc2-367e-493d-8889-e336ac3e517d tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.474513 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-88f45bc2-367e-493d-8889-e336ac3e517d tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.016343 Aug 29 04:50:17.483163 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 50/71] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:17.489241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21d6f9ff-bc83-440f-bb1e-bc31fcc0ecb1 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.514294 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21d6f9ff-bc83-440f-bb1e-bc31fcc0ecb1 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.029112 Aug 29 04:50:17.528792 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 51/72] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:17.534364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af4242fd-26ec-495c-aeb8-a3ec0df98b51 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.558291 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af4242fd-26ec-495c-aeb8-a3ec0df98b51 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.028384 Aug 29 04:50:17.572241 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 52/73] 10.222.0.20 () {58 vars in 1175 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:17.578831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d5156b8a-f983-4376-b573-8cb121142e05 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.636040 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d5156b8a-f983-4376-b573-8cb121142e05 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.062331 Aug 29 04:50:17.636668 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 53/74] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:17.654683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4300324-24ee-4b57-9174-2999b0513fea tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.695417 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a4300324-24ee-4b57-9174-2999b0513fea tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.044602 Aug 29 04:50:17.696102 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 54/75] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:17.718527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d93d33ef-8907-4805-9815-d61fd74b4994 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.735922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=5,nova_api:DELETE=17 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:17.750311 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d93d33ef-8907-4805-9815-d61fd74b4994 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1194138846" status: 202 len: 0 microversion: 2.1 time: 0.035405 Aug 29 04:50:17.754612 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 55/76] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:50:17 2022] DELETE /compute/v2.1/flavors/1194138846 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:17.767076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-42643099-6578-4f3e-8b13-9e14985abb38 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.794812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-697530530", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "availability_zone": "tempest-test_az-1846629757"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:17.801666 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-42643099-6578-4f3e-8b13-9e14985abb38 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045626 Aug 29 04:50:17.810778 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 56/77] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:17.829803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-32b951ac-9e28-43d5-9272-77014b5e9438 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.847804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:17.848319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:17.848751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:17.849495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:17.849979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:17.850409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:17.864974 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-32b951ac-9e28-43d5-9272-77014b5e9438 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/282999758" status: 202 len: 0 microversion: 2.1 time: 0.039344 Aug 29 04:50:17.866152 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 57/78] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 04:50:17 2022] DELETE /compute/v2.1/flavors/282999758 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:17.873857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e4f62ae5-8bcd-4c0f-a159-c02084a8b47c tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:17.905374 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e4f62ae5-8bcd-4c0f-a159-c02084a8b47c tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035083 Aug 29 04:50:17.909450 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 58/79] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:17.938678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9c6a6fb7-d7e1-48b4-9b33-d90f833925f4 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1093567658", "id": 1411684830, "os-flavor-access:is_public": "False"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:17.981411 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9c6a6fb7-d7e1-48b4-9b33-d90f833925f4 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.048690 Aug 29 04:50:17.992565 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 59/80] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:17 2022] POST /compute/v2.1/flavors => generated 415 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:17.998859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ad4cca0-be82-40ae-9e7a-2e2840c89e9e tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:18.025820 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ad4cca0-be82-40ae-9e7a-2e2840c89e9e tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030925 Aug 29 04:50:18.040523 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 60/81] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:18.048997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c1d69595-4d7b-4312-8bfa-1928c109b887 tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:18.076277 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c1d69595-4d7b-4312-8bfa-1928c109b887 tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033285 Aug 29 04:50:18.082539 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 61/82] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:18.095248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c902e70-911f-499d-b4d1-a9c4e169bfd2 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:18.129243 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c902e70-911f-499d-b4d1-a9c4e169bfd2 tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1411684830" status: 202 len: 0 microversion: 2.1 time: 0.037777 Aug 29 04:50:18.135078 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 62/83] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:50:18 2022] DELETE /compute/v2.1/flavors/1411684830 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:50:18.163740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71b7574e-8f04-4f18-b645-3637d499deba tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:18.219624 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71b7574e-8f04-4f18-b645-3637d499deba tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080492 Aug 29 04:50:18.235193 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 63/84] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:18.250299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d178f34e-286b-469e-b188-d67b5ebcdbbf tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-761700272", "id": 2024217913, "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:18.300079 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d178f34e-286b-469e-b188-d67b5ebcdbbf tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.059239 Aug 29 04:50:18.302214 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 64/85] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:18 2022] POST /compute/v2.1/flavors => generated 413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:18.314171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b3429af7-b84f-4fb2-b931-45ea4336bf7b tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:18.372793 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b3429af7-b84f-4fb2-b931-45ea4336bf7b tempest-FlavorsAdminTestJSON-1591965860 tempest-FlavorsAdminTestJSON-1591965860-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.061009 Aug 29 04:50:18.378226 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 65/86] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:18 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:18.398457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c38f030c-0488-4c2b-b584-b3f84fc3543e tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:18.439762 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c38f030c-0488-4c2b-b584-b3f84fc3543e tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2024217913" status: 202 len: 0 microversion: 2.1 time: 0.046639 Aug 29 04:50:18.447712 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 66/87] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:50:18 2022] DELETE /compute/v2.1/flavors/2024217913 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:50:18.474865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7094080f-dfd9-4c7d-9c2c-026d851ec94f tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:18.530732 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7094080f-dfd9-4c7d-9c2c-026d851ec94f tempest-FlavorsAdminTestJSON-1979358741 tempest-FlavorsAdminTestJSON-1979358741-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079891 Aug 29 04:50:18.533850 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 67/88] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:20.107919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:50:20.898696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:50:20.900069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:50:20.900834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:50:20.916184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:50:20.917061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:50:20.963536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:20.964390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:20.964990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:20.966064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:20.967409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:20.968308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:21.052427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Getting quotas for project ce08765336dc474e8b9f646d1014cbe6. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:50:21.064210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Getting quotas for user 17de3738d4794c679bbc7cd4bbe02bc3 and project ce08765336dc474e8b9f646d1014cbe6. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:50:21.081709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:50:21.084781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:50:21.179296 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.945762 Aug 29 04:50:21.187376 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 22/89] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:50:21.192852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff364b74-b13d-48c5-8599-551af0345647 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:21.194600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff364b74-b13d-48c5-8599-551af0345647 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:23.171063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ff364b74-b13d-48c5-8599-551af0345647 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:23.194795 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff364b74-b13d-48c5-8599-551af0345647 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1242 microversion: 2.1 time: 2.004306 Aug 29 04:50:23.195849 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 68/90] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:21 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1242 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:24.040166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:24.041234 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f960272e-7158-425f-b6de-76b2020c543d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001419 Aug 29 04:50:24.042149 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 23/91] 10.222.0.20 () {56 vars in 886 bytes} [Mon Aug 29 04:50:24 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 04:50:24.220089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:24.220847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:24.232156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:24.234080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:24.234694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:24.236392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:24.238174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:24.238786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:24.527529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:24.547244 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7897d87-9803-4132-b792-543e76adc0b4 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1298 microversion: 2.1 time: 0.331891 Aug 29 04:50:24.548299 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 69/92] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:24 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1298 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:25.577599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:25.578760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:25.603157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:25.603754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:25.604332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:25.605065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:25.605681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:25.606415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:25.845275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:25.869676 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-526b6c03-4ee9-4107-9d46-758b01d529da tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1296 microversion: 2.1 time: 0.299439 Aug 29 04:50:25.877677 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 24/93] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:25 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1296 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:26.306710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1587134b-7761-4871-b24e-d14d203738ce tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:26.329282 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1587134b-7761-4871-b24e-d14d203738ce tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.717281 Aug 29 04:50:26.329933 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 70/94] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:50:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:26.919390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:26.920009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:26.940872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:26.941536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:26.941974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:26.943173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:26.943714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:26.944152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:27.233777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:27.243623 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-583df459-f95c-43ec-aec9-4abe2120906d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.346012 Aug 29 04:50:27.245458 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 71/95] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:26 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:27.509868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-935f75a2-32fb-4525-8029-a9695d76c9e7 tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1733824363", "id": 201204300, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:27.551836 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-935f75a2-32fb-4525-8029-a9695d76c9e7 tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 1.209034 Aug 29 04:50:27.551836 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 25/96] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:26 2022] POST /compute/v2.1/flavors => generated 422 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:27.563105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a412482-d5fe-4902-b91c-4da375a6bb8c tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:27.583140 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a412482-d5fe-4902-b91c-4da375a6bb8c tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024585 Aug 29 04:50:27.583739 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 72/97] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Aug 29 04:50:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:27.610270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-84e547b8-2dfd-4975-8e44-9cc7247b072c tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-406572343", "id": 472192401, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:27.639980 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-84e547b8-2dfd-4975-8e44-9cc7247b072c tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.048923 Aug 29 04:50:27.641322 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 26/98] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:27 2022] POST /compute/v2.1/flavors => generated 421 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:27.653205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25543544-f1f3-45bf-b0c9-4c798ad2973a tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:27.666484 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-25543544-f1f3-45bf-b0c9-4c798ad2973a tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016957 Aug 29 04:50:27.677042 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 73/99] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Aug 29 04:50:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:27.695226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2cc34dd7-3bcc-4ba6-9679-d23ed3d310da tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Action: 'create', calling method: .version_select at 0x7f1aba4c54c0>, body: {"keypair": {"name": "tempest-keypair-232144476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfty/hQTj2RduaobSy4re0z9s6p3ISVvDdIy8DZr3DoTO9AAIabnL3/kBAG1E3ENqqgVUUaZLgPyGfssUBVGw2d3rOxGY1K4zy63SHT91rULtyrzBuA/ntrY67XGAcD3w=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:27.736985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-2cc34dd7-3bcc-4ba6-9679-d23ed3d310da tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Getting quotas for project ff90f242c8c443ea81148656e08dd959. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:50:27.742753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-2cc34dd7-3bcc-4ba6-9679-d23ed3d310da tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Getting quotas for user a7d92346a9fb41fdb9c482a405661d2b and project ff90f242c8c443ea81148656e08dd959. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:50:27.776554 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2cc34dd7-3bcc-4ba6-9679-d23ed3d310da tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086634 Aug 29 04:50:27.776554 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 27/100] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:50:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:28.269004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:28.270068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:28.304034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:28.309244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:28.310371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:28.311872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:28.316081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:28.317881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:28.819225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:28.829302 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b527a3c9-b01e-4990-aa1a-4a52a5d036e8 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.566824 Aug 29 04:50:28.859723 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 74/101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:28 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:29.448133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Calling method '.version_select at 0x7f1aba59d430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:29.449928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:29.450402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:29.453087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:29.533218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:29.533964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:29.535049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:29.565367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:29.566396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:29.567778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:29.584421 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5858168b-e59e-45a8-bc87-46c678ffeaf4 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.659613 Aug 29 04:50:29.585810 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 28/102] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:29.863589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87159622-a09f-41c8-93eb-35c724986c38 tempest-InstanceUsageAuditLogTestJSON-1454324823 tempest-InstanceUsageAuditLogTestJSON-1454324823-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:29.923700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-87159622-a09f-41c8-93eb-35c724986c38 tempest-InstanceUsageAuditLogTestJSON-1454324823 tempest-InstanceUsageAuditLogTestJSON-1454324823-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 04:50:29" status: 200 len: 318 microversion: 2.1 time: 0.630750 Aug 29 04:50:29.926523 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 75/103] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 04:50:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2004%3A50%3A29 => generated 318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:50:29.937460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Calling method '.version_select at 0x7f1ac0c87b80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:29.940736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:29.946097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:29.946810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:30.001518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:30.004741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:30.005878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:30.096797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:30.098703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:30.100568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:30.116943 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28d28519-fc54-4323-a807-dc8518f27765 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-854119-9/servers" status: 200 len: 196 microversion: 2.1 time: 0.188441 Aug 29 04:50:30.120459 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 76/104] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Aug 29 04:50:29 2022] GET /compute/v2.1/os-hypervisors/n-h1-854119-9/servers => generated 196 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:30.508236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a913c652-38a9-437c-8333-529557028579 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:30.512398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a913c652-38a9-437c-8333-529557028579 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:30.513175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a913c652-38a9-437c-8333-529557028579 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:30.513559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a913c652-38a9-437c-8333-529557028579 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:30.514293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a913c652-38a9-437c-8333-529557028579 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:30.514739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a913c652-38a9-437c-8333-529557028579 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:30.522601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a913c652-38a9-437c-8333-529557028579 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:30.553192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-954994414", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:30.576587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a913c652-38a9-437c-8333-529557028579 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.988309 Aug 29 04:50:30.579162 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 29/105] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Aug 29 04:50:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:30.596587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:30.597294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:30.603255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:30.603787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:30.604301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:30.605228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:30.610088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:30.610773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:30.678678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:50:31.235785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:50:31.237398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:50:31.238043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:50:31.238901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:50:31.240077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:50:31.295726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:31.307512 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d392cc8-1fff-4bbd-809b-06201e20b163 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.726699 Aug 29 04:50:31.307944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:31.309484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:31.310083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:31.310456 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 30/106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:30 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:31.313069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:31.314052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:31.317844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:31.321458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c193fc16-38da-4dd0-8a48-72fd0b39ca58 tempest-InstanceUsageAuditLogTestJSON-1454324823 tempest-InstanceUsageAuditLogTestJSON-1454324823-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:31.370602 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c193fc16-38da-4dd0-8a48-72fd0b39ca58 tempest-InstanceUsageAuditLogTestJSON-1454324823 tempest-InstanceUsageAuditLogTestJSON-1454324823-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.058109 Aug 29 04:50:31.375159 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 31/107] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Aug 29 04:50:31 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:31.389300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Calling method '.version_select at 0x7f1aba45a940>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:31.396328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:31.399313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:31.400005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:31.401522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:50:31.425952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for user 4fbcb22f6bfb44e7b149c0b9e06014b8 and project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:50:31.453968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:31.454689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:31.456269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:31.470161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:50:31.476885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:50:31.485664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:31.487184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:31.489382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:31.509244 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2cac0019-35b1-4ca8-a010-7db507bd868e tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.132351 Aug 29 04:50:31.514009 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 32/108] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:50:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:31.618073 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-acbdcd4c-3992-479f-85a9-779428450126 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493926 Aug 29 04:50:31.620087 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 77/109] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:50:31.632362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-77b1a184-224a-4d37-ad33-d1a118854921 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Calling method '.version_select at 0x7f1aba3dd310>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:31.638274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77b1a184-224a-4d37-ad33-d1a118854921 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:31.640718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77b1a184-224a-4d37-ad33-d1a118854921 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:31.642264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77b1a184-224a-4d37-ad33-d1a118854921 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:31.666051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77b1a184-224a-4d37-ad33-d1a118854921 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:31.666551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77b1a184-224a-4d37-ad33-d1a118854921 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:31.666984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77b1a184-224a-4d37-ad33-d1a118854921 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:31.686634 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-77b1a184-224a-4d37-ad33-d1a118854921 tempest-HypervisorAdminUnderV252Test-1554133013 tempest-HypervisorAdminUnderV252Test-1554133013-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-854119-9/search" status: 200 len: 104 microversion: 2.1 time: 0.065137 Aug 29 04:50:31.687731 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 78/110] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Aug 29 04:50:31 2022] GET /compute/v2.1/os-hypervisors/n-h1-854119-9/search => generated 104 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:31.693935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75b12fd3-9a99-450c-ae8e-072980e4d5b9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:31.694765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-75b12fd3-9a99-450c-ae8e-072980e4d5b9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:31.889787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-75b12fd3-9a99-450c-ae8e-072980e4d5b9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:31.910320 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75b12fd3-9a99-450c-ae8e-072980e4d5b9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1212 microversion: 2.1 time: 0.218143 Aug 29 04:50:31.912049 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 79/111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:31 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1212 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:32.130582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-53a98f12-4d32-4f57-af0a-52d29fd66a46 req-a513af46-3797-4322-9ea7-a71d58c8fcab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa2a319-6a8e-4ec2-aa56-350234e5fd13", "tag": "28e95d53-d75e-46f2-a1bf-7ae6e4ef510e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:32.167729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-53a98f12-4d32-4f57-af0a-52d29fd66a46 req-a513af46-3797-4322-9ea7-a71d58c8fcab service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:32.171922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-53a98f12-4d32-4f57-af0a-52d29fd66a46 req-a513af46-3797-4322-9ea7-a71d58c8fcab service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:32.172472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-53a98f12-4d32-4f57-af0a-52d29fd66a46 req-a513af46-3797-4322-9ea7-a71d58c8fcab service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:32.238376 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-53a98f12-4d32-4f57-af0a-52d29fd66a46 req-a513af46-3797-4322-9ea7-a71d58c8fcab service nova] Creating event network-changed:28e95d53-d75e-46f2-a1bf-7ae6e4ef510e for instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 on n-h1-854119-9 Aug 29 04:50:32.244643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-53a98f12-4d32-4f57-af0a-52d29fd66a46 req-a513af46-3797-4322-9ea7-a71d58c8fcab service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 04:50:32.247795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-53a98f12-4d32-4f57-af0a-52d29fd66a46 req-a513af46-3797-4322-9ea7-a71d58c8fcab service nova] Acquired lock "compute-rpcapi-router" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 04:50:32.250081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01ba7c4-6d11-483d-bf5f-a4dbb3482b71 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:32.250744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01ba7c4-6d11-483d-bf5f-a4dbb3482b71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:32.251864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01ba7c4-6d11-483d-bf5f-a4dbb3482b71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:32.252781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01ba7c4-6d11-483d-bf5f-a4dbb3482b71 None None] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:32.268252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01ba7c4-6d11-483d-bf5f-a4dbb3482b71 None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:32.273900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01ba7c4-6d11-483d-bf5f-a4dbb3482b71 None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:32.306473 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.rpcapi [None req-e01ba7c4-6d11-483d-bf5f-a4dbb3482b71 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 04:50:32.307412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01ba7c4-6d11-483d-bf5f-a4dbb3482b71 None None] Releasing lock "compute-rpcapi-router" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 04:50:32.332814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:32.333435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:32.343318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:32.343811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:32.344294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:32.345004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:32.345450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:32.345871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:32.366515 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e01ba7c4-6d11-483d-bf5f-a4dbb3482b71 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.850965 Aug 29 04:50:32.372148 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 33/112] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:33.329796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4e3b0eb-4b69-4661-9ca6-8a2e23c33e5e tempest-FlavorMetadataValidation-937501976 tempest-FlavorMetadataValidation-937501976-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-644290865", "id": 876107652, "os-flavor-access:is_public": "True"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:33.417838 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4e3b0eb-4b69-4661-9ca6-8a2e23c33e5e tempest-FlavorMetadataValidation-937501976 tempest-FlavorMetadataValidation-937501976-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.772166 Aug 29 04:50:33.429398 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 34/113] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 04:50:32 2022] POST /compute/v2.1/flavors => generated 467 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 04:50:33.436016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:33.437755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:33.447697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:33.448835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:33.449880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:33.451148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:33.453525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:33.454739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:33.653966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:33.667012 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab2dd927-7d82-493e-afd0-d1f39cabf970 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1216 microversion: 2.1 time: 0.234787 Aug 29 04:50:33.669169 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 35/114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:33 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1216 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:33.681966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0ea9d39-e130-4810-adb4-9c60ffdd513f tempest-FlavorMetadataValidation-937501976 tempest-FlavorMetadataValidation-937501976-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:33.859973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:33.874167 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-860017a2-a178-4841-a6bd-bc0b92afe3b9 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 1.545761 Aug 29 04:50:33.887373 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 80/115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:32 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:33.887373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1018670313", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "472192401", "adminPass": "***", "networks": [{"uuid": "eb87980e-7802-4e62-8250-7148cfcebf92"}], "security_groups": [{"name": "tempest-securitygroup--1344051755"}], "key_name": "tempest-keypair-232144476", "user_data": "}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:34.035596 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0ea9d39-e130-4810-adb4-9c60ffdd513f tempest-FlavorMetadataValidation-937501976 tempest-FlavorMetadataValidation-937501976-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/876107652/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.364202 Aug 29 04:50:34.037689 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 36/116] 10.222.0.20 () {62 vars in 1262 bytes} [Mon Aug 29 04:50:33 2022] POST /compute/v2.1/flavors/876107652/os-extra_specs => generated 62 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:34.053449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e173182d-2e99-4ef9-91de-7b67551abc0a tempest-FlavorMetadataValidation-937501976 tempest-FlavorMetadataValidation-937501976-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:34.075959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=11,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:34.085613 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e173182d-2e99-4ef9-91de-7b67551abc0a tempest-FlavorMetadataValidation-937501976 tempest-FlavorMetadataValidation-937501976-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/876107652" status: 202 len: 0 microversion: 2.86 time: 0.040201 Aug 29 04:50:34.089897 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 37/117] 10.222.0.20 () {60 vars in 1199 bytes} [Mon Aug 29 04:50:34 2022] DELETE /compute/v2.1/flavors/876107652 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:50:34.099647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-179f7dc3-cf19-4713-a601-58389967ebe9 tempest-FlavorMetadataValidation-937501976 tempest-FlavorMetadataValidation-937501976-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:34.136104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] validate_networks() for [('eb87980e-7802-4e62-8250-7148cfcebf92', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:50:34.140925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-179f7dc3-cf19-4713-a601-58389967ebe9 tempest-FlavorMetadataValidation-937501976 tempest-FlavorMetadataValidation-937501976-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6678 microversion: 2.86 time: 0.047150 Aug 29 04:50:34.142302 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 38/118] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:50:34 2022] GET /compute/v2.1/flavors/detail => generated 6678 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:50:34.690716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:34.692044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:34.700984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:34.707394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:34.710400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:34.712745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:34.713537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:34.716834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:34.930289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:34.943661 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-887ae2a5-0376-4163-b52b-683231a56f83 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1270 microversion: 2.1 time: 0.256066 Aug 29 04:50:34.946105 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 39/119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:34 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1270 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:34.958598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:34.959920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:34.973392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:34.977891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:34.979499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:34.981954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:34.983710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:34.984438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:35.441552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:35.454306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c36da78b-66c4-4db2-ba5c-0a72493c8a36 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.506813 Aug 29 04:50:35.457895 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 40/120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:34 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:35.969839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:35.970564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:35.982136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:35.982705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:35.983121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:35.986521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:35.987281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:35.987734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:36.517318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:36.527171 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ce6ac85-30fa-465b-b40d-c358a113fcdf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1270 microversion: 2.1 time: 0.564144 Aug 29 04:50:36.547277 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 41/121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:35 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1270 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:36.570922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:36.577474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:36.591655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:36.595013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:36.596935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:36.598048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:36.600553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:36.601278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:37.437936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:37.449582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d14d706f-add2-4d44-a5fc-b8897f3aba48 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.899004 Aug 29 04:50:37.465605 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 42/122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:36 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:37.553780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:37.554923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:37.563687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:37.567420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:37.568289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:37.573152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:37.573949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:37.578926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:37.748581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:37.769119 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9aa36aa-a1ff-4239-95ea-94589496783a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1270 microversion: 2.1 time: 0.219669 Aug 29 04:50:37.784219 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 43/123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:37 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1270 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:37.963582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:50:37.964073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:50:37.964589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:50:37.965001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:50:37.965412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:50:37.990639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:37.991160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:37.991613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:37.998083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:37.998692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:38.002242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:38.070063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Getting quotas for project ff90f242c8c443ea81148656e08dd959. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:50:38.085765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Getting quotas for user a7d92346a9fb41fdb9c482a405661d2b and project ff90f242c8c443ea81148656e08dd959. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:50:38.101296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:38.144885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:50:38.152290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:50:38.313003 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4cb73cf1-5732-48d9-aa19-0acf440f882f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.436625 Aug 29 04:50:38.320490 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 81/124] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:50:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 4445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:50:38.330679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5db72a0a-b708-459d-9932-73bad2557ad1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:38.332795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5db72a0a-b708-459d-9932-73bad2557ad1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:38.474894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:38.475970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:38.492572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:38.493525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:38.494581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:38.495778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:38.496901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:38.502880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:38.565046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5db72a0a-b708-459d-9932-73bad2557ad1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:38.601439 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5db72a0a-b708-459d-9932-73bad2557ad1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1262 microversion: 2.1 time: 0.274753 Aug 29 04:50:38.605102 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 44/125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:38 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1262 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:38.791873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:38.793095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:38.813969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:38.820288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:38.821130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:38.827175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:38.830610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:38.833058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:39.473758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:39.510414 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6f089100-9b8b-4d48-ac01-b959fcc459fa tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 1.039003 Aug 29 04:50:39.514291 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 82/126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:38 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:39.551373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:39.568900 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b86f2e70-19ae-4a6e-9855-b1c80751c486 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.781359 Aug 29 04:50:39.572444 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 45/127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:38 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:39.629559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a52c93d2-b69e-4294-9f0c-72d70963c0a3 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:39.631274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a52c93d2-b69e-4294-9f0c-72d70963c0a3 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:40.001533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a52c93d2-b69e-4294-9f0c-72d70963c0a3 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:40.013875 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a52c93d2-b69e-4294-9f0c-72d70963c0a3 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1262 microversion: 2.1 time: 0.388997 Aug 29 04:50:40.016674 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 83/128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:39 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1262 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:40.535346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:40.535956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:40.547761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:40.552320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:40.561971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:40.564830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:40.567946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:40.571456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:40.596149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:40.596761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:40.610813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:40.612319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:40.615073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:40.617070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:40.619184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:40.620025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:40.629864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=61 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:41.759417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:41.777676 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fad95360-25dd-4c9e-beb6-bdd515640923 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 1.184881 Aug 29 04:50:41.791971 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 84/129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:40 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:41.803252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:41.804199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:41.811309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:41.812004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:41.812791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:41.813810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:41.814390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:41.814958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:41.884453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:41.887912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:41.896997 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-36d7a5e6-8460-40ba-b4c2-c542138d1f9a tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 1.365816 Aug 29 04:50:41.900076 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 46/130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:40 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:41.929982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:41.948336 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a12c19bd-3ed2-427d-b8d1-71aa85b167d2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1314 microversion: 2.1 time: 0.151944 Aug 29 04:50:41.957491 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 85/131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:41 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:42.227363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5f539278-570c-429f-84a1-00fecf76fc79 req-b64c7d41-4522-4210-9368-60aec7d05601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ffbebb-969a-4762-a339-032f7da39897", "tag": "e3cc9390-436f-423e-9d4e-3f5a7740bcc5"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:42.263041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5f539278-570c-429f-84a1-00fecf76fc79 req-b64c7d41-4522-4210-9368-60aec7d05601 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:42.263776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5f539278-570c-429f-84a1-00fecf76fc79 req-b64c7d41-4522-4210-9368-60aec7d05601 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:42.267453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5f539278-570c-429f-84a1-00fecf76fc79 req-b64c7d41-4522-4210-9368-60aec7d05601 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:42.283585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64d771d7-6e93-449c-8f91-b6a923659506 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:42.286272 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-64d771d7-6e93-449c-8f91-b6a923659506 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 29 04:50:42.293686 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5f539278-570c-429f-84a1-00fecf76fc79 req-b64c7d41-4522-4210-9368-60aec7d05601 service nova] Creating event network-changed:e3cc9390-436f-423e-9d4e-3f5a7740bcc5 for instance 53ffbebb-969a-4762-a339-032f7da39897 on n-h2-854119-9 Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64d771d7-6e93-449c-8f91-b6a923659506 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544-project-admin] Request method failure captured: Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWh8O0oiqwolzcLh5_nBN6Lru2jGYOlQvSeFx0vzZ2fep334-FaWgSP8PHH7VFny2uAzgRucAfT1V8nRV2HOjKdc0pVuaYg4fwBMtEavbgcHbtCoKIowVPBl0HkiUPF0ZQi2CyMgt0uUntrPu0dfbHZExxSH4MmzN8_F0nD63Bz5H8 Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: ebb48d0e44174dd8859abdaca743ecc1 Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544 Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:50:42.298760 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebb48d0e44174dd8859abdaca743ecc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebb48d0e44174dd8859abdaca743ecc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebb48d0e44174dd8859abdaca743ecc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebb48d0e44174dd8859abdaca743ecc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544 Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: ebb48d0e44174dd8859abdaca743ecc1 Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544 Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544-project-admin Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 494ff94992cc420ea97db3075c1a9a9a Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544-project-admin Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:42.299991 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid timestamp for date invalid_time Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'invalid_time'} Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:42.300817 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 29 04:50:42.301850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.302629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:42.304706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64d771d7-6e93-449c-8f91-b6a923659506 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:42.306525 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5f539278-570c-429f-84a1-00fecf76fc79 req-b64c7d41-4522-4210-9368-60aec7d05601 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.404955 Aug 29 04:50:42.306642 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-64d771d7-6e93-449c-8f91-b6a923659506 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544 tempest-InstanceUsageAuditLogNegativeTestJSON-1513625544-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.344101 Aug 29 04:50:42.307199 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 86/132] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 04:50:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 349 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:50:42.309270 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 47/133] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:42.759580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d44235c-9898-44ba-96cc-c42f9e4a7e45 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:42.763287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3d44235c-9898-44ba-96cc-c42f9e4a7e45 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '338decbb4c134203934c278764b6ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5bcb661bb642ac974a7d7ecaf0de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d44235c-9898-44ba-96cc-c42f9e4a7e45 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] Request method failure captured: Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWggEcS1xwHyVLXlSNFSK_21HP23zxiqZQ-xGX0ZVvk3RlhtAtJEcRDjmOAriarPTt-n6DJtDsYvyS3hQUMwEe-xv6jh3gEML7BtXuzebhbL2z6Zws024Q0Dyo-ceVPvZWNCZUEVTkRXApc5fcTfgleoQZ6SsDo7GU7muNUF0bhIOY Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fb5bcb661bb642ac974a7d7ecaf0de14 Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:50:42.767154 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb5bcb661bb642ac974a7d7ecaf0de14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb5bcb661bb642ac974a7d7ecaf0de14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb5bcb661bb642ac974a7d7ecaf0de14", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb5bcb661bb642ac974a7d7ecaf0de14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fb5bcb661bb642ac974a7d7ecaf0de14 Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 338decbb4c134203934c278764b6ed9e Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project Aug 29 04:50:42.769062 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: action_args: {} Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:50:42.769743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 04:50:42.771044 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.773081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d44235c-9898-44ba-96cc-c42f9e4a7e45 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:42.773981 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3d44235c-9898-44ba-96cc-c42f9e4a7e45 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.459303 Aug 29 04:50:42.780258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 87/134] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Aug 29 04:50:42 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 466 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:50:42.786053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c20a0b15-05dd-4cf7-86db-b2b47084120d tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:42.788885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c20a0b15-05dd-4cf7-86db-b2b47084120d tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '338decbb4c134203934c278764b6ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5bcb661bb642ac974a7d7ecaf0de14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c20a0b15-05dd-4cf7-86db-b2b47084120d tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] Request method failure captured: Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2004:50:42 HTTP/1.1 Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWggEcS1xwHyVLXlSNFSK_21HP23zxiqZQ-xGX0ZVvk3RlhtAtJEcRDjmOAriarPTt-n6DJtDsYvyS3hQUMwEe-xv6jh3gEML7BtXuzebhbL2z6Zws024Q0Dyo-ceVPvZWNCZUEVTkRXApc5fcTfgleoQZ6SsDo7GU7muNUF0bhIOY Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fb5bcb661bb642ac974a7d7ecaf0de14 Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:50:42.791302 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb5bcb661bb642ac974a7d7ecaf0de14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb5bcb661bb642ac974a7d7ecaf0de14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb5bcb661bb642ac974a7d7ecaf0de14", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb5bcb661bb642ac974a7d7ecaf0de14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fb5bcb661bb642ac974a7d7ecaf0de14 Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 338decbb4c134203934c278764b6ed9e Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project Aug 29 04:50:42.792524 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '2022-08-29 04:50:42'} Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:50:42.793193 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 04:50:42.794434 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:42.798278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c20a0b15-05dd-4cf7-86db-b2b47084120d tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:42.799523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c20a0b15-05dd-4cf7-86db-b2b47084120d tempest-InstanceUsageAuditLogNegativeTestJSON-795659502 tempest-InstanceUsageAuditLogNegativeTestJSON-795659502-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 04:50:42" status: 403 len: 128 microversion: 2.1 time: 0.019730 Aug 29 04:50:42.808965 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 48/135] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 04:50:42 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2004%3A50%3A42 => generated 128 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:50:42.811309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:42.812054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:42.819393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:42.820141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:42.820673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:42.822364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:42.822939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:42.823839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:42.929722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:42.930449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:42.952565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:42.954266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:42.955862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:42.956830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:42.958360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:42.959742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:43.237162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:43.258136 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f943daaa-bd67-443a-aa32-bc9f012c03ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.459477 Aug 29 04:50:43.263030 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 88/136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:42 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:43.289088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:43.290094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:43.300767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:43.302028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:43.304526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:43.304855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:43.306348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:43.309403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:43.353353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:43.362412 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d83bde42-42e1-465e-99d1-4d7e514dbf03 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.438883 Aug 29 04:50:43.363007 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 49/137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:42 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:43.540171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:43.549028 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c78afb94-0628-4f2f-9994-903f34f3d954 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1314 microversion: 2.1 time: 0.272018 Aug 29 04:50:43.549613 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 89/138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:43 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:44.287457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:44.288782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:44.307096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:44.309751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:44.310229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:44.312667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:44.313130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:44.313566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:44.383994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:44.385370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:44.394482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:44.397843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:44.400229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:44.401194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:44.403288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:44.403787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:45.242031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:45.260473 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8bd4e852-77bc-4a63-99a5-cc863f65d02c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.977358 Aug 29 04:50:45.271095 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 50/139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:44 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:45.276160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:45.282326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:45.290816 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e6f0824-efae-4b5d-90cf-31fa43901342 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.911199 Aug 29 04:50:45.299641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:45.313469 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 90/140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:44 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:45.320587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:45.321283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:45.321983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:45.322900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:45.323801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:45.324543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:45.425940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:45.441001 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bcfd58dd-bf1e-4264-9014-c3c31346d126 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1314 microversion: 2.1 time: 0.166709 Aug 29 04:50:45.444592 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 51/141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:45 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:46.298725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:46.302620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:46.328544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:46.329800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:46.338887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:46.339926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:46.340449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:46.345966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:46.788395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-94b0fac2-3e34-47bd-8b6b-098ce04c8627 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Calling method '.version_select at 0x7f1aba325280>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:46.795277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94b0fac2-3e34-47bd-8b6b-098ce04c8627 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:46.795809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94b0fac2-3e34-47bd-8b6b-098ce04c8627 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:46.799771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94b0fac2-3e34-47bd-8b6b-098ce04c8627 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:46.800935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94b0fac2-3e34-47bd-8b6b-098ce04c8627 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:46.801658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94b0fac2-3e34-47bd-8b6b-098ce04c8627 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:46.806337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94b0fac2-3e34-47bd-8b6b-098ce04c8627 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:46.853755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:46.875671 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f59f5bd8-ef10-4c3f-ac80-2fc1dbf08383 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.586565 Aug 29 04:50:46.876332 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 52/142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:46 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:46.897416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:46.900248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:46.920500 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-94b0fac2-3e34-47bd-8b6b-098ce04c8627 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.665724 Aug 29 04:50:46.924723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:46.926117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:46.928424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:46.929234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:46.929706 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 91/143] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Aug 29 04:50:46 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:46.932745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:46.937930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:46.940316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:46.943770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:46.963119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:46.963625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:46.964432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:46.965139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:46.967842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:46.968680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:47.129190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:47.138377 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09ce9daa-1309-44b4-8670-4da328f217ec tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1314 microversion: 2.1 time: 0.206696 Aug 29 04:50:47.153396 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 92/144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:46 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:47.172985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ef81f57-352f-409c-9899-2377108c8421 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Calling method '.version_select at 0x7f1aba339700>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:47.177367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef81f57-352f-409c-9899-2377108c8421 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:47.177854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef81f57-352f-409c-9899-2377108c8421 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:47.178290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef81f57-352f-409c-9899-2377108c8421 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:47.179079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef81f57-352f-409c-9899-2377108c8421 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:47.179534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef81f57-352f-409c-9899-2377108c8421 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:47.179946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef81f57-352f-409c-9899-2377108c8421 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:47.219317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:47.223548 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2ef81f57-352f-409c-9899-2377108c8421 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.056231 Aug 29 04:50:47.224805 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 93/145] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Aug 29 04:50:47 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:47.233918 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0594cbf4-bd3c-4108-9b7a-7b4466347443 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.355168 Aug 29 04:50:47.235028 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 53/146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:46 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:47.250158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72c8ecdc-7ca7-438b-b08e-4db0ed47df76 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Calling method '.version_select at 0x7f1aba3d99d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:47.256733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c8ecdc-7ca7-438b-b08e-4db0ed47df76 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:47.257575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c8ecdc-7ca7-438b-b08e-4db0ed47df76 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:47.258189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c8ecdc-7ca7-438b-b08e-4db0ed47df76 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:47.259298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c8ecdc-7ca7-438b-b08e-4db0ed47df76 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:47.259756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c8ecdc-7ca7-438b-b08e-4db0ed47df76 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:47.260207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c8ecdc-7ca7-438b-b08e-4db0ed47df76 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:47.308380 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72c8ecdc-7ca7-438b-b08e-4db0ed47df76 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.071281 Aug 29 04:50:47.315409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 54/147] 10.222.0.20 () {58 vars in 1145 bytes} [Mon Aug 29 04:50:47 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:50:47.478562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1b5b7ee0-a033-48bc-8c4d-f09ea6026b58 req-e2d0dcfb-746a-4c8d-a83d-4357957d385f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa2a319-6a8e-4ec2-aa56-350234e5fd13", "name": "network-vif-plugged", "status": "completed", "tag": "28e95d53-d75e-46f2-a1bf-7ae6e4ef510e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:47.505774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b5b7ee0-a033-48bc-8c4d-f09ea6026b58 req-e2d0dcfb-746a-4c8d-a83d-4357957d385f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:47.506463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b5b7ee0-a033-48bc-8c4d-f09ea6026b58 req-e2d0dcfb-746a-4c8d-a83d-4357957d385f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:47.507208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b5b7ee0-a033-48bc-8c4d-f09ea6026b58 req-e2d0dcfb-746a-4c8d-a83d-4357957d385f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:47.527397 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1b5b7ee0-a033-48bc-8c4d-f09ea6026b58 req-e2d0dcfb-746a-4c8d-a83d-4357957d385f service nova] Creating event network-vif-plugged:28e95d53-d75e-46f2-a1bf-7ae6e4ef510e for instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 on n-h1-854119-9 Aug 29 04:50:47.528029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b5b7ee0-a033-48bc-8c4d-f09ea6026b58 req-e2d0dcfb-746a-4c8d-a83d-4357957d385f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 04:50:47.528547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b5b7ee0-a033-48bc-8c4d-f09ea6026b58 req-e2d0dcfb-746a-4c8d-a83d-4357957d385f service nova] Acquired lock "compute-rpcapi-router" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 04:50:47.529692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c7adbe-cba7-4c0b-aa02-8ab0e0c2c20c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:47.530218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c7adbe-cba7-4c0b-aa02-8ab0e0c2c20c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:47.530732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c7adbe-cba7-4c0b-aa02-8ab0e0c2c20c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:47.531568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c7adbe-cba7-4c0b-aa02-8ab0e0c2c20c None None] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:47.532080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c7adbe-cba7-4c0b-aa02-8ab0e0c2c20c None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:47.532592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c7adbe-cba7-4c0b-aa02-8ab0e0c2c20c None None] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:47.541805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.compute.rpcapi [None req-a5c7adbe-cba7-4c0b-aa02-8ab0e0c2c20c None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 04:50:47.542773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c7adbe-cba7-4c0b-aa02-8ab0e0c2c20c None None] Releasing lock "compute-rpcapi-router" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 04:50:47.562820 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5c7adbe-cba7-4c0b-aa02-8ab0e0c2c20c None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333920 Aug 29 04:50:47.564543 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 94/148] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:47.899958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:47.900911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:47.912658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:47.913698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:47.914750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:47.916777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:47.918970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:47.920034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:48.164929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:48.167214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:48.172556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:48.177614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:48.178339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:48.179004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:48.180223 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-355a333f-9f58-4d0a-94d1-c3044639c3be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.284317 Aug 29 04:50:48.180794 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 55/149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:47 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:48.181037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:48.182722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:48.183649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:48.259736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:48.260782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:48.266974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:48.268273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:48.269291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:48.274024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:48.274795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:48.276719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:48.310920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:48.321030 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2f554e6-dc94-43eb-b286-16f9796a9e83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1314 microversion: 2.1 time: 0.162659 Aug 29 04:50:48.339490 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 95/150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:48 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:48.502589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:48.517596 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7dd1aee1-cf69-4f09-9ad3-c15ace356118 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.263420 Aug 29 04:50:48.518126 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 56/151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:48 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:49.210497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:49.214133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:49.223776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:49.224387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:49.225062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:49.226595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:49.227456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:49.228207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:49.346653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:49.347634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:49.353657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=16 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:49.355463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:49.356387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:49.357089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:49.357978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:49.358730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:49.359401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:49.487798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:49.501386 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c53bfced-3594-4653-a8d9-42263b95d8cd tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1320 microversion: 2.1 time: 0.158411 Aug 29 04:50:49.514915 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 57/152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:49 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:49.543172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:49.544092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:49.561004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:49.562359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:49.563130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:49.564113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:49.565476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:49.566154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:49.790224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:49.798307 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57cfaf19-b160-4e54-86ba-9b0227a994e2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.594290 Aug 29 04:50:49.811776 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 96/153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:49 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:50.083303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:50.128970 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0250893b-10a6-4ea9-8741-f9a54a33a101 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1338 microversion: 2.1 time: 0.594493 Aug 29 04:50:50.129616 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 58/154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:49 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1338 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:50.524708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:50.525959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:50.533786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=22 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:50.545898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:50.546637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:50.547381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:50.549519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:50.551433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:50.554043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:50.700420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:50.714195 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b52087a6-fa7c-4b31-ba42-bce43a1747c2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1320 microversion: 2.1 time: 0.194873 Aug 29 04:50:50.715290 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 97/155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:50 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:50.832508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:50.833138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:50.854213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:50.854721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:50.855513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:50.856467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:50.857114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:50.857977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:51.157065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:51.157998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:51.167096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:51.168748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:51.169364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:51.170238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:51.170832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:51.171386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:51.388970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:51.397792 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42407804-72de-4366-bb4e-d6df9b1adfb5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.582494 Aug 29 04:50:51.401467 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 59/156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:50 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:51.735030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:51.735663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:51.747027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:51.747906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:51.748523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:51.749420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:51.751042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:51.760343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:51.762349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:51.788055 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e84e0b3-44e5-4515-a966-262d286adc6f tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1488 microversion: 2.1 time: 0.639189 Aug 29 04:50:51.802609 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 98/157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:51 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1488 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:51.814944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3df580ce-4ae0-4d64-885e-ae529945c0f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:51.815728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3df580ce-4ae0-4d64-885e-ae529945c0f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:51.830551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df580ce-4ae0-4d64-885e-ae529945c0f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:51.832404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df580ce-4ae0-4d64-885e-ae529945c0f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:51.833867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df580ce-4ae0-4d64-885e-ae529945c0f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:51.836221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df580ce-4ae0-4d64-885e-ae529945c0f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:51.836916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df580ce-4ae0-4d64-885e-ae529945c0f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:51.837570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df580ce-4ae0-4d64-885e-ae529945c0f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:52.244860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:52.257689 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8cd41ad8-5244-4d27-a2b5-eb87cbfef31f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 0.526485 Aug 29 04:50:52.258284 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 60/158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:51 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:52.431433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:52.432071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:52.440969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:52.441480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:52.441920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:52.442633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:52.443087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:52.443509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:52.835958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:52.861549 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5dec1b3e-a344-438b-8905-72e0a511270d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.424400 Aug 29 04:50:52.861549 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 61/159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:52 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:52.871050 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3df580ce-4ae0-4d64-885e-ae529945c0f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1639 microversion: 2.1 time: 1.063208 Aug 29 04:50:52.875784 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 99/160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:51 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1639 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:52.896189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:52.896189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:52.908574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:52.909117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:52.914427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:52.915246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:52.915718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:52.916386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:52.952891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:50:53.039574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d4e3e3b2-5066-4596-80ed-e7bf5358c628 req-22464e43-2c22-4f76-bb02-375258d0c626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd58c75-b4bb-4fd6-846e-e3cb7e72388a", "tag": "7de24bde-df42-4bc2-9d60-e138225d92a4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:53.056759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d4e3e3b2-5066-4596-80ed-e7bf5358c628 req-22464e43-2c22-4f76-bb02-375258d0c626 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:53.057256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d4e3e3b2-5066-4596-80ed-e7bf5358c628 req-22464e43-2c22-4f76-bb02-375258d0c626 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:53.060883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d4e3e3b2-5066-4596-80ed-e7bf5358c628 req-22464e43-2c22-4f76-bb02-375258d0c626 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:53.078806 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d4e3e3b2-5066-4596-80ed-e7bf5358c628 req-22464e43-2c22-4f76-bb02-375258d0c626 service nova] Creating event network-changed:7de24bde-df42-4bc2-9d60-e138225d92a4 for instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a on n-h2-854119-9 Aug 29 04:50:53.088337 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d4e3e3b2-5066-4596-80ed-e7bf5358c628 req-22464e43-2c22-4f76-bb02-375258d0c626 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052804 Aug 29 04:50:53.089600 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 100/161] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:53.153617 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7732d66-1fcc-48ff-b106-714985d47fbd tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 204 len: 0 microversion: 2.1 time: 0.263909 Aug 29 04:50:53.154229 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 62/162] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:50:52 2022] DELETE /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:50:53.163627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:53.164408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:53.171868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:53.172944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:53.173555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:53.174600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:53.175353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:53.175929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:53.283940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:53.285142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:53.300067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:53.300670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:53.301114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:53.301865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:53.302309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:53.302735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:53.393737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:53.408157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-34edbc13-a5c8-4249-b518-c2e3bee14761 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1494 microversion: 2.1 time: 0.249006 Aug 29 04:50:53.411416 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 101/163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:53 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1494 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:53.502475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:53.519533 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc041f52-7c3a-4101-8933-08fa9e76d51c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 0.244188 Aug 29 04:50:53.524559 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 63/164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:53 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:53.869147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:53.869758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:53.887703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:53.888894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:53.889484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:53.890194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:53.890643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:53.899025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:54.276502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:54.293882 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7cb4b95a-b522-45b7-9aca-1f2926eab76e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.428261 Aug 29 04:50:54.310710 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 102/165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:53 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:54.430747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:54.432949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:54.446884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:54.449667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:54.451511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:54.452469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:54.454465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:54.460499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:54.479171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:54.547436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:54.548233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:54.554581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:54.555070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:54.555499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:54.556336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:54.557015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:54.557608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:55.510438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:55.528297 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42760a0b-c314-4b6b-86cb-90dc77fa704d tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1494 microversion: 2.1 time: 1.101929 Aug 29 04:50:55.531284 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 64/166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:54 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1494 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:55.538440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:55.539244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:55.554444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:55.555158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:55.555880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:55.556753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:55.560876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:55.561538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:55.639132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:55.656992 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5f1d55f8-f811-4c06-8edb-8c77fdf2cfb0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 1.113934 Aug 29 04:50:55.657916 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 103/167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:54 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:56.058254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:56.086807 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f051477-3bbe-4fde-b71b-5ddf388937b7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.550782 Aug 29 04:50:56.087775 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 65/168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:55 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:56.554219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:56.555194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:56.582227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:56.582836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:56.588953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:56.589966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:56.591129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:56.591738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:56.677273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:56.677904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:56.686935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:56.690441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:56.691247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:56.692145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:56.692746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:56.695165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:56.804862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17de3738d4794c679bbc7cd4bbe02bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08765336dc474e8b9f646d1014cbe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:56.818921 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2dffba6-c422-491d-9687-e152710f1a30 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 200 len: 1452 microversion: 2.1 time: 0.268410 Aug 29 04:50:56.837771 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 104/169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:56 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 1452 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:57.107439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:57.108059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:57.117658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:57.118156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:57.118581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:57.119299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:57.119756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:57.120194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:57.135107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:57.285064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:57.540538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:50:58.022334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:58.037673 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ded62f3b-3262-4588-81e7-94fa531834ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 1.360804 Aug 29 04:50:58.052232 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 66/170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:56 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:58.052852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4aac6572-0d45-4e60-8940-fbf60fe64901 req-5fba8898-a629-42c8-b3cb-beabf81924e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa2a319-6a8e-4ec2-aa56-350234e5fd13", "name": "network-vif-deleted", "tag": "28e95d53-d75e-46f2-a1bf-7ae6e4ef510e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:58.078528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4aac6572-0d45-4e60-8940-fbf60fe64901 req-5fba8898-a629-42c8-b3cb-beabf81924e2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.079461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4aac6572-0d45-4e60-8940-fbf60fe64901 req-5fba8898-a629-42c8-b3cb-beabf81924e2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.079760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4aac6572-0d45-4e60-8940-fbf60fe64901 req-5fba8898-a629-42c8-b3cb-beabf81924e2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.109018 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4aac6572-0d45-4e60-8940-fbf60fe64901 req-5fba8898-a629-42c8-b3cb-beabf81924e2 service nova] Creating event network-vif-deleted:28e95d53-d75e-46f2-a1bf-7ae6e4ef510e for instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 on n-h1-854119-9 Aug 29 04:50:58.121989 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4aac6572-0d45-4e60-8940-fbf60fe64901 req-5fba8898-a629-42c8-b3cb-beabf81924e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073101 Aug 29 04:50:58.123328 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 67/171] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:58.142946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:58.144084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:58.162733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.163500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.164085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.166284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.168026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.172595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.215486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:58.226394 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6728b0e7-53aa-4400-bb9e-7e1ad9ea4da2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 1.123012 Aug 29 04:50:58.229762 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 105/172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:57 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:50:58.236299 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] HTTP exception thrown: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Request method failure captured: Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 HTTP/1.1 Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWBkic4kEiPuUSk1lxs9HuBF6D_okBuGZpGzR44vwMAeRqe4Rwdr5slylo9-GwUaPhspUW9Q_tsKsUI3uKkOchHzpLYFcg66z1RWawOXP7KtbX_cOm6HpOYawmii7B9Zf2THLbDNVwPVBJ73bq8txpIp9B4uLxbcEH0B6-wOkRyQdA Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ce08765336dc474e8b9f646d1014cbe6 Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AggregatesAdminTestJSON-1577717649 Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:50:58.252408 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce08765336dc474e8b9f646d1014cbe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce08765336dc474e8b9f646d1014cbe6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce08765336dc474e8b9f646d1014cbe6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce08765336dc474e8b9f646d1014cbe6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AggregatesAdminTestJSON-1577717649 Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ce08765336dc474e8b9f646d1014cbe6 Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1577717649 Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AggregatesAdminTestJSON-1577717649-project Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 17de3738d4794c679bbc7cd4bbe02bc3 Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AggregatesAdminTestJSON-1577717649-project Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:50:58.253853 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ffa2a319-6a8e-4ec2-aa56-350234e5fd13'} Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:58.254630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:50:58.255886 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:50:58.260635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Returning 404 to user: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:58.264007 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dd08efec-b8ce-4cb6-8625-20b976cd382e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 404 len: 111 microversion: 2.1 time: 0.138008 Aug 29 04:50:58.266106 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 68/173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:58 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:50:58.274770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-95d59292-e077-4e6e-bed2-3276c45e42e2 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:58.302209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95d59292-e077-4e6e-bed2-3276c45e42e2 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.302779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95d59292-e077-4e6e-bed2-3276c45e42e2 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.303161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95d59292-e077-4e6e-bed2-3276c45e42e2 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.528268 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-95d59292-e077-4e6e-bed2-3276c45e42e2 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.257188 Aug 29 04:50:58.528884 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 106/174] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:50:58 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:58.540548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b95d4e72-3280-4c9d-87e2-2b43b1ee131d tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:58.582823 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b95d4e72-3280-4c9d-87e2-2b43b1ee131d tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.046202 Aug 29 04:50:58.583446 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 69/175] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:50:58 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:50:58.595637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f3c67cfb-5272-43eb-beb8-8263b7606911 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Calling method '.version_select at 0x7f1aba3908b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:58.599732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3c67cfb-5272-43eb-beb8-8263b7606911 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.600394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3c67cfb-5272-43eb-beb8-8263b7606911 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.600828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3c67cfb-5272-43eb-beb8-8263b7606911 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.601551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3c67cfb-5272-43eb-beb8-8263b7606911 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.602003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3c67cfb-5272-43eb-beb8-8263b7606911 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.602487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3c67cfb-5272-43eb-beb8-8263b7606911 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.662244 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f3c67cfb-5272-43eb-beb8-8263b7606911 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.070882 Aug 29 04:50:58.662864 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 107/176] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Aug 29 04:50:58 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:58.673746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-969a5c69-95ae-472e-90b8-074abbb9dbe8 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Calling method '.version_select at 0x7f1aba1cd700>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:58.679368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969a5c69-95ae-472e-90b8-074abbb9dbe8 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.679783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969a5c69-95ae-472e-90b8-074abbb9dbe8 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.686910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969a5c69-95ae-472e-90b8-074abbb9dbe8 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.687877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969a5c69-95ae-472e-90b8-074abbb9dbe8 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.688388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969a5c69-95ae-472e-90b8-074abbb9dbe8 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.688815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969a5c69-95ae-472e-90b8-074abbb9dbe8 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.752289 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-969a5c69-95ae-472e-90b8-074abbb9dbe8 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.082064 Aug 29 04:50:58.752902 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 70/177] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:50:58 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:58.764767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d71be4af-9ad4-4551-80a2-885b28b2972b tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Calling method '.version_select at 0x7f1aba3b2790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:58.769524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71be4af-9ad4-4551-80a2-885b28b2972b tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.770010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71be4af-9ad4-4551-80a2-885b28b2972b tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.770441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71be4af-9ad4-4551-80a2-885b28b2972b tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.771166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71be4af-9ad4-4551-80a2-885b28b2972b tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.771611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71be4af-9ad4-4551-80a2-885b28b2972b tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.772029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71be4af-9ad4-4551-80a2-885b28b2972b tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.805463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c8be383e-f31c-4da2-9117-04e2c40804d6 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1379617484"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:58.854500 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d71be4af-9ad4-4551-80a2-885b28b2972b tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.093274 Aug 29 04:50:58.863081 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 108/178] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Aug 29 04:50:58 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:58.867887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bbc395c3-aa5c-4b47-be65-bebd26acdf37 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Calling method '.version_select at 0x7f1aba3008b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:58.880397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.aggregate [None req-c8be383e-f31c-4da2-9117-04e2c40804d6 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Generated uuid 0b3d8007-f967-480f-a0a2-23cbfe442870 for aggregate {{(pid=128871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:50:58.912789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc395c3-aa5c-4b47-be65-bebd26acdf37 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.924510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc395c3-aa5c-4b47-be65-bebd26acdf37 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.925740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc395c3-aa5c-4b47-be65-bebd26acdf37 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.949835 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c8be383e-f31c-4da2-9117-04e2c40804d6 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.148618 Aug 29 04:50:58.950448 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 71/179] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:50:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:50:58.961653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b6d4a3d-5dcc-41a6-ab88-8598812848db tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:58.977642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc395c3-aa5c-4b47-be65-bebd26acdf37 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.978641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc395c3-aa5c-4b47-be65-bebd26acdf37 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.979278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc395c3-aa5c-4b47-be65-bebd26acdf37 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.992104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b6d4a3d-5dcc-41a6-ab88-8598812848db tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:58.992830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b6d4a3d-5dcc-41a6-ab88-8598812848db tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:58.994141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b6d4a3d-5dcc-41a6-ab88-8598812848db tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:58.994963 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bbc395c3-aa5c-4b47-be65-bebd26acdf37 tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h1-854119-9" status: 200 len: 332 microversion: 2.1 time: 0.130674 Aug 29 04:50:59.001095 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 109/180] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 29 04:50:58 2022] GET /compute/v2.1/os-hosts/n-h1-854119-9 => generated 332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:59.006319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-10b30fe7-f60d-446c-806e-0222b4d1c1fa tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Calling method '.version_select at 0x7f1aba2a9310>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:59.028380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10b30fe7-f60d-446c-806e-0222b4d1c1fa tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:59.028887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10b30fe7-f60d-446c-806e-0222b4d1c1fa tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:59.029323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10b30fe7-f60d-446c-806e-0222b4d1c1fa tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:59.046670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10b30fe7-f60d-446c-806e-0222b4d1c1fa tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:59.047150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10b30fe7-f60d-446c-806e-0222b4d1c1fa tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:59.047637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10b30fe7-f60d-446c-806e-0222b4d1c1fa tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:59.072576 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-10b30fe7-f60d-446c-806e-0222b4d1c1fa tempest-HostsAdminTestJSON-1849991036 tempest-HostsAdminTestJSON-1849991036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h2-854119-9" status: 200 len: 598 microversion: 2.1 time: 0.069947 Aug 29 04:50:59.073509 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 110/181] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 29 04:50:59 2022] GET /compute/v2.1/os-hosts/n-h2-854119-9 => generated 598 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:59.080296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:59.080979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:59.101728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:59.107608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:59.108284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:59.109176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:59.111663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:59.114571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:59.246093 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b6d4a3d-5dcc-41a6-ab88-8598812848db tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.288084 Aug 29 04:50:59.253004 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 72/182] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:50:58 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:50:59.253004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:50:59.253004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:50:59.268245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:59.269092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:59.269537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:59.270259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:59.283615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:59.285451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:59.465690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:59.489629 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-05a6a536-56f3-4dda-b5cc-ef3e2f21c486 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 0.414768 Aug 29 04:50:59.512147 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 111/183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:59 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:59.519399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22e6f19e-78a1-42b3-b9da-e5d33a7fe876 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:59.553942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e6f19e-78a1-42b3-b9da-e5d33a7fe876 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:59.556264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e6f19e-78a1-42b3-b9da-e5d33a7fe876 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:59.558103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e6f19e-78a1-42b3-b9da-e5d33a7fe876 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:50:59.645759 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-22e6f19e-78a1-42b3-b9da-e5d33a7fe876 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] HTTP exception thrown: Aggregate 3 already has host n-h1-854119-9. Aug 29 04:50:59.672970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:50:59.686563 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09c6a7e3-76e4-4a7f-8aba-c7d773477d19 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.434942 Aug 29 04:50:59.705566 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 73/184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:50:59 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22e6f19e-78a1-42b3-b9da-e5d33a7fe876 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Request method failure captured: Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 39 Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWVGPuPUUKMyUzKF0iuz6_Scqq_ASX_dfG_-kCcWACdb8lY5PgTFlNjnQAi3v74On5LfOwIRNWwbi1my2g7upXhMpS0HZn4lesACuQIL213JWmBBMAVLWuGpXYmIA5umTb4Z5krkGWVFPeawglItuAarzTxcs-0S9OW6ulKRTqmR7Q Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:50:59.820700 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e02abee07944f68ae3c2775a40e7f5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b4c798cec26c4da4ae158bd3923dcad2 Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: {"add_host": {"host": "n-h1-854119-9"}} Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:50:59.822191 n-d-854119-9 devstack@n-api.service[128872]: exception: Aggregate 3 already has host n-h1-854119-9. Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-854119-9'}}} Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result.read() Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 04:50:59.823526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-854119-9-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 04:50:59.824848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 04:50:59.825906 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 04:50:59.826956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result.read() Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-854119-9-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 4, 50, 59, 617925), 'updated_at': None, 'host': 'n-h1-854119-9', 'aggregate_id': 3}] Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:59.827866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 3 already has host n-h1-854119-9. Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:59.828753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 3 already has host n-h1-854119-9. Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:50:59.830340 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:50:59.831400 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 3 already has host n-h1-854119-9. Aug 29 04:50:59.831400 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:50:59.833160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22e6f19e-78a1-42b3-b9da-e5d33a7fe876 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Returning 409 to user: Aggregate 3 already has host n-h1-854119-9. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:50:59.834460 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22e6f19e-78a1-42b3-b9da-e5d33a7fe876 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 409 len: 95 microversion: 2.1 time: 0.332922 Aug 29 04:50:59.840080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 112/185] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:50:59 2022] POST /compute/v2.1/os-aggregates/3/action => generated 95 bytes in 339 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 29 04:50:59.859730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-58ac46f6-574e-409f-ba64-8cbd58415f8b tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:50:59.874200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58ac46f6-574e-409f-ba64-8cbd58415f8b tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:50:59.874926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58ac46f6-574e-409f-ba64-8cbd58415f8b tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:50:59.875718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58ac46f6-574e-409f-ba64-8cbd58415f8b tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:00.042804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1296490137", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "a8766693-25d9-4aae-b9cf-1bcb5ffe843b"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:00.068552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=5,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:00.129441 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-58ac46f6-574e-409f-ba64-8cbd58415f8b tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.279723 Aug 29 04:51:00.133249 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 113/186] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:50:59 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:00.148186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad1d63c6-c7bf-4738-a609-2dd06c68a3b3 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:00.170507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] validate_networks() for [('a8766693-25d9-4aae-b9cf-1bcb5ffe843b', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:51:00.189874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:00.212264 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad1d63c6-c7bf-4738-a609-2dd06c68a3b3 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.070076 Aug 29 04:51:00.214420 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 114/187] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:00 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 29 04:51:00.232182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2fc98c13-deac-49fd-9875-116186d20dda tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-849796104"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:00.239954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-2fc98c13-deac-49fd-9875-116186d20dda tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Generated uuid f71b1f8e-10dc-4f5e-bba6-4d375cee7022 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:00.277830 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2fc98c13-deac-49fd-9875-116186d20dda tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.056820 Aug 29 04:51:00.280038 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 115/188] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:00 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:00.285324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e4affdfc-ccee-4f94-a2a3-3211e7b503ea tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1707156381"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:00.289891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-e4affdfc-ccee-4f94-a2a3-3211e7b503ea tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Generated uuid 4f1ad815-73c6-48a9-bec0-05aad562f51a for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:00.324749 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e4affdfc-ccee-4f94-a2a3-3211e7b503ea tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042850 Aug 29 04:51:00.326191 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 116/189] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:00.538107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e38481f7-bc24-4462-b6c4-1928eebe64ab tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:00.544223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e38481f7-bc24-4462-b6c4-1928eebe64ab tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '74e66494c1aa4e92b2c4ccafd70ba020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839dd978a464cef90cab897d513f25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e38481f7-bc24-4462-b6c4-1928eebe64ab tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Request method failure captured: Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 39 Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWQNGeDCubECVkoDs0s7KCj2u2Uhw4BaTBoiDjXsvuIG5PiaNpj_eMcnSAmCZEnf01Z90zAfkpS42WjbLZH4XIWqchct-fQK4gcS_SIU9CblEcCPN1GU_x9w-1WiDgWk-AEqpF4XAvcNxijepJph83VE020r9RzjfPnscJAqAyW3ME Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:00.547226 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7839dd978a464cef90cab897d513f25b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7839dd978a464cef90cab897d513f25b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 74e66494c1aa4e92b2c4ccafd70ba020 Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: {"add_host": {"host": "n-h1-854119-9"}} Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:00.548496 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h1-854119-9'}}} Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:00.549162 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 04:51:00.550256 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:00.554215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e38481f7-bc24-4462-b6c4-1928eebe64ab tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:00.555317 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e38481f7-bc24-4462-b6c4-1928eebe64ab tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 403 len: 118 microversion: 2.1 time: 0.227887 Aug 29 04:51:00.556391 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 117/190] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:51:00 2022] POST /compute/v2.1/os-aggregates/4/action => generated 118 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:00.562372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5e89f19-0550-4971-9a80-e2936c5f6888 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:00.580472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e89f19-0550-4971-9a80-e2936c5f6888 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:00.581252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e89f19-0550-4971-9a80-e2936c5f6888 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:00.581906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e89f19-0550-4971-9a80-e2936c5f6888 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:00.837119 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5e89f19-0550-4971-9a80-e2936c5f6888 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.279350 Aug 29 04:51:00.837702 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 118/191] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:51:00 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:00.852614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:00.853241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:00.896306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:00.896927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:00.897373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:00.903038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:00.908087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:00.911426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:01.551675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:51:01.552801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:51:01.553501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:51:01.554103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:51:01.554743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:51:01.572834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:01.573692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:01.574914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:01.577066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:01.580976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:01.583667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:01.610305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for project 2864fc0a731f4945a27e68889572000f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:51:01.618510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:01.619003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for user 62ea00a8210b4ede95e54c53e7445794 and project 2864fc0a731f4945a27e68889572000f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:51:01.629274 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e50ba1a4-cc1e-4a36-ab0c-e21d5f7f4be2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 0.790224 Aug 29 04:51:01.631060 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 119/192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:00 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:01.636333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e507e5d7-2c56-4ada-851a-5afa4984b23d tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:01.668109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:51:01.675792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:51:01.691440 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e507e5d7-2c56-4ada-851a-5afa4984b23d tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.058803 Aug 29 04:51:01.697778 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 120/193] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:01 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:01.704234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:01.709975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:01.721309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:01.723221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:01.727457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:01.728526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:01.729242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:01.732980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:01.793292 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f00de869-9bef-4d85-bcd0-a298dc100c4e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.085602 Aug 29 04:51:01.794338 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 74/194] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 04:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 04:51:01.804319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f322d9f9-99db-4607-b998-6bb8bd94b048 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:01.815285 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f322d9f9-99db-4607-b998-6bb8bd94b048 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/5" status: 200 len: 242 microversion: 2.1 time: 0.019592 Aug 29 04:51:01.816138 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 75/195] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 29 04:51:01 2022] GET /compute/v2.1/os-aggregates/5 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:01.827611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e80d5cb0-8939-438a-9c3a-f24e0e41d30e tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-815603954"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:01.843611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.aggregate [None req-e80d5cb0-8939-438a-9c3a-f24e0e41d30e tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Generated uuid eb679cbf-333a-414a-a516-089d88fb576f for aggregate {{(pid=128871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:01.909620 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e80d5cb0-8939-438a-9c3a-f24e0e41d30e tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.091326 Aug 29 04:51:01.910687 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 76/196] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:01.925300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-399754d4-0278-4a5a-a99c-04905c59b316 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:01.928216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-399754d4-0278-4a5a-a99c-04905c59b316 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:02.090054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-399754d4-0278-4a5a-a99c-04905c59b316 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:02.104185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-399754d4-0278-4a5a-a99c-04905c59b316 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:02.112774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-399754d4-0278-4a5a-a99c-04905c59b316 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:02.116319 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-399754d4-0278-4a5a-a99c-04905c59b316 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1262 microversion: 2.25 time: 0.203736 Aug 29 04:51:02.121434 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 77/197] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:01 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1262 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:02.139254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4425877-bf43-47f2-b8d2-587b963bfec1 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-9"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.140542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:02.149215 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-64a8df2e-86a9-4ce8-a347-1d81e781a4dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.449920 Aug 29 04:51:02.150833 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 121/198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:01 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:02.169575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1362998077"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.189382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4425877-bf43-47f2-b8d2-587b963bfec1 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:02.190025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4425877-bf43-47f2-b8d2-587b963bfec1 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:02.190538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4425877-bf43-47f2-b8d2-587b963bfec1 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:02.192965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:02.193839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:02.194664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:02.214916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:02.216623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:02.227832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:02.247480 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1362998077 could not be found. Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Request method failure captured: Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 58 Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWVGPuPUUKMyUzKF0iuz6_Scqq_ASX_dfG_-kCcWACdb8lY5PgTFlNjnQAi3v74On5LfOwIRNWwbi1my2g7upXhMpS0HZn4lesACuQIL213JWmBBMAVLWuGpXYmIA5umTb4Z5krkGWVFPeawglItuAarzTxcs-0S9OW6ulKRTqmR7Q Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:02.261230 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e02abee07944f68ae3c2775a40e7f5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b4c798cec26c4da4ae158bd3923dcad2 Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: {"add_host": {"host": "tempest-nonexist_host-1362998077"}} Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:02.262338 n-d-854119-9 devstack@n-api.service[128872]: exception: Compute host tempest-nonexist_host-1362998077 could not be found. Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6', 'body': {'add_host': {'host': 'tempest-nonexist_host-1362998077'}}} Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1362998077' is not mapped to any cell Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.263098 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 29 04:51:02.264701 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1362998077 could not be found. Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1362998077 could not be found. Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.265801 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.268797 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.268797 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.268797 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.268797 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:02.268797 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:02.268797 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1362998077 could not be found. Aug 29 04:51:02.268797 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.281125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1362998077 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:02.282208 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b111eecc-e723-48d2-be69-7aab914e6b61 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/6/action" status: 404 len: 111 microversion: 2.1 time: 0.130320 Aug 29 04:51:02.283060 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 122/199] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates/6/action => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:02.310685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae6213e2-b95e-4b2d-8bed-2d1230e2f9ab tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:02.365159 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae6213e2-b95e-4b2d-8bed-2d1230e2f9ab tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.071213 Aug 29 04:51:02.370577 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 123/200] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:02 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:02.376376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-247db793-297d-4a83-901f-9256e531251d tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-247db793-297d-4a83-901f-9256e531251d tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Request method failure captured: Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 283 Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWVGPuPUUKMyUzKF0iuz6_Scqq_ASX_dfG_-kCcWACdb8lY5PgTFlNjnQAi3v74On5LfOwIRNWwbi1my2g7upXhMpS0HZn4lesACuQIL213JWmBBMAVLWuGpXYmIA5umTb4Z5krkGWVFPeawglItuAarzTxcs-0S9OW6ulKRTqmR7Q Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:02.380079 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e02abee07944f68ae3c2775a40e7f5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b4c798cec26c4da4ae158bd3923dcad2 Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:02.381532 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:51:02.382442 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:02.383069 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.384538 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.385467 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:51:02.385467 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:51:02.385467 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 04:51:02.385467 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.400563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-247db793-297d-4a83-901f-9256e531251d tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:02.401604 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-247db793-297d-4a83-901f-9256e531251d tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.029408 Aug 29 04:51:02.409468 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 124/201] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:51:02.418603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-067f3297-e680-4904-bb3a-8f9b4c40b5c9 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-067f3297-e680-4904-bb3a-8f9b4c40b5c9 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Request method failure captured: Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 27 Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWVGPuPUUKMyUzKF0iuz6_Scqq_ASX_dfG_-kCcWACdb8lY5PgTFlNjnQAi3v74On5LfOwIRNWwbi1my2g7upXhMpS0HZn4lesACuQIL213JWmBBMAVLWuGpXYmIA5umTb4Z5krkGWVFPeawglItuAarzTxcs-0S9OW6ulKRTqmR7Q Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:02.423736 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e02abee07944f68ae3c2775a40e7f5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b4c798cec26c4da4ae158bd3923dcad2 Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: {"aggregate": {"name": ""}} Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:02.425562 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi '' Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:02.426237 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 04:51:02.427541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.431750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-067f3297-e680-4904-bb3a-8f9b4c40b5c9 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:02.433288 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-067f3297-e680-4904-bb3a-8f9b4c40b5c9 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019888 Aug 29 04:51:02.434114 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 125/202] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:51:02.439985 n-d-854119-9 devstack@n-api.service[128871]: WARNING nova.scheduler.client.report [None req-f4425877-bf43-47f2-b8d2-587b963bfec1 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] [req-f5c8d0c4-d53e-4206-8e9b-f397c112b201] Failed to update aggregates to [] for resource provider with UUID 786f371a-d76a-4c67-a819-d6811fa970a4. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-f5c8d0c4-d53e-4206-8e9b-f397c112b201"}]} Aug 29 04:51:02.446465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66aff393-228d-40bf-a974-8f60d267c1e7 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-525452830"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.450233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-66aff393-228d-40bf-a974-8f60d267c1e7 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '74e66494c1aa4e92b2c4ccafd70ba020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839dd978a464cef90cab897d513f25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66aff393-228d-40bf-a974-8f60d267c1e7 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Request method failure captured: Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 59 Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWQNGeDCubECVkoDs0s7KCj2u2Uhw4BaTBoiDjXsvuIG5PiaNpj_eMcnSAmCZEnf01Z90zAfkpS42WjbLZH4XIWqchct-fQK4gcS_SIU9CblEcCPN1GU_x9w-1WiDgWk-AEqpF4XAvcNxijepJph83VE020r9RzjfPnscJAqAyW3ME Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:02.452665 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7839dd978a464cef90cab897d513f25b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7839dd978a464cef90cab897d513f25b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 74e66494c1aa4e92b2c4ccafd70ba020 Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: {"aggregate": {"name": "tempest-test_aggregate-525452830"}} Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:02.453920 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-525452830'}}} Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:02.454620 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:02.455927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 04:51:02.457026 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.458556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66aff393-228d-40bf-a974-8f60d267c1e7 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:02.459636 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-66aff393-228d-40bf-a974-8f60d267c1e7 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.017095 Aug 29 04:51:02.460488 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 126/203] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:02.471259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5c3b6c8-9e9e-4580-b4a8-57b7e15ca275 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2046174297"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.476578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-f5c3b6c8-9e9e-4580-b4a8-57b7e15ca275 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Generated uuid 5f83c057-5b49-4c5a-a619-6d38217d3299 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:02.500640 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5c3b6c8-9e9e-4580-b4a8-57b7e15ca275 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034012 Aug 29 04:51:02.501591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 127/204] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:02.519596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7d4be16-3e28-407e-bff5-dd6e4c887e78 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2046174297"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.530221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-f7d4be16-3e28-407e-bff5-dd6e4c887e78 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Generated uuid 0aa537c4-62e4-4fed-9c4b-472ea400e1ba for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:02.548308 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-f7d4be16-3e28-407e-bff5-dd6e4c887e78 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2046174297 already exists. Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7d4be16-3e28-407e-bff5-dd6e4c887e78 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Request method failure captured: Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 60 Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWVGPuPUUKMyUzKF0iuz6_Scqq_ASX_dfG_-kCcWACdb8lY5PgTFlNjnQAi3v74On5LfOwIRNWwbi1my2g7upXhMpS0HZn4lesACuQIL213JWmBBMAVLWuGpXYmIA5umTb4Z5krkGWVFPeawglItuAarzTxcs-0S9OW6ulKRTqmR7Q Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:02.556768 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e02abee07944f68ae3c2775a40e7f5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b4c798cec26c4da4ae158bd3923dcad2 Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: {"aggregate": {"name": "tempest-test_aggregate-2046174297"}} Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:02.557979 n-d-854119-9 devstack@n-api.service[128872]: exception: Aggregate tempest-test_aggregate-2046174297 already exists. Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2046174297'}}} Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 29 04:51:02.558658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2046174297 already exists. Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:02.559639 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2046174297 already exists. Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2046174297 already exists. Aug 29 04:51:02.560800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.562389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7d4be16-3e28-407e-bff5-dd6e4c887e78 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2046174297 already exists. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:02.565387 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f7d4be16-3e28-407e-bff5-dd6e4c887e78 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.054366 Aug 29 04:51:02.566612 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 128/205] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:02.576308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11031ac5-1a45-4f19-9d41-f3fa78e81122 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:02.609318 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4425877-bf43-47f2-b8d2-587b963bfec1 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.486734 Aug 29 04:51:02.618441 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 78/206] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:02.623570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6afbfdf5-d46b-4e37-8ca9-fe2cddce1401 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:02.640170 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11031ac5-1a45-4f19-9d41-f3fa78e81122 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.068141 Aug 29 04:51:02.641581 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 129/207] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:02 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:02.650273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e827d78c-d59c-4116-b831-d79f18db81dc tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1485930839"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.661990 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6afbfdf5-d46b-4e37-8ca9-fe2cddce1401 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.041879 Aug 29 04:51:02.662616 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 79/208] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:02 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:02.666127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-e827d78c-d59c-4116-b831-d79f18db81dc tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Generated uuid 26326bf4-c4cb-47bc-bd2f-75356c35827b for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:02.674893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:02.675687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:02.682833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:02.683931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:02.685780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:02.685780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:02.686320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:02.686949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:02.725165 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e827d78c-d59c-4116-b831-d79f18db81dc tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078966 Aug 29 04:51:02.725771 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 130/209] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:51:02.737199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8b2ad053-b8cf-4323-8e06-b949ec6605cb tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1112888235"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.740797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-8b2ad053-b8cf-4323-8e06-b949ec6605cb tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Generated uuid 94885395-b5ce-412f-9178-e20dc8e57ce0 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:02.796136 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8b2ad053-b8cf-4323-8e06-b949ec6605cb tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064770 Aug 29 04:51:02.797406 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 131/210] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:02.804402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb1a4faf-0534-4f5e-9e08-2b5425e918c8 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:02.808077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fb1a4faf-0534-4f5e-9e08-2b5425e918c8 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '74e66494c1aa4e92b2c4ccafd70ba020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839dd978a464cef90cab897d513f25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb1a4faf-0534-4f5e-9e08-2b5425e918c8 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Request method failure captured: Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWQNGeDCubECVkoDs0s7KCj2u2Uhw4BaTBoiDjXsvuIG5PiaNpj_eMcnSAmCZEnf01Z90zAfkpS42WjbLZH4XIWqchct-fQK4gcS_SIU9CblEcCPN1GU_x9w-1WiDgWk-AEqpF4XAvcNxijepJph83VE020r9RzjfPnscJAqAyW3ME Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:02.810046 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7839dd978a464cef90cab897d513f25b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7839dd978a464cef90cab897d513f25b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 74e66494c1aa4e92b2c4ccafd70ba020 Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 04:51:02.811493 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8'} Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:02.813355 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:02.814823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb1a4faf-0534-4f5e-9e08-2b5425e918c8 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:02.816047 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb1a4faf-0534-4f5e-9e08-2b5425e918c8 tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 403 len: 116 microversion: 2.1 time: 0.015815 Aug 29 04:51:02.816819 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 132/211] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:02 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:02.824481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-377d7f0f-3c94-47eb-848f-d9df09d08b22 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:02.841626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-377d7f0f-3c94-47eb-848f-d9df09d08b22 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:02.843990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-377d7f0f-3c94-47eb-848f-d9df09d08b22 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:02.845279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-377d7f0f-3c94-47eb-848f-d9df09d08b22 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:02.985544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:02.993531 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-288df4a5-2e5c-4676-8773-ee9176a318f2 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 0.329450 Aug 29 04:51:02.996418 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 80/212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:02 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:03.010948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9e0fb320-7766-4cef-bd98-058871e9683b tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:03.048606 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9e0fb320-7766-4cef-bd98-058871e9683b tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.050967 Aug 29 04:51:03.053185 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 81/213] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:02 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:03.058167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dbf4139a-59c4-424e-a1ce-f3c4fce03100 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:03.070906 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-377d7f0f-3c94-47eb-848f-d9df09d08b22 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.252909 Aug 29 04:51:03.071605 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 133/214] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:51:02 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:03.085736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41bdfb2d-632f-4ee7-8fb2-91231e8e88c7 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:03.098573 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-dbf4139a-59c4-424e-a1ce-f3c4fce03100 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 04:51:03.102955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-41bdfb2d-632f-4ee7-8fb2-91231e8e88c7 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.022797 Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dbf4139a-59c4-424e-a1ce-f3c4fce03100 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Request method failure captured: Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWVGPuPUUKMyUzKF0iuz6_Scqq_ASX_dfG_-kCcWACdb8lY5PgTFlNjnQAi3v74On5LfOwIRNWwbi1my2g7upXhMpS0HZn4lesACuQIL213JWmBBMAVLWuGpXYmIA5umTb4Z5krkGWVFPeawglItuAarzTxcs-0S9OW6ulKRTqmR7Q Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:51:03.104582 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e02abee07944f68ae3c2775a40e7f5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: b4c798cec26c4da4ae158bd3923dcad2 Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: exception: Aggregate -1 could not be found. Aug 29 04:51:03.105693 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '-1'} Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 04:51:03.106369 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:03.107318 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:03.108429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:03.108429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:03.108429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:03.108429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:03.108429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 04:51:03.108429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:03.109785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dbf4139a-59c4-424e-a1ce-f3c4fce03100 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:03.110793 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dbf4139a-59c4-424e-a1ce-f3c4fce03100 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.056409 Aug 29 04:51:03.111878 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 82/215] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:03 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:03.112009 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 134/216] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:51:03 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:51:03.123095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a050f170-44ef-4748-ad73-4197e6cb3f49 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-611039268"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:03.128952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-a050f170-44ef-4748-ad73-4197e6cb3f49 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Generated uuid 8f633a2b-46cf-422a-a457-ba10d4171c50 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:03.185479 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a050f170-44ef-4748-ad73-4197e6cb3f49 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067079 Aug 29 04:51:03.194518 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 135/217] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:03.202851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-511b15fc-0949-4b98-b551-cf089359f0f4 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:03.230050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-511b15fc-0949-4b98-b551-cf089359f0f4 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:03.230596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-511b15fc-0949-4b98-b551-cf089359f0f4 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:03.231032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-511b15fc-0949-4b98-b551-cf089359f0f4 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:03.538107 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-511b15fc-0949-4b98-b551-cf089359f0f4 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.342361 Aug 29 04:51:03.538730 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 136/218] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Aug 29 04:51:03 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:03.545218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:03.552143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:03.579440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:03.580417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:03.580955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:03.581706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:03.582175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:03.582593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:03.593592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f2946fa-590b-44e1-8ed3-9353731a6af4 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Action: 'create', calling method: .version_select at 0x7f1aba2675e0>, body: {"pool": null} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:04.285047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:04.304669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:04.306507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:04.307693 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-142b82f3-4519-436f-9bc1-33114fd0bd24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1314 microversion: 2.25 time: 0.767990 Aug 29 04:51:04.336543 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 137/219] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:03 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:04.345259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:04.346090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:04.352460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:04.353197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:04.353769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:04.354619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:04.355215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:04.355781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:05.085304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:05.094554 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc97b662-cf37-41a8-8739-0a1ae32b23cd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.756764 Aug 29 04:51:05.096788 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 138/220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:04 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:05.113137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-113b933a-5441-4c5d-960d-3d4b9418bb4c tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:05.118536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-113b933a-5441-4c5d-960d-3d4b9418bb4c tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '74e66494c1aa4e92b2c4ccafd70ba020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839dd978a464cef90cab897d513f25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-113b933a-5441-4c5d-960d-3d4b9418bb4c tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Request method failure captured: Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWQNGeDCubECVkoDs0s7KCj2u2Uhw4BaTBoiDjXsvuIG5PiaNpj_eMcnSAmCZEnf01Z90zAfkpS42WjbLZH4XIWqchct-fQK4gcS_SIU9CblEcCPN1GU_x9w-1WiDgWk-AEqpF4XAvcNxijepJph83VE020r9RzjfPnscJAqAyW3ME Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:05.121402 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7839dd978a464cef90cab897d513f25b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7839dd978a464cef90cab897d513f25b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 74e66494c1aa4e92b2c4ccafd70ba020 Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 04:51:05.122793 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '10'} Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:05.123577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:05.124741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-113b933a-5441-4c5d-960d-3d4b9418bb4c tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:05.125760 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-113b933a-5441-4c5d-960d-3d4b9418bb4c tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/10" status: 403 len: 114 microversion: 2.1 time: 0.026483 Aug 29 04:51:05.138438 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 139/221] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:05 2022] GET /compute/v2.1/os-aggregates/10 => generated 114 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:05.143298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8d37489a-1042-423b-9f93-9c442a362e64 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:05.197121 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8d37489a-1042-423b-9f93-9c442a362e64 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.057443 Aug 29 04:51:05.204439 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 140/222] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:05 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:05.210063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:05.210933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:05.218184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:05.219110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:05.220069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:05.221235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:05.221870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:05.222428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:06.030751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:06.040254 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7b33493-95fd-4762-9357-48082ceaa1b0 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 0.833951 Aug 29 04:51:06.049159 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 141/223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:05 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:06.058865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-40aa5c8a-b67c-4071-bc36-d86dc05616b1 req-22791e02-0377-4c36-aff7-f8e923d107f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ffbebb-969a-4762-a339-032f7da39897", "name": "network-vif-plugged", "status": "completed", "tag": "e3cc9390-436f-423e-9d4e-3f5a7740bcc5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:06.088493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-40aa5c8a-b67c-4071-bc36-d86dc05616b1 req-22791e02-0377-4c36-aff7-f8e923d107f7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:06.089041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-40aa5c8a-b67c-4071-bc36-d86dc05616b1 req-22791e02-0377-4c36-aff7-f8e923d107f7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:06.089556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-40aa5c8a-b67c-4071-bc36-d86dc05616b1 req-22791e02-0377-4c36-aff7-f8e923d107f7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:06.109612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-40aa5c8a-b67c-4071-bc36-d86dc05616b1 req-22791e02-0377-4c36-aff7-f8e923d107f7 service nova] Creating event network-vif-plugged:e3cc9390-436f-423e-9d4e-3f5a7740bcc5 for instance 53ffbebb-969a-4762-a339-032f7da39897 on n-h2-854119-9 Aug 29 04:51:06.126755 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-40aa5c8a-b67c-4071-bc36-d86dc05616b1 req-22791e02-0377-4c36-aff7-f8e923d107f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076039 Aug 29 04:51:06.127768 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 142/224] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:06.133499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b26a1775-5c4f-4dd5-9c90-b664b90f26c6 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:06.200814 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b26a1775-5c4f-4dd5-9c90-b664b90f26c6 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.071251 Aug 29 04:51:06.207855 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 143/225] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:06 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:06.223477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a81a578c-f9dd-45b1-b363-f6a35b8f244c tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-356558581"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:06.227531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-a81a578c-f9dd-45b1-b363-f6a35b8f244c tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Generated uuid e518060e-feaa-4354-b3cd-1fda5efb7980 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:06.241973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:DELETE=13,nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:06.256648 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a81a578c-f9dd-45b1-b363-f6a35b8f244c tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047274 Aug 29 04:51:06.258032 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 144/226] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:06.266293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:06.267654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:06.276052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:06.276883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:06.277518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:06.278541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:06.279184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:06.279799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:06.537322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:06.550057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:06.559657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:06.566000 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f001ca02-5a00-45a0-aa4a-3fc15f7780c6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1320 microversion: 2.25 time: 0.306591 Aug 29 04:51:06.570786 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 145/227] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:06 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:06.797734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Calling method '.version_select at 0x7f1aba339700>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:06.800299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:06.801051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:06.801386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:06.819530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:06.820283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:06.820964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:06.834519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:06.835002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:06.835598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:06.842300 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-753f5113-9960-425d-83b6-402cb632427e tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.267795 Aug 29 04:51:06.848562 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 146/228] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:06.854176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:06.854991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:06.863668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:06.866102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:06.866102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:06.866975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:06.867565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:06.868334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:07.320518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:07.332288 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f295dfff-a8ec-42eb-acf8-1957a9531544 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.486857 Aug 29 04:51:07.332961 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 147/229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:06 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:07.349444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab0257cb-6b23-47d1-86cf-5c8e2cce2099 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:07.362352 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ab0257cb-6b23-47d1-86cf-5c8e2cce2099 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab0257cb-6b23-47d1-86cf-5c8e2cce2099 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Request method failure captured: Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWVGPuPUUKMyUzKF0iuz6_Scqq_ASX_dfG_-kCcWACdb8lY5PgTFlNjnQAi3v74On5LfOwIRNWwbi1my2g7upXhMpS0HZn4lesACuQIL213JWmBBMAVLWuGpXYmIA5umTb4Z5krkGWVFPeawglItuAarzTxcs-0S9OW6ulKRTqmR7Q Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:07.364169 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e02abee07944f68ae3c2775a40e7f5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b4c798cec26c4da4ae158bd3923dcad2 Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: exception: Aggregate -1 could not be found. Aug 29 04:51:07.365392 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '-1'} Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:07.366074 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 04:51:07.367348 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.368473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab0257cb-6b23-47d1-86cf-5c8e2cce2099 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:07.368473 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab0257cb-6b23-47d1-86cf-5c8e2cce2099 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031562 Aug 29 04:51:07.368473 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 148/230] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:07 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:07.377269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-33b0d3f3-2703-4d87-93cf-e86d6b3bdcd3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:07.405978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33b0d3f3-2703-4d87-93cf-e86d6b3bdcd3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:07.409317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33b0d3f3-2703-4d87-93cf-e86d6b3bdcd3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:07.409918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33b0d3f3-2703-4d87-93cf-e86d6b3bdcd3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:07.416946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:07.621450 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-33b0d3f3-2703-4d87-93cf-e86d6b3bdcd3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.252226 Aug 29 04:51:07.622703 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 149/231] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 04:51:07 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:07.776522 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5f2946fa-590b-44e1-8ed3-9353731a6af4 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.663082 Aug 29 04:51:07.778308 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 83/232] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 04:51:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:07.783995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:07.787732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:07.814185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:07.815097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:07.815797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:07.818225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:07.819708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:07.820990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:07.893480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c87478c5-77c2-4200-95ec-2f9b669b7a65 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] Calling method '.version_select at 0x7f1aba3258b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:07.896289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c87478c5-77c2-4200-95ec-2f9b669b7a65 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '15af9d35ac58443ea266a8b7230722ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb3c1fe83f34425aeab3144ff7ca447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c87478c5-77c2-4200-95ec-2f9b669b7a65 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] Request method failure captured: Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-hypervisors/n-h1-854119-9/search HTTP/1.1 Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEW46qxoOEubaYEiTS5vatbyZZP9ffDdaQ4DjmAftnu-bS60R06GWgkLM2XOVwL1WaACb0EER5eLmKS_nfdism4PmFJ2UI8wfOyDuTZKMC84nZPiw_tO2KHk0-03NTXHd-OWLn8uLLDEwbwwwD8gC4h6eOLKJOIHJBlvNbHsKAQc9rY Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: ccb3c1fe83f34425aeab3144ff7ca447 Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-480413611 Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:07.905963 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccb3c1fe83f34425aeab3144ff7ca447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccb3c1fe83f34425aeab3144ff7ca447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccb3c1fe83f34425aeab3144ff7ca447", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccb3c1fe83f34425aeab3144ff7ca447"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-480413611 Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: ccb3c1fe83f34425aeab3144ff7ca447 Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-480413611 Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-480413611-project Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 15af9d35ac58443ea266a8b7230722ba Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-480413611-project Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 04:51:07.907543 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'n-h1-854119-9'} Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:07.908432 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 04:51:07.909704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.912744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c87478c5-77c2-4200-95ec-2f9b669b7a65 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:07.913850 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c87478c5-77c2-4200-95ec-2f9b669b7a65 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-854119-9/search" status: 403 len: 117 microversion: 2.1 time: 0.289937 Aug 29 04:51:07.916486 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 150/233] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Aug 29 04:51:07 2022] GET /compute/v2.1/os-hypervisors/n-h1-854119-9/search => generated 117 bytes in 293 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:07.932673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e851f061-5a7f-4c39-a6a2-db666c1c890b tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:07.949960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e851f061-5a7f-4c39-a6a2-db666c1c890b tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '74e66494c1aa4e92b2c4ccafd70ba020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839dd978a464cef90cab897d513f25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e851f061-5a7f-4c39-a6a2-db666c1c890b tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Request method failure captured: Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWQNGeDCubECVkoDs0s7KCj2u2Uhw4BaTBoiDjXsvuIG5PiaNpj_eMcnSAmCZEnf01Z90zAfkpS42WjbLZH4XIWqchct-fQK4gcS_SIU9CblEcCPN1GU_x9w-1WiDgWk-AEqpF4XAvcNxijepJph83VE020r9RzjfPnscJAqAyW3ME Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:07.951566 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7839dd978a464cef90cab897d513f25b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7839dd978a464cef90cab897d513f25b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 74e66494c1aa4e92b2c4ccafd70ba020 Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 04:51:07.952863 n-d-854119-9 devstack@n-api.service[128872]: action_args: {} Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:07.953613 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:07.954656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e851f061-5a7f-4c39-a6a2-db666c1c890b tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:07.955908 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e851f061-5a7f-4c39-a6a2-db666c1c890b tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.031536 Aug 29 04:51:07.955908 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 151/234] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:51:07 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:07.982229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:07.982863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:07.994867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:08.000904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:08.002826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:08.003767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:08.006809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:08.007799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:08.192795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:08.218652 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7a767c71-bd90-4470-8adc-a27878d38084 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 0.438528 Aug 29 04:51:08.250963 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 84/235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:07 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:08.276850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ec111b5-4bc1-4ca6-a9b0-413d5c6f2ab3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-9"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:08.316713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ec111b5-4bc1-4ca6-a9b0-413d5c6f2ab3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:08.317640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ec111b5-4bc1-4ca6-a9b0-413d5c6f2ab3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:08.320107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ec111b5-4bc1-4ca6-a9b0-413d5c6f2ab3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:08.489080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:08.506273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:08.510311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:08.514543 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73280a3e-d903-42ec-8614-a63aa6ce416c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1362 microversion: 2.25 time: 0.560005 Aug 29 04:51:08.517289 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 152/236] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:07 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1362 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:08.536551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38e7518d-8ee2-41c9-b3ba-c7405fdb7af1 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Calling method '.version_select at 0x7f1ab9f27820>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:08.588859 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ec111b5-4bc1-4ca6-a9b0-413d5c6f2ab3 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.336592 Aug 29 04:51:08.589462 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 85/237] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 04:51:08 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:08.605350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-77d07ef7-355b-4fba-822a-1826aa1445c3 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Calling method '.version_select at 0x7f1aba2673a0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:08.607997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77d07ef7-355b-4fba-822a-1826aa1445c3 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:08.613446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77d07ef7-355b-4fba-822a-1826aa1445c3 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:08.614301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77d07ef7-355b-4fba-822a-1826aa1445c3 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:08.654154 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-77d07ef7-355b-4fba-822a-1826aa1445c3 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-77d07ef7-355b-4fba-822a-1826aa1445c3 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Request method failure captured: Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEW5YPL7jiVKDeFchDFlsg6aZ7ppk7FVbDj6PTeGxU8qqzn9dMpRtBP9WWENFD4TANgyWc-ItjFKkDcmD6znyiH1E2r8jkcgXpVsIFvMghVAHguCR6ZyXFzu4ff5lQmOfdYUfu2tnHgx8l_Jan1IRsBRIQxb2MmtquQxA42fgxybjys Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c7d1a0e4abf4458b75c022946460b99 Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-539276647 Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:51:08.659207 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c7d1a0e4abf4458b75c022946460b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c7d1a0e4abf4458b75c022946460b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c7d1a0e4abf4458b75c022946460b99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c7d1a0e4abf4458b75c022946460b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-539276647 Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c7d1a0e4abf4458b75c022946460b99 Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-539276647 Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: a778f48692634f608377b05198857f4c Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 04:51:08.660697 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:08.661536 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:08.662914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:08.662914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:08.662914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:08.662914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 04:51:08.662914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:08.666293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-77d07ef7-355b-4fba-822a-1826aa1445c3 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:08.667364 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-77d07ef7-355b-4fba-822a-1826aa1445c3 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.076900 Aug 29 04:51:08.670223 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 86/238] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 04:51:08 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:08.677706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:08.685801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:08.711743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:08.714558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:08.715159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:08.716058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:08.717917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:08.718518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:09.119633 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-38e7518d-8ee2-41c9-b3ba-c7405fdb7af1 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/062e38ce-28e8-4b3c-b1be-8e287c8b6061" status: 200 len: 142 microversion: 2.1 time: 0.600893 Aug 29 04:51:09.120169 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 153/239] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 04:51:08 2022] GET /compute/v2.1/os-floating-ips/062e38ce-28e8-4b3c-b1be-8e287c8b6061 => generated 142 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:09.126213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9c808f5-905c-4213-8fc0-043e54ad29d9 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:09.171680 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9c808f5-905c-4213-8fc0-043e54ad29d9 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.050363 Aug 29 04:51:09.174249 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 154/240] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:09 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:09.191424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Calling method '.version_select at 0x7f1aba5ffc10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:09.199805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:09.199805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:09.202977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:09.246436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:09.248390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:09.249412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:09.251390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:09.259693 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa85e8e1-1a03-4c69-8a4d-fd637a86007a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1312 microversion: 2.1 time: 0.587533 Aug 29 04:51:09.262959 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 87/241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:08 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1312 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:09.282504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a845e58-7396-4279-bcac-d07309c7d7f3 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Calling method '.version_select at 0x7f1aba1199d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:09.282796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:09.285240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:09.288059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:09.311831 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-35b1445a-873c-4b36-ba3e-c5978a1dcfd1 tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.135755 Aug 29 04:51:09.319627 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 155/242] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:09.335028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08a95570-0e62-470f-a068-48cb7756c076 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-373270339"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:09.353208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-08a95570-0e62-470f-a068-48cb7756c076 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Generated uuid fbb38bc7-f578-4836-93b4-c54324d8f88d for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:09.409651 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08a95570-0e62-470f-a068-48cb7756c076 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081420 Aug 29 04:51:09.410445 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 156/243] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:09.422515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a397864c-debb-43c4-9d03-7a5a7f1624c7 req-a6b8659d-b41f-4442-8577-a9facef1f294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd58c75-b4bb-4fd6-846e-e3cb7e72388a", "name": "network-vif-plugged", "status": "completed", "tag": "7de24bde-df42-4bc2-9d60-e138225d92a4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:09.451017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a397864c-debb-43c4-9d03-7a5a7f1624c7 req-a6b8659d-b41f-4442-8577-a9facef1f294 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:09.451595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a397864c-debb-43c4-9d03-7a5a7f1624c7 req-a6b8659d-b41f-4442-8577-a9facef1f294 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:09.452025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a397864c-debb-43c4-9d03-7a5a7f1624c7 req-a6b8659d-b41f-4442-8577-a9facef1f294 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:09.472763 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a397864c-debb-43c4-9d03-7a5a7f1624c7 req-a6b8659d-b41f-4442-8577-a9facef1f294 service nova] Creating event network-vif-plugged:7de24bde-df42-4bc2-9d60-e138225d92a4 for instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a on n-h2-854119-9 Aug 29 04:51:09.489210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a397864c-debb-43c4-9d03-7a5a7f1624c7 req-a6b8659d-b41f-4442-8577-a9facef1f294 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076812 Aug 29 04:51:09.490184 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 157/244] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:09.498306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b89ed91-4e28-4e72-bc31-72e91442d0f7 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1194401131"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:09.507528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-9b89ed91-4e28-4e72-bc31-72e91442d0f7 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Generated uuid e4155917-d9e7-40e4-9868-17b3392fc07d for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:09.565995 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b89ed91-4e28-4e72-bc31-72e91442d0f7 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074354 Aug 29 04:51:09.573853 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 158/245] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:09.582009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:09.583872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:09.598723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:09.601819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:09.602566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:09.607703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:09.608738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:09.610002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:10.091755 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a845e58-7396-4279-bcac-d07309c7d7f3 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.826318 Aug 29 04:51:10.100608 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 88/246] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 29 04:51:09 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:10.107209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5848d435-1710-449f-ab47-c7050af0ecd8 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] Calling method '.version_select at 0x7f1aba104940>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:10.111886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5848d435-1710-449f-ab47-c7050af0ecd8 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '15af9d35ac58443ea266a8b7230722ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb3c1fe83f34425aeab3144ff7ca447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5848d435-1710-449f-ab47-c7050af0ecd8 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] Request method failure captured: Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEW46qxoOEubaYEiTS5vatbyZZP9ffDdaQ4DjmAftnu-bS60R06GWgkLM2XOVwL1WaACb0EER5eLmKS_nfdism4PmFJ2UI8wfOyDuTZKMC84nZPiw_tO2KHk0-03NTXHd-OWLn8uLLDEwbwwwD8gC4h6eOLKJOIHJBlvNbHsKAQc9rY Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ccb3c1fe83f34425aeab3144ff7ca447 Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-480413611 Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:10.113508 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccb3c1fe83f34425aeab3144ff7ca447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccb3c1fe83f34425aeab3144ff7ca447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccb3c1fe83f34425aeab3144ff7ca447", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccb3c1fe83f34425aeab3144ff7ca447"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-480413611 Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ccb3c1fe83f34425aeab3144ff7ca447 Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-480413611 Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-480413611-project Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 15af9d35ac58443ea266a8b7230722ba Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-480413611-project Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 04:51:10.114916 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '1'} Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:10.115706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 04:51:10.117081 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.118229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5848d435-1710-449f-ab47-c7050af0ecd8 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:10.118229 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5848d435-1710-449f-ab47-c7050af0ecd8 tempest-HypervisorAdminNegativeUnderV252Test-480413611 tempest-HypervisorAdminNegativeUnderV252Test-480413611-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.012934 Aug 29 04:51:10.124369 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 89/247] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Aug 29 04:51:10 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:10.131622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a4500d3f-e35d-47fe-a6d8-e2c3251fd6c8 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:10.173088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a4500d3f-e35d-47fe-a6d8-e2c3251fd6c8 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.047040 Aug 29 04:51:10.174269 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 90/248] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:10 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:10.182665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:10.184378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:10.197511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:10.198857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:10.199448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:10.200356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:10.201514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:10.203250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:10.204391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:10.216162 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-15ed0449-ac89-4922-8cf1-f095741c7281 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1388 microversion: 2.1 time: 0.640615 Aug 29 04:51:10.216950 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 159/249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:09 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1388 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:10.223331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da84fbab-805d-4bf6-ace6-ccd72e0e839c tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:10.247593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da84fbab-805d-4bf6-ace6-ccd72e0e839c tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:10.248414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da84fbab-805d-4bf6-ace6-ccd72e0e839c tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:10.249376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da84fbab-805d-4bf6-ace6-ccd72e0e839c tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:10.627780 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da84fbab-805d-4bf6-ace6-ccd72e0e839c tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.407969 Aug 29 04:51:10.631222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:10.635563 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 160/250] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 04:51:10 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:10.640705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-bc3430b6-b421-4536-8c43-33c1a65c8dbb req-ee328b91-8027-44f9-a309-34f38d83952e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62702580-59ac-4125-ba70-96e4f239dbc3", "tag": "2a21104d-abfb-4eaa-ba7f-9469f2215d82"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:10.651405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:10.653175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:10.655491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b949a73-54d2-452d-a445-ddf5cb559040 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1362 microversion: 2.25 time: 0.479422 Aug 29 04:51:10.661288 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 91/251] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:10 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:10.666310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-48d90e18-3a5c-4603-869c-230f137abd43 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Calling method '.version_select at 0x7f1aba104550>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:10.680494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bc3430b6-b421-4536-8c43-33c1a65c8dbb req-ee328b91-8027-44f9-a309-34f38d83952e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:10.683719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bc3430b6-b421-4536-8c43-33c1a65c8dbb req-ee328b91-8027-44f9-a309-34f38d83952e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:10.684744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bc3430b6-b421-4536-8c43-33c1a65c8dbb req-ee328b91-8027-44f9-a309-34f38d83952e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:10.705768 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-bc3430b6-b421-4536-8c43-33c1a65c8dbb req-ee328b91-8027-44f9-a309-34f38d83952e service nova] Creating event network-changed:2a21104d-abfb-4eaa-ba7f-9469f2215d82 for instance 62702580-59ac-4125-ba70-96e4f239dbc3 on n-h1-854119-9 Aug 29 04:51:10.714325 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-bc3430b6-b421-4536-8c43-33c1a65c8dbb req-ee328b91-8027-44f9-a309-34f38d83952e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074702 Aug 29 04:51:10.717369 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 161/252] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:10.725637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fbcfdfe8-33af-4b85-83d0-a6d919f13feb tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Calling method '.version_select at 0x7f1aba22daf0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:10.727451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbcfdfe8-33af-4b85-83d0-a6d919f13feb tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:10.727936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbcfdfe8-33af-4b85-83d0-a6d919f13feb tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:10.728440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbcfdfe8-33af-4b85-83d0-a6d919f13feb tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:10.736942 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-fbcfdfe8-33af-4b85-83d0-a6d919f13feb tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] HTTP exception thrown: No hypervisor matching '29dbec4c-9987-40be-a81b-b8e5bf2f7590' could be found. Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fbcfdfe8-33af-4b85-83d0-a6d919f13feb tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Request method failure captured: Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-hypervisors/29dbec4c-9987-40be-a81b-b8e5bf2f7590/servers HTTP/1.1 Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEW5YPL7jiVKDeFchDFlsg6aZ7ppk7FVbDj6PTeGxU8qqzn9dMpRtBP9WWENFD4TANgyWc-ItjFKkDcmD6znyiH1E2r8jkcgXpVsIFvMghVAHguCR6ZyXFzu4ff5lQmOfdYUfu2tnHgx8l_Jan1IRsBRIQxb2MmtquQxA42fgxybjys Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c7d1a0e4abf4458b75c022946460b99 Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-539276647 Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:10.738635 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c7d1a0e4abf4458b75c022946460b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c7d1a0e4abf4458b75c022946460b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c7d1a0e4abf4458b75c022946460b99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c7d1a0e4abf4458b75c022946460b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-539276647 Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c7d1a0e4abf4458b75c022946460b99 Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-539276647 Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: a778f48692634f608377b05198857f4c Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: exception: No hypervisor matching '29dbec4c-9987-40be-a81b-b8e5bf2f7590' could be found. Aug 29 04:51:10.739988 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '29dbec4c-9987-40be-a81b-b8e5bf2f7590'} Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '29dbec4c-9987-40be-a81b-b8e5bf2f7590' could be found. Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.740808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:10.742038 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:10.742038 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:10.742038 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:10.742038 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:10.742038 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '29dbec4c-9987-40be-a81b-b8e5bf2f7590' could be found. Aug 29 04:51:10.742038 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.743338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fbcfdfe8-33af-4b85-83d0-a6d919f13feb tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] Returning 404 to user: No hypervisor matching '29dbec4c-9987-40be-a81b-b8e5bf2f7590' could be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:10.744673 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fbcfdfe8-33af-4b85-83d0-a6d919f13feb tempest-HypervisorAdminNegativeUnderV252Test-539276647 tempest-HypervisorAdminNegativeUnderV252Test-539276647-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/29dbec4c-9987-40be-a81b-b8e5bf2f7590/servers" status: 404 len: 123 microversion: 2.1 time: 0.025831 Aug 29 04:51:10.745685 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 162/253] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Aug 29 04:51:10 2022] GET /compute/v2.1/os-hypervisors/29dbec4c-9987-40be-a81b-b8e5bf2f7590/servers => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:10.760749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c71f6114-c55f-481f-9131-663047bb4353 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:10.780463 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-c71f6114-c55f-481f-9131-663047bb4353 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c71f6114-c55f-481f-9131-663047bb4353 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Request method failure captured: Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWDF6b0W2JlECVEC6_BXg1QhO8i-XNtvoeu0nMATTq2BB_UQzzZ8IFUBI42yn_4k2e-IJktjuYLRStNAGWsXwSjbihcBJ3_rOCJ1qUliyh3PQQDhJdo7dqdDIgm_TB1B-sVseYzldwNKT_SRI_YeOVYCUV0dfo49pd9amtrED81RzA Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f46e1a885a174ac2b223ad4e4c407d18 Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:10.782025 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f46e1a885a174ac2b223ad4e4c407d18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f46e1a885a174ac2b223ad4e4c407d18 Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminTestJSON-1972407622-project-admin Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 78a242e3273a433e80c1874a3e67ec8c Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminTestJSON-1972407622-project-admin Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: exception: Aggregate 12 could not be found. Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '12'} Aug 29 04:51:10.783306 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:10.784031 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 29 04:51:10.786418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:10.787341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c71f6114-c55f-481f-9131-663047bb4353 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:10.787341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c71f6114-c55f-481f-9131-663047bb4353 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.036596 Aug 29 04:51:10.792013 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 163/254] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:10 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:10.805803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:10.807737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:10.817530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:10.818072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:10.818518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:10.819251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:10.819701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:10.820150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:11.599997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:11.750542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:11.762411 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8d2ce148-b012-442d-878c-8e99581a25f3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1461 microversion: 2.1 time: 0.968955 Aug 29 04:51:11.763665 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 164/255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:10 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1461 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:11.784992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0a9d059-2be0-49e0-b182-33bc4cc093bb tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:11.789905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a0a9d059-2be0-49e0-b182-33bc4cc093bb tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '74e66494c1aa4e92b2c4ccafd70ba020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839dd978a464cef90cab897d513f25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0a9d059-2be0-49e0-b182-33bc4cc093bb tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Request method failure captured: Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 42 Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWQNGeDCubECVkoDs0s7KCj2u2Uhw4BaTBoiDjXsvuIG5PiaNpj_eMcnSAmCZEnf01Z90zAfkpS42WjbLZH4XIWqchct-fQK4gcS_SIU9CblEcCPN1GU_x9w-1WiDgWk-AEqpF4XAvcNxijepJph83VE020r9RzjfPnscJAqAyW3ME Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:11.792292 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7839dd978a464cef90cab897d513f25b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7839dd978a464cef90cab897d513f25b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839dd978a464cef90cab897d513f25b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7839dd978a464cef90cab897d513f25b Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-194250294 Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 74e66494c1aa4e92b2c4ccafd70ba020 Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-194250294-project Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: {"remove_host": {"host": "n-h1-854119-9"}} Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:11.793884 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-854119-9'}}} Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:11.794762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 04:51:11.796046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:11.799317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0a9d059-2be0-49e0-b182-33bc4cc093bb tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:11.800462 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0a9d059-2be0-49e0-b182-33bc4cc093bb tempest-AggregatesAdminNegativeTestJSON-194250294 tempest-AggregatesAdminNegativeTestJSON-194250294-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.035099 Aug 29 04:51:11.801174 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 165/256] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 04:51:11 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:11.806187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c80623e8-f097-44bf-983e-b7fe1baec7f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:11.821788 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-c80623e8-f097-44bf-983e-b7fe1baec7f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c80623e8-f097-44bf-983e-b7fe1baec7f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Request method failure captured: Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWDF6b0W2JlECVEC6_BXg1QhO8i-XNtvoeu0nMATTq2BB_UQzzZ8IFUBI42yn_4k2e-IJktjuYLRStNAGWsXwSjbihcBJ3_rOCJ1qUliyh3PQQDhJdo7dqdDIgm_TB1B-sVseYzldwNKT_SRI_YeOVYCUV0dfo49pd9amtrED81RzA Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f46e1a885a174ac2b223ad4e4c407d18 Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:11.823538 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f46e1a885a174ac2b223ad4e4c407d18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f46e1a885a174ac2b223ad4e4c407d18 Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminTestJSON-1972407622-project-admin Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 78a242e3273a433e80c1874a3e67ec8c Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminTestJSON-1972407622-project-admin Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: exception: Aggregate 12 could not be found. Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '12'} Aug 29 04:51:11.825033 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:11.825871 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:11.827112 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:11.828769 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:11.828769 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:11.828769 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:11.828769 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 29 04:51:11.828769 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:11.828769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c80623e8-f097-44bf-983e-b7fe1baec7f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:11.828769 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c80623e8-f097-44bf-983e-b7fe1baec7f0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.024135 Aug 29 04:51:11.828769 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 166/257] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:11 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:11.839531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:11.840440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:11.849360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:11.850108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:11.850783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:11.851541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:11.852111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:11.852793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:12.095090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:12.218017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:12.336776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:12.347404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0cd820f5-69ab-4150-bcff-43867cbd0b6c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1587 microversion: 2.1 time: 0.517952 Aug 29 04:51:12.348342 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 167/258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:11 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1587 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:12.360319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:12.361240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:12.373771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:12.380872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:12.381633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:12.384203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:12.389512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:12.390573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:12.925255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:12.935148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:12.941272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:12.945584 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aba08898-fed5-46ed-9417-90cf931a3bc9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1362 microversion: 2.25 time: 0.594962 Aug 29 04:51:12.947066 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 168/259] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:12 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1362 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:13.315973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd2fbe8a-3db1-4198-9a80-1d14bfb9bec8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:13.316616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cd2fbe8a-3db1-4198-9a80-1d14bfb9bec8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:13.325214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2fbe8a-3db1-4198-9a80-1d14bfb9bec8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:13.325715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2fbe8a-3db1-4198-9a80-1d14bfb9bec8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:13.326155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2fbe8a-3db1-4198-9a80-1d14bfb9bec8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:13.326865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2fbe8a-3db1-4198-9a80-1d14bfb9bec8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:13.327321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2fbe8a-3db1-4198-9a80-1d14bfb9bec8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:13.327743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2fbe8a-3db1-4198-9a80-1d14bfb9bec8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:13.467041 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-48d90e18-3a5c-4603-869c-230f137abd43 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/062e38ce-28e8-4b3c-b1be-8e287c8b6061" status: 202 len: 0 microversion: 2.1 time: 2.804371 Aug 29 04:51:13.473265 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 92/260] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 04:51:10 2022] DELETE /compute/v2.1/os-floating-ips/062e38ce-28e8-4b3c-b1be-8e287c8b6061 => generated 0 bytes in 2811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:13.478022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5a19ca6f-4512-44b3-b4b8-b7a52e62d4dd tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-9"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:13.498368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a19ca6f-4512-44b3-b4b8-b7a52e62d4dd tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:13.501515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a19ca6f-4512-44b3-b4b8-b7a52e62d4dd tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:13.502742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a19ca6f-4512-44b3-b4b8-b7a52e62d4dd tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:13.663674 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5a19ca6f-4512-44b3-b4b8-b7a52e62d4dd tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.188983 Aug 29 04:51:13.665040 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 93/261] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 04:51:13 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:13.670859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7a4a4e0d-8b45-4d5b-af55-e7fc4f8a1466 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2111080332", "name": "tempest-test_aggregate-387961777"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:13.694438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.aggregate [None req-7a4a4e0d-8b45-4d5b-af55-e7fc4f8a1466 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Generated uuid 079a1aa0-6864-4941-9224-9f9e44635cd0 for aggregate {{(pid=128871) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:13.725662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7a4a4e0d-8b45-4d5b-af55-e7fc4f8a1466 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.059225 Aug 29 04:51:13.727634 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 94/262] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Aug 29 04:51:13 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:13.734170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ead30e2-4e56-4ac1-9a39-ed2ec9942707 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:13.734661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8ead30e2-4e56-4ac1-9a39-ed2ec9942707 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:13.742728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ead30e2-4e56-4ac1-9a39-ed2ec9942707 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:13.743546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ead30e2-4e56-4ac1-9a39-ed2ec9942707 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:13.744542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ead30e2-4e56-4ac1-9a39-ed2ec9942707 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:13.745457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ead30e2-4e56-4ac1-9a39-ed2ec9942707 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:13.746725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ead30e2-4e56-4ac1-9a39-ed2ec9942707 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:13.747273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ead30e2-4e56-4ac1-9a39-ed2ec9942707 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:13.918179 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8ead30e2-4e56-4ac1-9a39-ed2ec9942707 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189217 Aug 29 04:51:13.918894 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 95/263] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 04:51:13 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:13.926070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42416ee3-173b-4010-a6ea-9bb9ee77b870 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Action: 'create', calling method: .version_select at 0x7f1aba109dc0>, body: {"pool": null} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:14.139055 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cd2fbe8a-3db1-4198-9a80-1d14bfb9bec8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1612 microversion: 2.1 time: 1.185798 Aug 29 04:51:14.140847 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 169/264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:12 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1612 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:14.146208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dde0c7eb-6291-4a7e-b3aa-0acc5f2c105b tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:14.187141 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dde0c7eb-6291-4a7e-b3aa-0acc5f2c105b tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.044756 Aug 29 04:51:14.188093 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 170/265] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:14 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:14.206440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eda725ad-b344-4ddd-a524-bd95c7e2b80c tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:14.249570 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eda725ad-b344-4ddd-a524-bd95c7e2b80c tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.060292 Aug 29 04:51:14.252060 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 171/266] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:14 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:14.259775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:14.261337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:14.270705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:14.270705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:14.270705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:14.270705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:14.270997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:14.271200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:14.754760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:14.766552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:14.768425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:14.770561 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-074faf87-0ff1-425b-bd3d-1da6cabaa5ed tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1362 microversion: 2.25 time: 0.515990 Aug 29 04:51:14.771339 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 172/267] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:14 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:14.778089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:14.778976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:14.833686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:14.834108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:14.835257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:14.836421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:14.837375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:14.837951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:15.046803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'aea0e5ec42e141939ae4050a3868a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d225bc4b57845e990e62a214d8e7532', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:15.047419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 53ffbebb-969a-4762-a339-032f7da39897] flavor_id is None. Assuming migration. {{(pid=128872) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 04:51:15.047859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128872) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 04:51:15.362628 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-24fd459f-8893-47a1-afce-010845969667 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897/action" status: 202 len: 0 microversion: 2.1 time: 0.589995 Aug 29 04:51:15.366628 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 173/268] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:51:14 2022] POST /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:15.384375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85610a17-6f68-40c7-bb2a-9130e97a07b6 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1260858244"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:15.391809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-85610a17-6f68-40c7-bb2a-9130e97a07b6 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Generated uuid 4c204990-4dd0-4231-928d-69fc1d2bfa74 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:15.438989 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85610a17-6f68-40c7-bb2a-9130e97a07b6 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067473 Aug 29 04:51:15.449685 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 174/269] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:15.463771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1fb01bb8-1911-494a-9a04-b19b31324142 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:15.478365 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1fb01bb8-1911-494a-9a04-b19b31324142 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1fb01bb8-1911-494a-9a04-b19b31324142 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Request method failure captured: Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWDF6b0W2JlECVEC6_BXg1QhO8i-XNtvoeu0nMATTq2BB_UQzzZ8IFUBI42yn_4k2e-IJktjuYLRStNAGWsXwSjbihcBJ3_rOCJ1qUliyh3PQQDhJdo7dqdDIgm_TB1B-sVseYzldwNKT_SRI_YeOVYCUV0dfo49pd9amtrED81RzA Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f46e1a885a174ac2b223ad4e4c407d18 Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:15.479862 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f46e1a885a174ac2b223ad4e4c407d18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f46e1a885a174ac2b223ad4e4c407d18 Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminTestJSON-1972407622-project-admin Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 78a242e3273a433e80c1874a3e67ec8c Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminTestJSON-1972407622-project-admin Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: exception: Aggregate 14 could not be found. Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '14'} Aug 29 04:51:15.481271 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:15.482108 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 29 04:51:15.483387 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:15.484655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1fb01bb8-1911-494a-9a04-b19b31324142 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:15.484655 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1fb01bb8-1911-494a-9a04-b19b31324142 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.032870 Aug 29 04:51:15.487324 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 175/270] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:15 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:15.501270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:15.502188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:15.521331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:15.522018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:15.522587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:15.523802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:15.526790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:15.528317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:15.960029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:15.968420 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c30a364d-3a35-4b33-a785-c31152be4643 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1470 microversion: 2.1 time: 0.478555 Aug 29 04:51:15.969869 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 176/271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:15 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1470 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:15.974489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:15.990095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:15.990771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:15.991370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:15.997532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:15.998204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:15.998779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:16.008276 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.compute.aggregates [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 04:51:16.008949 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Request method failure captured: Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 42 Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWVGPuPUUKMyUzKF0iuz6_Scqq_ASX_dfG_-kCcWACdb8lY5PgTFlNjnQAi3v74On5LfOwIRNWwbi1my2g7upXhMpS0HZn4lesACuQIL213JWmBBMAVLWuGpXYmIA5umTb4Z5krkGWVFPeawglItuAarzTxcs-0S9OW6ulKRTqmR7Q Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:16.010988 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e02abee07944f68ae3c2775a40e7f5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e02abee07944f68ae3c2775a40e7f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 4e02abee07944f68ae3c2775a40e7f5f Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-119929515 Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b4c798cec26c4da4ae158bd3923dcad2 Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: {"remove_host": {"host": "nonexist_host"}} Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:16.012431 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot remove host nonexist_host in aggregate 15 Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 04:51:16.013304 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 29 04:51:16.014577 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.015864 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:16.017222 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:16.017222 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:16.017222 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:16.017222 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:16.017222 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Aug 29 04:51:16.017222 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.018599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:16.020294 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8db89b02-a15a-447c-ab79-dbe540157b33 tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.049248 Aug 29 04:51:16.022059 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 177/272] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 04:51:15 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:16.031735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-abc7fd38-0eaa-4979-8710-1d700a25790a tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:16.070139 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-abc7fd38-0eaa-4979-8710-1d700a25790a tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-abc7fd38-0eaa-4979-8710-1d700a25790a tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Request method failure captured: Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWDF6b0W2JlECVEC6_BXg1QhO8i-XNtvoeu0nMATTq2BB_UQzzZ8IFUBI42yn_4k2e-IJktjuYLRStNAGWsXwSjbihcBJ3_rOCJ1qUliyh3PQQDhJdo7dqdDIgm_TB1B-sVseYzldwNKT_SRI_YeOVYCUV0dfo49pd9amtrED81RzA Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f46e1a885a174ac2b223ad4e4c407d18 Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:16.072177 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f46e1a885a174ac2b223ad4e4c407d18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46e1a885a174ac2b223ad4e4c407d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f46e1a885a174ac2b223ad4e4c407d18 Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1972407622 Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminTestJSON-1972407622-project-admin Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 78a242e3273a433e80c1874a3e67ec8c Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminTestJSON-1972407622-project-admin Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: exception: Aggregate 14 could not be found. Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '14'} Aug 29 04:51:16.073578 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:16.074399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:16.075590 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:16.076923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:16.076923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:16.076923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:16.076923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 29 04:51:16.076923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:16.078470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-abc7fd38-0eaa-4979-8710-1d700a25790a tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:16.080475 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-abc7fd38-0eaa-4979-8710-1d700a25790a tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.056436 Aug 29 04:51:16.081626 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 178/273] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:16 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:16.090176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:16.091018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:16.101675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:16.104700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:16.105322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:16.106304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:16.109175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:16.109818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:16.865260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:16.887677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:16.892520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:16.896195 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-041d1f98-054f-4115-9b21-53675d8f4d82 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1362 microversion: 2.25 time: 0.813383 Aug 29 04:51:16.901020 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 179/274] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:16 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1362 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:16.907204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b0a1882-b76e-4f69-b921-556c2650967e tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:16.929568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:16.946051 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b0a1882-b76e-4f69-b921-556c2650967e tempest-AggregatesAdminNegativeTestJSON-119929515 tempest-AggregatesAdminNegativeTestJSON-119929515-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.043288 Aug 29 04:51:16.947454 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 180/275] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:16 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:16.956911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e07daa44-58af-4761-85e1-5a5241d14621 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-346509079"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:16.961107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-e07daa44-58af-4761-85e1-5a5241d14621 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Generated uuid 96518f71-fe5c-4a6c-b9b1-ff9735e72599 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:17.013804 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e07daa44-58af-4761-85e1-5a5241d14621 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063765 Aug 29 04:51:17.016181 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 181/276] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:17.282632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfd24dd0-1a88-47d9-922f-d338e6ac5d8c tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Action: 'create', calling method: .version_select at 0x7f1ab9f0e0d0>, body: {"keypair": {"name": "tempest-keypair-2048150936", "type": "ssh", "user_id": "ccd995b1f1d846afbfe65c351395d20a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHKdtnxz9Ai5QY6Nx7OpzCDFhrZ32NPEsXNwDtcCOMWm6t/t1dhdLQvcqh4u0L+FsNrJ+8Ve/azRRyZllRXv2ybd84O+Su4DCxPWHodJwEFO364NmaOeCv+wiMtqIIyhA=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:17.362012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-dfd24dd0-1a88-47d9-922f-d338e6ac5d8c tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Getting quotas for project c19d5e3189f443f7ad560872d7bbb21d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:51:17.378025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-dfd24dd0-1a88-47d9-922f-d338e6ac5d8c tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Getting quotas for user e4fa061cee3b4d63a213204f499cb50b and project c19d5e3189f443f7ad560872d7bbb21d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:51:17.453766 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dfd24dd0-1a88-47d9-922f-d338e6ac5d8c tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.436275 Aug 29 04:51:17.462848 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 182/277] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 04:51:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 437 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 04:51:17.462848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:17.462848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:17.481831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:17.485921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:17.486653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:17.488339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:17.489128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:17.492648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:17.899321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:17.908334 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21f8671e-507b-4164-b8d8-dc17b16fda6d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1470 microversion: 2.1 time: 0.452559 Aug 29 04:51:17.929429 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 183/278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:17 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1470 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:17.934921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-96f0952a-ddde-460c-92a5-d90ba4ac84b0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:17.943112 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-96f0952a-ddde-460c-92a5-d90ba4ac84b0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.012247 Aug 29 04:51:17.950450 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 184/279] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:17 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:17.955948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-15283667-df60-4144-99fc-7baf6a791d3c tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Action: 'create', calling method: .version_select at 0x7f1aba3dd310>, body: {"keypair": {"name": "tempest-keypair-9001430", "type": "ssh", "user_id": "ccd995b1f1d846afbfe65c351395d20a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1KudIR6ZBS3SMBwPBlGWkIueVzNX1f5imqld7Q7hxRO8VM3xbVHpAVXtHxpe3je0eS589SMLMd0yD6lz/VPbb/1fQ0eCA547R9bmwd9OtCS36N9H5qaQn9TaMeWBLMMw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:17.973316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-15283667-df60-4144-99fc-7baf6a791d3c tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Getting quotas for project c19d5e3189f443f7ad560872d7bbb21d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:51:17.977386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-15283667-df60-4144-99fc-7baf6a791d3c tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Getting quotas for user e4fa061cee3b4d63a213204f499cb50b and project c19d5e3189f443f7ad560872d7bbb21d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:51:18.007530 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-15283667-df60-4144-99fc-7baf6a791d3c tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.10 time: 0.055596 Aug 29 04:51:18.009733 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 185/280] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 04:51:17 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 04:51:18.017766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:18.018715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:18.032892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:18.033687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:18.034777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:18.035911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:18.051139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:18.053097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:18.074522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:18.688985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:18.702228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42416ee3-173b-4010-a6ea-9bb9ee77b870 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.779730 Aug 29 04:51:18.712439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 96/281] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 04:51:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:18.718549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6152ab6e-3582-451c-bd6b-cb47dbb8c0e6 req-e9bcb603-e409-470c-9984-f4664f1e7e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd58c75-b4bb-4fd6-846e-e3cb7e72388a", "tag": "7de24bde-df42-4bc2-9d60-e138225d92a4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:18.733843 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6839c50-f7c2-4a8b-9553-92ffe73385f1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 200 len: 1587 microversion: 2.1 time: 0.722271 Aug 29 04:51:18.751502 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 186/282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:18 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 1587 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:18.762051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:18.762681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:18.764161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6152ab6e-3582-451c-bd6b-cb47dbb8c0e6 req-e9bcb603-e409-470c-9984-f4664f1e7e46 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:18.765855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6152ab6e-3582-451c-bd6b-cb47dbb8c0e6 req-e9bcb603-e409-470c-9984-f4664f1e7e46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:18.768661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6152ab6e-3582-451c-bd6b-cb47dbb8c0e6 req-e9bcb603-e409-470c-9984-f4664f1e7e46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:18.777021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:18.777520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:18.777953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:18.778669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:18.779109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:18.782128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:18.796548 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6152ab6e-3582-451c-bd6b-cb47dbb8c0e6 req-e9bcb603-e409-470c-9984-f4664f1e7e46 service nova] Creating event network-changed:7de24bde-df42-4bc2-9d60-e138225d92a4 for instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a on n-h2-854119-9 Aug 29 04:51:18.806352 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6152ab6e-3582-451c-bd6b-cb47dbb8c0e6 req-e9bcb603-e409-470c-9984-f4664f1e7e46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092172 Aug 29 04:51:18.814268 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 97/283] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:18.821127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea742969-7b77-4a32-9aa1-cd50a6ebeb71 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:18.985296 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ea742969-7b77-4a32-9aa1-cd50a6ebeb71 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.168584 Aug 29 04:51:18.986837 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 98/284] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 04:51:18 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:18.997303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-722502c9-2f30-4753-9e0c-cffa52a34777 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Calling method '.version_select at 0x7f1aba1093a0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:19.311094 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-722502c9-2f30-4753-9e0c-cffa52a34777 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-2048150936?user_id=ccd995b1f1d846afbfe65c351395d20a" status: 200 len: 512 microversion: 2.10 time: 0.321123 Aug 29 04:51:19.311711 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 99/285] 10.222.0.20 () {60 vars in 1340 bytes} [Mon Aug 29 04:51:18 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2048150936?user_id=ccd995b1f1d846afbfe65c351395d20a => generated 512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:51:19.322188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-fbf73a83-1110-4568-8b97-2bac8ecff9da req-485582a9-a4dc-4bd3-80c9-b71cda53eaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62702580-59ac-4125-ba70-96e4f239dbc3", "name": "network-vif-plugged", "status": "completed", "tag": "2a21104d-abfb-4eaa-ba7f-9469f2215d82"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:19.348353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fbf73a83-1110-4568-8b97-2bac8ecff9da req-485582a9-a4dc-4bd3-80c9-b71cda53eaf3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:19.348908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fbf73a83-1110-4568-8b97-2bac8ecff9da req-485582a9-a4dc-4bd3-80c9-b71cda53eaf3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:19.349572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fbf73a83-1110-4568-8b97-2bac8ecff9da req-485582a9-a4dc-4bd3-80c9-b71cda53eaf3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:19.370395 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-fbf73a83-1110-4568-8b97-2bac8ecff9da req-485582a9-a4dc-4bd3-80c9-b71cda53eaf3 service nova] Creating event network-vif-plugged:2a21104d-abfb-4eaa-ba7f-9469f2215d82 for instance 62702580-59ac-4125-ba70-96e4f239dbc3 on n-h1-854119-9 Aug 29 04:51:19.381173 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-fbf73a83-1110-4568-8b97-2bac8ecff9da req-485582a9-a4dc-4bd3-80c9-b71cda53eaf3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066411 Aug 29 04:51:19.395630 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 100/286] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:19.403188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e228de2d-d364-464a-b2d6-bef0593894c4 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Calling method '.version_select at 0x7f1aba2d71f0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:19.583459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:19.594680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:19.596387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:19.597683 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b31aaa3-89cb-46e5-942b-dd36ce48b4fe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1362 microversion: 2.25 time: 0.845042 Aug 29 04:51:19.598722 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 187/287] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:18 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1362 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:19.603839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:19.604942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:19.640170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:19.642074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:19.644373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:19.645275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:19.645868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:19.649325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:20.007640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:20.022173 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5db0696e-acfc-4dea-b2d6-f1a8fc599768 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1470 microversion: 2.1 time: 0.421102 Aug 29 04:51:20.023104 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 188/288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:19 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1470 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:20.032639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-acf4a0cc-2743-487b-be51-f72828137824 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:20.052989 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-acf4a0cc-2743-487b-be51-f72828137824 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.028575 Aug 29 04:51:20.054176 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 189/289] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:20 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:20.066221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57278209-91da-4bbd-92e7-0b33a182d321 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Action: 'create', calling method: .version_select at 0x7f1ab9f27c10>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2035354780", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoVEdbkeJOApifJNnkWwKPwR/nLE3x3TcukITzcOALOpAT1iB9e1oZ4NqE8J4CYUPmrCIkzDtBfWyyggWJktK7zYLtbGCtWpP0IloTSsHdNu5sfr/fxcP3Dx+VaeXDZg=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:20.084472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-57278209-91da-4bbd-92e7-0b33a182d321 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Getting quotas for project c19d5e3189f443f7ad560872d7bbb21d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:51:20.088606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-57278209-91da-4bbd-92e7-0b33a182d321 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Getting quotas for user e4fa061cee3b4d63a213204f499cb50b and project c19d5e3189f443f7ad560872d7bbb21d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:51:20.116417 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57278209-91da-4bbd-92e7-0b33a182d321 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.054332 Aug 29 04:51:20.120286 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 190/290] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 04:51:20 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 04:51:20.130096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b1edd01c-e3af-4dce-99e5-71f8f05b9c55 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:20.183499 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b1edd01c-e3af-4dce-99e5-71f8f05b9c55 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.061288 Aug 29 04:51:20.188258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 191/291] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:20 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:20.189208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ac055e53-b175-4f96-a714-57aab3907837 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Calling method '.version_select at 0x7f1ab9e33280>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:20.193106 n-d-854119-9 devstack@n-api.service[128872]: WARNING oslo_db.sqlalchemy.utils [None req-ac055e53-b175-4f96-a714-57aab3907837 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 04:51:20.202843 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ac055e53-b175-4f96-a714-57aab3907837 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=ccd995b1f1d846afbfe65c351395d20a" status: 200 len: 723 microversion: 2.10 time: 0.017344 Aug 29 04:51:20.209542 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 192/292] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Aug 29 04:51:20 2022] GET /compute/v2.1/os-keypairs?user_id=ccd995b1f1d846afbfe65c351395d20a => generated 723 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:51:20.209542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-394340d2-3e77-479c-9043-30c53f9c15b6 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1785468228", "availability_zone": "tempest-test_az-965647114"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:20.235795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-394340d2-3e77-479c-9043-30c53f9c15b6 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Generated uuid 217c6f39-125d-43ff-8c59-3f9ca5ee68db for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:20.273406 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-394340d2-3e77-479c-9043-30c53f9c15b6 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.068796 Aug 29 04:51:20.274098 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 193/293] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Aug 29 04:51:20 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:20.280286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6821926d-034e-43dd-a063-31eb99485414 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Calling method '.version_select at 0x7f1aba390820>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:20.302626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6821926d-034e-43dd-a063-31eb99485414 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2035354780" status: 204 len: 0 microversion: 2.10 time: 0.027423 Aug 29 04:51:20.306943 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 194/294] 10.222.0.20 () {60 vars in 1325 bytes} [Mon Aug 29 04:51:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2035354780 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:51:20.309059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd270bc9-c567-4342-83f5-e88e43df0a03 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1785468228_new", "availability_zone": "tempest-test_az-965647114_new"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:20.454992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd270bc9-c567-4342-83f5-e88e43df0a03 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:20.457041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd270bc9-c567-4342-83f5-e88e43df0a03 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:20.457766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd270bc9-c567-4342-83f5-e88e43df0a03 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:20.506934 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cd270bc9-c567-4342-83f5-e88e43df0a03 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.201813 Aug 29 04:51:20.507577 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 195/295] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Aug 29 04:51:20 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:20.523317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ddbc9ef1-32e4-4c0b-b7fc-ab2ea59743b3 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Calling method '.version_select at 0x7f1ab9f7ff70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:20.555647 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ddbc9ef1-32e4-4c0b-b7fc-ab2ea59743b3 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-9001430?user_id=ccd995b1f1d846afbfe65c351395d20a" status: 204 len: 0 microversion: 2.10 time: 0.041677 Aug 29 04:51:20.560171 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 196/296] 10.222.0.20 () {60 vars in 1334 bytes} [Mon Aug 29 04:51:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-9001430?user_id=ccd995b1f1d846afbfe65c351395d20a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:51:20.565427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2228cf87-1f11-473e-b4b8-188b54f9ad76 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:20.575070 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2228cf87-1f11-473e-b4b8-188b54f9ad76 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.013660 Aug 29 04:51:20.575662 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 197/297] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:51:20 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:20.588327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0eba2895-878e-4cc5-8c17-e443b370c5f7 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] Calling method '.version_select at 0x7f1ab9e49700>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:20.612564 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0eba2895-878e-4cc5-8c17-e443b370c5f7 tempest-KeyPairsV210TestJSON-1003349853 tempest-KeyPairsV210TestJSON-1003349853-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048150936?user_id=ccd995b1f1d846afbfe65c351395d20a" status: 204 len: 0 microversion: 2.10 time: 0.027747 Aug 29 04:51:20.618752 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 198/298] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:51:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048150936?user_id=ccd995b1f1d846afbfe65c351395d20a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:51:20.623547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64cda67f-d55d-42e2-ac9a-fee4b114a697 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:20.673280 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-64cda67f-d55d-42e2-ac9a-fee4b114a697 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.053661 Aug 29 04:51:20.679329 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 199/299] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:20 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:20.685084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:20.685689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:20.692571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:20.694088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:20.694723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:20.695792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:20.697745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:20.697745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:20.697745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:21.043371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:21.055041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:21.056650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:21.057798 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-362c6e14-5f83-4eea-bdd2-9fd3cdb067e6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1362 microversion: 2.25 time: 0.377366 Aug 29 04:51:21.059979 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 200/300] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:20 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:21.075313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e4e99afb-78c1-48f3-94d8-98c26869059d tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-11614132"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:21.087345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-e4e99afb-78c1-48f3-94d8-98c26869059d tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Generated uuid 3e2b0398-5773-4533-84ba-5b469c384816 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 04:51:21.129292 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e4e99afb-78c1-48f3-94d8-98c26869059d tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.067838 Aug 29 04:51:21.130034 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 201/301] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 04:51:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:21.141372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:21.149621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:21.160355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:21.161004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:21.161668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:21.162573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:21.163481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:21.164308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:21.327641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e228de2d-d364-464a-b2d6-bef0593894c4 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4" status: 202 len: 0 microversion: 2.1 time: 1.930576 Aug 29 04:51:21.330461 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 101/302] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 04:51:19 2022] DELETE /compute/v2.1/os-floating-ips/6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 => generated 0 bytes in 1934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:21.356247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03e157bc-5ec1-428f-8f9d-93e20fe42147 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:21.385070 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03e157bc-5ec1-428f-8f9d-93e20fe42147 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 229 microversion: 2.1 time: 0.049750 Aug 29 04:51:21.386368 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 102/303] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:51:21 2022] GET /compute/v2.1/os-aggregates => generated 229 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:21.399067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f91e2471-ee4a-43a3-8084-82395ca04d67 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Calling method '.version_select at 0x7f1aba2d7af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:21.574113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-f91e2471-ee4a-43a3-8084-82395ca04d67 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 could not be found", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 04:51:21.574820 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f91e2471-ee4a-43a3-8084-82395ca04d67 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] HTTP exception thrown: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f91e2471-ee4a-43a3-8084-82395ca04d67 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Request method failure captured: Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-floating-ips/6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 HTTP/1.1 Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEW2FpWC0H9GS9p9jdz-BuySM9AKQff8Ueaawu1WFSooicH0SopEC1GJNvSGW9EiPnPNu8a8OdO6XookT2pJ1qwr_BDVUt45MTqkiut76xIbRfP6X4lNYxaP3S75A97zuYMjr_hYwumZx1E-_jkNuwXLkz5fGkxEC2uBeduS1D41iwM Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 55fae43d829c46c69b88e36fe5e90206 Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-FloatingIPsTestJSON-1900405813 Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:21.588250 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/55fae43d829c46c69b88e36fe5e90206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/55fae43d829c46c69b88e36fe5e90206"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_55fae43d829c46c69b88e36fe5e90206", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/55fae43d829c46c69b88e36fe5e90206"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-FloatingIPsTestJSON-1900405813 Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 55fae43d829c46c69b88e36fe5e90206 Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1900405813 Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-FloatingIPsTestJSON-1900405813-project Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e35dfa93f9c9491ba39f9d998192d955 Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-FloatingIPsTestJSON-1900405813-project Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: exception: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4'} Aug 29 04:51:21.590320 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 04:51:21.591247 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 could not be found Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63f98cc8-f108-42cf-ab25-d27ab42a1185'] Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4. Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.592534 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:21.593852 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:21.595623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 Aug 29 04:51:21.595623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.595853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f91e2471-ee4a-43a3-8084-82395ca04d67 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Returning 404 to user: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:21.597752 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f91e2471-ee4a-43a3-8084-82395ca04d67 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4" status: 404 len: 111 microversion: 2.1 time: 0.209541 Aug 29 04:51:21.602020 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 103/304] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 04:51:21 2022] GET /compute/v2.1/os-floating-ips/6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:21.606784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-544a2494-1106-4953-82d6-34a65b6eb7c0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:21.616507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:21.636834 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-226063e6-afee-4b64-b69d-e1320dd0badc tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1470 microversion: 2.1 time: 0.505427 Aug 29 04:51:21.638134 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 202/305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:21 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1470 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:21.649695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=11 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:21.656090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3234fd85-234a-43cc-8e18-d32f15edacc0 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Calling method '.version_select at 0x7f1ab9e49160>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:21.668941 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-544a2494-1106-4953-82d6-34a65b6eb7c0 tempest-AggregatesAdminTestJSON-1972407622 tempest-AggregatesAdminTestJSON-1972407622-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.069049 Aug 29 04:51:21.672805 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 104/306] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:21 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 04:51:21.690692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:21.695220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:21.713246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:21.714056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:21.714736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:21.715655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:21.719053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:21.719753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:21.764085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-3234fd85-234a-43cc-8e18-d32f15edacc0 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 could not be found", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 04:51:21.764811 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3234fd85-234a-43cc-8e18-d32f15edacc0 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] HTTP exception thrown: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3234fd85-234a-43cc-8e18-d32f15edacc0 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Request method failure captured: Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-floating-ips/6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 HTTP/1.1 Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEW2FpWC0H9GS9p9jdz-BuySM9AKQff8Ueaawu1WFSooicH0SopEC1GJNvSGW9EiPnPNu8a8OdO6XookT2pJ1qwr_BDVUt45MTqkiut76xIbRfP6X4lNYxaP3S75A97zuYMjr_hYwumZx1E-_jkNuwXLkz5fGkxEC2uBeduS1D41iwM Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 55fae43d829c46c69b88e36fe5e90206 Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FloatingIPsTestJSON-1900405813 Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:21.769012 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/55fae43d829c46c69b88e36fe5e90206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/55fae43d829c46c69b88e36fe5e90206"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_55fae43d829c46c69b88e36fe5e90206", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/55fae43d829c46c69b88e36fe5e90206"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FloatingIPsTestJSON-1900405813 Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 55fae43d829c46c69b88e36fe5e90206 Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1900405813 Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FloatingIPsTestJSON-1900405813-project Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e35dfa93f9c9491ba39f9d998192d955 Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FloatingIPsTestJSON-1900405813-project Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: exception: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4'} Aug 29 04:51:21.770258 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 04:51:21.770952 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 could not be found Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c35faa3-f1f6-41ac-9c8e-fee2c8bcb149'] Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4. Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.772547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:21.775981 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:21.778232 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 Aug 29 04:51:21.778232 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.778232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3234fd85-234a-43cc-8e18-d32f15edacc0 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] Returning 404 to user: Floating IP not found for ID 6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:21.778232 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3234fd85-234a-43cc-8e18-d32f15edacc0 tempest-FloatingIPsTestJSON-1900405813 tempest-FloatingIPsTestJSON-1900405813-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4" status: 404 len: 111 microversion: 2.1 time: 0.129274 Aug 29 04:51:21.778232 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 203/307] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 04:51:21 2022] DELETE /compute/v2.1/os-floating-ips/6fa986ff-d07d-4457-b2f7-0bdc3c1bf9b4 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:21.782776 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] HTTP exception thrown: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Request method failure captured: Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 HTTP/1.1 Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWBkic4kEiPuUSk1lxs9HuBF6D_okBuGZpGzR44vwMAeRqe4Rwdr5slylo9-GwUaPhspUW9Q_tsKsUI3uKkOchHzpLYFcg66z1RWawOXP7KtbX_cOm6HpOYawmii7B9Zf2THLbDNVwPVBJ73bq8txpIp9B4uLxbcEH0B6-wOkRyQdA Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ce08765336dc474e8b9f646d1014cbe6 Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AggregatesAdminTestJSON-1577717649 Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:21.784402 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce08765336dc474e8b9f646d1014cbe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce08765336dc474e8b9f646d1014cbe6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce08765336dc474e8b9f646d1014cbe6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce08765336dc474e8b9f646d1014cbe6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AggregatesAdminTestJSON-1577717649 Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ce08765336dc474e8b9f646d1014cbe6 Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1577717649 Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AggregatesAdminTestJSON-1577717649-project Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 17de3738d4794c679bbc7cd4bbe02bc3 Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AggregatesAdminTestJSON-1577717649-project Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.785603 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ffa2a319-6a8e-4ec2-aa56-350234e5fd13'} Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:21.786245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.788289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.790325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Returning 404 to user: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:21.790325 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1056b4a0-04c2-4881-8715-84ea4745d8d5 tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 404 len: 111 microversion: 2.1 time: 0.107789 Aug 29 04:51:21.790325 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 105/308] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:51:21 2022] DELETE /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:21.797579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:21.798302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] [instance: ffa2a319-6a8e-4ec2-aa56-350234e5fd13] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:21.806737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:21.807237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:21.807679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:21.808428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:21.808878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:21.809604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:21.829048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] HTTP exception thrown: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Request method failure captured: Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 HTTP/1.1 Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWBkic4kEiPuUSk1lxs9HuBF6D_okBuGZpGzR44vwMAeRqe4Rwdr5slylo9-GwUaPhspUW9Q_tsKsUI3uKkOchHzpLYFcg66z1RWawOXP7KtbX_cOm6HpOYawmii7B9Zf2THLbDNVwPVBJ73bq8txpIp9B4uLxbcEH0B6-wOkRyQdA Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: ce08765336dc474e8b9f646d1014cbe6 Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AggregatesAdminTestJSON-1577717649 Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:21.831636 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce08765336dc474e8b9f646d1014cbe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce08765336dc474e8b9f646d1014cbe6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce08765336dc474e8b9f646d1014cbe6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce08765336dc474e8b9f646d1014cbe6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AggregatesAdminTestJSON-1577717649 Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: ce08765336dc474e8b9f646d1014cbe6 Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1577717649 Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AggregatesAdminTestJSON-1577717649-project Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 17de3738d4794c679bbc7cd4bbe02bc3 Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AggregatesAdminTestJSON-1577717649-project Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.832830 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'ffa2a319-6a8e-4ec2-aa56-350234e5fd13'} Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:21.833496 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. Aug 29 04:51:21.834515 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:21.836406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] Returning 404 to user: Instance ffa2a319-6a8e-4ec2-aa56-350234e5fd13 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:21.837831 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-94db65cc-6eb7-4425-89f6-69b00beda90e tempest-AggregatesAdminTestJSON-1577717649 tempest-AggregatesAdminTestJSON-1577717649-project] 10.222.0.20 "GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13" status: 404 len: 111 microversion: 2.1 time: 0.046709 Aug 29 04:51:21.841303 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 204/309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:21 2022] GET /compute/v2.1/servers/ffa2a319-6a8e-4ec2-aa56-350234e5fd13 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:22.081712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:22.082618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:22.089722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:22.098527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:22.099222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:22.101262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:22.112338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:22.112904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:22.375877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:22.387674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:22.398770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:22.421161 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c771e666-5850-4ab2-859c-6bc32e224009 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1559 microversion: 2.25 time: 0.341670 Aug 29 04:51:22.421775 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 106/310] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:22 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1559 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:51:22.661448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:22.663126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:22.674755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:22.675247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:22.675673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:22.680167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:22.680167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:22.682984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:22.862663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:22.875299 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6da58485-1d56-45a1-9886-db2882c21b8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.217280 Aug 29 04:51:22.876566 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 107/311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:22 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:51:22.926875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:22.927637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:22.939721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:22.943739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:22.944728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:22.946110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:22.947412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:22.948375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:23.181670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 62702580-59ac-4125-ba70-96e4f239dbc3 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:51:23.299496 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-053f50ff-ff2d-4ecd-95a5-0276c9f8e8f5 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 2052 microversion: 2.25 time: 0.850964 Aug 29 04:51:23.300825 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 205/312] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:22 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 2052 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:23.322224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:23.323020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:23.329061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:23.329545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:23.330442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:23.331580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:23.332542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:23.332967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:23.546475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:23.555297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 62702580-59ac-4125-ba70-96e4f239dbc3 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:51:23.613252 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec6c200e-0bf5-4346-9cf4-051e8e42b63d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 2052 microversion: 2.25 time: 0.295241 Aug 29 04:51:23.614595 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 108/313] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:23 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 2052 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:23.635880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b840a996-12b0-4576-9f68-26b766f66e70 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:23.640021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b840a996-12b0-4576-9f68-26b766f66e70 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:23.640536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b840a996-12b0-4576-9f68-26b766f66e70 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:23.640970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b840a996-12b0-4576-9f68-26b766f66e70 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:23.641691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b840a996-12b0-4576-9f68-26b766f66e70 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:23.642144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b840a996-12b0-4576-9f68-26b766f66e70 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:23.642561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b840a996-12b0-4576-9f68-26b766f66e70 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:23.712449 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b840a996-12b0-4576-9f68-26b766f66e70 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.080265 Aug 29 04:51:23.717262 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 206/314] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Aug 29 04:51:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:51:23.725511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-9", "block_migration": "auto"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:23.728801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:23.743357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:23.744944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:23.745609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:23.746463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:23.747190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:23.747769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:23.882510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'flavor' on Instance uuid 62702580-59ac-4125-ba70-96e4f239dbc3 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:51:23.916727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:23.917355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:23.929589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:23.933158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:23.933612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:23.934344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:23.934803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:23.935228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:23.976685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Going to try to live migrate instance to n-h2-854119-9 {{(pid=128871) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 04:51:24.194411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:24.214729 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e3ef8b6e-b48c-4703-8292-487c3da72ebd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.317217 Aug 29 04:51:24.217144 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 207/315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:23 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:25.569437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-27c40ee6-8f25-402b-94f9-36018974262c tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1680893910", "id": 151382139, "os-flavor-access:is_public": "False"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:25.603558 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-27c40ee6-8f25-402b-94f9-36018974262c tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.395042 Aug 29 04:51:25.605132 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 208/316] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:25 2022] POST /compute/v2.1/flavors => generated 436 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:25.616316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:25.617508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:25.629527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:25.630521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:25.631487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:25.633616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:25.633616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:25.634106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:25.862070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:25.879241 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e37d86a-ea8a-40d2-bc4b-86182fbdcca6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.272365 Aug 29 04:51:25.880255 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 209/317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:25 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:25.885443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49f69681-81a0-48ce-b3f9-a2e8270e0201 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:26.685245 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-49f69681-81a0-48ce-b3f9-a2e8270e0201 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/151382139/action" status: 200 len: 96 microversion: 2.1 time: 0.803697 Aug 29 04:51:26.691688 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 210/318] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Aug 29 04:51:25 2022] POST /compute/v2.1/flavors/151382139/action => generated 96 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:51:26.702396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dcab26f9-7cd7-4efb-a84d-1d6771896dfd tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:26.988396 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-dcab26f9-7cd7-4efb-a84d-1d6771896dfd tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project 0c6e1418a3004c3ca856e1d27eb32edc combination. Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dcab26f9-7cd7-4efb-a84d-1d6771896dfd tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Request method failure captured: Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/flavors/151382139/action HTTP/1.1 Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 67 Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXLDTXMHwBqy5kasagmG5hjoYvGSO5PVh-rPjxKBOibkd3eJiS8EyPw5fuqNlvmxs5zeFdea5QCmoaUs8WquKOK0-5ptbyHOpPfjz1SWkbPedvEUhKSWJNuaty8Cmdus93J_WvzfnMJwJ4FuPbSxM8Wnd_oqzo0n3g9TcchNNJF_so Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 5d671497f3da4fb0a01e4b9b059e3c6f Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-41630589 Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:26.993506 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d671497f3da4fb0a01e4b9b059e3c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d671497f3da4fb0a01e4b9b059e3c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d671497f3da4fb0a01e4b9b059e3c6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d671497f3da4fb0a01e4b9b059e3c6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-41630589 Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 5d671497f3da4fb0a01e4b9b059e3c6f Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-41630589 Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 459fd239adaf4d9e8a6bc4f1fc152c12 Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: {"addTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} Aug 29 04:51:26.994762 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: exception: Flavor access already exists for flavor 31 and project 0c6e1418a3004c3ca856e1d27eb32edc combination. Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '151382139', 'body': {'addTenantAccess': {'tenant': '0c6e1418a3004c3ca856e1d27eb32edc'}}} Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result.read() Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 04:51:26.995426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '31-0c6e1418a3004c3ca856e1d27eb32edc' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 04:51:26.996425 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 04:51:26.997703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 04:51:26.998681 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result.read() Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '31-0c6e1418a3004c3ca856e1d27eb32edc' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 4, 51, 26, 975155), 'updated_at': None, 'flavor_id': 31, 'project_id': '0c6e1418a3004c3ca856e1d27eb32edc'}] Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:27.001155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 31 and project 0c6e1418a3004c3ca856e1d27eb32edc combination. Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:27.003061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 31 and project 0c6e1418a3004c3ca856e1d27eb32edc combination. Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:27.007326 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:27.009633 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 31 and project 0c6e1418a3004c3ca856e1d27eb32edc combination. Aug 29 04:51:27.009633 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:27.009633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dcab26f9-7cd7-4efb-a84d-1d6771896dfd tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project 0c6e1418a3004c3ca856e1d27eb32edc combination. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:27.009633 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dcab26f9-7cd7-4efb-a84d-1d6771896dfd tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/151382139/action" status: 409 len: 152 microversion: 2.1 time: 0.303515 Aug 29 04:51:27.009633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 211/319] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Aug 29 04:51:26 2022] POST /compute/v2.1/flavors/151382139/action => generated 152 bytes in 307 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:27.015302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:27.016092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:27.030513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:27.031904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:27.033427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:27.034340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:27.034978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:27.035582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:27.702024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:27.714300 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea655b0c-db1b-4f15-bd8e-1c739b75e35c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.713773 Aug 29 04:51:27.715300 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 212/320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:26 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:27.720197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b965bdcf-3ed0-4cfc-8ef8-6f6ba407d0c9 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:27.832543 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa062cc8-bc08-4de2-b6e8-addb28306f5c tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3/action" status: 202 len: 0 microversion: 2.25 time: 4.111096 Aug 29 04:51:27.833171 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 109/321] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 04:51:23 2022] POST /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3/action => generated 0 bytes in 4112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:51:27.841599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:27.842401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:27.865815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:27.872912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:27.873696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:27.874843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:27.875526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:27.876137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:28.198854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:28.209555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:28.211893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:28.213274 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af1aa9f8-36b6-4b64-84ef-a51f2d1a3b0b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1569 microversion: 2.25 time: 0.375832 Aug 29 04:51:28.214164 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 110/322] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:27 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1569 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:51:28.296431 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b965bdcf-3ed0-4cfc-8ef8-6f6ba407d0c9 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/151382139/action" status: 200 len: 21 microversion: 2.1 time: 0.579782 Aug 29 04:51:28.301446 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 213/323] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Aug 29 04:51:27 2022] POST /compute/v2.1/flavors/151382139/action => generated 21 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:51:28.336618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0468ff4e-1a5e-4e1b-acb3-821bf54809e0 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-55707081", "id": 1056794446, "os-flavor-access:is_public": "False"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:28.372308 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0468ff4e-1a5e-4e1b-acb3-821bf54809e0 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.156690 Aug 29 04:51:28.390645 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 111/324] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:28 2022] POST /compute/v2.1/flavors => generated 429 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:28.401218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1506708a-b7b2-48b5-a41b-b68bf681d6b4 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:28.462830 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1506708a-b7b2-48b5-a41b-b68bf681d6b4 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/151382139" status: 202 len: 0 microversion: 2.1 time: 0.067918 Aug 29 04:51:28.468307 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 112/325] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 04:51:28 2022] DELETE /compute/v2.1/flavors/151382139 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:28.473660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22214a8c-2616-40e0-8158-7694ebffe759 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3382946d3a4f4b8ab13606c86165d64b"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:28.479191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-95c30362-6aa1-40af-840d-7ece3d1fc0a9 tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] Action: 'create', calling method: .version_select at 0x7f1ab9e49c10>, body: {"security_group": {"name": "tempest-securitygroup-1326247396", "description": "tempest-description-1642829213"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:28.815851 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22214a8c-2616-40e0-8158-7694ebffe759 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1056794446/action" status: 200 len: 97 microversion: 2.1 time: 0.346484 Aug 29 04:51:28.817328 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 113/326] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Aug 29 04:51:28 2022] POST /compute/v2.1/flavors/1056794446/action => generated 97 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:51:28.822303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f429120-0ebb-4f78-b651-f29a9b534eb5 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:28.848017 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f429120-0ebb-4f78-b651-f29a9b534eb5 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028802 Aug 29 04:51:28.861627 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 114/327] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:28 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:28.870761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:28.871803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:28.879116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:28.879771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:28.880793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:28.881936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:28.882537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:28.883130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:29.274421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:29.305385 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d57ceb69-de2d-404f-951e-6a8569c8459a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.441224 Aug 29 04:51:29.315482 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-95c30362-6aa1-40af-840d-7ece3d1fc0a9 tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.012909 Aug 29 04:51:29.322525 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 115/328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:28 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:29.324507 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 214/329] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:51:28 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:29.329167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9c868ef-57ce-4b3a-9e9d-8bbb48792b0c tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1647535577", "id": 643440561, "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:29.388769 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9c868ef-57ce-4b3a-9e9d-8bbb48792b0c tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.062998 Aug 29 04:51:29.389406 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 215/330] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:29 2022] POST /compute/v2.1/flavors => generated 435 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:29.403989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:29.404649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:29.425403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:29.433155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:29.435009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:29.436742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:29.437550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:29.438351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:29.687219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ca4f5bb-3f83-4cc8-99a0-c814094b645d tempest-FlavorsAccessTestJSON-1181845236 tempest-FlavorsAccessTestJSON-1181845236-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:29.731424 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ca4f5bb-3f83-4cc8-99a0-c814094b645d tempest-FlavorsAccessTestJSON-1181845236 tempest-FlavorsAccessTestJSON-1181845236-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6658 microversion: 2.1 time: 0.406636 Aug 29 04:51:29.731647 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 116/331] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:29 2022] GET /compute/v2.1/flavors/detail => generated 6658 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:29.736007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:29.738447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cc5cad4d-ae27-4b2e-be0d-52f5a9b1e31a tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] Action: 'create', calling method: .version_select at 0x7f1ab9efe8b0>, body: {"security_group": {"name": "tempest-securitygroup-2037252488", "description": "tempest-description-72893630"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:29.746459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:29.754453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:29.756165 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f4e9c759-e00d-43b7-8218-c58b71ecccaf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1569 microversion: 2.25 time: 0.365802 Aug 29 04:51:29.756969 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 216/332] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:29 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1569 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:29.767806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f3fdb9a8-37b2-4c39-b2b4-b6df08c5826b tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:29.779341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-f3fdb9a8-37b2-4c39-b2b4-b6df08c5826b tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f3fdb9a8-37b2-4c39-b2b4-b6df08c5826b tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Request method failure captured: Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/flavors/643440561/os-flavor-access HTTP/1.1 Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXLDTXMHwBqy5kasagmG5hjoYvGSO5PVh-rPjxKBOibkd3eJiS8EyPw5fuqNlvmxs5zeFdea5QCmoaUs8WquKOK0-5ptbyHOpPfjz1SWkbPedvEUhKSWJNuaty8Cmdus93J_WvzfnMJwJ4FuPbSxM8Wnd_oqzo0n3g9TcchNNJF_so Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 5d671497f3da4fb0a01e4b9b059e3c6f Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-41630589 Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:29.789810 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d671497f3da4fb0a01e4b9b059e3c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d671497f3da4fb0a01e4b9b059e3c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d671497f3da4fb0a01e4b9b059e3c6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d671497f3da4fb0a01e4b9b059e3c6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-41630589 Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 5d671497f3da4fb0a01e4b9b059e3c6f Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-41630589 Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 459fd239adaf4d9e8a6bc4f1fc152c12 Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: exception: Access list not available for public flavors. Aug 29 04:51:29.791301 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'flavor_id': '643440561'} Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 29 04:51:29.792147 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:29.793546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f3fdb9a8-37b2-4c39-b2b4-b6df08c5826b tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:29.793546 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f3fdb9a8-37b2-4c39-b2b4-b6df08c5826b tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/643440561/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.033445 Aug 29 04:51:29.793546 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 217/333] 10.222.0.20 () {58 vars in 1206 bytes} [Mon Aug 29 04:51:29 2022] GET /compute/v2.1/flavors/643440561/os-flavor-access => generated 91 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:29.799849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13d21807-408e-49e5-9ee5-b998803931d5 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3382946d3a4f4b8ab13606c86165d64b"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:30.016550 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13d21807-408e-49e5-9ee5-b998803931d5 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1056794446/action" status: 200 len: 21 microversion: 2.1 time: 0.220196 Aug 29 04:51:30.017223 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 218/334] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Aug 29 04:51:29 2022] POST /compute/v2.1/flavors/1056794446/action => generated 21 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:51:30.022556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ffc98f2-527f-4c32-991c-34a5abcda031 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:30.045201 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ffc98f2-527f-4c32-991c-34a5abcda031 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/643440561" status: 202 len: 0 microversion: 2.1 time: 0.026533 Aug 29 04:51:30.046186 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 219/335] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 04:51:30 2022] DELETE /compute/v2.1/flavors/643440561 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:30.052401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9dde8c13-adef-4fb5-980c-98a65735b05c req-9afe65b5-b8e2-4f34-8fff-2e90a0fe7a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62702580-59ac-4125-ba70-96e4f239dbc3", "name": "network-vif-unplugged", "status": "completed", "tag": "2a21104d-abfb-4eaa-ba7f-9469f2215d82"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:30.066751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9dde8c13-adef-4fb5-980c-98a65735b05c req-9afe65b5-b8e2-4f34-8fff-2e90a0fe7a70 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:30.067234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9dde8c13-adef-4fb5-980c-98a65735b05c req-9afe65b5-b8e2-4f34-8fff-2e90a0fe7a70 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:30.067665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9dde8c13-adef-4fb5-980c-98a65735b05c req-9afe65b5-b8e2-4f34-8fff-2e90a0fe7a70 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:30.086798 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9dde8c13-adef-4fb5-980c-98a65735b05c req-9afe65b5-b8e2-4f34-8fff-2e90a0fe7a70 service nova] Creating event network-vif-unplugged:2a21104d-abfb-4eaa-ba7f-9469f2215d82 for instance 62702580-59ac-4125-ba70-96e4f239dbc3 on n-h1-854119-9 Aug 29 04:51:30.093282 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9dde8c13-adef-4fb5-980c-98a65735b05c req-9afe65b5-b8e2-4f34-8fff-2e90a0fe7a70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044898 Aug 29 04:51:30.096090 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 220/336] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:30.098979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=12 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:30.124676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d4cc12b-8775-455c-8ad4-a8c46c043431 tempest-FlavorsAccessTestJSON-1181845236 tempest-FlavorsAccessTestJSON-1181845236-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:30.135982 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cc5cad4d-ae27-4b2e-be0d-52f5a9b1e31a tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.403324 Aug 29 04:51:30.137166 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 117/337] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:51:29 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:30.145513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-73477dab-9050-4976-8f9f-d747cc48ab29 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:30.166579 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d4cc12b-8775-455c-8ad4-a8c46c043431 tempest-FlavorsAccessTestJSON-1181845236 tempest-FlavorsAccessTestJSON-1181845236-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.067643 Aug 29 04:51:30.167726 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 221/338] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:30 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:30.171360 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-73477dab-9050-4976-8f9f-d747cc48ab29 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.033447 Aug 29 04:51:30.172233 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 118/339] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:30 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:30.188365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5fb0cbe-28b0-45c2-9c46-e30020f41dc7 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:30.216501 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f5fb0cbe-28b0-45c2-9c46-e30020f41dc7 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1056794446" status: 202 len: 0 microversion: 2.1 time: 0.034320 Aug 29 04:51:30.218635 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 119/340] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:51:30 2022] DELETE /compute/v2.1/flavors/1056794446 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:30.224701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf3a0c53-55b0-4118-b6f0-5d2514358484 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1134771412", "id": 1726911113, "os-flavor-access:is_public": "False"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:30.257056 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf3a0c53-55b0-4118-b6f0-5d2514358484 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.036796 Aug 29 04:51:30.258214 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 120/341] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:30 2022] POST /compute/v2.1/flavors => generated 439 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:30.266036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-484cfddc-d552-4a86-a2c4-8baaa336b353 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:30.296640 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-484cfddc-d552-4a86-a2c4-8baaa336b353 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.037121 Aug 29 04:51:30.297732 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 121/342] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:30 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:30.422115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2d4a9af-878a-4709-af39-99c1bf2af9d3 tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] Action: 'create', calling method: .version_select at 0x7f1ab9d26d30>, body: {"security_group": {"name": "tempest-securitygroup-1413134438", "description": "tempest-description-1555349988"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:30.569642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a466c700-4459-4033-8276-85c6367266eb tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:30.573206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a466c700-4459-4033-8276-85c6367266eb tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f6a71d9a050f48e2888b85a01d94ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6e1418a3004c3ca856e1d27eb32edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a466c700-4459-4033-8276-85c6367266eb tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] Request method failure captured: Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/flavors/1726911113/action HTTP/1.1 Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 67 Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXKa0tVUHrSgSwNXWhxjgPXeFfmorzIY70NfEsL6faMJn8a_PKcNEiz48TShdSQnfCcAc_LBTb2VeFsJu1xU8WhWKnZpXV3uhS6C2cXe53cEkiioQ3ddLZtNY2pfZd3e48LK7JLTH7iHon5P3SD8m_-Bb8y40fRW8RN-naA18BGKOI Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0c6e1418a3004c3ca856e1d27eb32edc Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-259805834 Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:30.578766 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c6e1418a3004c3ca856e1d27eb32edc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0c6e1418a3004c3ca856e1d27eb32edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0c6e1418a3004c3ca856e1d27eb32edc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c6e1418a3004c3ca856e1d27eb32edc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-259805834 Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0c6e1418a3004c3ca856e1d27eb32edc Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-259805834 Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-FlavorsAccessNegativeTestJSON-259805834-project Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: f6a71d9a050f48e2888b85a01d94ff4d Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-259805834-project Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: {"addTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} Aug 29 04:51:30.580561 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '1726911113', 'body': {'addTenantAccess': {'tenant': '0c6e1418a3004c3ca856e1d27eb32edc'}}} Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:30.581373 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 04:51:30.582765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:30.585526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a466c700-4459-4033-8276-85c6367266eb tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:30.588358 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a466c700-4459-4033-8276-85c6367266eb tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] 10.222.0.20 "POST /compute/v2.1/flavors/1726911113/action" status: 403 len: 130 microversion: 2.1 time: 0.289050 Aug 29 04:51:30.591003 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 122/343] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Aug 29 04:51:30 2022] POST /compute/v2.1/flavors/1726911113/action => generated 130 bytes in 293 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:30.601230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8c75fd4-2b1f-457f-8881-36e144da6f8b tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1135797106", "id": 85762011, "os-flavor-access:is_public": "False"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:30.641628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f8c75fd4-2b1f-457f-8881-36e144da6f8b tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.048608 Aug 29 04:51:30.644056 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 123/344] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:30 2022] POST /compute/v2.1/flavors => generated 425 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:30.655996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:30.659584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:30.675923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:30.676740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:30.677343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:30.678427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:30.679080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:30.679787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:30.975408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:30.983591 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d372974-df04-4fb7-8999-391193e433d3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.338151 Aug 29 04:51:30.984231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 124/345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:30 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:31.002912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bbc9ad1d-c769-47b1-bdd3-fee2cfac8ddb tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:31.024376 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bbc9ad1d-c769-47b1-bdd3-fee2cfac8ddb tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1726911113" status: 202 len: 0 microversion: 2.1 time: 0.024745 Aug 29 04:51:31.029527 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 125/346] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:51:30 2022] DELETE /compute/v2.1/flavors/1726911113 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:31.032541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cbe7ab34-d2db-4738-b710-e50ac2572ac5 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:31.046070 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cbe7ab34-d2db-4738-b710-e50ac2572ac5 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/85762011/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.018060 Aug 29 04:51:31.047435 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 126/347] 10.222.0.20 () {58 vars in 1203 bytes} [Mon Aug 29 04:51:31 2022] GET /compute/v2.1/flavors/85762011/os-flavor-access => generated 21 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:51:31.052895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:31.053762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:31.060406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:31.061088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:31.061728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:31.062584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:31.063183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:31.063778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:31.420696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:31.430963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:31.444560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:31.446872 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72e94c5b-8806-45b7-b911-b6dfc3f68b62 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1569 microversion: 2.25 time: 0.397500 Aug 29 04:51:31.447538 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 127/348] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:31 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1569 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:31.452596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c645fac0-e319-47f6-bc43-78193f786051 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:31.476824 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c645fac0-e319-47f6-bc43-78193f786051 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.027798 Aug 29 04:51:31.477689 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 128/349] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:31.482347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6cf4eda-2178-4d45-8ff4-5dcf1f39bc2f tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:31.492672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2d4a9af-878a-4709-af39-99c1bf2af9d3 tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.323687 Aug 29 04:51:31.493414 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 222/350] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:51:30 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:31.509321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cdea1bf3-b78f-4027-9224-8e33b971b4aa tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1748486276", "id": 1048596421, "os-flavor-access:is_public": "False"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:31.522981 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6cf4eda-2178-4d45-8ff4-5dcf1f39bc2f tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/85762011" status: 202 len: 0 microversion: 2.1 time: 0.043930 Aug 29 04:51:31.528571 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 129/351] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 04:51:31 2022] DELETE /compute/v2.1/flavors/85762011 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:31.534839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03739801-b496-4acd-a5ab-e862907e8ad0 tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] Action: 'create', calling method: .version_select at 0x7f1ab9fc73a0>, body: {"security_group": {"name": "tempest-securitygroup-1248995820", "description": "tempest-description-249229383"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:31.551929 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cdea1bf3-b78f-4027-9224-8e33b971b4aa tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.046444 Aug 29 04:51:31.553135 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 223/352] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:31 2022] POST /compute/v2.1/flavors => generated 439 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:31.564603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3218ee5e-e6ee-4416-b03a-79662084c9a4 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:31.594588 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3218ee5e-e6ee-4416-b03a-79662084c9a4 tempest-FlavorsAccessTestJSON-976245367 tempest-FlavorsAccessTestJSON-976245367-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.040051 Aug 29 04:51:31.608147 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 224/353] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:31.617198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d5e2a09d-141a-45f7-8c4c-296dd830fd60 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:31.864341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d5e2a09d-141a-45f7-8c4c-296dd830fd60 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1048596421/action" status: 200 len: 97 microversion: 2.1 time: 0.259996 Aug 29 04:51:31.866195 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 225/354] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Aug 29 04:51:31 2022] POST /compute/v2.1/flavors/1048596421/action => generated 97 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:51:31.878134 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03739801-b496-4acd-a5ab-e862907e8ad0 tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.347157 Aug 29 04:51:31.888811 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 130/355] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:51:31 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:31.899037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59b80151-03e2-4023-b13e-7267c97d34a2 tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:31.902491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-59b80151-03e2-4023-b13e-7267c97d34a2 tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f6a71d9a050f48e2888b85a01d94ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6e1418a3004c3ca856e1d27eb32edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:31.905995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4399a36d-5775-4030-86d1-01baa25ed5df tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] Calling method '.version_select at 0x7f1ab9e5f040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59b80151-03e2-4023-b13e-7267c97d34a2 tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] Request method failure captured: Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/flavors/1048596421/action HTTP/1.1 Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 70 Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXKa0tVUHrSgSwNXWhxjgPXeFfmorzIY70NfEsL6faMJn8a_PKcNEiz48TShdSQnfCcAc_LBTb2VeFsJu1xU8WhWKnZpXV3uhS6C2cXe53cEkiioQ3ddLZtNY2pfZd3e48LK7JLTH7iHon5P3SD8m_-Bb8y40fRW8RN-naA18BGKOI Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0c6e1418a3004c3ca856e1d27eb32edc Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-259805834 Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:51:31.910822 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c6e1418a3004c3ca856e1d27eb32edc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0c6e1418a3004c3ca856e1d27eb32edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0c6e1418a3004c3ca856e1d27eb32edc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c6e1418a3004c3ca856e1d27eb32edc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-259805834 Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0c6e1418a3004c3ca856e1d27eb32edc Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-259805834 Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsAccessNegativeTestJSON-259805834-project Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f6a71d9a050f48e2888b85a01d94ff4d Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-259805834-project Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: {"removeTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} Aug 29 04:51:31.912339 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '1048596421', 'body': {'removeTenantAccess': {'tenant': '0c6e1418a3004c3ca856e1d27eb32edc'}}} Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can( Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:31.913121 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 04:51:31.914451 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:31.919941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59b80151-03e2-4023-b13e-7267c97d34a2 tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:31.922175 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59b80151-03e2-4023-b13e-7267c97d34a2 tempest-FlavorsAccessNegativeTestJSON-259805834 tempest-FlavorsAccessNegativeTestJSON-259805834-project] 10.222.0.20 "POST /compute/v2.1/flavors/1048596421/action" status: 403 len: 133 microversion: 2.1 time: 0.034125 Aug 29 04:51:31.924681 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 226/356] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Aug 29 04:51:31 2022] POST /compute/v2.1/flavors/1048596421/action => generated 133 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:31.933489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0eacce22-eb43-4920-a047-9d15d080c67f tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0c6e1418a3004c3ca856e1d27eb32edc"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:32.238948 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0eacce22-eb43-4920-a047-9d15d080c67f tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1048596421/action" status: 200 len: 21 microversion: 2.1 time: 0.309363 Aug 29 04:51:32.244635 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 227/357] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Aug 29 04:51:31 2022] POST /compute/v2.1/flavors/1048596421/action => generated 21 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 04:51:32.248098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:32.248877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:32.264554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:32.266407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:32.268661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:32.269407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:32.270043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:32.270979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:32.617863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:32.628134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59dc3e83-e909-41d9-b724-06551b412f1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.386981 Aug 29 04:51:32.628737 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 228/358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:32 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:32.640105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-12dba07b-54d9-452c-8a7d-dd1db9fe6ce4 req-6902f5ae-e286-41d5-bda5-4ec356dda928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62702580-59ac-4125-ba70-96e4f239dbc3", "tag": "2a21104d-abfb-4eaa-ba7f-9469f2215d82"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:32.667319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-12dba07b-54d9-452c-8a7d-dd1db9fe6ce4 req-6902f5ae-e286-41d5-bda5-4ec356dda928 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:32.672834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-12dba07b-54d9-452c-8a7d-dd1db9fe6ce4 req-6902f5ae-e286-41d5-bda5-4ec356dda928 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:32.674150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-12dba07b-54d9-452c-8a7d-dd1db9fe6ce4 req-6902f5ae-e286-41d5-bda5-4ec356dda928 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:32.696077 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-12dba07b-54d9-452c-8a7d-dd1db9fe6ce4 req-6902f5ae-e286-41d5-bda5-4ec356dda928 service nova] Creating event network-changed:2a21104d-abfb-4eaa-ba7f-9469f2215d82 for instance 62702580-59ac-4125-ba70-96e4f239dbc3 on n-h1-854119-9 Aug 29 04:51:32.704218 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-12dba07b-54d9-452c-8a7d-dd1db9fe6ce4 req-6902f5ae-e286-41d5-bda5-4ec356dda928 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073930 Aug 29 04:51:32.705378 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 229/359] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:32.727673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c506544-eefa-4c2f-bb32-6e68dd236459 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:32.778541 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4c506544-eefa-4c2f-bb32-6e68dd236459 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1048596421" status: 202 len: 0 microversion: 2.1 time: 0.072056 Aug 29 04:51:32.780012 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 230/360] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:51:32 2022] DELETE /compute/v2.1/flavors/1048596421 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:32.784593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:32.795368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:32.802152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:32.802642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:32.803080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:32.803782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:32.804500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:32.804733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:33.177832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:33.193181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:33.194729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:33.196018 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ede200d6-f4ec-4321-9eba-5566cce108b1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1569 microversion: 2.25 time: 0.415870 Aug 29 04:51:33.211811 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 231/361] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:32 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1569 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:33.216707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6bad2333-b56c-48ab-a476-7cdc474251b8 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:33.239484 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6bad2333-b56c-48ab-a476-7cdc474251b8 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026339 Aug 29 04:51:33.252747 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 232/362] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:33.260436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d64b002-16ac-4258-97c8-b755c305003f tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2138080803", "id": 1074304407, "os-flavor-access:is_public": "False"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:33.269354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:33.285124 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d64b002-16ac-4258-97c8-b755c305003f tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.028674 Aug 29 04:51:33.294254 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 233/363] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:33 2022] POST /compute/v2.1/flavors => generated 439 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:51:33.303233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c00e131-5974-4762-a291-e5a0e0b82680 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6b4777724b2c4c89990568e802d992e3"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:33.414069 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1c00e131-5974-4762-a291-e5a0e0b82680 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] HTTP exception thrown: Flavor access not found for 37 / 6b4777724b2c4c89990568e802d992e3 combination. Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c00e131-5974-4762-a291-e5a0e0b82680 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Request method failure captured: Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/flavors/1074304407/action HTTP/1.1 Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 70 Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXLDTXMHwBqy5kasagmG5hjoYvGSO5PVh-rPjxKBOibkd3eJiS8EyPw5fuqNlvmxs5zeFdea5QCmoaUs8WquKOK0-5ptbyHOpPfjz1SWkbPedvEUhKSWJNuaty8Cmdus93J_WvzfnMJwJ4FuPbSxM8Wnd_oqzo0n3g9TcchNNJF_so Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 5d671497f3da4fb0a01e4b9b059e3c6f Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-41630589 Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:33.415836 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d671497f3da4fb0a01e4b9b059e3c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d671497f3da4fb0a01e4b9b059e3c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d671497f3da4fb0a01e4b9b059e3c6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d671497f3da4fb0a01e4b9b059e3c6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-41630589 Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 5d671497f3da4fb0a01e4b9b059e3c6f Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-41630589 Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 459fd239adaf4d9e8a6bc4f1fc152c12 Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: {"removeTenantAccess": {"tenant": "6b4777724b2c4c89990568e802d992e3"}} Aug 29 04:51:33.417359 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: exception: Flavor access not found for 37 / 6b4777724b2c4c89990568e802d992e3 combination. Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '1074304407', 'body': {'removeTenantAccess': {'tenant': '6b4777724b2c4c89990568e802d992e3'}}} Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 29 04:51:33.418175 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / 6b4777724b2c4c89990568e802d992e3 combination. Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / 6b4777724b2c4c89990568e802d992e3 combination. Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:33.419335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:33.420656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:33.420656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:33.420656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:33.420656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:33.420656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / 6b4777724b2c4c89990568e802d992e3 combination. Aug 29 04:51:33.420656 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:33.421328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c00e131-5974-4762-a291-e5a0e0b82680 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Returning 404 to user: Flavor access not found for 37 / 6b4777724b2c4c89990568e802d992e3 combination. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:33.422213 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c00e131-5974-4762-a291-e5a0e0b82680 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1074304407/action" status: 404 len: 124 microversion: 2.1 time: 0.126520 Aug 29 04:51:33.427071 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 234/364] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Aug 29 04:51:33 2022] POST /compute/v2.1/flavors/1074304407/action => generated 124 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:33.441580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2cb5a4b5-95d1-4fdc-bc6b-df80418d5567 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:33.495239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2cb5a4b5-95d1-4fdc-bc6b-df80418d5567 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1074304407" status: 202 len: 0 microversion: 2.1 time: 0.062998 Aug 29 04:51:33.496258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 235/365] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:51:33 2022] DELETE /compute/v2.1/flavors/1074304407 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:33.504826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c6aa627-fd1d-4c23-bccf-20de7a5cd5c2 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:33.530928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c6aa627-fd1d-4c23-bccf-20de7a5cd5c2 tempest-FlavorsAccessNegativeTestJSON-41630589 tempest-FlavorsAccessNegativeTestJSON-41630589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.030514 Aug 29 04:51:33.532151 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 236/366] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:33.657002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:33.658525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:33.675300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:33.684902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:33.686039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:33.699382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:33.704396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:33.709389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:33.713550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:34.086196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:34.096846 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bc3e3cb6-f4c1-4bb9-adbf-c4294de6ea3f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.450329 Aug 29 04:51:34.098113 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 237/367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:33 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:34.221570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:34.223878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:34.237234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:34.238565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:34.242158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:34.243497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:34.245348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:34.246067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:34.771302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:34.781033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:34.782484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:34.783673 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ce35a2b-95ee-450e-968b-d7bf6da56265 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1569 microversion: 2.25 time: 0.568239 Aug 29 04:51:34.793278 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 238/368] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:34 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1569 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:35.119123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:35.119706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:35.128996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:35.129486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:35.129909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:35.130610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:35.131053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:35.138097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:35.837639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:35.850678 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55d43c8b-915c-4fd3-8a61-e876b922a551 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.735643 Aug 29 04:51:35.869778 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 239/369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:35 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:51:35.873646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:35.874319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:35.886577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:35.887061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:35.887489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:35.888203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:35.888646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:35.889062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:35.891902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:36.430336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:36.443314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:36.449530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:36.450762 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8ec1df9b-3599-4a19-9874-b9ef5a96d613 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1569 microversion: 2.25 time: 0.593100 Aug 29 04:51:36.451919 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 240/370] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:35 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1569 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:36.876827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:36.877457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:36.887552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:36.888112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:36.888506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:36.904069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:36.905685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:36.906140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:38.690043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:38.700896 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09f77969-8c28-4fc9-b116-f77542a634ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 1.828370 Aug 29 04:51:38.723591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 241/371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:36 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:38.729318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:38.730274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:38.742236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:38.743044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:38.743655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:38.744575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:38.745248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:38.746080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:39.141886 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4399a36d-5775-4030-86d1-01baa25ed5df tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10368 microversion: 2.1 time: 7.251436 Aug 29 04:51:39.142761 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 131/372] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Aug 29 04:51:31 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10368 bytes in 7253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:51:39.334460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:39.344732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:39.347845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:39.361632 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8c301ebf-e70b-4645-9294-d65bb2ad559c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1569 microversion: 2.25 time: 0.626831 Aug 29 04:51:39.362326 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 242/373] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:38 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1569 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:39.370518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17585f4a-c083-407d-b7f0-5bec177f43f9 tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] Calling method '.version_select at 0x7f1ab9ce5940>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:39.561414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c8e02727-4cfb-41de-96db-9c92df0a4c76 tempest-FlavorsV255TestJSON-1777802312 tempest-FlavorsV255TestJSON-1777802312-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-982310047", "id": 52652071, "os-flavor-access:is_public": "True"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:39.598437 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c8e02727-4cfb-41de-96db-9c92df0a4c76 tempest-FlavorsV255TestJSON-1777802312 tempest-FlavorsV255TestJSON-1777802312-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 442 microversion: 2.55 time: 0.454690 Aug 29 04:51:39.612154 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 132/374] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 04:51:39 2022] POST /compute/v2.1/flavors => generated 442 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:51:39.765006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e50f278-6464-4481-b2a3-77c5adbcc724 tempest-FlavorsV255TestJSON-140091337 tempest-FlavorsV255TestJSON-140091337-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:39.774811 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e50f278-6464-4481-b2a3-77c5adbcc724 tempest-FlavorsV255TestJSON-140091337 tempest-FlavorsV255TestJSON-140091337-project] 10.222.0.20 "GET /compute/v2.1/flavors/52652071" status: 200 len: 442 microversion: 2.55 time: 0.160187 Aug 29 04:51:39.783320 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 133/375] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 04:51:39 2022] GET /compute/v2.1/flavors/52652071 => generated 442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:51:39.787018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:39.787742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:39.794899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:39.795398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:39.796008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:39.796928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:39.797532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:39.798121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:39.910103 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17585f4a-c083-407d-b7f0-5bec177f43f9 tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.546379 Aug 29 04:51:39.911628 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 243/376] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Aug 29 04:51:39 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:39.916753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37bab271-1fee-4233-aac1-cf5a7a22586b tempest-FlavorsV255TestJSON-1777802312 tempest-FlavorsV255TestJSON-1777802312-project-admin] Action: 'update', calling method: .version_select at 0x7f1abb4b1d30>, body: {"flavor": {"description": "new"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:39.973590 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37bab271-1fee-4233-aac1-cf5a7a22586b tempest-FlavorsV255TestJSON-1777802312 tempest-FlavorsV255TestJSON-1777802312-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/52652071" status: 200 len: 443 microversion: 2.55 time: 0.058568 Aug 29 04:51:39.974855 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 244/377] 10.222.0.20 () {62 vars in 1213 bytes} [Mon Aug 29 04:51:39 2022] PUT /compute/v2.1/flavors/52652071 => generated 443 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:51:39.981029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bd659f10-2141-44f6-909f-50d6064b7312 tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] Calling method '.version_select at 0x7f1ab9e498b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:40.057811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:40.083529 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4bf67218-5445-4ba4-ab19-b744b74a9c87 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.305708 Aug 29 04:51:40.112402 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 134/378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:39 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:40.119141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a53a2e9a-8ab1-40ac-89d1-d26bafe7122f tempest-FlavorsV255TestJSON-140091337 tempest-FlavorsV255TestJSON-140091337-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:40.172618 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a53a2e9a-8ab1-40ac-89d1-d26bafe7122f tempest-FlavorsV255TestJSON-140091337 tempest-FlavorsV255TestJSON-140091337-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6583 microversion: 2.55 time: 0.058631 Aug 29 04:51:40.174315 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 135/379] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:51:40 2022] GET /compute/v2.1/flavors/detail => generated 6583 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:40.193847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-90166ded-c171-4ee3-b256-bf8031ea3272 tempest-FlavorsV255TestJSON-140091337 tempest-FlavorsV255TestJSON-140091337-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:40.232955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-90166ded-c171-4ee3-b256-bf8031ea3272 tempest-FlavorsV255TestJSON-140091337 tempest-FlavorsV255TestJSON-140091337-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3673 microversion: 2.55 time: 0.043115 Aug 29 04:51:40.235918 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 136/380] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 29 04:51:40 2022] GET /compute/v2.1/flavors => generated 3673 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:40.251614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-466012d2-80b7-499a-993d-0ff1d33caa5f tempest-FlavorsV255TestJSON-1777802312 tempest-FlavorsV255TestJSON-1777802312-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:40.285579 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-466012d2-80b7-499a-993d-0ff1d33caa5f tempest-FlavorsV255TestJSON-1777802312 tempest-FlavorsV255TestJSON-1777802312-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/52652071" status: 202 len: 0 microversion: 2.55 time: 0.037482 Aug 29 04:51:40.286196 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 137/381] 10.222.0.20 () {60 vars in 1196 bytes} [Mon Aug 29 04:51:40 2022] DELETE /compute/v2.1/flavors/52652071 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:51:40.294749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4433280-46c7-4824-b682-c183ec4f6182 tempest-FlavorsV255TestJSON-1777802312 tempest-FlavorsV255TestJSON-1777802312-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:40.324896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=15 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:40.384703 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4433280-46c7-4824-b682-c183ec4f6182 tempest-FlavorsV255TestJSON-1777802312 tempest-FlavorsV255TestJSON-1777802312-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.086073 Aug 29 04:51:40.385544 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 138/382] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:51:40 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:40.405032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:40.410178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:40.442330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:40.443168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:40.444478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:40.446324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:40.447685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:40.449884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:40.966930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:40.981749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:40.983243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:40.984419 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-40371f4b-ee1d-40fb-9f86-380ab8750ddb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1569 microversion: 2.25 time: 0.597849 Aug 29 04:51:40.988746 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 139/383] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:40 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1569 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:41.109226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:41.110034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:41.120440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:41.123040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:41.123659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:41.125849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:41.127299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:41.127925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:41.383590 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bd659f10-2141-44f6-909f-50d6064b7312 tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/08062ec2-6f22-43d4-891f-142c0e43f855" status: 202 len: 0 microversion: 2.1 time: 1.407336 Aug 29 04:51:41.384969 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 245/384] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:51:39 2022] DELETE /compute/v2.1/os-security-groups/08062ec2-6f22-43d4-891f-142c0e43f855 => generated 0 bytes in 1409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:41.395352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7b72b47-4003-461b-873e-5afe920ed1c3 tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] Calling method '.version_select at 0x7f1ab9d26d30>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:41.542726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:41.557500 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-438437d2-ca38-4f10-9faf-c6544c11bc93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1475 microversion: 2.1 time: 0.453501 Aug 29 04:51:41.577184 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 140/385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:41 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1475 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:42.154505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1868957407", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "88954c15-7b5c-4596-81c9-e1fa7d3eb920"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:42.182873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7b72b47-4003-461b-873e-5afe920ed1c3 tempest-SecurityGroupsTestAdminJSON-1965505559 tempest-SecurityGroupsTestAdminJSON-1965505559-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/944f9fdf-eae9-48d6-8cfa-0313fc736270" status: 202 len: 0 microversion: 2.1 time: 0.794004 Aug 29 04:51:42.184023 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 246/386] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:51:41 2022] DELETE /compute/v2.1/os-security-groups/944f9fdf-eae9-48d6-8cfa-0313fc736270 => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:42.189565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:42.190359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:42.207899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:42.218221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:42.218831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:42.220669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:42.222436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:42.223109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:42.301776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] validate_networks() for [('88954c15-7b5c-4596-81c9-e1fa7d3eb920', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:51:43.183665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:43.203454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:43.207832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:43.209827 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28b3bbfe-83cd-49c5-b75f-1a11fa7c87c9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1559 microversion: 2.25 time: 1.024629 Aug 29 04:51:43.211924 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 247/387] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:42 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1559 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:43.235896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-65c275ec-9eb2-409d-961f-ffccc96dad17 tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] Calling method '.version_select at 0x7f1ab9ce58b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:43.686401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:51:43.687350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:51:43.687956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:51:43.688683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:51:43.689227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:51:43.705172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:43.705933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:43.706559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:43.708938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:43.714690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:43.716869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:43.752179 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-65c275ec-9eb2-409d-961f-ffccc96dad17 tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/42979020-1093-4d9f-805f-bf9c9bb97ae1" status: 202 len: 0 microversion: 2.1 time: 0.538472 Aug 29 04:51:43.753859 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 248/388] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:51:43 2022] DELETE /compute/v2.1/os-security-groups/42979020-1093-4d9f-805f-bf9c9bb97ae1 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:43.760697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:43.761619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:43.796495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:43.798823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:43.799744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Getting quotas for project 97fb2ee2a4cf4e17822da422a33bf43a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:51:43.800276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:43.802997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:43.807450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:43.841990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:43.864812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Getting quotas for user 56acc42254af4204b832dff3f7240d20 and project 97fb2ee2a4cf4e17822da422a33bf43a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:51:43.925482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:51:43.933350 n-d-854119-9 devstack@n-api.service[128871]: WARNING nova.utils [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1868957407 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-186895740 Aug 29 04:51:43.934267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:51:44.060275 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed126ed1-531d-489e-82ed-bc7472767574 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.162624 Aug 29 04:51:44.061527 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 141/389] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:51:44.066238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-53cc08ce-9289-496e-928f-0b8747e0578a tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '.version_select at 0x7f1ab9efe3a0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:44.070085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53cc08ce-9289-496e-928f-0b8747e0578a tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:44.070785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53cc08ce-9289-496e-928f-0b8747e0578a tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:44.071390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53cc08ce-9289-496e-928f-0b8747e0578a tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:44.121305 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-53cc08ce-9289-496e-928f-0b8747e0578a tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1109 microversion: 2.25 time: 0.058396 Aug 29 04:51:44.122562 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 142/390] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Aug 29 04:51:44 2022] GET /compute/v2.1/os-migrations => generated 1109 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:44.576927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:44.587355 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-283b5425-6fa7-406d-8242-6b6655dda2d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1474 microversion: 2.1 time: 0.831964 Aug 29 04:51:44.597141 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 249/391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:43 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1474 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:44.620679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8cd7f144-11a3-43fb-9fc2-bb4c7dc050cc tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] Calling method '.version_select at 0x7f1ab9ce3160>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:44.803759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Calling method '.version_select at 0x7f1ab9f088b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:44.807628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:44.808797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:44.809494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:44.846731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:44.854140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:44.854861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:44.882033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:44.884421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:44.885038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:44.901917 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95b1ab80-c848-42dd-8142-73ddac28da83 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.778116 Aug 29 04:51:44.906141 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 143/392] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:44.917915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c64cb35b-d273-482b-9be3-99588d936f5a tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:44.920818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c64cb35b-d273-482b-9be3-99588d936f5a tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:45.046764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c64cb35b-d273-482b-9be3-99588d936f5a tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:45.061333 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c64cb35b-d273-482b-9be3-99588d936f5a tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1232 microversion: 2.1 time: 0.151606 Aug 29 04:51:45.062076 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 144/393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:44 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1232 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:45.076397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:45.077415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:45.087670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.088885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.089490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.090652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.091289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.092083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.596024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 62702580-59ac-4125-ba70-96e4f239dbc3 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:51:45.630512 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-32f01e7b-3f84-428c-b011-4a01fc574c0e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 2052 microversion: 2.25 time: 0.566723 Aug 29 04:51:45.632652 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 145/394] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:45 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 2052 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:45.651113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Calling method '.version_select at 0x7f1ab9f03ee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:45.660620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.661128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.671379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.709980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.710809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.711443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.728334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.730276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.733452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.742863 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-983f37a2-3695-40f8-9ff4-65151726245d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.108824 Aug 29 04:51:45.753618 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 146/395] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 29 04:51:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:45.758725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:45.764550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:45.782851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.784874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.785421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.787099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.789611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.790521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.795978 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8cd7f144-11a3-43fb-9fc2-bb4c7dc050cc tempest-SecurityGroupsTestAdminJSON-669512218 tempest-SecurityGroupsTestAdminJSON-669512218-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/8618551b-d69b-464f-8059-356c1b98f177" status: 202 len: 0 microversion: 2.1 time: 1.194595 Aug 29 04:51:45.802861 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 250/396] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:51:44 2022] DELETE /compute/v2.1/os-security-groups/8618551b-d69b-464f-8059-356c1b98f177 => generated 0 bytes in 1202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:51:45.814086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Calling method '.version_select at 0x7f1ab9e49c10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:45.816414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.821039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.823695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.874503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.876499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.877300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.907759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:45.915969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:45.916675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:45.923987 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5431d18-47d4-4153-a240-92ed2d8ade6c tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.119318 Aug 29 04:51:45.925943 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 251/397] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:45.937138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1518706196", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "a8766693-25d9-4aae-b9cf-1bcb5ffe843b"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:46.056495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] validate_networks() for [('a8766693-25d9-4aae-b9cf-1bcb5ffe843b', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:51:46.402295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:46.415698 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bb114ab-3bd8-4399-8fa7-7d5750f89673 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1474 microversion: 2.1 time: 0.660475 Aug 29 04:51:46.416635 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 147/398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:45 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1474 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:46.432314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c253b8ae-6be6-4cae-a377-501cb042ff1d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Calling method '.version_select at 0x7f1ab9ee58b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:46.438056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c253b8ae-6be6-4cae-a377-501cb042ff1d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:46.438843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c253b8ae-6be6-4cae-a377-501cb042ff1d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:46.440543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c253b8ae-6be6-4cae-a377-501cb042ff1d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:46.493679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c253b8ae-6be6-4cae-a377-501cb042ff1d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:46.495925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c253b8ae-6be6-4cae-a377-501cb042ff1d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:46.496601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c253b8ae-6be6-4cae-a377-501cb042ff1d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:46.513583 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c253b8ae-6be6-4cae-a377-501cb042ff1d tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.093304 Aug 29 04:51:46.517003 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 148/399] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:46 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:46.531170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b9a87bfe-bf7d-4133-8f97-975e67d7209a req-36aed906-5b4a-496e-bb40-86bc3bd8c6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ffbebb-969a-4762-a339-032f7da39897", "name": "network-vif-unplugged", "status": "completed", "tag": "e3cc9390-436f-423e-9d4e-3f5a7740bcc5"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:46.552714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b9a87bfe-bf7d-4133-8f97-975e67d7209a req-36aed906-5b4a-496e-bb40-86bc3bd8c6ad service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:46.553486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b9a87bfe-bf7d-4133-8f97-975e67d7209a req-36aed906-5b4a-496e-bb40-86bc3bd8c6ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:46.554173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b9a87bfe-bf7d-4133-8f97-975e67d7209a req-36aed906-5b4a-496e-bb40-86bc3bd8c6ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:46.587831 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b9a87bfe-bf7d-4133-8f97-975e67d7209a req-36aed906-5b4a-496e-bb40-86bc3bd8c6ad service nova] Creating event network-vif-unplugged:e3cc9390-436f-423e-9d4e-3f5a7740bcc5 for instance 53ffbebb-969a-4762-a339-032f7da39897 on n-h1-854119-9 Aug 29 04:51:46.593375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:46.611954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-b9a87bfe-bf7d-4133-8f97-975e67d7209a req-36aed906-5b4a-496e-bb40-86bc3bd8c6ad service nova] Instance 53ffbebb-969a-4762-a339-032f7da39897 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:51:46.640247 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b9a87bfe-bf7d-4133-8f97-975e67d7209a req-36aed906-5b4a-496e-bb40-86bc3bd8c6ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121409 Aug 29 04:51:46.641058 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 149/400] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:46.648598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:46.649646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:46.656737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:46.657699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:46.658479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:46.659389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:46.660036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:46.660683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:46.818959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:46.830367 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc1bb0d9-5e2e-42cb-9761-135fb2eb40ad tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1290 microversion: 2.1 time: 0.187877 Aug 29 04:51:46.836148 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 150/401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:46 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1290 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:46.855114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-765d5969-6999-4552-9b39-f99157317786 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Calling method '.version_select at 0x7f1ab9f08dc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:46.857787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-765d5969-6999-4552-9b39-f99157317786 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:46.858589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-765d5969-6999-4552-9b39-f99157317786 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:46.859176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-765d5969-6999-4552-9b39-f99157317786 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:46.882291 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-765d5969-6999-4552-9b39-f99157317786 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.030633 Aug 29 04:51:46.897899 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 151/402] 10.222.0.20 () {58 vars in 1179 bytes} [Mon Aug 29 04:51:46 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:46.904257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Calling method '.version_select at 0x7f1aba025310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:46.907024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:46.907699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:46.915849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:46.939455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:46.940445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:46.941400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:46.960388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:46.962085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:46.962784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:46.978123 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0065c3bb-2ca7-43a8-a463-cc2c62b84b7e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.078219 Aug 29 04:51:46.979026 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 152/403] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:51:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:47.003752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b5ba91e5-ce4c-4211-bd6a-00ac8d6f1c91 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Calling method '.version_select at 0x7f1ab9f03ee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:47.023040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5ba91e5-ce4c-4211-bd6a-00ac8d6f1c91 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:47.023902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5ba91e5-ce4c-4211-bd6a-00ac8d6f1c91 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:47.026894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5ba91e5-ce4c-4211-bd6a-00ac8d6f1c91 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:47.059976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5ba91e5-ce4c-4211-bd6a-00ac8d6f1c91 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:47.069359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5ba91e5-ce4c-4211-bd6a-00ac8d6f1c91 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:47.071248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5ba91e5-ce4c-4211-bd6a-00ac8d6f1c91 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:47.094705 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b5ba91e5-ce4c-4211-bd6a-00ac8d6f1c91 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.108403 Aug 29 04:51:47.102020 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 153/404] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:46 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:47.115628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-165949f0-8af5-482b-a30f-841d8d3f406e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Calling method '.version_select at 0x7f1ab9f03a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:47.124398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-165949f0-8af5-482b-a30f-841d8d3f406e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:47.126133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-165949f0-8af5-482b-a30f-841d8d3f406e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:47.128922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-165949f0-8af5-482b-a30f-841d8d3f406e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:47.159807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-165949f0-8af5-482b-a30f-841d8d3f406e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:47.164568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-165949f0-8af5-482b-a30f-841d8d3f406e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:47.165934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-165949f0-8af5-482b-a30f-841d8d3f406e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:47.180090 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-165949f0-8af5-482b-a30f-841d8d3f406e tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.072333 Aug 29 04:51:47.182733 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 154/405] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:51:47 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:47.207665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Calling method '.version_select at 0x7f1aba025af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:47.209021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:47.211856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:47.212556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:47.230569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:47.231373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:47.231947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:47.247984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:47.248778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:47.255266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:47.301478 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-feda097b-a7c2-4596-8ea4-f429720ca023 tempest-HypervisorAdminTestJSON-981368768 tempest-HypervisorAdminTestJSON-981368768-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.106112 Aug 29 04:51:47.311740 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 155/406] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Aug 29 04:51:47 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:47.443972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:47.444765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:47.464183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:47.466811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:47.470265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:47.472092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:47.474049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:47.479242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:48.293056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:51:48.293553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:51:48.293931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:51:48.294337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:51:48.294743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:51:48.312073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:48.313879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:48.314503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:48.320852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:48.321707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:48.322412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:48.386820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for project 2864fc0a731f4945a27e68889572000f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:51:48.400042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for user 62ea00a8210b4ede95e54c53e7445794 and project 2864fc0a731f4945a27e68889572000f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:51:48.419060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:51:48.423178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:51:48.434024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:48.441921 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4ff0d227-6146-4bc5-92f1-66870e260d1c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1474 microversion: 2.1 time: 1.003856 Aug 29 04:51:48.452520 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 156/407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:47 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1474 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:51:48.467646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:48.468636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:48.482185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:48.484813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:48.485492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:48.486386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:48.488761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:48.489362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:48.501215 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-609d60fe-89aa-49e2-9569-ffd0eb6d91b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.573629 Aug 29 04:51:48.508779 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 252/408] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 04:51:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2582 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 04:51:48.516908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9cb9a8c5-3c40-444c-a34e-7559d5f7d071 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:48.518325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9cb9a8c5-3c40-444c-a34e-7559d5f7d071 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:48.665098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9cb9a8c5-3c40-444c-a34e-7559d5f7d071 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:48.674345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9cb9a8c5-3c40-444c-a34e-7559d5f7d071 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:48.681279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:48.696746 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-194326e5-c235-402a-bd5f-68fc0d85ea5c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1290 microversion: 2.1 time: 0.243024 Aug 29 04:51:48.697582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9cb9a8c5-3c40-444c-a34e-7559d5f7d071 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:48.698885 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9cb9a8c5-3c40-444c-a34e-7559d5f7d071 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1262 microversion: 2.25 time: 0.187748 Aug 29 04:51:48.699769 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 253/409] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:48 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1262 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:48.701404 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 157/410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:48 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1290 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:48.706397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-eff7158a-491e-47e4-a4f1-5bae18af755f req-27fea9fa-7232-45ef-b5ca-835c6b82561f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ffbebb-969a-4762-a339-032f7da39897", "tag": "e3cc9390-436f-423e-9d4e-3f5a7740bcc5"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:48.741943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eff7158a-491e-47e4-a4f1-5bae18af755f req-27fea9fa-7232-45ef-b5ca-835c6b82561f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:48.742417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eff7158a-491e-47e4-a4f1-5bae18af755f req-27fea9fa-7232-45ef-b5ca-835c6b82561f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:48.742832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eff7158a-491e-47e4-a4f1-5bae18af755f req-27fea9fa-7232-45ef-b5ca-835c6b82561f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:48.759841 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-eff7158a-491e-47e4-a4f1-5bae18af755f req-27fea9fa-7232-45ef-b5ca-835c6b82561f service nova] Creating event network-changed:e3cc9390-436f-423e-9d4e-3f5a7740bcc5 for instance 53ffbebb-969a-4762-a339-032f7da39897 on n-h1-854119-9 Aug 29 04:51:48.775698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-eff7158a-491e-47e4-a4f1-5bae18af755f req-27fea9fa-7232-45ef-b5ca-835c6b82561f service nova] Instance 53ffbebb-969a-4762-a339-032f7da39897 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:51:48.799616 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-eff7158a-491e-47e4-a4f1-5bae18af755f req-27fea9fa-7232-45ef-b5ca-835c6b82561f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096860 Aug 29 04:51:48.800882 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 158/411] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:49.099053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-34a3e986-13f5-43b7-885d-a6c7b6eb627f tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Calling method '.version_select at 0x7f1ab9ce3550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:49.104245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a3e986-13f5-43b7-885d-a6c7b6eb627f tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:49.108294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a3e986-13f5-43b7-885d-a6c7b6eb627f tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:49.109879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a3e986-13f5-43b7-885d-a6c7b6eb627f tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:49.110976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a3e986-13f5-43b7-885d-a6c7b6eb627f tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:49.113558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a3e986-13f5-43b7-885d-a6c7b6eb627f tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:49.114405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a3e986-13f5-43b7-885d-a6c7b6eb627f tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:49.161266 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-34a3e986-13f5-43b7-885d-a6c7b6eb627f tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.459440 Aug 29 04:51:49.161812 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 254/412] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Aug 29 04:51:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:49.535725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6230e12c-011e-41c4-982f-180527e85109 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Calling method '.version_select at 0x7f1ab9f03dc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:49.546336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6230e12c-011e-41c4-982f-180527e85109 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'c2232b0bbb86498aa6cbba41bca65155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f605e8887c546e7bc78d4869929a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6230e12c-011e-41c4-982f-180527e85109 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Request method failure captured: Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXips3FouvK5mS9LC_t22_Qho2PBEfQa6QeO9yV8R42PAJWxmfM55Movif2x-e7AfU91N86z1AB1EpS9DrbEhh3fD_f-j8ucr5_pAz86o3LMtiob-tt0UP_YuAhfS45_1RIEIj0ZvJELaMM2hnN9ewWsCXzTO5nhd7KLpNNbAHYs4E Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:49.575163 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f605e8887c546e7bc78d4869929a5a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c2232b0bbb86498aa6cbba41bca65155 Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: action_args: {} Aug 29 04:51:49.576604 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:49.577448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 04:51:49.578885 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:49.581743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6230e12c-011e-41c4-982f-180527e85109 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:49.582608 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6230e12c-011e-41c4-982f-180527e85109 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.412007 Aug 29 04:51:49.583312 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 159/413] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Aug 29 04:51:49 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 414 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:49.589136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:49.590774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:49.611881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:49.612915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:49.613721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:49.618516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:49.619205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:49.619836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:50.091440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1332412570", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "9035ba9b-de41-4199-ad6d-44b4cdc08bb4"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:50.139506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:50.154032 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-584e7f2e-945c-4f43-8364-d10412f02ac0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1474 microversion: 2.1 time: 0.569441 Aug 29 04:51:50.154593 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 160/414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:49 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1474 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:50.168652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0484580a-1db1-4649-b80f-56c9fb3dfda3 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Calling method '.version_select at 0x7f1ab9e85790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:50.176188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0484580a-1db1-4649-b80f-56c9fb3dfda3 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'c2232b0bbb86498aa6cbba41bca65155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f605e8887c546e7bc78d4869929a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0484580a-1db1-4649-b80f-56c9fb3dfda3 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Request method failure captured: Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hosts/n-d-854119-9/reboot HTTP/1.1 Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXips3FouvK5mS9LC_t22_Qho2PBEfQa6QeO9yV8R42PAJWxmfM55Movif2x-e7AfU91N86z1AB1EpS9DrbEhh3fD_f-j8ucr5_pAz86o3LMtiob-tt0UP_YuAhfS45_1RIEIj0ZvJELaMM2hnN9ewWsCXzTO5nhd7KLpNNbAHYs4E Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:50.178039 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f605e8887c546e7bc78d4869929a5a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c2232b0bbb86498aa6cbba41bca65155 Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'n-d-854119-9'} Aug 29 04:51:50.179406 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:50.180166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 04:51:50.181321 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.183995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0484580a-1db1-4649-b80f-56c9fb3dfda3 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:50.185134 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0484580a-1db1-4649-b80f-56c9fb3dfda3 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-854119-9/reboot" status: 403 len: 111 microversion: 2.1 time: 0.027384 Aug 29 04:51:50.187850 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 161/415] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Aug 29 04:51:50 2022] GET /compute/v2.1/os-hosts/n-d-854119-9/reboot => generated 111 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:50.195494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:50.196510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:50.205363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] validate_networks() for [('9035ba9b-de41-4199-ad6d-44b4cdc08bb4', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:51:50.208693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:50.209411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:50.210097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:50.211046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:50.211708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:50.212363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:50.665710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:50.680953 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-79cd06e1-f8b2-4f12-bc86-1d4029ce1376 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.491464 Aug 29 04:51:50.681242 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 162/416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:50 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:50.689808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:50.692908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:50.702050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:50.702616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:50.703387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:50.704698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:50.705337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:50.705761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:50.840086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:50.849086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:50.850990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:50.852359 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0056f15a-f6e2-42a5-beea-f0c5605732d4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1314 microversion: 2.25 time: 0.168707 Aug 29 04:51:50.852978 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 163/417] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:50 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:50.858058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5a45a5c3-15d7-4709-9cdf-29bb5944f26a tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Calling method '.version_select at 0x7f1ab9e52af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:50.867109 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5a45a5c3-15d7-4709-9cdf-29bb5944f26a tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5a45a5c3-15d7-4709-9cdf-29bb5944f26a tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Request method failure captured: Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXk2K5Olyqu9E_qoFw5tPLBw6R3oc-8hxur6BYvBFbvt2LFyQkm0QXL_9Dzr8risRd8mJ9uq7tyvHuzX1eoTqR6lUWD8sNHgDZImEwxta3UYreKPj6xvH4CbAQaKaQjWCjI7zkVJ1_TQqbC8YURuXBG5x3Gi_HGQqwsL-j8duYPKGw Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:51:50.869162 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf6969a2f26247ab91a4dfc3608ad909", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e7969836bb3a4a28a47685f492f57176 Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'nonexistent_hostname'} Aug 29 04:51:50.870360 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:50.871315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 04:51:50.873164 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.874312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.876567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5a45a5c3-15d7-4709-9cdf-29bb5944f26a tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:50.877730 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5a45a5c3-15d7-4709-9cdf-29bb5944f26a tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.023294 Aug 29 04:51:50.878606 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 164/418] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Aug 29 04:51:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:50.889744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9260ff30-f762-4790-bfae-14579d6c40c6 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Calling method '.version_select at 0x7f1ab9e5fc10>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:50.897839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9260ff30-f762-4790-bfae-14579d6c40c6 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'c2232b0bbb86498aa6cbba41bca65155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f605e8887c546e7bc78d4869929a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9260ff30-f762-4790-bfae-14579d6c40c6 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Request method failure captured: Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hosts/n-d-854119-9 HTTP/1.1 Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXips3FouvK5mS9LC_t22_Qho2PBEfQa6QeO9yV8R42PAJWxmfM55Movif2x-e7AfU91N86z1AB1EpS9DrbEhh3fD_f-j8ucr5_pAz86o3LMtiob-tt0UP_YuAhfS45_1RIEIj0ZvJELaMM2hnN9ewWsCXzTO5nhd7KLpNNbAHYs4E Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:50.901005 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f605e8887c546e7bc78d4869929a5a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c2232b0bbb86498aa6cbba41bca65155 Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'n-d-854119-9'} Aug 29 04:51:50.902202 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:50.902917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 04:51:50.903929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.906815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9260ff30-f762-4790-bfae-14579d6c40c6 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:50.908495 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9260ff30-f762-4790-bfae-14579d6c40c6 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-854119-9" status: 403 len: 109 microversion: 2.1 time: 0.022603 Aug 29 04:51:50.915325 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 165/419] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 29 04:51:50 2022] GET /compute/v2.1/os-hosts/n-d-854119-9 => generated 109 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:51:50.928828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b830ae3-39f6-4d45-90d4-a81535861c81 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Calling method '.version_select at 0x7f1aba2790d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:50.936491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-1b830ae3-39f6-4d45-90d4-a81535861c81 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b830ae3-39f6-4d45-90d4-a81535861c81 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Request method failure captured: Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXk2K5Olyqu9E_qoFw5tPLBw6R3oc-8hxur6BYvBFbvt2LFyQkm0QXL_9Dzr8risRd8mJ9uq7tyvHuzX1eoTqR6lUWD8sNHgDZImEwxta3UYreKPj6xvH4CbAQaKaQjWCjI7zkVJ1_TQqbC8YURuXBG5x3Gi_HGQqwsL-j8duYPKGw Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:51:50.938402 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf6969a2f26247ab91a4dfc3608ad909", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e7969836bb3a4a28a47685f492f57176 Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'nonexistent_hostname'} Aug 29 04:51:50.939533 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.940826 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.941960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.943091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b830ae3-39f6-4d45-90d4-a81535861c81 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:50.943091 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b830ae3-39f6-4d45-90d4-a81535861c81 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018039 Aug 29 04:51:50.943091 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 166/420] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Aug 29 04:51:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:50.951999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24b0bcb6-2bce-4a46-aa08-f0825dd10a15 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Calling method '.version_select at 0x7f1ab9d988b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:50.954087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-24b0bcb6-2bce-4a46-aa08-f0825dd10a15 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'c2232b0bbb86498aa6cbba41bca65155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f605e8887c546e7bc78d4869929a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24b0bcb6-2bce-4a46-aa08-f0825dd10a15 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Request method failure captured: Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hosts/n-d-854119-9/shutdown HTTP/1.1 Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXips3FouvK5mS9LC_t22_Qho2PBEfQa6QeO9yV8R42PAJWxmfM55Movif2x-e7AfU91N86z1AB1EpS9DrbEhh3fD_f-j8ucr5_pAz86o3LMtiob-tt0UP_YuAhfS45_1RIEIj0ZvJELaMM2hnN9ewWsCXzTO5nhd7KLpNNbAHYs4E Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:50.956574 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f605e8887c546e7bc78d4869929a5a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c2232b0bbb86498aa6cbba41bca65155 Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'n-d-854119-9'} Aug 29 04:51:50.957783 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:50.958495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 04:51:50.959501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.960880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24b0bcb6-2bce-4a46-aa08-f0825dd10a15 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:50.960880 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-24b0bcb6-2bce-4a46-aa08-f0825dd10a15 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-854119-9/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011295 Aug 29 04:51:50.960880 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 167/421] 10.222.0.20 () {58 vars in 1194 bytes} [Mon Aug 29 04:51:50 2022] GET /compute/v2.1/os-hosts/n-d-854119-9/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:50.969479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8ff791b-b666-44c0-a760-5a868121e7d5 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Calling method '.version_select at 0x7f1ab9e85790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:50.980701 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b8ff791b-b666-44c0-a760-5a868121e7d5 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8ff791b-b666-44c0-a760-5a868121e7d5 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Request method failure captured: Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXk2K5Olyqu9E_qoFw5tPLBw6R3oc-8hxur6BYvBFbvt2LFyQkm0QXL_9Dzr8risRd8mJ9uq7tyvHuzX1eoTqR6lUWD8sNHgDZImEwxta3UYreKPj6xvH4CbAQaKaQjWCjI7zkVJ1_TQqbC8YURuXBG5x3Gi_HGQqwsL-j8duYPKGw Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:51:50.982943 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf6969a2f26247ab91a4dfc3608ad909", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e7969836bb3a4a28a47685f492f57176 Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'nonexistent_hostname'} Aug 29 04:51:50.984405 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:50.985163 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 04:51:50.986200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8ff791b-b666-44c0-a760-5a868121e7d5 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b8ff791b-b666-44c0-a760-5a868121e7d5 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.019986 Aug 29 04:51:50.987244 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 168/422] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 04:51:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 04:51:51.002711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10a49b3c-69b0-4711-8be7-6a686080d3cd tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Calling method '.version_select at 0x7f1ab9d98820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:51.005362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-10a49b3c-69b0-4711-8be7-6a686080d3cd tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'c2232b0bbb86498aa6cbba41bca65155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f605e8887c546e7bc78d4869929a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10a49b3c-69b0-4711-8be7-6a686080d3cd tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Request method failure captured: Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hosts/n-d-854119-9/startup HTTP/1.1 Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXips3FouvK5mS9LC_t22_Qho2PBEfQa6QeO9yV8R42PAJWxmfM55Movif2x-e7AfU91N86z1AB1EpS9DrbEhh3fD_f-j8ucr5_pAz86o3LMtiob-tt0UP_YuAhfS45_1RIEIj0ZvJELaMM2hnN9ewWsCXzTO5nhd7KLpNNbAHYs4E Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:51.007925 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f605e8887c546e7bc78d4869929a5a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c2232b0bbb86498aa6cbba41bca65155 Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'n-d-854119-9'} Aug 29 04:51:51.009227 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:51.009941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 04:51:51.010994 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.013609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10a49b3c-69b0-4711-8be7-6a686080d3cd tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:51.014998 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-10a49b3c-69b0-4711-8be7-6a686080d3cd tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-854119-9/startup" status: 403 len: 110 microversion: 2.1 time: 0.023928 Aug 29 04:51:51.015916 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 169/423] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Aug 29 04:51:50 2022] GET /compute/v2.1/os-hosts/n-d-854119-9/startup => generated 110 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:51.037396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8b58e85-247f-402f-bfdc-3c8e464ae9fe tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Calling method '.version_select at 0x7f1ab9e5f160>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:51.071058 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b8b58e85-247f-402f-bfdc-3c8e464ae9fe tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8b58e85-247f-402f-bfdc-3c8e464ae9fe tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Request method failure captured: Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXk2K5Olyqu9E_qoFw5tPLBw6R3oc-8hxur6BYvBFbvt2LFyQkm0QXL_9Dzr8risRd8mJ9uq7tyvHuzX1eoTqR6lUWD8sNHgDZImEwxta3UYreKPj6xvH4CbAQaKaQjWCjI7zkVJ1_TQqbC8YURuXBG5x3Gi_HGQqwsL-j8duYPKGw Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:51:51.073031 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf6969a2f26247ab91a4dfc3608ad909", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e7969836bb3a4a28a47685f492f57176 Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'nonexistent_hostname'} Aug 29 04:51:51.074296 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:51.075018 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 04:51:51.076693 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.077740 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.080947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8b58e85-247f-402f-bfdc-3c8e464ae9fe tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:51.082046 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b8b58e85-247f-402f-bfdc-3c8e464ae9fe tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.060788 Aug 29 04:51:51.082835 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 170/424] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Aug 29 04:51:51 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:51.095104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47fe8d8e-24f2-4e20-a35a-1a8e675bc077 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9e78f70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47fe8d8e-24f2-4e20-a35a-1a8e675bc077 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Request method failure captured: Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/os-hosts/n-d-854119-9 HTTP/1.1 Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 51 Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXk2K5Olyqu9E_qoFw5tPLBw6R3oc-8hxur6BYvBFbvt2LFyQkm0QXL_9Dzr8risRd8mJ9uq7tyvHuzX1eoTqR6lUWD8sNHgDZImEwxta3UYreKPj6xvH4CbAQaKaQjWCjI7zkVJ1_TQqbC8YURuXBG5x3Gi_HGQqwsL-j8duYPKGw Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:51:51.109118 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf6969a2f26247ab91a4dfc3608ad909", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e7969836bb3a4a28a47685f492f57176 Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: {"status": "enable", "maintenance_mode": "invalid"} Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:51.110509 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'n-d-854119-9', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance: Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.111242 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.113640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.114689 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.114689 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:51:51.114689 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:51:51.114689 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 04:51:51.114689 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.114689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47fe8d8e-24f2-4e20-a35a-1a8e675bc077 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:51.114689 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-47fe8d8e-24f2-4e20-a35a-1a8e675bc077 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-854119-9" status: 400 len: 199 microversion: 2.1 time: 0.021459 Aug 29 04:51:51.114689 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 171/425] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:51:51 2022] PUT /compute/v2.1/os-hosts/n-d-854119-9 => generated 199 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:51:51.120671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91aca6bc-bae4-47bf-8a0f-8f762941b592 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9e524c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91aca6bc-bae4-47bf-8a0f-8f762941b592 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Request method failure captured: Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/os-hosts/n-d-854119-9 HTTP/1.1 Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 51 Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXk2K5Olyqu9E_qoFw5tPLBw6R3oc-8hxur6BYvBFbvt2LFyQkm0QXL_9Dzr8risRd8mJ9uq7tyvHuzX1eoTqR6lUWD8sNHgDZImEwxta3UYreKPj6xvH4CbAQaKaQjWCjI7zkVJ1_TQqbC8YURuXBG5x3Gi_HGQqwsL-j8duYPKGw Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:51:51.124300 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf6969a2f26247ab91a4dfc3608ad909", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e7969836bb3a4a28a47685f492f57176 Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: {"status": "invalid", "maintenance_mode": "enable"} Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:51.125556 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'n-d-854119-9', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance: Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.126306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.127619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.128816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.128816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:51:51.128816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:51:51.128816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 04:51:51.128816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.128816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91aca6bc-bae4-47bf-8a0f-8f762941b592 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:51.128816 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-91aca6bc-bae4-47bf-8a0f-8f762941b592 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-854119-9" status: 400 len: 189 microversion: 2.1 time: 0.008958 Aug 29 04:51:51.130834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 172/426] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:51:51 2022] PUT /compute/v2.1/os-hosts/n-d-854119-9 => generated 189 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:51:51.136861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb6565c0-ff7a-4601-bc41-631c563d0661 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Action: 'update', calling method: .version_select at 0x7f1ab9e85a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:51.142965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bb6565c0-ff7a-4601-bc41-631c563d0661 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'c2232b0bbb86498aa6cbba41bca65155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f605e8887c546e7bc78d4869929a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb6565c0-ff7a-4601-bc41-631c563d0661 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Request method failure captured: Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/os-hosts/n-d-854119-9 HTTP/1.1 Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 50 Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXips3FouvK5mS9LC_t22_Qho2PBEfQa6QeO9yV8R42PAJWxmfM55Movif2x-e7AfU91N86z1AB1EpS9DrbEhh3fD_f-j8ucr5_pAz86o3LMtiob-tt0UP_YuAhfS45_1RIEIj0ZvJELaMM2hnN9ewWsCXzTO5nhd7KLpNNbAHYs4E Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:51:51.145484 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f605e8887c546e7bc78d4869929a5a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f605e8887c546e7bc78d4869929a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0f605e8887c546e7bc78d4869929a5a2 Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1215541242 Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c2232b0bbb86498aa6cbba41bca65155 Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1215541242-project Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 04:51:51.146911 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'n-d-854119-9', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:51.147765 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 04:51:51.149200 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.150233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb6565c0-ff7a-4601-bc41-631c563d0661 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:51.150233 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bb6565c0-ff7a-4601-bc41-631c563d0661 tempest-HostsAdminNegativeTestJSON-1215541242 tempest-HostsAdminNegativeTestJSON-1215541242-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-854119-9" status: 403 len: 111 microversion: 2.1 time: 0.014282 Aug 29 04:51:51.152015 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 173/427] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:51:51 2022] PUT /compute/v2.1/os-hosts/n-d-854119-9 => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:51:51.163946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cadd7848-f452-4c90-a19e-694afce74048 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9d985e0>, body: {"status": null, "maintenance_mode": null} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cadd7848-f452-4c90-a19e-694afce74048 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Request method failure captured: Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/os-hosts/n-d-854119-9 HTTP/1.1 Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 42 Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXk2K5Olyqu9E_qoFw5tPLBw6R3oc-8hxur6BYvBFbvt2LFyQkm0QXL_9Dzr8risRd8mJ9uq7tyvHuzX1eoTqR6lUWD8sNHgDZImEwxta3UYreKPj6xvH4CbAQaKaQjWCjI7zkVJ1_TQqbC8YURuXBG5x3Gi_HGQqwsL-j8duYPKGw Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:51:51.177073 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf6969a2f26247ab91a4dfc3608ad909", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e7969836bb3a4a28a47685f492f57176 Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: {"status": null, "maintenance_mode": null} Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 04:51:51.178322 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'n-d-854119-9', 'body': {'status': None, 'maintenance_mode': None}} Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance: Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi None Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.179210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.180916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.182699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:51:51.182699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:51:51.182699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 04:51:51.182699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.182699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cadd7848-f452-4c90-a19e-694afce74048 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:51.182699 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cadd7848-f452-4c90-a19e-694afce74048 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-854119-9" status: 400 len: 127 microversion: 2.1 time: 0.022402 Aug 29 04:51:51.182699 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 174/428] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:51:51 2022] PUT /compute/v2.1/os-hosts/n-d-854119-9 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:51:51.190235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:51.191156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:51.198527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:51.199087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:51.199679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:51.200509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:51.201196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:51.201796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:51.220147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:51:51.221137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:51:51.221847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:51:51.222747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:51:51.223877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:51:51.242123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:51.242659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:51.243324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:51.244658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:51.245242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:51.245910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:51.268434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:51:51.272611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for user f5a5756b12204e9f9fbd7a2f3c5e1749 and project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:51:51.285066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:51:51.287237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:51:51.369707 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7548f850-dcb2-4eae-8f87-18cf305e56d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.087491 Aug 29 04:51:51.371971 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 255/429] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:51:51.378172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f276282-5209-49a1-acc2-5d387dd66553 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Action: 'update', calling method: .version_select at 0x7f1aba1ef790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:51.383930 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.hosts [None req-2f276282-5209-49a1-acc2-5d387dd66553 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Enabling host nonexistent_hostname. Aug 29 04:51:51.398198 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-2f276282-5209-49a1-acc2-5d387dd66553 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f276282-5209-49a1-acc2-5d387dd66553 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Request method failure captured: Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 50 Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXk2K5Olyqu9E_qoFw5tPLBw6R3oc-8hxur6BYvBFbvt2LFyQkm0QXL_9Dzr8risRd8mJ9uq7tyvHuzX1eoTqR6lUWD8sNHgDZImEwxta3UYreKPj6xvH4CbAQaKaQjWCjI7zkVJ1_TQqbC8YURuXBG5x3Gi_HGQqwsL-j8duYPKGw Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 04:51:51.402071 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf6969a2f26247ab91a4dfc3608ad909", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf6969a2f26247ab91a4dfc3608ad909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: cf6969a2f26247ab91a4dfc3608ad909 Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1939997023 Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e7969836bb3a4a28a47685f492f57176 Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1939997023-project-admin Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.403279 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 04:51:51.404050 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:51:51.405124 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:51:51.406246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f276282-5209-49a1-acc2-5d387dd66553 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:51:51.407498 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f276282-5209-49a1-acc2-5d387dd66553 tempest-HostsAdminNegativeTestJSON-1939997023 tempest-HostsAdminNegativeTestJSON-1939997023-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.032465 Aug 29 04:51:51.407498 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 256/430] 10.222.0.20 () {60 vars in 1211 bytes} [Mon Aug 29 04:51:51 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:51:51.415967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d9700d3-40f5-4bb8-bd56-d660d09a398c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:51.417169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d9700d3-40f5-4bb8-bd56-d660d09a398c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:51.548646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d9700d3-40f5-4bb8-bd56-d660d09a398c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:51.559655 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d9700d3-40f5-4bb8-bd56-d660d09a398c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1211 microversion: 2.1 time: 0.151149 Aug 29 04:51:51.560568 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 257/431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:51 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1211 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:51.628364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-81fde174-92ef-4107-9ac7-f9d11c66e6f3 req-b568a7bf-8f8d-4882-9dfa-eb974bca7e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c2838d-345b-4021-a412-afdf0272b510", "tag": "f5749b3f-469d-44cb-9547-09804c2ab09c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:51.640417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-81fde174-92ef-4107-9ac7-f9d11c66e6f3 req-b568a7bf-8f8d-4882-9dfa-eb974bca7e7b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:51.644761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-81fde174-92ef-4107-9ac7-f9d11c66e6f3 req-b568a7bf-8f8d-4882-9dfa-eb974bca7e7b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:51.645276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-81fde174-92ef-4107-9ac7-f9d11c66e6f3 req-b568a7bf-8f8d-4882-9dfa-eb974bca7e7b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:51.666402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:51.667553 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-81fde174-92ef-4107-9ac7-f9d11c66e6f3 req-b568a7bf-8f8d-4882-9dfa-eb974bca7e7b service nova] Creating event network-changed:f5749b3f-469d-44cb-9547-09804c2ab09c for instance 27c2838d-345b-4021-a412-afdf0272b510 on n-h1-854119-9 Aug 29 04:51:51.677908 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-81fde174-92ef-4107-9ac7-f9d11c66e6f3 req-b568a7bf-8f8d-4882-9dfa-eb974bca7e7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053121 Aug 29 04:51:51.679115 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3a16a059-cf47-4dd2-b6d1-883230da8445 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1472 microversion: 2.1 time: 0.492856 Aug 29 04:51:51.681815 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 258/432] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:51:51.686028 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 175/433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:51 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1472 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:51.709266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:51.710077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:51.729155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:51.729680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:51.730123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:51.730842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:51.731293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:51.731716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:51.875503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:51.876207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:51.886597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:51.887824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:51.888153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:51.892373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:51.893732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:51.895156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:52.079768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:52.091670 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-10d126a5-998c-499b-9838-c5c7dd66867b tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.393423 Aug 29 04:51:52.113433 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 259/434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:51 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:51:52.128844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:52.144423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:52.146171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:52.147558 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d71cc812-88c9-4eb7-af6e-f5c215c54f24 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1314 microversion: 2.25 time: 0.276549 Aug 29 04:51:52.148316 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 176/435] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:51 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:52.455922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1845218172", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:52.592699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:52.593405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:52.600038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:51:52.608825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:52.609338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:52.612071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:52.615294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:52.615972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:52.616495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:52.776502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:52.798009 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d385307b-06fa-4b14-9f6c-172028122500 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1263 microversion: 2.1 time: 0.217059 Aug 29 04:51:52.801127 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 177/436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:52 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1263 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:52.811981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:52.815837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:52.824346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:52.824844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:52.825282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:52.826129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:52.827291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:52.828320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:53.643181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:53.660706 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6ddea024-5dfd-46db-bf32-7612b766170b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1472 microversion: 2.1 time: 0.857427 Aug 29 04:51:53.679979 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 178/437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:52 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1472 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:53.690334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:53.694987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:53.708790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:53.716525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:53.717636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:53.718600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:53.719590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:53.720346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:53.753338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:54.005205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:51:54.006226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:51:54.007823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:51:54.010937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:51:54.012463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:51:54.038148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:54.039156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:54.039704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:54.041790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:54.043080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:54.043618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:54.071774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:51:54.077795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=88,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:54.079693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:51:54.097227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:51:54.101909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:51:54.184907 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2a216fbe-20f5-456d-86ac-b667f9812781 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.010559 Aug 29 04:51:54.185889 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 260/438] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:51:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:51:54.191129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:54.192214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:54.205556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:54.206057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:54.206493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:54.207265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:54.207811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:54.208263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:54.540276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:54.545198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:54.548801 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-76e58dfe-dc2a-4a77-9476-5e90ca3d089d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.867636 Aug 29 04:51:54.553012 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 179/439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:53 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:54.558279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:54.559628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:54.561152 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d16d1d97-38d9-44e6-8a97-2c3caf44c6bd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1320 microversion: 2.25 time: 0.374204 Aug 29 04:51:54.565961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:54.567167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:54.579563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:54.580501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:54.581499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:54.582273 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 261/440] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:54 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1320 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:54.584793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:54.585449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:54.586720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:54.772485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:54.783653 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2455e4ca-bab4-458d-94d5-605d91d99ad3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1269 microversion: 2.1 time: 0.228354 Aug 29 04:51:54.790164 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 180/441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:54 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1269 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:54.797889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-447f55c3-a661-4ec5-abb7-ac2c31d06393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:54.798796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-447f55c3-a661-4ec5-abb7-ac2c31d06393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:54.818138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0bf775eb-b129-479a-8197-266c7d6ff64c tempest-NetworksTest-570029732 tempest-NetworksTest-570029732-project-admin] Calling method '.version_select at 0x7f1ab9ce5dc0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:55.053482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:55.111264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-447f55c3-a661-4ec5-abb7-ac2c31d06393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:55.135905 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-447f55c3-a661-4ec5-abb7-ac2c31d06393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1217 microversion: 2.1 time: 0.343905 Aug 29 04:51:55.140147 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 181/442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:54 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1217 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:55.152592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:55.156843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:55.168610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:55.173653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:55.174604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:55.175374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:55.175848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:55.176469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:55.185985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:55.727751 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0bf775eb-b129-479a-8197-266c7d6ff64c tempest-NetworksTest-570029732 tempest-NetworksTest-570029732-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 6769 microversion: 2.1 time: 1.143354 Aug 29 04:51:55.729805 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 262/443] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:51:54 2022] GET /compute/v2.1/os-networks => generated 6769 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:55.737818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:55.738443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:55.756768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:55.770791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:55.771450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:55.774205 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1a137f1c-088f-4246-8d8b-1b118b409a31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1469 microversion: 2.1 time: 0.630195 Aug 29 04:51:55.774753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:55.775575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:55.776042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:55.776536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:55.777284 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 182/444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:55 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1469 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:55.789907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:55.791820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:55.808772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:55.809461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:55.810040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:55.811059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:55.811707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:55.820624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:56.190196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:56.211542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:56.244253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:56.245634 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6681a719-a971-4873-adb8-127d638593a9 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.512712 Aug 29 04:51:56.267263 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 263/445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:55 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:56.274776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:56.285881 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a2232f7e-31fa-4d92-b267-7b1346053718 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1362 microversion: 2.25 time: 0.502184 Aug 29 04:51:56.293874 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 183/446] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:55 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:56.303029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2c190a2f-6cf3-4201-b873-2a8267ee3347 tempest-NetworksTest-570029732 tempest-NetworksTest-570029732-project-admin] Calling method '.version_select at 0x7f1ab9cc4d30>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:56.311635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f8445d4-e1b9-4acd-b8dd-5452b3ff98bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:56.312188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f8445d4-e1b9-4acd-b8dd-5452b3ff98bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:56.348938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f8445d4-e1b9-4acd-b8dd-5452b3ff98bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:56.349591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f8445d4-e1b9-4acd-b8dd-5452b3ff98bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:56.350133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f8445d4-e1b9-4acd-b8dd-5452b3ff98bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:56.351211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f8445d4-e1b9-4acd-b8dd-5452b3ff98bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:56.351882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f8445d4-e1b9-4acd-b8dd-5452b3ff98bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:56.352455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f8445d4-e1b9-4acd-b8dd-5452b3ff98bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:56.502816 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f8445d4-e1b9-4acd-b8dd-5452b3ff98bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897/action" status: 204 len: 0 microversion: 2.1 time: 0.207501 Aug 29 04:51:56.505019 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 184/447] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:51:56 2022] POST /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897/action => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:51:56.515985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:56.522335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:56.533299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:56.535681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:56.536650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:56.538171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:56.539150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:56.540718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:56.770976 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2c190a2f-6cf3-4201-b873-2a8267ee3347 tempest-NetworksTest-570029732 tempest-NetworksTest-570029732-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/776871d1-de18-4cbe-bbad-5deeb3ebda78" status: 200 len: 652 microversion: 2.1 time: 0.499866 Aug 29 04:51:56.771973 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 264/448] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 04:51:56 2022] GET /compute/v2.1/os-networks/776871d1-de18-4cbe-bbad-5deeb3ebda78 => generated 652 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:56.778562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b35ff489-5f22-4f07-ae63-fb5fd6761fa2 req-db1d2c8b-018f-4bad-8a97-072c3e2ee5fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b96b18-802e-42f5-9751-0f1aac336e11", "tag": "130be427-70c6-4954-bb69-4cbabeacd226"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:56.804288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b35ff489-5f22-4f07-ae63-fb5fd6761fa2 req-db1d2c8b-018f-4bad-8a97-072c3e2ee5fb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:56.806372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b35ff489-5f22-4f07-ae63-fb5fd6761fa2 req-db1d2c8b-018f-4bad-8a97-072c3e2ee5fb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:56.807113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b35ff489-5f22-4f07-ae63-fb5fd6761fa2 req-db1d2c8b-018f-4bad-8a97-072c3e2ee5fb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:56.825161 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b35ff489-5f22-4f07-ae63-fb5fd6761fa2 req-db1d2c8b-018f-4bad-8a97-072c3e2ee5fb service nova] Creating event network-changed:130be427-70c6-4954-bb69-4cbabeacd226 for instance 91b96b18-802e-42f5-9751-0f1aac336e11 on n-h1-854119-9 Aug 29 04:51:56.840190 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b35ff489-5f22-4f07-ae63-fb5fd6761fa2 req-db1d2c8b-018f-4bad-8a97-072c3e2ee5fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066325 Aug 29 04:51:56.842729 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 265/449] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:56.850647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:56.852547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:56.863119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:56.863866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:56.864792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:56.865961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:56.866625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:56.867377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:57.060787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:57.073580 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d8b4378a-f995-4380-8789-512b0cae0ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1275 microversion: 2.1 time: 0.229049 Aug 29 04:51:57.074323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 266/450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:56 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:57.081058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:57.081980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:57.091921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:57.092571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:57.093062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:57.093815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:57.094491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:57.094909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:57.137754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:57.152199 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fca69330-12de-496e-b089-a284594d847d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.643536 Aug 29 04:51:57.168866 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 185/451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:56 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:57.188533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6a91e55e-568b-42f9-bd61-a8ea7f0642ea req-9760f48e-79b7-4357-8e71-51edaa50d6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ffbebb-969a-4762-a339-032f7da39897", "name": "network-vif-plugged", "status": "completed", "tag": "e3cc9390-436f-423e-9d4e-3f5a7740bcc5"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:57.200190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:57.207970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6a91e55e-568b-42f9-bd61-a8ea7f0642ea req-9760f48e-79b7-4357-8e71-51edaa50d6a1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:57.208514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6a91e55e-568b-42f9-bd61-a8ea7f0642ea req-9760f48e-79b7-4357-8e71-51edaa50d6a1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:57.208957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6a91e55e-568b-42f9-bd61-a8ea7f0642ea req-9760f48e-79b7-4357-8e71-51edaa50d6a1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:57.233085 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6a91e55e-568b-42f9-bd61-a8ea7f0642ea req-9760f48e-79b7-4357-8e71-51edaa50d6a1 service nova] Creating event network-vif-plugged:e3cc9390-436f-423e-9d4e-3f5a7740bcc5 for instance 53ffbebb-969a-4762-a339-032f7da39897 on n-h1-854119-9 Aug 29 04:51:57.253028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-6a91e55e-568b-42f9-bd61-a8ea7f0642ea req-9760f48e-79b7-4357-8e71-51edaa50d6a1 service nova] Instance 53ffbebb-969a-4762-a339-032f7da39897 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:51:57.275133 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6a91e55e-568b-42f9-bd61-a8ea7f0642ea req-9760f48e-79b7-4357-8e71-51edaa50d6a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102967 Aug 29 04:51:57.275749 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 186/452] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:57.282415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a3dee31-7b5d-4ff3-96ef-30198fe992e5 tempest-NetworksTest-570029732 tempest-NetworksTest-570029732-project-admin] Calling method '.version_select at 0x7f1ab9e855e0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:57.726723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:57.737057 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f847b5bc-db53-45fb-bd3b-33748d7338ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1469 microversion: 2.1 time: 0.661235 Aug 29 04:51:57.737642 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 267/453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:57 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1469 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:57.755531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:57.756212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:57.763181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:57.763911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:57.764511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:57.765889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:57.766485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:57.767224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:57.942322 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4a3dee31-7b5d-4ff3-96ef-30198fe992e5 tempest-NetworksTest-570029732 tempest-NetworksTest-570029732-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 6769 microversion: 2.1 time: 0.664732 Aug 29 04:51:57.949473 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 187/454] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:51:57 2022] GET /compute/v2.1/os-networks => generated 6769 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:57.955752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:57.957694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:57.975101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:57.975603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:57.976239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:57.978402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:57.984485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:57.984934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.214895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:58.240044 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d242bd00-dc9d-46db-a971-a4afb5b765b3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.488002 Aug 29 04:51:58.241388 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 268/455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:57 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:58.373292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:58.381744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:58.383119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:58.391180 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-93f2d2b3-3432-4386-944f-e1ea99ed09f5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1362 microversion: 2.25 time: 0.433751 Aug 29 04:51:58.404526 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 188/456] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:57 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1362 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:58.417495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:58.418466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:58.434753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.435246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.435673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.437057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.437515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.439808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.530923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Calling method '.version_select at 0x7f1ab9cc4280>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:58.534553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.535029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.535448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.550539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.551808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.553290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.580321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.580946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.581604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.593436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.594168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.594817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.621496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.622068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.622892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.631640 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4069fc7a-1811-437d-bb28-83f430028614 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2152 microversion: 2.53 time: 0.388930 Aug 29 04:51:58.633729 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 269/457] 10.222.0.20 () {60 vars in 1243 bytes} [Mon Aug 29 04:51:58 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2152 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:58.639149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:58.639919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:58.647026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.647755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.648775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.649563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.650097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.650957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.668791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:51:58.835976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:58.861265 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-618cacd0-1482-4104-9540-8d9d156316f4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1317 microversion: 2.1 time: 0.453815 Aug 29 04:51:58.861966 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 189/458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:58 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:58.884519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Calling method '.version_select at 0x7f1ab9db1c10>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:58.888774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.890169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.890756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.926488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:58.927366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:58.927911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:58.988953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:59.003803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.004817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.005647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.007002 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a3a6f8d-2d1b-4b1d-a3ab-0d35c07bb388 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.371723 Aug 29 04:51:59.007655 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 270/459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:58 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:59.024443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:59.025302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:59.031722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.032418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.033008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.033918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.034523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.035093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.047962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.052885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.056670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.082367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.083179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.083607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.090115 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8f67bc1f-b2ae-4801-9afa-d230fbb7cd43 tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 844 microversion: 2.53 time: 0.226918 Aug 29 04:51:59.090854 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 190/460] 10.222.0.20 () {60 vars in 1222 bytes} [Mon Aug 29 04:51:58 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 844 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:51:59.097689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-824d9b7a-b401-4e2f-9a85-758a6b48f25b req-937bfaa4-68a5-4dec-82e5-22b730bdec3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cda4a1-ab65-4090-bd93-058f432f3732", "tag": "4e4164cb-6f8b-4514-bf16-f053ecafa7e4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:59.107565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-824d9b7a-b401-4e2f-9a85-758a6b48f25b req-937bfaa4-68a5-4dec-82e5-22b730bdec3b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.108308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-824d9b7a-b401-4e2f-9a85-758a6b48f25b req-937bfaa4-68a5-4dec-82e5-22b730bdec3b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.108881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-824d9b7a-b401-4e2f-9a85-758a6b48f25b req-937bfaa4-68a5-4dec-82e5-22b730bdec3b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.120295 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-824d9b7a-b401-4e2f-9a85-758a6b48f25b req-937bfaa4-68a5-4dec-82e5-22b730bdec3b service nova] Creating event network-changed:4e4164cb-6f8b-4514-bf16-f053ecafa7e4 for instance 33cda4a1-ab65-4090-bd93-058f432f3732 on n-h2-854119-9 Aug 29 04:51:59.126004 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-824d9b7a-b401-4e2f-9a85-758a6b48f25b req-937bfaa4-68a5-4dec-82e5-22b730bdec3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033831 Aug 29 04:51:59.127154 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 191/461] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:59.132431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-814596c6-d1a9-424d-b6bc-8054df80d44d tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Calling method '.version_select at 0x7f1ab9d68e50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:59.137201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-814596c6-d1a9-424d-b6bc-8054df80d44d tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.137869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-814596c6-d1a9-424d-b6bc-8054df80d44d tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.138460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-814596c6-d1a9-424d-b6bc-8054df80d44d tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.157196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-814596c6-d1a9-424d-b6bc-8054df80d44d tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.157940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-814596c6-d1a9-424d-b6bc-8054df80d44d tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.158376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-814596c6-d1a9-424d-b6bc-8054df80d44d tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.166035 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-814596c6-d1a9-424d-b6bc-8054df80d44d tempest-HypervisorAdminV253TestBase-328065498 tempest-HypervisorAdminV253TestBase-328065498-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/786f371a-d76a-4c67-a819-d6811fa970a4" status: 200 len: 792 microversion: 2.53 time: 0.037436 Aug 29 04:51:59.166854 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 192/462] 10.222.0.20 () {60 vars in 1298 bytes} [Mon Aug 29 04:51:59 2022] GET /compute/v2.1/os-hypervisors/786f371a-d76a-4c67-a819-d6811fa970a4 => generated 792 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:51:59.261934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:59.262725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:59.269634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.270209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.270745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.271543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.272147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.272686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.393176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:59.404701 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eff6a7d7-97f4-4258-94d1-a8e885044167 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1469 microversion: 2.1 time: 0.396056 Aug 29 04:51:59.417330 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 271/463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:59 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:51:59.425553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:59.426382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:59.435557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.436492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.437219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.438321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.438921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.439491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.577097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:59.598498 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef3d4c4c-9ffc-4310-9c57-36f4fceb2139 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.339481 Aug 29 04:51:59.605234 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 193/464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:59 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:51:59.615062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0fa417b3-3002-426a-8dd1-abf1dbc015af req-244b4679-9c96-474e-983b-dda5bc0c6cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b208f5-b156-40d9-abb8-1cc1a0f0f348", "tag": "f5871f66-d98c-45e7-82d7-a580d66552bd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:51:59.636315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0fa417b3-3002-426a-8dd1-abf1dbc015af req-244b4679-9c96-474e-983b-dda5bc0c6cef service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.655407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0fa417b3-3002-426a-8dd1-abf1dbc015af req-244b4679-9c96-474e-983b-dda5bc0c6cef service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.657114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0fa417b3-3002-426a-8dd1-abf1dbc015af req-244b4679-9c96-474e-983b-dda5bc0c6cef service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.692204 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0fa417b3-3002-426a-8dd1-abf1dbc015af req-244b4679-9c96-474e-983b-dda5bc0c6cef service nova] Creating event network-changed:f5871f66-d98c-45e7-82d7-a580d66552bd for instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 on n-h1-854119-9 Aug 29 04:51:59.715898 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0fa417b3-3002-426a-8dd1-abf1dbc015af req-244b4679-9c96-474e-983b-dda5bc0c6cef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108199 Aug 29 04:51:59.716993 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 194/465] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:51:59.820203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:59.838004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:59.846547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:51:59.849858 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e2ae202-0ea8-4ab2-8a9d-ad13c943356e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1362 microversion: 2.25 time: 0.431129 Aug 29 04:51:59.855299 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 272/466] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:51:59 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:51:59.886905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:51:59.887948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:51:59.898311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.899141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.899582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:51:59.900563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:51:59.901118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:51:59.901603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.032722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:00.033339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:00.040938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.041427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.041861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.042560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.043011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.043434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.167619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:00.176360 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9b53433-7f0a-47db-908b-80b7091056c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1317 microversion: 2.1 time: 0.296151 Aug 29 04:52:00.177785 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 195/467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:51:59 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:00.272704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:00.300864 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-79e4bce2-31d9-4d05-958d-84d0593e53ef tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.272833 Aug 29 04:52:00.301517 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 273/468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:00 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:00.428908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:00.430106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:00.437827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.438918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.439685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.440720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.441411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.442019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.602372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:00.615452 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f604914-8376-43f6-a6a8-8e6ee853f9c5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1461 microversion: 2.1 time: 0.190239 Aug 29 04:52:00.618224 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 196/469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:00 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1461 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:00.623327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:00.624814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:00.631657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.633087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.633954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.635117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.635940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.636744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.637456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b50d855-6dc2-43fe-b1b3-a149d1ffe5d8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:00.639058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8b50d855-6dc2-43fe-b1b3-a149d1ffe5d8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:00.648849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b50d855-6dc2-43fe-b1b3-a149d1ffe5d8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.649613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b50d855-6dc2-43fe-b1b3-a149d1ffe5d8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.650200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b50d855-6dc2-43fe-b1b3-a149d1ffe5d8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.651232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b50d855-6dc2-43fe-b1b3-a149d1ffe5d8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.651826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b50d855-6dc2-43fe-b1b3-a149d1ffe5d8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.653010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b50d855-6dc2-43fe-b1b3-a149d1ffe5d8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.898600 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8b50d855-6dc2-43fe-b1b3-a149d1ffe5d8 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1612 microversion: 2.1 time: 0.264793 Aug 29 04:52:00.900436 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 197/470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:00 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1612 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:00.905135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:00.907019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:00.913549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.914042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.914475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.921138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.922051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:00.927337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.927838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.934818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8914a692-d990-47e9-ba04-c95adec96f94 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.316027 Aug 29 04:52:00.935592 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 274/471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:00 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:00.940113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7644e68-d962-47e9-b70a-147660b839f0 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '.version_select at 0x7f1ab9e498b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:00.943704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7644e68-d962-47e9-b70a-147660b839f0 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:00.944434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7644e68-d962-47e9-b70a-147660b839f0 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:00.945020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7644e68-d962-47e9-b70a-147660b839f0 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:00.989166 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f7644e68-d962-47e9-b70a-147660b839f0 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.052292 Aug 29 04:52:00.990130 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 275/472] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:52:00 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:01.107553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1651201282", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:01.176457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:01.240237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:01.249303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:01.250735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:01.252146 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68989d68-2799-44ca-abef-0caaaba852f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1362 microversion: 2.25 time: 0.350735 Aug 29 04:52:01.252764 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 198/473] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:00 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:01.257960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:01.259771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:01.267395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:01.268062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:01.268658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:01.269559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:01.270315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:01.271007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:01.276481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:01.707456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:01.719636 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-26b2f527-7a00-42b0-a415-95c0b07e08bf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1317 microversion: 2.1 time: 0.465510 Aug 29 04:52:01.735712 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 199/474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:01 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:01.741967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:01.742861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:01.749669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:01.750699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:01.751319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:01.752248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:01.752892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:01.753468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:02.133433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:02.133933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:02.134325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:02.134732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:02.135146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:02.150799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:02.151292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:02.151723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:02.171828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:02.172722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:02.173327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:02.179955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:02.190083 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be597ce2-c277-440c-bd31-72e100f9bdff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.452889 Aug 29 04:52:02.190825 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 200/475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:01 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:02.195668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:02.196488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:02.216573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:02.220463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:02.221959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:02.222405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:02.223145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:02.223586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:02.224190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:02.228308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for user 4fbcb22f6bfb44e7b149c0b9e06014b8 and project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:02.243539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:52:02.246514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:02.305268 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c87379f4-d787-46f7-ba38-d051649f92e7 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201845 Aug 29 04:52:02.306633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 276/476] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:52:02.314941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:02.318222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:02.326545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:02.327883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:02.328510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:02.329845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:02.331411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:02.331995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:02.639628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:02.647682 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b9dbd76c-1163-4447-8477-09b7329f9c0c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.455640 Aug 29 04:52:02.648273 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 201/477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:02 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:02.676382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d84d9ce-6f04-4874-b1a2-6d5f3716fb52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:02.684400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d84d9ce-6f04-4874-b1a2-6d5f3716fb52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:02.824285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:02.831880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4d84d9ce-6f04-4874-b1a2-6d5f3716fb52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:02.840392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:02.842113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:02.843492 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea836a44-94c1-46fc-b66f-7319c890c1b5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1362 microversion: 2.25 time: 0.533971 Aug 29 04:52:02.844945 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 277/478] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:02 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:02.852759 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d84d9ce-6f04-4874-b1a2-6d5f3716fb52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1213 microversion: 2.1 time: 0.186836 Aug 29 04:52:02.853652 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 202/479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:02 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:02.860981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5e17fc01-6972-43db-8306-f20e3f73fd2b req-86178c32-99f2-4dd6-b6b2-5df02c466636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c2838d-345b-4021-a412-afdf0272b510", "name": "network-vif-plugged", "status": "completed", "tag": "f5749b3f-469d-44cb-9547-09804c2ab09c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:02.879694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5e17fc01-6972-43db-8306-f20e3f73fd2b req-86178c32-99f2-4dd6-b6b2-5df02c466636 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:02.880210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5e17fc01-6972-43db-8306-f20e3f73fd2b req-86178c32-99f2-4dd6-b6b2-5df02c466636 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:02.880637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5e17fc01-6972-43db-8306-f20e3f73fd2b req-86178c32-99f2-4dd6-b6b2-5df02c466636 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:02.900862 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5e17fc01-6972-43db-8306-f20e3f73fd2b req-86178c32-99f2-4dd6-b6b2-5df02c466636 service nova] Creating event network-vif-plugged:f5749b3f-469d-44cb-9547-09804c2ab09c for instance 27c2838d-345b-4021-a412-afdf0272b510 on n-h1-854119-9 Aug 29 04:52:02.906446 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5e17fc01-6972-43db-8306-f20e3f73fd2b req-86178c32-99f2-4dd6-b6b2-5df02c466636 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050530 Aug 29 04:52:02.907919 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 203/480] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:02.923202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:02.923919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:02.930942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:02.931605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:02.932232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:02.933423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:02.934057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:02.935415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.239096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76907d1f-b81b-41b7-93e2-09e853d6efd0 tempest-QuotaClassesAdmin257Test-695236656 tempest-QuotaClassesAdmin257Test-695236656-project-admin] Calling method '.version_select at 0x7f1abb964c10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:03.273088 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76907d1f-b81b-41b7-93e2-09e853d6efd0 tempest-QuotaClassesAdmin257Test-695236656 tempest-QuotaClassesAdmin257Test-695236656-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.425730 Aug 29 04:52:03.274319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:03.274502 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 278/481] 10.222.0.20 () {60 vars in 1226 bytes} [Mon Aug 29 04:52:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:52:03.279970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:03.281071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:03.282836 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-241e12b5-1d28-40f5-ae36-2059e27640b3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1317 microversion: 2.1 time: 0.364187 Aug 29 04:52:03.283417 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 204/482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:02 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:03.287835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-999bed9e-871f-4340-8b69-567f085fceb3 tempest-QuotaClassesAdmin257Test-695236656 tempest-QuotaClassesAdmin257Test-695236656-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9d34c10>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:03.307135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.308028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.308696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.310060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.313424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.314206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.547815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:03.555908 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dc4e5680-9c68-42a1-bed6-383e75312a7d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.280315 Aug 29 04:52:03.557416 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 279/483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:03 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:03.588611 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-999bed9e-871f-4340-8b69-567f085fceb3 tempest-QuotaClassesAdmin257Test-695236656 tempest-QuotaClassesAdmin257Test-695236656-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.304090 Aug 29 04:52:03.595549 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 205/484] 10.222.0.20 () {62 vars in 1247 bytes} [Mon Aug 29 04:52:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:52:03.601942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5b7e79d-760b-422f-b26c-89c657234b5f tempest-QuotaClassesAdmin257Test-695236656 tempest-QuotaClassesAdmin257Test-695236656-project-admin] Calling method '.version_select at 0x7f1ab9ce78b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:03.612497 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f5b7e79d-760b-422f-b26c-89c657234b5f tempest-QuotaClassesAdmin257Test-695236656 tempest-QuotaClassesAdmin257Test-695236656-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.015813 Aug 29 04:52:03.613065 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 206/485] 10.222.0.20 () {60 vars in 1226 bytes} [Mon Aug 29 04:52:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:52:03.639121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b0f4ed3-ab4c-43c6-b979-bd25380bc241 tempest-QuotaClassesAdmin257Test-695236656 tempest-QuotaClassesAdmin257Test-695236656-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9d98b80>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:03.717739 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b0f4ed3-ab4c-43c6-b979-bd25380bc241 tempest-QuotaClassesAdmin257Test-695236656 tempest-QuotaClassesAdmin257Test-695236656-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.087120 Aug 29 04:52:03.718475 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 207/486] 10.222.0.20 () {62 vars in 1247 bytes} [Mon Aug 29 04:52:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:52:03.725194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:03.726766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:03.730282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=14,nova_api:INSERT=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:03.736669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.737212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.738113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.738904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.739929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.740425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.776364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7bb3d6ec-d5c6-4df7-a115-3d58d19d0d35 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:03.782308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bb3d6ec-d5c6-4df7-a115-3d58d19d0d35 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.783340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bb3d6ec-d5c6-4df7-a115-3d58d19d0d35 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.784002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bb3d6ec-d5c6-4df7-a115-3d58d19d0d35 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.784858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bb3d6ec-d5c6-4df7-a115-3d58d19d0d35 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.785382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bb3d6ec-d5c6-4df7-a115-3d58d19d0d35 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.785932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bb3d6ec-d5c6-4df7-a115-3d58d19d0d35 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.815774 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7bb3d6ec-d5c6-4df7-a115-3d58d19d0d35 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.239167 Aug 29 04:52:03.816634 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 280/487] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:52:03 2022] GET /compute/v2.1/os-services => generated 944 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:03.829017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23675e1e-0e6c-4524-9ca2-0fe7ad555582 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:03.834941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23675e1e-0e6c-4524-9ca2-0fe7ad555582 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.835641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23675e1e-0e6c-4524-9ca2-0fe7ad555582 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.836081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23675e1e-0e6c-4524-9ca2-0fe7ad555582 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.836845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23675e1e-0e6c-4524-9ca2-0fe7ad555582 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.837296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23675e1e-0e6c-4524-9ca2-0fe7ad555582 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.837816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23675e1e-0e6c-4524-9ca2-0fe7ad555582 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.865035 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23675e1e-0e6c-4524-9ca2-0fe7ad555582 tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-854119-9" status: 200 len: 578 microversion: 2.1 time: 0.039546 Aug 29 04:52:03.865656 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 281/488] 10.222.0.20 () {58 vars in 1172 bytes} [Mon Aug 29 04:52:03 2022] GET /compute/v2.1/os-services?host=n-d-854119-9 => generated 578 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:03.874430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:03.874430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:03.881108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.881946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.882600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.883552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.884224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.884837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.910081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:03.918278 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0c58e04f-989c-4961-b62c-a8ec463e92d7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.196755 Aug 29 04:52:03.918834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 208/489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:03 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:03.923384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:03.923988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:03.929679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.930163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.930592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:03.931338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:03.931813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:03.932244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.005674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:04.014389 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e7cfd64-f549-49ba-aa25-bfbc87efdb65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1265 microversion: 2.1 time: 0.094558 Aug 29 04:52:04.020429 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 209/490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:03 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:04.020429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83304aad-e18b-4bfd-9881-ab5dc75140ef tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:04.023137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83304aad-e18b-4bfd-9881-ab5dc75140ef tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.023651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83304aad-e18b-4bfd-9881-ab5dc75140ef tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.024074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83304aad-e18b-4bfd-9881-ab5dc75140ef tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.024813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83304aad-e18b-4bfd-9881-ab5dc75140ef tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.025296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83304aad-e18b-4bfd-9881-ab5dc75140ef tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.026054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83304aad-e18b-4bfd-9881-ab5dc75140ef tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.052688 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83304aad-e18b-4bfd-9881-ab5dc75140ef tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036506 Aug 29 04:52:04.053678 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 210/491] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Aug 29 04:52:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:04.066202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2032291-fd27-4102-8588-16d771bb66ba tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:04.071160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2032291-fd27-4102-8588-16d771bb66ba tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.071654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2032291-fd27-4102-8588-16d771bb66ba tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.072229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2032291-fd27-4102-8588-16d771bb66ba tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.073043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2032291-fd27-4102-8588-16d771bb66ba tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.073693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2032291-fd27-4102-8588-16d771bb66ba tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.074272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2032291-fd27-4102-8588-16d771bb66ba tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.082625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:04.091751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:04.093339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:04.094585 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2cb5f160-9cd9-4194-b668-121f0c5e37d5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1362 microversion: 2.25 time: 0.225404 Aug 29 04:52:04.095253 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 282/492] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:03 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:04.107719 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f2032291-fd27-4102-8588-16d771bb66ba tempest-ServicesAdminTestJSON-14338248 tempest-ServicesAdminTestJSON-14338248-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.045795 Aug 29 04:52:04.108661 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 211/493] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:52:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:52:04.304619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:04.305217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:04.313063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.318264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.319033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.319959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.320637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.321260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.578455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:04.579762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:04.587098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.587922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.588673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.589612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.590282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.590956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.641282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:04.653812 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-29ca0b96-0df7-476b-88d9-f509dbe9bdac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1317 microversion: 2.1 time: 0.353274 Aug 29 04:52:04.656895 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 283/494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:04 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:04.892764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:04.917457 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b4fc8434-0e57-402f-bf7c-d6aeb877e9d8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.342510 Aug 29 04:52:04.918217 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 212/495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:04 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:04.939544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:04.940606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:04.951018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.957838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.959383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:04.960247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:04.960712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:04.961236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:05.034880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:05.035491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:05.051561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:05.052047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:05.052708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:05.053706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:05.054161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:05.054583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:05.192099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:05.216555 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44b9840a-b7f9-4888-ac9e-583dec4ce413 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1271 microversion: 2.1 time: 0.184402 Aug 29 04:52:05.220870 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 213/496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:05 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:05.234926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:05.236888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:05.245244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:05.245731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:05.246340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:05.248544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:05.249441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:05.250016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:05.414125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:05.427244 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fafeca51-49dc-4607-a855-bc67ecad5c7d tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.492175 Aug 29 04:52:05.428017 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 284/497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:04 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:05.583837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:05.602738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:05.604401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:05.605553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c104624-97fd-4997-aa0e-e6cde3affea6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1362 microversion: 2.25 time: 0.383425 Aug 29 04:52:05.617599 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 214/498] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:05 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:05.686969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:05.696395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:05.716050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:05.725526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:05.730478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:05.731359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:05.734301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:05.734747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:05.938772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:05.939495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:05.957812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:05.960766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:05.962507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:05.963348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:05.965511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:05.966369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:06.229831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:06.246577 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea2138dc-9dc0-4544-990b-6669fbcb8cc1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1317 microversion: 2.1 time: 0.571210 Aug 29 04:52:06.247170 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 285/499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:05 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:06.251886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-bf6546ed-1f04-4d9d-b37a-e13768dd91d9 req-247eb6e5-ff4e-4444-b928-4b36c6efd784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cda4a1-ab65-4090-bd93-058f432f3732", "name": "network-vif-plugged", "status": "completed", "tag": "4e4164cb-6f8b-4514-bf16-f053ecafa7e4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:06.271241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bf6546ed-1f04-4d9d-b37a-e13768dd91d9 req-247eb6e5-ff4e-4444-b928-4b36c6efd784 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:06.271971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bf6546ed-1f04-4d9d-b37a-e13768dd91d9 req-247eb6e5-ff4e-4444-b928-4b36c6efd784 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:06.272628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bf6546ed-1f04-4d9d-b37a-e13768dd91d9 req-247eb6e5-ff4e-4444-b928-4b36c6efd784 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:06.287157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-bf6546ed-1f04-4d9d-b37a-e13768dd91d9 req-247eb6e5-ff4e-4444-b928-4b36c6efd784 service nova] Creating event network-vif-plugged:4e4164cb-6f8b-4514-bf16-f053ecafa7e4 for instance 33cda4a1-ab65-4090-bd93-058f432f3732 on n-h2-854119-9 Aug 29 04:52:06.297869 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-bf6546ed-1f04-4d9d-b37a-e13768dd91d9 req-247eb6e5-ff4e-4444-b928-4b36c6efd784 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048414 Aug 29 04:52:06.299121 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 286/500] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:06.308953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:06.311206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:06.325080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:06.334189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:06.337927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:06.339081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:06.339705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:06.344483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:06.386120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:06.395918 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-844ad0e5-cbaa-4710-adcd-1786a9df384f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.461417 Aug 29 04:52:06.401453 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 215/501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:05 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:06.451416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:06.452434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:06.466453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:06.469380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:06.470447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:06.471357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:06.472669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:06.473820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:06.770281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:06.781922 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6cb1ce8e-f272-4d03-bf5d-05244f901ff2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1313 microversion: 2.1 time: 0.481130 Aug 29 04:52:06.782524 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 287/502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:06 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:06.797619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:06.799988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:06.811183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:06.812433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:06.813110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:06.814007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:06.814638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:06.815418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:06.847261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:06.858793 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b864aff-9b97-4cc7-97d6-62761a8da177 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1332 microversion: 2.1 time: 0.411565 Aug 29 04:52:06.862432 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 216/503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:06 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1332 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:07.095214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:07.124275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:07.127880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:07.133151 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4f054624-dd2a-4a8d-b486-0a9390313946 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1362 microversion: 2.25 time: 0.338963 Aug 29 04:52:07.144162 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 288/504] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:06 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:07.269277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:07.269971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:07.276242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a7e5a998-9aa7-49b4-9276-c222f4ba5062 req-59628095-c606-47ed-bc88-0339aa1948bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9c6427-61b8-4bc8-8916-7f16bfab3481", "tag": "d1e67a19-a229-4469-8585-f4f9bb1b7a2f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:07.282717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:07.283615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:07.284278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:07.285013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:07.286161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:07.286829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:07.292478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a7e5a998-9aa7-49b4-9276-c222f4ba5062 req-59628095-c606-47ed-bc88-0339aa1948bc service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:07.293986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a7e5a998-9aa7-49b4-9276-c222f4ba5062 req-59628095-c606-47ed-bc88-0339aa1948bc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:07.295088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a7e5a998-9aa7-49b4-9276-c222f4ba5062 req-59628095-c606-47ed-bc88-0339aa1948bc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:07.308524 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a7e5a998-9aa7-49b4-9276-c222f4ba5062 req-59628095-c606-47ed-bc88-0339aa1948bc service nova] Creating event network-changed:d1e67a19-a229-4469-8585-f4f9bb1b7a2f for instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 on n-h2-854119-9 Aug 29 04:52:07.315146 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a7e5a998-9aa7-49b4-9276-c222f4ba5062 req-59628095-c606-47ed-bc88-0339aa1948bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045822 Aug 29 04:52:07.316426 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 289/505] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:07.425700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:07.427596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:07.439749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:07.440675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:07.441809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:07.443039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:07.443859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:07.445128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:07.495186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:07.503697 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1e13f68-38fb-4f62-915b-1c7c91fa0355 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1317 microversion: 2.1 time: 0.238948 Aug 29 04:52:07.506616 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 217/506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:07 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:07.705148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:07.714979 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16325637-5569-4e19-8ba8-3da8e57cdbfc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.295544 Aug 29 04:52:07.716080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 290/507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:07 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:07.805214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:07.808749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:07.818925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:07.819448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:07.819879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:07.821087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:07.821547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:07.821971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:07.983502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2c91018-ddc1-4744-992d-d7e42fc4eabf tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Calling method '.version_select at 0x7f1ab9d0eaf0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:08.050797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:08.060483 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c348e06d-8069-44bd-b437-af20e02769bd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1313 microversion: 2.1 time: 0.259347 Aug 29 04:52:08.061022 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 291/508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:07 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:08.065490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:08.071701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:08.087429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:08.091283 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e2c91018-ddc1-4744-992d-d7e42fc4eabf tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 200 len: 371 microversion: 2.1 time: 0.365056 Aug 29 04:52:08.092425 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 218/509] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 04:52:07 2022] GET /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 371 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:08.092754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:08.093203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:08.093937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:08.094403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:08.094817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:08.097907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:08.107903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a4707f2f-e5cc-4165-8f00-b489c6aa42ed tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9ca9160>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:08.182911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4707f2f-e5cc-4165-8f00-b489c6aa42ed tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:08.183405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4707f2f-e5cc-4165-8f00-b489c6aa42ed tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:08.183843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4707f2f-e5cc-4165-8f00-b489c6aa42ed tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:08.185258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4707f2f-e5cc-4165-8f00-b489c6aa42ed tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:08.186117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4707f2f-e5cc-4165-8f00-b489c6aa42ed tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:08.186539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4707f2f-e5cc-4165-8f00-b489c6aa42ed tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:08.268510 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a4707f2f-e5cc-4165-8f00-b489c6aa42ed tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 200 len: 328 microversion: 2.1 time: 0.168091 Aug 29 04:52:08.270861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 219/510] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:52:08 2022] PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 328 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:08.276666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:08.277627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:08.289282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:08.290022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:08.291193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:08.292342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:08.293155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:08.294131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:08.760503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:08.764097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:08.773950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:08.776226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:08.777743 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1586245e-c711-41f9-8f05-49ad5a1d41b8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1362 microversion: 2.25 time: 0.505068 Aug 29 04:52:08.779045 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 220/511] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:08 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1362 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:08.798780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1a1a8a1c-669d-48db-9086-bea0eeb73a00 req-406f40f9-6bee-43fe-9c3d-4d0ff00d5b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b96b18-802e-42f5-9751-0f1aac336e11", "name": "network-vif-plugged", "status": "completed", "tag": "130be427-70c6-4954-bb69-4cbabeacd226"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:08.800007 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-244059fc-8075-4ee1-92be-016e681817cb tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1537 microversion: 2.1 time: 0.737908 Aug 29 04:52:08.800992 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 292/512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:08 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1537 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:08.819268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1a1a8a1c-669d-48db-9086-bea0eeb73a00 req-406f40f9-6bee-43fe-9c3d-4d0ff00d5b9c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:08.824338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1a1a8a1c-669d-48db-9086-bea0eeb73a00 req-406f40f9-6bee-43fe-9c3d-4d0ff00d5b9c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:08.825724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1a1a8a1c-669d-48db-9086-bea0eeb73a00 req-406f40f9-6bee-43fe-9c3d-4d0ff00d5b9c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:08.871248 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1a1a8a1c-669d-48db-9086-bea0eeb73a00 req-406f40f9-6bee-43fe-9c3d-4d0ff00d5b9c service nova] Creating event network-vif-plugged:130be427-70c6-4954-bb69-4cbabeacd226 for instance 91b96b18-802e-42f5-9751-0f1aac336e11 on n-h1-854119-9 Aug 29 04:52:08.886875 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1a1a8a1c-669d-48db-9086-bea0eeb73a00 req-406f40f9-6bee-43fe-9c3d-4d0ff00d5b9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103034 Aug 29 04:52:08.888832 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 221/513] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:08.921125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:08.922229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:08.933255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:08.934024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:08.934844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:08.935946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:08.936825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:08.937497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:08.949533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-133250827", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:09.055853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:09.268475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:09.282980 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5af42219-614e-465e-a059-6b5c75427fad tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1466 microversion: 2.1 time: 0.389272 Aug 29 04:52:09.284952 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 222/514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:08 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1466 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:09.305183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:09.306120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:09.321073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:09.321554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:09.322179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:09.323052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:09.323681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:09.324288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:09.555049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:09.555623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:09.556097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:09.556549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:09.556957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:09.562091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:09.566345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:09.566905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:09.567417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:09.570585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:09.571326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:09.572384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:09.576329 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e8c2541-aab5-41d1-bc45-9e807bb31dbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.290004 Aug 29 04:52:09.577426 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 223/515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:09 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:09.583724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2fc299c7-5821-4e39-8b8b-fe131e22fde3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Action: 'create', calling method: .version_select at 0x7f1ab9cde160>, body: {"pool": "776871d1-de18-4cbe-bbad-5deeb3ebda78"} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:09.596531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Getting quotas for project 3efffdd404994dd7a0eff62e29972ff4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:09.606876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Getting quotas for user 9d6f228d852a4c1b8a85b34ce74dfdaa and project 3efffdd404994dd7a0eff62e29972ff4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:09.611869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:09.630256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.utils [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] cores quota exceeded for 3efffdd404994dd7a0eff62e29972ff4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128872) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 04:52:09.631379 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Request method failure captured: Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 144 Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEX2dvhDD4JVqaRU1Pu9Ubr_c4eaUJlTz-jJKJNAnfZyk2xJh4yHFOcSpa0uqmUxeqjx3tPpOg147TwPxx9vGnGFqnsSg-ruEZNGShq4SHqdAHVG1fk-F_10hEuNaQRUTiCLBnZ4pjZ1gKjlFe4Hhx3FiAW7a_J8KJmsNwH14fS7j68 Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3efffdd404994dd7a0eff62e29972ff4 Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:52:09.637722 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3efffdd404994dd7a0eff62e29972ff4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3efffdd404994dd7a0eff62e29972ff4 Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-QuotasAdminNegativeTest-81423763-project Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 9d6f228d852a4c1b8a85b34ce74dfdaa Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-QuotasAdminNegativeTest-81423763-project Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-133250827", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} Aug 29 04:52:09.639326 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-133250827', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452'}}} Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 04:52:09.640273 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:09.641616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:09.643152 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:09.644635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:09.644635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:09.644635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:52:09.644635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:52:09.644635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 04:52:09.644635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:09.644635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:09.644635 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-207b732c-12ce-42b3-ace6-dfbfef6b05c0 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.837026 Aug 29 04:52:09.644635 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 293/516] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:08 2022] POST /compute/v2.1/servers => generated 111 bytes in 842 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:52:09.648558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:09.649160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:09.655520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:09.656250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:09.656849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:09.657698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:09.658420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:09.658983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:09.931304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:09.941882 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b2d0e689-fc2e-45a5-81b7-4ca6a24c3140 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1313 microversion: 2.1 time: 0.297044 Aug 29 04:52:09.942462 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 294/517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:09 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:10.076840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4b97fd6-be22-4903-b9a2-a979483b3351 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:10.077539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a4b97fd6-be22-4903-b9a2-a979483b3351 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:10.084394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4b97fd6-be22-4903-b9a2-a979483b3351 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:10.085156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4b97fd6-be22-4903-b9a2-a979483b3351 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:10.085769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4b97fd6-be22-4903-b9a2-a979483b3351 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:10.086637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4b97fd6-be22-4903-b9a2-a979483b3351 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:10.087243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4b97fd6-be22-4903-b9a2-a979483b3351 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:10.087816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4b97fd6-be22-4903-b9a2-a979483b3351 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:10.576557 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a4b97fd6-be22-4903-b9a2-a979483b3351 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1617 microversion: 2.1 time: 0.631418 Aug 29 04:52:10.592176 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 295/518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:09 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1617 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:10.598111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-750fc743-d13c-4368-915f-450d5a76d2f8 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9ce3160>, body: {"quota_set": {"cores": 20}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:10.686949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=37 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:10.692424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-750fc743-d13c-4368-915f-450d5a76d2f8 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:10.693160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-750fc743-d13c-4368-915f-450d5a76d2f8 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:10.693832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-750fc743-d13c-4368-915f-450d5a76d2f8 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:10.695038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-750fc743-d13c-4368-915f-450d5a76d2f8 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:10.696279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-750fc743-d13c-4368-915f-450d5a76d2f8 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:10.697048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-750fc743-d13c-4368-915f-450d5a76d2f8 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:10.812196 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-750fc743-d13c-4368-915f-450d5a76d2f8 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 200 len: 329 microversion: 2.1 time: 0.229735 Aug 29 04:52:10.815984 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 296/519] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:52:10 2022] PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 329 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:10.826252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:10.830399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:10.848324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:10.849342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:10.850807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:10.851861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:10.852777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:10.853448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:11.137226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:11.148431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:11.150676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:11.152495 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0839437c-8c3c-434b-b0f2-53db95d96022 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1558 microversion: 2.25 time: 0.332872 Aug 29 04:52:11.169268 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 297/520] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:10 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1558 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:11.176668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:11.177282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:11.189461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:11.190240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:11.190924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:11.191915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:11.193990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:11.194853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:11.422744 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2fc299c7-5821-4e39-8b8b-fe131e22fde3 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.843217 Aug 29 04:52:11.424620 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 224/521] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 04:52:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:11.430484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb09b58d-c6da-43c6-a451-af9960de5393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Action: 'create', calling method: .version_select at 0x7f1ab9ccb0d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1895702724", "policies": ["affinity"]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:11.433336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:11.441602 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6b565cc-811f-4bb2-8d40-262cd4b073cb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1311 microversion: 2.1 time: 0.273083 Aug 29 04:52:11.442539 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 298/522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:11 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1311 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:11.447197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d943879-ca83-4a73-a760-47d967df9347 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Calling method '.version_select at 0x7f1ab9ba8ee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:11.475395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-eb09b58d-c6da-43c6-a451-af9960de5393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:11.480863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-eb09b58d-c6da-43c6-a451-af9960de5393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:11.534141 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d943879-ca83-4a73-a760-47d967df9347 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 200 len: 371 microversion: 2.1 time: 0.090252 Aug 29 04:52:11.537112 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 299/523] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 04:52:11 2022] GET /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:11.542277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:11.543423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:11.549809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:11.550595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:11.551243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:11.552203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:11.552851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:11.553570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:11.560943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-eb09b58d-c6da-43c6-a451-af9960de5393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:11.567045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-eb09b58d-c6da-43c6-a451-af9960de5393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:11.585226 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eb09b58d-c6da-43c6-a451-af9960de5393 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.158637 Aug 29 04:52:11.586314 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 225/524] 10.222.0.20 () {60 vars in 1174 bytes} [Mon Aug 29 04:52:11 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:11.592267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:11.593536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:11.600670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:11.601437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:11.602090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:11.603758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:11.604576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:11.605866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:11.610924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:11.931704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:11.940325 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f49d0c14-7ae3-4f24-902c-b6016d472b52 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1313 microversion: 2.1 time: 0.401708 Aug 29 04:52:11.956205 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 300/525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:11 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:11.963542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-4b68f9f9-30f7-4bff-97a5-2cb7b1b6befb req-414cb4c5-9f89-49b9-a02d-b6b5a7493b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b208f5-b156-40d9-abb8-1cc1a0f0f348", "name": "network-vif-plugged", "status": "completed", "tag": "f5871f66-d98c-45e7-82d7-a580d66552bd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:11.969179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 91b96b18-802e-42f5-9751-0f1aac336e11 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:52:11.978070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4b68f9f9-30f7-4bff-97a5-2cb7b1b6befb req-414cb4c5-9f89-49b9-a02d-b6b5a7493b09 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:11.978930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4b68f9f9-30f7-4bff-97a5-2cb7b1b6befb req-414cb4c5-9f89-49b9-a02d-b6b5a7493b09 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:11.979659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4b68f9f9-30f7-4bff-97a5-2cb7b1b6befb req-414cb4c5-9f89-49b9-a02d-b6b5a7493b09 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:11.993895 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7cdd2bfe-1db2-4203-99e2-b0589f912d68 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 2051 microversion: 2.25 time: 0.406263 Aug 29 04:52:11.994492 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 226/526] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:11 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 2051 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:11.994880 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-4b68f9f9-30f7-4bff-97a5-2cb7b1b6befb req-414cb4c5-9f89-49b9-a02d-b6b5a7493b09 service nova] Creating event network-vif-plugged:f5871f66-d98c-45e7-82d7-a580d66552bd for instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 on n-h1-854119-9 Aug 29 04:52:12.001065 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-4b68f9f9-30f7-4bff-97a5-2cb7b1b6befb req-414cb4c5-9f89-49b9-a02d-b6b5a7493b09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041963 Aug 29 04:52:12.002392 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 301/527] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:12.009063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8969f622-a7e0-4769-ac3a-51b55e59ba4d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9ba8f70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:12.030295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Action: 'action', calling method: .version_select at 0x7f1abb866040>, body: {"addFloatingIp": {"address": "172.25.9.238"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:12.040222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:12.052547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:12.053115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:12.054041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:12.054996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:12.055453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:12.055993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:12.127737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8969f622-a7e0-4769-ac3a-51b55e59ba4d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:12.128415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8969f622-a7e0-4769-ac3a-51b55e59ba4d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:12.129082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8969f622-a7e0-4769-ac3a-51b55e59ba4d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:12.130385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8969f622-a7e0-4769-ac3a-51b55e59ba4d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:12.131033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8969f622-a7e0-4769-ac3a-51b55e59ba4d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:12.131813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8969f622-a7e0-4769-ac3a-51b55e59ba4d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:12.134739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 04:52:12.135212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquired lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 04:52:12.201490 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8969f622-a7e0-4769-ac3a-51b55e59ba4d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 200 len: 328 microversion: 2.1 time: 0.196985 Aug 29 04:52:12.203448 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 302/528] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:52:12 2022] PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 328 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:12.234172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1686375778", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b9032b51-7400-475f-8aab-76fd60d08d1b"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:12.335075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:12.798370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:12.798781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:12.799236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:12.799646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:12.800044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:12.845052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:12.845793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:12.846448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:12.848470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:12.849838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:12.850673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:12.875057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:12.881866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:12.899443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Going to run 2 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:52:12.902836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:12.959816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128872) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 04:52:12.990790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:12.996659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:13.064568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:13.069838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:13.087482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=2ccdf52d-5472-4915-a47a-007b164fb08d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:13.144227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:13.161997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:13.169868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:13.231843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:13.240063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:13.304666 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b8bd5720-1481-44b3-b4b2-3b589fe20031 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.099481 Aug 29 04:52:13.305641 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 303/529] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 1101 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 04:52:13.310966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:13.311973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:13.320698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:13.321198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:13.321763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:13.322469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:13.322916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:13.323333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:13.599378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 91b96b18-802e-42f5-9751-0f1aac336e11 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:52:13.647492 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b521d24c-990d-490f-9b28-60e78ffb8573 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 2051 microversion: 2.25 time: 0.334688 Aug 29 04:52:13.652856 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 304/530] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:13 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 2051 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:13.658606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1381150750", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:13.751277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:14.496090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:14.497233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:14.497990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:14.498772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:14.499404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:14.526191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:14.527151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:14.532954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:14.536165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:14.539920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:14.540935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:14.601189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=23 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:14.648599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Getting quotas for project 3efffdd404994dd7a0eff62e29972ff4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:14.667616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Getting quotas for user 9d6f228d852a4c1b8a85b34ce74dfdaa and project 3efffdd404994dd7a0eff62e29972ff4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:14.708794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.utils [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] instances quota exceeded for 3efffdd404994dd7a0eff62e29972ff4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128872) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 04:52:14.711474 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Request method failure captured: Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 145 Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEX2dvhDD4JVqaRU1Pu9Ubr_c4eaUJlTz-jJKJNAnfZyk2xJh4yHFOcSpa0uqmUxeqjx3tPpOg147TwPxx9vGnGFqnsSg-ruEZNGShq4SHqdAHVG1fk-F_10hEuNaQRUTiCLBnZ4pjZ1gKjlFe4Hhx3FiAW7a_J8KJmsNwH14fS7j68 Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3efffdd404994dd7a0eff62e29972ff4 Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:52:14.715716 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3efffdd404994dd7a0eff62e29972ff4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3efffdd404994dd7a0eff62e29972ff4 Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-QuotasAdminNegativeTest-81423763-project Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 9d6f228d852a4c1b8a85b34ce74dfdaa Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-QuotasAdminNegativeTest-81423763-project Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1381150750", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} Aug 29 04:52:14.717168 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1381150750', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452'}}} Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 04:52:14.717878 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:14.718939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:14.721909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:14.724581 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:14.724581 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:14.724581 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:52:14.724581 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:52:14.724581 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 04:52:14.724581 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:14.726609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:14.727735 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-25bcb2de-19eb-4e61-873d-52810ad6e63a tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.073710 Aug 29 04:52:14.728796 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 305/531] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:13 2022] POST /compute/v2.1/servers => generated 119 bytes in 1075 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:52:14.739361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:14.740492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:14.747475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:14.748411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:14.750370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:14.751363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:14.752072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:14.752749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:14.966353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Building network info cache for instance {{(pid=128871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 04:52:15.246212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:15.258026 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3df06495-73ef-46bf-8bd2-1b9fcff75a59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1495 microversion: 2.1 time: 0.527811 Aug 29 04:52:15.260548 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 306/532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:14 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1495 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:15.271437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:15.272108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:15.286493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:15.286991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:15.287467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:15.288213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:15.288666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:15.289096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:15.848709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:15.859728 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-67850153-2f35-47a2-a9d6-47e783f029e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1313 microversion: 2.1 time: 0.598207 Aug 29 04:52:15.860396 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 307/533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:15 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:15.876701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:15.882132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:15.883127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Searching by: {'deleted': False, 'project_id': '38bcab4cb30d4894bdec1572236a6347'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:52:15.908679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:15.909508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:15.910132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:15.911056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:15.911707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:15.912210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:16.095832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 04:52:16.311270 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5452f374-66e7-4580-b673-26f092772bd9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.447744 Aug 29 04:52:16.331361 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 308/534] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 04:52:15 2022] GET /compute/v2.1/servers => generated 1004 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:16.346647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa068fad-893e-429d-9246-0409622ad18f tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:16.356066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa068fad-893e-429d-9246-0409622ad18f tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:16.356897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa068fad-893e-429d-9246-0409622ad18f tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:16.359395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa068fad-893e-429d-9246-0409622ad18f tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:16.360400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa068fad-893e-429d-9246-0409622ad18f tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:16.364402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa068fad-893e-429d-9246-0409622ad18f tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:16.366423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa068fad-893e-429d-9246-0409622ad18f tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:16.440956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa068fad-893e-429d-9246-0409622ad18f tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.108252 Aug 29 04:52:16.442034 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 309/535] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Aug 29 04:52:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:52:16.454950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9f6e75f9-d6e0-4b36-9af5-20535c07cf55 req-6d3a3c5a-c59d-40c5-93f7-d34cad01cfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9c6427-61b8-4bc8-8916-7f16bfab3481", "name": "network-vif-plugged", "status": "completed", "tag": "d1e67a19-a229-4469-8585-f4f9bb1b7a2f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:16.473407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9f6e75f9-d6e0-4b36-9af5-20535c07cf55 req-6d3a3c5a-c59d-40c5-93f7-d34cad01cfb3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:16.477120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9f6e75f9-d6e0-4b36-9af5-20535c07cf55 req-6d3a3c5a-c59d-40c5-93f7-d34cad01cfb3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:16.477693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9f6e75f9-d6e0-4b36-9af5-20535c07cf55 req-6d3a3c5a-c59d-40c5-93f7-d34cad01cfb3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:16.509719 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9f6e75f9-d6e0-4b36-9af5-20535c07cf55 req-6d3a3c5a-c59d-40c5-93f7-d34cad01cfb3 service nova] Creating event network-vif-plugged:d1e67a19-a229-4469-8585-f4f9bb1b7a2f for instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 on n-h2-854119-9 Aug 29 04:52:16.520855 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9f6e75f9-d6e0-4b36-9af5-20535c07cf55 req-6d3a3c5a-c59d-40c5-93f7-d34cad01cfb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069581 Aug 29 04:52:16.524178 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 310/536] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:16.535688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66567023-d877-4ac0-8948-ac4c2efc5705 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9cc1f70>, body: {"quota_set": {"instances": 10}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:16.700838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Updating instance_info_cache with network_info: [{"id": "f5749b3f-469d-44cb-9547-09804c2ab09c", "address": "fa:16:3e:5a:1d:19", "network": {"id": "88954c15-7b5c-4596-81c9-e1fa7d3eb920", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1848659011-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "97fb2ee2a4cf4e17822da422a33bf43a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf5749b3f-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 04:52:16.723263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Releasing lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 04:52:16.725751 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f9b827df-0416-44cd-b272-f0672acc7543 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action" status: 202 len: 0 microversion: 2.1 time: 4.702702 Aug 29 04:52:16.731512 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 227/537] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:52:11 2022] POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action => generated 0 bytes in 4735 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 04:52:16.740790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-08423889-74bd-4c4a-a9b7-cbecf4d95688 req-4fa78a34-c178-4d6b-8f38-4b305ec08b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c2838d-345b-4021-a412-afdf0272b510", "tag": "f5749b3f-469d-44cb-9547-09804c2ab09c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:16.782419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-08423889-74bd-4c4a-a9b7-cbecf4d95688 req-4fa78a34-c178-4d6b-8f38-4b305ec08b82 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:16.786888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-08423889-74bd-4c4a-a9b7-cbecf4d95688 req-4fa78a34-c178-4d6b-8f38-4b305ec08b82 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:16.789761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-08423889-74bd-4c4a-a9b7-cbecf4d95688 req-4fa78a34-c178-4d6b-8f38-4b305ec08b82 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:16.823627 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-08423889-74bd-4c4a-a9b7-cbecf4d95688 req-4fa78a34-c178-4d6b-8f38-4b305ec08b82 service nova] Creating event network-changed:f5749b3f-469d-44cb-9547-09804c2ab09c for instance 27c2838d-345b-4021-a412-afdf0272b510 on n-h1-854119-9 Aug 29 04:52:16.839967 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-08423889-74bd-4c4a-a9b7-cbecf4d95688 req-4fa78a34-c178-4d6b-8f38-4b305ec08b82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106684 Aug 29 04:52:16.843132 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 228/538] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:16.963256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66567023-d877-4ac0-8948-ac4c2efc5705 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:16.963793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66567023-d877-4ac0-8948-ac4c2efc5705 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:16.964162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66567023-d877-4ac0-8948-ac4c2efc5705 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:16.964884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66567023-d877-4ac0-8948-ac4c2efc5705 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:16.965330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66567023-d877-4ac0-8948-ac4c2efc5705 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:16.965743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66567023-d877-4ac0-8948-ac4c2efc5705 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:17.048273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7253e772-06de-4a83-a2cc-ce231fcd924f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:17.049674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7253e772-06de-4a83-a2cc-ce231fcd924f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:17.062893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7253e772-06de-4a83-a2cc-ce231fcd924f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:17.064973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7253e772-06de-4a83-a2cc-ce231fcd924f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:17.066936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7253e772-06de-4a83-a2cc-ce231fcd924f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:17.070649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7253e772-06de-4a83-a2cc-ce231fcd924f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:17.071862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7253e772-06de-4a83-a2cc-ce231fcd924f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:17.074015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7253e772-06de-4a83-a2cc-ce231fcd924f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:17.094790 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-66567023-d877-4ac0-8948-ac4c2efc5705 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 200 len: 329 microversion: 2.1 time: 0.569233 Aug 29 04:52:17.098701 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 311/539] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:52:16 2022] PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 329 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:17.109729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:17.113244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:17.124287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:17.125023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:17.125612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:17.126528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:17.127131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:17.134036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:17.621998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:17.634961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f254fe44-e84e-48ac-ab1e-ea972965e0b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1277 microversion: 2.1 time: 0.534964 Aug 29 04:52:17.640447 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 312/540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:17 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1277 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:17.645224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75ea344a-118b-4171-9638-cb359fe816aa tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:17.645947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-75ea344a-118b-4171-9638-cb359fe816aa tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:17.655710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75ea344a-118b-4171-9638-cb359fe816aa tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:17.659969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75ea344a-118b-4171-9638-cb359fe816aa tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:17.660543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75ea344a-118b-4171-9638-cb359fe816aa tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:17.661296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75ea344a-118b-4171-9638-cb359fe816aa tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:17.661760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75ea344a-118b-4171-9638-cb359fe816aa tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:17.662175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75ea344a-118b-4171-9638-cb359fe816aa tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:17.883621 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75ea344a-118b-4171-9638-cb359fe816aa tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11/action" status: 202 len: 0 microversion: 2.25 time: 0.240820 Aug 29 04:52:17.888240 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 313/541] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 04:52:17 2022] POST /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:52:17.914338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7fcc6ab3-1e18-4f21-a8c9-c2a2626c5f9c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Action: 'create', calling method: .version_select at 0x7f1ab9ba84c0>, body: {"pool": "776871d1-de18-4cbe-bbad-5deeb3ebda78"} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:17.934582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7253e772-06de-4a83-a2cc-ce231fcd924f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1646 microversion: 2.1 time: 1.087637 Aug 29 04:52:17.937318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 229/542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:16 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1646 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:17.951991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:17.953022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:17.972673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:17.973519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:17.976531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:17.977462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:17.978389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:17.979479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:18.212059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:18.457034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:18.480684 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b44bfc6-3a68-4c0e-8152-9635d969c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1313 microversion: 2.1 time: 0.541273 Aug 29 04:52:18.498458 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 230/543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:17 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:18.509540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa14e324-b386-4da5-87ae-18c97279f53f tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Calling method '.version_select at 0x7f1ab9c6d8b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:18.628153 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa14e324-b386-4da5-87ae-18c97279f53f tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 200 len: 371 microversion: 2.1 time: 0.125288 Aug 29 04:52:18.630529 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 231/544] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 04:52:18 2022] GET /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:18.640677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:18.642376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:18.663813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:18.665064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:18.665734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:18.667153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:18.667855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:18.668532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:19.317204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 91b96b18-802e-42f5-9751-0f1aac336e11 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:52:19.363210 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-53e2b4c6-57fb-42cf-ad1f-836791cb04de tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 2036 microversion: 2.25 time: 0.730829 Aug 29 04:52:19.364175 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 232/545] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:18 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 2036 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:19.380587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a45adf96-6410-475b-991f-c64d7f30f688 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:19.381647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a45adf96-6410-475b-991f-c64d7f30f688 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:19.411575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a45adf96-6410-475b-991f-c64d7f30f688 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:19.412725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a45adf96-6410-475b-991f-c64d7f30f688 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:19.413989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a45adf96-6410-475b-991f-c64d7f30f688 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:19.414958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a45adf96-6410-475b-991f-c64d7f30f688 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:19.415667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a45adf96-6410-475b-991f-c64d7f30f688 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:19.416671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a45adf96-6410-475b-991f-c64d7f30f688 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:19.780667 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a45adf96-6410-475b-991f-c64d7f30f688 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1646 microversion: 2.1 time: 0.412654 Aug 29 04:52:19.781258 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 233/546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:19 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1646 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:19.800172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-290f5d26-aaf7-457f-85f3-d829695b7e6d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9d34790>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:19.953692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-290f5d26-aaf7-457f-85f3-d829695b7e6d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:19.954856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-290f5d26-aaf7-457f-85f3-d829695b7e6d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:19.955705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-290f5d26-aaf7-457f-85f3-d829695b7e6d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:19.957379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-290f5d26-aaf7-457f-85f3-d829695b7e6d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:19.958243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-290f5d26-aaf7-457f-85f3-d829695b7e6d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:19.958821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-290f5d26-aaf7-457f-85f3-d829695b7e6d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:19.995442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:20.048947 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-290f5d26-aaf7-457f-85f3-d829695b7e6d tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 200 len: 325 microversion: 2.1 time: 0.266610 Aug 29 04:52:20.050246 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 234/547] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:52:19 2022] PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:20.056235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:20.057093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:20.068901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:20.069878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:20.070762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:20.071813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:20.072616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:20.073312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:20.551160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:20.566618 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-45cb061e-cb8b-47af-a372-7169cedec788 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1319 microversion: 2.1 time: 0.515048 Aug 29 04:52:20.567647 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 235/548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:20 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:20.572569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-9", "block_migration": "auto"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:20.577663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:20.588560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:20.589417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:20.590086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:20.591240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:20.591910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:20.592571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:20.635186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'flavor' on Instance uuid 91b96b18-802e-42f5-9751-0f1aac336e11 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:52:20.654582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Going to try to live migrate instance to n-h2-854119-9 {{(pid=128871) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 04:52:21.008911 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7fcc6ab3-1e18-4f21-a8c9-c2a2626c5f9c tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.118599 Aug 29 04:52:21.018103 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 314/549] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 04:52:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:21.031053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:21.031053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:21.041744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:21.042353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:21.043191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:21.044760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:21.046211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:21.047862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:21.100364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:21.427985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:21.444812 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-74abd430-e2da-454d-9817-73c9ed239777 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1462 microversion: 2.1 time: 0.424534 Aug 29 04:52:21.446895 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 315/550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:21 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1462 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:21.458636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ca22f084-e926-4360-ac2c-8be2648d6dd1 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:21.465468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca22f084-e926-4360-ac2c-8be2648d6dd1 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:21.465987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca22f084-e926-4360-ac2c-8be2648d6dd1 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:21.466415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca22f084-e926-4360-ac2c-8be2648d6dd1 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:21.467164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca22f084-e926-4360-ac2c-8be2648d6dd1 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:21.467609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca22f084-e926-4360-ac2c-8be2648d6dd1 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:21.468030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca22f084-e926-4360-ac2c-8be2648d6dd1 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:21.505131 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ca22f084-e926-4360-ac2c-8be2648d6dd1 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055650 Aug 29 04:52:21.520903 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 316/551] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Aug 29 04:52:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:21.526813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-87708884", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:21.587905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:22.016538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:22.017662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:22.018314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:22.018869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:22.019719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:22.029457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:22.030165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:22.031324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:22.032591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:22.033315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:22.034087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:22.058626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Getting quotas for project 3efffdd404994dd7a0eff62e29972ff4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:22.065049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Getting quotas for user 9d6f228d852a4c1b8a85b34ce74dfdaa and project 3efffdd404994dd7a0eff62e29972ff4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:22.081076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.utils [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] ram quota exceeded for 3efffdd404994dd7a0eff62e29972ff4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128872) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 04:52:22.081867 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Request method failure captured: Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 143 Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEX2dvhDD4JVqaRU1Pu9Ubr_c4eaUJlTz-jJKJNAnfZyk2xJh4yHFOcSpa0uqmUxeqjx3tPpOg147TwPxx9vGnGFqnsSg-ruEZNGShq4SHqdAHVG1fk-F_10hEuNaQRUTiCLBnZ4pjZ1gKjlFe4Hhx3FiAW7a_J8KJmsNwH14fS7j68 Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3efffdd404994dd7a0eff62e29972ff4 Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:52:22.084374 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3efffdd404994dd7a0eff62e29972ff4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3efffdd404994dd7a0eff62e29972ff4 Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-QuotasAdminNegativeTest-81423763-project Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 9d6f228d852a4c1b8a85b34ce74dfdaa Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-QuotasAdminNegativeTest-81423763-project Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-87708884", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} Aug 29 04:52:22.085891 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-87708884', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452'}}} Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 04:52:22.086734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:22.087995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:22.089524 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:22.090972 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:22.090972 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:22.090972 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:52:22.090972 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:52:22.090972 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 04:52:22.090972 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:22.093266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:22.094306 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5bfc6e62-4287-4478-b9a3-12018427158f tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.571855 Aug 29 04:52:22.098595 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 317/552] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:21 2022] POST /compute/v2.1/servers => generated 110 bytes in 577 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:52:22.104065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Action: 'action', calling method: .version_select at 0x7f1abb395550>, body: {"addFloatingIp": {"address": "172.25.9.198"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:22.106774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:22.113120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:22.114067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:22.114662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:22.115579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:22.116413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:22.117101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:22.198366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 04:52:22.198923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquired lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 04:52:22.997001 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-234694fd-9dc0-45da-ac37-2a2492b88f43 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11/action" status: 202 len: 0 microversion: 2.25 time: 2.427116 Aug 29 04:52:22.998491 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 236/553] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 04:52:20 2022] POST /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11/action => generated 0 bytes in 2430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:52:23.004489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-784c83b1-83c2-4a5f-bad2-19478d08d87c req-aa2a0133-b68f-4dea-92c6-215e44743203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ccdf52d-5472-4915-a47a-007b164fb08d", "tag": "36b48416-52f3-4bc9-acf3-f4ce2ced8f0a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:23.005054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.198 (165d5d10-0339-4828-8e51-890257a51655) with port f5749b3f-469d-44cb-9547-09804c2ab09c using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 776871d1-de18-4cbe-bbad-5deeb3ebda78.", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 04:52:23.005855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Releasing lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 04:52:23.006568 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.198 (165d5d10-0339-4828-8e51-890257a51655) with port f5749b3f-469d-44cb-9547-09804c2ab09c using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 776871d1-de18-4cbe-bbad-5deeb3ebda78. Aug 29 04:52:23.006568 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-24524bb6-5b32-4f89-816e-d23324e4f00a'] Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Request method failure captured: Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action HTTP/1.1 Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 46 Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXdDuGq4kSQs399CC0h7B4bDBcYZd8sDATCuA4b8YEJDdWYtOU9pAzQ1CKxW3BRxWSIaWBFUlh7AVKNADtdlAk6yFXwLx0yngb_EeuoEMPEIV7yii0pNAnUh9kGSw5G5NcT7Xk4OJTfzHZwcMBRzPMG8aulsNKeW8HGpcD_M2AHVw0 Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:52:23.008702 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_97fb2ee2a4cf4e17822da422a33bf43a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 56acc42254af4204b832dff3f7240d20 Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: {"addFloatingIp": {"address": "172.25.9.198"}} Aug 29 04:52:23.010136 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot associate floating IP 172.25.9.198 (165d5d10-0339-4828-8e51-890257a51655) with port f5749b3f-469d-44cb-9547-09804c2ab09c using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 776871d1-de18-4cbe-bbad-5deeb3ebda78. Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-24524bb6-5b32-4f89-816e-d23324e4f00a'] Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '27c2838d-345b-4021-a412-afdf0272b510', 'body': {'addFloatingIp': {'address': '172.25.9.198'}}} Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:23.011297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 04:52:23.012508 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.198 (165d5d10-0339-4828-8e51-890257a51655) with port f5749b3f-469d-44cb-9547-09804c2ab09c using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 776871d1-de18-4cbe-bbad-5deeb3ebda78. Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24524bb6-5b32-4f89-816e-d23324e4f00a'] Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.198 (165d5d10-0339-4828-8e51-890257a51655) with port f5749b3f-469d-44cb-9547-09804c2ab09c using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 776871d1-de18-4cbe-bbad-5deeb3ebda78. Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24524bb6-5b32-4f89-816e-d23324e4f00a'] Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:23.013564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.198 (165d5d10-0339-4828-8e51-890257a51655) with port f5749b3f-469d-44cb-9547-09804c2ab09c using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 776871d1-de18-4cbe-bbad-5deeb3ebda78. Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24524bb6-5b32-4f89-816e-d23324e4f00a'] Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:23.015201 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.198 (165d5d10-0339-4828-8e51-890257a51655) with port f5749b3f-469d-44cb-9547-09804c2ab09c using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 776871d1-de18-4cbe-bbad-5deeb3ebda78. Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24524bb6-5b32-4f89-816e-d23324e4f00a'] Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Returning 400 to user: Cannot associate floating IP 172.25.9.198 (165d5d10-0339-4828-8e51-890257a51655) with port f5749b3f-469d-44cb-9547-09804c2ab09c using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 776871d1-de18-4cbe-bbad-5deeb3ebda78. Aug 29 04:52:23.018039 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-24524bb6-5b32-4f89-816e-d23324e4f00a'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:23.020730 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-111fe952-6ca4-49d7-b99f-501ca63dd6e7 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action" status: 400 len: 382 microversion: 2.1 time: 0.910204 Aug 29 04:52:23.020730 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 318/554] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:52:22 2022] POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action => generated 382 bytes in 915 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:52:23.021067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-784c83b1-83c2-4a5f-bad2-19478d08d87c req-aa2a0133-b68f-4dea-92c6-215e44743203 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.021067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-784c83b1-83c2-4a5f-bad2-19478d08d87c req-aa2a0133-b68f-4dea-92c6-215e44743203 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.021067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-784c83b1-83c2-4a5f-bad2-19478d08d87c req-aa2a0133-b68f-4dea-92c6-215e44743203 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.021549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:23.023511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:23.030621 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-784c83b1-83c2-4a5f-bad2-19478d08d87c req-aa2a0133-b68f-4dea-92c6-215e44743203 service nova] Creating event network-changed:36b48416-52f3-4bc9-acf3-f4ce2ced8f0a for instance 2ccdf52d-5472-4915-a47a-007b164fb08d on n-h2-854119-9 Aug 29 04:52:23.032512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.033871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.034373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.035140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.035635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.036183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.036321 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-784c83b1-83c2-4a5f-bad2-19478d08d87c req-aa2a0133-b68f-4dea-92c6-215e44743203 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035613 Aug 29 04:52:23.037207 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 237/555] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:23.043120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-9", "block_migration": true, "disk_over_commit": false}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:23.045662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:23.055557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.056043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.056716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.057721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.058322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.058882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.088945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lazy-loading 'flavor' on Instance uuid 74b208f5-b156-40d9-abb8-1cc1a0f0f348 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:52:23.102961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Going to try to live migrate instance to n-h2-854119-9 {{(pid=128871) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 04:52:23.134091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:23.141331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Old instance type m1.heat2, new instance type m1.heat {{(pid=128872) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 04:52:23.151519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:23.151928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:23.152421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:23.152960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:23.153370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:23.272803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b426c509-9895-4d1b-ba7a-ac75c463f0ba tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481/action" status: 202 len: 0 microversion: 2.1 time: 0.256818 Aug 29 04:52:23.273875 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 319/556] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:52:23 2022] POST /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:52:23.289683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:23.290497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:23.298321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.298989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.299474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.300318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.300827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.301303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.527313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:23.536312 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a0b29f0-cbf6-4c6d-87a2-c930bae22ca2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1319 microversion: 2.1 time: 0.260803 Aug 29 04:52:23.537309 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 320/557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:23 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:23.542003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a35f2a24-6e4c-49e3-91f9-312bdd1280b1 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9ba3940>, body: {"quota_set": {"ram": 51200}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:23.633557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35f2a24-6e4c-49e3-91f9-312bdd1280b1 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.634283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35f2a24-6e4c-49e3-91f9-312bdd1280b1 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.634855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35f2a24-6e4c-49e3-91f9-312bdd1280b1 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.635751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35f2a24-6e4c-49e3-91f9-312bdd1280b1 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.636438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35f2a24-6e4c-49e3-91f9-312bdd1280b1 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.637029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35f2a24-6e4c-49e3-91f9-312bdd1280b1 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.655144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:23.699515 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a35f2a24-6e4c-49e3-91f9-312bdd1280b1 tempest-QuotasAdminNegativeTest-631102148 tempest-QuotasAdminNegativeTest-631102148-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 200 len: 329 microversion: 2.1 time: 0.160849 Aug 29 04:52:23.701349 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 321/558] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:52:23 2022] PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 329 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:23.708638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e9fffe76-17a6-49dd-838f-aa673d35251d req-f84dc3c2-5acc-482a-bd05-43e522871775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3f0ff4-e186-4e1e-b425-f4216bdb515b", "tag": "95f0f1e4-bb45-403f-9a1c-a586976f64b4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:23.723507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e9fffe76-17a6-49dd-838f-aa673d35251d req-f84dc3c2-5acc-482a-bd05-43e522871775 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.724104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e9fffe76-17a6-49dd-838f-aa673d35251d req-f84dc3c2-5acc-482a-bd05-43e522871775 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.724646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e9fffe76-17a6-49dd-838f-aa673d35251d req-f84dc3c2-5acc-482a-bd05-43e522871775 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.736443 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e9fffe76-17a6-49dd-838f-aa673d35251d req-f84dc3c2-5acc-482a-bd05-43e522871775 service nova] Creating event network-changed:95f0f1e4-bb45-403f-9a1c-a586976f64b4 for instance 4f3f0ff4-e186-4e1e-b425-f4216bdb515b on n-h2-854119-9 Aug 29 04:52:23.741227 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e9fffe76-17a6-49dd-838f-aa673d35251d req-f84dc3c2-5acc-482a-bd05-43e522871775 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038052 Aug 29 04:52:23.744831 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 322/559] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:23.857358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-53af9d2f-07e1-4d8e-8c8c-3ed1c6470f59 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Action: 'create', calling method: .version_select at 0x7f1ab9cc1af0>, body: {"keypair": {"name": "tempest-keypair-2109706827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCDfqbtQ6vrcFVuyYwGXaQ/KQ0lfd297jVIQ6BB4Xy7fj/QYGp4YaaJCu1XCVRIbZ9jSS1drfuiCBmNZpqcO84r1p43314RrH84u7BKZrns80QIlrJmegIiBb/S+CvXaQ=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:23.874074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-53af9d2f-07e1-4d8e-8c8c-3ed1c6470f59 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Getting quotas for project 9e4aeab40a6546e799cb321f5978468f. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:23.879953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-53af9d2f-07e1-4d8e-8c8c-3ed1c6470f59 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Getting quotas for user 3b0266d5991442649190b2f052809d2c and project 9e4aeab40a6546e799cb321f5978468f. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:23.917738 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-53af9d2f-07e1-4d8e-8c8c-3ed1c6470f59 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171618 Aug 29 04:52:23.918663 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 323/560] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:52:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:23.925823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:23.926862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:23.935639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.936527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.937383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:23.938623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:23.939217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:23.939776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:24.116675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:24.138420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:24.140768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:24.142160 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b0ec9ec-2310-4b82-917b-83d5498081a5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.222512 Aug 29 04:52:24.142880 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 324/561] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:23 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:24.148011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1dec8fa-d884-47f0-8e86-2370f983d0ea tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '.version_select at 0x7f1ab9cc1f70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:25.978838 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-76bd8d15-4a8e-4040-9be2-fbbc41621821 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348/action" status: 202 len: 0 microversion: 2.1 time: 2.940221 Aug 29 04:52:25.979492 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 238/562] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:52:23 2022] POST /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348/action => generated 0 bytes in 2942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:52:25.991886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:25.992902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:26.014218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:26.015662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:26.016961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:26.020013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:26.026714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:26.027339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:26.095448 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1dec8fa-d884-47f0-8e86-2370f983d0ea tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/165d5d10-0339-4828-8e51-890257a51655" status: 202 len: 0 microversion: 2.1 time: 1.951280 Aug 29 04:52:26.096049 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 325/563] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 04:52:24 2022] DELETE /compute/v2.1/os-floating-ips/165d5d10-0339-4828-8e51-890257a51655 => generated 0 bytes in 1952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:52:26.103722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-662f7217-f82d-4586-ae14-b1b4e50f4904 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Action: 'update', calling method: .version_select at 0x7f1ab99fe5e0>, body: {"quota_set": {"ram": 0}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:26.108868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-662f7217-f82d-4586-ae14-b1b4e50f4904 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '9d6f228d852a4c1b8a85b34ce74dfdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efffdd404994dd7a0eff62e29972ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-662f7217-f82d-4586-ae14-b1b4e50f4904 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Request method failure captured: Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 HTTP/1.1 Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 25 Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEX2dvhDD4JVqaRU1Pu9Ubr_c4eaUJlTz-jJKJNAnfZyk2xJh4yHFOcSpa0uqmUxeqjx3tPpOg147TwPxx9vGnGFqnsSg-ruEZNGShq4SHqdAHVG1fk-F_10hEuNaQRUTiCLBnZ4pjZ1gKjlFe4Hhx3FiAW7a_J8KJmsNwH14fS7j68 Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3efffdd404994dd7a0eff62e29972ff4 Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:52:26.110971 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3efffdd404994dd7a0eff62e29972ff4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3efffdd404994dd7a0eff62e29972ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3efffdd404994dd7a0eff62e29972ff4 Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-81423763 Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-QuotasAdminNegativeTest-81423763-project Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 9d6f228d852a4c1b8a85b34ce74dfdaa Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-QuotasAdminNegativeTest-81423763-project Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: {"quota_set": {"ram": 0}} Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 04:52:26.112262 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '3efffdd404994dd7a0eff62e29972ff4', 'body': {'quota_set': {'ram': 0}}} Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:26.113048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:26.114676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:26.115911 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:26.115911 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:26.115911 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:52:26.115911 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:52:26.115911 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 04:52:26.115911 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:26.117957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-662f7217-f82d-4586-ae14-b1b4e50f4904 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:26.119071 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-662f7217-f82d-4586-ae14-b1b4e50f4904 tempest-QuotasAdminNegativeTest-81423763 tempest-QuotasAdminNegativeTest-81423763-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4" status: 403 len: 116 microversion: 2.1 time: 0.021840 Aug 29 04:52:26.120179 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 326/564] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:52:26 2022] PUT /compute/v2.1/os-quota-sets/3efffdd404994dd7a0eff62e29972ff4 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:52:26.149379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:26.152007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:26.172870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:26.180317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:26.183033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:26.184060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:26.189830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:26.192093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:26.595544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:26.608729 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d4d5752-8aef-4961-95c9-872a231ad1f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1471 microversion: 2.1 time: 0.627613 Aug 29 04:52:26.610021 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 239/565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:25 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1471 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:26.614891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:26.619040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:26.635430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:26.636093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:26.636664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:26.637522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:26.642771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:26.643356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:26.658298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:26.667179 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-810f64fb-3eee-4a1f-b39c-3634f65f3d2b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1319 microversion: 2.1 time: 0.545473 Aug 29 04:52:26.668553 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 327/566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:26 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:26.672085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=5,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:26.673612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:26.674431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:26.680570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:26.681325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:26.681970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:26.682868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:26.683518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:26.684180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:27.227165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:27.234372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:27.242674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:27.242939 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eec6ef52-a59d-4281-aa84-e1ea57ef0ecd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.573136 Aug 29 04:52:27.243513 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 328/567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:26 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:27.245340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:27.247484 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d670e94-cc3e-434e-84b4-62e17a3df501 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.636218 Aug 29 04:52:27.249111 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 240/568] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:26 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:27.256224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1946414908", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "a6c40ff8-12f2-4f87-80cf-2e32f6de070b"}], "security_groups": [{"name": "tempest-securitygroup--1865164779"}], "key_name": "tempest-keypair-2109706827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:27.265983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Action: 'action', calling method: .version_select at 0x7f1abb395940>, body: {"removeFloatingIp": {"address": "172.25.9.238"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:27.504403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] validate_networks() for [('a6c40ff8-12f2-4f87-80cf-2e32f6de070b', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:27.517189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:27.528275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:27.529144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:27.529804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:27.531084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:27.531729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:27.532398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:27.902251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 04:52:27.902858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquired lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 04:52:28.323302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:28.325306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:28.326183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:28.326910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:28.327615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:28.337342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=60,nova_cell0:UPDATE=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:28.341063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:28.342004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:28.342763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:28.343770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:28.344629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:28.345256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:28.381179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Getting quotas for project 9e4aeab40a6546e799cb321f5978468f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:28.391362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Getting quotas for user 3b0266d5991442649190b2f052809d2c and project 9e4aeab40a6546e799cb321f5978468f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:28.415568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:52:28.418350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:28.522476 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-04b4d62a-c627-40fe-9e22-dd712f9d1c06 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.269430 Aug 29 04:52:28.523197 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 241/569] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:52:28.542945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:28.543614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:28.553662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:28.554155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:28.554672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:28.555430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:28.555894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:28.556352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:28.786935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:28.832661 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ab89cae-0146-4706-b6cf-5adfc4fa06e6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1471 microversion: 2.1 time: 0.269376 Aug 29 04:52:28.833340 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 242/570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:28 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:28.873629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:28.874329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:28.885935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:28.886827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:28.908507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:28.909563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:28.913000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:28.913848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:28.981484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Building network info cache for instance {{(pid=128872) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 04:52:29.266515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:29.275130 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f0f7ac5c-5e1b-4c34-80bd-ee4502ae4ab6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1319 microversion: 2.1 time: 0.417021 Aug 29 04:52:29.277975 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 243/571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:28 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:29.282515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:29.286978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:29.301253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:29.303708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:29.306014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:29.308471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:29.309005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:29.309504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:29.568826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:29.581296 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-35e91fb1-0cb7-4278-8e44-fe0f8af4c7ff tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.302274 Aug 29 04:52:29.582388 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 244/572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:29 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:29.591452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:29.592510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:29.600797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:29.601926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:29.602572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:29.604981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:29.606279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:29.608016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:29.898956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:29.926024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:29.934834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:29.939795 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7a83a0bf-1e2c-465b-b943-da11d3e192f6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.355888 Aug 29 04:52:29.947724 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 245/573] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:29 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:29.963136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:29.963837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:29.970291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:29.973028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:29.973777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:29.975306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:29.975825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:29.976501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:30.048742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Updating instance_info_cache with network_info: [{"id": "f5749b3f-469d-44cb-9547-09804c2ab09c", "address": "fa:16:3e:5a:1d:19", "network": {"id": "88954c15-7b5c-4596-81c9-e1fa7d3eb920", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1848659011-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "97fb2ee2a4cf4e17822da422a33bf43a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf5749b3f-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128872) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 04:52:30.086780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Releasing lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 04:52:30.088300 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb4009f7-cc8a-42bc-a87a-4712a0a13e7e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action" status: 202 len: 0 microversion: 2.1 time: 2.843415 Aug 29 04:52:30.089286 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 329/574] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:52:27 2022] POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action => generated 0 bytes in 2845 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 04:52:30.096064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-bfe0c186-d1ab-4e55-b141-e58df4e391e9 req-984d1912-588b-4760-aff1-81779facf872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccdf52d-5472-4915-a47a-007b164fb08d", "name": "network-vif-plugged", "status": "completed", "tag": "36b48416-52f3-4bc9-acf3-f4ce2ced8f0a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:30.107419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bfe0c186-d1ab-4e55-b141-e58df4e391e9 req-984d1912-588b-4760-aff1-81779facf872 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:30.108160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bfe0c186-d1ab-4e55-b141-e58df4e391e9 req-984d1912-588b-4760-aff1-81779facf872 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:30.108782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bfe0c186-d1ab-4e55-b141-e58df4e391e9 req-984d1912-588b-4760-aff1-81779facf872 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:30.124513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:30.125629 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-bfe0c186-d1ab-4e55-b141-e58df4e391e9 req-984d1912-588b-4760-aff1-81779facf872 service nova] Creating event network-vif-plugged:36b48416-52f3-4bc9-acf3-f4ce2ced8f0a for instance 2ccdf52d-5472-4915-a47a-007b164fb08d on n-h2-854119-9 Aug 29 04:52:30.132270 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-bfe0c186-d1ab-4e55-b141-e58df4e391e9 req-984d1912-588b-4760-aff1-81779facf872 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041302 Aug 29 04:52:30.133986 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 330/575] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:30.141493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-048f8683-378d-4f31-9a78-2e496fc448d0 req-c97f776d-623f-4d7e-ad7e-de4baa6c7ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c2838d-345b-4021-a412-afdf0272b510", "tag": "f5749b3f-469d-44cb-9547-09804c2ab09c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:30.141662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fe8bab5f-254f-462c-a0eb-8d032afb67ac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1294 microversion: 2.1 time: 0.187124 Aug 29 04:52:30.142138 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 246/576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:29 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1294 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:30.157820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-048f8683-378d-4f31-9a78-2e496fc448d0 req-c97f776d-623f-4d7e-ad7e-de4baa6c7ebe service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:30.158335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-048f8683-378d-4f31-9a78-2e496fc448d0 req-c97f776d-623f-4d7e-ad7e-de4baa6c7ebe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:30.158768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-048f8683-378d-4f31-9a78-2e496fc448d0 req-c97f776d-623f-4d7e-ad7e-de4baa6c7ebe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:30.164560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1db9b778-ee88-4425-8b11-ece37a852bbd req-fec39e75-57f6-4aba-959d-231911c192f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b96b18-802e-42f5-9751-0f1aac336e11", "name": "network-vif-unplugged", "status": "completed", "tag": "130be427-70c6-4954-bb69-4cbabeacd226"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:30.174994 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-048f8683-378d-4f31-9a78-2e496fc448d0 req-c97f776d-623f-4d7e-ad7e-de4baa6c7ebe service nova] Creating event network-changed:f5749b3f-469d-44cb-9547-09804c2ab09c for instance 27c2838d-345b-4021-a412-afdf0272b510 on n-h1-854119-9 Aug 29 04:52:30.175154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1db9b778-ee88-4425-8b11-ece37a852bbd req-fec39e75-57f6-4aba-959d-231911c192f0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:30.175478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1db9b778-ee88-4425-8b11-ece37a852bbd req-fec39e75-57f6-4aba-959d-231911c192f0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:30.175907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1db9b778-ee88-4425-8b11-ece37a852bbd req-fec39e75-57f6-4aba-959d-231911c192f0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:30.184498 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-048f8683-378d-4f31-9a78-2e496fc448d0 req-c97f776d-623f-4d7e-ad7e-de4baa6c7ebe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046201 Aug 29 04:52:30.187323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 331/577] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:30.196526 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1db9b778-ee88-4425-8b11-ece37a852bbd req-fec39e75-57f6-4aba-959d-231911c192f0 service nova] Creating event network-vif-unplugged:130be427-70c6-4954-bb69-4cbabeacd226 for instance 91b96b18-802e-42f5-9751-0f1aac336e11 on n-h1-854119-9 Aug 29 04:52:30.202113 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1db9b778-ee88-4425-8b11-ece37a852bbd req-fec39e75-57f6-4aba-959d-231911c192f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043371 Aug 29 04:52:30.202891 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 247/578] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:30.203004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:30.203693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:30.212737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:30.213537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:30.214219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:30.215099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:30.215720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:30.216540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:30.219000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12b0eb17-4e7a-49e3-a9ff-eb95a9f9bc27 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '.version_select at 0x7f1ab9c7dd30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:30.491636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:30.503648 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f07f8895-a1a4-4944-a536-24b60e54a8a2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.312368 Aug 29 04:52:30.506979 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 332/579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:30 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:30.512841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:30.513785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:30.532218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:30.534789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:30.535355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:30.536384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:30.537098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:30.540560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:31.418827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:31.426858 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a8cfb5b0-de1e-4641-aa4c-4156d3cbe9e7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1319 microversion: 2.1 time: 0.917834 Aug 29 04:52:31.427407 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 333/580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:30 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1319 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:31.432050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:31.433760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:31.440227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:31.440709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:31.441135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:31.441820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:31.442266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:31.442682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:31.715880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:31.725221 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7576a654-a52b-4d37-bec4-b8973430a3a4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.296578 Aug 29 04:52:31.726400 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 334/581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:31 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:31.855358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1603125140", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:31.910430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:32.232061 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12b0eb17-4e7a-49e3-a9ff-eb95a9f9bc27 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/6b63044c-444d-4f4b-ba2b-606f997c6df0" status: 202 len: 0 microversion: 2.1 time: 2.027208 Aug 29 04:52:32.232877 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 248/582] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 04:52:30 2022] DELETE /compute/v2.1/os-floating-ips/6b63044c-444d-4f4b-ba2b-606f997c6df0 => generated 0 bytes in 2030 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:52:32.238384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:32.239097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:32.246322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.246812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.247262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.247966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.248481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.248901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.319039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:32.319514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:32.320055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:32.320564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:32.321036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:32.330839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.331297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.331858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.332660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.333184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.333675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.351517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Getting quotas for project 13f1750a840a4c9e91529b3f71830c8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:32.356641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Getting quotas for user c02a1e5093784394a6dd23c5d5ff51d6 and project 13f1750a840a4c9e91529b3f71830c8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:32.369089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:52:32.371782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:32.418359 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc2a219e-1ad0-4432-9c8a-257525a41672 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690621 Aug 29 04:52:32.419002 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 335/583] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:52:32.433523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:32.434720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:32.446556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.447231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.447875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.449346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.451249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.452176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.504402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:32.513999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:32.516013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:32.517414 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f030e5e-3743-42f2-a965-8b0e204b5ccf tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.283280 Aug 29 04:52:32.518715 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 249/584] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:32 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:32.525278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:32.526245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:32.534431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.535056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.535741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.536882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.537452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.537975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.731266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:32.741762 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40c7e57d-35e2-4861-ac10-405d255fcae8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1368 microversion: 2.1 time: 0.319114 Aug 29 04:52:32.742833 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 336/585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:32 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1368 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:32.747723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c78be0b2-bb7c-4974-814f-7df9fddabfdb req-7346062a-bb32-49f4-854f-b82c7ab43b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b96b18-802e-42f5-9751-0f1aac336e11", "tag": "130be427-70c6-4954-bb69-4cbabeacd226"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:32.757393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c78be0b2-bb7c-4974-814f-7df9fddabfdb req-7346062a-bb32-49f4-854f-b82c7ab43b29 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.758166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c78be0b2-bb7c-4974-814f-7df9fddabfdb req-7346062a-bb32-49f4-854f-b82c7ab43b29 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.758654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c78be0b2-bb7c-4974-814f-7df9fddabfdb req-7346062a-bb32-49f4-854f-b82c7ab43b29 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.772401 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c78be0b2-bb7c-4974-814f-7df9fddabfdb req-7346062a-bb32-49f4-854f-b82c7ab43b29 service nova] Creating event network-changed:130be427-70c6-4954-bb69-4cbabeacd226 for instance 91b96b18-802e-42f5-9751-0f1aac336e11 on n-h1-854119-9 Aug 29 04:52:32.783860 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c78be0b2-bb7c-4974-814f-7df9fddabfdb req-7346062a-bb32-49f4-854f-b82c7ab43b29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039581 Aug 29 04:52:32.784677 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 337/586] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:32.794092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec318271-5fdd-4e65-8a8e-470e05d422e6 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec318271-5fdd-4e65-8a8e-470e05d422e6 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Request method failure captured: Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action HTTP/1.1 Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 34 Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXdDuGq4kSQs399CC0h7B4bDBcYZd8sDATCuA4b8YEJDdWYtOU9pAzQ1CKxW3BRxWSIaWBFUlh7AVKNADtdlAk6yFXwLx0yngb_EeuoEMPEIV7yii0pNAnUh9kGSw5G5NcT7Xk4OJTfzHZwcMBRzPMG8aulsNKeW8HGpcD_M2AHVw0 Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:52:32.797941 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_97fb2ee2a4cf4e17822da422a33bf43a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 56acc42254af4204b832dff3f7240d20 Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: {"addFloatingIp": {"address": ""}} Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:52:32.799244 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '27c2838d-345b-4021-a412-afdf0272b510', 'body': {'addFloatingIp': {'address': ''}}} Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi '' Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:32.799984 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:52:32.801270 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:52:32.802412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 04:52:32.802412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:32.804681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec318271-5fdd-4e65-8a8e-470e05d422e6 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:32.805769 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ec318271-5fdd-4e65-8a8e-470e05d422e6 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action" status: 400 len: 142 microversion: 2.1 time: 0.017191 Aug 29 04:52:32.806970 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 338/587] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:52:32 2022] POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:52:32.818195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:32.819472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:32.830718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:32.845833 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-05b3de8d-a266-44bd-850e-52c1588b6bea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.324707 Aug 29 04:52:32.856604 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 250/588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:32 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:32.862992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.863723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.864332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.865237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:32.865918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:32.866383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2031094", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:32.866518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:32.892790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:32.959855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:33.279924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:33.290377 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a008fb5c-f000-4960-9982-f4424747222f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1319 microversion: 2.1 time: 0.482128 Aug 29 04:52:33.291483 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 339/589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:32 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:33.295882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:33.296507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:33.303090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:33.304355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:33.305634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:33.322320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:33.323374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:33.324057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:33.439322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:33.439850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:33.440206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:33.440782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:33.441394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:33.462671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:33.463143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:33.464008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:33.464299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:33.464743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:33.465158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:33.534473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Getting quotas for project 13f1750a840a4c9e91529b3f71830c8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:33.542801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Getting quotas for user c02a1e5093784394a6dd23c5d5ff51d6 and project 13f1750a840a4c9e91529b3f71830c8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:33.559830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:52:33.563621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:33.634276 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-df7f3364-e374-4606-8240-d9a1a60a706b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776256 Aug 29 04:52:33.641413 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 251/590] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:52:33.641413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:33.645102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:33.655887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:33.656735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:33.657432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:33.662644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:33.663325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:33.663876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:33.691914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:33.704760 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7eabcc78-62ef-472f-ab29-86dcccc7b93d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.411181 Aug 29 04:52:33.705354 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 340/591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:33 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:33.710949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 04:52:33.717345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b2601c69-1c1b-4f0e-906b-48f611f7efe5 req-b5e5aaf8-6e30-496b-813d-5f726daa954c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3f0ff4-e186-4e1e-b425-f4216bdb515b", "name": "network-vif-plugged", "status": "completed", "tag": "95f0f1e4-bb45-403f-9a1c-a586976f64b4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:33.718003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquired lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 04:52:33.730578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b2601c69-1c1b-4f0e-906b-48f611f7efe5 req-b5e5aaf8-6e30-496b-813d-5f726daa954c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:33.732095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b2601c69-1c1b-4f0e-906b-48f611f7efe5 req-b5e5aaf8-6e30-496b-813d-5f726daa954c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:33.733024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b2601c69-1c1b-4f0e-906b-48f611f7efe5 req-b5e5aaf8-6e30-496b-813d-5f726daa954c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:33.750910 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b2601c69-1c1b-4f0e-906b-48f611f7efe5 req-b5e5aaf8-6e30-496b-813d-5f726daa954c service nova] Creating event network-vif-plugged:95f0f1e4-bb45-403f-9a1c-a586976f64b4 for instance 4f3f0ff4-e186-4e1e-b425-f4216bdb515b on n-h2-854119-9 Aug 29 04:52:33.757880 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b2601c69-1c1b-4f0e-906b-48f611f7efe5 req-b5e5aaf8-6e30-496b-813d-5f726daa954c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049711 Aug 29 04:52:33.757880 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 341/592] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:33.763387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:33.764150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:33.772207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:33.772759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:33.773252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:33.774010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:33.774544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:33.775024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:33.859140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Releasing lock "refresh_cache-27c2838d-345b-4021-a412-afdf0272b510" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 04:52:33.859914 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] HTTP exception thrown: floating IP not found Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Request method failure captured: Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action HTTP/1.1 Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 41 Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXdDuGq4kSQs399CC0h7B4bDBcYZd8sDATCuA4b8YEJDdWYtOU9pAzQ1CKxW3BRxWSIaWBFUlh7AVKNADtdlAk6yFXwLx0yngb_EeuoEMPEIV7yii0pNAnUh9kGSw5G5NcT7Xk4OJTfzHZwcMBRzPMG8aulsNKeW8HGpcD_M2AHVw0 Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:52:33.862042 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_97fb2ee2a4cf4e17822da422a33bf43a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 56acc42254af4204b832dff3f7240d20 Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:52:33.863447 n-d-854119-9 devstack@n-api.service[128871]: exception: floating IP not found Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '27c2838d-345b-4021-a412-afdf0272b510', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:33.864380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 29 04:52:33.865737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:33.868026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Returning 404 to user: floating IP not found {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:33.868903 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dde3db8c-1dfe-4ff7-b771-749e2b8bbdd0 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action" status: 404 len: 67 microversion: 2.1 time: 0.231958 Aug 29 04:52:33.869625 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 252/593] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:52:33 2022] POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action => generated 67 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:52:33.874331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64931754-a0f1-4dbb-8cce-f7221b3efb8f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:33.875131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-64931754-a0f1-4dbb-8cce-f7221b3efb8f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:33.970838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-64931754-a0f1-4dbb-8cce-f7221b3efb8f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:33.978177 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64931754-a0f1-4dbb-8cce-f7221b3efb8f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1211 microversion: 2.1 time: 0.107441 Aug 29 04:52:33.990052 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 253/594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:33 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:33.995001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:33.995911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:34.003018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.004180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.004663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.005406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.005966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.006411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.035389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:34.045992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:34.048027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:34.049850 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cd2e4483-753d-49d7-8336-f4b4b11013fd tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.291124 Aug 29 04:52:34.064333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 342/595] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:33 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:34.072536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:34.073931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:34.081541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.082321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.082945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.083744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.084428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.084776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.370418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:34.379376 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c03e5ac3-4637-40ff-9099-4224eda3325f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1368 microversion: 2.1 time: 0.396291 Aug 29 04:52:34.391318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 254/596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:33 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1368 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:34.396376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1962fa0-e458-4ef1-a399-cd4bfa057bcf tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Action: 'action', calling method: .version_select at 0x7f1abb8d1f70>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:34.397389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:34.413376 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22917d2c-3e30-4082-b089-02451ff49265 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.360740 Aug 29 04:52:34.426791 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 343/597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:34 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:34.433155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5f71bb18-d7f1-42e9-9db4-8b92d82245fb req-c55ddd5f-6388-4b23-a2d7-dd88b2697fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b8c9c9-249d-412e-86ca-35d59cbdd971", "tag": "71d3554f-991d-4013-bd32-c59c58bd7bf3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:34.467566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5f71bb18-d7f1-42e9-9db4-8b92d82245fb req-c55ddd5f-6388-4b23-a2d7-dd88b2697fa8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.468190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5f71bb18-d7f1-42e9-9db4-8b92d82245fb req-c55ddd5f-6388-4b23-a2d7-dd88b2697fa8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.468641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b1962fa0-e458-4ef1-a399-cd4bfa057bcf tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 29 04:52:34.469712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5f71bb18-d7f1-42e9-9db4-8b92d82245fb req-c55ddd5f-6388-4b23-a2d7-dd88b2697fa8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1962fa0-e458-4ef1-a399-cd4bfa057bcf tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Request method failure captured: Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action HTTP/1.1 Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 44 Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXdDuGq4kSQs399CC0h7B4bDBcYZd8sDATCuA4b8YEJDdWYtOU9pAzQ1CKxW3BRxWSIaWBFUlh7AVKNADtdlAk6yFXwLx0yngb_EeuoEMPEIV7yii0pNAnUh9kGSw5G5NcT7Xk4OJTfzHZwcMBRzPMG8aulsNKeW8HGpcD_M2AHVw0 Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:52:34.470397 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_97fb2ee2a4cf4e17822da422a33bf43a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 56acc42254af4204b832dff3f7240d20 Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:52:34.471894 n-d-854119-9 devstack@n-api.service[128871]: exception: Floating IP not found for address 0.0.0.0. Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '27c2838d-345b-4021-a412-afdf0272b510', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:34.472992 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 29 04:52:34.474210 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:52:34.476353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1962fa0-e458-4ef1-a399-cd4bfa057bcf tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:34.476353 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b1962fa0-e458-4ef1-a399-cd4bfa057bcf tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action" status: 404 len: 88 microversion: 2.1 time: 0.079669 Aug 29 04:52:34.476353 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 255/598] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:52:34 2022] POST /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510/action => generated 88 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:52:34.485192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:34.485949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:34.490100 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5f71bb18-d7f1-42e9-9db4-8b92d82245fb req-c55ddd5f-6388-4b23-a2d7-dd88b2697fa8 service nova] Creating event network-changed:71d3554f-991d-4013-bd32-c59c58bd7bf3 for instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 on n-h1-854119-9 Aug 29 04:52:34.493351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.494120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.494882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.495800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.496562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.497196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.498553 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5f71bb18-d7f1-42e9-9db4-8b92d82245fb req-c55ddd5f-6388-4b23-a2d7-dd88b2697fa8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070089 Aug 29 04:52:34.499458 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 344/599] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:34.508758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:34.509386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:34.517265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.517739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.518162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.518849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.519293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.519701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.547059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:52:34.704630 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6f501ec2-ae3d-476c-8b84-15358ab63e6e tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 204 len: 0 microversion: 2.1 time: 0.201793 Aug 29 04:52:34.705337 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 345/600] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:52:34 2022] DELETE /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:52:34.714540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:34.715265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:34.721837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.722327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.722757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.723562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.724014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.724538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.759221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:34.766902 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c6ee97d6-a1c9-47d1-b45b-6f82927186ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1319 microversion: 2.1 time: 0.292218 Aug 29 04:52:34.767754 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 256/601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:34 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:34.783877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:34.784512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:34.790829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.791313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.791740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.792462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:34.792912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:34.793328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:34.924687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:34.933575 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da07c474-15e0-4dc1-9cf1-b81605b28e71 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1543 microversion: 2.1 time: 0.223487 Aug 29 04:52:34.934173 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 346/602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:34 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1543 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:34.955227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:34.963134 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-53c7d189-47c3-4eb8-a909-7f5a91d6727f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.194072 Aug 29 04:52:34.963706 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 257/603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:34 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:35.001690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:35.002395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:35.011174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.011733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.012545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.013535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.014210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.014794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.073721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:35.074321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:35.086657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.087397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.087830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.088553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.089213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.089636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.127650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:35.135717 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-015755f2-9595-42b1-8887-d3cf03990e1e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1263 microversion: 2.1 time: 0.139988 Aug 29 04:52:35.136303 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 347/604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:34 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1263 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:35.260497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:35.269922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:35.271321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:35.272495 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-59546215-0776-4840-897b-68f035a00fc8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.203313 Aug 29 04:52:35.273063 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 258/605] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:35 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:52:35.392246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:35.392719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:35.399051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.399529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.399962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.400720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.401171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.401591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.411187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:35.412364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:35.419920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.420474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.421259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.422236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.422881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.423395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.430788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:52:35.511263 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4cdee18f-4695-4f64-be8c-7101dd54376a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 204 len: 0 microversion: 2.1 time: 0.122740 Aug 29 04:52:35.511843 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 348/606] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:52:35 2022] DELETE /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:52:35.517130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:35.517874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:35.524365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.524722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.525142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.525863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:35.526246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:35.526653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:35.639849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:35.647739 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f32e3734-1a55-4782-abb9-58039fdab4fb tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1368 microversion: 2.1 time: 0.240635 Aug 29 04:52:35.649397 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 259/607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:35 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:35.660703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1253117053", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "201204300", "adminPass": "***", "networks": [{"uuid": "eb87980e-7802-4e62-8250-7148cfcebf92"}], "security_groups": [{"name": "tempest-securitygroup--1344051755"}], "key_name": "tempest-keypair-232144476", "user_data": "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:36.140739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] validate_networks() for [('eb87980e-7802-4e62-8250-7148cfcebf92', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:36.171117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:36.182682 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a761be91-1812-4165-9556-f929d6689e29 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.669463 Aug 29 04:52:36.183365 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 349/608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:35 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:36.190290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:36.191114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:36.197322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:36.198085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:36.198599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:36.199338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:36.199946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:36.200491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:36.458052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:36.466129 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1e91206f-06e3-43ae-a92c-9ce89a85b2f9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1319 microversion: 2.1 time: 0.281571 Aug 29 04:52:36.480284 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 350/609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:36 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:36.480284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:36.480284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:36.480284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:36.480284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:36.480909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:36.480909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:36.481097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:36.481450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:36.481874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:36.747468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:36.756680 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6c7117ca-5b3e-4b4e-846b-769f8810e008 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1543 microversion: 2.1 time: 0.288966 Aug 29 04:52:36.757307 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 351/610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:36 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1543 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:36.762320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:36.763904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:36.771003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:36.771875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:36.772526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:36.773428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:36.774054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:36.774655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:36.997784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:36.998315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:36.998653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:36.999143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:36.999606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:37.015694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.016800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.017680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.018606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.019231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.020035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.024941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.041938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Getting quotas for project ff90f242c8c443ea81148656e08dd959. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:37.043351 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-42368b6e-3939-4d99-b267-d24b081d0b7f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.283805 Aug 29 04:52:37.057019 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 352/611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:36 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:37.057772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Getting quotas for user a7d92346a9fb41fdb9c482a405661d2b and project ff90f242c8c443ea81148656e08dd959. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:37.060092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:37.072715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:37.073591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:37.076348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:52:37.079313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:37.085562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.088571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.096791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.097627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.098398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.099048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.145198 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c9fbbdd1-4844-4c4f-bd93-113db8fa4958 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.489168 Aug 29 04:52:37.146001 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 260/612] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:52:37.150691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:37.151381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:37.158268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.158859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.159362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.160167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.160837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.161605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.184846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.188921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:37.195424 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3fceab3a-c826-4e4b-b5a6-6c45c9c67e30 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1263 microversion: 2.1 time: 0.137288 Aug 29 04:52:37.196052 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 353/613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:37 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1263 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:37.211846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:37.213194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:37.220049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.220704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.221232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.222021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.222583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.223104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.371142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.381095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.382531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.383694 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8624fed6-7f1d-432a-8e80-553799e83f60 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.236701 Aug 29 04:52:37.396636 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 261/614] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:37 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:37.403500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.405030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a589fac-bf1d-40e5-8ea5-cc6941561f1e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:37.405921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a589fac-bf1d-40e5-8ea5-cc6941561f1e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:37.411229 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a2618f1-819a-464d-ae97-60f957adcdc6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1368 microversion: 2.1 time: 0.203228 Aug 29 04:52:37.412181 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 354/615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:37 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:37.417508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:37.418112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:37.423841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.424367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.424797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.425480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.425924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.426334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.466735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a589fac-bf1d-40e5-8ea5-cc6941561f1e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.476018 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a589fac-bf1d-40e5-8ea5-cc6941561f1e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1262 microversion: 2.1 time: 0.078193 Aug 29 04:52:37.477579 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 262/616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:37 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:37.496356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:37.497077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:37.503720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.504372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.504896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.505760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.506306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.507051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.621422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.635350 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5cc0316f-373b-49f0-b0f1-7327620337d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.221846 Aug 29 04:52:37.649846 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 355/617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:37 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:37.691395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.700775 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af1a9c92-21a1-4b9c-ae32-24d8a6bfb07e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1319 microversion: 2.1 time: 0.208593 Aug 29 04:52:37.714748 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 263/618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:37 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:37.777835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:37.778448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:37.785310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.785799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.786231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.786963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:37.787416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:37.787836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:37.975971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:37.984059 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6eb82e19-0d3e-4831-aa8b-f37ba7bee7d8 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1543 microversion: 2.1 time: 0.210122 Aug 29 04:52:37.984880 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 356/619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:37 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1543 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:38.066179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:38.066728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:38.072991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:38.073474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:38.073975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:38.074609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:38.075064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:38.075482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:38.078095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:38.218919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:38.220100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:38.227857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:38.228708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:38.229340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:38.230235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:38.230974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:38.231544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:38.382651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:38.395694 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-612f52ff-d8bf-4ee4-ba26-478a454d1e48 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1263 microversion: 2.1 time: 0.182679 Aug 29 04:52:38.396791 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 357/620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:38 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:38.411684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:38.412352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:38.419081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:38.419890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:38.420359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:38.421057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:38.421503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:38.421924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:38.563021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:38.571614 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fe1ab6e9-7a91-403f-8da5-177a87145bf8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.509380 Aug 29 04:52:38.576266 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 264/621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:38 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:38.595895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:38.596633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:38.603420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:38.603803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:38.604508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:38.605235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:38.605689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:38.606219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:39.000789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:39.011896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:39.019030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:39.020344 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8dda6bb4-b56a-45df-b2c7-e61dd4b285c2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.615016 Aug 29 04:52:39.022948 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 358/622] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:38 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:39.031073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:39.033585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:39.041713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:39.042441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:39.043034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:39.043887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:39.048956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:39.049619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:39.155738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:39.165772 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d73f9973-6892-47a5-8911-d36a89f4041e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1368 microversion: 2.1 time: 0.588169 Aug 29 04:52:39.175403 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 265/623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:38 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1368 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:39.190558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:39.191485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:39.208692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:39.209828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:39.210926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:39.215605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:39.216506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:39.217894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:39.281812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:39.300143 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8afb86ef-e702-4ea5-ab01-8c508c3dd037 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1314 microversion: 2.1 time: 0.275875 Aug 29 04:52:39.301862 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 359/624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:39 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:39.307970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:39.308614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:39.321596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:39.322368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:39.322812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:39.323580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:39.324030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:39.324475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:40.285567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:40.304012 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3ba078ab-c231-44ce-b2ef-38d752fffc86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 1.125857 Aug 29 04:52:40.310439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 266/625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:39 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:40.315809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:40.316646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:40.329136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:40.329895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:40.330506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:40.331418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:40.332023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:40.332614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:40.411842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:40.435531 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ab0b030-3a53-49db-bd81-fab1809d0476 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1469 microversion: 2.1 time: 1.131094 Aug 29 04:52:40.436677 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 360/626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:39 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1469 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:40.451044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:40.451855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:40.463910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:40.467224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:40.467854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:40.469532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:40.470898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:40.473801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:40.652546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56acc42254af4204b832dff3f7240d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb2ee2a4cf4e17822da422a33bf43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:40.662127 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-149b5a09-f0b7-4332-a16d-2572977f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 200 len: 1501 microversion: 2.1 time: 0.349899 Aug 29 04:52:40.662989 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 267/627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:40 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 1501 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:40.668616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:40.669529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:40.689530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:40.690337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:40.691754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:40.693541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:40.694191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:40.695312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:40.729677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:40.752616 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ce8407f8-ffdd-49c1-a2a4-39fc32242038 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1269 microversion: 2.1 time: 0.305449 Aug 29 04:52:40.753288 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 361/628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:40 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1269 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:40.766068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:40.767830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:40.793540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:40.794072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:40.794567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:40.795278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:40.795726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:40.796385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:41.348699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:41.360600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:41.362585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:41.363960 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c6d120da-12fd-4469-b033-3df2761b0d70 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.609677 Aug 29 04:52:41.365009 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 362/629] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:40 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:41.370294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3800d4f8-3a37-4cb1-a22f-12a8b38d4962 req-282c25fd-e28d-4430-84d9-2fd592742a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd58c75-b4bb-4fd6-846e-e3cb7e72388a", "name": "network-vif-deleted", "tag": "7de24bde-df42-4bc2-9d60-e138225d92a4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:41.380052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3800d4f8-3a37-4cb1-a22f-12a8b38d4962 req-282c25fd-e28d-4430-84d9-2fd592742a32 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:41.380650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3800d4f8-3a37-4cb1-a22f-12a8b38d4962 req-282c25fd-e28d-4430-84d9-2fd592742a32 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:41.381075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3800d4f8-3a37-4cb1-a22f-12a8b38d4962 req-282c25fd-e28d-4430-84d9-2fd592742a32 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:41.403536 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3800d4f8-3a37-4cb1-a22f-12a8b38d4962 req-282c25fd-e28d-4430-84d9-2fd592742a32 service nova] Creating event network-vif-deleted:7de24bde-df42-4bc2-9d60-e138225d92a4 for instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a on n-h2-854119-9 Aug 29 04:52:41.410250 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3800d4f8-3a37-4cb1-a22f-12a8b38d4962 req-282c25fd-e28d-4430-84d9-2fd592742a32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043680 Aug 29 04:52:41.411378 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 363/630] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:41.416741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:41.417397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:41.425927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:41.426639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:41.427295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:41.428232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:41.428841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:41.429419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:41.787232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:41.798582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7d2861a3-3741-4c25-b45b-bd5680e493d2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 1.134395 Aug 29 04:52:41.812272 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 268/631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:40 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:41.823513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:41.826577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:41.842813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:41.847260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:41.847765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:41.849143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:41.851885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:41.852615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:41.947229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:41.956031 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a81e696-a28d-4187-8b94-ce84c5b26cb1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1368 microversion: 2.1 time: 0.543156 Aug 29 04:52:41.957216 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 364/632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:41 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1368 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:41.962337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:41.963169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:41.969485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:41.970002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:41.970421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:41.971103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:41.972072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:41.972072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.033383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:42.047829 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-451399dd-811e-4923-a1b8-06d6cd442f2a tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1320 microversion: 2.1 time: 0.233676 Aug 29 04:52:42.060903 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 269/633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:41 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:42.066079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-bd2dbfab-fd23-40d9-a261-f9c198b63488 req-3f7bca64-60f2-4eeb-bce3-5be13c709544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c2838d-345b-4021-a412-afdf0272b510", "name": "network-vif-deleted", "tag": "f5749b3f-469d-44cb-9547-09804c2ab09c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:42.078527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bd2dbfab-fd23-40d9-a261-f9c198b63488 req-3f7bca64-60f2-4eeb-bce3-5be13c709544 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.079242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bd2dbfab-fd23-40d9-a261-f9c198b63488 req-3f7bca64-60f2-4eeb-bce3-5be13c709544 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.079664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bd2dbfab-fd23-40d9-a261-f9c198b63488 req-3f7bca64-60f2-4eeb-bce3-5be13c709544 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.091724 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-bd2dbfab-fd23-40d9-a261-f9c198b63488 req-3f7bca64-60f2-4eeb-bce3-5be13c709544 service nova] Creating event network-vif-deleted:f5749b3f-469d-44cb-9547-09804c2ab09c for instance 27c2838d-345b-4021-a412-afdf0272b510 on n-h1-854119-9 Aug 29 04:52:42.096772 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-bd2dbfab-fd23-40d9-a261-f9c198b63488 req-3f7bca64-60f2-4eeb-bce3-5be13c709544 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034436 Aug 29 04:52:42.097379 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 270/634] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:42.102585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:42.103265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:42.109321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.109796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.110226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.110913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.111367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.111787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.341893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=15 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:42.363588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=77 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:42.459046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:42.473078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5432094-7299-4e03-a768-e6920abf336b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 200 len: 1469 microversion: 2.1 time: 0.514635 Aug 29 04:52:42.473807 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 365/635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:41 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 1469 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:42.498702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:42.499648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] [instance: 27c2838d-345b-4021-a412-afdf0272b510] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:42.506984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.507818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.509149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.510422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.511023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.511581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.531007 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] HTTP exception thrown: Instance 27c2838d-345b-4021-a412-afdf0272b510 could not be found. Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Request method failure captured: Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 HTTP/1.1 Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXdDuGq4kSQs399CC0h7B4bDBcYZd8sDATCuA4b8YEJDdWYtOU9pAzQ1CKxW3BRxWSIaWBFUlh7AVKNADtdlAk6yFXwLx0yngb_EeuoEMPEIV7yii0pNAnUh9kGSw5G5NcT7Xk4OJTfzHZwcMBRzPMG8aulsNKeW8HGpcD_M2AHVw0 Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:52:42.533026 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_97fb2ee2a4cf4e17822da422a33bf43a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97fb2ee2a4cf4e17822da422a33bf43a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 97fb2ee2a4cf4e17822da422a33bf43a Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238 Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 56acc42254af4204b832dff3f7240d20 Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 27c2838d-345b-4021-a412-afdf0272b510 could not be found. Aug 29 04:52:42.534599 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '27c2838d-345b-4021-a412-afdf0272b510'} Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c2838d-345b-4021-a412-afdf0272b510 could not be found. Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:42.535376 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c2838d-345b-4021-a412-afdf0272b510 could not be found. Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c2838d-345b-4021-a412-afdf0272b510 could not be found. Aug 29 04:52:42.537142 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:42.539190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] Returning 404 to user: Instance 27c2838d-345b-4021-a412-afdf0272b510 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:42.540042 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-20c3cf48-7b93-4d4f-8cc5-010d9113df65 tempest-FloatingIPsAssociationNegativeTestJSON-39702238 tempest-FloatingIPsAssociationNegativeTestJSON-39702238-project] 10.222.0.20 "GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510" status: 404 len: 111 microversion: 2.1 time: 0.050994 Aug 29 04:52:42.540644 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 366/636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:42 2022] GET /compute/v2.1/servers/27c2838d-345b-4021-a412-afdf0272b510 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:52:42.548965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:42.549773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:42.558158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.558856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.559471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.560351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.560932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.561492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.595440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:42.603172 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fb85abc0-a493-4f80-b059-b72454c48483 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.504484 Aug 29 04:52:42.603744 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 271/637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:42 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:42.618119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:42.618733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:42.632400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.632970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.633588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.634548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.635004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.635428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.697529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:42.708979 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3562c2dc-874d-431e-8cfe-6c1373c27118 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1269 microversion: 2.1 time: 0.163206 Aug 29 04:52:42.710514 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 367/638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:42 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:42.716422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:42.725736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:42.727290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Searching by: {'reservation_id': 'r-09efb813', 'deleted': False, 'project_id': '38bcab4cb30d4894bdec1572236a6347'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:52:42.733630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.735117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.735868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.736869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:42.737648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:42.738292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:42.921799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 04:52:43.005149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:43.012935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:43.013416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:43.013845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:43.025349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:43.040271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:43.042194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:43.043523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5053c40f-562d-41ea-b0b8-0ce877937fc6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1568 microversion: 2.25 time: 0.436379 Aug 29 04:52:43.046574 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 272/639] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:42 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1568 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:43.053038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7e10d716-7da2-47e2-a694-0954dd694b85 req-d6ec88e9-207f-49ad-9801-7a7a99c99712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b8c9c9-249d-412e-86ca-35d59cbdd971", "name": "network-vif-plugged", "status": "completed", "tag": "71d3554f-991d-4013-bd32-c59c58bd7bf3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:43.069016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7e10d716-7da2-47e2-a694-0954dd694b85 req-d6ec88e9-207f-49ad-9801-7a7a99c99712 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:43.069632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7e10d716-7da2-47e2-a694-0954dd694b85 req-d6ec88e9-207f-49ad-9801-7a7a99c99712 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:43.070690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7e10d716-7da2-47e2-a694-0954dd694b85 req-d6ec88e9-207f-49ad-9801-7a7a99c99712 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:43.094328 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7e10d716-7da2-47e2-a694-0954dd694b85 req-d6ec88e9-207f-49ad-9801-7a7a99c99712 service nova] Creating event network-vif-plugged:71d3554f-991d-4013-bd32-c59c58bd7bf3 for instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 on n-h1-854119-9 Aug 29 04:52:43.101958 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7e10d716-7da2-47e2-a694-0954dd694b85 req-d6ec88e9-207f-49ad-9801-7a7a99c99712 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053257 Aug 29 04:52:43.103380 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 273/640] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:43.113941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:43.114843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:43.127483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:43.128032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:43.128738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:43.129598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:43.130141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:43.130826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:43.749562 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e64d2152-f899-48b3-9f90-7d4ee375b839 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-09efb813" status: 200 len: 2931 microversion: 2.1 time: 1.037764 Aug 29 04:52:43.751648 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 368/641] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Aug 29 04:52:42 2022] GET /compute/v2.1/servers/detail?reservation_id=r-09efb813 => generated 2931 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:43.756871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:43.757703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:43.774516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:43.775005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:43.775434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:43.776175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:43.776639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:43.777541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:43.816761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:43.829644 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3b3c097-ff35-4e96-aa14-be19ea080562 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.724272 Aug 29 04:52:43.830819 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 274/642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:43 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:43.837246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:43.838104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:43.845167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:43.845901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:43.846728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:43.847657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:43.848349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:43.848965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:43.976638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:43.989145 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-945d46d5-d6c8-4cb5-bad1-3f1cb9492500 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1368 microversion: 2.1 time: 0.236016 Aug 29 04:52:43.990107 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 369/643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:43 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:43.996205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:43.997021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:44.005400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.006111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.006710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.007893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.008545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.008967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.028776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:44.037735 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be54eb1f-9836-4907-bb8d-a450dde3b4ba tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1388 microversion: 2.1 time: 0.205015 Aug 29 04:52:44.038303 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 275/644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:43 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1388 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:44.054773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:44.055388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:44.061517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.062001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.062617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.063316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.063765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.064206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.269377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:44.277453 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-79c379e8-3628-4468-8fbf-62b51f9bb3df tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.285516 Aug 29 04:52:44.278229 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 370/645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:43 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:44.283042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0a6e5c13-9253-410b-b6d0-4cbebc98b789 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:44.296756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:44.297918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.compute.server_groups [None req-0a6e5c13-9253-410b-b6d0-4cbebc98b789 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Querying cell a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) for 2 instances {{(pid=128872) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 04:52:44.298777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a6e5c13-9253-410b-b6d0-4cbebc98b789 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.299416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a6e5c13-9253-410b-b6d0-4cbebc98b789 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.299996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a6e5c13-9253-410b-b6d0-4cbebc98b789 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.305758 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-286dbef3-ed0d-440c-bf58-8dbf52c6e51d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.264300 Aug 29 04:52:44.316313 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 276/646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:44 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:44.321790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:44.322676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:44.330267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.334230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.339934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.341046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.341676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.342265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.500758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:44.517414 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0a6e5c13-9253-410b-b6d0-4cbebc98b789 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/b9032b51-7400-475f-8aab-76fd60d08d1b" status: 200 len: 266 microversion: 2.1 time: 0.237643 Aug 29 04:52:44.524041 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 371/647] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 04:52:44 2022] GET /compute/v2.1/os-server-groups/b9032b51-7400-475f-8aab-76fd60d08d1b => generated 266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:44.529182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ed703713-2e32-4a82-ac02-a5b3ad7433a8 req-b32a7fe2-358c-4866-8e01-2cd78881f929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e4c604-f8ec-4543-87ae-906f5e0fbb2f", "tag": "a629769f-7290-46cd-9c9d-933b910b2c27"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:44.538922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ed703713-2e32-4a82-ac02-a5b3ad7433a8 req-b32a7fe2-358c-4866-8e01-2cd78881f929 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.539541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ed703713-2e32-4a82-ac02-a5b3ad7433a8 req-b32a7fe2-358c-4866-8e01-2cd78881f929 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.540077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ed703713-2e32-4a82-ac02-a5b3ad7433a8 req-b32a7fe2-358c-4866-8e01-2cd78881f929 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.551216 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ed703713-2e32-4a82-ac02-a5b3ad7433a8 req-b32a7fe2-358c-4866-8e01-2cd78881f929 service nova] Creating event network-changed:a629769f-7290-46cd-9c9d-933b910b2c27 for instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f on n-h2-854119-9 Aug 29 04:52:44.556821 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ed703713-2e32-4a82-ac02-a5b3ad7433a8 req-b32a7fe2-358c-4866-8e01-2cd78881f929 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031375 Aug 29 04:52:44.557873 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 372/648] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:44.563746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-01e2f1f3-ac77-40bd-ba21-1f3f2ec8efb2 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:44.565029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-01e2f1f3-ac77-40bd-ba21-1f3f2ec8efb2 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:44.574274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01e2f1f3-ac77-40bd-ba21-1f3f2ec8efb2 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.575218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01e2f1f3-ac77-40bd-ba21-1f3f2ec8efb2 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.575923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01e2f1f3-ac77-40bd-ba21-1f3f2ec8efb2 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.576822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01e2f1f3-ac77-40bd-ba21-1f3f2ec8efb2 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.577370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01e2f1f3-ac77-40bd-ba21-1f3f2ec8efb2 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.577973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01e2f1f3-ac77-40bd-ba21-1f3f2ec8efb2 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.596588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:44.611599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:44.613071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:44.614376 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-08c83514-c287-41c3-a9db-cc82db7060bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1543 microversion: 2.25 time: 0.296533 Aug 29 04:52:44.615010 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 277/649] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:44 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1543 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:44.648610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-535dd270-1c28-4d7b-84a3-f26567d77a11 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '.version_select at 0x7f1ab9c7d4c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:44.652399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-535dd270-1c28-4d7b-84a3-f26567d77a11 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.652705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-535dd270-1c28-4d7b-84a3-f26567d77a11 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.653145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-535dd270-1c28-4d7b-84a3-f26567d77a11 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.663553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-535dd270-1c28-4d7b-84a3-f26567d77a11 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2608 microversion: 2.25 time: 0.018676 Aug 29 04:52:44.664707 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 278/650] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Aug 29 04:52:44 2022] GET /compute/v2.1/os-migrations => generated 2608 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:52:44.679569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:44.680499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:44.686966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.687680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.688336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.689224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.689828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.690503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.918334 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-01e2f1f3-ac77-40bd-ba21-1f3f2ec8efb2 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 200 len: 1620 microversion: 2.1 time: 0.358452 Aug 29 04:52:44.932141 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 373/651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:44 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 1620 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:44.947137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:44.947857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:44.953096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 91b96b18-802e-42f5-9751-0f1aac336e11 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:52:44.968979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.969472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.969907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.973845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:44.974349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:44.975385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:44.986188 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72cc5de5-87eb-4376-985c-68cc4959a74e tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 2036 microversion: 2.25 time: 0.307555 Aug 29 04:52:44.989350 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 279/652] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:44 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 2036 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:45.005963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e9d1c95d-0d9c-4c59-b1e3-c19f52c5ac30 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:45.006579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e9d1c95d-0d9c-4c59-b1e3-c19f52c5ac30 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:45.021661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9d1c95d-0d9c-4c59-b1e3-c19f52c5ac30 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:45.022374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9d1c95d-0d9c-4c59-b1e3-c19f52c5ac30 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:45.024435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9d1c95d-0d9c-4c59-b1e3-c19f52c5ac30 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:45.025172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9d1c95d-0d9c-4c59-b1e3-c19f52c5ac30 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:45.025632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9d1c95d-0d9c-4c59-b1e3-c19f52c5ac30 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:45.026050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9d1c95d-0d9c-4c59-b1e3-c19f52c5ac30 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:45.288164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:45.303030 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e9d1c95d-0d9c-4c59-b1e3-c19f52c5ac30 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 200 len: 1620 microversion: 2.1 time: 0.312487 Aug 29 04:52:45.304177 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b922e519-b148-4dda-ac07-79b02d263698 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.382907 Aug 29 04:52:45.305147 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 280/653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:44 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 1620 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:45.310268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:45.311113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:45.317213 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 374/654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:44 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:45.319054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:45.319803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:45.320504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:45.321445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:45.324284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b133c27-2be6-4de9-97fe-273561df73e8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Action: 'create', calling method: .version_select at 0x7f1ab9a42a60>, body: {"keypair": {"name": "tempest-keypair-890935324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ78m7HAD/pxXrplxOkbjnIzIfGgg0NwYQktBh5zT9oO+I2BphBkK3iAwVhJXV69he+t0c++sSn4jCc7tFzV7QRXEW36WYAo0uIbc3xcQPqXsg898fZuPDcDfgm5Ch9bGw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:45.326597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:45.327271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:45.347700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7b133c27-2be6-4de9-97fe-273561df73e8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for project 2864fc0a731f4945a27e68889572000f. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:45.353270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7b133c27-2be6-4de9-97fe-273561df73e8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for user 62ea00a8210b4ede95e54c53e7445794 and project 2864fc0a731f4945a27e68889572000f. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:45.396799 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b133c27-2be6-4de9-97fe-273561df73e8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.078396 Aug 29 04:52:45.398087 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 375/655] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 04:52:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 04:52:45.407940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:45.408813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:45.415818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:45.416337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:45.416759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:45.417624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:45.418221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:45.418788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:45.911412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:45.927980 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3da198d8-6ea3-4a77-a6f5-b186669a4bf1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1559 microversion: 2.1 time: 0.619887 Aug 29 04:52:45.928793 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 281/656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:45 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1559 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:45.942151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:45.943084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:45.954226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:45.957533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:45.958270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:45.960560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:45.964519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:45.965191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:45.998610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:46.080847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:46.091225 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-79b4cdff-6a65-43bf-a01f-be40d95858f9 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1388 microversion: 2.1 time: 0.691848 Aug 29 04:52:46.098411 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 376/657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:45 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1388 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:46.103895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:46.104698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:46.111893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:46.112905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:46.113495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:46.114405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:46.115027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:46.115610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:46.802327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:46.811953 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39d671ba-ea47-4ace-a6dd-e03130620bb4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.712100 Aug 29 04:52:46.812805 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 377/658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:46 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:46.818546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4f67484a-b4a8-4b83-a2cb-692878e873ac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Action: 'create', calling method: .version_select at 0x7f1ab990c280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1823252695", "policies": ["anti-affinity"]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:46.840280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4f67484a-b4a8-4b83-a2cb-692878e873ac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:46.848027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4f67484a-b4a8-4b83-a2cb-692878e873ac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:46.854333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:46.870619 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f8bdf12-0ec4-4bc7-846d-78fe6fb25840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.940547 Aug 29 04:52:46.871721 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 282/659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:45 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:46.877658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc0ecedc-01fa-42ee-830a-c99d8339e426 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:46.878335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc0ecedc-01fa-42ee-830a-c99d8339e426 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:46.885132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc0ecedc-01fa-42ee-830a-c99d8339e426 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:46.885847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc0ecedc-01fa-42ee-830a-c99d8339e426 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:46.886668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc0ecedc-01fa-42ee-830a-c99d8339e426 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:46.887530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc0ecedc-01fa-42ee-830a-c99d8339e426 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:46.888989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc0ecedc-01fa-42ee-830a-c99d8339e426 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:46.889701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc0ecedc-01fa-42ee-830a-c99d8339e426 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:46.928013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4f67484a-b4a8-4b83-a2cb-692878e873ac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:46.933167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4f67484a-b4a8-4b83-a2cb-692878e873ac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:46.949786 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4f67484a-b4a8-4b83-a2cb-692878e873ac tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.135501 Aug 29 04:52:46.950614 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 378/660] 10.222.0.20 () {60 vars in 1174 bytes} [Mon Aug 29 04:52:46 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:46.967056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:46.967982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:46.976185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:46.977082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:46.977609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:46.982395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:46.983122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:46.983909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:47.035811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:47.187499 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc0ecedc-01fa-42ee-830a-c99d8339e426 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.314045 Aug 29 04:52:47.188376 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 283/661] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 04:52:46 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-interface => generated 285 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:47.199714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5f6078bc-19b5-44a1-8ac1-70935d11a758 req-af395ac3-71d2-434f-b771-b8aeb61ff43c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50354b59-597b-4592-aab3-4b1fcd07d8bb", "tag": "c7c220d0-79d0-42ef-a221-b6dd9107c608"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:47.219464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5f6078bc-19b5-44a1-8ac1-70935d11a758 req-af395ac3-71d2-434f-b771-b8aeb61ff43c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:47.220360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5f6078bc-19b5-44a1-8ac1-70935d11a758 req-af395ac3-71d2-434f-b771-b8aeb61ff43c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:47.221021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5f6078bc-19b5-44a1-8ac1-70935d11a758 req-af395ac3-71d2-434f-b771-b8aeb61ff43c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:47.247332 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5f6078bc-19b5-44a1-8ac1-70935d11a758 req-af395ac3-71d2-434f-b771-b8aeb61ff43c service nova] Creating event network-changed:c7c220d0-79d0-42ef-a221-b6dd9107c608 for instance 50354b59-597b-4592-aab3-4b1fcd07d8bb on n-h1-854119-9 Aug 29 04:52:47.253913 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5f6078bc-19b5-44a1-8ac1-70935d11a758 req-af395ac3-71d2-434f-b771-b8aeb61ff43c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059525 Aug 29 04:52:47.255151 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 284/662] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:47.262793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1734957800", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5d82fee1-fd1f-426c-8681-0ad48c37cade"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:47.336700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:47.474385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=21 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:47.881112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:47.893265 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b325caed-6331-4f9d-a6b1-3a2d170a9f01 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.931714 Aug 29 04:52:47.905043 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 379/663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:46 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:47.911830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:47.912806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:47.921255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:47.921926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:47.922357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:47.923294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:47.923467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:47.923880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:48.428183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:48.438642 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22067827-c8ec-41dd-ad45-2e348c34ad74 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1388 microversion: 2.1 time: 0.531713 Aug 29 04:52:48.452974 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 380/664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:47 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1388 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:48.459949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:48.461181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:48.465364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:48.469937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:48.470705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:48.471531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:48.472510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:48.473508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:48.474195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:48.486505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:48.487082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:48.487447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:48.487863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:48.488307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:48.537324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:48.537818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:48.538258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:48.538992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:48.539548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:48.540107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:48.566006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:48.573629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:48.589795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Going to run 2 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:52:48.594133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:48.638359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128871) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 04:52:48.663659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:48.670346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:48.728625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:48.735443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:48.761774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=accfa42e-7428-47a8-a6da-7594c2ebe80e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:48.783654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:48.824541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:48.832967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:48.887895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:48.897148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:48.938077 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4069438f-c13e-4ce7-87f6-06e7845b5c51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.681063 Aug 29 04:52:48.942070 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 285/665] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:52:47 2022] POST /compute/v2.1/servers => generated 32 bytes in 1686 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 04:52:48.947678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:48.948326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:48.956866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:48.957356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:48.957788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:48.958587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:48.959042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:48.959463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:48.966045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:48.977813 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a498c5f2-e8de-47f1-a08f-762a06b181d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.523558 Aug 29 04:52:48.978438 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 381/666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:48 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:48.994100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:48.994726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:49.008588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:49.010588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:49.011929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:49.014419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:49.015105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:49.018270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:49.529476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:49.542323 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-36cc0cee-781f-4ab5-84a9-70108297d308 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.598984 Aug 29 04:52:49.555814 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 286/667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:48 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:49.560772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:49.565671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:49.566443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Searching by: {'deleted': False, 'project_id': '38bcab4cb30d4894bdec1572236a6347'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:52:49.603369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:49.603854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:49.616028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:49.617060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:49.617553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:49.617993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:49.695023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:49.703564 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-63123402-d09b-4db5-8e64-701c4135b543 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.724027 Aug 29 04:52:49.705206 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 382/668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:48 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:49.721165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d9b3a044-a0fc-4f7b-8b49-8a202f42bce2 req-85e4cfbf-6860-41d2-a86e-fdcf098379a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41720f63-3f39-4147-8868-b95777a61445", "tag": "5abe974e-ded5-492a-a97f-ae98fbaccab4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:49.737229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d9b3a044-a0fc-4f7b-8b49-8a202f42bce2 req-85e4cfbf-6860-41d2-a86e-fdcf098379a0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:49.740309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d9b3a044-a0fc-4f7b-8b49-8a202f42bce2 req-85e4cfbf-6860-41d2-a86e-fdcf098379a0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:49.744756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d9b3a044-a0fc-4f7b-8b49-8a202f42bce2 req-85e4cfbf-6860-41d2-a86e-fdcf098379a0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:49.765527 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d9b3a044-a0fc-4f7b-8b49-8a202f42bce2 req-85e4cfbf-6860-41d2-a86e-fdcf098379a0 service nova] Creating event network-changed:5abe974e-ded5-492a-a97f-ae98fbaccab4 for instance 41720f63-3f39-4147-8868-b95777a61445 on n-h2-854119-9 Aug 29 04:52:49.779822 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d9b3a044-a0fc-4f7b-8b49-8a202f42bce2 req-85e4cfbf-6860-41d2-a86e-fdcf098379a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072862 Aug 29 04:52:49.781028 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 383/669] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:49.792668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:49.797187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:49.811433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:49.814244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:49.814897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:49.815830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:49.819267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:49.820105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:49.842257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 04:52:50.080870 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-27bba43e-6179-4b86-907e-fa116ab24aef tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.523746 Aug 29 04:52:50.089416 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 287/670] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 04:52:49 2022] GET /compute/v2.1/servers => generated 1666 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:50.094790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7b322d95-2002-428c-bcac-1c6753e9b77b req-3d364fc8-4ce6-4c06-ad5e-e28621dc7825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b8c9c9-249d-412e-86ca-35d59cbdd971", "tag": "71d3554f-991d-4013-bd32-c59c58bd7bf3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:50.105767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7b322d95-2002-428c-bcac-1c6753e9b77b req-3d364fc8-4ce6-4c06-ad5e-e28621dc7825 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.106279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7b322d95-2002-428c-bcac-1c6753e9b77b req-3d364fc8-4ce6-4c06-ad5e-e28621dc7825 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.106687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7b322d95-2002-428c-bcac-1c6753e9b77b req-3d364fc8-4ce6-4c06-ad5e-e28621dc7825 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:50.118762 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7b322d95-2002-428c-bcac-1c6753e9b77b req-3d364fc8-4ce6-4c06-ad5e-e28621dc7825 service nova] Creating event network-changed:71d3554f-991d-4013-bd32-c59c58bd7bf3 for instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 on n-h1-854119-9 Aug 29 04:52:50.124010 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7b322d95-2002-428c-bcac-1c6753e9b77b req-3d364fc8-4ce6-4c06-ad5e-e28621dc7825 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033397 Aug 29 04:52:50.125070 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 288/671] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:50.130409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-afc0462d-20b2-4ac2-a919-ea7aef8e581a req-e7f5ab4a-496c-462d-bb0f-5f1678eac1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e4c604-f8ec-4543-87ae-906f5e0fbb2f", "name": "network-vif-plugged", "status": "completed", "tag": "a629769f-7290-46cd-9c9d-933b910b2c27"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:50.141148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-afc0462d-20b2-4ac2-a919-ea7aef8e581a req-e7f5ab4a-496c-462d-bb0f-5f1678eac1b2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.141630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-afc0462d-20b2-4ac2-a919-ea7aef8e581a req-e7f5ab4a-496c-462d-bb0f-5f1678eac1b2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.142062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-afc0462d-20b2-4ac2-a919-ea7aef8e581a req-e7f5ab4a-496c-462d-bb0f-5f1678eac1b2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:50.157271 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-afc0462d-20b2-4ac2-a919-ea7aef8e581a req-e7f5ab4a-496c-462d-bb0f-5f1678eac1b2 service nova] Creating event network-vif-plugged:a629769f-7290-46cd-9c9d-933b910b2c27 for instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f on n-h2-854119-9 Aug 29 04:52:50.162953 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-afc0462d-20b2-4ac2-a919-ea7aef8e581a req-e7f5ab4a-496c-462d-bb0f-5f1678eac1b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036448 Aug 29 04:52:50.167582 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 289/672] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:50.173886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:50.174685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:50.181997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.182246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.182698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:50.183409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.184051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.184549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:50.287227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:50.296702 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f9553522-d59d-4d41-96dd-6ffaba66fad6 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1388 microversion: 2.1 time: 0.513026 Aug 29 04:52:50.298128 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 384/673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:49 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1388 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:50.314541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:50.317168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:50.333019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.333909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.337294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:50.337884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.340295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.341009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:50.503235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:50.529077 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ef44fa6-5ad7-435b-9fa5-c766cd04b535 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1223 microversion: 2.1 time: 0.229578 Aug 29 04:52:50.529762 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 385/674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:50 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1223 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:50.538010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:50.550418 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b99aa52c-412c-47e1-a0de-0350c4d21f9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.381352 Aug 29 04:52:50.563509 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 290/675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:50 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:50.566518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:50.567488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:50.574502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.575300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.575953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:50.576871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.577479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.578079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:50.728037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:50.729099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:50.736335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.737211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.737838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:50.738777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:50.739506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:50.743942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:51.077228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:51.095174 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5d6535c4-588d-4cea-8073-4d8de99eb781 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.533216 Aug 29 04:52:51.112061 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 386/676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:50 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:51.175165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-317161832", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "a8766693-25d9-4aae-b9cf-1bcb5ffe843b"}], "security_groups": [{"name": "tempest-securitygroup--1725291328"}], "key_name": "tempest-keypair-890935324", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:51.270274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:51.280425 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15004c1b-00e7-4825-89c6-efbb04c88d71 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.557251 Aug 29 04:52:51.294619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 291/677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:50 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:51.323203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:51.326574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:51.341352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:51.341849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:51.342283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:51.345992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:51.346494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:51.351143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:51.394210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] validate_networks() for [('a8766693-25d9-4aae-b9cf-1bcb5ffe843b', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:52:51.762408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:51.773667 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6aa5f7f9-f133-4946-a3c8-87cc82b7368f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1388 microversion: 2.1 time: 0.457783 Aug 29 04:52:51.789785 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 292/678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:51 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1388 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:51.795026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:51.795981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:51.807767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:51.811074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:51.811753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:51.814645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:51.815359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:51.816049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:52.247071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:52.257818 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7f4dd6a8-9803-4886-a16b-b8b1aa2cf0dc tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1223 microversion: 2.1 time: 0.466627 Aug 29 04:52:52.259352 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 293/679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:51 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1223 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:52.264751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:52.265662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:52.272967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:52.273777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:52.274452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:52.276543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:52.277228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:52.278288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:52.785089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:52.904683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:52.912715 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-81e505d5-ceb8-4e26-8aef-a6bb87bd765d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.651779 Aug 29 04:52:52.926033 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 294/680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:52 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:52.939737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:52.940641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:52.954880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:52.956746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:52.957641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:52.959979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:52.960932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:52.961516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:53.242498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:52:53.243429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:52:53.244073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:52:53.244324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:52:53.244946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:52:53.264864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:53.265629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:53.266243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:53.266976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:53.267446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:53.267876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:53.268666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:53.282088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d700f0b3-7283-4ca0-ab9e-c6f8f71b747b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.360206 Aug 29 04:52:53.284918 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 295/681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:52 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:53.309715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-289bf74e-e2d1-4514-8850-1c21262402d1 req-0859780c-22bd-4ec1-8f18-10419d260ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b208f5-b156-40d9-abb8-1cc1a0f0f348", "name": "network-vif-unplugged", "status": "completed", "tag": "f5871f66-d98c-45e7-82d7-a580d66552bd"}, {"name": "network-changed", "server_uuid": "74b208f5-b156-40d9-abb8-1cc1a0f0f348", "tag": "f5871f66-d98c-45e7-82d7-a580d66552bd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:53.310465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for project 2864fc0a731f4945a27e68889572000f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:52:53.316862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for user 62ea00a8210b4ede95e54c53e7445794 and project 2864fc0a731f4945a27e68889572000f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:52:53.333697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-289bf74e-e2d1-4514-8850-1c21262402d1 req-0859780c-22bd-4ec1-8f18-10419d260ae3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:53.334210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-289bf74e-e2d1-4514-8850-1c21262402d1 req-0859780c-22bd-4ec1-8f18-10419d260ae3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:53.334617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-289bf74e-e2d1-4514-8850-1c21262402d1 req-0859780c-22bd-4ec1-8f18-10419d260ae3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:53.335403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:52:53.338875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:52:53.361867 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-289bf74e-e2d1-4514-8850-1c21262402d1 req-0859780c-22bd-4ec1-8f18-10419d260ae3 service nova] Creating event network-vif-unplugged:f5871f66-d98c-45e7-82d7-a580d66552bd for instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 on n-h1-854119-9 Aug 29 04:52:53.368732 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-289bf74e-e2d1-4514-8850-1c21262402d1 req-0859780c-22bd-4ec1-8f18-10419d260ae3 service nova] Creating event network-changed:f5871f66-d98c-45e7-82d7-a580d66552bd for instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 on n-h1-854119-9 Aug 29 04:52:53.376585 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-289bf74e-e2d1-4514-8850-1c21262402d1 req-0859780c-22bd-4ec1-8f18-10419d260ae3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.090011 Aug 29 04:52:53.379987 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 296/682] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:53.407088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:53.407804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:53.422276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:53.424237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:53.425526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:53.427028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:53.428702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:53.428841 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59ad55c8-c984-4fb4-a6cf-0828c1f1adb6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.256452 Aug 29 04:52:53.431778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:53.436920 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 387/683] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 04:52:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 2267 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 04:52:53.447417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:53.448165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:53.458099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:53.458661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:53.459095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:53.459855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:53.460335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:53.460981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:54.459513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:54.473497 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee7fef14-b61e-4782-9ee4-2e7672829cd3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 1.092008 Aug 29 04:52:54.475880 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 297/684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:53 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:54.487363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:54.489233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:54.499899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:54.507306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:54.508039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:54.509048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:54.509791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:54.510414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:54.624529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:54.650809 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c7148255-1a3f-4e63-b0c1-6660d38f196c tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1388 microversion: 2.1 time: 1.212524 Aug 29 04:52:54.656355 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 388/685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:53 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1388 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:54.670761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:54.671914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:54.691763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:54.692899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:54.695520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:54.699251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:54.699977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:54.702566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:54.702990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:54.717309 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aec22f38-c729-4b06-9885-bba4d582a5c6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1271 microversion: 2.1 time: 0.239929 Aug 29 04:52:54.718024 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 298/686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:54 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:54.730585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:54.731480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:54.746259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:54.746972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:54.747575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:54.748474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:54.749120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:54.749702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:54.974042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:55.002586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:55.006988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:55.017778 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80da4f19-a07f-4db0-9a56-31b88051bfa7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1336 microversion: 2.25 time: 0.360000 Aug 29 04:52:55.022462 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 389/687] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:54 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1336 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:55.029747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:55.037205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:55.047790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:55.048873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:55.050431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:55.054006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:55.054801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:55.055239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:55.180855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:55.196413 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-427f2867-4cfd-4f6b-9c96-704bddb3e194 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.476976 Aug 29 04:52:55.197334 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 299/688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:54 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:55.203369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-48b53ddf-9cd2-40d7-a57f-bafc02899188 req-2d57e641-ea26-4a93-b9bf-ca2375b20918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50354b59-597b-4592-aab3-4b1fcd07d8bb", "name": "network-vif-plugged", "status": "completed", "tag": "c7c220d0-79d0-42ef-a221-b6dd9107c608"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:55.226205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-48b53ddf-9cd2-40d7-a57f-bafc02899188 req-2d57e641-ea26-4a93-b9bf-ca2375b20918 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:55.227179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-48b53ddf-9cd2-40d7-a57f-bafc02899188 req-2d57e641-ea26-4a93-b9bf-ca2375b20918 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:55.227773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-48b53ddf-9cd2-40d7-a57f-bafc02899188 req-2d57e641-ea26-4a93-b9bf-ca2375b20918 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:55.251101 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-48b53ddf-9cd2-40d7-a57f-bafc02899188 req-2d57e641-ea26-4a93-b9bf-ca2375b20918 service nova] Creating event network-vif-plugged:c7c220d0-79d0-42ef-a221-b6dd9107c608 for instance 50354b59-597b-4592-aab3-4b1fcd07d8bb on n-h1-854119-9 Aug 29 04:52:55.267282 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-48b53ddf-9cd2-40d7-a57f-bafc02899188 req-2d57e641-ea26-4a93-b9bf-ca2375b20918 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068503 Aug 29 04:52:55.268221 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 300/689] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:55.499733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:55.503217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:55.525522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:55.528011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:55.529194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:55.530311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:55.530947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:55.531703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:56.269166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:56.271481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:56.280264 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-10181ff9-5e5d-415e-a873-10ba608319ac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.788808 Aug 29 04:52:56.284769 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f33baeeb-65bc-4a1e-9b05-80fa9d5062be tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 1.259671 Aug 29 04:52:56.299685 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 301/690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:55 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:56.307011 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 390/691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:55 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:56.310350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:56.311209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:56.331983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:56.332511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:56.332989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:56.333700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:56.334153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:56.334569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:56.335434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:56.337226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:56.372633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:56.377930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:56.378388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:56.383643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:56.384199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:56.384642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:56.552491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:56.567205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba6bac87-e31d-46a4-8271-32ea7a23435a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1289 microversion: 2.1 time: 0.255341 Aug 29 04:52:56.568447 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 391/692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:56 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1289 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:56.573853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:56.574485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:56.581433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:56.582697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:56.583361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:56.584280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:56.585246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:56.585832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:56.590735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:56.700591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:56.711125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:56.711433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:56.713330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:56.714721 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-83978939-2d94-4aec-9283-8b01fdf15990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1342 microversion: 2.25 time: 0.145163 Aug 29 04:52:56.728205 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb824225-ff6c-4b32-ac61-d0c96c0f3670 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1388 microversion: 2.1 time: 0.426999 Aug 29 04:52:56.729025 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 392/693] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:56 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:56.732948 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 302/694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:56 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1388 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:56.764957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:56.766076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:56.793362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:56.793862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:56.794724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:56.795460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:56.795910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:56.796359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.077943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:57.088644 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11297cb4-20b1-4c65-92c6-82e4eda28096 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.357618 Aug 29 04:52:57.102874 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 393/695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:56 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:57.306636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:57.307258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:57.314638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.315124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.315540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.322021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.322483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.322917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.326604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:57.327397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:57.337228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.339470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.340734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.344813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.345417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.345994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.346298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:57.609163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:57.617812 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b38ea79-44de-4c09-ae2a-a26b749922eb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.315137 Aug 29 04:52:57.619236 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 303/696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:57 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:57.624205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:57.624994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:57.630817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.631302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.631800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.632702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.633426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.634270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.688732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:57.697201 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-493cbec9-ce7e-46c3-8559-b6ab96bd1243 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.375038 Aug 29 04:52:57.698080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 394/697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:57 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:57.719129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ef23af75-407c-4358-9fc9-46c73979ca6a req-68783e08-2396-4fde-ab76-434cc8d1d7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accfa42e-7428-47a8-a6da-7594c2ebe80e", "tag": "414f3c57-c1ce-484b-b358-b628484b7d89"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:57.730964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ef23af75-407c-4358-9fc9-46c73979ca6a req-68783e08-2396-4fde-ab76-434cc8d1d7bb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.731685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ef23af75-407c-4358-9fc9-46c73979ca6a req-68783e08-2396-4fde-ab76-434cc8d1d7bb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.735422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:57.739068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ef23af75-407c-4358-9fc9-46c73979ca6a req-68783e08-2396-4fde-ab76-434cc8d1d7bb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.748454 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8d516e8e-0223-4349-9dc9-f71bbe2b9ae1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1277 microversion: 2.1 time: 0.127838 Aug 29 04:52:57.749582 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 304/698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:57 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:57.756020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:57.756856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:57.757530 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ef23af75-407c-4358-9fc9-46c73979ca6a req-68783e08-2396-4fde-ab76-434cc8d1d7bb service nova] Creating event network-changed:414f3c57-c1ce-484b-b358-b628484b7d89 for instance accfa42e-7428-47a8-a6da-7594c2ebe80e on n-h1-854119-9 Aug 29 04:52:57.766299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.767443 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ef23af75-407c-4358-9fc9-46c73979ca6a req-68783e08-2396-4fde-ab76-434cc8d1d7bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052109 Aug 29 04:52:57.767591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.768085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.769334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.769958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.770547 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 395/699] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:57.770819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.779378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:57.780166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:57.786590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.787084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.787512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:57.793689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:57.794363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:57.794962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:58.020483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:58.030579 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3f9ab659-55bb-4248-af3c-3099c02e65ca tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1388 microversion: 2.1 time: 0.258261 Aug 29 04:52:58.049504 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 396/700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:57 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1388 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:58.097582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:58.107380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:58.111194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:58.111838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:58.114892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:58.116315 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3cf6e034-7eb8-4a4d-b0e5-6834f214a0b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.365523 Aug 29 04:52:58.118632 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 305/701] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:57 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:58.122426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:58.123117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:58.123328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:58.124037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:58.124695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:58.124936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:58.421749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:58.432711 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b2cb2f7-093f-4db9-be46-e5f123a492a1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.325665 Aug 29 04:52:58.433809 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 397/702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:58 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:58.644977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:58.645891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:58.654998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:58.655741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:58.656349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:58.657209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:58.657810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:58.658406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:58.724647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:58.725877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:58.733864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:58.734345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:58.734776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:58.735486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:58.736146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:58.736575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:58.892442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:58.904329 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fe915780-d441-4834-acba-56075e8f0c09 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.264618 Aug 29 04:52:58.921446 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 306/703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:58 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:58.926577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:58.927401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:58.931683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=22 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:58.935465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:58.936154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:58.936731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:58.937613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:58.938211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:58.938771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:58.951542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:58.967064 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5817839-b001-40da-9a39-dbb0c8dcff06 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.251748 Aug 29 04:52:58.968301 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 398/704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:58 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:59.053685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:59.054583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:59.065267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.065760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.069105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:59.070123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.073077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.074747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:59.353271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:59.365328 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e3843619-d547-40c2-b914-066885236e2e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1586 microversion: 2.1 time: 0.317669 Aug 29 04:52:59.380680 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 399/705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:59 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1586 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:52:59.387893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:59.388755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:59.389105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:59.397128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.397873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.398669 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c9d2054d-e6ed-4622-a462-d03882ae4441 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.475217 Aug 29 04:52:59.399187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:59.399567 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 307/706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:58 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:52:59.400509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.401173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.401799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:59.580693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:59.590455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39df9f31-131a-48c0-a833-db69ac787fbd tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] Calling method '.version_select at 0x7f1ab99da160>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:59.591001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:59.593056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:52:59.594301 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa8e1f2b-5220-4c4d-99d1-cf6c69a8173c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.212123 Aug 29 04:52:59.603050 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 400/707] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:52:59 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:52:59.603050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fdee7368-be5f-4879-a32d-38e7a9868723 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:59.603050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fdee7368-be5f-4879-a32d-38e7a9868723 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:59.607180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdee7368-be5f-4879-a32d-38e7a9868723 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.607785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdee7368-be5f-4879-a32d-38e7a9868723 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.608377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdee7368-be5f-4879-a32d-38e7a9868723 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:59.610320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdee7368-be5f-4879-a32d-38e7a9868723 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.610320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdee7368-be5f-4879-a32d-38e7a9868723 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.610320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdee7368-be5f-4879-a32d-38e7a9868723 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:59.657091 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39df9f31-131a-48c0-a833-db69ac787fbd tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.256052 Aug 29 04:52:59.669478 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 308/708] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 29 04:52:59 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:52:59.675135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:59.675860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:59.684521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.685022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.685461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:59.686181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.686639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.687666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:59.715346 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fdee7368-be5f-4879-a32d-38e7a9868723 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118751 Aug 29 04:52:59.716186 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 401/709] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 04:52:59 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:52:59.720875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b7c32231-41f9-4e28-a34f-cf7f134ab027 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] Action: 'create', calling method: .version_select at 0x7f1ab99f20d0>, body: {"pool": "non_exist_pool"} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:52:59.724287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:52:59.823119 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-b7c32231-41f9-4e28-a34f-cf7f134ab027 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] HTTP exception thrown: Floating IP pool not found. Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b7c32231-41f9-4e28-a34f-cf7f134ab027 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] Request method failure captured: Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 26 Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEYr-YY_Q2mbiwLmbOJVOfS-2lOZh8dQ7YDXlAeptvGOlGh5HtfVChcxMGwp4IvrITtW-uEbqD5i2DinozeGfR49qeswbkLlM6qjCVy3HnfvkJICxdq3kk-esa8edQvVt7o5hccNjvEetmKFUr3-bQnW28A5rCGu9oaoIIe4WqMII3E Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 8f097866428447eeb2325ec57209154e Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1303246133 Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:52:59.825556 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f097866428447eeb2325ec57209154e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f097866428447eeb2325ec57209154e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f097866428447eeb2325ec57209154e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f097866428447eeb2325ec57209154e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1303246133 Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 8f097866428447eeb2325ec57209154e Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1303246133 Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FloatingIPsNegativeTestJSON-1303246133-project Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 73600d89e9f1414b96aad93e87ea369c Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1303246133-project Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: {"pool": "non_exist_pool"} Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: exception: Floating IP pool not found. Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 29 04:52:59.826891 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:59.827938 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 29 04:52:59.829506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.832480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b7c32231-41f9-4e28-a34f-cf7f134ab027 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] Returning 404 to user: Floating IP pool not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:59.833843 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b7c32231-41f9-4e28-a34f-cf7f134ab027 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.116623 Aug 29 04:52:59.835044 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 402/710] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 04:52:59 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:52:59.846224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71a37049-0c58-445a-a1ea-1236aacc5656 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] Calling method '.version_select at 0x7f1ab98cdf70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:59.953274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-71a37049-0c58-445a-a1ea-1236aacc5656 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7d90911d-215b-41b3-b17b-d66e7f34a6b0 could not be found", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 04:52:59.954264 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-71a37049-0c58-445a-a1ea-1236aacc5656 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] HTTP exception thrown: Floating IP not found for ID 7d90911d-215b-41b3-b17b-d66e7f34a6b0 Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71a37049-0c58-445a-a1ea-1236aacc5656 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] Request method failure captured: Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-floating-ips/7d90911d-215b-41b3-b17b-d66e7f34a6b0 HTTP/1.1 Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEYr-YY_Q2mbiwLmbOJVOfS-2lOZh8dQ7YDXlAeptvGOlGh5HtfVChcxMGwp4IvrITtW-uEbqD5i2DinozeGfR49qeswbkLlM6qjCVy3HnfvkJICxdq3kk-esa8edQvVt7o5hccNjvEetmKFUr3-bQnW28A5rCGu9oaoIIe4WqMII3E Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 8f097866428447eeb2325ec57209154e Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1303246133 Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:52:59.956096 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f097866428447eeb2325ec57209154e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f097866428447eeb2325ec57209154e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f097866428447eeb2325ec57209154e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f097866428447eeb2325ec57209154e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1303246133 Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 8f097866428447eeb2325ec57209154e Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1303246133 Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FloatingIPsNegativeTestJSON-1303246133-project Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 73600d89e9f1414b96aad93e87ea369c Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1303246133-project Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: exception: Floating IP not found for ID 7d90911d-215b-41b3-b17b-d66e7f34a6b0 Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7d90911d-215b-41b3-b17b-d66e7f34a6b0'} Aug 29 04:52:59.957801 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 04:52:59.958754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7d90911d-215b-41b3-b17b-d66e7f34a6b0 could not be found Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7335607a-35c2-456c-9bdf-bf92178c80a3'] Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7d90911d-215b-41b3-b17b-d66e7f34a6b0. Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:59.968379 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7d90911d-215b-41b3-b17b-d66e7f34a6b0 Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:52:59.970002 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:52:59.971394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7d90911d-215b-41b3-b17b-d66e7f34a6b0 Aug 29 04:52:59.971394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:52:59.971394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71a37049-0c58-445a-a1ea-1236aacc5656 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] Returning 404 to user: Floating IP not found for ID 7d90911d-215b-41b3-b17b-d66e7f34a6b0 {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:52:59.971394 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71a37049-0c58-445a-a1ea-1236aacc5656 tempest-FloatingIPsNegativeTestJSON-1303246133 tempest-FloatingIPsNegativeTestJSON-1303246133-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/7d90911d-215b-41b3-b17b-d66e7f34a6b0" status: 404 len: 111 microversion: 2.1 time: 0.116388 Aug 29 04:52:59.971394 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 403/711] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 04:52:59 2022] DELETE /compute/v2.1/os-floating-ips/7d90911d-215b-41b3-b17b-d66e7f34a6b0 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:52:59.971394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:52:59.972578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:52:59.979340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.979547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.980293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:52:59.980637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:52:59.984578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:52:59.990795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:00.257085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:00.295540 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d1245815-7bd1-4b55-a5a6-10b3cf919b57 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.624102 Aug 29 04:53:00.298246 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 309/712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:59 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:00.327157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:00.328036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:00.337259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:00.338246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:00.339882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:00.340941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:00.341643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:00.343047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:00.554468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:00.563935 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4239d57c-94df-4376-8e91-f91d2fc3424a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.603653 Aug 29 04:53:00.564890 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 404/713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:52:59 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:00.570429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ed7c8a86-c0bb-4742-8c5e-8a4be51f6a46 req-f1286727-4431-4950-bad4-cee37f5519c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b14f0ef-853d-4876-888d-045a86ffd64a", "tag": "cb07cff6-85cd-45cb-b12a-e416d047ddfb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:00.581766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ed7c8a86-c0bb-4742-8c5e-8a4be51f6a46 req-f1286727-4431-4950-bad4-cee37f5519c9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:00.583138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ed7c8a86-c0bb-4742-8c5e-8a4be51f6a46 req-f1286727-4431-4950-bad4-cee37f5519c9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:00.583792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ed7c8a86-c0bb-4742-8c5e-8a4be51f6a46 req-f1286727-4431-4950-bad4-cee37f5519c9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:00.603133 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ed7c8a86-c0bb-4742-8c5e-8a4be51f6a46 req-f1286727-4431-4950-bad4-cee37f5519c9 service nova] Creating event network-changed:cb07cff6-85cd-45cb-b12a-e416d047ddfb for instance 1b14f0ef-853d-4876-888d-045a86ffd64a on n-h1-854119-9 Aug 29 04:53:00.608326 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ed7c8a86-c0bb-4742-8c5e-8a4be51f6a46 req-f1286727-4431-4950-bad4-cee37f5519c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041545 Aug 29 04:53:00.609009 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 405/714] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:00.618110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:00.618801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:00.625168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:00.625831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:00.626259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:00.626955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:00.627449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:00.627992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:00.788566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:00.796506 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-864f6d37-eb63-418d-a30e-a5aedde28f37 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1476 microversion: 2.1 time: 0.496522 Aug 29 04:53:00.797079 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 310/715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:00 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:00.801995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:00.802808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:00.808813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:00.809304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:00.809913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:00.812969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:00.813630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:00.814062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:01.463390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:01.483619 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-31da5dcb-92cc-4a1d-825b-48fc542c9bc5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.869523 Aug 29 04:53:01.488266 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 406/716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:00 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:01.501030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:01.502127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:01.509327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:01.510139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:01.510716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:01.511563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:01.512425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:01.513008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:01.856369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:01.866252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:01.868506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:01.869841 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3278b808-b392-4223-b057-58be110215b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 1.071661 Aug 29 04:53:01.871004 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 311/717] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:00 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:53:01.876967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:01.877823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:01.886765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:01.887289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:01.887749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:01.888731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:01.889193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:01.889629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:02.155635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:02.163467 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-104bbc01-19c5-4a51-bbed-b05b83bcd8da tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.673897 Aug 29 04:53:02.164059 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 407/718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:01 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:02.181879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:02.182624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:02.193436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:02.193934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:02.194384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:02.195078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:02.195526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:02.196153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:02.404426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:02.413688 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1633670f-8627-4bff-bf3e-66482846182a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.541472 Aug 29 04:53:02.417480 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 312/719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:01 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:02.422124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-181cff31-c052-4249-a2b5-c2df0206596e req-e942bede-cdf2-428e-88f9-6bac6b5c1b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41720f63-3f39-4147-8868-b95777a61445", "name": "network-vif-plugged", "status": "completed", "tag": "5abe974e-ded5-492a-a97f-ae98fbaccab4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:02.447679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-181cff31-c052-4249-a2b5-c2df0206596e req-e942bede-cdf2-428e-88f9-6bac6b5c1b56 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:02.448471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-181cff31-c052-4249-a2b5-c2df0206596e req-e942bede-cdf2-428e-88f9-6bac6b5c1b56 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:02.449482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-181cff31-c052-4249-a2b5-c2df0206596e req-e942bede-cdf2-428e-88f9-6bac6b5c1b56 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:02.472182 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-181cff31-c052-4249-a2b5-c2df0206596e req-e942bede-cdf2-428e-88f9-6bac6b5c1b56 service nova] Creating event network-vif-plugged:5abe974e-ded5-492a-a97f-ae98fbaccab4 for instance 41720f63-3f39-4147-8868-b95777a61445 on n-h2-854119-9 Aug 29 04:53:02.480615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-181cff31-c052-4249-a2b5-c2df0206596e req-e942bede-cdf2-428e-88f9-6bac6b5c1b56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061697 Aug 29 04:53:02.482857 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 313/720] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:02.529094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:02.529873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:02.537711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:02.538214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:02.538650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:02.539351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:02.539985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:02.540589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:03.253654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:03.269717 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2376bedd-b280-4f57-a07a-bb51193b00cb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1475 microversion: 2.1 time: 1.091588 Aug 29 04:53:03.271945 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 408/721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:02 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1475 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:03.281473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-015f1994-33dc-4755-aa17-7280987dd30c req-95f930ca-3170-4a15-aa70-828dad08199b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419bf8df-33bd-47c9-beb5-4398ea8db81f", "tag": "04cfbf0e-aa49-41f9-ac96-1e1c42605e9a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:03.293662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:03.296988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-015f1994-33dc-4755-aa17-7280987dd30c req-95f930ca-3170-4a15-aa70-828dad08199b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:03.297882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-015f1994-33dc-4755-aa17-7280987dd30c req-95f930ca-3170-4a15-aa70-828dad08199b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:03.298700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-015f1994-33dc-4755-aa17-7280987dd30c req-95f930ca-3170-4a15-aa70-828dad08199b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:03.317271 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-015f1994-33dc-4755-aa17-7280987dd30c req-95f930ca-3170-4a15-aa70-828dad08199b service nova] Creating event network-changed:04cfbf0e-aa49-41f9-ac96-1e1c42605e9a for instance 419bf8df-33bd-47c9-beb5-4398ea8db81f on n-h2-854119-9 Aug 29 04:53:03.325837 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-015f1994-33dc-4755-aa17-7280987dd30c req-95f930ca-3170-4a15-aa70-828dad08199b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051530 Aug 29 04:53:03.327667 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 409/722] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:03.337269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:03.339192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:03.346606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=20 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:03.350302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:03.351397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:03.352949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:03.354482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:03.355295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:03.356219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:03.456792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:03.465665 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d266a7d-8069-4ceb-9ae4-923db0197da6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.957739 Aug 29 04:53:03.466798 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 314/723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:02 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:03.478890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:03.479729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:03.499812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:03.505437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:03.506087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:03.506936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:03.507502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:03.508036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:04.049126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:04.059708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:04.065767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:04.066964 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-12ae1b30-f6f3-4bf8-a9b0-9f90e790d73e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.736024 Aug 29 04:53:04.069882 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 410/724] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:03 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:53:04.079732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:04.080815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:04.098239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:04.100777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:04.101223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:04.103744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:04.104457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:04.104652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:04.321212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:04.333300 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-838e68cc-04b2-4fce-9857-99d0576434e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1311 microversion: 2.1 time: 0.864535 Aug 29 04:53:04.333873 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 315/725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:03 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1311 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:04.348722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:04.349369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:04.357911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:04.358408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:04.358842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:04.367548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:04.368311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:04.368904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.292057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:05.304349 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee0f3331-3c7b-4b27-8399-9ffcb9934cbc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 1.233159 Aug 29 04:53:05.308298 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 411/726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:04 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:05.314676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:05.315899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:05.323186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.323871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.324497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.325380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.325982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.326697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.379377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:05.387147 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-19322b10-3193-4779-9e7a-ad7350c4a15e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1475 microversion: 2.1 time: 1.052238 Aug 29 04:53:05.401328 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 316/727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:04 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1475 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:05.407323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-aaa4ed56-229e-4420-a551-24c13bcd1306 req-e2968a71-566a-4d51-8579-6fab178c1222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50354b59-597b-4592-aab3-4b1fcd07d8bb", "tag": "c7c220d0-79d0-42ef-a221-b6dd9107c608"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:05.417422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-aaa4ed56-229e-4420-a551-24c13bcd1306 req-e2968a71-566a-4d51-8579-6fab178c1222 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.418129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-aaa4ed56-229e-4420-a551-24c13bcd1306 req-e2968a71-566a-4d51-8579-6fab178c1222 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.418709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-aaa4ed56-229e-4420-a551-24c13bcd1306 req-e2968a71-566a-4d51-8579-6fab178c1222 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.431074 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-aaa4ed56-229e-4420-a551-24c13bcd1306 req-e2968a71-566a-4d51-8579-6fab178c1222 service nova] Creating event network-changed:c7c220d0-79d0-42ef-a221-b6dd9107c608 for instance 50354b59-597b-4592-aab3-4b1fcd07d8bb on n-h1-854119-9 Aug 29 04:53:05.437459 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-aaa4ed56-229e-4420-a551-24c13bcd1306 req-e2968a71-566a-4d51-8579-6fab178c1222 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034519 Aug 29 04:53:05.438276 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 317/728] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:05.444591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:05.445347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:05.451610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.452098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.452794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.453823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.454437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.455038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.672487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:05.685370 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ec255e1d-42eb-46b5-84d4-1d04ec6ddc01 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1586 microversion: 2.1 time: 0.375904 Aug 29 04:53:05.686557 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 412/729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:05 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1586 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:05.691898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5aa30ab0-16c4-4710-b780-171ab9bf483d req-2a331694-fc24-47fe-90a0-77b6da60e87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9c6427-61b8-4bc8-8916-7f16bfab3481", "name": "network-vif-unplugged", "status": "completed", "tag": "d1e67a19-a229-4469-8585-f4f9bb1b7a2f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:05.702135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5aa30ab0-16c4-4710-b780-171ab9bf483d req-2a331694-fc24-47fe-90a0-77b6da60e87f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.702848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5aa30ab0-16c4-4710-b780-171ab9bf483d req-2a331694-fc24-47fe-90a0-77b6da60e87f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.703783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5aa30ab0-16c4-4710-b780-171ab9bf483d req-2a331694-fc24-47fe-90a0-77b6da60e87f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.708634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:05.718549 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5aa30ab0-16c4-4710-b780-171ab9bf483d req-2a331694-fc24-47fe-90a0-77b6da60e87f service nova] Creating event network-vif-unplugged:d1e67a19-a229-4469-8585-f4f9bb1b7a2f for instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 on n-h1-854119-9 Aug 29 04:53:05.727222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-5aa30ab0-16c4-4710-b780-171ab9bf483d req-2a331694-fc24-47fe-90a0-77b6da60e87f service nova] Instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:53:05.739059 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5aa30ab0-16c4-4710-b780-171ab9bf483d req-2a331694-fc24-47fe-90a0-77b6da60e87f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050535 Aug 29 04:53:05.739990 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 413/730] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:05.745262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:05.745953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:05.752474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.753205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.753646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.754395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.754849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.755273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.765667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:05.773711 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c43a07d4-95ac-413f-b9cc-a42496d8cb7f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.333320 Aug 29 04:53:05.780199 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 318/731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:05 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:05.780199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:05.780199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:05.793776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.794523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.795112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:05.795996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:05.796705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:05.797282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.046706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:06.055198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:06.056850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:06.058050 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3287f5b1-836f-4316-955d-469614dd412d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.316912 Aug 29 04:53:06.058707 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 414/732] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:05 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:53:06.070505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:06.076416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-85f96750-c79e-41d3-9e9b-886ae1eaf58f req-fe606dd6-e051-4f81-8f69-9dbb0feb256d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9c6427-61b8-4bc8-8916-7f16bfab3481", "tag": "d1e67a19-a229-4469-8585-f4f9bb1b7a2f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:06.079462 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95317174-d55b-453b-a289-b46984f203a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1461 microversion: 2.1 time: 0.303737 Aug 29 04:53:06.080100 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 319/733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:05 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1461 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:06.086800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-85f96750-c79e-41d3-9e9b-886ae1eaf58f req-fe606dd6-e051-4f81-8f69-9dbb0feb256d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.087354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-85f96750-c79e-41d3-9e9b-886ae1eaf58f req-fe606dd6-e051-4f81-8f69-9dbb0feb256d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.087846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-85f96750-c79e-41d3-9e9b-886ae1eaf58f req-fe606dd6-e051-4f81-8f69-9dbb0feb256d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.099662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:06.099946 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-85f96750-c79e-41d3-9e9b-886ae1eaf58f req-fe606dd6-e051-4f81-8f69-9dbb0feb256d service nova] Creating event network-changed:d1e67a19-a229-4469-8585-f4f9bb1b7a2f for instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 on n-h1-854119-9 Aug 29 04:53:06.100409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:06.106051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-85f96750-c79e-41d3-9e9b-886ae1eaf58f req-fe606dd6-e051-4f81-8f69-9dbb0feb256d service nova] Instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:53:06.106922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.107402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.107828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.108554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.109001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.109420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.117488 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-85f96750-c79e-41d3-9e9b-886ae1eaf58f req-fe606dd6-e051-4f81-8f69-9dbb0feb256d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057573 Aug 29 04:53:06.118351 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 415/734] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:06.303428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:06.311568 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0b239658-a9ae-418e-9b4d-40dbfd250c0e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1464 microversion: 2.1 time: 0.215685 Aug 29 04:53:06.312098 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 320/735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:06 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:06.326200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:06.327128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:06.335212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.335702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.336153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.336992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.337619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.338070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.409364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:06.411127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:06.423231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.423733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.426587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.427362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.427836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.428999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.511400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:06.523590 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-19911290-a0c2-48e1-8ae5-991ff3615ba2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.201596 Aug 29 04:53:06.525281 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 416/736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:06 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:06.534404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-628635122", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "10e4c604-f8ec-4543-87ae-906f5e0fbb2f"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:06.608055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:53:06.615232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:06.623591 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4fb8131-c551-41eb-bf72-fd52d526933e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1473 microversion: 2.1 time: 0.218383 Aug 29 04:53:06.639743 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 321/737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:06 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1473 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:06.794162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:06.794775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:06.802691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.803392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.804003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.805555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.806168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.806869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.811910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:06.849975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:53:06.850397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:53:06.850864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:53:06.851262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:53:06.851670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:53:06.861284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.861801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.862609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.863398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:06.863876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:06.864539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:06.884182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Getting quotas for project 13f1750a840a4c9e91529b3f71830c8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:53:06.889047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Getting quotas for user c02a1e5093784394a6dd23c5d5ff51d6 and project 13f1750a840a4c9e91529b3f71830c8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:53:06.917654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:53:06.920109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:53:06.976003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:06.980362 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-adf32e72-9894-4ba4-8062-81d415d8b1bc tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453495 Aug 29 04:53:06.981372 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 417/738] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:53:06.989689 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12564222-4414-46d2-817b-3d93ba5ae917 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.199388 Aug 29 04:53:06.993159 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 322/739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:06 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:06.994378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6c6901d0-2ed3-4930-8bc9-cb96a706d393 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:06.995059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c6901d0-2ed3-4930-8bc9-cb96a706d393 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:06.998329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:07.050586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6c6901d0-2ed3-4930-8bc9-cb96a706d393 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:07.057572 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6c6901d0-2ed3-4930-8bc9-cb96a706d393 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1213 microversion: 2.1 time: 0.069575 Aug 29 04:53:07.058556 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 418/740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:06 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:07.083613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:07.084418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:07.087915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:07.091477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:07.092073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:07.092876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:07.093783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:07.094430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:07.095274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:07.241821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:07.251444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:07.253145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:07.259311 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3fb0b096-86ec-40e0-8b11-bbe996a8797b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.182244 Aug 29 04:53:07.260096 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 323/741] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:07 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:53:07.550724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:07.552341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:07.560156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:07.560743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:07.561334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:07.562058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:07.562723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:07.563197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:07.648827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:07.650051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:07.668238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:07.672378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:07.673414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:07.674716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:07.675359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:07.676047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:07.955950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:07.964267 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2e5e07d2-faec-46cb-adcd-0ae6ae9a8de8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.418514 Aug 29 04:53:07.965153 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 419/742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:07 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:07.969751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-feb5f63e-d7e9-4d5f-8d3c-fee95f2a75b2 req-ac7394ab-9d68-47b8-8cab-cc1c95167b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accfa42e-7428-47a8-a6da-7594c2ebe80e", "name": "network-vif-plugged", "status": "completed", "tag": "414f3c57-c1ce-484b-b358-b628484b7d89"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:07.979147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-feb5f63e-d7e9-4d5f-8d3c-fee95f2a75b2 req-ac7394ab-9d68-47b8-8cab-cc1c95167b70 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:07.979627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-feb5f63e-d7e9-4d5f-8d3c-fee95f2a75b2 req-ac7394ab-9d68-47b8-8cab-cc1c95167b70 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:07.980046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-feb5f63e-d7e9-4d5f-8d3c-fee95f2a75b2 req-ac7394ab-9d68-47b8-8cab-cc1c95167b70 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:07.992059 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-feb5f63e-d7e9-4d5f-8d3c-fee95f2a75b2 req-ac7394ab-9d68-47b8-8cab-cc1c95167b70 service nova] Creating event network-vif-plugged:414f3c57-c1ce-484b-b358-b628484b7d89 for instance accfa42e-7428-47a8-a6da-7594c2ebe80e on n-h1-854119-9 Aug 29 04:53:07.999774 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-feb5f63e-d7e9-4d5f-8d3c-fee95f2a75b2 req-ac7394ab-9d68-47b8-8cab-cc1c95167b70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033308 Aug 29 04:53:08.000421 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 420/743] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:08.014371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:08.015370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:08.021986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:08.022468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:08.022900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:08.023655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:08.024104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:08.024543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:08.117290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:08.125496 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0134794b-28d2-45d2-9a9e-b4ee4f414df4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1473 microversion: 2.1 time: 0.483103 Aug 29 04:53:08.126035 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 324/744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:07 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1473 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:08.130690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:08.131414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:08.137429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:08.137917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:08.138348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:08.139059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:08.139499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:08.139970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:08.226352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:08.234364 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8959c09-9855-435c-a6ef-3d733b5f2ba0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1217 microversion: 2.1 time: 0.107168 Aug 29 04:53:08.235656 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 325/745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:08 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:08.279784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:08.283264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:08.284085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:08.290277 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e1258bec-363e-4861-8500-2090d4b3b153 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.280339 Aug 29 04:53:08.291481 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 421/746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:08 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:08.291702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:08.292515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:08.293164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:08.294232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:08.294954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:08.295684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:08.562399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:08.589446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:08.589446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:08.606984 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9f4e8226-2681-413e-a4a6-3f01794de9c0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.309390 Aug 29 04:53:08.612539 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 326/747] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:08 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:53:08.994994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:08.998005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:09.021179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.024277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.025204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.026355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.028526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.029882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.146866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:09.148099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:09.156421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.161841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.162496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.163433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.166358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.167399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.476606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:09.489309 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-257bf4a7-acd6-4eb4-a2d7-79c74b32705e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.507275 Aug 29 04:53:09.496529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:09.497266 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 422/748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:08 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:09.503574 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1437561a-20c5-4004-865b-d53224aa2513 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1470 microversion: 2.1 time: 0.360658 Aug 29 04:53:09.504501 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 327/749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:09 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1470 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:09.507425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:09.508154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:09.510799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:09.511706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:09.516109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.516752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.518165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.519053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.519361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.519667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.519938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.520323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.520432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.521104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.521586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.522011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.616348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:09.625309 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2dfb12bf-6a49-46c6-a7eb-e84315d0e23f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1265 microversion: 2.1 time: 0.124968 Aug 29 04:53:09.626125 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 423/750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:09 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:09.631923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-728f7234-e537-4319-a57e-f31699e289d5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:09.632487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-728f7234-e537-4319-a57e-f31699e289d5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:09.639870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-728f7234-e537-4319-a57e-f31699e289d5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.640637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-728f7234-e537-4319-a57e-f31699e289d5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.641276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-728f7234-e537-4319-a57e-f31699e289d5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.642168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-728f7234-e537-4319-a57e-f31699e289d5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.642796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-728f7234-e537-4319-a57e-f31699e289d5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.643368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-728f7234-e537-4319-a57e-f31699e289d5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.700154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:09.708939 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e591ecd6-ab9f-46d3-94f8-165d3a964080 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.203279 Aug 29 04:53:09.722377 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 328/751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:09 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:09.727343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:09.727952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:09.734188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.734688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.735122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.736189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.736873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.737638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.751335 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-728f7234-e537-4319-a57e-f31699e289d5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481/action" status: 204 len: 0 microversion: 2.1 time: 0.123599 Aug 29 04:53:09.755697 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 424/752] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:53:09 2022] POST /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481/action => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:53:09.779912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:09.780910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:09.787606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.788443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.788955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:09.789790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:09.790526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:09.790963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:10.782755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:10.793235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:10.797826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:10.803282 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ecbe298a-75f7-4c9b-97ee-37947fa5afe6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 1.077413 Aug 29 04:53:10.816680 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 329/753] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:09 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:53:10.840054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:10.842955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:10.847221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:10.859781 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dff8769f-c89e-4acd-b142-0fc6cb84fd0b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1470 microversion: 2.1 time: 1.102549 Aug 29 04:53:10.862216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:10.862894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:10.877295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:10.877854 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 425/754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:09 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1470 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:10.880984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:10.881644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:10.883343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:10.886676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:10.891774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:10.910314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:10.911102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:10.911699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:10.912580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:10.913165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:10.913721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:11.153491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:11.162823 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-abee9386-f2f5-4958-88b5-362047d93bd2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1271 microversion: 2.1 time: 0.283365 Aug 29 04:53:11.168298 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 426/755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:10 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:11.175716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:11.177122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:11.184775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:11.185489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:11.186737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:11.187690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:11.188359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:11.188929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:11.550974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:11.573803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c71ac38-87ab-4425-8a95-1b441d404b8b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1505 microversion: 2.1 time: 0.755837 Aug 29 04:53:11.574397 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 330/756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:10 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1505 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:11.612337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f418c44a-af28-49f6-898f-ccf6efd5c641 req-c413a67c-d3ef-4ae9-a846-5725a72c4467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9c6427-61b8-4bc8-8916-7f16bfab3481", "name": "network-vif-plugged", "status": "completed", "tag": "d1e67a19-a229-4469-8585-f4f9bb1b7a2f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:11.636393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f418c44a-af28-49f6-898f-ccf6efd5c641 req-c413a67c-d3ef-4ae9-a846-5725a72c4467 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:11.637319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f418c44a-af28-49f6-898f-ccf6efd5c641 req-c413a67c-d3ef-4ae9-a846-5725a72c4467 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:11.638133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f418c44a-af28-49f6-898f-ccf6efd5c641 req-c413a67c-d3ef-4ae9-a846-5725a72c4467 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:11.655248 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f418c44a-af28-49f6-898f-ccf6efd5c641 req-c413a67c-d3ef-4ae9-a846-5725a72c4467 service nova] Creating event network-vif-plugged:d1e67a19-a229-4469-8585-f4f9bb1b7a2f for instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 on n-h1-854119-9 Aug 29 04:53:11.664514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-f418c44a-af28-49f6-898f-ccf6efd5c641 req-c413a67c-d3ef-4ae9-a846-5725a72c4467 service nova] Instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:53:11.676634 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f418c44a-af28-49f6-898f-ccf6efd5c641 req-c413a67c-d3ef-4ae9-a846-5725a72c4467 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100902 Aug 29 04:53:11.677935 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 331/757] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:11.709406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:11.721338 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-02ca43f0-9e5b-4caf-bd14-7e9c0347fcd6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.556448 Aug 29 04:53:11.722533 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 427/758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:11 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:11.841394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dadc9fac-e77c-4cbf-89ce-39f3fa8e94b9 tempest-AZV2TestJSON-1127276690 tempest-AZV2TestJSON-1127276690-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:11.842952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dadc9fac-e77c-4cbf-89ce-39f3fa8e94b9 tempest-AZV2TestJSON-1127276690 tempest-AZV2TestJSON-1127276690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:11.843426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dadc9fac-e77c-4cbf-89ce-39f3fa8e94b9 tempest-AZV2TestJSON-1127276690 tempest-AZV2TestJSON-1127276690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:11.844021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dadc9fac-e77c-4cbf-89ce-39f3fa8e94b9 tempest-AZV2TestJSON-1127276690 tempest-AZV2TestJSON-1127276690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:11.844774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dadc9fac-e77c-4cbf-89ce-39f3fa8e94b9 tempest-AZV2TestJSON-1127276690 tempest-AZV2TestJSON-1127276690-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:11.845221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dadc9fac-e77c-4cbf-89ce-39f3fa8e94b9 tempest-AZV2TestJSON-1127276690 tempest-AZV2TestJSON-1127276690-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:11.845632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dadc9fac-e77c-4cbf-89ce-39f3fa8e94b9 tempest-AZV2TestJSON-1127276690 tempest-AZV2TestJSON-1127276690-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:11.854776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:11.855984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:11.869950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:11.870811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:11.871582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:11.872174 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dadc9fac-e77c-4cbf-89ce-39f3fa8e94b9 tempest-AZV2TestJSON-1127276690 tempest-AZV2TestJSON-1127276690-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.192586 Aug 29 04:53:11.872500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:11.872948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:11.873236 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 332/759] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Aug 29 04:53:11 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:53:11.873520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:11.888867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:11.893166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:11.913315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:11.916147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:11.916656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:11.921054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:11.921583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:11.922598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:12.246594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:12.261244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:12.262920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:12.264854 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5bc73e13-be9c-4110-baa8-a3075dc665a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.413218 Aug 29 04:53:12.290180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 428/760] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:11 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:53:12.305078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:12.306453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:12.319752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:12.321990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:12.322620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:12.324870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:12.326750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:12.329168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:12.333050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:12.347689 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c61f97be-9e6b-4c5e-8e5a-bba1eeaffb5b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1470 microversion: 2.1 time: 0.467214 Aug 29 04:53:12.350922 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 333/761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:11 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:12.601220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:12.603025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:12.607439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:12.631658 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af4134ee-5561-4e15-80eb-b8654931bfb3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1313 microversion: 2.1 time: 0.337618 Aug 29 04:53:12.634611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:12.635458 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 429/762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:12 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:12.635835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:12.636736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:12.637755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:12.638385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:12.638960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:12.649495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-be81c4d4-2b0a-46d6-979e-83ab88ccd11e req-8dd95049-a282-4e6a-9d54-adbbe827860a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63eef86-e101-462a-ab1f-3d16795b0689", "tag": "826a9e27-8404-452e-9266-5e59fd5a4c03"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:12.668427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-be81c4d4-2b0a-46d6-979e-83ab88ccd11e req-8dd95049-a282-4e6a-9d54-adbbe827860a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:12.669056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-be81c4d4-2b0a-46d6-979e-83ab88ccd11e req-8dd95049-a282-4e6a-9d54-adbbe827860a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:12.669578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-be81c4d4-2b0a-46d6-979e-83ab88ccd11e req-8dd95049-a282-4e6a-9d54-adbbe827860a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:12.681810 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-be81c4d4-2b0a-46d6-979e-83ab88ccd11e req-8dd95049-a282-4e6a-9d54-adbbe827860a service nova] Creating event network-changed:826a9e27-8404-452e-9266-5e59fd5a4c03 for instance e63eef86-e101-462a-ab1f-3d16795b0689 on n-h2-854119-9 Aug 29 04:53:12.686961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-be81c4d4-2b0a-46d6-979e-83ab88ccd11e req-8dd95049-a282-4e6a-9d54-adbbe827860a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048900 Aug 29 04:53:12.688184 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 430/763] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:12.766856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:12.768132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:12.780523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:12.782040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:12.783034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:12.799952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:12.803883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:12.805067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.049869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:13.063883 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e4d26b04-4796-45d0-a5ec-35b6c30b57b9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1495 microversion: 2.1 time: 0.471795 Aug 29 04:53:13.065146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 334/764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:12 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1495 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:13.085710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86f2bb05-6797-496e-8e21-77a1f972f5e3 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '.version_select at 0x7f1ab9cde670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:13.090746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86f2bb05-6797-496e-8e21-77a1f972f5e3 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.091498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86f2bb05-6797-496e-8e21-77a1f972f5e3 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.092089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86f2bb05-6797-496e-8e21-77a1f972f5e3 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.105397 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86f2bb05-6797-496e-8e21-77a1f972f5e3 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.024110 Aug 29 04:53:13.106569 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 335/765] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:53:13 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:13.124193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc3a07da-81e9-4137-986b-e31a1245a63f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:13.125203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc3a07da-81e9-4137-986b-e31a1245a63f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:13.138542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc3a07da-81e9-4137-986b-e31a1245a63f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.141352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc3a07da-81e9-4137-986b-e31a1245a63f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.143430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc3a07da-81e9-4137-986b-e31a1245a63f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.147584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc3a07da-81e9-4137-986b-e31a1245a63f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.148903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc3a07da-81e9-4137-986b-e31a1245a63f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.149947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc3a07da-81e9-4137-986b-e31a1245a63f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.297989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:13.324797 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2bc330ae-7292-485b-b976-e865d24afb2c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.582402 Aug 29 04:53:13.340429 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 431/766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:12 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:13.345778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:13.348830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:13.359799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.360343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.360949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.362058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.365600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.366088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.399971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:13.463734 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc3a07da-81e9-4137-986b-e31a1245a63f tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1646 microversion: 2.1 time: 0.346858 Aug 29 04:53:13.473668 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 336/767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:13 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1646 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:13.484724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:13.485496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:13.522965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.525687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.528567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.530978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.531642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.536393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.586344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:13.598223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:13.601078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:13.602769 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8044a96d-2f82-4ca7-82b2-d4124ff66315 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.273038 Aug 29 04:53:13.603993 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 432/768] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:13 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:53:13.655022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:13.655653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:13.668742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.669259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.669697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.670573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.671222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.671811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.736900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:13.752061 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3eae2573-300d-413f-9279-96ea02b37f7d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1462 microversion: 2.1 time: 0.277071 Aug 29 04:53:13.753812 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 337/769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:13 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1462 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:13.763011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6b812476-58ec-4f5f-bd94-647e56cf186d req-436e0f40-35ae-47f0-8f35-c18c667f3a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419bf8df-33bd-47c9-beb5-4398ea8db81f", "name": "network-vif-plugged", "status": "completed", "tag": "04cfbf0e-aa49-41f9-ac96-1e1c42605e9a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:13.784706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6b812476-58ec-4f5f-bd94-647e56cf186d req-436e0f40-35ae-47f0-8f35-c18c667f3a80 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.785253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6b812476-58ec-4f5f-bd94-647e56cf186d req-436e0f40-35ae-47f0-8f35-c18c667f3a80 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.785726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6b812476-58ec-4f5f-bd94-647e56cf186d req-436e0f40-35ae-47f0-8f35-c18c667f3a80 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.800443 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6b812476-58ec-4f5f-bd94-647e56cf186d req-436e0f40-35ae-47f0-8f35-c18c667f3a80 service nova] Creating event network-vif-plugged:04cfbf0e-aa49-41f9-ac96-1e1c42605e9a for instance 419bf8df-33bd-47c9-beb5-4398ea8db81f on n-h2-854119-9 Aug 29 04:53:13.806385 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6b812476-58ec-4f5f-bd94-647e56cf186d req-436e0f40-35ae-47f0-8f35-c18c667f3a80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051247 Aug 29 04:53:13.807764 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 338/770] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:13.814373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:13.815585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:13.822535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.823329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.824068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.825250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:13.825883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:13.826516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:13.970563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:13.978955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7394b385-84f6-47b4-bb10-4f9a5874bcc0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1313 microversion: 2.1 time: 0.328105 Aug 29 04:53:13.979535 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 433/771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:13 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:13.996081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-182725137", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "9035ba9b-de41-4199-ad6d-44b4cdc08bb4"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:14.079533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] validate_networks() for [('9035ba9b-de41-4199-ad6d-44b4cdc08bb4', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:53:14.231673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:14.240418 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a6abc26b-7618-4b28-8300-a42e57243f62 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1462 microversion: 2.1 time: 0.431209 Aug 29 04:53:14.242427 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 339/772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:13 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1462 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:14.269559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b3761ce-16dc-438b-b10e-ceec546f7b24 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'create', calling method: .version_select at 0x7f1ab99e9310>, body: {"keypair": {"name": "tempest-keypair-875221044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFliM4PVxAvLdL98bsgj1U45gf4ibsGDKARrfaJ7vHpTpez6SL7lssO3W6qga76urYzBOXrXaQrw2W0mAkgzvdn4KI9PPEjtblN23JVD1ws3KNe0lZ1tce4EHLwiaLgTKQ=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:14.296230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7b3761ce-16dc-438b-b10e-ceec546f7b24 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:53:14.302226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7b3761ce-16dc-438b-b10e-ceec546f7b24 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for user 4fbcb22f6bfb44e7b149c0b9e06014b8 and project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:53:14.357863 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b3761ce-16dc-438b-b10e-ceec546f7b24 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092139 Aug 29 04:53:14.358837 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 340/773] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:53:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:14.372036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:14.373114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:14.381696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:14.382447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:14.383266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:14.385048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:14.386485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:14.386485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:14.996940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:15.006881 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-996a4054-0c87-4ae3-a306-986fbb94c92e tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.645406 Aug 29 04:53:15.007584 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 341/774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:14 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:15.018191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:15.020857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:15.035831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:15.036599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:15.037198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:15.038137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:15.038747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:15.039503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:15.043450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:15.226601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:53:15.227654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:53:15.228248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:53:15.228886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:53:15.229481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:53:15.242817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:15.243633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:15.244789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:15.245836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:15.246657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:15.247650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:15.261282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:15.272481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:53:15.273305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:15.275068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:15.277078 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b002aeb1-0828-4df1-9e33-ccce6dd9422f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.267969 Aug 29 04:53:15.278378 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 342/775] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:15 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:53:15.284144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:15.285968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:15.299360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for user f5a5756b12204e9f9fbd7a2f3c5e1749 and project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:53:15.302565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:15.305934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:15.305934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:15.306834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:15.308723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:15.309470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:15.323675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:53:15.342042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:53:15.406838 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c3e18e4a-c294-4367-9a3f-109e8d112daf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420872 Aug 29 04:53:15.409886 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 434/776] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:53:15.420183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-26581958-c936-43eb-9a10-f953de7132b6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:15.420816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-26581958-c936-43eb-9a10-f953de7132b6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:15.546880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-26581958-c936-43eb-9a10-f953de7132b6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:15.558698 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-26581958-c936-43eb-9a10-f953de7132b6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1210 microversion: 2.1 time: 0.140232 Aug 29 04:53:15.573932 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 435/777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:15 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1210 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:15.630843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:15.641533 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f2582460-d07b-4104-b37d-08e5391ac6e1 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1313 microversion: 2.1 time: 0.361735 Aug 29 04:53:15.645412 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 343/778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:15 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:15.928162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-13933c8c-52f5-49a4-87f2-59608d394f97 req-9d47dde0-04b6-4615-a4a3-ad3b4d7e2c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b14f0ef-853d-4876-888d-045a86ffd64a", "name": "network-vif-plugged", "status": "completed", "tag": "cb07cff6-85cd-45cb-b12a-e416d047ddfb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:15.943452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-13933c8c-52f5-49a4-87f2-59608d394f97 req-9d47dde0-04b6-4615-a4a3-ad3b4d7e2c23 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:15.943941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-13933c8c-52f5-49a4-87f2-59608d394f97 req-9d47dde0-04b6-4615-a4a3-ad3b4d7e2c23 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:15.944427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-13933c8c-52f5-49a4-87f2-59608d394f97 req-9d47dde0-04b6-4615-a4a3-ad3b4d7e2c23 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:15.957834 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-13933c8c-52f5-49a4-87f2-59608d394f97 req-9d47dde0-04b6-4615-a4a3-ad3b4d7e2c23 service nova] Creating event network-vif-plugged:cb07cff6-85cd-45cb-b12a-e416d047ddfb for instance 1b14f0ef-853d-4876-888d-045a86ffd64a on n-h1-854119-9 Aug 29 04:53:15.963050 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-13933c8c-52f5-49a4-87f2-59608d394f97 req-9d47dde0-04b6-4615-a4a3-ad3b4d7e2c23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038641 Aug 29 04:53:15.963988 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 436/779] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:16.028030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:16.028770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:16.037821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:16.041562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:16.043409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:16.045186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:16.047304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:16.048298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:16.301410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:16.302103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:16.308993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:16.310562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:16.311314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:16.312134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:16.312949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:16.313829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:16.351283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:16.359145 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1943936-0db5-46c6-b704-41b5568fcf8b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.336060 Aug 29 04:53:16.359727 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 344/780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:16 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:16.583775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:16.584693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:16.593379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:16.595026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:16.596528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:16.597440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:16.598061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:16.599251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:16.610027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:16.621384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:16.623127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:16.624739 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-572531b9-4502-4fda-8e2e-c924dadec303 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.327680 Aug 29 04:53:16.630603 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 437/781] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:16 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:53:16.666033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:16.667275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:16.677578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:16.678092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:16.678511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:16.679224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:16.679676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:16.680102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:16.732983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:16.741949 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-84b6b2c9-e357-49bb-a5af-e6a9b315b005 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1206 microversion: 2.1 time: 0.163186 Aug 29 04:53:16.742843 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 345/782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:16 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1206 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:16.900240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:16.913191 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b063e24-f4e6-48df-814b-345b1ff9b1c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1313 microversion: 2.1 time: 0.251546 Aug 29 04:53:16.914084 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 438/783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:16 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:17.125972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d80fbfd-3316-411b-a47d-564fedda96a9 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '.version_select at 0x7f1ab9d688b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:17.129707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d80fbfd-3316-411b-a47d-564fedda96a9 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:17.130223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d80fbfd-3316-411b-a47d-564fedda96a9 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:17.130664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d80fbfd-3316-411b-a47d-564fedda96a9 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:17.141475 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d80fbfd-3316-411b-a47d-564fedda96a9 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.019969 Aug 29 04:53:17.142102 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 346/784] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:53:17 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:17.164249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-19dcb41b-e996-42b0-bd1c-22f12188e25d tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:17.172202 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-19dcb41b-e996-42b0-bd1c-22f12188e25d tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012712 Aug 29 04:53:17.173275 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 439/785] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:53:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:17.184982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e142ac3-4c59-490b-8578-27f0c6e37929 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1542137130", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:17.208621 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e142ac3-4c59-490b-8578-27f0c6e37929 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.027138 Aug 29 04:53:17.209372 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 347/786] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Aug 29 04:53:17 2022] POST /compute/v2.1/flavors => generated 499 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:17.221139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3536a33d-f715-4764-982c-df02a8084c9f tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:17.233421 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3536a33d-f715-4764-982c-df02a8084c9f tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016240 Aug 29 04:53:17.241789 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 440/787] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Aug 29 04:53:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:53:17.376416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-217643752", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "062e7785-2153-43f5-a355-279546983f9f"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:17.383113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:17.383739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:17.394672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:17.395186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:17.399143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:17.400216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:17.402074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:17.405032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:17.444415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:53:17.651983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:17.662763 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45986c97-03e2-4863-92bf-0d0972723923 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.286493 Aug 29 04:53:17.676307 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 441/788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:17 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:17.681388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:17.682191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:17.688527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:17.689763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:17.690528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:17.691472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:17.691915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:17.692493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:17.788283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:53:17.788710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:53:17.789511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:53:17.790699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:53:17.791312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:53:17.825923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:17.826332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:17.826763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:17.830505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:17.831076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:17.831522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:17.883636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:53:17.898530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for user 4fbcb22f6bfb44e7b149c0b9e06014b8 and project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:53:17.913743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:53:17.916042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:53:17.960517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:17.974174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:17.976983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:17.978629 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3605069e-ebd3-4a58-8faf-4792e0fda44b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1410 microversion: 2.25 time: 0.301037 Aug 29 04:53:17.980261 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 442/789] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:17 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1410 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:53:17.985334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:17.986247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:18.010366 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2a66540-a31e-4686-b91a-92841f9d230f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639216 Aug 29 04:53:18.015231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:18.016693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:18.017521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:18.020236 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 348/790] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:53:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:53:18.025255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:18.026274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:18.026919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:18.031862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:18.032818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:18.043697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:18.049662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:18.050268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:18.051375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:18.051971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:18.054290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:18.117660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:18.126504 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0fac02d-d4d4-4f64-9fd3-a76bd25cd902 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1262 microversion: 2.1 time: 0.144891 Aug 29 04:53:18.127286 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 443/791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:17 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1262 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:18.142322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-407affb7-7501-4eae-b0c1-fb08c840de08 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:18.142948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-407affb7-7501-4eae-b0c1-fb08c840de08 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:18.260760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-407affb7-7501-4eae-b0c1-fb08c840de08 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:18.280901 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-407affb7-7501-4eae-b0c1-fb08c840de08 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1278 microversion: 2.1 time: 0.151791 Aug 29 04:53:18.282839 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 444/792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:18 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:18.404232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:18.414399 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f853e6b-807e-4e7a-bc4b-ab5ac5f325c5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1313 microversion: 2.1 time: 0.392916 Aug 29 04:53:18.417104 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 349/793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:18 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:18.684981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:18.687047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:18.710931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:18.711385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:18.712009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:18.717783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:18.718869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:18.720034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.002913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:19.011951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:19.036070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.037990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.038638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.042734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.043287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.046866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.121695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:19.132080 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e67ac686-bf18-40af-a751-bbfe66bd2e9a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1319 microversion: 2.1 time: 0.450749 Aug 29 04:53:19.133865 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 445/794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:18 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:19.149746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:19.150605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:19.165496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.167495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.168068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.170054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.171973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.172505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.361897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:19.375558 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55fdffe3-1a53-41c1-bd97-b9077de7f6dc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1268 microversion: 2.1 time: 0.232305 Aug 29 04:53:19.377524 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 446/795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:19 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:19.383761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:19.397273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:19.404493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.405287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.412866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.413896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.414536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.415120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.502051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:19.513917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:19.515560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:19.517031 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d9259d38-0792-4883-b54c-023ab6f75d69 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1607 microversion: 2.25 time: 0.518080 Aug 29 04:53:19.518456 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 350/796] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:53:18 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1607 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:53:19.523963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:19.524823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:19.531460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.532229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.532859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.533730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.534335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.534914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.606299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:19.618142 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-652f2b6f-ed64-4f1a-861d-e6214a45c258 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1330 microversion: 2.1 time: 0.238319 Aug 29 04:53:19.621323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 447/797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:19 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1330 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:19.629778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9e27511-8d77-4385-8b09-81cf1c297f73 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:19.631613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9e27511-8d77-4385-8b09-81cf1c297f73 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:19.647911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9e27511-8d77-4385-8b09-81cf1c297f73 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.648942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9e27511-8d77-4385-8b09-81cf1c297f73 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.650593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9e27511-8d77-4385-8b09-81cf1c297f73 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.653055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9e27511-8d77-4385-8b09-81cf1c297f73 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:19.654768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9e27511-8d77-4385-8b09-81cf1c297f73 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:19.656024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9e27511-8d77-4385-8b09-81cf1c297f73 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:19.810719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:19.848395 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9e27511-8d77-4385-8b09-81cf1c297f73 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.225444 Aug 29 04:53:19.849598 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 448/798] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 29 04:53:19 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-interface => generated 285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:53:19.864266 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86a51a12-8df9-4bc7-b4fb-de388a71ab11 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1313 microversion: 2.1 time: 0.344395 Aug 29 04:53:19.864866 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 351/799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:19 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:20.153407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:20.154031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:20.164272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:20.164768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:20.165194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:20.165907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:20.166351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:20.166767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:20.412107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:20.417793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:20.447822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:20.450423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:20.453656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:20.454471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:20.457175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:20.458382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:20.491793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:20.500525 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e675e4db-fdd5-4f96-b24d-81bcddf7cc1f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1468 microversion: 2.1 time: 0.350954 Aug 29 04:53:20.501316 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 449/800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:20 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1468 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:20.522700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:20.533001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:20.542969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:20.543485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:20.543973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:20.547114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:20.547626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:20.548067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:21.029441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:21.043547 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-136d0d8d-4a6a-492e-86fb-ec01a1c98a99 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1310 microversion: 2.1 time: 0.648004 Aug 29 04:53:21.044165 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 352/801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:20 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1310 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:21.057739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:21.058701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:21.074157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:21.075933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:21.077198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:21.079473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:21.079950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:21.080405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:21.620342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:21.630587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc9e2209-8709-470b-b286-f73a508e8e22 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1336 microversion: 2.1 time: 0.583614 Aug 29 04:53:21.640271 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 353/802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:21 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1336 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:21.654098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:21.655121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:21.663894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:21.667881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:21.668407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:21.668843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:21.669578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:21.670022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:21.670435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:21.671735 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8344395b-7f9b-411f-964d-bd92ba70ecd0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e" status: 200 len: 1468 microversion: 2.1 time: 1.153293 Aug 29 04:53:21.684666 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 450/803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:20 2022] GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e => generated 1468 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:21.696299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:21.702588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:21.703849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Searching by: {'reservation_id': 'r-m9wozu4q', 'deleted': False, 'project_id': '38bcab4cb30d4894bdec1572236a6347'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:53:21.718226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:21.718743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:21.719166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:21.720841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:21.721536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:21.722235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:21.841588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 04:53:21.977838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:21.993510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:21.995177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:21.996676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:22.055937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:22.069292 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-33a3852c-e6f0-46e0-9809-5242845aaa78 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1313 microversion: 2.1 time: 0.427459 Aug 29 04:53:22.071527 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 354/804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:21 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:22.089615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:22.090986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:22.101373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:22.103920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:22.104652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:22.105603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:22.106266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:22.107068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:22.490014 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6450f99a-36c8-4752-87cc-3c0d05d3310b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-m9wozu4q" status: 200 len: 2929 microversion: 2.1 time: 0.797999 Aug 29 04:53:22.490968 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 451/805] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Aug 29 04:53:21 2022] GET /compute/v2.1/servers/detail?reservation_id=r-m9wozu4q => generated 2929 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:22.496093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1784b22b-b2eb-49fe-80a1-5ca3b46fe426 req-0eaa1af3-5212-4855-8904-3e3a26c4d5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b14f0ef-853d-4876-888d-045a86ffd64a", "tag": "cb07cff6-85cd-45cb-b12a-e416d047ddfb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:22.510202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1784b22b-b2eb-49fe-80a1-5ca3b46fe426 req-0eaa1af3-5212-4855-8904-3e3a26c4d5a1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:22.510702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1784b22b-b2eb-49fe-80a1-5ca3b46fe426 req-0eaa1af3-5212-4855-8904-3e3a26c4d5a1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:22.511124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1784b22b-b2eb-49fe-80a1-5ca3b46fe426 req-0eaa1af3-5212-4855-8904-3e3a26c4d5a1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:22.532189 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1784b22b-b2eb-49fe-80a1-5ca3b46fe426 req-0eaa1af3-5212-4855-8904-3e3a26c4d5a1 service nova] Creating event network-changed:cb07cff6-85cd-45cb-b12a-e416d047ddfb for instance 1b14f0ef-853d-4876-888d-045a86ffd64a on n-h1-854119-9 Aug 29 04:53:22.538993 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-1784b22b-b2eb-49fe-80a1-5ca3b46fe426 req-0eaa1af3-5212-4855-8904-3e3a26c4d5a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046609 Aug 29 04:53:22.540111 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 452/806] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:22.549475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f23c3a75-a79b-444d-b3a8-dffdd4d65aae tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:22.569138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.compute.server_groups [None req-f23c3a75-a79b-444d-b3a8-dffdd4d65aae tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Querying cell a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) for 2 instances {{(pid=128872) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 04:53:22.570164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f23c3a75-a79b-444d-b3a8-dffdd4d65aae tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:22.570758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f23c3a75-a79b-444d-b3a8-dffdd4d65aae tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:22.571425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f23c3a75-a79b-444d-b3a8-dffdd4d65aae tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:22.594797 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f23c3a75-a79b-444d-b3a8-dffdd4d65aae tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/5d82fee1-fd1f-426c-8681-0ad48c37cade" status: 200 len: 271 microversion: 2.1 time: 0.052634 Aug 29 04:53:22.600223 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 453/807] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 04:53:22 2022] GET /compute/v2.1/os-server-groups/5d82fee1-fd1f-426c-8681-0ad48c37cade => generated 271 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:22.607431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8c9174a1-41d6-4b2d-a9fb-5bccd9459d13 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:22.608760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8c9174a1-41d6-4b2d-a9fb-5bccd9459d13 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:22.615343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c9174a1-41d6-4b2d-a9fb-5bccd9459d13 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:22.616106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c9174a1-41d6-4b2d-a9fb-5bccd9459d13 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:22.616276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c9174a1-41d6-4b2d-a9fb-5bccd9459d13 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:22.616970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c9174a1-41d6-4b2d-a9fb-5bccd9459d13 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:22.617911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c9174a1-41d6-4b2d-a9fb-5bccd9459d13 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:22.617911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c9174a1-41d6-4b2d-a9fb-5bccd9459d13 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:22.645215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:22.654284 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fdc5f0e9-182f-4b0a-a637-d83f79d47a40 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1310 microversion: 2.1 time: 0.569087 Aug 29 04:53:22.654893 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 355/808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:22 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1310 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:22.659512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:22.660211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:22.667493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:22.668217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:22.668803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:22.669651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:22.670244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:22.670848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:22.858390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:22.867475 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e649f3bd-3780-416c-b19a-806ba1dfac31 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1336 microversion: 2.1 time: 0.211367 Aug 29 04:53:22.868219 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 356/809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:22 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1336 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:23.097007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:23.098276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:23.111165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:23.111934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:23.112572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:23.113717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:23.114812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:23.115341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:23.195937 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8c9174a1-41d6-4b2d-a9fb-5bccd9459d13 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 200 len: 1619 microversion: 2.1 time: 0.593475 Aug 29 04:53:23.217037 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 454/810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:22 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 1619 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:23.225834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2bedaf2d-ac58-4786-802a-3ab1b4dd7f94 req-2603897e-6122-4d1e-8b66-3d9d5e3b476d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca257379-780a-4815-8792-3b7356fff43f", "tag": "475dea98-d637-462b-a3e0-d1da0dcada7f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:23.241922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2bedaf2d-ac58-4786-802a-3ab1b4dd7f94 req-2603897e-6122-4d1e-8b66-3d9d5e3b476d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:23.243794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2bedaf2d-ac58-4786-802a-3ab1b4dd7f94 req-2603897e-6122-4d1e-8b66-3d9d5e3b476d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:23.244574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2bedaf2d-ac58-4786-802a-3ab1b4dd7f94 req-2603897e-6122-4d1e-8b66-3d9d5e3b476d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:23.283365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:23.296855 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2bedaf2d-ac58-4786-802a-3ab1b4dd7f94 req-2603897e-6122-4d1e-8b66-3d9d5e3b476d service nova] Creating event network-changed:475dea98-d637-462b-a3e0-d1da0dcada7f for instance ca257379-780a-4815-8792-3b7356fff43f on n-h1-854119-9 Aug 29 04:53:23.319091 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2bedaf2d-ac58-4786-802a-3ab1b4dd7f94 req-2603897e-6122-4d1e-8b66-3d9d5e3b476d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096770 Aug 29 04:53:23.321696 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 455/811] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:23.329988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b895e374-29ee-44d7-8e34-6ce52c78669a tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:23.331088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b895e374-29ee-44d7-8e34-6ce52c78669a tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:23.339704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:23.345660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b895e374-29ee-44d7-8e34-6ce52c78669a tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:23.347260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b895e374-29ee-44d7-8e34-6ce52c78669a tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:23.348060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b895e374-29ee-44d7-8e34-6ce52c78669a tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:23.354821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b895e374-29ee-44d7-8e34-6ce52c78669a tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:23.357390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b895e374-29ee-44d7-8e34-6ce52c78669a tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:23.358171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b895e374-29ee-44d7-8e34-6ce52c78669a tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:23.889036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:23.925665 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4265d752-f36b-4f26-91cb-9bba843938d0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1313 microversion: 2.1 time: 0.836811 Aug 29 04:53:23.944034 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 357/812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:23 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1313 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:23.951980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-08d2de34-06ed-43d8-9980-c09a13ca4d04 req-c526b6ee-d99f-4c5b-a613-6b4ef4fd25be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63eef86-e101-462a-ab1f-3d16795b0689", "name": "network-vif-plugged", "status": "completed", "tag": "826a9e27-8404-452e-9266-5e59fd5a4c03"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:23.973783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-08d2de34-06ed-43d8-9980-c09a13ca4d04 req-c526b6ee-d99f-4c5b-a613-6b4ef4fd25be service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:23.975216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-08d2de34-06ed-43d8-9980-c09a13ca4d04 req-c526b6ee-d99f-4c5b-a613-6b4ef4fd25be service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:23.976571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-08d2de34-06ed-43d8-9980-c09a13ca4d04 req-c526b6ee-d99f-4c5b-a613-6b4ef4fd25be service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:24.023573 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b895e374-29ee-44d7-8e34-6ce52c78669a tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e" status: 200 len: 1619 microversion: 2.1 time: 0.697793 Aug 29 04:53:24.027290 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 456/813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:23 2022] GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e => generated 1619 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:24.031456 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-08d2de34-06ed-43d8-9980-c09a13ca4d04 req-c526b6ee-d99f-4c5b-a613-6b4ef4fd25be service nova] Creating event network-vif-plugged:826a9e27-8404-452e-9266-5e59fd5a4c03 for instance e63eef86-e101-462a-ab1f-3d16795b0689 on n-h2-854119-9 Aug 29 04:53:24.034299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:24.034967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:24.050296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:24.050753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:24.063050 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-08d2de34-06ed-43d8-9980-c09a13ca4d04 req-c526b6ee-d99f-4c5b-a613-6b4ef4fd25be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117495 Aug 29 04:53:24.064865 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 358/814] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:24.076207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:24.077215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:24.077701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:24.078131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:24.079442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:24.080184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:24.107625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:24.108359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:24.123601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:24.127034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:24.127432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:24.127883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:25.161742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:25.173539 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2bc4849a-790c-4a04-bd46-ed342b48e91a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 1.105100 Aug 29 04:53:25.176775 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 359/815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:24 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:25.198179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:25.207155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-422714757", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "33cda4a1-ab65-4090-bd93-058f432f3732"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:25.216686 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b3b30bc2-fb45-4176-b5d8-62b21b1e4e23 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1310 microversion: 2.1 time: 1.187880 Aug 29 04:53:25.218089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 457/816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:24 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1310 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:25.233871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:25.235037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:25.246812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:25.247629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:25.248479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:25.249398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:25.250036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:25.250601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:25.309725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:53:25.771172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:25.779545 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b6773685-dc2b-47e9-a40f-34bd0ddcc3a0 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1313 microversion: 2.1 time: 0.560147 Aug 29 04:53:25.784269 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 458/817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:25 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:25.864896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:53:25.865650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:53:25.866266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:53:25.866828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:53:25.867231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:53:25.870289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:25.882350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:25.883116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:25.883687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:25.886436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:25.886893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:25.887368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:25.929909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:53:25.937089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:53:25.954336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:53:25.958492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:53:26.003093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b9f37ced-8455-4037-bbde-5f789f40405d req-10d481c1-2d57-4933-84aa-61b3160b2a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b820ba-bc27-4a3b-81a0-43a45340f60b", "tag": "bbab69b1-3249-4a95-ba39-0f3c3196a9e2"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:26.033868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b9f37ced-8455-4037-bbde-5f789f40405d req-10d481c1-2d57-4933-84aa-61b3160b2a49 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:26.035714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b9f37ced-8455-4037-bbde-5f789f40405d req-10d481c1-2d57-4933-84aa-61b3160b2a49 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:26.036898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b9f37ced-8455-4037-bbde-5f789f40405d req-10d481c1-2d57-4933-84aa-61b3160b2a49 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:26.071971 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1cba8643-a70c-4584-85d9-3d43e2836d4b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883382 Aug 29 04:53:26.075897 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b9f37ced-8455-4037-bbde-5f789f40405d req-10d481c1-2d57-4933-84aa-61b3160b2a49 service nova] Creating event network-changed:bbab69b1-3249-4a95-ba39-0f3c3196a9e2 for instance 20b820ba-bc27-4a3b-81a0-43a45340f60b on n-h1-854119-9 Aug 29 04:53:26.076138 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 360/818] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:53:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:53:26.092686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c3e7f32e-f9f9-4c0e-9cc2-e06ca3660b6f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:26.093338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c3e7f32e-f9f9-4c0e-9cc2-e06ca3660b6f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:26.095825 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b9f37ced-8455-4037-bbde-5f789f40405d req-10d481c1-2d57-4933-84aa-61b3160b2a49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093279 Aug 29 04:53:26.097454 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 459/819] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:26.191768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c3e7f32e-f9f9-4c0e-9cc2-e06ca3660b6f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:26.199831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:26.200546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:26.209683 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c3e7f32e-f9f9-4c0e-9cc2-e06ca3660b6f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1216 microversion: 2.1 time: 0.126288 Aug 29 04:53:26.210201 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 361/820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:26 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1216 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:26.210316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:26.211594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:26.227192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:26.228701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:26.229887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:26.230472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:26.237337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:26.238161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:26.254272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:26.255006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:26.259385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:26.260308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:26.261109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:26.261671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:26.655931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:26.681254 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-77fea49e-5034-4749-af7f-630c72f9a248 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.485006 Aug 29 04:53:26.682154 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 460/821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:26 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:26.720853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:26.731920 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54250810-451c-43d6-acf3-6145e1735722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1310 microversion: 2.1 time: 0.498082 Aug 29 04:53:26.732930 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 362/822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:26 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1310 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:26.802264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:26.802893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:26.819263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:26.820044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:26.822142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:26.823387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:26.825877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:26.829080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:27.049483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:27.058244 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3d87e1a-1d18-4f7b-8e33-5245e5204bd6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1463 microversion: 2.1 time: 0.261221 Aug 29 04:53:27.059176 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 461/823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:26 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:27.234481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:27.236383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:27.244315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:27.244975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:27.245402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:27.246297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:27.246898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:27.247486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:27.328021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:27.339399 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9d20dec7-7cff-4495-b3a3-35946acf8612 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1220 microversion: 2.1 time: 0.112099 Aug 29 04:53:27.354046 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 462/824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:27 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:27.366189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e1cacf97-da5c-4daf-b5ba-3f18d68ae8a5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:27.372676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e1cacf97-da5c-4daf-b5ba-3f18d68ae8a5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Searching by: {'deleted': False, 'project_id': 'e9aae02e83c743c2939f3a060fa13386'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:53:27.387632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1cacf97-da5c-4daf-b5ba-3f18d68ae8a5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:27.388355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1cacf97-da5c-4daf-b5ba-3f18d68ae8a5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:27.388798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1cacf97-da5c-4daf-b5ba-3f18d68ae8a5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:27.390200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1cacf97-da5c-4daf-b5ba-3f18d68ae8a5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:27.391127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1cacf97-da5c-4daf-b5ba-3f18d68ae8a5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:27.391556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1cacf97-da5c-4daf-b5ba-3f18d68ae8a5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:27.509631 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e1cacf97-da5c-4daf-b5ba-3f18d68ae8a5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.430852 Aug 29 04:53:27.511250 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 363/825] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:53:27 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:53:27.532652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:27.539420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Searching by: {'deleted': False} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:53:27.545955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:27.546701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:27.547379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:27.548299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:27.549662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:27.549662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:27.702546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:27.703727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:27.723340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:27.723846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:27.724389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:27.725295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:27.725993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:27.730482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:27.750128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:27.758018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Listed batch of 19 results from cell out of 1000 limit. Returned 19 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 04:53:27.940438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:27.940931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:27.941735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:28.214087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:28.222362 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8ef7d464-4596-497c-8038-1efac15fdd04 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.523679 Aug 29 04:53:28.227171 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 364/826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:27 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:28.237693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:28.238637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:28.249344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:28.249839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:28.250270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:28.250980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:28.251430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:28.251848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:28.609697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:28.619638 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f321448b-ec7c-40ae-b366-392f8d2b45d7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1310 microversion: 2.1 time: 0.391222 Aug 29 04:53:28.625045 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 365/827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:28 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1310 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:28.631777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:28.632885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:28.651207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:28.652638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:28.653233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:28.655146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:28.657574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:28.659478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:28.814576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:28.844658 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-65c325f3-2209-40d0-b94d-ca7da71b4df1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1268 microversion: 2.1 time: 0.217828 Aug 29 04:53:28.880620 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 366/828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:28 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1268 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:29.247271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:29.248096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:29.253104 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7cd8b01d-163b-4269-911a-ccdd08a98508 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 30820 microversion: 2.1 time: 1.712617 Aug 29 04:53:29.259746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:29.265964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:29.266728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:29.267648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:29.268879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:29.271921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:29.278387 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 463/829] 10.222.0.20 () {58 vars in 1171 bytes} [Mon Aug 29 04:53:27 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 30820 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:53:29.326493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d282c1ee-4311-4a6f-8698-6fca9879b9ea tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:29.333281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d282c1ee-4311-4a6f-8698-6fca9879b9ea tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Searching by: {'deleted': False, 'project_id': 'e9aae02e83c743c2939f3a060fa13386'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:53:29.340023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d282c1ee-4311-4a6f-8698-6fca9879b9ea tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:29.340698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d282c1ee-4311-4a6f-8698-6fca9879b9ea tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:29.341332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d282c1ee-4311-4a6f-8698-6fca9879b9ea tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:29.342118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d282c1ee-4311-4a6f-8698-6fca9879b9ea tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:29.342636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d282c1ee-4311-4a6f-8698-6fca9879b9ea tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:29.343143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d282c1ee-4311-4a6f-8698-6fca9879b9ea tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:29.497586 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d282c1ee-4311-4a6f-8698-6fca9879b9ea tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=13f1750a840a4c9e91529b3f71830c8a" status: 200 len: 15 microversion: 2.1 time: 0.175769 Aug 29 04:53:29.498446 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 464/830] 10.222.0.20 () {58 vars in 1231 bytes} [Mon Aug 29 04:53:29 2022] GET /compute/v2.1/servers/detail?tenant_id=13f1750a840a4c9e91529b3f71830c8a => generated 15 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:53:29.543556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:29.554594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Searching by: {'tenant_id': '13f1750a840a4c9e91529b3f71830c8a', 'deleted': False} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:53:29.562575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:29.563395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:29.564072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:29.565126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:29.566009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:29.566783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:29.614595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 04:53:29.698056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:29.700257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:29.700953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:29.731901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:29.739967 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-abf961a0-0df0-4ab1-8394-f11d1613a46d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.496692 Aug 29 04:53:29.740761 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 367/831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:29 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:29.758511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:29.759347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:29.770661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:29.771166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:29.771592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:29.772526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:29.773130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:29.773703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.010606 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-68c2e0a5-a435-4dd3-b321-7d997837de02 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=13f1750a840a4c9e91529b3f71830c8a" status: 200 len: 4824 microversion: 2.1 time: 0.489286 Aug 29 04:53:30.011625 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 465/832] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Aug 29 04:53:29 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=13f1750a840a4c9e91529b3f71830c8a => generated 4824 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:30.020465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:30.021766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:30.037667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.038162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.038596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.039308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.039757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.040212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.194816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:30.204976 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6663c286-dbcf-49c7-8d37-77522b1908cd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1274 microversion: 2.1 time: 0.192123 Aug 29 04:53:30.206240 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 466/833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:30 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1274 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:30.221142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec42aa51-33d4-492b-aa33-d12895194076 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:30.235202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ec42aa51-33d4-492b-aa33-d12895194076 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Searching by: {'tenant_id': 'e9aae02e83c743c2939f3a060fa13386', 'deleted': False} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:53:30.247197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec42aa51-33d4-492b-aa33-d12895194076 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.247965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec42aa51-33d4-492b-aa33-d12895194076 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.248873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec42aa51-33d4-492b-aa33-d12895194076 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.249822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec42aa51-33d4-492b-aa33-d12895194076 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.250424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec42aa51-33d4-492b-aa33-d12895194076 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.251003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec42aa51-33d4-492b-aa33-d12895194076 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.298539 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ec42aa51-33d4-492b-aa33-d12895194076 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e9aae02e83c743c2939f3a060fa13386" status: 200 len: 15 microversion: 2.1 time: 0.090967 Aug 29 04:53:30.309457 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 467/834] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Aug 29 04:53:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e9aae02e83c743c2939f3a060fa13386 => generated 15 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:53:30.323888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:30.331903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-82f7ebb6-a520-4bce-a2a8-7d352d7af7d5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:30.335564 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4075ae25-6cde-4368-9eb6-6eb0fd4cdebb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1310 microversion: 2.1 time: 0.580771 Aug 29 04:53:30.336248 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 368/835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:29 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1310 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:30.337256 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-82f7ebb6-a520-4bce-a2a8-7d352d7af7d5 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011230 Aug 29 04:53:30.345641 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 468/836] 10.222.0.20 () {58 vars in 1189 bytes} [Mon Aug 29 04:53:30 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 04:53:30.363434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a5d7951-72ee-4c5c-9163-5d6a711b1d53 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:30.369392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a5d7951-72ee-4c5c-9163-5d6a711b1d53 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:30.390052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5d7951-72ee-4c5c-9163-5d6a711b1d53 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.391464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5d7951-72ee-4c5c-9163-5d6a711b1d53 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.393503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5d7951-72ee-4c5c-9163-5d6a711b1d53 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.394577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5d7951-72ee-4c5c-9163-5d6a711b1d53 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.397557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5d7951-72ee-4c5c-9163-5d6a711b1d53 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.398171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5d7951-72ee-4c5c-9163-5d6a711b1d53 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.540876 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a5d7951-72ee-4c5c-9163-5d6a711b1d53 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action" status: 202 len: 0 microversion: 2.1 time: 0.181886 Aug 29 04:53:30.541838 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 369/837] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:53:30 2022] POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:53:30.550827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:30.555878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:30.556695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '13f1750a840a4c9e91529b3f71830c8a'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:53:30.562276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.562874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.563628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.564489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.564944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.565357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.666998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 04:53:30.741566 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d68edb6d-f9b8-457d-bcc6-a137fbfa489e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.194843 Aug 29 04:53:30.744248 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 469/838] 10.222.0.20 () {58 vars in 1150 bytes} [Mon Aug 29 04:53:30 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:30.756970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b88d1b7-7f7c-4f40-9b68-74be3693995c tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:30.761530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b88d1b7-7f7c-4f40-9b68-74be3693995c tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:30.761886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:30.762491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:30.770815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.771309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.772155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.772891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.773336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.773752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.773983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b88d1b7-7f7c-4f40-9b68-74be3693995c tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.774490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b88d1b7-7f7c-4f40-9b68-74be3693995c tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.774919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b88d1b7-7f7c-4f40-9b68-74be3693995c tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.775615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b88d1b7-7f7c-4f40-9b68-74be3693995c tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.776066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b88d1b7-7f7c-4f40-9b68-74be3693995c tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.783222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b88d1b7-7f7c-4f40-9b68-74be3693995c tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.903850 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b88d1b7-7f7c-4f40-9b68-74be3693995c tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action" status: 202 len: 0 microversion: 2.1 time: 0.151650 Aug 29 04:53:30.906567 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 370/839] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:53:30 2022] POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:53:30.915465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9167efe8-12f3-4f74-a6e7-53f28c16e5c3 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:30.916712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9167efe8-12f3-4f74-a6e7-53f28c16e5c3 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:30.929859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9167efe8-12f3-4f74-a6e7-53f28c16e5c3 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.930762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9167efe8-12f3-4f74-a6e7-53f28c16e5c3 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.931551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9167efe8-12f3-4f74-a6e7-53f28c16e5c3 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:30.932521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9167efe8-12f3-4f74-a6e7-53f28c16e5c3 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:30.933213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9167efe8-12f3-4f74-a6e7-53f28c16e5c3 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:30.933830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9167efe8-12f3-4f74-a6e7-53f28c16e5c3 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:31.468980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:31.478710 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a91ffc5d-4695-49da-9960-db1ac8514509 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.721628 Aug 29 04:53:31.495328 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9167efe8-12f3-4f74-a6e7-53f28c16e5c3 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1615 microversion: 2.1 time: 0.584979 Aug 29 04:53:31.495929 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 470/840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:30 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:31.499917 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 371/841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:30 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1615 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:31.513664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:31.514507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:31.517276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:31.518105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:31.530723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:31.533961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:31.534468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:31.535268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:31.535742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:31.539767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:31.540435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:31.540874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:31.541586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:31.542035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:31.542443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:31.542657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:31.836527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:31.847805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed55c2bc-5bdc-43b6-ab60-3c0c7883fe43 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.346527 Aug 29 04:53:31.848765 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 471/842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:31 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:31.861333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bcfd0d99-6580-4334-a1b9-8047d3d9ebd1 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:31.862387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bcfd0d99-6580-4334-a1b9-8047d3d9ebd1 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:31.876025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcfd0d99-6580-4334-a1b9-8047d3d9ebd1 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:31.876578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcfd0d99-6580-4334-a1b9-8047d3d9ebd1 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:31.877012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcfd0d99-6580-4334-a1b9-8047d3d9ebd1 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:31.877718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcfd0d99-6580-4334-a1b9-8047d3d9ebd1 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:31.878171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcfd0d99-6580-4334-a1b9-8047d3d9ebd1 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:31.878628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcfd0d99-6580-4334-a1b9-8047d3d9ebd1 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:31.916743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:31.930223 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-384bd7e0-b101-447e-81fd-8ad4c08e0fdb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1310 microversion: 2.1 time: 0.422065 Aug 29 04:53:31.931001 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 372/843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:31 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1310 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:31.943434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d58db322-6c20-468b-a1cd-d3e72d352a97 req-963d661b-f7c2-497b-8cba-871fac01e7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca257379-780a-4815-8792-3b7356fff43f", "name": "network-vif-plugged", "status": "completed", "tag": "475dea98-d637-462b-a3e0-d1da0dcada7f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:31.984505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d58db322-6c20-468b-a1cd-d3e72d352a97 req-963d661b-f7c2-497b-8cba-871fac01e7cb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:31.985052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d58db322-6c20-468b-a1cd-d3e72d352a97 req-963d661b-f7c2-497b-8cba-871fac01e7cb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:31.985715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d58db322-6c20-468b-a1cd-d3e72d352a97 req-963d661b-f7c2-497b-8cba-871fac01e7cb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.019160 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d58db322-6c20-468b-a1cd-d3e72d352a97 req-963d661b-f7c2-497b-8cba-871fac01e7cb service nova] Creating event network-vif-plugged:475dea98-d637-462b-a3e0-d1da0dcada7f for instance ca257379-780a-4815-8792-3b7356fff43f on n-h1-854119-9 Aug 29 04:53:32.025870 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d58db322-6c20-468b-a1cd-d3e72d352a97 req-963d661b-f7c2-497b-8cba-871fac01e7cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093027 Aug 29 04:53:32.027007 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 373/844] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:32.112390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bcfd0d99-6580-4334-a1b9-8047d3d9ebd1 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1615 microversion: 2.1 time: 0.261170 Aug 29 04:53:32.120181 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 472/845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:31 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1615 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:32.134295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:32.143822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Searching by: {'host': 'n-h2-854119-9', 'deleted': False} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:53:32.149165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.149657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.150083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.150796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.151240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.151720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.266129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 04:53:32.335088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c4097fe-650c-4cf8-ba24-b000407c446f tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=n-h2-854119-9&all_tenants=1" status: 200 len: 3304 microversion: 2.1 time: 0.206289 Aug 29 04:53:32.340264 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 374/846] 10.222.0.20 () {58 vars in 1190 bytes} [Mon Aug 29 04:53:32 2022] GET /compute/v2.1/servers?host=n-h2-854119-9&all_tenants=1 => generated 3304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:32.349177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-efe29a59-dc46-4141-bbd4-51cccb97ddcc tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:32.355356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-efe29a59-dc46-4141-bbd4-51cccb97ddcc tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 04:53:32.360866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efe29a59-dc46-4141-bbd4-51cccb97ddcc tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.361343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efe29a59-dc46-4141-bbd4-51cccb97ddcc tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.361764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efe29a59-dc46-4141-bbd4-51cccb97ddcc tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.362470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efe29a59-dc46-4141-bbd4-51cccb97ddcc tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.362946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efe29a59-dc46-4141-bbd4-51cccb97ddcc tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.363358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efe29a59-dc46-4141-bbd4-51cccb97ddcc tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.445589 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-efe29a59-dc46-4141-bbd4-51cccb97ddcc tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.100545 Aug 29 04:53:32.446534 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 473/847] 10.222.0.20 () {58 vars in 1196 bytes} [Mon Aug 29 04:53:32 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 04:53:32.458896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-614f5b62-4454-41f7-96fa-11f5acaef926 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:32.461762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-614f5b62-4454-41f7-96fa-11f5acaef926 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:32.468726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-614f5b62-4454-41f7-96fa-11f5acaef926 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.469238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-614f5b62-4454-41f7-96fa-11f5acaef926 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.469678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-614f5b62-4454-41f7-96fa-11f5acaef926 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.470393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-614f5b62-4454-41f7-96fa-11f5acaef926 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.470849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-614f5b62-4454-41f7-96fa-11f5acaef926 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.471276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-614f5b62-4454-41f7-96fa-11f5acaef926 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.502598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:32.503263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:32.513626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.514390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.515166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.516074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.516793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.517472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.539366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:32.570943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-614f5b62-4454-41f7-96fa-11f5acaef926 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action" status: 202 len: 0 microversion: 2.1 time: 0.116088 Aug 29 04:53:32.571731 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 375/848] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:53:32 2022] POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:53:32.581825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:32.585541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:32.595730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.597373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.598169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.599086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.600145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.600787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.648451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:32.717825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:32.726136 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b5fbfbb7-4aa0-4892-a3b2-970462c5fa0e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.230031 Aug 29 04:53:32.744241 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 474/849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:32 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:32.752061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:53:32.752538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:53:32.753121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:53:32.753770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:53:32.754244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:53:32.820552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:32.827512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.828095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.828956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.829953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.830585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.831029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.861567 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-46e228e1-e1c1-47be-b560-2256dc22c6c8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action" status: 202 len: 1068 microversion: 2.1 time: 0.285295 Aug 29 04:53:32.862891 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 376/850] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:53:32 2022] POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action => generated 1068 bytes in 287 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 04:53:32.877213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:32.878706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:32.878841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:32.879364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:32.885439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.885628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.885920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.886071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.886463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.886675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.887166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.887371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:32.887615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.888032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:32.888242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:32.888820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:33.266189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:33.280658 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-872f2ecb-7415-426f-9bd0-e56630ccf481 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.405376 Aug 29 04:53:33.282477 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 377/851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:32 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:33.288535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:33.289712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:33.300564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:33.301365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:33.302162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:33.303260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:33.304798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:33.305241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:33.329364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:33.344153 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e728edbe-fc80-4b8d-884e-6276a3fc45de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.470617 Aug 29 04:53:33.345654 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 475/852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:32 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:33.620148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:33.635229 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2d33a1a-b26b-4a4e-abf5-afd59d60c854 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1310 microversion: 2.1 time: 0.350684 Aug 29 04:53:33.636598 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 378/853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:33 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1310 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:33.751189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:33.751761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:33.768598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:33.775057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:33.775842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:33.776931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:33.778597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:33.780300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:34.046539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:34.055720 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5c744e98-b1d4-4fc3-b77c-d1d57ebc5ae2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.308658 Aug 29 04:53:34.056771 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 476/854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:33 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:34.098961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-03fe2618-3d1e-4ca1-a6d8-2c5ff8060e21 req-1d1c3e45-3434-4fd4-a941-b2a249842edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3", "tag": "9efe761d-cb21-4dbc-bcbd-4b5c7a18d21f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:34.115278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-03fe2618-3d1e-4ca1-a6d8-2c5ff8060e21 req-1d1c3e45-3434-4fd4-a941-b2a249842edf service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:34.115774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-03fe2618-3d1e-4ca1-a6d8-2c5ff8060e21 req-1d1c3e45-3434-4fd4-a941-b2a249842edf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:34.116228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-03fe2618-3d1e-4ca1-a6d8-2c5ff8060e21 req-1d1c3e45-3434-4fd4-a941-b2a249842edf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:34.128932 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-03fe2618-3d1e-4ca1-a6d8-2c5ff8060e21 req-1d1c3e45-3434-4fd4-a941-b2a249842edf service nova] Creating event network-changed:9efe761d-cb21-4dbc-bcbd-4b5c7a18d21f for instance ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 on n-h1-854119-9 Aug 29 04:53:34.135582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-03fe2618-3d1e-4ca1-a6d8-2c5ff8060e21 req-1d1c3e45-3434-4fd4-a941-b2a249842edf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041530 Aug 29 04:53:34.136495 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 379/855] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:34.302917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:34.303535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:34.319607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:34.320208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:34.320615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:34.321919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:34.324662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:34.325701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:34.368437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:34.369140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:34.381093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:34.381764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:34.383503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:34.384243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:34.384704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:34.385121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:34.553697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:34.565925 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f191c091-388f-457f-bc00-13a3c80a0f7c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.267174 Aug 29 04:53:34.566509 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 477/856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:34 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:34.599342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:34.609394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3cd2d8fd-996d-4479-86aa-82d21b76aac9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.245778 Aug 29 04:53:34.610200 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 380/857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:34 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:34.657179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:34.657790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:34.664473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:34.664957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:34.665561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:34.666416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:34.667056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:34.667454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:34.841030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:34.849024 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5cb873ec-7d05-42a9-83ae-e1b20dd6bd11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1310 microversion: 2.1 time: 0.195753 Aug 29 04:53:34.849601 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 478/858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:34 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1310 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:35.077083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:35.077579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:35.085782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:35.086279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:35.086724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:35.087431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:35.087883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:35.088337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:35.354512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:35.363114 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1f769c37-1792-46e8-b52d-d852411fde97 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.289967 Aug 29 04:53:35.381140 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 381/859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:35 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:35.589041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:35.589646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:35.600740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:35.601020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:35.601528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:35.602366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:35.602685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:35.603103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:35.634206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:35.635308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:35.646690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:35.648312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:35.650602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:35.653983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:35.654891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:35.655337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:35.818356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:35.826655 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff6386eb-9759-4de4-b429-8f1bf07a2587 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.243566 Aug 29 04:53:35.840163 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 479/860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:35 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:35.851158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:35.859030 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-656c5741-2ee5-48bd-a541-75da1b5d07de tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.231366 Aug 29 04:53:35.859682 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 382/861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:35 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:35.870008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:35.871260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:35.877856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:35.878348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:35.878823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:35.879516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:35.879969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:35.880488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.026594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:36.039944 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f6bc062f-3155-4d2d-a0bd-3bddcae97c97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1494 microversion: 2.1 time: 0.174033 Aug 29 04:53:36.041185 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 480/862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:35 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1494 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:36.060285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8d1eb23a-6899-4b77-a18c-1d7b1c8b90be tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:36.060896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8d1eb23a-6899-4b77-a18c-1d7b1c8b90be tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:36.067046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d1eb23a-6899-4b77-a18c-1d7b1c8b90be tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.067533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d1eb23a-6899-4b77-a18c-1d7b1c8b90be tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.068156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d1eb23a-6899-4b77-a18c-1d7b1c8b90be tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.069037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d1eb23a-6899-4b77-a18c-1d7b1c8b90be tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.069488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d1eb23a-6899-4b77-a18c-1d7b1c8b90be tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.069908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d1eb23a-6899-4b77-a18c-1d7b1c8b90be tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.210464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=18 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:36.213284 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8d1eb23a-6899-4b77-a18c-1d7b1c8b90be tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1645 microversion: 2.1 time: 0.156714 Aug 29 04:53:36.214180 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 383/863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:36 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1645 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:36.233976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c466569f-b518-4378-a33a-8af987d662e4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:36.234592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c466569f-b518-4378-a33a-8af987d662e4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:36.241209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c466569f-b518-4378-a33a-8af987d662e4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.241697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c466569f-b518-4378-a33a-8af987d662e4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.242126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c466569f-b518-4378-a33a-8af987d662e4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.243029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c466569f-b518-4378-a33a-8af987d662e4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.243477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c466569f-b518-4378-a33a-8af987d662e4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.244069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c466569f-b518-4378-a33a-8af987d662e4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.383461 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c466569f-b518-4378-a33a-8af987d662e4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1645 microversion: 2.1 time: 0.153115 Aug 29 04:53:36.383754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:36.384406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:36.386473 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 481/864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:36 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1645 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:36.391656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.392166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.392763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.393666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.394160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.394578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.406111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3cba3048-abdc-4d90-836b-15afb0db3977 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:36.409912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cba3048-abdc-4d90-836b-15afb0db3977 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.410395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cba3048-abdc-4d90-836b-15afb0db3977 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.410864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cba3048-abdc-4d90-836b-15afb0db3977 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.411783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cba3048-abdc-4d90-836b-15afb0db3977 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.412291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cba3048-abdc-4d90-836b-15afb0db3977 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.412709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cba3048-abdc-4d90-836b-15afb0db3977 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.417549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=19 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:36.445271 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3cba3048-abdc-4d90-836b-15afb0db3977 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042731 Aug 29 04:53:36.445996 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 482/865] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Aug 29 04:53:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:53:36.457698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98601137-d6ac-4b8a-b4c3-96143269b33c tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:36.458223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98601137-d6ac-4b8a-b4c3-96143269b33c tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:36.465869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98601137-d6ac-4b8a-b4c3-96143269b33c tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.466352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98601137-d6ac-4b8a-b4c3-96143269b33c tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.466781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98601137-d6ac-4b8a-b4c3-96143269b33c tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.467511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98601137-d6ac-4b8a-b4c3-96143269b33c tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.467925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98601137-d6ac-4b8a-b4c3-96143269b33c tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.468376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98601137-d6ac-4b8a-b4c3-96143269b33c tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.535273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:36.539814 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98601137-d6ac-4b8a-b4c3-96143269b33c tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f/action" status: 202 len: 0 microversion: 2.1 time: 0.086097 Aug 29 04:53:36.540616 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 483/866] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:53:36 2022] POST /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:53:36.548837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e2aec561-59d3-4efb-bb15-1891c7ee4882 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:36.549533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e2aec561-59d3-4efb-bb15-1891c7ee4882 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:36.550872 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff091276-a4be-41a1-be6c-0f207fc836e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.170458 Aug 29 04:53:36.551457 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 384/867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:36 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:36.556286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2aec561-59d3-4efb-bb15-1891c7ee4882 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.556771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2aec561-59d3-4efb-bb15-1891c7ee4882 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.557201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2aec561-59d3-4efb-bb15-1891c7ee4882 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.557898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2aec561-59d3-4efb-bb15-1891c7ee4882 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.558350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2aec561-59d3-4efb-bb15-1891c7ee4882 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.558770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2aec561-59d3-4efb-bb15-1891c7ee4882 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.692728 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e2aec561-59d3-4efb-bb15-1891c7ee4882 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1650 microversion: 2.1 time: 0.147706 Aug 29 04:53:36.693759 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 484/868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:36 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1650 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:36.848834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:36.849775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:36.857587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.858278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.858858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.859714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.861490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.862046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.879922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:36.880701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:36.887888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.888626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.889221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:36.890067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:36.890651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:36.891856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:37.078963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:37.089544 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f3dc5ec-738b-4d14-b6e6-7b82c5c68461 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.244549 Aug 29 04:53:37.090675 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 385/869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:36 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:37.130537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:37.138666 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fbf95904-2d0f-4829-a802-0f124d072904 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.262600 Aug 29 04:53:37.139244 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 485/870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:36 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:37.571360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:37.572677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:37.579429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:37.580048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:37.580783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:37.581739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:37.582353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:37.582982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:37.714067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f23c3c47-8e24-4403-9d0d-fae77d859de4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:37.714676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f23c3c47-8e24-4403-9d0d-fae77d859de4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:37.724528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f23c3c47-8e24-4403-9d0d-fae77d859de4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:37.727344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f23c3c47-8e24-4403-9d0d-fae77d859de4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:37.730642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f23c3c47-8e24-4403-9d0d-fae77d859de4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:37.731444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:37.731588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f23c3c47-8e24-4403-9d0d-fae77d859de4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:37.732925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f23c3c47-8e24-4403-9d0d-fae77d859de4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:37.734048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f23c3c47-8e24-4403-9d0d-fae77d859de4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:37.740398 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b9865efb-2454-4169-bbc3-90e1e192089f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.172648 Aug 29 04:53:37.742178 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 386/871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:37 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:37.896595 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f23c3c47-8e24-4403-9d0d-fae77d859de4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1650 microversion: 2.1 time: 0.186161 Aug 29 04:53:37.905052 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 486/872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:37 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1650 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:37.945790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a38e8278-3388-443a-8398-653776297b80 req-800f2429-19d9-4ead-9c19-d6c4b6c6b209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b820ba-bc27-4a3b-81a0-43a45340f60b", "name": "network-vif-plugged", "status": "completed", "tag": "bbab69b1-3249-4a95-ba39-0f3c3196a9e2"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:37.960494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a38e8278-3388-443a-8398-653776297b80 req-800f2429-19d9-4ead-9c19-d6c4b6c6b209 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:37.961260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a38e8278-3388-443a-8398-653776297b80 req-800f2429-19d9-4ead-9c19-d6c4b6c6b209 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:37.961864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a38e8278-3388-443a-8398-653776297b80 req-800f2429-19d9-4ead-9c19-d6c4b6c6b209 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:37.974993 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a38e8278-3388-443a-8398-653776297b80 req-800f2429-19d9-4ead-9c19-d6c4b6c6b209 service nova] Creating event network-vif-plugged:bbab69b1-3249-4a95-ba39-0f3c3196a9e2 for instance 20b820ba-bc27-4a3b-81a0-43a45340f60b on n-h1-854119-9 Aug 29 04:53:37.982094 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a38e8278-3388-443a-8398-653776297b80 req-800f2429-19d9-4ead-9c19-d6c4b6c6b209 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039936 Aug 29 04:53:37.984750 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 387/873] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:38.110660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:38.111447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:38.117859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:38.118356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:38.118786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:38.119491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:38.119936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:38.120424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:38.159247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:38.160016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:38.166763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:38.167251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:38.167684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:38.168422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:38.168877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:38.169297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:38.303073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:38.313112 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6dde233-dceb-4d30-b783-2ab6e1906094 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.206292 Aug 29 04:53:38.322022 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 487/874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:38 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:38.333857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:38.341623 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f1d1e429-f64c-45a1-ad4f-83941b600556 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.186584 Aug 29 04:53:38.342379 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 388/875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:38 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:38.762247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:38.763150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:38.770449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:38.770962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:38.771395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:38.772158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:38.772711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:38.773141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:38.913392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:38.917928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b6259fd-cb91-48fc-a93b-8c1314e36f7a tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:38.918567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3b6259fd-cb91-48fc-a93b-8c1314e36f7a tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:38.922300 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-56a25157-b4d2-4014-ae74-e2ce8f43c71a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.164451 Aug 29 04:53:38.922879 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 488/876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:38 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:38.924866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b6259fd-cb91-48fc-a93b-8c1314e36f7a tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:38.925593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b6259fd-cb91-48fc-a93b-8c1314e36f7a tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:38.926034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b6259fd-cb91-48fc-a93b-8c1314e36f7a tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:38.926761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b6259fd-cb91-48fc-a93b-8c1314e36f7a tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:38.927213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b6259fd-cb91-48fc-a93b-8c1314e36f7a tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:38.927638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b6259fd-cb91-48fc-a93b-8c1314e36f7a tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:39.074017 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b6259fd-cb91-48fc-a93b-8c1314e36f7a tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1630 microversion: 2.1 time: 0.159746 Aug 29 04:53:39.074756 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 389/877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:38 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:39.094961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-9", "block_migration": true, "disk_over_commit": false}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:39.097486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:39.103467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:39.103939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:39.104397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:39.105063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:39.105494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:39.105904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:39.183073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lazy-loading 'flavor' on Instance uuid ca257379-780a-4815-8792-3b7356fff43f {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:53:39.229622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: ca257379-780a-4815-8792-3b7356fff43f] Going to try to live migrate instance to n-h2-854119-9 {{(pid=128872) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 04:53:39.257198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:39.335544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:39.335847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:39.342147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:39.342634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:39.343292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:39.344006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:39.344533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:39.344950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:39.510685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:39.519256 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e6bad74d-5755-471f-8fca-254df0c730cb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.188107 Aug 29 04:53:39.526757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 390/878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:39 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:39.526757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:39.526757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:39.531176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:39.531703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:39.534240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:39.535945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:39.536480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:39.536919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:39.686561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:39.689145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=24 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:39.698605 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-251d29ea-b5f7-4ffe-9ddb-a7377addfd5c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.177199 Aug 29 04:53:39.699542 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 391/879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:39 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:39.943667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:39.944396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:39.951348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:39.952266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:39.952696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:39.953740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:39.954364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:39.954774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:39.981192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:40.178067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:40.192370 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23d079c0-f0c2-4fc0-a7c8-eeb4428ae840 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1378 microversion: 2.1 time: 0.252767 Aug 29 04:53:40.205618 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 392/880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:39 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1378 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:40.443502 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8c4883a5-9d57-4fb4-9bf5-5f5b40b97094 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f/action" status: 202 len: 0 microversion: 2.1 time: 1.352196 Aug 29 04:53:40.453580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:40.454475 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 489/881] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:53:39 2022] POST /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f/action => generated 0 bytes in 1364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:53:40.455554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:40.464389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:40.465135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:40.465762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:40.466477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:40.466927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:40.467346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:40.543577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:40.544910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:40.553623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:40.554584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:40.555197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:40.556059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:40.557088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:40.557467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:40.645595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:40.656710 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22be8759-692a-4db8-bf4b-e8957072c464 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1504 microversion: 2.1 time: 0.207102 Aug 29 04:53:40.671262 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 393/882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:40 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:40.720318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:40.730527 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b6a6905c-b687-4bf5-96f2-aa179e2a16ed tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.192432 Aug 29 04:53:40.737847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:40.739292 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 490/883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:40 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:40.739417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:40.745502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:40.745991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:40.746467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:40.747131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:40.747585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:40.748012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:40.897528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:40.905813 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60d0d1ca-0d54-4229-8ec1-3e0cdce771e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.190492 Aug 29 04:53:40.906404 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 394/884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:40 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:41.219966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:41.220616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:41.231007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.231440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.231957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.232722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.233173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.233597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.392238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:41.401676 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f0580865-f63e-4cd8-9569-a2524de3f6af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1528 microversion: 2.1 time: 0.191874 Aug 29 04:53:41.416207 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 491/885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:41 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1528 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:41.424357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:41.425318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:41.436396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.436885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.437400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.438102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.438735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.439414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.577625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:41.600383 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e181c6f5-b2cc-414d-b1b2-4fed08af5604 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1528 microversion: 2.1 time: 0.177247 Aug 29 04:53:41.600998 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 395/886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:41 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1528 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:41.629100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc74d22c-43d8-494e-a685-6aae40a28c0a tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:41.647328 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc74d22c-43d8-494e-a685-6aae40a28c0a tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/062e7785-2153-43f5-a355-279546983f9f" status: 202 len: 0 microversion: 2.1 time: 0.031082 Aug 29 04:53:41.648302 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 492/887] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:53:41 2022] DELETE /compute/v2.1/flavors/062e7785-2153-43f5-a355-279546983f9f => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:53:41.656219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54920176-50be-4c31-9c26-2089cf46fa01 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:41.677971 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54920176-50be-4c31-9c26-2089cf46fa01 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025295 Aug 29 04:53:41.678841 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 396/888] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:53:41 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:41.684530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:41.685180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:41.693909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5c13e123-ed6c-488f-9936-320661280a55 req-6cb1b570-b51f-4157-a376-b9b680fd5862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca257379-780a-4815-8792-3b7356fff43f", "name": "network-vif-unplugged", "status": "completed", "tag": "475dea98-d637-462b-a3e0-d1da0dcada7f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:41.694700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.695216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.695653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.696726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.697207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.697741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.714732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5c13e123-ed6c-488f-9936-320661280a55 req-6cb1b570-b51f-4157-a376-b9b680fd5862 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.715215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5c13e123-ed6c-488f-9936-320661280a55 req-6cb1b570-b51f-4157-a376-b9b680fd5862 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.715640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5c13e123-ed6c-488f-9936-320661280a55 req-6cb1b570-b51f-4157-a376-b9b680fd5862 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.747212 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5c13e123-ed6c-488f-9936-320661280a55 req-6cb1b570-b51f-4157-a376-b9b680fd5862 service nova] Creating event network-vif-unplugged:475dea98-d637-462b-a3e0-d1da0dcada7f for instance ca257379-780a-4815-8792-3b7356fff43f on n-h1-854119-9 Aug 29 04:53:41.759723 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5c13e123-ed6c-488f-9936-320661280a55 req-6cb1b570-b51f-4157-a376-b9b680fd5862 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069885 Aug 29 04:53:41.761784 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 397/889] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:41.771377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:41.775527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:41.791062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.791498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.793728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.799916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.802332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.803385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.948878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:41.963541 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c1646fbf-0d48-4c3b-a5a6-89c5777a5298 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1504 microversion: 2.1 time: 0.286365 Aug 29 04:53:41.964938 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 493/890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:41 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:41.969844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:41.971913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:41.983455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.984244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.984980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.985919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:41.986576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:41.987192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:41.991257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:42.003192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Old instance type tempest-test_resize_flavor_-1542137130, new instance type m1.heat {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 04:53:42.014245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:53:42.014686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:53:42.015492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:53:42.015618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:53:42.015952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:53:42.042049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:42.177573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:42.177974 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d3a8e75f-9fe5-4b62-a693-79b50fdc49d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b/action" status: 202 len: 0 microversion: 2.1 time: 0.414528 Aug 29 04:53:42.178600 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 398/891] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:53:41 2022] POST /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:53:42.184652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:42.185264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:42.193170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:42.193660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:42.194095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:42.194833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:42.195280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:42.195696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:42.196202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=10 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:42.205175 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9164db7-dd3b-4c6b-a04f-d8b5889c9d6b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.238928 Aug 29 04:53:42.219624 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 494/892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:41 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:42.224770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3e5b15c6-2795-43eb-8a83-660447b8249a req-f58e31fc-c59d-4a95-b68d-1211fe7fd57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3", "name": "network-vif-plugged", "status": "completed", "tag": "9efe761d-cb21-4dbc-bcbd-4b5c7a18d21f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:42.261476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3e5b15c6-2795-43eb-8a83-660447b8249a req-f58e31fc-c59d-4a95-b68d-1211fe7fd57d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:42.265146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3e5b15c6-2795-43eb-8a83-660447b8249a req-f58e31fc-c59d-4a95-b68d-1211fe7fd57d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:42.265146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3e5b15c6-2795-43eb-8a83-660447b8249a req-f58e31fc-c59d-4a95-b68d-1211fe7fd57d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:42.290721 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3e5b15c6-2795-43eb-8a83-660447b8249a req-f58e31fc-c59d-4a95-b68d-1211fe7fd57d service nova] Creating event network-vif-plugged:9efe761d-cb21-4dbc-bcbd-4b5c7a18d21f for instance ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 on n-h1-854119-9 Aug 29 04:53:42.295980 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3e5b15c6-2795-43eb-8a83-660447b8249a req-f58e31fc-c59d-4a95-b68d-1211fe7fd57d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074771 Aug 29 04:53:42.296633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 495/893] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:42.302191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:42.302882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:42.312542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:42.313528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:42.314234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:42.316106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:42.316585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:42.317013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:42.370981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:42.380819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-18af275f-1d4d-411e-88c5-d085419e7be1 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.201168 Aug 29 04:53:42.381688 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 399/894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:42 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:42.501700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:42.509808 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2f8e4a6-72b1-4925-9f83-d381a53afb35 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1537 microversion: 2.1 time: 0.211512 Aug 29 04:53:42.510378 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 496/895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:42 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:42.985105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:42.985720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:42.992774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:42.993553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:42.994201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:42.995137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:42.995781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:42.996419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:43.136051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:43.146900 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4c3484dc-bd22-4760-b456-15e8cdb6a959 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1504 microversion: 2.1 time: 0.165518 Aug 29 04:53:43.147766 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 400/896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:42 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:43.225936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:43.227285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:43.234191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:43.234964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:43.235403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:43.236196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:43.236656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:43.237096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:43.371643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:43.380997 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bcaf22f1-16d7-4b9b-ae24-a3bd6400edfa tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.159049 Aug 29 04:53:43.381601 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 497/897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:43 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:43.402944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:43.403562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:43.411054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:43.411616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:43.412063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:43.412795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:43.413244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:43.413662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:43.532338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:43.533185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:43.539220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:43.539699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:43.540358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:43.541222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:43.541813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:43.542382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:43.553739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:43.563651 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2184412b-7b07-43d7-940b-ea3e69ca1b92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1316 microversion: 2.1 time: 0.164396 Aug 29 04:53:43.567008 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 401/898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:43 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:43.680329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:43.688728 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ccdd7ec-b61e-485a-860a-6861d2a2ed79 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1537 microversion: 2.1 time: 0.160033 Aug 29 04:53:43.689316 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 498/899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:43 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1537 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:43.774963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6e3c5c85-b093-4625-8c42-9930d44d5fa1 req-69efd71e-9e05-4f9f-9ea1-1d136d41615f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca257379-780a-4815-8792-3b7356fff43f", "tag": "475dea98-d637-462b-a3e0-d1da0dcada7f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:43.784789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6e3c5c85-b093-4625-8c42-9930d44d5fa1 req-69efd71e-9e05-4f9f-9ea1-1d136d41615f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:43.785297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6e3c5c85-b093-4625-8c42-9930d44d5fa1 req-69efd71e-9e05-4f9f-9ea1-1d136d41615f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:43.785718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6e3c5c85-b093-4625-8c42-9930d44d5fa1 req-69efd71e-9e05-4f9f-9ea1-1d136d41615f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:43.799970 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6e3c5c85-b093-4625-8c42-9930d44d5fa1 req-69efd71e-9e05-4f9f-9ea1-1d136d41615f service nova] Creating event network-changed:475dea98-d637-462b-a3e0-d1da0dcada7f for instance ca257379-780a-4815-8792-3b7356fff43f on n-h1-854119-9 Aug 29 04:53:43.805226 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6e3c5c85-b093-4625-8c42-9930d44d5fa1 req-69efd71e-9e05-4f9f-9ea1-1d136d41615f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033892 Aug 29 04:53:43.805816 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 402/900] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:44.168272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:44.168882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:44.170984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:44.176420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:44.176900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:44.177321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:44.178011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:44.178459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:44.178910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:44.382315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:44.391989 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b3183dbd-a1fe-4958-bf49-8b3bf11da0f7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1504 microversion: 2.1 time: 0.227625 Aug 29 04:53:44.393119 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 499/901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:44 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:44.403197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:44.405260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:44.413422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:44.414256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:44.414866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:44.415773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:44.416755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:44.417301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:44.586377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:44.587334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:44.594193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:44.594786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:44.595331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:44.596151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:44.596734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:44.597538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:44.626289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:44.634373 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-171a095e-794c-4d26-8f6c-6ef5ba4039ee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1472 microversion: 2.1 time: 0.236200 Aug 29 04:53:44.634934 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 403/902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:44 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:44.710363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:44.710970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:44.717670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:44.718152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:44.718577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:44.719355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:44.719803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:44.720240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:45.152880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:45.160061 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f4a5127a-cc38-4faf-853c-ab64f68495b9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1466 microversion: 2.1 time: 0.577678 Aug 29 04:53:45.163248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:45.165728 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 500/903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:44 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1466 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:45.171513 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ce7ec7ee-6c2c-4c58-8641-9cb6018c1064 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1537 microversion: 2.1 time: 0.465085 Aug 29 04:53:45.172081 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 404/904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:44 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1537 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:45.184685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b53d216d-5706-46a2-8e0b-4f035a244904 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:45.185285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b53d216d-5706-46a2-8e0b-4f035a244904 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:45.191827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b53d216d-5706-46a2-8e0b-4f035a244904 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:45.192398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b53d216d-5706-46a2-8e0b-4f035a244904 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:45.192859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b53d216d-5706-46a2-8e0b-4f035a244904 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:45.193574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b53d216d-5706-46a2-8e0b-4f035a244904 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:45.194020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b53d216d-5706-46a2-8e0b-4f035a244904 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:45.194552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b53d216d-5706-46a2-8e0b-4f035a244904 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:45.322355 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b53d216d-5706-46a2-8e0b-4f035a244904 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1617 microversion: 2.1 time: 0.141283 Aug 29 04:53:45.322963 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 501/905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:45 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1617 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:45.387326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-595452270", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["33cda4a1-ab65-4090-bd93-058f432f3732"]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:45.414154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:45.414759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:45.420770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:45.421241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:45.421662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:45.422340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:45.422782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:45.423198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:45.441507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:53:45.648418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:45.657083 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3736a471-66a5-4452-88a9-77a0433bdf84 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1504 microversion: 2.1 time: 0.246815 Aug 29 04:53:45.658087 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 502/906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:45 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:45.664180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:45.664902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:45.671365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:45.671948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:45.672506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:45.673295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:45.673970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:45.674617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:45.785593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:53:45.786251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:53:45.786734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:53:45.787138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:53:45.787542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:53:45.797873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:45.798350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:45.798779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:45.799684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:45.800260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:45.800683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:45.818435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:53:45.823161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:53:45.835586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:53:45.838030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:53:45.856443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:45.877038 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dbaa49bf-91c5-4581-884a-b548247ad692 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1490 microversion: 2.1 time: 0.217321 Aug 29 04:53:45.877818 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 503/907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:45 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1490 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:45.904800 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-484ac36e-39b9-4b7a-bfa6-2815734154f6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521996 Aug 29 04:53:45.908725 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 405/908] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:53:45.917389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8f0134f5-1769-4c3b-a6f7-de51940a8f9f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:45.917999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8f0134f5-1769-4c3b-a6f7-de51940a8f9f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:45.999876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8f0134f5-1769-4c3b-a6f7-de51940a8f9f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:46.008705 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8f0134f5-1769-4c3b-a6f7-de51940a8f9f tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1216 microversion: 2.1 time: 0.095625 Aug 29 04:53:46.010013 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 504/909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:45 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:46.193807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:46.194508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:46.210254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:46.211326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:46.212155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:46.213043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:46.214215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:46.214640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:46.472401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:46.482878 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d795351-7da1-4d6b-885d-3e20dabe402f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1537 microversion: 2.1 time: 0.294326 Aug 29 04:53:46.483629 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 406/910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:46 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:46.682075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:46.683583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:46.690498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:46.692635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:46.693107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:46.693716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:46.694623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:46.695474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:46.695905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:46.857510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:46.870050 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0bec41ca-42f9-44cc-99b4-a07fdb8898ad tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1504 microversion: 2.1 time: 0.192303 Aug 29 04:53:46.870678 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 505/911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:46 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:46.910654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:46.911279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:46.917767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:46.918255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:46.918686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:46.919387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:46.919870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:46.920327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:47.030409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:47.031337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:47.037951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:47.038641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:47.039225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:47.040070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:47.040706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:47.041275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:47.063864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:47.072044 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9ee6bf41-c3e6-47cc-aaeb-5fb1a657d56f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1478 microversion: 2.1 time: 0.166167 Aug 29 04:53:47.072979 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 407/912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:46 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1478 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:47.108133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:47.116168 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b2c62762-b4be-470d-a95b-468f72906f3c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1268 microversion: 2.1 time: 0.089821 Aug 29 04:53:47.116914 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 506/913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:47 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1268 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:47.505367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:47.506151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:47.514569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:47.515519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:47.516049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:47.516940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:47.517583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:47.518384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:47.762640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:47.770459 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f894982-376b-412d-9a2f-ecf11d2ef176 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.269303 Aug 29 04:53:47.783817 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 408/914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:47 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:47.891240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:47.892068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:47.899450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:47.900300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:47.901451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:47.902368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:47.902960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:47.903245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:48.094750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:48.095474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:48.102165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:48.102889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:48.103510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:48.104454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:48.105129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:48.105580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:48.105967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:48.116284 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1dfc84e3-4555-48b2-a5af-e638d2c22722 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1504 microversion: 2.1 time: 0.228873 Aug 29 04:53:48.118245 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 507/915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:47 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:48.137377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:48.138350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:48.144913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:48.145641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:48.146255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:48.147147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:48.147854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:48.148503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:48.167784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:48.305847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:48.314684 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b15cec84-0496-432e-aa4e-f3c0f327b6e6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1274 microversion: 2.1 time: 0.181152 Aug 29 04:53:48.328573 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 508/916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:48 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:48.506501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:48.516240 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7904489-0af2-46d9-82ab-41efc27d834d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1478 microversion: 2.1 time: 0.425665 Aug 29 04:53:48.517298 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 409/917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:48 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1478 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:48.790892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:48.791544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:48.798875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:48.799510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:48.800922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:48.802362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:48.802362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:48.802883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:49.137809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:49.138711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:49.154032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:49.154815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:49.155877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:49.156837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:49.157456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:49.158722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:49.244018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:49.258109 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a244d26-53a8-4139-a609-b05d1ba4ae2e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.471016 Aug 29 04:53:49.278554 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 509/918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:48 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:49.335613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:49.336600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:49.344489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:49.346701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:49.346701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:49.346701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:49.347258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:49.347860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:49.592844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:49.596973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:49.602377 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44efeda4-598a-42b2-82ae-913782fd4d2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1504 microversion: 2.1 time: 0.468233 Aug 29 04:53:49.602943 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 410/919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:49 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:49.621292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:49.622019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:49.629604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:49.630075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:49.630514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:49.631207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:49.631981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:49.632100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:49.719900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:49.728418 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9437aa4d-1057-4b25-ad4f-e8180ebe7377 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1316 microversion: 2.1 time: 0.396671 Aug 29 04:53:49.729300 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 510/920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:49 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:49.848595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:49.861036 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a327f697-e742-4637-b6e5-f9a2dea80df6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1478 microversion: 2.1 time: 0.246981 Aug 29 04:53:49.862303 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 411/921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:49 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1478 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:50.088388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8ecc4eff-e5fb-42ff-afb6-e8491493db9c req-121e3a05-c6c8-4341-a946-3926889362ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "118904bf-3f8d-4850-85b2-b4a4540462a1", "tag": "43cc0ac5-8468-4481-8b84-d388ee80d718"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:50.098997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8ecc4eff-e5fb-42ff-afb6-e8491493db9c req-121e3a05-c6c8-4341-a946-3926889362ba service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:50.099585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8ecc4eff-e5fb-42ff-afb6-e8491493db9c req-121e3a05-c6c8-4341-a946-3926889362ba service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:50.100132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8ecc4eff-e5fb-42ff-afb6-e8491493db9c req-121e3a05-c6c8-4341-a946-3926889362ba service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:50.112461 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8ecc4eff-e5fb-42ff-afb6-e8491493db9c req-121e3a05-c6c8-4341-a946-3926889362ba service nova] Creating event network-changed:43cc0ac5-8468-4481-8b84-d388ee80d718 for instance 118904bf-3f8d-4850-85b2-b4a4540462a1 on n-h1-854119-9 Aug 29 04:53:50.117484 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8ecc4eff-e5fb-42ff-afb6-e8491493db9c req-121e3a05-c6c8-4341-a946-3926889362ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033257 Aug 29 04:53:50.118248 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 511/922] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:50.284720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:50.285687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:50.292082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:50.292607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:50.293042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:50.293913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:50.294363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:50.294785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:50.547519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:50.562487 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-02f44980-f6f6-40e7-b381-487a4814e613 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.280753 Aug 29 04:53:50.563609 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 412/923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:50 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:50.627695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:50.628446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:50.634602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:50.635073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:50.635496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:50.636394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:50.636837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:50.637259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:50.750468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:50.751086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:50.757483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:50.758549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:50.759128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:50.760202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:50.760808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:50.761233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:50.774802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:50.784640 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7f89ee7-e4e2-4766-816e-606c411fe878 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1504 microversion: 2.1 time: 0.161077 Aug 29 04:53:50.785391 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 512/924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:50 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:50.882288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:50.883275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:50.888897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:50.889372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:50.889793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:50.890476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:50.890932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:50.891343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:50.900395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:50.908803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6864151b-b035-4f64-8ad3-71fa029ac8e0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1316 microversion: 2.1 time: 0.162611 Aug 29 04:53:50.909972 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 413/925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:50 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:51.025378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:51.034024 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c6210715-3a57-4b94-b566-24a214cb5c00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1478 microversion: 2.1 time: 0.155661 Aug 29 04:53:51.035161 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 513/926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:50 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1478 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:51.230536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-938cf48a-d2ec-4763-aa8f-6acbaf464542 req-55192437-9c37-44b8-b4d1-3268652f2582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e4c604-f8ec-4543-87ae-906f5e0fbb2f", "name": "network-vif-unplugged", "status": "completed", "tag": "a629769f-7290-46cd-9c9d-933b910b2c27"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:51.245652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-938cf48a-d2ec-4763-aa8f-6acbaf464542 req-55192437-9c37-44b8-b4d1-3268652f2582 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:51.246153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-938cf48a-d2ec-4763-aa8f-6acbaf464542 req-55192437-9c37-44b8-b4d1-3268652f2582 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:51.246641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-938cf48a-d2ec-4763-aa8f-6acbaf464542 req-55192437-9c37-44b8-b4d1-3268652f2582 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:51.258775 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-938cf48a-d2ec-4763-aa8f-6acbaf464542 req-55192437-9c37-44b8-b4d1-3268652f2582 service nova] Creating event network-vif-unplugged:a629769f-7290-46cd-9c9d-933b910b2c27 for instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f on n-h2-854119-9 Aug 29 04:53:51.263804 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-938cf48a-d2ec-4763-aa8f-6acbaf464542 req-55192437-9c37-44b8-b4d1-3268652f2582 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039360 Aug 29 04:53:51.264789 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 414/927] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:51.587135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:51.588318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:51.598246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:51.598948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:51.599552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:51.600451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:51.601052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:51.601621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:51.733197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:51.741340 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-faa9ffae-4514-43e1-94a8-e934f1f4c29e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.160009 Aug 29 04:53:51.741962 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 514/928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:51 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:51.807152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:51.807825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:51.814484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:51.814960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:51.815619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:51.816073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:51.816550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:51.816967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:51.929399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:51.929975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:51.938063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:51.938656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:51.939142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:51.939836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:51.940306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:51.940741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:51.955274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:51.965023 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-939f5bf1-54fe-4f3d-a163-a3926ae9eb25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1479 microversion: 2.1 time: 0.162974 Aug 29 04:53:51.965689 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 415/929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:51 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1479 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:51.988300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f77cf2b8-320a-4631-8d54-10d74f9e13e8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '.version_select at 0x7f1ab9e85e50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:51.992234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f77cf2b8-320a-4631-8d54-10d74f9e13e8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:51.992872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f77cf2b8-320a-4631-8d54-10d74f9e13e8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:51.993476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f77cf2b8-320a-4631-8d54-10d74f9e13e8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:52.004867 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f77cf2b8-320a-4631-8d54-10d74f9e13e8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.023407 Aug 29 04:53:52.005654 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 416/930] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:53:51 2022] GET /compute/v2.1/os-migrations => generated 2729 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:52.020205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b419f2f-3fca-48d9-bf5a-6ef61a2f3449 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:52.021046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b419f2f-3fca-48d9-bf5a-6ef61a2f3449 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:52.027309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b419f2f-3fca-48d9-bf5a-6ef61a2f3449 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:52.027793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b419f2f-3fca-48d9-bf5a-6ef61a2f3449 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:52.028255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b419f2f-3fca-48d9-bf5a-6ef61a2f3449 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:52.029310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b419f2f-3fca-48d9-bf5a-6ef61a2f3449 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:52.029757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b419f2f-3fca-48d9-bf5a-6ef61a2f3449 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:52.030172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b419f2f-3fca-48d9-bf5a-6ef61a2f3449 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:52.107230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:52.118427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e3f2189e-35b6-4b78-bd54-6e89862b3979 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1316 microversion: 2.1 time: 0.192915 Aug 29 04:53:52.120310 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 515/931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:51 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:52.125152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:52.125970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:52.132330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:52.133103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:52.133819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:52.135415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:52.135976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:52.136592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:52.199530 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b419f2f-3fca-48d9-bf5a-6ef61a2f3449 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1630 microversion: 2.1 time: 0.183277 Aug 29 04:53:52.200447 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 417/932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:52 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1630 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:52.231240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-256c1ffa-7d3d-4254-ab3a-2b80aea7f320 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Action: 'create', calling method: .version_select at 0x7f1ab9a29430>, body: {"keypair": {"name": "tempest-keypair-2124226703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz67xcGvUsPPc4kx+3CfuHwIPT4lWMsIXRZ4aavpAwCtbpcnhJRDM9e2oxGhGRrFtpVKwDFQH+1CrWssmehuKjSkT1vxLBe9rs7H6hDbKCoBO7TO+vj2+W44bHd3wDVpw=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:52.248416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-256c1ffa-7d3d-4254-ab3a-2b80aea7f320 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:53:52.253577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-256c1ffa-7d3d-4254-ab3a-2b80aea7f320 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for user f5a5756b12204e9f9fbd7a2f3c5e1749 and project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:53:52.282679 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-256c1ffa-7d3d-4254-ab3a-2b80aea7f320 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055363 Aug 29 04:53:52.283305 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 418/933] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:53:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:53:52.607578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:52.616533 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d447d235-c973-4df1-865c-b2359384c44f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1478 microversion: 2.1 time: 0.494889 Aug 29 04:53:52.617139 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 516/934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:52 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1478 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:52.762452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:52.763376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:52.770010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:52.770817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:52.771593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:52.772433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:52.772992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:52.773522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:52.992036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:53.001394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c9277d46-650d-4513-a0f9-a7b3e6a96876 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.243146 Aug 29 04:53:53.002021 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 419/935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:52 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:53.146357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:53.147038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:53.155849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:53.157270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:53.158442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:53.159621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:53.160348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:53.160944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:53.457385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:53.466803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1202d9fd-8d29-4822-85d1-befd6560a915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1316 microversion: 2.1 time: 0.324440 Aug 29 04:53:53.467449 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 517/936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:53 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:53.639656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:53.640412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:53.652045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:53.653893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:53.654521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:53.655444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:53.656090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:53.659049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:53.991355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:54.000508 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-79f65901-e23d-4f63-a4ca-e930fbb39910 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1478 microversion: 2.1 time: 0.364612 Aug 29 04:53:54.014053 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 420/937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:53 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1478 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:54.027556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:54.028429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:54.039534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:54.041188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:54.041992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:54.044864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:54.045671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:54.046470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:54.199431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1003102812", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "9035ba9b-de41-4199-ad6d-44b4cdc08bb4"}], "security_groups": [{"name": "tempest-securitygroup--2050586432"}], "key_name": "tempest-keypair-2124226703", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:54.345934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:54.354818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-33004fac-6ed3-4ab7-8b7c-8b9a6325e878 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.336080 Aug 29 04:53:54.368717 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 518/938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:54 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:54.377205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] validate_networks() for [('9035ba9b-de41-4199-ad6d-44b4cdc08bb4', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:53:54.487649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:54.489051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:54.495787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:54.496591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:54.497172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:54.498040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:54.498697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:54.499381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:54.901176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:54.910471 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-122bff39-ef9c-40d0-9101-259366ef0d33 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1316 microversion: 2.1 time: 0.426532 Aug 29 04:53:54.911395 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 519/939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:54 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:55.022032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:55.022579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:55.029210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:55.029725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:55.030284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:55.031057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:55.031444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:55.031864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:55.241449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:53:55.241980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:53:55.242455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:53:55.242869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:53:55.243269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:53:55.252749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:55.253256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:55.253692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:55.254422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:55.254881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:55.255299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:55.272457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:53:55.277437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for user f5a5756b12204e9f9fbd7a2f3c5e1749 and project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:53:55.289450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:53:55.291786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:53:55.297279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:55.306561 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3156fb66-b118-46a0-a156-8620f945c1e2 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1478 microversion: 2.1 time: 0.288848 Aug 29 04:53:55.307267 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 520/940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:55 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1478 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:55.342211 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-395cb762-71d4-47e9-a483-786841455385 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.147231 Aug 29 04:53:55.343231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 421/941] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:53:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:53:55.353985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-147ef4d8-8aac-48cc-8d9b-6f04d21e499d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:55.354724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-147ef4d8-8aac-48cc-8d9b-6f04d21e499d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:55.376149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:55.376756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:55.384857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:55.385378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:55.385824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:55.386497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:55.386940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:55.387408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:55.430857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-147ef4d8-8aac-48cc-8d9b-6f04d21e499d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:55.439491 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-147ef4d8-8aac-48cc-8d9b-6f04d21e499d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1235 microversion: 2.1 time: 0.089606 Aug 29 04:53:55.440297 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 521/942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:55 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1235 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:55.581144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:55.592840 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54501af0-1290-4006-9f4f-276737106071 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.220440 Aug 29 04:53:55.606790 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 422/943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:55 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:53:55.933668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:55.934764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:55.937256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8f0cecb0-49f6-4ea0-bfbb-d440cee3aca1 req-59ff6613-704d-4ed6-9206-ded7c0853573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e4c604-f8ec-4543-87ae-906f5e0fbb2f", "name": "network-vif-plugged", "status": "completed", "tag": "a629769f-7290-46cd-9c9d-933b910b2c27"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:55.942412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:55.943129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:55.943714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:55.944927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:55.945543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:55.947236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:55.959874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8f0cecb0-49f6-4ea0-bfbb-d440cee3aca1 req-59ff6613-704d-4ed6-9206-ded7c0853573 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:55.960731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8f0cecb0-49f6-4ea0-bfbb-d440cee3aca1 req-59ff6613-704d-4ed6-9206-ded7c0853573 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:55.961374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8f0cecb0-49f6-4ea0-bfbb-d440cee3aca1 req-59ff6613-704d-4ed6-9206-ded7c0853573 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:55.983354 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8f0cecb0-49f6-4ea0-bfbb-d440cee3aca1 req-59ff6613-704d-4ed6-9206-ded7c0853573 service nova] Creating event network-vif-plugged:a629769f-7290-46cd-9c9d-933b910b2c27 for instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f on n-h2-854119-9 Aug 29 04:53:55.991228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8f0cecb0-49f6-4ea0-bfbb-d440cee3aca1 req-59ff6613-704d-4ed6-9206-ded7c0853573 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057625 Aug 29 04:53:55.992578 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 423/944] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:53:56.233669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:56.250827 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b3ba9056-fed4-4c37-bf5a-e2f68d3f9032 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1316 microversion: 2.1 time: 0.322342 Aug 29 04:53:56.255872 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 522/945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:55 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:56.340777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:56.342092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:56.368651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:56.372034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:56.372952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:56.375250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:56.375789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:56.378395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:56.462113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:56.463527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:56.474826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:56.475892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:56.476496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:56.477350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:56.477916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:56.478431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:56.603639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:56.614359 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a237caee-62ac-4fde-be73-5642fab62a41 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1287 microversion: 2.1 time: 0.156466 Aug 29 04:53:56.615258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 523/946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:56 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:56.622355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:56.622972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:56.630180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:56.630679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:56.631619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:56.632381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:56.632843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:56.633267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:56.821351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:56.830741 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-945ce613-5577-4091-b30c-fedf8d03a009 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1478 microversion: 2.1 time: 0.506834 Aug 29 04:53:56.844619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 424/947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:56 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1478 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:56.875981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:56.886679 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9679eafa-ad83-4e9a-93fe-684239e98fdd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.268019 Aug 29 04:53:56.889907 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 524/948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:56 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:57.277489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:57.278108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:57.288501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:57.289046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:57.291374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:57.292300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:57.293120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:57.293704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:57.642457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:57.644924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:57.658117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:57.659123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:57.659762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:57.660996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:57.661668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:57.662339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:57.816097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:57.828282 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-72858686-b1e8-474b-ab0c-4a1ae3725623 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1293 microversion: 2.1 time: 0.194690 Aug 29 04:53:57.835671 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 525/949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:57 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1293 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:57.853130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:57.854125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:57.861199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:57.862191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:57.862938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:57.863887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:57.864466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:57.865001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:57.885270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:53:58.003221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:58.024537 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4fc38e83-00f8-4ef0-b90e-dfb9b2d39022 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1316 microversion: 2.1 time: 0.751580 Aug 29 04:53:58.027390 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 425/950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:57 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:58.059646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:58.061983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:58.081025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:58.083633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:58.085504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:58.088034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:58.088909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:58.089956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:58.215251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:58.228775 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eabdf7f4-8a41-475e-a17c-f39e1371e65a tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1478 microversion: 2.1 time: 0.381267 Aug 29 04:53:58.230069 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 526/951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:57 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1478 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:58.237363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f2a95d05-27e2-4e82-b932-78e97096b2f4 req-6b6f2990-594f-4e68-8655-534da6edc032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118904bf-3f8d-4850-85b2-b4a4540462a1", "name": "network-vif-plugged", "status": "completed", "tag": "43cc0ac5-8468-4481-8b84-d388ee80d718"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:58.248736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f2a95d05-27e2-4e82-b932-78e97096b2f4 req-6b6f2990-594f-4e68-8655-534da6edc032 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:58.250131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f2a95d05-27e2-4e82-b932-78e97096b2f4 req-6b6f2990-594f-4e68-8655-534da6edc032 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:58.250775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f2a95d05-27e2-4e82-b932-78e97096b2f4 req-6b6f2990-594f-4e68-8655-534da6edc032 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:58.271597 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f2a95d05-27e2-4e82-b932-78e97096b2f4 req-6b6f2990-594f-4e68-8655-534da6edc032 service nova] Creating event network-vif-plugged:43cc0ac5-8468-4481-8b84-d388ee80d718 for instance 118904bf-3f8d-4850-85b2-b4a4540462a1 on n-h1-854119-9 Aug 29 04:53:58.278948 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f2a95d05-27e2-4e82-b932-78e97096b2f4 req-6b6f2990-594f-4e68-8655-534da6edc032 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046780 Aug 29 04:53:58.280789 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 527/952] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:53:58.404091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:58.418706 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-05df5822-0d86-4224-8532-d0be30cae736 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.388971 Aug 29 04:53:58.419846 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 426/953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:58 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:58.864784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:58.866673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:58.890370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:58.893470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:58.893470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:58.894223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:58.896290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:58.896290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:59.048582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:59.049189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:59.060689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:59.061194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:59.061632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:59.062357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:59.062803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:59.067014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:59.238232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:59.246474 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1653d58b-8061-4bc7-99f0-6268910ae677 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.391853 Aug 29 04:53:59.260209 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 528/954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:58 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:59.263828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:59.264147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:59.280974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:59.281500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:59.281932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:59.282640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:59.290461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:59.291587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:59.568948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:59.581438 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-59e9e131-b160-422b-9cd0-c738265040ba tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1316 microversion: 2.1 time: 0.536730 Aug 29 04:53:59.584165 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 427/955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:59 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1316 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:59.605206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:59.606095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:59.615314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:59.616001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:59.616625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:59.617579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:59.619119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:59.620343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:59.626241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:59.637692 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d632f3da-feb5-429e-a58b-c4c708711ccb tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1464 microversion: 2.1 time: 0.381241 Aug 29 04:53:59.638555 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 529/956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:59 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1464 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:53:59.656265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8485317c-de38-4ecd-bcb0-ee85ee6b1f4a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Action: 'create', calling method: .version_select at 0x7f1ab93543a0>, body: {"keypair": {"name": "tempest-keypair-814986845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzjv/joShKC2L9PcsqI3P3u0iLpMZAUQ3MzOeWsu7OaTZscAXb8hYoQdW7hYXc6a/W1Old9EIKbVRPe7HZkKc/CTFfQZVN9p5lWAmTfpOVfRZvwGyJuPK9TdmJujf/dfg=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:53:59.679471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-8485317c-de38-4ecd-bcb0-ee85ee6b1f4a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Getting quotas for project 4757ab0515fe4b6db413ebefc1251588. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:53:59.684397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-8485317c-de38-4ecd-bcb0-ee85ee6b1f4a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Getting quotas for user ca81c4e0350646e58b67cc11892cd035 and project 4757ab0515fe4b6db413ebefc1251588. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:53:59.710136 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8485317c-de38-4ecd-bcb0-ee85ee6b1f4a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.070340 Aug 29 04:53:59.710733 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 530/957] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 04:53:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 04:53:59.715422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:53:59.716012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:53:59.722216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:59.722689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:59.723100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:59.723782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:53:59.724258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:53:59.724672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:53:59.939240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:53:59.947298 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-317b5609-673f-4484-a4e5-1d115c6ad8c2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.361747 Aug 29 04:53:59.947934 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 428/958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:59 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:00.034358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:00.048502 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f44bbf5e-0c64-4be8-92a3-2bd4863bf186 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1464 microversion: 2.1 time: 0.334041 Aug 29 04:54:00.049238 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 531/959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:53:59 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:00.069451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:00.074224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:00.081162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:00.083195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.083887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.084547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.086801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.087428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.088037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.165706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-cd7da386-4559-456e-a7fd-0dd7b0374093 req-7225e823-a8e0-4bcc-ad4f-a9a771668196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c9b159-0dc2-4520-95ea-01bea5848a83", "tag": "ab2261dd-06cc-4525-b84d-5964ae7d42b7"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:00.183606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd7da386-4559-456e-a7fd-0dd7b0374093 req-7225e823-a8e0-4bcc-ad4f-a9a771668196 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.184518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd7da386-4559-456e-a7fd-0dd7b0374093 req-7225e823-a8e0-4bcc-ad4f-a9a771668196 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.184952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd7da386-4559-456e-a7fd-0dd7b0374093 req-7225e823-a8e0-4bcc-ad4f-a9a771668196 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.199148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:54:00.204539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:54:00.205028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:54:00.205436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:54:00.205904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:54:00.211756 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-cd7da386-4559-456e-a7fd-0dd7b0374093 req-7225e823-a8e0-4bcc-ad4f-a9a771668196 service nova] Creating event network-changed:ab2261dd-06cc-4525-b84d-5964ae7d42b7 for instance d7c9b159-0dc2-4520-95ea-01bea5848a83 on n-h1-854119-9 Aug 29 04:54:00.221592 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-cd7da386-4559-456e-a7fd-0dd7b0374093 req-7225e823-a8e0-4bcc-ad4f-a9a771668196 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059784 Aug 29 04:54:00.223584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 532/960] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:00.268608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:00.269164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:00.278990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.284659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.285450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.285841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.288387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.288843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.291273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:00.337760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:00.348977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.350246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.350843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.352095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.352935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.353514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.409709 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0916975a-b301-4ef1-b05f-d532b83ab77d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action" status: 202 len: 1068 microversion: 2.1 time: 0.344583 Aug 29 04:54:00.413492 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 429/961] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:54:00 2022] POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action => generated 1068 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 04:54:00.441636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:00.442816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:00.450925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.451418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.451849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.453156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.454161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.454752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.685293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:00.695130 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e824a9c-3cd0-40da-8d6f-aeb508f238af tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.431704 Aug 29 04:54:00.696465 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 533/962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:00 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:00.710516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:00.711531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:00.718805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.719630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.721064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.721888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.722469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.723439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.758307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:00.768404 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fb2b0f8c-55aa-438d-b6a6-56bfe3b6e5e4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.330584 Aug 29 04:54:00.769191 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 430/963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:00 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:00.953391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:00.962707 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c45ad1b5-3798-4b7a-822d-80732ba996dd tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1465 microversion: 2.1 time: 0.264957 Aug 29 04:54:00.968884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:00.969529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:00.973667 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 534/964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:00 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1465 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:00.977184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.977696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.978120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.978830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:00.979278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:00.979699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:00.994446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5b1ee312-e7aa-41c1-a778-ed5ff80419e8 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:00.996096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5b1ee312-e7aa-41c1-a778-ed5ff80419e8 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:01.006221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1ee312-e7aa-41c1-a778-ed5ff80419e8 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:01.006797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1ee312-e7aa-41c1-a778-ed5ff80419e8 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:01.007443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1ee312-e7aa-41c1-a778-ed5ff80419e8 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:01.008273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1ee312-e7aa-41c1-a778-ed5ff80419e8 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:01.008795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1ee312-e7aa-41c1-a778-ed5ff80419e8 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:01.009286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1ee312-e7aa-41c1-a778-ed5ff80419e8 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:01.242167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:01.251397 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-20d658a7-4094-411e-b380-1f9ada6c6e65 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.286662 Aug 29 04:54:01.265881 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5b1ee312-e7aa-41c1-a778-ed5ff80419e8 tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1616 microversion: 2.1 time: 0.266455 Aug 29 04:54:01.265881 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 535/965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:00 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1616 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:01.267241 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 431/966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:00 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:01.320707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1545333471", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "33cda4a1-ab65-4090-bd93-058f432f3732"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:01.374646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:54:01.375340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1939439341", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c7a66cda-b9d0-4779-80bb-20b936e4acf3"}, {"port": "e51c89e9-9080-422f-9836-19aa7e66d035", "tag": "port-1"}, {"port": "3372f051-9c0d-493f-b763-67cf604a724d", "tag": "port-2"}, {"uuid": "4f26f54c-8b51-4c7c-96b1-33715bdb2f64", "tag": "net-1"}, {"uuid": "4f26f54c-8b51-4c7c-96b1-33715bdb2f64"}, {"uuid": "6005ed5c-53f9-4df7-a165-09413f3d0a3b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6005ed5c-53f9-4df7-a165-09413f3d0a3b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a8c89a1b-ec7c-4bbf-b335-a0be6d764838", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "eda81a05-c9cc-4d24-a973-7c5781de4fbb", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9be16a9c-21e9-4fa8-b555-0c69b287f216", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--98995190"}], "key_name": "tempest-keypair-814986845", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:01.532522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] validate_networks() for [('c7a66cda-b9d0-4779-80bb-20b936e4acf3', None, None, None, None, None), (None, None, 'e51c89e9-9080-422f-9836-19aa7e66d035', None, None, None), (None, None, '3372f051-9c0d-493f-b763-67cf604a724d', None, None, None), ('4f26f54c-8b51-4c7c-96b1-33715bdb2f64', None, None, None, None, None), ('4f26f54c-8b51-4c7c-96b1-33715bdb2f64', None, None, None, None, None), ('6005ed5c-53f9-4df7-a165-09413f3d0a3b', '10.2.2.100', None, None, None, None), ('6005ed5c-53f9-4df7-a165-09413f3d0a3b', '10.2.2.200', None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:54:01.712082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:54:01.712538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:54:01.713035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:54:01.713438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:54:01.713845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:54:01.723186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:01.723663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:01.724095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:01.724944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:01.725308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:01.725724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:01.744377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:54:01.749216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Getting quotas for user 12fbf10dbdfe42a292e3c4e239196e36 and project 38bcab4cb30d4894bdec1572236a6347. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:54:01.761182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:54:01.763515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:54:01.773895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:01.810577 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39fedbc8-cae6-4434-ae9e-1f0059356fee tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494197 Aug 29 04:54:01.817331 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 536/967] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:54:01.821310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:01.822168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:01.829340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:01.829973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:01.830916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:01.831534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:01.832359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:01.833142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:02.042444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:02.050474 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-244a36c6-8431-433e-9c7d-43b635bb44a6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.233013 Aug 29 04:54:02.051607 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 537/968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:01 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:02.056518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:02.057129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:02.062808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:02.063282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:02.063709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:02.064420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:02.064890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:02.065331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:02.308436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:02.318078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de66ba4c-511a-4fca-a73b-764e5ebb33a3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.265106 Aug 29 04:54:02.318981 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 538/969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:02 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:02.323758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:02.324393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:02.330872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:02.331614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:02.332330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:02.333033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:02.333786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:02.334264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:02.421375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:02.429743 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b12532e-8f60-42cf-b778-da5c47e4c702 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1213 microversion: 2.1 time: 0.109547 Aug 29 04:54:02.430306 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 539/970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:02 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:02.439401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:02.440998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:02.447574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:02.448144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:02.448519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:02.449230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:02.449664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:02.450279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:02.657276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:02.665524 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-00003779-3a2f-4ab7-b90a-f1371b65e7f1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.233964 Aug 29 04:54:02.669299 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 540/971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:02 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:03.072296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:03.073201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:03.081398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:03.081895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:03.082331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:03.083034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:03.083488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:03.083930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:03.446547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:03.455907 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c26e1063-b78e-41a7-b9ff-532b83dbb9a7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.387643 Aug 29 04:54:03.456523 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 541/972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:03 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:03.461421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:03.462019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:03.468307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:03.469048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:03.469518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:03.470358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:03.471004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:03.471500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:03.708376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:03.717348 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3ce32b62-58fd-4952-bb7b-87829bbe12ef tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.259653 Aug 29 04:54:03.718530 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 542/973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:03 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:03.723373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:03.724032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:03.731647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:03.732154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:03.732607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:03.733323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:03.733773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:03.734183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:03.815080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:03.823436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc669979-ab08-4ce0-b930-03de6d7dd8ec tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1275 microversion: 2.1 time: 0.104345 Aug 29 04:54:03.831683 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 543/974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:03 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1275 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:03.831683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:03.831683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:03.837913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:03.839111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:03.839552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:03.840361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:03.840809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:03.841541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:04.102800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:04.119769 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-434379fb-cfbe-46a2-b5f5-0b325bf889fd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.294416 Aug 29 04:54:04.120297 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 544/975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:03 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:04.479922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:04.482496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:04.491090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:04.493464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:04.494041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:04.494866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:04.495437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:04.496251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:04.670365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:54:04.672738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:54:04.674318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:54:04.675735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:54:04.676404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:54:04.707160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:04.707991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:04.709862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:04.711123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:04.712200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:04.713796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:04.753526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Getting quotas for project 4757ab0515fe4b6db413ebefc1251588. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:54:04.761234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Getting quotas for user ca81c4e0350646e58b67cc11892cd035 and project 4757ab0515fe4b6db413ebefc1251588. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:54:04.775185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:04.784696 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-be097609-5023-4dea-95d1-daca7b0a8297 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.310725 Aug 29 04:54:04.799390 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 545/976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:04 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:04.802989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:04.804774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:04.815452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:04.815945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:04.816408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:04.817114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:04.817566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:04.822153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:04.870402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:05.025675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:05.033982 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8686a996-5002-45f3-83e9-e3a90f835912 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.245666 Aug 29 04:54:05.034584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 546/977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:04 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:05.047406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7563bb28-d585-4155-9aba-07896dd069cb req-727b8114-d7d5-4df9-83f8-3a7552988fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9bd447c-9443-4a62-b55b-9196a72a886d", "tag": "c35aea71-2499-4604-959f-ec48f6a5f313"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:05.049770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7563bb28-d585-4155-9aba-07896dd069cb req-727b8114-d7d5-4df9-83f8-3a7552988fc1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:05.050514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7563bb28-d585-4155-9aba-07896dd069cb req-727b8114-d7d5-4df9-83f8-3a7552988fc1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:05.050792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7563bb28-d585-4155-9aba-07896dd069cb req-727b8114-d7d5-4df9-83f8-3a7552988fc1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:05.058773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:54:05.062278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a8c89a1b-ec7c-4bbf-b335-a0be6d764838',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='eda81a05-c9cc-4d24-a973-7c5781de4fbb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9be16a9c-21e9-4fa8-b555-0c69b287f216',volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:54:05.063880 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7563bb28-d585-4155-9aba-07896dd069cb req-727b8114-d7d5-4df9-83f8-3a7552988fc1 service nova] Creating event network-changed:c35aea71-2499-4604-959f-ec48f6a5f313 for instance f9bd447c-9443-4a62-b55b-9196a72a886d on n-h2-854119-9 Aug 29 04:54:05.068914 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7563bb28-d585-4155-9aba-07896dd069cb req-727b8114-d7d5-4df9-83f8-3a7552988fc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033173 Aug 29 04:54:05.069518 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 547/978] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:05.074558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:05.075253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:05.083786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:05.084364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:05.084800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:05.085499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:05.085946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:05.086385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:05.418655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:05.427274 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-586ff0f8-5942-435b-b709-cb8f63882f6a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1317 microversion: 2.1 time: 0.356583 Aug 29 04:54:05.440605 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 548/979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:05 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:05.448094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:05.449043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:05.468080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:05.471410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:05.473668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:05.474787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:05.475664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:05.478084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:05.590635 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-67fc3b75-c474-4113-a87f-decbd84e3811 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 4.219300 Aug 29 04:54:05.591798 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 432/980] 10.222.0.20 () {62 vars in 1189 bytes} [Mon Aug 29 04:54:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 4221 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 04:54:05.605470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-446b4ef2-70f2-4b0b-9979-566eb55cf3c1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:05.607979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-446b4ef2-70f2-4b0b-9979-566eb55cf3c1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:05.707402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-446b4ef2-70f2-4b0b-9979-566eb55cf3c1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:05.720304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-446b4ef2-70f2-4b0b-9979-566eb55cf3c1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:05.723361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-446b4ef2-70f2-4b0b-9979-566eb55cf3c1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:05.724946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-446b4ef2-70f2-4b0b-9979-566eb55cf3c1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1285 microversion: 2.32 time: 0.126003 Aug 29 04:54:05.744665 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 433/981] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:05 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:05.760428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:05.784767 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bd0ee700-71e6-418e-bf0b-df81db16993c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.342661 Aug 29 04:54:05.786040 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 549/982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:05 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:05.807355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:05.808331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:05.815430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:05.816182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:05.816757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:05.817601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:05.818468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:05.818856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:06.055886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:06.056932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:06.067429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:06.068243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:06.069250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:06.072954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:06.073711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:06.074271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:06.152044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:06.163085 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-94560044-29ee-4a1c-8f69-f14f0d2802fb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.358665 Aug 29 04:54:06.164445 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 434/983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:05 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:06.340471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:06.352823 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76efc71e-8391-4b36-af66-efc2a98c67df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.301037 Aug 29 04:54:06.354944 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 550/984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:06 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:06.451541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:06.452378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:06.459927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:06.460702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:06.461272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:06.462053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:06.462591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:06.463077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:06.624897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:06.642583 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b6f81d91-7626-49c8-8a10-a1c545dfd951 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1317 microversion: 2.1 time: 0.195303 Aug 29 04:54:06.643634 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 435/985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:06 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:06.755609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:06.756899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:06.763463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:06.764051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:06.764549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:06.765247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:06.765691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:06.766102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:06.805710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:06.806473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:06.812522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:06.813015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:06.813445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:06.814140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:06.814588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:06.815007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:06.887582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:06.898432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:06.900871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:06.902318 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed8f9ed8-180d-42d6-95b8-20889ae2e44d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1575 microversion: 2.32 time: 0.150703 Aug 29 04:54:06.902884 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 551/986] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:06 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:06.979143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:06.986942 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab89fbfb-75d9-4ecd-8acf-30e6380ecd0c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.185042 Aug 29 04:54:06.987503 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 436/987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:06 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:07.189368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:07.190314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:07.197212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.197700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.198130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:07.198816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.199263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.199681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:07.334513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:07.342423 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-15a604d4-398a-47b1-a71a-e9ccb759cee3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.159533 Aug 29 04:54:07.342990 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 552/988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:07 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:07.374995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:07.375626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:07.382206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.382687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.383120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:07.383807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.384297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.384753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:07.517717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:07.525697 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c7f42843-dacc-4513-bf69-3935a2f311df tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.154595 Aug 29 04:54:07.526264 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 437/989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:07 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:07.669301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:07.670199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:07.678254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.678736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.679165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:07.679860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.680368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.680783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:07.747451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68d1c20f-6348-4904-a17c-c0be42177822 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "107e219a-7035-4c08-8c4f-51a5f1e05e97"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:07.749968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68d1c20f-6348-4904-a17c-c0be42177822 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:07.756028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d1c20f-6348-4904-a17c-c0be42177822 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.756622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d1c20f-6348-4904-a17c-c0be42177822 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.757116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d1c20f-6348-4904-a17c-c0be42177822 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:07.757924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d1c20f-6348-4904-a17c-c0be42177822 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.758423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d1c20f-6348-4904-a17c-c0be42177822 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.759415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d1c20f-6348-4904-a17c-c0be42177822 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:07.819300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:07.827168 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0d039177-ba39-41a1-8ca0-1f022251999d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1317 microversion: 2.1 time: 0.164487 Aug 29 04:54:07.828050 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 553/990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:07 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:07.926421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:07.927345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:07.933842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.934571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.934988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:07.935866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:07.936322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:07.936949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.040522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:08.050583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:08.052110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:08.053367 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf1b87c0-9576-49d6-b0aa-2fb9d2c5ccc8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1583 microversion: 2.32 time: 0.131451 Aug 29 04:54:08.054001 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 554/991] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:07 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1583 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:54:08.059728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:08.060533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:08.068853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:08.069653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:08.071161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.072147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:08.073362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:08.073761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.181857 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68d1c20f-6348-4904-a17c-c0be42177822 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "POST /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438310 Aug 29 04:54:08.184339 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 438/992] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 04:54:07 2022] POST /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:08.255047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:08.270803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-48265c24-a64d-41de-bf6c-7996a3a43cc9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.215312 Aug 29 04:54:08.271793 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 555/993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:08 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:08.364724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:08.365490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:08.371929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:08.372443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:08.372908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.373618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:08.374052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:08.374457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.404868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-81d55edd-02db-4efb-98ba-d769d8cb60ba req-64476fae-193c-477a-8192-4c02d16bedb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c9b159-0dc2-4520-95ea-01bea5848a83", "name": "network-vif-plugged", "status": "completed", "tag": "ab2261dd-06cc-4525-b84d-5964ae7d42b7"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:08.415766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-81d55edd-02db-4efb-98ba-d769d8cb60ba req-64476fae-193c-477a-8192-4c02d16bedb7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:08.416500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-81d55edd-02db-4efb-98ba-d769d8cb60ba req-64476fae-193c-477a-8192-4c02d16bedb7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:08.416916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-81d55edd-02db-4efb-98ba-d769d8cb60ba req-64476fae-193c-477a-8192-4c02d16bedb7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.430116 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-81d55edd-02db-4efb-98ba-d769d8cb60ba req-64476fae-193c-477a-8192-4c02d16bedb7 service nova] Creating event network-vif-plugged:ab2261dd-06cc-4525-b84d-5964ae7d42b7 for instance d7c9b159-0dc2-4520-95ea-01bea5848a83 on n-h1-854119-9 Aug 29 04:54:08.435343 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-81d55edd-02db-4efb-98ba-d769d8cb60ba req-64476fae-193c-477a-8192-4c02d16bedb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035074 Aug 29 04:54:08.437153 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 556/994] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:08.550054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:08.550054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:08.558204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:08.558871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:08.559301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.560094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:08.560577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:08.561165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.629789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:08.641395 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44eeaabd-ade5-4656-ba8b-9f99a2e4918c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.281808 Aug 29 04:54:08.642259 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 439/995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:08 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:08.849120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:08.850135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:08.856928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:08.857866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:08.858650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.859740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:08.861443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:08.862269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:08.949917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:08.959450 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-971fbd17-b4d1-4e94-a107-89daeae23e00 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.416497 Aug 29 04:54:08.960310 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 557/996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:08 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:09.078256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:09.079108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:09.085737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:09.086499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:09.087081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:09.088159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:09.088760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:09.089348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:09.155763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:09.175063 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4734987b-3d18-479a-8c7e-837fc224b889 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1317 microversion: 2.1 time: 0.330554 Aug 29 04:54:09.193404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:09.193612 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 440/997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:08 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:09.204915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:09.206654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:09.207972 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cdd9181b-3068-44c7-a871-debddd48fc56 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1593 microversion: 2.32 time: 0.133963 Aug 29 04:54:09.209134 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 558/998] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:09 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1593 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:54:09.293007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:09.293797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:09.310661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:09.312601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:09.313638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:09.315153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:09.316282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:09.317375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:09.586465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:09.597881 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-666f708a-439f-4c9f-b133-f889d775edea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.309914 Aug 29 04:54:09.598594 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 441/999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:09 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:09.666074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:09.667130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:09.674415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:09.675089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:09.675515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:09.676400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:09.676996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:09.677600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:09.887991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:09.904296 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f34aa240-7ffd-43fa-9df2-64ba1354dd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.241935 Aug 29 04:54:09.905807 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 559/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:09 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:09.982811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:09.983610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:09.991995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:09.993133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:09.993827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:09.994918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:09.996233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:09.997077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:10.201418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:10.204642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:10.213996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:10.214852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:10.215524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:10.216599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:10.217275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:10.217980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:10.591330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:10.604063 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3fcb009a-363b-4c91-9302-d6321d70cf10 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.625828 Aug 29 04:54:10.604723 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 442/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:09 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:10.606389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:10.610654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:10.612426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:10.619501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:10.620647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:10.621271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:10.622013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:10.623140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:10.623567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:10.632385 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9801005-e339-4069-af6e-997eeff900ab tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1317 microversion: 2.1 time: 0.436883 Aug 29 04:54:10.652679 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 560/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:10 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:10.667143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:10.668324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:10.685138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:10.685780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:10.688240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:10.689105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:10.689703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:10.691069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:11.058632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:11.062232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:11.070171 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2fd0c68d-2cb7-4e1b-a4a5-1ad2c9c26906 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.414713 Aug 29 04:54:11.070745 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 561/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:10 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:11.075506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:11.076103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:11.076291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:11.078529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:11.080230 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-55f731ba-4913-42e5-93ab-7af9d2376ecf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1704 microversion: 2.32 time: 0.474372 Aug 29 04:54:11.093606 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 443/1004] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:10 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1704 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:11.095283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:11.096022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:11.096644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:11.097377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:11.097823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:11.098410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:11.356005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:11.365798 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b7ca977f-5457-455a-9477-472a9f4fdd31 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1361 microversion: 2.1 time: 0.293816 Aug 29 04:54:11.367126 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 562/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:11 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:11.626128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:11.628560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:11.648499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:11.649644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:11.650673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:11.653603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:11.654373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:11.655029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:11.657872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:11.658578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:11.667447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:11.668217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:11.668830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:11.669691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:11.670291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:11.670963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:11.733216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:11.756314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=14 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:12.001006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:12.010276 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bb1bcb9-d6b5-4f94-b681-86d275731dee tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.388153 Aug 29 04:54:12.026251 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 444/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:11 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:12.034686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:12.044470 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c7b781d8-ca4d-415c-91c6-452144671c84 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1317 microversion: 2.1 time: 0.391135 Aug 29 04:54:12.045281 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 563/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:11 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:12.096171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:12.096819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:12.103958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:12.104618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:12.106117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:12.106614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:12.107047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:12.107774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:12.108439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:12.109184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:12.114884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:12.115487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:12.116167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:12.117767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:12.118334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:12.118842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:12.127933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:12.430435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:12.438515 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0dc14220-6021-4da8-a81f-f9a28ca0c0d0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.347718 Aug 29 04:54:12.439116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:12.452958 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 445/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:12 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:12.453572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:12.455992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:12.458096 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8899efcc-5aa3-4976-841d-2aeacce990c0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1749 microversion: 2.32 time: 0.357713 Aug 29 04:54:12.458989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:12.459725 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 564/1009] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:12 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1749 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:54:12.460051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:12.469597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:12.470481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:12.471200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:12.472340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:12.473275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:12.474929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:12.479423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:12.702160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:12.711837 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a4cbec3-c2c6-46fe-b695-6599852bf8c9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1544 microversion: 2.1 time: 0.257431 Aug 29 04:54:12.712763 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 446/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:12 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:12.732856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e808eb2f-3f38-476a-bcb3-3d9ddb772ac1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:12.733375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e808eb2f-3f38-476a-bcb3-3d9ddb772ac1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:12.739929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e808eb2f-3f38-476a-bcb3-3d9ddb772ac1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:12.740698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e808eb2f-3f38-476a-bcb3-3d9ddb772ac1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:12.741123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e808eb2f-3f38-476a-bcb3-3d9ddb772ac1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:12.741803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e808eb2f-3f38-476a-bcb3-3d9ddb772ac1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:12.742409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e808eb2f-3f38-476a-bcb3-3d9ddb772ac1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:12.742983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e808eb2f-3f38-476a-bcb3-3d9ddb772ac1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:12.860968 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e808eb2f-3f38-476a-bcb3-3d9ddb772ac1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131957 Aug 29 04:54:12.869385 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 565/1011] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 04:54:12 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:13.033988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:13.034598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:13.041022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:13.041507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:13.041932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:13.042621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:13.047293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:13.047745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:13.066998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:13.067942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:13.074452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:13.075263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:13.075914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:13.076698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:13.077334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:13.078279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:13.303551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:13.313290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-257cc315-7f1c-4e71-a504-afbb7582f518 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1317 microversion: 2.1 time: 0.250252 Aug 29 04:54:13.325577 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 566/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:13 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:13.465120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:13.466710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:13.473649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:13.474369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:13.475023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:13.478924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:13.479759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:13.480392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:13.520933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:13.529999 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b32d9b12-5a2b-4d9c-afe6-9282542a75d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.499892 Aug 29 04:54:13.543670 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 447/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:13 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:13.549075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:13.549882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:13.556064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:13.556814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:13.557404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:13.558240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:13.558829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:13.559388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:13.819177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:13.830822 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78b59fcc-05a2-44fe-aabe-4ebe627617ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.369696 Aug 29 04:54:13.844523 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 567/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:13 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:13.869548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:13.879748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:13.883380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:13.887756 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8661ef6c-b556-41e9-b78b-b47cdefacce2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1794 microversion: 2.32 time: 0.339500 Aug 29 04:54:13.897066 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 448/1015] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:13 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1794 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:13.988197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-cdcb0b93-a485-43ab-9105-48d336dd711b req-f8f47c37-c916-41ca-9908-0b5b2e3577f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bd447c-9443-4a62-b55b-9196a72a886d", "name": "network-vif-plugged", "status": "completed", "tag": "c35aea71-2499-4604-959f-ec48f6a5f313"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:14.016605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cdcb0b93-a485-43ab-9105-48d336dd711b req-f8f47c37-c916-41ca-9908-0b5b2e3577f3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.017103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cdcb0b93-a485-43ab-9105-48d336dd711b req-f8f47c37-c916-41ca-9908-0b5b2e3577f3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.017535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cdcb0b93-a485-43ab-9105-48d336dd711b req-f8f47c37-c916-41ca-9908-0b5b2e3577f3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:14.043884 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-cdcb0b93-a485-43ab-9105-48d336dd711b req-f8f47c37-c916-41ca-9908-0b5b2e3577f3 service nova] Creating event network-vif-plugged:c35aea71-2499-4604-959f-ec48f6a5f313 for instance f9bd447c-9443-4a62-b55b-9196a72a886d on n-h2-854119-9 Aug 29 04:54:14.058455 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-cdcb0b93-a485-43ab-9105-48d336dd711b req-f8f47c37-c916-41ca-9908-0b5b2e3577f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074495 Aug 29 04:54:14.059300 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 568/1016] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:14.337590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:14.338292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:14.349189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.349567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.349997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:14.350701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.351146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.357239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:14.508313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-25a36387-a02c-470d-ba62-9856807ca4ff req-f7ae7958-79f3-46bd-88ea-97023c60bf4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c9b159-0dc2-4520-95ea-01bea5848a83", "tag": "ab2261dd-06cc-4525-b84d-5964ae7d42b7"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:14.519094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-25a36387-a02c-470d-ba62-9856807ca4ff req-f7ae7958-79f3-46bd-88ea-97023c60bf4a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.519581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-25a36387-a02c-470d-ba62-9856807ca4ff req-f7ae7958-79f3-46bd-88ea-97023c60bf4a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.520010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-25a36387-a02c-470d-ba62-9856807ca4ff req-f7ae7958-79f3-46bd-88ea-97023c60bf4a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:14.533473 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-25a36387-a02c-470d-ba62-9856807ca4ff req-f7ae7958-79f3-46bd-88ea-97023c60bf4a service nova] Creating event network-changed:ab2261dd-06cc-4525-b84d-5964ae7d42b7 for instance d7c9b159-0dc2-4520-95ea-01bea5848a83 on n-h1-854119-9 Aug 29 04:54:14.538994 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-25a36387-a02c-470d-ba62-9856807ca4ff req-f7ae7958-79f3-46bd-88ea-97023c60bf4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034549 Aug 29 04:54:14.543180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 569/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:14.564646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:14.566316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:14.573678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:14.583000 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b8a162b9-eee3-4fcb-9487-a3ade128fd51 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1317 microversion: 2.1 time: 0.250081 Aug 29 04:54:14.586180 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 449/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:14 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:14.600747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.601679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.602321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:14.603276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.603638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.603981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:14.853194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:14.855403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:14.864440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:14.867494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.868190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.868834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:14.869698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.873165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.873912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:14.925265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:14.935044 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a589ecda-671b-4640-93e1-087c09ba2039 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.387117 Aug 29 04:54:14.936357 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 570/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:14 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:14.944307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:14.945500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:14.958637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.959186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.960220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:14.964097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:14.965030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:14.966034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:15.383260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:15.409786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:15.419633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:15.421109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:15.421255 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1d44ed0-f290-4229-8e47-a0121f58fa95 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.572989 Aug 29 04:54:15.422264 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6cd39226-28e2-4782-b69d-c9ef0ea49256 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1839 microversion: 2.32 time: 0.484687 Aug 29 04:54:15.422821 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 571/1020] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:14 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1839 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:15.436458 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 450/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:14 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:15.609341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:15.610869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:15.618255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:15.623966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:15.637532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:15.643039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:15.643530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:15.646870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:15.957570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:15.959095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:15.962032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=24 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:15.967077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:15.967772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:15.968396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:15.969341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:15.969792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:15.970390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:16.115346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:16.127383 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7796ac3c-e495-4a91-9d9a-013554f04bf3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1317 microversion: 2.1 time: 0.521941 Aug 29 04:54:16.141765 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 572/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:15 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:16.232982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-bf846e58-9690-4768-9fa2-6e0c6cdb8f1a req-5f73497f-0ec4-4d13-9c79-770a0ce8b7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "tag": "9da0fa16-4ab8-435c-abe2-442d313636cf"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:16.254670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bf846e58-9690-4768-9fa2-6e0c6cdb8f1a req-5f73497f-0ec4-4d13-9c79-770a0ce8b7f1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:16.259332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bf846e58-9690-4768-9fa2-6e0c6cdb8f1a req-5f73497f-0ec4-4d13-9c79-770a0ce8b7f1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:16.260019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bf846e58-9690-4768-9fa2-6e0c6cdb8f1a req-5f73497f-0ec4-4d13-9c79-770a0ce8b7f1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:16.274565 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-bf846e58-9690-4768-9fa2-6e0c6cdb8f1a req-5f73497f-0ec4-4d13-9c79-770a0ce8b7f1 service nova] Creating event network-changed:9da0fa16-4ab8-435c-abe2-442d313636cf for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:54:16.281251 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-bf846e58-9690-4768-9fa2-6e0c6cdb8f1a req-5f73497f-0ec4-4d13-9c79-770a0ce8b7f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058973 Aug 29 04:54:16.282688 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 573/1023] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:16.319083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:16.326998 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ad8d944-ac7b-49a7-ba97-150034f43e25 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.374083 Aug 29 04:54:16.327560 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 451/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:15 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:16.444051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:16.444915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:16.455562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:16.456216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:16.464659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:16.465147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:16.465574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:16.466263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:16.466723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:16.467139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:16.473067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:16.473567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:16.474003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:16.476521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:16.477006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:16.477440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:16.936169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:16.947990 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5f058b96-1eee-4760-bcb4-1e61a90850a0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.508387 Aug 29 04:54:16.949393 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 574/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:16 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:17.020165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:17.031152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:17.032718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:17.034086 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dafaf6e8-f4f6-4708-bdba-17475ff413db tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1839 microversion: 2.32 time: 0.582968 Aug 29 04:54:17.034842 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 452/1026] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:16 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1839 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:54:17.151189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:17.151802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:17.158787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.159310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.159959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.160876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.161327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.161749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.349272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:17.349906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:17.350787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:17.357572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.358381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.358916 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-53b761b6-ddb9-477a-8dd9-b87361661a85 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1467 microversion: 2.1 time: 0.211908 Aug 29 04:54:17.359527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.360631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.361298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.361980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.370691 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 575/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:17 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1467 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:17.381688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-99c840ea-bedb-4e92-9d0f-087e622219da tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:17.383809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-99c840ea-bedb-4e92-9d0f-087e622219da tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:17.393318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99c840ea-bedb-4e92-9d0f-087e622219da tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.394181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99c840ea-bedb-4e92-9d0f-087e622219da tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.395627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99c840ea-bedb-4e92-9d0f-087e622219da tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.396802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99c840ea-bedb-4e92-9d0f-087e622219da tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.397488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99c840ea-bedb-4e92-9d0f-087e622219da tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.398337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99c840ea-bedb-4e92-9d0f-087e622219da tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.724004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:17.732246 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-11d564e4-449f-4406-916d-9dc75bbc5ce7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.386642 Aug 29 04:54:17.737027 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 453/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:17 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:17.751953 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-99c840ea-bedb-4e92-9d0f-087e622219da tempest-ServersOnMultiNodesTest-1570154309 tempest-ServersOnMultiNodesTest-1570154309-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1618 microversion: 2.1 time: 0.376547 Aug 29 04:54:17.770803 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 576/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:17 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1618 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:17.778969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:17.780626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:17.789442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.790279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.790919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.791822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.792515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.793692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.823770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:17.954203 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a4ab36ca-86d1-48af-afc9-2e0366f063e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 204 len: 0 microversion: 2.1 time: 0.179635 Aug 29 04:54:17.956528 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 454/1030] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:17 2022] DELETE /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:17.964414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:17.965921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:17.971863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:17.972875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.973075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:17.973684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.974503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.975367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.975961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.976561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.983735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.984455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.985010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:17.985843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:17.986552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:17.987061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:18.298551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:18.313812 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-61986b04-0e66-4eb4-bf4f-5a8a4b330eb4 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1473 microversion: 2.1 time: 0.353904 Aug 29 04:54:18.314512 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 577/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:17 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:18.320546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:18.321458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:18.329990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:18.330482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:18.330905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:18.331590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:18.331696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:18.332113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:18.332476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:18.342535 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-94309a33-27d4-4ab1-84f4-4757a1d84276 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.375845 Aug 29 04:54:18.343484 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 455/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:17 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:18.348225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-39fe1b3c-d42f-4131-9711-bdc6c9dc8556 req-cf8d8016-9b64-447f-9be2-ae2d7d6aba2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "tag": "e51c89e9-9080-422f-9836-19aa7e66d035"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:18.363106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-39fe1b3c-d42f-4131-9711-bdc6c9dc8556 req-cf8d8016-9b64-447f-9be2-ae2d7d6aba2e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:18.363720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-39fe1b3c-d42f-4131-9711-bdc6c9dc8556 req-cf8d8016-9b64-447f-9be2-ae2d7d6aba2e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:18.367301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-39fe1b3c-d42f-4131-9711-bdc6c9dc8556 req-cf8d8016-9b64-447f-9be2-ae2d7d6aba2e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:18.379987 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-39fe1b3c-d42f-4131-9711-bdc6c9dc8556 req-cf8d8016-9b64-447f-9be2-ae2d7d6aba2e service nova] Creating event network-changed:e51c89e9-9080-422f-9836-19aa7e66d035 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:54:18.389533 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-39fe1b3c-d42f-4131-9711-bdc6c9dc8556 req-cf8d8016-9b64-447f-9be2-ae2d7d6aba2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044752 Aug 29 04:54:18.390382 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 456/1033] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:18.622941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:18.636061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:18.638990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:18.640432 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-947e8c95-499b-447e-8c9c-4a35f26868e2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.324710 Aug 29 04:54:18.641597 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 578/1034] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:18 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:18.758885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:18.759558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:18.766251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:18.766727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:18.767149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:18.767929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:18.768411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:18.768824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:18.910097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:18.918169 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d06b6b5e-b397-4f30-9dd9-4e18acadc642 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.164110 Aug 29 04:54:18.918847 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 457/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:18 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:19.335196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:19.336325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:19.343945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:19.344433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:19.345066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:19.345869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:19.346496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:19.347029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:19.366283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:19.369230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:19.384072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:19.385952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:19.386789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:19.388736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:19.390300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:19.391626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:19.682949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:19.693144 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1f4de209-5ee3-4b16-9bc9-81a5ba2beae7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1473 microversion: 2.1 time: 0.361849 Aug 29 04:54:19.694681 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 579/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:19 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1473 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:19.700227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:19.701050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:19.707903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:19.708757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:19.709291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:19.710791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:19.711708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:19.712917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:19.713544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:19.716630 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bfd9c485-d87e-4c3e-8c16-a818dea14132 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1542 microversion: 2.1 time: 0.356961 Aug 29 04:54:19.717197 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 458/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:19 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1542 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:19.940222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:19.941369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:19.950501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:19.951483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:19.952184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:19.953926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:19.954744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:19.955595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:20.662962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:20.710694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:20.714364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:20.715761 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f7f613c4-e294-49d9-8251-ea9f3a344813 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 1.019577 Aug 29 04:54:20.747362 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 580/1038] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:19 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:20.760146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5f4f338d-993a-43af-b8ef-57631fbd0aaf req-439b0baa-b889-4326-9a48-c5e9bacd8e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bd447c-9443-4a62-b55b-9196a72a886d", "name": "network-vif-deleted", "tag": "c35aea71-2499-4604-959f-ec48f6a5f313"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:20.769617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:20.778717 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4e7d91d1-2919-4a05-bb52-4e59761f5525 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.843070 Aug 29 04:54:20.779636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5f4f338d-993a-43af-b8ef-57631fbd0aaf req-439b0baa-b889-4326-9a48-c5e9bacd8e00 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:20.780152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5f4f338d-993a-43af-b8ef-57631fbd0aaf req-439b0baa-b889-4326-9a48-c5e9bacd8e00 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:20.780581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5f4f338d-993a-43af-b8ef-57631fbd0aaf req-439b0baa-b889-4326-9a48-c5e9bacd8e00 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:20.787833 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 459/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:19 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:20.793462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1c11a50e-f286-4fab-9b5b-0135ad54161c req-85da0ee1-eba4-48c2-8841-bd254337f05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "tag": "3372f051-9c0d-493f-b763-67cf604a724d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:20.807825 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5f4f338d-993a-43af-b8ef-57631fbd0aaf req-439b0baa-b889-4326-9a48-c5e9bacd8e00 service nova] Creating event network-vif-deleted:c35aea71-2499-4604-959f-ec48f6a5f313 for instance f9bd447c-9443-4a62-b55b-9196a72a886d on n-h2-854119-9 Aug 29 04:54:20.812691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1c11a50e-f286-4fab-9b5b-0135ad54161c req-85da0ee1-eba4-48c2-8841-bd254337f05c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:20.816404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1c11a50e-f286-4fab-9b5b-0135ad54161c req-85da0ee1-eba4-48c2-8841-bd254337f05c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:20.824788 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5f4f338d-993a-43af-b8ef-57631fbd0aaf req-439b0baa-b889-4326-9a48-c5e9bacd8e00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067003 Aug 29 04:54:20.825647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1c11a50e-f286-4fab-9b5b-0135ad54161c req-85da0ee1-eba4-48c2-8841-bd254337f05c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:20.827905 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 581/1040] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:20.845457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:20.846535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:20.855624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:20.856440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:20.857033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:20.857951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:20.858542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:20.859121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:20.860852 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1c11a50e-f286-4fab-9b5b-0135ad54161c req-85da0ee1-eba4-48c2-8841-bd254337f05c service nova] Creating event network-changed:3372f051-9c0d-493f-b763-67cf604a724d for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:54:20.875927 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1c11a50e-f286-4fab-9b5b-0135ad54161c req-85da0ee1-eba4-48c2-8841-bd254337f05c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086757 Aug 29 04:54:20.882961 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 460/1041] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:20.889695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:20.903383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:20.916424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:20.923352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:20.927186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:20.928205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:20.928886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:20.929522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:20.948598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:20.951757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:20.951757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:20.956696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lazy-loading 'fault' on Instance uuid f9bd447c-9443-4a62-b55b-9196a72a886d {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:21.126973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:21.138786 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-63515d70-973c-4b64-9a56-809656498e59 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 200 len: 1307 microversion: 2.1 time: 0.308367 Aug 29 04:54:21.139745 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 582/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:20 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 1307 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:21.494253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:21.504893 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a731009e-01de-4e6c-9388-ae0c151e49ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1541 microversion: 2.1 time: 0.619343 Aug 29 04:54:21.505813 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 461/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:20 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1541 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:21.743321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:21.744625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:21.752505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:21.753224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:21.753827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:21.754519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:21.755112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:21.755528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:21.772564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:21.812866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:21.814081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:21.820094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:21.820596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:21.821198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:21.821889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:21.822333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:21.822903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:21.842911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:22.304610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:22.314127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:22.322617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:22.328854 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aa994956-c06f-4e3d-b86c-5bb875b2cade tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.519129 Aug 29 04:54:22.344883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:22.344883 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e130597-e760-4fd7-82d1-c22aee7c30d1 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.591885 Aug 29 04:54:22.344883 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 583/1044] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:21 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:22.347431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:22.348248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: f9bd447c-9443-4a62-b55b-9196a72a886d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:22.350841 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 462/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:21 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:22.352404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:22.357809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:22.358261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:22.358684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:22.359396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:22.359831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:22.360553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:22.376349 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] HTTP exception thrown: Instance f9bd447c-9443-4a62-b55b-9196a72a886d could not be found. Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Request method failure captured: Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d HTTP/1.1 Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXmZ61QjiDxll7vMGfu5O06pHptECUVnpAoLYjE-L86c4NvnxoMWVYRpXwz3ZNhyO-VOvRf_w9W5rT3cdSKHKEbPR6QLaEmdRipJvMamxxqERTUZ6CCnfZEVJvudVeLdqnmdnkk5QuVuoDgPn3P_THedQwkapA5ilqJuEE7erdwrvA Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:54:22.378357 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38bcab4cb30d4894bdec1572236a6347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 12fbf10dbdfe42a292e3c4e239196e36 Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance f9bd447c-9443-4a62-b55b-9196a72a886d could not be found. Aug 29 04:54:22.379902 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'f9bd447c-9443-4a62-b55b-9196a72a886d'} Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9bd447c-9443-4a62-b55b-9196a72a886d could not be found. Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:22.380809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9bd447c-9443-4a62-b55b-9196a72a886d could not be found. Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9bd447c-9443-4a62-b55b-9196a72a886d could not be found. Aug 29 04:54:22.382115 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:22.384495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Returning 404 to user: Instance f9bd447c-9443-4a62-b55b-9196a72a886d could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:22.385529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16200cdd-cbca-4fec-8693-fa81e471665c tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d" status: 404 len: 111 microversion: 2.1 time: 0.052721 Aug 29 04:54:22.386102 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 584/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:22 2022] GET /compute/v2.1/servers/f9bd447c-9443-4a62-b55b-9196a72a886d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:22.402917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:22.403510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:22.410927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:22.411504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:22.412001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:22.412794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:22.413334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:22.413822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:22.440405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:22.527374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:22.528335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:22.535065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:22.536429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:22.537042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:22.538423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:22.539040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:22.539617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:22.543108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:22.553509 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-116055f0-4f87-4e63-99b6-0dbe05ce23f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 204 len: 0 microversion: 2.1 time: 0.154198 Aug 29 04:54:22.557159 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 463/1047] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:22 2022] DELETE /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:22.564823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:22.565599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:22.573930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:22.574602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:22.575255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:22.576205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:22.576816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:22.577442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:22.949287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:22.957652 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a927af5-1f13-425f-bfe8-9193120344f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1541 microversion: 2.1 time: 0.434103 Aug 29 04:54:22.958219 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 585/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:22 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1541 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:22.979277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:22.987514 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-98f665d9-93c1-471c-854a-7d462aa86148 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1471 microversion: 2.1 time: 0.428419 Aug 29 04:54:23.000141 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 464/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:22 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1471 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:23.033507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-aca04e0b-2ee4-4b62-861d-6b603b869d97 req-0cbf00d6-4709-4fe6-b950-c828c2313e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "tag": "1e83970a-7e64-4b23-bf48-2452589a5692"}, {"server_uuid": "20b820ba-bc27-4a3b-81a0-43a45340f60b", "name": "network-vif-unplugged", "status": "completed", "tag": "bbab69b1-3249-4a95-ba39-0f3c3196a9e2"}, {"name": "network-changed", "server_uuid": "20b820ba-bc27-4a3b-81a0-43a45340f60b", "tag": "bbab69b1-3249-4a95-ba39-0f3c3196a9e2"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:23.045842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-aca04e0b-2ee4-4b62-861d-6b603b869d97 req-0cbf00d6-4709-4fe6-b950-c828c2313e49 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:23.046705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-aca04e0b-2ee4-4b62-861d-6b603b869d97 req-0cbf00d6-4709-4fe6-b950-c828c2313e49 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:23.047045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-aca04e0b-2ee4-4b62-861d-6b603b869d97 req-0cbf00d6-4709-4fe6-b950-c828c2313e49 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:23.063456 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-aca04e0b-2ee4-4b62-861d-6b603b869d97 req-0cbf00d6-4709-4fe6-b950-c828c2313e49 service nova] Creating event network-changed:1e83970a-7e64-4b23-bf48-2452589a5692 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:54:23.064044 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-aca04e0b-2ee4-4b62-861d-6b603b869d97 req-0cbf00d6-4709-4fe6-b950-c828c2313e49 service nova] Creating event network-vif-unplugged:bbab69b1-3249-4a95-ba39-0f3c3196a9e2 for instance 20b820ba-bc27-4a3b-81a0-43a45340f60b on n-h2-854119-9 Aug 29 04:54:23.064688 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-aca04e0b-2ee4-4b62-861d-6b603b869d97 req-0cbf00d6-4709-4fe6-b950-c828c2313e49 service nova] Creating event network-changed:bbab69b1-3249-4a95-ba39-0f3c3196a9e2 for instance 20b820ba-bc27-4a3b-81a0-43a45340f60b on n-h2-854119-9 Aug 29 04:54:23.070626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-aca04e0b-2ee4-4b62-861d-6b603b869d97 req-0cbf00d6-4709-4fe6-b950-c828c2313e49 service nova] Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:54:23.084906 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-aca04e0b-2ee4-4b62-861d-6b603b869d97 req-0cbf00d6-4709-4fe6-b950-c828c2313e49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.056157 Aug 29 04:54:23.085773 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 586/1050] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:23.355885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:23.356406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:23.359304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:23.359954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:23.363868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:23.364458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:23.364965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:23.365781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:23.366291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:23.366780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:23.367822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:23.368569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:23.369162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:23.369996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:23.370586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:23.371149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:23.656395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:23.662862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:23.665667 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1f8aee04-9daa-42a5-890c-8c9cf328276c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.314299 Aug 29 04:54:23.666261 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 465/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:23 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:23.672496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:23.673931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:23.675109 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d141ae1e-9077-48b0-a2b1-6b3b4bcee485 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.320558 Aug 29 04:54:23.675659 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 587/1052] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:23 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:23.981637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:23.983650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:23.992640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:23.992995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:23.993445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:23.994537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:23.995271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:23.995656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:24.009108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:24.010279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:24.018604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:24.019300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:24.020240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:24.021111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:24.021528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:24.022169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:24.196409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:24.199706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:24.204623 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cfe1492e-06b1-475f-9eb9-4f2bf353fdaf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1473 microversion: 2.1 time: 0.228662 Aug 29 04:54:24.205250 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 466/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:23 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:24.208625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-35590c83-e7f1-41d5-80e8-45ef3fa845c2 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1471 microversion: 2.1 time: 0.203265 Aug 29 04:54:24.209256 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 588/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:24 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:24.687320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:24.688029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:24.695381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:24.696014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:24.696717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:24.697528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:24.698075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:24.698586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:24.698710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:24.699237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:24.707779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:24.708203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:24.708646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:24.709339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:24.709787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:24.710208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:25.394072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:25.402502 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f833a2f4-8cea-4aa0-b2aa-fc5ff5eeb262 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.719262 Aug 29 04:54:25.403078 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 467/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:24 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:25.416695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4a863fc8-4905-4c67-aeb1-1cf26b2a4510 req-40b776d1-6bd4-4c5b-9fc2-91882fcad574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "tag": "e6173923-7d90-4415-821f-4e432a713b3e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:25.417852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4a863fc8-4905-4c67-aeb1-1cf26b2a4510 req-40b776d1-6bd4-4c5b-9fc2-91882fcad574 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:25.418331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4a863fc8-4905-4c67-aeb1-1cf26b2a4510 req-40b776d1-6bd4-4c5b-9fc2-91882fcad574 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:25.418753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4a863fc8-4905-4c67-aeb1-1cf26b2a4510 req-40b776d1-6bd4-4c5b-9fc2-91882fcad574 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:25.431106 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4a863fc8-4905-4c67-aeb1-1cf26b2a4510 req-40b776d1-6bd4-4c5b-9fc2-91882fcad574 service nova] Creating event network-changed:e6173923-7d90-4415-821f-4e432a713b3e for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:54:25.433250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:25.437169 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4a863fc8-4905-4c67-aeb1-1cf26b2a4510 req-40b776d1-6bd4-4c5b-9fc2-91882fcad574 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032230 Aug 29 04:54:25.437938 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 468/1056] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:25.443889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:25.445398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:25.445977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:25.446569 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af93c2e9-200d-484a-a8c6-97921ff44f8b tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.752022 Aug 29 04:54:25.446709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:25.447995 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 589/1057] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:24 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:25.453412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:25.453711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:25.453889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:25.454317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:25.454782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:25.455037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:25.455480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:25.455891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:25.461760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:25.462489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:25.463961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:25.464847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:25.465257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:25.465672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:25.723611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:25.731823 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1a9d6968-34d1-43d5-9302-6f0f61794f7c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1473 microversion: 2.1 time: 0.292245 Aug 29 04:54:25.732503 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 469/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:25 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1473 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:25.737606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:25.745941 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9aa54d5e-c64f-47ff-91ec-4f751672b285 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1471 microversion: 2.1 time: 0.296084 Aug 29 04:54:25.746534 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 590/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:25 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:26.425982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:26.427407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:26.437622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:26.439123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:26.439752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:26.441303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:26.441968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:26.442542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:26.450606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7f15b080-56fd-4bd9-af0d-ca991170fdde"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:26.453969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:26.460884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:26.462034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:26.462623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:26.463482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:26.464262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:26.466521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:26.609043 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] HTTP exception thrown: Volume 7f15b080-56fd-4bd9-af0d-ca991170fdde could not be found. Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Request method failure captured: Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments/107e219a-7035-4c08-8c4f-51a5f1e05e97 HTTP/1.1 Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 74 Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEYGkuTbFus4WdwQTcLstGYpIBD3ViWxYElNvvrQRQNkEWo44B0sdWxIyqpDs3QaB2EgL0CRl3TEXm5qNek2hni870EnuTvb8QFMc7nD2oz6vekqs-C4118DGADMmv-Va_aEOnydTVfnszHkyiiFeCl8iWUUDdQThgo-5iGSG6Sgpyc Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 63c88f74577b4fba833f79d481da2ae2 Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesAdminNegativeTest-15591133 Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:54:26.613114 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63c88f74577b4fba833f79d481da2ae2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63c88f74577b4fba833f79d481da2ae2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63c88f74577b4fba833f79d481da2ae2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63c88f74577b4fba833f79d481da2ae2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesAdminNegativeTest-15591133 Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 63c88f74577b4fba833f79d481da2ae2 Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-15591133 Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesAdminNegativeTest-15591133-project-admin Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5e49d93796d54b729adca1febd2d7716 Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesAdminNegativeTest-15591133-project-admin Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: {"volumeAttachment": {"volumeId": "7f15b080-56fd-4bd9-af0d-ca991170fdde"}} Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:26.614728 n-d-854119-9 devstack@n-api.service[128871]: exception: Volume 7f15b080-56fd-4bd9-af0d-ca991170fdde could not be found. Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': 'c1b8c9c9-249d-412e-86ca-35d59cbdd971', 'id': '107e219a-7035-4c08-8c4f-51a5f1e05e97', 'body': {'volumeAttachment': {'volumeId': '7f15b080-56fd-4bd9-af0d-ca991170fdde'}}} Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 04:54:26.615697 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f15b080-56fd-4bd9-af0d-ca991170fdde could not be found. (HTTP 404) (Request-ID: req-e8372a76-2a04-470d-a4c9-bd63d95042be) Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 04:54:26.616934 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f15b080-56fd-4bd9-af0d-ca991170fdde could not be found. Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:26.618580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 7f15b080-56fd-4bd9-af0d-ca991170fdde could not be found. Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f15b080-56fd-4bd9-af0d-ca991170fdde could not be found. Aug 29 04:54:26.619860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:26.622235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Returning 400 to user: Volume 7f15b080-56fd-4bd9-af0d-ca991170fdde could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:26.623112 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d8d7e69-304c-47a6-bfd0-57737a905d83 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments/107e219a-7035-4c08-8c4f-51a5f1e05e97" status: 400 len: 107 microversion: 2.1 time: 0.301447 Aug 29 04:54:26.623691 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 470/1060] 10.222.0.20 () {60 vars in 1433 bytes} [Mon Aug 29 04:54:26 2022] PUT /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments/107e219a-7035-4c08-8c4f-51a5f1e05e97 => generated 107 bytes in 303 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:54:26.633559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:26.637031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:26.657088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:26.657787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:26.658405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:26.659257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:26.659865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:26.660499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:26.979976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:26.991667 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6b278e0a-d448-4d7b-a023-25863fafae89 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.571913 Aug 29 04:54:27.007180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 591/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:26 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:27.017520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:27.018831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:27.027338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:27.028148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:27.028990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:27.029970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:27.030636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:27.031268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:27.223061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lazy-loading 'services' on Instance uuid c1b8c9c9-249d-412e-86ca-35d59cbdd971 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:27.299336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:27.322498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:27.325974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:27.328617 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2103af08-e85d-4a67-9b40-bc04585f7d10 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.700438 Aug 29 04:54:27.329916 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 471/1062] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:26 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:27.335592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:27.336609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:27.346827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:27.349121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:27.350195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:27.350923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:27.352914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:27.353679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:27.384803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17ff600c-8cdf-495b-83ce-d7f46e4016e7 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments/107e219a-7035-4c08-8c4f-51a5f1e05e97" status: 202 len: 0 microversion: 2.1 time: 0.375706 Aug 29 04:54:27.390180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 592/1063] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 04:54:27 2022] DELETE /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments/107e219a-7035-4c08-8c4f-51a5f1e05e97 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:54:27.396988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:27.397909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:27.404864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:27.405573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:27.406936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:27.408358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:27.408975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:27.409544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:27.606806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:27.617457 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ee29207-f610-438b-b1b2-096809b22bc0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 200 len: 1429 microversion: 2.1 time: 0.286192 Aug 29 04:54:27.621131 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 472/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:27 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 1429 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:27.626623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af8d7a9b-39ee-4ae6-accb-c56942130620 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:27.633213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af8d7a9b-39ee-4ae6-accb-c56942130620 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:27.645500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8d7a9b-39ee-4ae6-accb-c56942130620 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:27.652649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8d7a9b-39ee-4ae6-accb-c56942130620 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:27.653485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8d7a9b-39ee-4ae6-accb-c56942130620 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:27.654264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8d7a9b-39ee-4ae6-accb-c56942130620 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:27.654909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8d7a9b-39ee-4ae6-accb-c56942130620 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:27.655396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8d7a9b-39ee-4ae6-accb-c56942130620 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:27.719113 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af8d7a9b-39ee-4ae6-accb-c56942130620 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096121 Aug 29 04:54:27.720885 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 473/1065] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:54:27 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:27.726464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-521f3114-d76d-4c5d-a4bc-e413f210b928 req-f3e379d6-177f-4776-96b4-20303a480e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "tag": "56f6927d-5229-47b9-8f1f-2f0466f24ad6"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:27.738628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-521f3114-d76d-4c5d-a4bc-e413f210b928 req-f3e379d6-177f-4776-96b4-20303a480e2d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:27.739501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-521f3114-d76d-4c5d-a4bc-e413f210b928 req-f3e379d6-177f-4776-96b4-20303a480e2d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:27.740172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-521f3114-d76d-4c5d-a4bc-e413f210b928 req-f3e379d6-177f-4776-96b4-20303a480e2d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:27.755947 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-521f3114-d76d-4c5d-a4bc-e413f210b928 req-f3e379d6-177f-4776-96b4-20303a480e2d service nova] Creating event network-changed:56f6927d-5229-47b9-8f1f-2f0466f24ad6 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:54:27.762529 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-521f3114-d76d-4c5d-a4bc-e413f210b928 req-f3e379d6-177f-4776-96b4-20303a480e2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040185 Aug 29 04:54:27.763798 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 474/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:28.015560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:28.016636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:28.022697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:28.032492 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85f07a30-cea4-467b-a286-4eb4fd02b5d9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1473 microversion: 2.1 time: 0.640777 Aug 29 04:54:28.033289 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 593/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:27 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1473 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:28.058049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:28.058557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:28.058995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:28.059757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:28.060673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:28.060673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:28.354982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:28.355595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:28.362318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:28.362816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:28.363448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:28.364472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:28.365081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:28.365655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.017263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:29.025581 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-056be711-41bd-4227-85c6-3256e4f8c92b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 1.014820 Aug 29 04:54:29.026256 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 475/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:28 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:29.031236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:29.032234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 118904bf-3f8d-4850-85b2-b4a4540462a1] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:29.039124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.040218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.040846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.041713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.042307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.042880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.050399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:29.068799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:29.070532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:29.072401 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f145f02d-6cca-4cae-886c-e198db24631c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.720918 Aug 29 04:54:29.073563 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 594/1069] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:28 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:54:29.078799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee14137d-199b-4e15-91ee-b07005c62136 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:29.080527 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] HTTP exception thrown: Instance 118904bf-3f8d-4850-85b2-b4a4540462a1 could not be found. Aug 29 04:54:29.081468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee14137d-199b-4e15-91ee-b07005c62136 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Request method failure captured: Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 HTTP/1.1 Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXmZ61QjiDxll7vMGfu5O06pHptECUVnpAoLYjE-L86c4NvnxoMWVYRpXwz3ZNhyO-VOvRf_w9W5rT3cdSKHKEbPR6QLaEmdRipJvMamxxqERTUZ6CCnfZEVJvudVeLdqnmdnkk5QuVuoDgPn3P_THedQwkapA5ilqJuEE7erdwrvA Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:29.083217 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38bcab4cb30d4894bdec1572236a6347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 12fbf10dbdfe42a292e3c4e239196e36 Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 118904bf-3f8d-4850-85b2-b4a4540462a1 could not be found. Aug 29 04:54:29.084808 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '118904bf-3f8d-4850-85b2-b4a4540462a1'} Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118904bf-3f8d-4850-85b2-b4a4540462a1 could not be found. Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:29.085541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118904bf-3f8d-4850-85b2-b4a4540462a1 could not be found. Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118904bf-3f8d-4850-85b2-b4a4540462a1 could not be found. Aug 29 04:54:29.086817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:29.087922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Returning 404 to user: Instance 118904bf-3f8d-4850-85b2-b4a4540462a1 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:29.087922 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c27a7e5-ff35-4e8c-89f5-c79a36493882 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1" status: 404 len: 111 microversion: 2.1 time: 0.058584 Aug 29 04:54:29.087922 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 476/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:29 2022] GET /compute/v2.1/servers/118904bf-3f8d-4850-85b2-b4a4540462a1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:29.093643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:29.094511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:29.095540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee14137d-199b-4e15-91ee-b07005c62136 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.096292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee14137d-199b-4e15-91ee-b07005c62136 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.096940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee14137d-199b-4e15-91ee-b07005c62136 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.097871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee14137d-199b-4e15-91ee-b07005c62136 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.098589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee14137d-199b-4e15-91ee-b07005c62136 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.099228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee14137d-199b-4e15-91ee-b07005c62136 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.105030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.108703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.109802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.111323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.111957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.112718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.145914 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee14137d-199b-4e15-91ee-b07005c62136 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071003 Aug 29 04:54:29.150658 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 595/1071] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:54:29 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:29.155456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:29.161084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:29.172982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.173949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.174386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.175709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.176175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.176629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.208538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:29.325156 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aae22620-5a45-4340-9e07-0150783d77e5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 204 len: 0 microversion: 2.1 time: 0.175328 Aug 29 04:54:29.326025 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 596/1072] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:29 2022] DELETE /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:29.334838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:29.335530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:29.343399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.343883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.344333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.345018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.345495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.345906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.449002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:29.458246 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28fd91f5-d3b3-4bcf-8146-da4627bcf06b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1470 microversion: 2.1 time: 0.370229 Aug 29 04:54:29.459153 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 477/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:29 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:29.479886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:29.480223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:29.487339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.488049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.488904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.489633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.490130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.490566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.520768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:29.529199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.529427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c2d362eb-38c3-41d3-9be5-d1efb2c201a5 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1472 microversion: 2.1 time: 0.198476 Aug 29 04:54:29.529677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.532157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.532298 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 597/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:29 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:29.532416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.532416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.532416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.558213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:54:29.563201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for user 4fbcb22f6bfb44e7b149c0b9e06014b8 and project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:54:29.570146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:29.673301 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0357d452-876c-4192-a4eb-f8d7dc9f8fd4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b/action" status: 202 len: 0 microversion: 2.1 time: 0.197639 Aug 29 04:54:29.673966 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 478/1075] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:54:29 2022] POST /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:54:29.682362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:29.682968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:29.689614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.690073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.690494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.691194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.691631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.692473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.796596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-280a7df7-8905-4372-9a9d-f2e6b6a589b4 req-714ce203-91a6-4668-abff-df3ef4c9fc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118904bf-3f8d-4850-85b2-b4a4540462a1", "name": "network-vif-deleted", "tag": "43cc0ac5-8468-4481-8b84-d388ee80d718"}, {"name": "network-changed", "server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "tag": "398b88bc-ab6b-4fae-9575-780d3764d159"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:29.809502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-280a7df7-8905-4372-9a9d-f2e6b6a589b4 req-714ce203-91a6-4668-abff-df3ef4c9fc62 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:29.810781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-280a7df7-8905-4372-9a9d-f2e6b6a589b4 req-714ce203-91a6-4668-abff-df3ef4c9fc62 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:29.810781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-280a7df7-8905-4372-9a9d-f2e6b6a589b4 req-714ce203-91a6-4668-abff-df3ef4c9fc62 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:29.827141 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-280a7df7-8905-4372-9a9d-f2e6b6a589b4 req-714ce203-91a6-4668-abff-df3ef4c9fc62 service nova] Creating event network-vif-deleted:43cc0ac5-8468-4481-8b84-d388ee80d718 for instance 118904bf-3f8d-4850-85b2-b4a4540462a1 on n-h1-854119-9 Aug 29 04:54:29.829138 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-280a7df7-8905-4372-9a9d-f2e6b6a589b4 req-714ce203-91a6-4668-abff-df3ef4c9fc62 service nova] Creating event network-changed:398b88bc-ab6b-4fae-9575-780d3764d159 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:54:29.836528 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-280a7df7-8905-4372-9a9d-f2e6b6a589b4 req-714ce203-91a6-4668-abff-df3ef4c9fc62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045890 Aug 29 04:54:29.837428 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 479/1076] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:29.919809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:29.922261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:29.930229 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-847df175-cc88-4fc7-8e99-2e57c5b802e3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1469 microversion: 2.1 time: 0.251842 Aug 29 04:54:29.930894 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 598/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:29 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:30.047590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:30.048482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:30.055034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.055584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.056377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:30.057161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.057798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.058188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:30.098402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:30.099001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:30.106443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.107104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.107537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:30.108246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.108869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.109281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:30.372882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:30.387911 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c0c1510-2839-421c-9884-04ad89aff9a5 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.344339 Aug 29 04:54:30.401597 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 480/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:30 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:30.413916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7b3f4c7-51a5-41a8-8807-e7150d260a19 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:30.417101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c7b3f4c7-51a5-41a8-8807-e7150d260a19 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:30.426323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7b3f4c7-51a5-41a8-8807-e7150d260a19 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.428175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7b3f4c7-51a5-41a8-8807-e7150d260a19 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.429989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7b3f4c7-51a5-41a8-8807-e7150d260a19 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:30.432453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7b3f4c7-51a5-41a8-8807-e7150d260a19 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.433022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7b3f4c7-51a5-41a8-8807-e7150d260a19 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.433525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7b3f4c7-51a5-41a8-8807-e7150d260a19 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:30.450494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:30.460720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:30.462225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:30.463617 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-524672ac-d28d-4fc4-bb89-eadc3109bc55 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.369113 Aug 29 04:54:30.477489 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c7b3f4c7-51a5-41a8-8807-e7150d260a19 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074256 Aug 29 04:54:30.478151 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 599/1079] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:30 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:54:30.480409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 481/1080] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:54:30 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:30.550920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:30.551626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:30.559458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.559948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.560404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:30.561104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.561550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.562040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:30.820072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:30.832004 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f5c7c52-882e-4c0b-bfcc-634156b75bf6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1472 microversion: 2.1 time: 0.284704 Aug 29 04:54:30.833032 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 600/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:30 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:30.953517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:30.954518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:30.961800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.962582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.963235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:30.964179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:30.965200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:30.965996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:31.147440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:31.155778 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-07f4e588-3825-4e84-9fad-e22004d554d6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1469 microversion: 2.1 time: 0.207642 Aug 29 04:54:31.156411 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 482/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:30 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:31.413944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:31.414733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:31.421660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:31.422552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:31.423256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:31.423922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:31.424464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:31.424981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:31.488968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:31.489223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:31.503031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:31.503626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:31.504161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:31.505015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:31.505821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:31.506329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:31.879363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:31.887700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2cb0d95a-453b-431a-b7aa-87df0559cd8c tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.477720 Aug 29 04:54:31.888311 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 601/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:31 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:31.894435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cb1e1802-3d6a-4b75-aafd-7fee658e8283 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:31.899633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cb1e1802-3d6a-4b75-aafd-7fee658e8283 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:31.906216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e1802-3d6a-4b75-aafd-7fee658e8283 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:31.907020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e1802-3d6a-4b75-aafd-7fee658e8283 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:31.907869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e1802-3d6a-4b75-aafd-7fee658e8283 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:31.908727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e1802-3d6a-4b75-aafd-7fee658e8283 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:31.909396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e1802-3d6a-4b75-aafd-7fee658e8283 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:31.910025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e1802-3d6a-4b75-aafd-7fee658e8283 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:31.950351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:31.969821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:31.971756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:31.974060 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-291be8dd-c948-4f8d-be57-b11cff5e40d6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.491056 Aug 29 04:54:31.975797 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 483/1084] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:31 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:54:31.981199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:31.982053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:31.995133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:31.995633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:31.996068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:31.996825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:31.997571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:31.997725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.171693 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cb1e1802-3d6a-4b75-aafd-7fee658e8283 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.282012 Aug 29 04:54:32.172628 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 602/1085] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:54:31 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:32.177499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:32.177996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:32.184690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.185184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.185578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.186269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.186710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.187124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.213201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:32.312787 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6169b5e3-9c87-45df-b402-479f6f3740ed tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "DELETE /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 204 len: 0 microversion: 2.1 time: 0.138069 Aug 29 04:54:32.313840 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 603/1086] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:32 2022] DELETE /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:32.320313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:32.321220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:32.327344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:32.330090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.331136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.331745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.332751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.333373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.333802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.340099 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-428e3806-2f85-4dc9-a4dc-1bd1ddec789b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1472 microversion: 2.1 time: 0.362644 Aug 29 04:54:32.342009 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 484/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:31 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:32.347738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:32.348659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:32.357190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.357996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.359414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.360492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.361230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.361886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.637269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:32.639250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:32.648738 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-107e3e25-de96-4eb7-829c-7b2076d28bd8 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1711 microversion: 2.1 time: 0.305044 Aug 29 04:54:32.662421 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 485/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:32 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1711 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:32.662614 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d82773f-a301-4c34-9803-b6ee39e4bb81 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1469 microversion: 2.1 time: 0.335442 Aug 29 04:54:32.662732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-82b14597-d901-4285-a1db-f74d52083ebd req-d8d4e716-751f-4f64-85c9-2cf711b1c8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3", "name": "network-vif-deleted", "tag": "9efe761d-cb21-4dbc-bcbd-4b5c7a18d21f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:32.663699 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 604/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:32 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:32.665305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-82b14597-d901-4285-a1db-f74d52083ebd req-d8d4e716-751f-4f64-85c9-2cf711b1c8e0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.665918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-82b14597-d901-4285-a1db-f74d52083ebd req-d8d4e716-751f-4f64-85c9-2cf711b1c8e0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.666443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-82b14597-d901-4285-a1db-f74d52083ebd req-d8d4e716-751f-4f64-85c9-2cf711b1c8e0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.679482 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-82b14597-d901-4285-a1db-f74d52083ebd req-d8d4e716-751f-4f64-85c9-2cf711b1c8e0 service nova] Creating event network-vif-deleted:9efe761d-cb21-4dbc-bcbd-4b5c7a18d21f for instance ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 on n-h1-854119-9 Aug 29 04:54:32.684814 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-82b14597-d901-4285-a1db-f74d52083ebd req-d8d4e716-751f-4f64-85c9-2cf711b1c8e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034210 Aug 29 04:54:32.685459 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 486/1090] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:32.916985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:32.917607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:32.929096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-379e898b-d34f-4aa2-b21e-38490e83a57b req-57917af8-ee8d-4593-b16d-00edf976026f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b820ba-bc27-4a3b-81a0-43a45340f60b", "name": "network-vif-plugged", "status": "completed", "tag": "bbab69b1-3249-4a95-ba39-0f3c3196a9e2"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:32.932508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.934417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.934857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.936675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.939675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.940127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.950176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-379e898b-d34f-4aa2-b21e-38490e83a57b req-57917af8-ee8d-4593-b16d-00edf976026f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:32.950656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-379e898b-d34f-4aa2-b21e-38490e83a57b req-57917af8-ee8d-4593-b16d-00edf976026f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:32.951079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-379e898b-d34f-4aa2-b21e-38490e83a57b req-57917af8-ee8d-4593-b16d-00edf976026f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:32.972085 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-379e898b-d34f-4aa2-b21e-38490e83a57b req-57917af8-ee8d-4593-b16d-00edf976026f service nova] Creating event network-vif-plugged:bbab69b1-3249-4a95-ba39-0f3c3196a9e2 for instance 20b820ba-bc27-4a3b-81a0-43a45340f60b on n-h2-854119-9 Aug 29 04:54:32.978310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-379e898b-d34f-4aa2-b21e-38490e83a57b req-57917af8-ee8d-4593-b16d-00edf976026f service nova] Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:54:32.989222 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-379e898b-d34f-4aa2-b21e-38490e83a57b req-57917af8-ee8d-4593-b16d-00edf976026f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067254 Aug 29 04:54:32.990054 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 487/1091] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:33.005021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:33.005833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:33.018275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.018920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.019726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:33.020691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.021622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.023361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:33.176577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:33.186233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f107cfa6-8b50-4651-bd53-2589c609a56e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1473 microversion: 2.1 time: 0.281040 Aug 29 04:54:33.187379 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 605/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:32 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:33.192782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16db0ae4-af05-4626-9e5f-1283f37b7255 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:33.195223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-16db0ae4-af05-4626-9e5f-1283f37b7255 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:33.201672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16db0ae4-af05-4626-9e5f-1283f37b7255 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.202235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16db0ae4-af05-4626-9e5f-1283f37b7255 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.203053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16db0ae4-af05-4626-9e5f-1283f37b7255 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:33.203818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16db0ae4-af05-4626-9e5f-1283f37b7255 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.204364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16db0ae4-af05-4626-9e5f-1283f37b7255 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.205266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16db0ae4-af05-4626-9e5f-1283f37b7255 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:33.238465 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16db0ae4-af05-4626-9e5f-1283f37b7255 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049645 Aug 29 04:54:33.240630 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 606/1093] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:54:33 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:33.262900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:33.272372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:33.273844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:33.275287 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b42146b2-8c08-44b4-9ea8-82d20f437adc tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.276666 Aug 29 04:54:33.275845 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 488/1094] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:32 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:33.362233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:33.362757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:33.369145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.369642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.370105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:33.370827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.371278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.371699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:33.436354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:33.444445 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-605a9cf5-3aec-4713-b641-249cdbe056f0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1430 microversion: 2.1 time: 0.086334 Aug 29 04:54:33.445041 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 607/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:33 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1430 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:33.670454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:33.671196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:33.672891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:33.673531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:33.680925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.681723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.681909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:33.682603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.683049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.683490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:33.691234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.691654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.692079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:33.693477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:33.694712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:33.695187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.307452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:34.317135 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ee1b0af-ddba-40ff-8a90-eb955b710669 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1469 microversion: 2.1 time: 0.647818 Aug 29 04:54:34.318232 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 608/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:33 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1469 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:34.341879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:34.343702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:34.352166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:34.352878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:34.353637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.354901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:34.355343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:34.355758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.393239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:34.401946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1e231766-242a-4132-94ea-dbfb126008bb tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1711 microversion: 2.1 time: 0.735589 Aug 29 04:54:34.402606 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 489/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:33 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1711 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:34.407914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-322405a3-5697-4eed-9a62-957c0b70c1e6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:34.410461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-322405a3-5697-4eed-9a62-957c0b70c1e6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:34.416697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-322405a3-5697-4eed-9a62-957c0b70c1e6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:34.417565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-322405a3-5697-4eed-9a62-957c0b70c1e6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:34.418214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-322405a3-5697-4eed-9a62-957c0b70c1e6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.419143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-322405a3-5697-4eed-9a62-957c0b70c1e6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:34.419666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-322405a3-5697-4eed-9a62-957c0b70c1e6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:34.420178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-322405a3-5697-4eed-9a62-957c0b70c1e6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.472789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-322405a3-5697-4eed-9a62-957c0b70c1e6 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068876 Aug 29 04:54:34.473594 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 490/1098] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:54:34 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:54:34.477800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:34.478410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:34.486870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:34.487405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:34.487834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.488550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:34.489248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:34.489667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.606160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:34.616550 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b741f70-e210-49cf-9c07-efd83e23fe21 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1479 microversion: 2.1 time: 0.285630 Aug 29 04:54:34.617614 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 609/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:34 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1479 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:34.624317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:34.625309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:34.633230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:34.633728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:34.634166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.634872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:34.635549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:34.635980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.678515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:34.679185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:34.679533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:34.680400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lazy-loading 'fault' on Instance uuid ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:34.767992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:34.777667 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ab17890-fb6b-4626-877c-3b6deaf3f9ea tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 200 len: 1306 microversion: 2.1 time: 0.158527 Aug 29 04:54:34.778681 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 610/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:34 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 1306 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:34.787095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1871609867", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "a6c40ff8-12f2-4f87-80cf-2e32f6de070b"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:34.851663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:34.872735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] validate_networks() for [('a6c40ff8-12f2-4f87-80cf-2e32f6de070b', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:54:34.881151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:34.884996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:34.886951 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a2dc6097-95a8-4df2-a454-01aa8688f39d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1881 microversion: 2.32 time: 0.412489 Aug 29 04:54:34.888567 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 491/1101] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:34 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1881 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:35.093795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ce627d32-c69f-46b4-af4c-1ff7f6e114ad req-7c3ef249-cc67-4c6d-8f17-aee4fac084fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50354b59-597b-4592-aab3-4b1fcd07d8bb", "name": "network-vif-unplugged", "status": "completed", "tag": "c7c220d0-79d0-42ef-a221-b6dd9107c608"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:35.110758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ce627d32-c69f-46b4-af4c-1ff7f6e114ad req-7c3ef249-cc67-4c6d-8f17-aee4fac084fb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:35.111647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ce627d32-c69f-46b4-af4c-1ff7f6e114ad req-7c3ef249-cc67-4c6d-8f17-aee4fac084fb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:35.112307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ce627d32-c69f-46b4-af4c-1ff7f6e114ad req-7c3ef249-cc67-4c6d-8f17-aee4fac084fb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:35.128223 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ce627d32-c69f-46b4-af4c-1ff7f6e114ad req-7c3ef249-cc67-4c6d-8f17-aee4fac084fb service nova] Creating event network-vif-unplugged:c7c220d0-79d0-42ef-a221-b6dd9107c608 for instance 50354b59-597b-4592-aab3-4b1fcd07d8bb on n-h1-854119-9 Aug 29 04:54:35.140237 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ce627d32-c69f-46b4-af4c-1ff7f6e114ad req-7c3ef249-cc67-4c6d-8f17-aee4fac084fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053866 Aug 29 04:54:35.141488 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 492/1102] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:35.341883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:35.343064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:35.350298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:35.350852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:35.351343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:35.352100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:35.352710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:35.353128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:35.833038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:35.843543 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a69b632a-e181-4426-84ef-8faf8e3e9aa8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1469 microversion: 2.1 time: 0.505809 Aug 29 04:54:35.845548 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 493/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:35 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1469 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:35.851610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:35.852387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:35.860391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:35.861254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:35.861843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:35.862704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:35.863304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:35.863873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.050056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:54:36.050549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:54:36.051144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:54:36.051680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:54:36.052216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:54:36.062330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.062878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.063378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.064412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.065041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.065456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.082938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Getting quotas for project 9e4aeab40a6546e799cb321f5978468f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:54:36.087732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Getting quotas for user 3b0266d5991442649190b2f052809d2c and project 9e4aeab40a6546e799cb321f5978468f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:54:36.099734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:54:36.102107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:54:36.149019 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a751bb57-6482-47e4-b6f9-bee1e40192df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368335 Aug 29 04:54:36.156665 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 611/1104] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:54:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:54:36.156665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:36.156665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:36.162198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.162921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.163282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.163944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.164460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.164901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.172497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:36.183935 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-882a4f89-55d7-4e08-840c-c7cce23b3d83 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1711 microversion: 2.1 time: 0.334828 Aug 29 04:54:36.200626 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 494/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:35 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1711 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:36.208688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:36.209569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:36.217888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.218574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.219230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.220665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.221381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.222002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.240058 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] HTTP exception thrown: Instance ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 could not be found. Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Request method failure captured: Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 HTTP/1.1 Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXmZ61QjiDxll7vMGfu5O06pHptECUVnpAoLYjE-L86c4NvnxoMWVYRpXwz3ZNhyO-VOvRf_w9W5rT3cdSKHKEbPR6QLaEmdRipJvMamxxqERTUZ6CCnfZEVJvudVeLdqnmdnkk5QuVuoDgPn3P_THedQwkapA5ilqJuEE7erdwrvA Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:36.242126 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38bcab4cb30d4894bdec1572236a6347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 12fbf10dbdfe42a292e3c4e239196e36 Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 could not be found. Aug 29 04:54:36.243529 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3'} Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 could not be found. Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:36.244265 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 could not be found. Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 could not be found. Aug 29 04:54:36.245435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:36.246494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Returning 404 to user: Instance ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:36.247533 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e604de1b-1a07-4331-b359-eb947ff192c8 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3" status: 404 len: 111 microversion: 2.1 time: 0.045180 Aug 29 04:54:36.251487 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 495/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:36 2022] GET /compute/v2.1/servers/ded2eeb3-c9ae-44b8-8a6a-83c7d669a1c3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:36.256007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:36.256624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:36.264003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.264516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.265064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.265785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.267210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.267645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.290248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:36.940450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:36.948937 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a09781cb-342f-4824-80ab-af58412fc39d tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1479 microversion: 2.1 time: 0.798214 Aug 29 04:54:36.949518 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 612/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:36 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1479 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:36.955858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:36.956545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:36.964613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.965281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.965715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.966415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:36.966898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:36.967295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:36.995088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:37.006112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:37.007854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:37.009876 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a4f7d08b-e3b0-40e2-b91b-2ccc6cf0245c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.760407 Aug 29 04:54:37.010521 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 496/1108] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:36 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:37.016250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:37.017182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:37.048496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.053772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.054571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.057662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.058398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.059083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.106870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:37.118511 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-799c3f0c-2385-4f7d-aec9-5803532cbcd5 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1222 microversion: 2.1 time: 0.167749 Aug 29 04:54:37.120020 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 613/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:36 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1222 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:37.125910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:37.127357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:37.144496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:37.145405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.146089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.148848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.149798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.150941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.153776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.167262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:37.276461 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-99d3e192-8ca5-4162-931a-9d3c9f2c9528 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e" status: 204 len: 0 microversion: 2.1 time: 0.263592 Aug 29 04:54:37.277527 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 497/1110] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:37 2022] DELETE /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:37.287919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:37.288655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:37.312524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.313145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.316809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.318910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.319499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.320337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.518023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:37.528577 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-265d579f-c29d-436b-b76b-1321e51a32a4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1643 microversion: 2.1 time: 0.249820 Aug 29 04:54:37.533812 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 498/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:37 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1643 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:37.538956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:37.539454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:37.546940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:37.556392 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4993870-3b56-4f1a-94e3-ef3b5813d696 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1469 microversion: 2.1 time: 0.434974 Aug 29 04:54:37.557412 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 614/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:37 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1469 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:37.558372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.558874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.559311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.560027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.560506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.560929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.563596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-58f40a9f-1bda-460b-a330-d1547ee93f5b req-ff2e7c13-d10c-4a07-a7df-db5ee756baf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50354b59-597b-4592-aab3-4b1fcd07d8bb", "name": "network-vif-deleted", "tag": "c7c220d0-79d0-42ef-a221-b6dd9107c608"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:37.576880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-58f40a9f-1bda-460b-a330-d1547ee93f5b req-ff2e7c13-d10c-4a07-a7df-db5ee756baf6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.577858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-58f40a9f-1bda-460b-a330-d1547ee93f5b req-ff2e7c13-d10c-4a07-a7df-db5ee756baf6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.578279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-58f40a9f-1bda-460b-a330-d1547ee93f5b req-ff2e7c13-d10c-4a07-a7df-db5ee756baf6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.591192 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-58f40a9f-1bda-460b-a330-d1547ee93f5b req-ff2e7c13-d10c-4a07-a7df-db5ee756baf6 service nova] Creating event network-vif-deleted:c7c220d0-79d0-42ef-a221-b6dd9107c608 for instance 50354b59-597b-4592-aab3-4b1fcd07d8bb on n-h1-854119-9 Aug 29 04:54:37.596537 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-58f40a9f-1bda-460b-a330-d1547ee93f5b req-ff2e7c13-d10c-4a07-a7df-db5ee756baf6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037863 Aug 29 04:54:37.597309 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 615/1113] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:37.607917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:37.701907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:37.735131 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-46c2c4ef-0367-4a74-80cc-b3e3a4692bbf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 204 len: 0 microversion: 2.1 time: 0.198930 Aug 29 04:54:37.744348 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 499/1114] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:37 2022] DELETE /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:37.745918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:37.746706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:37.754163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.754880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.756107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.756786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.757435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.757994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.903876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:37.916312 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b0e2931-7be0-48d8-b60f-2ee53d5e6e92 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e" status: 200 len: 1474 microversion: 2.1 time: 0.175687 Aug 29 04:54:37.917135 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 616/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:37 2022] GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e => generated 1474 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:37.972632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:37.973355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:37.979744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.980266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.980694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:37.981398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:37.982088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:37.982503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.037036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:38.037656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:38.043654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.044170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.044612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.045309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.045760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.046183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.210424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:38.221277 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f5085117-a0ab-470a-8d47-ddeb76a69081 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1479 microversion: 2.1 time: 0.254086 Aug 29 04:54:38.221878 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 500/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:37 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1479 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:38.226426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:38.227147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:38.233268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.233757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.234175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.234877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.235325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.235839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.263512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:38.273731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:38.275485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:38.277227 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-81ff0d2a-79d4-4068-a661-0a4d550338f5 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.244271 Aug 29 04:54:38.277781 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 617/1117] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:38 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:38.307741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:38.315865 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15245e64-b302-4172-a761-3924252cd7f0 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1270 microversion: 2.1 time: 0.092956 Aug 29 04:54:38.316474 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 501/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:38 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:38.553777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:38.554073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:38.560109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.567786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.568630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.569436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.570162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.570566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.577909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:38.578667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:38.592915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.593405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.593837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.594535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.595197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.595500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.615963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.616510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.617333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.617868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lazy-loading 'fault' on Instance uuid 50354b59-597b-4592-aab3-4b1fcd07d8bb {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:38.683389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d92346a9fb41fdb9c482a405661d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff90f242c8c443ea81148656e08dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:38.699900 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4f14c55-a76b-494c-b7b5-3453190cbcb1 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 200 len: 1352 microversion: 2.1 time: 0.150238 Aug 29 04:54:38.704817 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 618/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:38 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 1352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:38.891236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:38.905127 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c97f2963-8d5e-449b-a9b9-444f4b54e194 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1535 microversion: 2.1 time: 0.331320 Aug 29 04:54:38.905700 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 502/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:38 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1535 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:38.937602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:38.938194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:38.940813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:38.946588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.947336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.947773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:38.949371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:38.949791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:38.951835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:39.242473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:39.243174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:39.249922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:39.251096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:39.251096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:39.251725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:39.252276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:39.252816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:39.264765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:39.278207 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17ea4a2f-d66c-444f-85b8-3809d2a8fffe tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e" status: 200 len: 1474 microversion: 2.1 time: 0.344047 Aug 29 04:54:39.279962 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 619/1121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:38 2022] GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e => generated 1474 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:39.304686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:39.305412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:39.312229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:39.312821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:39.313316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:39.314663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:39.322333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:39.323151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:39.543795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:39.919585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:39.928270 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1344a9f9-7797-4c3c-b820-da1cc0bfda62 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1479 microversion: 2.1 time: 0.689786 Aug 29 04:54:39.928843 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 503/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:39 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1479 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:39.933524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:39.934129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:39.940063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:39.940572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:39.941244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:39.942189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:39.942855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:39.943467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:40.090223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:40.099655 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0542a681-644f-4dc1-8f08-9d1da4e0c812 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1276 microversion: 2.1 time: 0.169594 Aug 29 04:54:40.100578 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 504/1123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:39 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:40.107914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:40.109609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:40.124216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:40.124946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:40.125279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:40.126401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:40.126996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:40.127429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:40.155145 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] HTTP exception thrown: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Request method failure captured: Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb HTTP/1.1 Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWHXZja--9IrzRCr2yxmHnK7PjPteF-E2x1M5g-F4fkJhmgqAq1oYyRZ-AxS5eK9mrc8xiVxb8KVZJxJ5iEZHG8lDOKuP_UTyNMV0Dkr8XjSYCZDaaLCe-iXcYMsChZS3KY7OI1DDrmOjFzI-QWLvcW9rmMBeRIvBOdk_D6Dus5XVU Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:40.159629 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff90f242c8c443ea81148656e08dd959", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: a7d92346a9fb41fdb9c482a405661d2b Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:40.161629 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '50354b59-597b-4592-aab3-4b1fcd07d8bb'} Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:40.162520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:40.163951 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.165251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Returning 404 to user: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:40.165251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8413321d-2916-4b12-ad2a-f8653c34a483 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 404 len: 111 microversion: 2.1 time: 0.059389 Aug 29 04:54:40.165251 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 505/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:40 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:40.170158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:40.170813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:40.177612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:40.178108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:40.178540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:40.179247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:40.179695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:40.181988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:40.198998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:40.217711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:40.219950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:40.221158 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f77b29c-cafe-4c30-b1d6-59290e6a08ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.923231 Aug 29 04:54:40.224922 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 620/1125] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:39 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:40.241838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-69715fe8-fbfc-4675-b364-7949be7f36c7 req-d41e19ce-dd0d-4520-b856-ba7fbb660411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419bf8df-33bd-47c9-beb5-4398ea8db81f", "name": "network-vif-deleted", "tag": "04cfbf0e-aa49-41f9-ac96-1e1c42605e9a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:40.269434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-69715fe8-fbfc-4675-b364-7949be7f36c7 req-d41e19ce-dd0d-4520-b856-ba7fbb660411 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:40.270672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-69715fe8-fbfc-4675-b364-7949be7f36c7 req-d41e19ce-dd0d-4520-b856-ba7fbb660411 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:40.271262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-69715fe8-fbfc-4675-b364-7949be7f36c7 req-d41e19ce-dd0d-4520-b856-ba7fbb660411 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:40.284957 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-69715fe8-fbfc-4675-b364-7949be7f36c7 req-d41e19ce-dd0d-4520-b856-ba7fbb660411 service nova] Creating event network-vif-deleted:04cfbf0e-aa49-41f9-ac96-1e1c42605e9a for instance 419bf8df-33bd-47c9-beb5-4398ea8db81f on n-h2-854119-9 Aug 29 04:54:40.290908 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-69715fe8-fbfc-4675-b364-7949be7f36c7 req-d41e19ce-dd0d-4520-b856-ba7fbb660411 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062403 Aug 29 04:54:40.292283 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 621/1126] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:40.299531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:40.300694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:40.308918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:40.310554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:40.311301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:40.312244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:40.312851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:40.313431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:40.330525 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] HTTP exception thrown: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Request method failure captured: Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a HTTP/1.1 Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWHXZja--9IrzRCr2yxmHnK7PjPteF-E2x1M5g-F4fkJhmgqAq1oYyRZ-AxS5eK9mrc8xiVxb8KVZJxJ5iEZHG8lDOKuP_UTyNMV0Dkr8XjSYCZDaaLCe-iXcYMsChZS3KY7OI1DDrmOjFzI-QWLvcW9rmMBeRIvBOdk_D6Dus5XVU Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:54:40.332796 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff90f242c8c443ea81148656e08dd959", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: a7d92346a9fb41fdb9c482a405661d2b Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:40.334649 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6dd58c75-b4bb-4fd6-846e-e3cb7e72388a'} Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:40.340052 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:40.341674 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:40.343133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Returning 404 to user: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:40.343133 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-14fcda56-831f-4b45-ab64-2ba9c4f66cb4 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 404 len: 111 microversion: 2.1 time: 0.040884 Aug 29 04:54:40.343133 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 622/1127] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:40 2022] DELETE /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:40.343610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:40.344459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:40.350814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:40.351440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:40.351880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:40.352614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:40.353058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:40.353475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.100515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:41.110475 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-74e2c948-7af1-4e2c-abf5-ab224a98867a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1535 microversion: 2.1 time: 0.944211 Aug 29 04:54:41.122231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 506/1128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:40 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1535 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:41.128486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:41.129462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:41.135705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:41.136279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:41.137077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.137782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:41.138243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:41.138667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.154657 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] HTTP exception thrown: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Request method failure captured: Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a HTTP/1.1 Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWHXZja--9IrzRCr2yxmHnK7PjPteF-E2x1M5g-F4fkJhmgqAq1oYyRZ-AxS5eK9mrc8xiVxb8KVZJxJ5iEZHG8lDOKuP_UTyNMV0Dkr8XjSYCZDaaLCe-iXcYMsChZS3KY7OI1DDrmOjFzI-QWLvcW9rmMBeRIvBOdk_D6Dus5XVU Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:41.156235 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff90f242c8c443ea81148656e08dd959", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: a7d92346a9fb41fdb9c482a405661d2b Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:41.157790 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6dd58c75-b4bb-4fd6-846e-e3cb7e72388a'} Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:41.158630 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:41.159867 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:41.161280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Returning 404 to user: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:41.161280 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e203f4c-96bc-45a6-9ab1-10c3f2428343 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 404 len: 111 microversion: 2.1 time: 0.033522 Aug 29 04:54:41.161280 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 507/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:41 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:41.167224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-beeded84-224b-4c17-81b0-196a1f64495f req-2650d414-3650-4b04-bd72-7811794f554a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b820ba-bc27-4a3b-81a0-43a45340f60b", "name": "network-vif-unplugged", "status": "completed", "tag": "bbab69b1-3249-4a95-ba39-0f3c3196a9e2"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:41.176792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-beeded84-224b-4c17-81b0-196a1f64495f req-2650d414-3650-4b04-bd72-7811794f554a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:41.177282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-beeded84-224b-4c17-81b0-196a1f64495f req-2650d414-3650-4b04-bd72-7811794f554a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:41.177885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-beeded84-224b-4c17-81b0-196a1f64495f req-2650d414-3650-4b04-bd72-7811794f554a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.192469 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-beeded84-224b-4c17-81b0-196a1f64495f req-2650d414-3650-4b04-bd72-7811794f554a service nova] Creating event network-vif-unplugged:bbab69b1-3249-4a95-ba39-0f3c3196a9e2 for instance 20b820ba-bc27-4a3b-81a0-43a45340f60b on n-h1-854119-9 Aug 29 04:54:41.199046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-beeded84-224b-4c17-81b0-196a1f64495f req-2650d414-3650-4b04-bd72-7811794f554a service nova] Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:54:41.212442 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-beeded84-224b-4c17-81b0-196a1f64495f req-2650d414-3650-4b04-bd72-7811794f554a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049255 Aug 29 04:54:41.213386 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 508/1130] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:41.215551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:41.218446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:41.219514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:41.226663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:41.227554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:41.228334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.229272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:41.230531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:41.230976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.233217 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6223dacf-dbf8-403f-bf1b-db4c89b32c14 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e" status: 200 len: 1474 microversion: 2.1 time: 0.895144 Aug 29 04:54:41.243267 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 623/1131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:40 2022] GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e => generated 1474 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:41.253269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:41.254177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:41.262311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:41.262952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:41.263644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.264663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:41.265377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:41.268458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.415949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:41.424066 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cf56b250-693c-413d-8524-7f0ef2e0f6df tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1276 microversion: 2.1 time: 0.177262 Aug 29 04:54:41.424674 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 624/1132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:41 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:41.429158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6ebe841-804a-4423-baad-6f2fd4359173 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '.version_select at 0x7f1ab924da60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:41.451386 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d6ebe841-804a-4423-baad-6f2fd4359173 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-232144476" status: 202 len: 0 microversion: 2.1 time: 0.025065 Aug 29 04:54:41.451386 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 625/1133] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 04:54:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-232144476 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:54:41.458884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:41.459681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:41.466115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:41.466617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:41.467039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.467740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:41.468207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:41.468616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:41.759720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:41.774687 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0299ece-a0fc-44ee-9306-5b13b1f37e9b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1479 microversion: 2.1 time: 0.559915 Aug 29 04:54:41.784160 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 509/1134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:41 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1479 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:41.920057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:41.944040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:41.947949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:41.949465 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa9e3f38-a96d-4659-b3e4-9ef5f66b4397 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.497088 Aug 29 04:54:41.950905 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 626/1135] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:41 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:42.131074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:42.131766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:42.148261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:42.153349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:42.156432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:42.157264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:42.158913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:42.159416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:42.258723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:42.259349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:42.267654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:42.268159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:42.268597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:42.269305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:42.269756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:42.270182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:42.388359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:42.396592 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a39c4dd-6423-475d-a1f9-9dffb0739bcf tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e" status: 200 len: 1432 microversion: 2.1 time: 0.143178 Aug 29 04:54:42.397368 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 627/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:42 2022] GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e => generated 1432 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:42.401885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bef590e2-0c93-4682-a07c-67fe6ad4eb4c tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:42.419406 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bef590e2-0c93-4682-a07c-67fe6ad4eb4c tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/472192401" status: 202 len: 0 microversion: 2.1 time: 0.020987 Aug 29 04:54:42.420151 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 628/1137] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 04:54:42 2022] DELETE /compute/v2.1/flavors/472192401 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:54:42.428247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f371a80e-c590-4c66-9b93-558e13c2372d tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:42.450864 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f371a80e-c590-4c66-9b93-558e13c2372d tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.026241 Aug 29 04:54:42.451560 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 629/1138] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:54:42 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:42.457630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:42.458717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:42.466678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:42.467482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:42.468145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:42.469090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:42.469748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:42.470435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:42.717381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:42.727550 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87c06781-7b04-4402-a1d6-d1ddd7dacdde tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1535 microversion: 2.1 time: 0.600267 Aug 29 04:54:42.728727 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 510/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:42 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1535 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:42.733936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ff11f92-b901-43aa-acef-62753a6a882c tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:42.753031 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ff11f92-b901-43aa-acef-62753a6a882c tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/201204300" status: 202 len: 0 microversion: 2.1 time: 0.023015 Aug 29 04:54:42.757142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 511/1140] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 04:54:42 2022] DELETE /compute/v2.1/flavors/201204300 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:54:42.762507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12da5ff0-4315-4ce6-be4b-c7158731982a tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:42.783453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12da5ff0-4315-4ce6-be4b-c7158731982a tempest-ServersWithSpecificFlavorTestJSON-1571506478 tempest-ServersWithSpecificFlavorTestJSON-1571506478-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024852 Aug 29 04:54:42.784101 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 512/1141] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:54:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:42.798323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:42.799168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:42.809192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:42.809678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:42.810104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:42.810801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:42.811245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:42.811655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:42.830572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:43.044092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:43.053879 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c387e246-a4b2-4c8b-af10-f188df3d7f45 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.600589 Aug 29 04:54:43.054458 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 630/1142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:42 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:43.059136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.059527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.069490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.069967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.070593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.071318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.071750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.072386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.087520 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] HTTP exception thrown: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Request method failure captured: Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb HTTP/1.1 Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWHXZja--9IrzRCr2yxmHnK7PjPteF-E2x1M5g-F4fkJhmgqAq1oYyRZ-AxS5eK9mrc8xiVxb8KVZJxJ5iEZHG8lDOKuP_UTyNMV0Dkr8XjSYCZDaaLCe-iXcYMsChZS3KY7OI1DDrmOjFzI-QWLvcW9rmMBeRIvBOdk_D6Dus5XVU Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:54:43.089723 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff90f242c8c443ea81148656e08dd959", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: a7d92346a9fb41fdb9c482a405661d2b Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.091387 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '50354b59-597b-4592-aab3-4b1fcd07d8bb'} Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:43.095565 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.097060 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.098481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Returning 404 to user: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:43.098481 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b4f76e1-52ac-4bf9-a9a4-cd0197e0675d tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "DELETE /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 404 len: 111 microversion: 2.1 time: 0.035880 Aug 29 04:54:43.098481 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 631/1143] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:43 2022] DELETE /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:43.098481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.098481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.103213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.103688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.104160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.104878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.105312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.105831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.270682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:43.278885 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-25641509-9922-44e3-9246-603907e9f012 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1479 microversion: 2.1 time: 0.485365 Aug 29 04:54:43.279453 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 513/1144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:42 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1479 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:43.284157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.284747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 50354b59-597b-4592-aab3-4b1fcd07d8bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.290542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.291001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.292012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.293031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.293478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.293892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.307588 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] HTTP exception thrown: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Request method failure captured: Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb HTTP/1.1 Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWHXZja--9IrzRCr2yxmHnK7PjPteF-E2x1M5g-F4fkJhmgqAq1oYyRZ-AxS5eK9mrc8xiVxb8KVZJxJ5iEZHG8lDOKuP_UTyNMV0Dkr8XjSYCZDaaLCe-iXcYMsChZS3KY7OI1DDrmOjFzI-QWLvcW9rmMBeRIvBOdk_D6Dus5XVU Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:43.309218 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff90f242c8c443ea81148656e08dd959", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: a7d92346a9fb41fdb9c482a405661d2b Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.310785 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '50354b59-597b-4592-aab3-4b1fcd07d8bb'} Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:43.311551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. Aug 29 04:54:43.312935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.314176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Returning 404 to user: Instance 50354b59-597b-4592-aab3-4b1fcd07d8bb could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:43.314176 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c38d35f-0e40-4048-884a-b3b4c4eb5f7e tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb" status: 404 len: 111 microversion: 2.1 time: 0.030534 Aug 29 04:54:43.314464 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 514/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:43 2022] GET /compute/v2.1/servers/50354b59-597b-4592-aab3-4b1fcd07d8bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:43.319278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e94da613-0bed-4cb3-8701-bfd3f9153697 req-0c5d9a8f-595f-487c-84fb-09152a9d3828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accfa42e-7428-47a8-a6da-7594c2ebe80e", "name": "network-vif-deleted", "tag": "414f3c57-c1ce-484b-b358-b628484b7d89"}, {"name": "network-changed", "server_uuid": "20b820ba-bc27-4a3b-81a0-43a45340f60b", "tag": "bbab69b1-3249-4a95-ba39-0f3c3196a9e2"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:43.329593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e94da613-0bed-4cb3-8701-bfd3f9153697 req-0c5d9a8f-595f-487c-84fb-09152a9d3828 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.330065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e94da613-0bed-4cb3-8701-bfd3f9153697 req-0c5d9a8f-595f-487c-84fb-09152a9d3828 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.330485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e94da613-0bed-4cb3-8701-bfd3f9153697 req-0c5d9a8f-595f-487c-84fb-09152a9d3828 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.343331 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e94da613-0bed-4cb3-8701-bfd3f9153697 req-0c5d9a8f-595f-487c-84fb-09152a9d3828 service nova] Creating event network-vif-deleted:414f3c57-c1ce-484b-b358-b628484b7d89 for instance accfa42e-7428-47a8-a6da-7594c2ebe80e on n-h1-854119-9 Aug 29 04:54:43.343819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e94da613-0bed-4cb3-8701-bfd3f9153697 req-0c5d9a8f-595f-487c-84fb-09152a9d3828 service nova] Creating event network-changed:bbab69b1-3249-4a95-ba39-0f3c3196a9e2 for instance 20b820ba-bc27-4a3b-81a0-43a45340f60b on n-h1-854119-9 Aug 29 04:54:43.349046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-e94da613-0bed-4cb3-8701-bfd3f9153697 req-0c5d9a8f-595f-487c-84fb-09152a9d3828 service nova] Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:54:43.361238 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e94da613-0bed-4cb3-8701-bfd3f9153697 req-0c5d9a8f-595f-487c-84fb-09152a9d3828 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045396 Aug 29 04:54:43.362009 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 515/1146] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:43.366861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.367491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.373700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.374199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.374696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.375396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.375845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.376351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.391479 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] HTTP exception thrown: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Request method failure captured: Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a HTTP/1.1 Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWHXZja--9IrzRCr2yxmHnK7PjPteF-E2x1M5g-F4fkJhmgqAq1oYyRZ-AxS5eK9mrc8xiVxb8KVZJxJ5iEZHG8lDOKuP_UTyNMV0Dkr8XjSYCZDaaLCe-iXcYMsChZS3KY7OI1DDrmOjFzI-QWLvcW9rmMBeRIvBOdk_D6Dus5XVU Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:43.393225 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff90f242c8c443ea81148656e08dd959", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: a7d92346a9fb41fdb9c482a405661d2b Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.394590 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6dd58c75-b4bb-4fd6-846e-e3cb7e72388a'} Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:43.395344 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.396608 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.397833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Returning 404 to user: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:43.397833 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ad5719c8-bfa5-4582-8b66-acf4cc62bb4f tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 404 len: 111 microversion: 2.1 time: 0.031665 Aug 29 04:54:43.397833 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 516/1147] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:43 2022] DELETE /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:43.403125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.403770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] [instance: 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.410434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.410827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.411270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.411953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.412640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.413056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.428468 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] HTTP exception thrown: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Request method failure captured: Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a HTTP/1.1 Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWHXZja--9IrzRCr2yxmHnK7PjPteF-E2x1M5g-F4fkJhmgqAq1oYyRZ-AxS5eK9mrc8xiVxb8KVZJxJ5iEZHG8lDOKuP_UTyNMV0Dkr8XjSYCZDaaLCe-iXcYMsChZS3KY7OI1DDrmOjFzI-QWLvcW9rmMBeRIvBOdk_D6Dus5XVU Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:43.430396 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff90f242c8c443ea81148656e08dd959", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff90f242c8c443ea81148656e08dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ff90f242c8c443ea81148656e08dd959 Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838 Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: a7d92346a9fb41fdb9c482a405661d2b Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1766345838-project Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.431859 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6dd58c75-b4bb-4fd6-846e-e3cb7e72388a'} Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:43.432968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. Aug 29 04:54:43.434144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.440421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] Returning 404 to user: Instance 6dd58c75-b4bb-4fd6-846e-e3cb7e72388a could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:43.440421 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-230378af-cfeb-49cb-995a-4be2a8636b42 tempest-ServersWithSpecificFlavorTestJSON-1766345838 tempest-ServersWithSpecificFlavorTestJSON-1766345838-project] 10.222.0.20 "GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a" status: 404 len: 111 microversion: 2.1 time: 0.034427 Aug 29 04:54:43.440421 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 517/1148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:43 2022] GET /compute/v2.1/servers/6dd58c75-b4bb-4fd6-846e-e3cb7e72388a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:54:43.441773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.442330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: accfa42e-7428-47a8-a6da-7594c2ebe80e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.448979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.449470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.449901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.450688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.451145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.451556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.466240 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] HTTP exception thrown: Instance accfa42e-7428-47a8-a6da-7594c2ebe80e could not be found. Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Request method failure captured: Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e HTTP/1.1 Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXmZ61QjiDxll7vMGfu5O06pHptECUVnpAoLYjE-L86c4NvnxoMWVYRpXwz3ZNhyO-VOvRf_w9W5rT3cdSKHKEbPR6QLaEmdRipJvMamxxqERTUZ6CCnfZEVJvudVeLdqnmdnkk5QuVuoDgPn3P_THedQwkapA5ilqJuEE7erdwrvA Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:43.467846 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38bcab4cb30d4894bdec1572236a6347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 12fbf10dbdfe42a292e3c4e239196e36 Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance accfa42e-7428-47a8-a6da-7594c2ebe80e could not be found. Aug 29 04:54:43.469220 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'accfa42e-7428-47a8-a6da-7594c2ebe80e'} Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accfa42e-7428-47a8-a6da-7594c2ebe80e could not be found. Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:43.470034 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accfa42e-7428-47a8-a6da-7594c2ebe80e could not be found. Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accfa42e-7428-47a8-a6da-7594c2ebe80e could not be found. Aug 29 04:54:43.474514 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.475677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Returning 404 to user: Instance accfa42e-7428-47a8-a6da-7594c2ebe80e could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:43.475677 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8303224a-a16d-4336-bffd-4c0045794b2d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e" status: 404 len: 111 microversion: 2.1 time: 0.032909 Aug 29 04:54:43.475677 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 518/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:43 2022] GET /compute/v2.1/servers/accfa42e-7428-47a8-a6da-7594c2ebe80e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:43.478019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.478633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 419bf8df-33bd-47c9-beb5-4398ea8db81f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.484904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.485072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.485547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.486254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.486700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.487114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.502140 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] HTTP exception thrown: Instance 419bf8df-33bd-47c9-beb5-4398ea8db81f could not be found. Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Request method failure captured: Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f HTTP/1.1 Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXmZ61QjiDxll7vMGfu5O06pHptECUVnpAoLYjE-L86c4NvnxoMWVYRpXwz3ZNhyO-VOvRf_w9W5rT3cdSKHKEbPR6QLaEmdRipJvMamxxqERTUZ6CCnfZEVJvudVeLdqnmdnkk5QuVuoDgPn3P_THedQwkapA5ilqJuEE7erdwrvA Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:43.503687 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38bcab4cb30d4894bdec1572236a6347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 12fbf10dbdfe42a292e3c4e239196e36 Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 419bf8df-33bd-47c9-beb5-4398ea8db81f could not be found. Aug 29 04:54:43.505095 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '419bf8df-33bd-47c9-beb5-4398ea8db81f'} Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419bf8df-33bd-47c9-beb5-4398ea8db81f could not be found. Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:43.505823 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419bf8df-33bd-47c9-beb5-4398ea8db81f could not be found. Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419bf8df-33bd-47c9-beb5-4398ea8db81f could not be found. Aug 29 04:54:43.506989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:43.508054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Returning 404 to user: Instance 419bf8df-33bd-47c9-beb5-4398ea8db81f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:43.508054 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5dc9ec61-39c1-4f64-aba5-b3bf81cd4447 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f" status: 404 len: 111 microversion: 2.1 time: 0.030893 Aug 29 04:54:43.509367 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 519/1150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:43 2022] GET /compute/v2.1/servers/419bf8df-33bd-47c9-beb5-4398ea8db81f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:43.514504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2886d660-69e9-488f-9270-763a825be0c9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.548812 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2886d660-69e9-488f-9270-763a825be0c9 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/5d82fee1-fd1f-426c-8681-0ad48c37cade" status: 204 len: 0 microversion: 2.1 time: 0.038284 Aug 29 04:54:43.549387 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 520/1151] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 04:54:43 2022] DELETE /compute/v2.1/os-server-groups/5d82fee1-fd1f-426c-8681-0ad48c37cade => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:43.558057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.558595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.566304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.566804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.567234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.567945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.568429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.569625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.597601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:43.616871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:43.631204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:43.633204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:43.636325 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7cfa0ca3-9694-46ee-a7a5-61b10d592944 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.543278 Aug 29 04:54:43.637686 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 632/1152] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:43 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:43.700933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-df27c2ca-e8d6-4ea0-ade1-ff30c1201ed3 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 204 len: 0 microversion: 2.1 time: 0.146836 Aug 29 04:54:43.703105 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 521/1153] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:43 2022] DELETE /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:54:43.719220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.720413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.730050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.730617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.731178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.732150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.734040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.734626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.752547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.753518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.762066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.763714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.764177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.765066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.766311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.766958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.773737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:43.869181 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7661cefe-b82f-44a2-9bb9-f804b8a3ca69 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 204 len: 0 microversion: 2.1 time: 0.161232 Aug 29 04:54:43.870086 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 633/1154] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:43 2022] DELETE /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:43.878648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:43.879610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:43.885884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.886613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.887375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.888278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:43.889445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:43.889873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:43.913139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:44.224288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:44.236948 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a504102c-a570-41fb-80ad-4038bb9edb76 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1535 microversion: 2.1 time: 0.490488 Aug 29 04:54:44.250478 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 522/1155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:43 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1535 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:44.255705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:44.256350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:44.263776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:44.264868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:44.265725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:44.266786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:44.267434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:44.268044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:44.313660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:44.324314 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5abdadf0-e354-4049-89ee-88c247b30817 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 200 len: 1475 microversion: 2.1 time: 0.449959 Aug 29 04:54:44.324896 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 634/1156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:43 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 1475 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:44.331915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-383ce2fd-8664-496f-bbe5-882d464975a6 req-6e49ad4b-3bb8-4eba-8a7a-57b9b6da0494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e4c604-f8ec-4543-87ae-906f5e0fbb2f", "name": "network-vif-plugged", "status": "completed", "tag": "a629769f-7290-46cd-9c9d-933b910b2c27"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:44.346113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-383ce2fd-8664-496f-bbe5-882d464975a6 req-6e49ad4b-3bb8-4eba-8a7a-57b9b6da0494 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:44.348263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-383ce2fd-8664-496f-bbe5-882d464975a6 req-6e49ad4b-3bb8-4eba-8a7a-57b9b6da0494 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:44.348967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-383ce2fd-8664-496f-bbe5-882d464975a6 req-6e49ad4b-3bb8-4eba-8a7a-57b9b6da0494 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:44.363322 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-383ce2fd-8664-496f-bbe5-882d464975a6 req-6e49ad4b-3bb8-4eba-8a7a-57b9b6da0494 service nova] Creating event network-vif-plugged:a629769f-7290-46cd-9c9d-933b910b2c27 for instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f on n-h2-854119-9 Aug 29 04:54:44.368736 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-383ce2fd-8664-496f-bbe5-882d464975a6 req-6e49ad4b-3bb8-4eba-8a7a-57b9b6da0494 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042263 Aug 29 04:54:44.369304 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 635/1157] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:44.377621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:44.378545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:44.385338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:44.386029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:44.386926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:44.387830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:44.389477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:44.390247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:44.459233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:44.467334 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-915dfb60-6f8a-414e-9850-7e681113c153 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.215410 Aug 29 04:54:44.467901 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 523/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:44 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:44.563351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:44.574028 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bea62146-6f33-40bc-849a-c3bb7c7a85e7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1479 microversion: 2.1 time: 0.200602 Aug 29 04:54:44.574940 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 636/1159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:44 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1479 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:44.661528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:44.662253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:44.669604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:44.670383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:44.670812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:44.671502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:44.672107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:44.672550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.167622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:45.177670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:45.179112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:45.180327 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6129a43d-45d8-4302-b628-1cd36ded621c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.523969 Aug 29 04:54:45.180918 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 524/1160] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:44 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:45.260435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:45.261644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:45.268271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:45.269040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:45.269677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.270434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:45.271056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:45.271479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.347185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:45.348074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:45.355027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:45.355716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:45.356357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.357405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:45.358024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:45.358602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.443184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:45.451178 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b088d03f-f62a-4450-ba2c-829e380be6b4 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1535 microversion: 2.1 time: 0.194729 Aug 29 04:54:45.465590 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 637/1161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:45 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1535 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:45.470755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e108bb54-97e8-48c5-8e22-66b63d4841cf req-d41b37cd-8758-4c8c-aff4-5883caa0b72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9bae47-9a30-48f5-b86d-ae9fa9c52403", "tag": "72f1d871-74e2-445e-a041-82dcc368be0c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:45.480428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e108bb54-97e8-48c5-8e22-66b63d4841cf req-d41b37cd-8758-4c8c-aff4-5883caa0b72d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:45.480895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e108bb54-97e8-48c5-8e22-66b63d4841cf req-d41b37cd-8758-4c8c-aff4-5883caa0b72d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:45.481499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e108bb54-97e8-48c5-8e22-66b63d4841cf req-d41b37cd-8758-4c8c-aff4-5883caa0b72d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.493657 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e108bb54-97e8-48c5-8e22-66b63d4841cf req-d41b37cd-8758-4c8c-aff4-5883caa0b72d service nova] Creating event network-changed:72f1d871-74e2-445e-a041-82dcc368be0c for instance 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 on n-h2-854119-9 Aug 29 04:54:45.499732 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e108bb54-97e8-48c5-8e22-66b63d4841cf req-d41b37cd-8758-4c8c-aff4-5883caa0b72d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032589 Aug 29 04:54:45.500707 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 638/1162] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:45.506842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:45.507714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:45.514252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:45.515001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:45.515704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.516702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:45.517339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:45.517759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.524801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:45.533729 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb31595e-86f1-4fbe-b103-505ed068c2ce tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 200 len: 1475 microversion: 2.1 time: 0.190578 Aug 29 04:54:45.548321 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 525/1163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:45 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 1475 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:45.594975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:45.595627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:45.603922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:45.604395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:45.605024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.605483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:45.610484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:45.610939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:45.717547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:45.725542 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-72f5e6c3-355d-487d-b7f8-58caf471209f tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.223447 Aug 29 04:54:45.736627 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 639/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:45 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:45.778990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:45.788136 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d48738da-c202-4867-9151-93d2cce7a913 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1479 microversion: 2.1 time: 0.197022 Aug 29 04:54:45.789312 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 526/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:45 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1479 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:46.203372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:46.204876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:46.208018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:46.209074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:46.214979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:46.215472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:46.215909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:46.216646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:46.217100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:46.217517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:46.472577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:46.473185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:46.479807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:46.480342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:46.480763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:46.481438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:46.481882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:46.482291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:46.673589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:46.690361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:46.692155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:46.693528 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-10483090-f21a-49dd-aa01-d4b558db953e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.494556 Aug 29 04:54:46.704373 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 640/1166] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:46 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:46.716553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:46.717081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:46.723847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:46.724720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:46.725154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:46.725887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:46.726492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:46.727069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:47.177963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:47.197589 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-24906455-dfaf-4dc4-a9ff-96d647a44638 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1535 microversion: 2.1 time: 0.728680 Aug 29 04:54:47.213597 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 527/1167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:46 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1535 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:47.219714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:47.220525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:47.227908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:47.228928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:47.229564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:47.230492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:47.231188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:47.239921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:47.256786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:47.264688 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8bf1ffda-3365-4c35-bbab-9199317ed954 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 200 len: 1475 microversion: 2.1 time: 0.552049 Aug 29 04:54:47.267819 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 641/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:46 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 1475 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:47.276783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:47.278772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:47.295850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:47.296385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:47.296823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:47.297540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:47.298234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:47.298654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:47.622602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:47.637943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1a53ff4a-d073-42bf-8a52-97e114340147 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.422601 Aug 29 04:54:47.639625 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 528/1169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:47 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:47.645995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c8e1bfa2-2db9-4f09-8773-83b4cf52e897 req-284c9845-3065-4b65-87f3-7c774378fe4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3f0ff4-e186-4e1e-b425-f4216bdb515b", "name": "network-vif-deleted", "tag": "95f0f1e4-bb45-403f-9a1c-a586976f64b4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:47.667444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c8e1bfa2-2db9-4f09-8773-83b4cf52e897 req-284c9845-3065-4b65-87f3-7c774378fe4a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:47.668654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c8e1bfa2-2db9-4f09-8773-83b4cf52e897 req-284c9845-3065-4b65-87f3-7c774378fe4a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:47.669094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c8e1bfa2-2db9-4f09-8773-83b4cf52e897 req-284c9845-3065-4b65-87f3-7c774378fe4a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:47.696154 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c8e1bfa2-2db9-4f09-8773-83b4cf52e897 req-284c9845-3065-4b65-87f3-7c774378fe4a service nova] Creating event network-vif-deleted:95f0f1e4-bb45-403f-9a1c-a586976f64b4 for instance 4f3f0ff4-e186-4e1e-b425-f4216bdb515b on n-h2-854119-9 Aug 29 04:54:47.704197 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c8e1bfa2-2db9-4f09-8773-83b4cf52e897 req-284c9845-3065-4b65-87f3-7c774378fe4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062412 Aug 29 04:54:47.704932 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 529/1170] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:47.714803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:47.739280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:47.740034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:47.753783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:47.754283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:47.754736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:47.755459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:47.755921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:47.760367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:47.764445 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1766dd18-0bd1-4d17-b188-39525d12fe12 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1479 microversion: 2.1 time: 0.493810 Aug 29 04:54:47.766753 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 642/1171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:47 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1479 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:48.126929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fa403357-3ef9-4f08-92a8-ff44ac22d85e req-e8ad39f7-cce6-4650-af8b-aa7858868d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccdf52d-5472-4915-a47a-007b164fb08d", "name": "network-vif-deleted", "tag": "36b48416-52f3-4bc9-acf3-f4ce2ced8f0a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:48.144707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fa403357-3ef9-4f08-92a8-ff44ac22d85e req-e8ad39f7-cce6-4650-af8b-aa7858868d22 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:48.148015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fa403357-3ef9-4f08-92a8-ff44ac22d85e req-e8ad39f7-cce6-4650-af8b-aa7858868d22 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:48.149631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fa403357-3ef9-4f08-92a8-ff44ac22d85e req-e8ad39f7-cce6-4650-af8b-aa7858868d22 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:48.217309 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fa403357-3ef9-4f08-92a8-ff44ac22d85e req-e8ad39f7-cce6-4650-af8b-aa7858868d22 service nova] Creating event network-vif-deleted:36b48416-52f3-4bc9-acf3-f4ce2ced8f0a for instance 2ccdf52d-5472-4915-a47a-007b164fb08d on n-h2-854119-9 Aug 29 04:54:48.234913 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fa403357-3ef9-4f08-92a8-ff44ac22d85e req-e8ad39f7-cce6-4650-af8b-aa7858868d22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110949 Aug 29 04:54:48.238842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 643/1172] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:48.258833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:48.259218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:48.261118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:48.276314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:48.276545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:48.277826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:48.278333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:48.279197 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9ec6244a-ffae-4b25-b58b-b2498decefd9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.551968 Aug 29 04:54:48.279817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:48.281466 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 530/1173] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:47 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:48.282590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:48.285571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:48.286381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:48.289812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:48.290447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:48.304508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:48.305006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:48.307627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:48.308450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:48.308918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:48.312170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:48.455020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:48.473199 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c61565ee-502b-45d0-8dba-3e2373e9785b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 200 len: 1304 microversion: 2.1 time: 0.186268 Aug 29 04:54:48.473820 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 531/1174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:48 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:48.607659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:48.620043 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef82f832-59f4-4be7-8470-a10dad37b362 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1535 microversion: 2.1 time: 0.379151 Aug 29 04:54:48.620681 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 644/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:48 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1535 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:48.668269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:48.668988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:48.685202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:48.685696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:48.690085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:48.694822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:48.695323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:48.695764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:48.788371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:48.789072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:48.796560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:48.796999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:48.797519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:48.798344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:48.798796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:48.799219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.058850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:49.069191 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-401c84b8-4cb4-45a8-b2cc-9282fbe0c1ee tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.409361 Aug 29 04:54:49.083571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:49.084760 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 532/1176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:48 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:49.098973 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-35f0ade4-f544-4942-88fb-3e0b3c5e66be tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1464 microversion: 2.1 time: 0.315997 Aug 29 04:54:49.127829 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 645/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:48 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:49.129078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b00ead6-dd0a-44fe-9369-0c44b01297c4 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:49.131458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b00ead6-dd0a-44fe-9369-0c44b01297c4 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:49.140746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b00ead6-dd0a-44fe-9369-0c44b01297c4 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.141483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b00ead6-dd0a-44fe-9369-0c44b01297c4 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.141977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b00ead6-dd0a-44fe-9369-0c44b01297c4 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.142883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b00ead6-dd0a-44fe-9369-0c44b01297c4 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.143517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b00ead6-dd0a-44fe-9369-0c44b01297c4 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.144182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b00ead6-dd0a-44fe-9369-0c44b01297c4 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.172501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:49.239051 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b00ead6-dd0a-44fe-9369-0c44b01297c4 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action" status: 202 len: 0 microversion: 2.1 time: 0.113826 Aug 29 04:54:49.243018 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 533/1178] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:54:49 2022] POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:54:49.248319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:49.249145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:49.259832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.260382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.260796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.261504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.263186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.263612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.297202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.297596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.298365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.298985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lazy-loading 'fault' on Instance uuid 10e4c604-f8ec-4543-87ae-906f5e0fbb2f {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:49.307405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:49.313873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:49.320808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.321380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.321902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.322691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.323237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.323707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.504697 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d4d21536-d321-4568-b88a-d810891a0d3b tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1598 microversion: 2.1 time: 0.260144 Aug 29 04:54:49.516269 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 646/1179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:49 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1598 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:49.516269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:49.516269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:49.516711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.517070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.517637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.518323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.518934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.519532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.554617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:49.564613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:49.566209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:49.567480 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5411464f-eefb-4114-8769-dc9cfadc10b0 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.264088 Aug 29 04:54:49.568258 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 534/1180] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:49 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:49.573368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:49.574203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:49.581711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.582470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.583096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.584016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.584588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.585025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.616798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.617316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.617855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.618637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lazy-loading 'fault' on Instance uuid 2ccdf52d-5472-4915-a47a-007b164fb08d {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:49.668381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 1b14f0ef-853d-4876-888d-045a86ffd64a {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:49.683730 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5dee9723-bc44-4f18-9fd6-893e9f662256 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 2344 microversion: 2.25 time: 0.176679 Aug 29 04:54:49.683876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:49.684682 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 647/1181] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:49 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 2344 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:49.689507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84a22198-b06f-41fa-aa8c-43c228890373 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:49.691914 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6b71a730-f8df-4015-ba09-870b1576eda7 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 200 len: 1309 microversion: 2.1 time: 0.122443 Aug 29 04:54:49.692715 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 535/1182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:49 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:49.693093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84a22198-b06f-41fa-aa8c-43c228890373 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:49.699881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a22198-b06f-41fa-aa8c-43c228890373 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.700629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a22198-b06f-41fa-aa8c-43c228890373 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.701237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a22198-b06f-41fa-aa8c-43c228890373 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.702087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a22198-b06f-41fa-aa8c-43c228890373 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.703054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a22198-b06f-41fa-aa8c-43c228890373 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.703482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a22198-b06f-41fa-aa8c-43c228890373 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.708978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:49.710116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:49.720483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.721123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.722178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.724321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.724885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.725407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.799936 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84a22198-b06f-41fa-aa8c-43c228890373 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action" status: 202 len: 0 microversion: 2.1 time: 0.113913 Aug 29 04:54:49.800736 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 648/1183] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:54:49 2022] POST /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:54:49.808640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-61819023-4bff-4755-bd0a-d21593e85e87 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:49.812380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61819023-4bff-4755-bd0a-d21593e85e87 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.812870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61819023-4bff-4755-bd0a-d21593e85e87 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.813342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61819023-4bff-4755-bd0a-d21593e85e87 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.814192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61819023-4bff-4755-bd0a-d21593e85e87 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.814639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61819023-4bff-4755-bd0a-d21593e85e87 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.815058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61819023-4bff-4755-bd0a-d21593e85e87 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.841841 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-61819023-4bff-4755-bd0a-d21593e85e87 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037034 Aug 29 04:54:49.843008 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 649/1184] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Aug 29 04:54:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:54:49.848433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6504af17-f310-4aa0-aa51-c0d1db62ff78 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:49.849845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6504af17-f310-4aa0-aa51-c0d1db62ff78 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:49.858631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6504af17-f310-4aa0-aa51-c0d1db62ff78 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.859340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6504af17-f310-4aa0-aa51-c0d1db62ff78 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.860184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6504af17-f310-4aa0-aa51-c0d1db62ff78 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.862368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6504af17-f310-4aa0-aa51-c0d1db62ff78 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.863280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6504af17-f310-4aa0-aa51-c0d1db62ff78 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.864552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6504af17-f310-4aa0-aa51-c0d1db62ff78 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.883010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:49.897239 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8ae7c5c-7802-412e-8a2c-4d26e07a1a16 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1528 microversion: 2.1 time: 0.194286 Aug 29 04:54:49.905551 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 536/1185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:49 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1528 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:49.918717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:49.920214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:49.927859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.928385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.928815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:49.929572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:49.930097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:49.930426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:50.117792 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6504af17-f310-4aa0-aa51-c0d1db62ff78 tempest-ServersAdminTestJSON-1916934003 tempest-ServersAdminTestJSON-1916934003-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1615 microversion: 2.1 time: 0.273553 Aug 29 04:54:50.119986 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 650/1186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:49 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1615 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:50.121074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:50.130141 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fdae747b-a186-43ac-8b89-bc32f781d4bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1528 microversion: 2.1 time: 0.220286 Aug 29 04:54:50.140242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:50.140242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:50.141670 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 537/1187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:49 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1528 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:50.147554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:50.147963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:50.148420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:50.149125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:50.149580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:50.150002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:50.150734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:50.151786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:50.158858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:50.159565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:50.159987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:50.160867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:50.161617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:50.162188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:50.190127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:50.194615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:50.292799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:DELETE=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:50.345174 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17cdb02b-bbd8-4630-afa3-33097ce00980 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 204 len: 0 microversion: 2.1 time: 0.201894 Aug 29 04:54:50.351417 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 538/1188] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:50 2022] DELETE /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:50.362620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e3aaae9-77f3-4714-acf0-1b724375da13 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:50.375949 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-0e3aaae9-77f3-4714-acf0-1b724375da13 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] HTTP exception thrown: Flavor 062e7785-2153-43f5-a355-279546983f9f could not be found. Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e3aaae9-77f3-4714-acf0-1b724375da13 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Request method failure captured: Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/flavors/062e7785-2153-43f5-a355-279546983f9f HTTP/1.1 Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWUeXnKaU2-pzroyoBpNmTQ23j7de04CVf24bNH2Sdu4AyOIGYdnym5ASx_aquBAcFeJqSBKZCQazwDm-Y0iiOW1JfY5-E1C77J0LTKtUIfkH4uB8aBqhoG92bRjkcQjBsL5J3qWBuploBZiHD76ChQIhTAeIiYnTliHSFe-CvJQRY Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 7d225bc4b57845e990e62a214d8e7532 Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-MigrationsAdminTest-1168929290 Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:54:50.380460 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d225bc4b57845e990e62a214d8e7532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d225bc4b57845e990e62a214d8e7532"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d225bc4b57845e990e62a214d8e7532", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d225bc4b57845e990e62a214d8e7532"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-MigrationsAdminTest-1168929290 Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 7d225bc4b57845e990e62a214d8e7532 Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-MigrationsAdminTest-1168929290 Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-MigrationsAdminTest-1168929290-project-admin Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: aea0e5ec42e141939ae4050a3868a415 Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-MigrationsAdminTest-1168929290-project-admin Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: exception: Flavor 062e7785-2153-43f5-a355-279546983f9f could not be found. Aug 29 04:54:50.382052 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '062e7785-2153-43f5-a355-279546983f9f'} Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 062e7785-2153-43f5-a355-279546983f9f could not be found. Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:50.382957 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 062e7785-2153-43f5-a355-279546983f9f could not be found. Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 062e7785-2153-43f5-a355-279546983f9f could not be found. Aug 29 04:54:50.384451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:50.385739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e3aaae9-77f3-4714-acf0-1b724375da13 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Returning 404 to user: Flavor 062e7785-2153-43f5-a355-279546983f9f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:50.385839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:50.386656 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e3aaae9-77f3-4714-acf0-1b724375da13 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/062e7785-2153-43f5-a355-279546983f9f" status: 404 len: 109 microversion: 2.1 time: 0.030676 Aug 29 04:54:50.387248 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 539/1189] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:50 2022] DELETE /compute/v2.1/flavors/062e7785-2153-43f5-a355-279546983f9f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:50.400078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:50.400078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:50.400327 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a490dca3-7915-4a4f-af3a-af9790531d9d tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.273273 Aug 29 04:54:50.408768 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 651/1190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:50 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:50.417785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:50.419363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:50.419901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:50.420795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:50.421326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:50.421835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:50.566268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-281090311", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:50.584913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:50.598642 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-da94a5bf-7ad3-4e8d-99c3-e2465cdddc85 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1469 microversion: 2.1 time: 0.210311 Aug 29 04:54:50.604284 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 540/1191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:50 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:50.622999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:50.624841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:50.632670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:50.633436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:50.634226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:50.635727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:50.636421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:50.637001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:50.637522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:54:51.037457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:51.049824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:51.051919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:51.053819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-159312c3-fb5c-4c99-ba43-57987291431c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.453115 Aug 29 04:54:51.064222 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 541/1192] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:50 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:51.064222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:51.064222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:51.070519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.071217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.071799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.072689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.073379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.073912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.109077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:54:51.109977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:54:51.110577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:54:51.110988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:54:51.111499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:54:51.125175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.127047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.127610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.128458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.128992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.129549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.131208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.131789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lazy-loading 'fault' on Instance uuid 2ccdf52d-5472-4915-a47a-007b164fb08d {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:51.135010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.135686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.175855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:54:51.182317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Getting quotas for user 4fbcb22f6bfb44e7b149c0b9e06014b8 and project 750d30e9d0ec4122a143ec01fd2c1a94. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:54:51.183572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:51.197258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:54:51.197656 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-65c2269a-b9d3-43ef-bc91-e978b74db2b0 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 200 len: 1309 microversion: 2.1 time: 0.139975 Aug 29 04:54:51.198319 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 542/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:51 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 1309 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:51.211656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:54:51.262269 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69435bec-07aa-463d-84ae-29f5d87922f2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699833 Aug 29 04:54:51.263158 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 652/1194] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:54:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 04:54:51.274800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-19e6767b-98c8-4aec-86d6-70c47d41f989 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:51.275696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-19e6767b-98c8-4aec-86d6-70c47d41f989 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:51.371659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-19e6767b-98c8-4aec-86d6-70c47d41f989 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:51.387657 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-19e6767b-98c8-4aec-86d6-70c47d41f989 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1212 microversion: 2.1 time: 0.117264 Aug 29 04:54:51.394669 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 543/1195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:51 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:51.421116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:51.422370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:51.422949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7096abea-2006-4da1-99cf-07f37e311d57 req-7703361a-eb56-4997-a692-6f0f6703b0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b820ba-bc27-4a3b-81a0-43a45340f60b", "name": "network-vif-plugged", "status": "completed", "tag": "bbab69b1-3249-4a95-ba39-0f3c3196a9e2"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:51.437760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.438363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:51.438959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.440956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.442971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.443538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.444560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.450274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7096abea-2006-4da1-99cf-07f37e311d57 req-7703361a-eb56-4997-a692-6f0f6703b0d2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.451102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7096abea-2006-4da1-99cf-07f37e311d57 req-7703361a-eb56-4997-a692-6f0f6703b0d2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.455314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7096abea-2006-4da1-99cf-07f37e311d57 req-7703361a-eb56-4997-a692-6f0f6703b0d2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.493669 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7096abea-2006-4da1-99cf-07f37e311d57 req-7703361a-eb56-4997-a692-6f0f6703b0d2 service nova] Creating event network-vif-plugged:bbab69b1-3249-4a95-ba39-0f3c3196a9e2 for instance 20b820ba-bc27-4a3b-81a0-43a45340f60b on n-h1-854119-9 Aug 29 04:54:51.494726 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7096abea-2006-4da1-99cf-07f37e311d57 req-7703361a-eb56-4997-a692-6f0f6703b0d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082453 Aug 29 04:54:51.498972 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 653/1196] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:51.620548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:51.621780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:51.635260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.635831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.636363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.637100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:51.637568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:51.637992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:51.766623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:51.774584 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5772c0b7-6560-483c-bf2e-b9dbe59a6353 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.357822 Aug 29 04:54:51.788926 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 544/1197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:51 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:51.868700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:51.877371 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de462107-c42f-4204-9b16-78618587231b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1469 microversion: 2.1 time: 0.261907 Aug 29 04:54:51.878313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 654/1198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:51 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1469 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:52.079198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:52.079820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:52.087574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:52.088069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:52.088538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:52.089242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:52.089700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:52.090121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:52.219120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:52.220457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:52.231507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:52.231999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:52.232663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:52.234161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:52.238016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:52.238779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:52.312420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:52.312912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:52.313400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:52.314183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lazy-loading 'fault' on Instance uuid 2ccdf52d-5472-4915-a47a-007b164fb08d {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:52.681501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:52.700436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cdc55316-d513-4f19-9ce3-b2c3fa5ced20 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 200 len: 1309 microversion: 2.1 time: 0.484603 Aug 29 04:54:52.706102 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 655/1199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:52 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:52.715384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:52.721863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:52.728386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:52.729070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:52.729665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:52.730637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:52.731314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:52.732040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:52.936435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:52.948856 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-131dbb5e-3d22-4a53-bed3-a4ab15b602d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1264 microversion: 2.1 time: 0.240766 Aug 29 04:54:52.953968 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 656/1200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:52 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:52.961377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a843cfa3-2ce5-4d9c-bffa-412d722408bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f33be1d-6cfe-40ea-aeb5-e9a74ca12685", "device": "/dev/xvdb"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:52.966897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a843cfa3-2ce5-4d9c-bffa-412d722408bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:52.974000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a843cfa3-2ce5-4d9c-bffa-412d722408bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:52.974626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a843cfa3-2ce5-4d9c-bffa-412d722408bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:52.975249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a843cfa3-2ce5-4d9c-bffa-412d722408bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:52.976056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a843cfa3-2ce5-4d9c-bffa-412d722408bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:52.976632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a843cfa3-2ce5-4d9c-bffa-412d722408bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:52.977199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a843cfa3-2ce5-4d9c-bffa-412d722408bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.109464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:53.120159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:53.121853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:53.123234 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3615290e-1868-49c6-8f04-e612c8151f01 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 1.048303 Aug 29 04:54:53.140465 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 545/1201] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:52 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:53.147133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:53.147953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:53.155220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.155932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.157415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.158460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.159304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.160518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.399238 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a843cfa3-2ce5-4d9c-bffa-412d722408bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "POST /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.443532 Aug 29 04:54:53.400908 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 657/1202] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Aug 29 04:54:52 2022] POST /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:54:53.406728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:53.408412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:53.419500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.420364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.421022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.422009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.423122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.423801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.761118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:53.770534 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b30838bf-7ef5-4bd0-9b4e-a47df1c9bd1a tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.627643 Aug 29 04:54:53.771212 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 546/1203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:53 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:53.776200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:53.777141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 2ccdf52d-5472-4915-a47a-007b164fb08d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:53.783268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.783819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.784342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.785083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.785748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.786357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.810476 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] HTTP exception thrown: Instance 2ccdf52d-5472-4915-a47a-007b164fb08d could not be found. Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Request method failure captured: Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d HTTP/1.1 Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXmZ61QjiDxll7vMGfu5O06pHptECUVnpAoLYjE-L86c4NvnxoMWVYRpXwz3ZNhyO-VOvRf_w9W5rT3cdSKHKEbPR6QLaEmdRipJvMamxxqERTUZ6CCnfZEVJvudVeLdqnmdnkk5QuVuoDgPn3P_THedQwkapA5ilqJuEE7erdwrvA Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:53.812034 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38bcab4cb30d4894bdec1572236a6347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 12fbf10dbdfe42a292e3c4e239196e36 Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 2ccdf52d-5472-4915-a47a-007b164fb08d could not be found. Aug 29 04:54:53.813667 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '2ccdf52d-5472-4915-a47a-007b164fb08d'} Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ccdf52d-5472-4915-a47a-007b164fb08d could not be found. Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:53.814553 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ccdf52d-5472-4915-a47a-007b164fb08d could not be found. Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ccdf52d-5472-4915-a47a-007b164fb08d could not be found. Aug 29 04:54:53.816058 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.818803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Returning 404 to user: Instance 2ccdf52d-5472-4915-a47a-007b164fb08d could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:53.818803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17ce2430-d5ff-469f-92a2-bf5bc1357507 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d" status: 404 len: 111 microversion: 2.1 time: 0.041000 Aug 29 04:54:53.818803 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 547/1204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:53 2022] GET /compute/v2.1/servers/2ccdf52d-5472-4915-a47a-007b164fb08d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:53.826386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:53.827091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 4f3f0ff4-e186-4e1e-b425-f4216bdb515b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:53.834951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.835511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.836403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.837181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.837706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.838199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.858135 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] HTTP exception thrown: Instance 4f3f0ff4-e186-4e1e-b425-f4216bdb515b could not be found. Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Request method failure captured: Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b HTTP/1.1 Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXmZ61QjiDxll7vMGfu5O06pHptECUVnpAoLYjE-L86c4NvnxoMWVYRpXwz3ZNhyO-VOvRf_w9W5rT3cdSKHKEbPR6QLaEmdRipJvMamxxqERTUZ6CCnfZEVJvudVeLdqnmdnkk5QuVuoDgPn3P_THedQwkapA5ilqJuEE7erdwrvA Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:53.859804 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38bcab4cb30d4894bdec1572236a6347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 12fbf10dbdfe42a292e3c4e239196e36 Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 4f3f0ff4-e186-4e1e-b425-f4216bdb515b could not be found. Aug 29 04:54:53.862485 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '4f3f0ff4-e186-4e1e-b425-f4216bdb515b'} Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3f0ff4-e186-4e1e-b425-f4216bdb515b could not be found. Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:53.863289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3f0ff4-e186-4e1e-b425-f4216bdb515b could not be found. Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3f0ff4-e186-4e1e-b425-f4216bdb515b could not be found. Aug 29 04:54:53.864703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:53.868514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Returning 404 to user: Instance 4f3f0ff4-e186-4e1e-b425-f4216bdb515b could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:53.868514 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ea481c7e-cd57-48aa-86df-c138a8b50915 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b" status: 404 len: 111 microversion: 2.1 time: 0.040786 Aug 29 04:54:53.868514 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 548/1205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:53 2022] GET /compute/v2.1/servers/4f3f0ff4-e186-4e1e-b425-f4216bdb515b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:54:53.868514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-56ca0b8c-4799-4a24-b24a-e796cd97de99 req-672b5ec1-d545-4719-bdb5-e1a401e33416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63eef86-e101-462a-ab1f-3d16795b0689", "name": "network-vif-deleted", "tag": "826a9e27-8404-452e-9266-5e59fd5a4c03"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:53.873589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:53.879098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-56ca0b8c-4799-4a24-b24a-e796cd97de99 req-672b5ec1-d545-4719-bdb5-e1a401e33416 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.879947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-56ca0b8c-4799-4a24-b24a-e796cd97de99 req-672b5ec1-d545-4719-bdb5-e1a401e33416 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.880611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-56ca0b8c-4799-4a24-b24a-e796cd97de99 req-672b5ec1-d545-4719-bdb5-e1a401e33416 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.884044 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-902231d7-9ba4-47a9-ad9a-206e57b9094e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1469 microversion: 2.1 time: 0.481301 Aug 29 04:54:53.898235 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 658/1206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:53 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1469 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:53.898533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b28167fd-ed5d-47d5-a87a-3470d35fd2ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:53.908876 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-56ca0b8c-4799-4a24-b24a-e796cd97de99 req-672b5ec1-d545-4719-bdb5-e1a401e33416 service nova] Creating event network-vif-deleted:826a9e27-8404-452e-9266-5e59fd5a4c03 for instance e63eef86-e101-462a-ab1f-3d16795b0689 on n-h2-854119-9 Aug 29 04:54:53.918917 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-56ca0b8c-4799-4a24-b24a-e796cd97de99 req-672b5ec1-d545-4719-bdb5-e1a401e33416 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055049 Aug 29 04:54:53.920754 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 549/1207] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:53.954512 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b28167fd-ed5d-47d5-a87a-3470d35fd2ca tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/b9032b51-7400-475f-8aab-76fd60d08d1b" status: 204 len: 0 microversion: 2.1 time: 0.067538 Aug 29 04:54:53.955382 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 659/1208] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 04:54:53 2022] DELETE /compute/v2.1/os-server-groups/b9032b51-7400-475f-8aab-76fd60d08d1b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:53.965864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:53.966596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:53.970317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:53.970999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:53.982155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.982356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.982660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.982984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.983528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.984092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.984299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.984901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.985565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:53.986187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:53.987988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:53.988678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.021512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:54.028915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:54.087560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:54.100485 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-02882e08-a08f-40f3-aa7a-9a1f7cfb29b8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1272 microversion: 2.1 time: 0.134534 Aug 29 04:54:54.102732 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 660/1209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:53 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:54.148220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:54.149002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:54.158440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.158832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.159265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.159987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.160544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.160891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.175335 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d1f3eef6-68df-4aca-8685-381a1dd0bb8a tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "DELETE /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 204 len: 0 microversion: 2.1 time: 0.215180 Aug 29 04:54:54.179527 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 550/1210] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:53 2022] DELETE /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:54.202992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:54.204093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:54.225935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.227058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.229207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.230089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.231700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.234010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.678859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:54.701395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:54.707676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:54.710647 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d98907a-d420-432d-818c-7509cdf09d68 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.567677 Aug 29 04:54:54.712158 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 661/1211] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:54 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:54.731893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:54.747825 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8bf94e8f-3597-42bf-8b50-42a14cd6d127 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1472 microversion: 2.1 time: 0.562789 Aug 29 04:54:54.765396 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 551/1212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:54 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1472 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:54.785099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a992ece3-7d3b-4359-ba36-1d85b8324103 req-5df6b478-4247-4069-b720-98dfc0a83e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9bae47-9a30-48f5-b86d-ae9fa9c52403", "name": "network-vif-plugged", "status": "completed", "tag": "72f1d871-74e2-445e-a041-82dcc368be0c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:54.792385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:54.793331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:54.803448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.805729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.807249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a992ece3-7d3b-4359-ba36-1d85b8324103 req-5df6b478-4247-4069-b720-98dfc0a83e43 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.807904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.809830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.810566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.810783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a992ece3-7d3b-4359-ba36-1d85b8324103 req-5df6b478-4247-4069-b720-98dfc0a83e43 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.811417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a992ece3-7d3b-4359-ba36-1d85b8324103 req-5df6b478-4247-4069-b720-98dfc0a83e43 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.811658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.864182 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a992ece3-7d3b-4359-ba36-1d85b8324103 req-5df6b478-4247-4069-b720-98dfc0a83e43 service nova] Creating event network-vif-plugged:72f1d871-74e2-445e-a041-82dcc368be0c for instance 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 on n-h2-854119-9 Aug 29 04:54:54.875140 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a992ece3-7d3b-4359-ba36-1d85b8324103 req-5df6b478-4247-4069-b720-98dfc0a83e43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094332 Aug 29 04:54:54.878590 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 662/1213] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:54.906660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:54.907385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:54.918240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.918729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.919154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.924026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.928333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.929166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.975644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:54.976374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:54.977079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:54.977773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lazy-loading 'fault' on Instance uuid e63eef86-e101-462a-ab1f-3d16795b0689 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:55.067164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:55.082179 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-65202dbe-ea8d-41af-b0db-2f231c52a4f6 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1303 microversion: 2.1 time: 0.178799 Aug 29 04:54:55.083872 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 663/1214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:54 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1303 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:55.098891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:55.108843 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d3deccd0-448d-4ee9-a11a-809957fb977e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.321360 Aug 29 04:54:55.110083 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 552/1215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:54 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:54:55.130238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:55.130857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:55.139694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:55.154927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:55.157398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:55.158414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:55.160307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:55.164897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:55.309832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:55.320537 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-945f9652-1840-4c08-be13-f58c2a9acdb2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1270 microversion: 2.1 time: 0.195390 Aug 29 04:54:55.324539 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 664/1216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:55 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1270 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:55.735053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:55.735716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:55.749869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:55.750638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:55.751249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:55.752276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:55.752959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:55.753583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:55.771071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:55.773968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:55.790381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:55.791624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:55.793423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:55.794778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:55.796348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:55.797901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:56.225227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:56.235132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:56.236598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:56.238111 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f06f7a56-a36b-4383-bfa7-1474210f1049 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.507225 Aug 29 04:54:56.238695 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 553/1217] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:55 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:56.244328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:56.245191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:56.251373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:56.252197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:56.252865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:56.253776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:56.254440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:56.255101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:56.285126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:56.287197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:56.287769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:56.288401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:56.289071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lazy-loading 'fault' on Instance uuid e63eef86-e101-462a-ab1f-3d16795b0689 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:56.301358 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06f85bfb-35d3-4d9e-a536-4323c2b94e03 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1472 microversion: 2.1 time: 0.533760 Aug 29 04:54:56.301964 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 665/1218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:55 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:56.310028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:56.311434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:56.318544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:56.319170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:56.319871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:56.320846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:56.321542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:56.322130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:56.362709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:56.371253 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-138bf5b9-443f-4bab-833d-f36f45099d14 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 200 len: 1303 microversion: 2.1 time: 0.131269 Aug 29 04:54:56.371935 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 554/1219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:56 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:56.530206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-473965210", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:56.540772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:56.550574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9759a99-125c-4549-bc4c-3c5b3177d6ed tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1318 microversion: 2.1 time: 0.246558 Aug 29 04:54:56.551782 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 666/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:56 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:56.556934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:56.557841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:56.566281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:56.566822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:56.567314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:56.568088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:56.568908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:56.569499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:56.606020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:54:56.923384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:56.932000 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-850e0a77-475b-4296-92ae-109cab47183c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1312 microversion: 2.1 time: 0.378814 Aug 29 04:54:56.933351 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 667/1221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:56 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1312 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:57.031264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:54:57.031815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:54:57.032995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:54:57.033414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:54:57.033937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:54:57.045733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-cd3e4d89-0d68-4d4b-a02e-d044a2bfd994 req-43f2d7ab-fa63-4d88-9671-d83e30ebdcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a99c1b-98ad-4d46-9be1-6d36ec32604b", "tag": "bf0358be-94b3-48f2-9869-3120396522f3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:57.046188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:57.046679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:57.047110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:57.047906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:57.048438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:57.048858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:57.071698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd3e4d89-0d68-4d4b-a02e-d044a2bfd994 req-43f2d7ab-fa63-4d88-9671-d83e30ebdcae service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:57.073808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd3e4d89-0d68-4d4b-a02e-d044a2bfd994 req-43f2d7ab-fa63-4d88-9671-d83e30ebdcae service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:57.075375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Getting quotas for project 202ee9ec794b40439b2c5aa9ab4f2dcb. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:54:57.076034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd3e4d89-0d68-4d4b-a02e-d044a2bfd994 req-43f2d7ab-fa63-4d88-9671-d83e30ebdcae service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:57.082923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Getting quotas for user 730821ec74eb48ab8e474db8bbcf97b7 and project 202ee9ec794b40439b2c5aa9ab4f2dcb. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:54:57.101779 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-cd3e4d89-0d68-4d4b-a02e-d044a2bfd994 req-43f2d7ab-fa63-4d88-9671-d83e30ebdcae service nova] Creating event network-changed:bf0358be-94b3-48f2-9869-3120396522f3 for instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b on n-h1-854119-9 Aug 29 04:54:57.106878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:54:57.108185 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-cd3e4d89-0d68-4d4b-a02e-d044a2bfd994 req-43f2d7ab-fa63-4d88-9671-d83e30ebdcae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067451 Aug 29 04:54:57.109405 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 668/1222] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:54:57.110087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:54:57.179094 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cac4a26f-f1f0-4775-a7f8-9e1dded1cbb0 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805619 Aug 29 04:54:57.180484 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 555/1223] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:54:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:54:57.204806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2060a1fa-32a9-40de-add3-3c0cd7f5a02b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:57.206979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2060a1fa-32a9-40de-add3-3c0cd7f5a02b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:57.275954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:57.277009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:57.284857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:57.285721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:57.286945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:57.287893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:57.289510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:57.290459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:57.783390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2060a1fa-32a9-40de-add3-3c0cd7f5a02b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:57.795542 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2060a1fa-32a9-40de-add3-3c0cd7f5a02b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1219 microversion: 2.1 time: 0.607059 Aug 29 04:54:57.798266 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 669/1224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:57 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1219 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:57.806475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:57.807402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:57.816462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:57.817077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:57.817886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:57.818752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:57.819586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:57.820379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.156604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:58.168303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:58.169963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:58.171303 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a3e9b0e5-bc7a-47c4-ad1d-8e5f68554679 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.913485 Aug 29 04:54:58.172405 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 556/1225] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:57 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:58.178794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:58.179630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: e63eef86-e101-462a-ab1f-3d16795b0689] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:58.187228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.187986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.188484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.189183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.189787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.190365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.201285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:58.210350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:54:58.217279 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-848e3797-ce6b-4653-8671-a108ceb2c1a6 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1472 microversion: 2.1 time: 0.415134 Aug 29 04:54:58.220782 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 670/1226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:57 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:58.240609 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] HTTP exception thrown: Instance e63eef86-e101-462a-ab1f-3d16795b0689 could not be found. Aug 29 04:54:58.241457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:58.242096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Request method failure captured: Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 HTTP/1.1 Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEYNJLQHji1DbBol6aNAjCtucALD8304ZlpDNZxCjMoAkFDTh0l0yemrbpinlJlRz5Ff43ioX9PU5mj8VuP7Uc5Ik6tkpK_I1gl9SQdD67qGcyJYtkKpR1RtmSJgP3SdD6YOjC5mRQ1BwEtPqNK5k6moX3WVEQNj71Eo1PjNN4fsxUI Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 13f1750a840a4c9e91529b3f71830c8a Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminTestJSON-1927656443 Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:54:58.243177 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f1750a840a4c9e91529b3f71830c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f1750a840a4c9e91529b3f71830c8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f1750a840a4c9e91529b3f71830c8a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f1750a840a4c9e91529b3f71830c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminTestJSON-1927656443 Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 13f1750a840a4c9e91529b3f71830c8a Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminTestJSON-1927656443 Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminTestJSON-1927656443-project Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c02a1e5093784394a6dd23c5d5ff51d6 Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminTestJSON-1927656443-project Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance e63eef86-e101-462a-ab1f-3d16795b0689 could not be found. Aug 29 04:54:58.244759 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'e63eef86-e101-462a-ab1f-3d16795b0689'} Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63eef86-e101-462a-ab1f-3d16795b0689 could not be found. Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:54:58.245581 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63eef86-e101-462a-ab1f-3d16795b0689 could not be found. Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63eef86-e101-462a-ab1f-3d16795b0689 could not be found. Aug 29 04:54:58.247652 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:54:58.252438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Returning 404 to user: Instance e63eef86-e101-462a-ab1f-3d16795b0689 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:54:58.252876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.253372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.254588 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a4f0aa4-cd35-4e54-aaa2-7f07b2ea633b tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689" status: 404 len: 111 microversion: 2.1 time: 0.079463 Aug 29 04:54:58.256032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.256228 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 557/1227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:58 2022] GET /compute/v2.1/servers/e63eef86-e101-462a-ab1f-3d16795b0689 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:54:58.257059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.257817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.258307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.264944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:58.272732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:58.281202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.283065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.283666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.284645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.285459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.286042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.688575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:58.694540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:58.699249 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-33fd04b4-849a-43e1-b04f-4e28a5721cae tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1508 microversion: 2.1 time: 0.477249 Aug 29 04:54:58.712147 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 671/1228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:58 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1508 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:58.719074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:58.720192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:58.736215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e2d231ed-6b97-437a-90f9-22be39490527 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1312 microversion: 2.1 time: 0.474366 Aug 29 04:54:58.746044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.746551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.746988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.747698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.748169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.748755 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 558/1229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:58 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1312 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:58.749579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.783936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:54:58.816507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:58.817132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:58.831049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.831669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.832188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.832967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.833611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.836816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.901504 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b285871a-0030-4ddb-8c53-e9d9d255a9d3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 204 len: 0 microversion: 2.1 time: 0.199397 Aug 29 04:54:58.902455 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 672/1230] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:54:58 2022] DELETE /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:54:58.913146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:58.914490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:58.925622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.926918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.927842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:58.929625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:58.930392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:58.930979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:59.056905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:59.065035 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee63dbfe-364f-4388-898d-83ffbe0afa16 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1279 microversion: 2.1 time: 0.252296 Aug 29 04:54:59.076477 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 559/1231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:58 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1279 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:59.152964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5251c40b-dbbe-42a0-bf39-4f8bdaadc1ad req-b0a7fdda-5dd0-4450-a78c-6c7073fe5854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cda4a1-ab65-4090-bd93-058f432f3732", "name": "network-vif-deleted", "tag": "4e4164cb-6f8b-4514-bf16-f053ecafa7e4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:54:59.177335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5251c40b-dbbe-42a0-bf39-4f8bdaadc1ad req-b0a7fdda-5dd0-4450-a78c-6c7073fe5854 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:59.178452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5251c40b-dbbe-42a0-bf39-4f8bdaadc1ad req-b0a7fdda-5dd0-4450-a78c-6c7073fe5854 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:59.179147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5251c40b-dbbe-42a0-bf39-4f8bdaadc1ad req-b0a7fdda-5dd0-4450-a78c-6c7073fe5854 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:59.195302 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5251c40b-dbbe-42a0-bf39-4f8bdaadc1ad req-b0a7fdda-5dd0-4450-a78c-6c7073fe5854 service nova] Creating event network-vif-deleted:4e4164cb-6f8b-4514-bf16-f053ecafa7e4 for instance 33cda4a1-ab65-4090-bd93-058f432f3732 on n-h2-854119-9 Aug 29 04:54:59.201383 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5251c40b-dbbe-42a0-bf39-4f8bdaadc1ad req-b0a7fdda-5dd0-4450-a78c-6c7073fe5854 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057538 Aug 29 04:54:59.202664 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 560/1232] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:54:59.209144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:59.210028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:59.217329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:59.218038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:59.218655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:59.219577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:59.220217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:59.220790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:59.234629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:59.244353 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43dec84f-faca-4c45-a5e1-bbbb93413d94 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1467 microversion: 2.1 time: 0.336679 Aug 29 04:54:59.256504 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 673/1233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:58 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1467 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:59.265674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:59.266770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:59.278987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:59.282316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:59.282885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:59.284524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:59.285145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:59.285720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:59.335203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:59.335709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:59.336180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:59.336632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lazy-loading 'fault' on Instance uuid 33cda4a1-ab65-4090-bd93-058f432f3732 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:54:59.414705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:59.424906 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-094f254d-48a9-4173-81fa-68264aeb9700 tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1307 microversion: 2.1 time: 0.163449 Aug 29 04:54:59.434097 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 674/1234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:59 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:54:59.456961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:59.466370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:59.467918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:59.469274 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6e3ea576-fda8-4aad-b33b-1888c3d02995 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.265362 Aug 29 04:54:59.469950 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 561/1235] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:54:59 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:54:59.758595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:54:59.759523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:54:59.766333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:59.766823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:59.767258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:59.767957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:54:59.768445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:54:59.768879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:54:59.922857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:54:59.932611 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-04d456ff-2fc7-4fa8-9239-023703d957ea tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1312 microversion: 2.1 time: 0.177965 Aug 29 04:54:59.939403 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 675/1236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:54:59 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:00.090654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:00.091390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:00.098972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.099545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.100069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.100817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.101272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.101696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.215661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:00.224714 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c3a9298a-ad9e-4075-9fbb-5d49abe8ede1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1289 microversion: 2.1 time: 0.138021 Aug 29 04:55:00.225881 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 562/1237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:00 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:00.270274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:00.270960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:00.286201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.286675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.287188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.287947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.288746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.289162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.351010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e55f9be9-f101-4e1d-b675-52488f44b0c1"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:00.353593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:00.361566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.362264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.362880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.363728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.364394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.364966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.431724 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] HTTP exception thrown: Volume f3685c3e-19c9-4eb3-b52b-5c1c67c74382 could not be found. Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Request method failure captured: Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403/os-volume_attachments/f3685c3e-19c9-4eb3-b52b-5c1c67c74382 HTTP/1.1 Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 74 Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEYGkuTbFus4WdwQTcLstGYpIBD3ViWxYElNvvrQRQNkEWo44B0sdWxIyqpDs3QaB2EgL0CRl3TEXm5qNek2hni870EnuTvb8QFMc7nD2oz6vekqs-C4118DGADMmv-Va_aEOnydTVfnszHkyiiFeCl8iWUUDdQThgo-5iGSG6Sgpyc Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 63c88f74577b4fba833f79d481da2ae2 Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesAdminNegativeTest-15591133 Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:55:00.434416 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63c88f74577b4fba833f79d481da2ae2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63c88f74577b4fba833f79d481da2ae2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63c88f74577b4fba833f79d481da2ae2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63c88f74577b4fba833f79d481da2ae2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesAdminNegativeTest-15591133 Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 63c88f74577b4fba833f79d481da2ae2 Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-15591133 Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesAdminNegativeTest-15591133-project-admin Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5e49d93796d54b729adca1febd2d7716 Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesAdminNegativeTest-15591133-project-admin Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: {"volumeAttachment": {"volumeId": "e55f9be9-f101-4e1d-b675-52488f44b0c1"}} Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:00.435939 n-d-854119-9 devstack@n-api.service[128871]: exception: Volume f3685c3e-19c9-4eb3-b52b-5c1c67c74382 could not be found. Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': '0c9bae47-9a30-48f5-b86d-ae9fa9c52403', 'id': 'f3685c3e-19c9-4eb3-b52b-5c1c67c74382', 'body': {'volumeAttachment': {'volumeId': 'e55f9be9-f101-4e1d-b675-52488f44b0c1'}}} Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 04:55:00.436981 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f3685c3e-19c9-4eb3-b52b-5c1c67c74382 could not be found. (HTTP 404) (Request-ID: req-6c304208-32cc-4cec-af9f-e5f3b38fbbe4) Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 04:55:00.438904 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f3685c3e-19c9-4eb3-b52b-5c1c67c74382 could not be found. Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:00.441964 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f3685c3e-19c9-4eb3-b52b-5c1c67c74382 could not be found. Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f3685c3e-19c9-4eb3-b52b-5c1c67c74382 could not be found. Aug 29 04:55:00.443336 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:00.444552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] Returning 404 to user: Volume f3685c3e-19c9-4eb3-b52b-5c1c67c74382 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:00.444552 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39df6f99-0eca-4171-a7ce-f2090350ce85 tempest-VolumesAdminNegativeTest-15591133 tempest-VolumesAdminNegativeTest-15591133-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403/os-volume_attachments/f3685c3e-19c9-4eb3-b52b-5c1c67c74382" status: 404 len: 109 microversion: 2.1 time: 0.088835 Aug 29 04:55:00.444552 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 563/1238] 10.222.0.20 () {60 vars in 1433 bytes} [Mon Aug 29 04:55:00 2022] PUT /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403/os-volume_attachments/f3685c3e-19c9-4eb3-b52b-5c1c67c74382 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:55:00.449769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:00.450378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:00.459367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.460365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.461233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.462136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.462906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.463511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.529968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:00.549157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-83b2c3b8-5ccb-4f29-932d-8ab19a7f85b8 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1467 microversion: 2.1 time: 0.287522 Aug 29 04:55:00.562536 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 676/1239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:00 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1467 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:00.571469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:00.575348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:00.587499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.589144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.589814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.590834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.592391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.594037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.817197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.817697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.818150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.818769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lazy-loading 'fault' on Instance uuid 33cda4a1-ab65-4090-bd93-058f432f3732 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:00.930238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12fbf10dbdfe42a292e3c4e239196e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bcab4cb30d4894bdec1572236a6347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:00.939070 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-810c7b82-21f6-4192-a012-91cf25b0627d tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 200 len: 1307 microversion: 2.1 time: 0.493972 Aug 29 04:55:00.939859 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 564/1240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:00 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 1307 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:00.958491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:00.959185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:00.965970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.966690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.967570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.968078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:00.968612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:00.969049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:00.996245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:01.007425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:01.009041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:01.010357 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-857eadf5-8cf9-459f-a45a-1f0ecf360b34 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.446293 Aug 29 04:55:01.011741 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 677/1241] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:00 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:01.243388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:01.248340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:01.249301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:01.260855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:01.261753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:01.262395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:01.263349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:01.264063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:01.264583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:01.274681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:01.283246 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b1b862dd-f992-467b-8100-a727b4dd8151 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1312 microversion: 2.1 time: 0.328765 Aug 29 04:55:01.296954 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 565/1242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:00 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1312 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:01.410494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:01.425140 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0bad9ef-ce9f-4b1a-b684-bd3bae23b39d tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1277 microversion: 2.1 time: 0.182486 Aug 29 04:55:01.426143 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 678/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:01 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:01.570379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:01.571274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:01.579617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:01.580457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:01.581294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:01.582184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:01.582696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:01.583386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:01.876460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:01.885025 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e52a1daa-6312-4d9b-8157-cc3460662c80 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1467 microversion: 2.1 time: 0.318862 Aug 29 04:55:01.919452 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 566/1244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:01 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1467 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:01.961129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:01.961932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] [instance: 33cda4a1-ab65-4090-bd93-058f432f3732] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:01.973395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:01.973972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:01.974474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:01.975184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:01.975743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:01.976281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:01.992608 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] HTTP exception thrown: Instance 33cda4a1-ab65-4090-bd93-058f432f3732 could not be found. Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Request method failure captured: Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 HTTP/1.1 Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXmZ61QjiDxll7vMGfu5O06pHptECUVnpAoLYjE-L86c4NvnxoMWVYRpXwz3ZNhyO-VOvRf_w9W5rT3cdSKHKEbPR6QLaEmdRipJvMamxxqERTUZ6CCnfZEVJvudVeLdqnmdnkk5QuVuoDgPn3P_THedQwkapA5ilqJuEE7erdwrvA Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:55:01.994295 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38bcab4cb30d4894bdec1572236a6347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38bcab4cb30d4894bdec1572236a6347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 38bcab4cb30d4894bdec1572236a6347 Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1369261201 Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 12fbf10dbdfe42a292e3c4e239196e36 Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersOnMultiNodesTest-1369261201-project Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 33cda4a1-ab65-4090-bd93-058f432f3732 could not be found. Aug 29 04:55:01.995852 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '33cda4a1-ab65-4090-bd93-058f432f3732'} Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cda4a1-ab65-4090-bd93-058f432f3732 could not be found. Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:01.996729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cda4a1-ab65-4090-bd93-058f432f3732 could not be found. Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cda4a1-ab65-4090-bd93-058f432f3732 could not be found. Aug 29 04:55:01.998490 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:02.000038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] Returning 404 to user: Instance 33cda4a1-ab65-4090-bd93-058f432f3732 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:02.000038 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0c56c7a2-1d3f-4042-af4b-4e195c96a64b tempest-ServersOnMultiNodesTest-1369261201 tempest-ServersOnMultiNodesTest-1369261201-project] 10.222.0.20 "GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732" status: 404 len: 111 microversion: 2.1 time: 0.039325 Aug 29 04:55:02.000038 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 679/1245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:01 2022] GET /compute/v2.1/servers/33cda4a1-ab65-4090-bd93-058f432f3732 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:55:02.035209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:02.035818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:02.043398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.044035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.051679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.052495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.052948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.053385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.099523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:02.127580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-dcfe1a88-d5c3-4e7d-9490-bbb038f981bc req-5197f77c-1b5b-4a3d-ab3a-d86b6430f36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41720f63-3f39-4147-8868-b95777a61445", "name": "network-vif-deleted", "tag": "5abe974e-ded5-492a-a97f-ae98fbaccab4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:02.161583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dcfe1a88-d5c3-4e7d-9490-bbb038f981bc req-5197f77c-1b5b-4a3d-ab3a-d86b6430f36d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.161898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dcfe1a88-d5c3-4e7d-9490-bbb038f981bc req-5197f77c-1b5b-4a3d-ab3a-d86b6430f36d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.164332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dcfe1a88-d5c3-4e7d-9490-bbb038f981bc req-5197f77c-1b5b-4a3d-ab3a-d86b6430f36d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.183780 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-dcfe1a88-d5c3-4e7d-9490-bbb038f981bc req-5197f77c-1b5b-4a3d-ab3a-d86b6430f36d service nova] Creating event network-vif-deleted:5abe974e-ded5-492a-a97f-ae98fbaccab4 for instance 41720f63-3f39-4147-8868-b95777a61445 on n-h2-854119-9 Aug 29 04:55:02.192874 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-dcfe1a88-d5c3-4e7d-9490-bbb038f981bc req-5197f77c-1b5b-4a3d-ab3a-d86b6430f36d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074476 Aug 29 04:55:02.194621 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 680/1246] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:02.304692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:02.305431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:02.316728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.318721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.320685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.321420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.321880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.325909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.691952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:02.701528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:02.703272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:02.704509 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3477ef5c-1fe6-44cd-91d7-819dd0bf9b4e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.673247 Aug 29 04:55:02.705056 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 567/1247] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:02 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:02.721327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:02.721931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:02.739604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.740108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.741194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.741916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.742368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.742792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.769833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:02.783940 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-15fa00f1-d788-45e8-8d56-2b2cba8f99bb tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1312 microversion: 2.1 time: 0.483893 Aug 29 04:55:02.785935 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 681/1248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:02 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1312 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:02.906469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:02.907512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:02.930575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.931582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.932473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.933280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.933640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.934052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.973379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:02.974318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:02.975185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:02.975917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lazy-loading 'fault' on Instance uuid 41720f63-3f39-4147-8868-b95777a61445 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:03.094738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:03.099395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:03.107281 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0d215463-226f-4cc7-82fe-39c8278da3c7 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 200 len: 1301 microversion: 2.1 time: 0.205167 Aug 29 04:55:03.110399 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 682/1249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:02 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 1301 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:03.112483 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fecc426f-2529-42ec-94e3-616a52c9d4c6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1319 microversion: 2.1 time: 0.395024 Aug 29 04:55:03.114083 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 568/1250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:02 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:03.680360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-820803e7-bf45-4bfb-b23a-787f7a079d40 req-92d1bf0a-de69-40d3-bc77-94be8f8943f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a99c1b-98ad-4d46-9be1-6d36ec32604b", "name": "network-vif-plugged", "status": "completed", "tag": "bf0358be-94b3-48f2-9869-3120396522f3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:03.706586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-820803e7-bf45-4bfb-b23a-787f7a079d40 req-92d1bf0a-de69-40d3-bc77-94be8f8943f6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:03.707237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-820803e7-bf45-4bfb-b23a-787f7a079d40 req-92d1bf0a-de69-40d3-bc77-94be8f8943f6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:03.708674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-820803e7-bf45-4bfb-b23a-787f7a079d40 req-92d1bf0a-de69-40d3-bc77-94be8f8943f6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:03.726789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:03.727389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:03.743936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:03.745344 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-820803e7-bf45-4bfb-b23a-787f7a079d40 req-92d1bf0a-de69-40d3-bc77-94be8f8943f6 service nova] Creating event network-vif-plugged:bf0358be-94b3-48f2-9869-3120396522f3 for instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b on n-h1-854119-9 Aug 29 04:55:03.745893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:03.746626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:03.748789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:03.752973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:03.753941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:03.758678 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-820803e7-bf45-4bfb-b23a-787f7a079d40 req-92d1bf0a-de69-40d3-bc77-94be8f8943f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084311 Aug 29 04:55:03.793625 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 683/1251] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:03.806855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:03.807821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:03.815633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:03.816476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:03.817066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:03.817945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:03.818394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:03.819046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.521415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:04.533099 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7301285-8470-4178-8b4d-31f4817b797c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1312 microversion: 2.1 time: 0.731432 Aug 29 04:55:04.543761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:04.551966 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 684/1252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:03 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1312 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:04.555864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:04.560968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:04.561147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:04.561479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:04.562885 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e1dca4d-0fb1-4d18-83b3-060ac4855874 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.839971 Aug 29 04:55:04.564294 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 569/1253] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:03 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:55:04.569494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.570021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:04.570391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.571251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.572145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.572772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.575206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.580654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 41720f63-3f39-4147-8868-b95777a61445] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:04.586807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.587297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.587723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.588742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.589350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.590104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.607819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] HTTP exception thrown: Instance 41720f63-3f39-4147-8868-b95777a61445 could not be found. Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Request method failure captured: Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 HTTP/1.1 Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEYNJLQHji1DbBol6aNAjCtucALD8304ZlpDNZxCjMoAkFDTh0l0yemrbpinlJlRz5Ff43ioX9PU5mj8VuP7Uc5Ik6tkpK_I1gl9SQdD67qGcyJYtkKpR1RtmSJgP3SdD6YOjC5mRQ1BwEtPqNK5k6moX3WVEQNj71Eo1PjNN4fsxUI Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 13f1750a840a4c9e91529b3f71830c8a Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminTestJSON-1927656443 Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:55:04.610424 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f1750a840a4c9e91529b3f71830c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f1750a840a4c9e91529b3f71830c8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f1750a840a4c9e91529b3f71830c8a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f1750a840a4c9e91529b3f71830c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminTestJSON-1927656443 Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 13f1750a840a4c9e91529b3f71830c8a Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminTestJSON-1927656443 Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminTestJSON-1927656443-project Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c02a1e5093784394a6dd23c5d5ff51d6 Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminTestJSON-1927656443-project Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 41720f63-3f39-4147-8868-b95777a61445 could not be found. Aug 29 04:55:04.611917 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '41720f63-3f39-4147-8868-b95777a61445'} Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41720f63-3f39-4147-8868-b95777a61445 could not be found. Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:04.612894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41720f63-3f39-4147-8868-b95777a61445 could not be found. Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41720f63-3f39-4147-8868-b95777a61445 could not be found. Aug 29 04:55:04.614234 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:04.615478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:55:04.616768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Returning 404 to user: Instance 41720f63-3f39-4147-8868-b95777a61445 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:04.617768 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4887bc09-699d-4772-bc73-b4ab79c9fe15 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445" status: 404 len: 111 microversion: 2.1 time: 0.052190 Aug 29 04:55:04.621770 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 570/1254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:04 2022] GET /compute/v2.1/servers/41720f63-3f39-4147-8868-b95777a61445 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:04.627670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:04.628600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:04.636113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.636839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.637787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.638661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.639641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.640530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.685268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:04.730324 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6626ce46-f3c1-4f41-bd22-65852a509ef9 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 204 len: 0 microversion: 2.1 time: 0.176766 Aug 29 04:55:04.730926 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 685/1255] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:55:04 2022] DELETE /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:55:04.739150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7af37e8f-86e8-4197-8b4b-dba140181590 req-842ec2bc-7108-4194-be7a-cf26170ba458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c1f871d-98e2-414a-bd84-3b0aa7d76005", "tag": "72a6d2c7-5af9-4dcf-bf51-f91734958b68"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:04.749404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7af37e8f-86e8-4197-8b4b-dba140181590 req-842ec2bc-7108-4194-be7a-cf26170ba458 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.749888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7af37e8f-86e8-4197-8b4b-dba140181590 req-842ec2bc-7108-4194-be7a-cf26170ba458 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.750336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7af37e8f-86e8-4197-8b4b-dba140181590 req-842ec2bc-7108-4194-be7a-cf26170ba458 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.762702 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7af37e8f-86e8-4197-8b4b-dba140181590 req-842ec2bc-7108-4194-be7a-cf26170ba458 service nova] Creating event network-changed:72a6d2c7-5af9-4dcf-bf51-f91734958b68 for instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 on n-h2-854119-9 Aug 29 04:55:04.768336 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7af37e8f-86e8-4197-8b4b-dba140181590 req-842ec2bc-7108-4194-be7a-cf26170ba458 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035981 Aug 29 04:55:04.768957 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 686/1256] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:04.774397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:04.775105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:04.783066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.783800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.784433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.785266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.785873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.786456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.816338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:55:04.844226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:04.855495 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af11d994-112a-479a-9554-b85e8e039e23 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1319 microversion: 2.1 time: 0.232044 Aug 29 04:55:04.868753 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 571/1257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:04 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:04.876220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:04.877137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:04.879700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:04.884704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.885472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.886152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.887066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.887791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.888335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.919239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:04.931255 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6bdd139a-1b3c-4114-bf50-e049473fd16f tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "DELETE /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 204 len: 0 microversion: 2.1 time: 0.160564 Aug 29 04:55:04.933208 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 687/1258] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:55:04 2022] DELETE /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:55:04.947840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:04.948678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:04.955930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.956469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.956904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:04.957605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:04.958051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:04.958465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:05.151716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:05.153646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:05.161268 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d45be317-74a1-42b3-b781-75081d8bb934 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1514 microversion: 2.1 time: 0.291236 Aug 29 04:55:05.161557 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df811202-4ad2-425d-ae2f-3fb2d3244fbf tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1470 microversion: 2.1 time: 0.224024 Aug 29 04:55:05.161988 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 572/1259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:04 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1514 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:05.174620 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 688/1260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:04 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:05.564388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:05.566038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:05.572432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:05.573140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:05.573671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:05.574567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:05.575116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:05.575827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:05.593463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:05.594971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:05.604856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:05.605579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:05.606678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:05.607611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:05.608509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:05.610106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:05.844418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:05.860523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c99bffbd-958e-4db1-9b0c-3fc5d4ea4e69 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1312 microversion: 2.1 time: 0.299839 Aug 29 04:55:05.862498 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 573/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:05 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:05.880986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:05.881815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:05.890545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:05.891922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:05.892578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:05.893477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:05.894086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:05.894704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:05.902029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:05.913577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:05.915481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:05.918293 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-edbcda83-627b-493a-9f0b-3bdbd0fe2212 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.331611 Aug 29 04:55:05.919320 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 689/1262] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:05 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:06.099167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:06.108675 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5524ce8c-0a69-49ba-aa9f-2ebe5928c82a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1319 microversion: 2.1 time: 0.232202 Aug 29 04:55:06.109262 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 574/1263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:05 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:06.185517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:06.187563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:06.188776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:06.189221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:06.199277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:06.204750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:06.205026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:06.205676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:06.206284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:06.207843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:06.208681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:06.209164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:06.209592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:06.212449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:06.216549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:06.219470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:06.571702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:06.597424 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b4cd173-c6c7-4497-9752-a34576379541 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1514 microversion: 2.1 time: 0.416066 Aug 29 04:55:06.598579 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 575/1264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:06 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:06.721696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:06.731580 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6f8a07be-8094-4aa2-b986-41738e734f01 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1470 microversion: 2.1 time: 0.553499 Aug 29 04:55:06.732370 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 690/1265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:06 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1470 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:06.891930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:06.892635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:06.901866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:06.902430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:06.902959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:06.903735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:06.904297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:06.904834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:06.944334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:06.946051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:06.960548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:06.965002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:06.965735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:06.967915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:06.968558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:06.969316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:07.060417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:07.096709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:07.316700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:07.342725 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b41cca2f-ad3a-4172-bde9-f1bffc997d02 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1461 microversion: 2.1 time: 0.454418 Aug 29 04:55:07.346292 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 576/1266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:06 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1461 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:07.373312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:07.374210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:07.378733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:07.399978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:07.402615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:07.402786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:07.403485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:07.403901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:07.404842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:07.405143 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-29c838a4-4acc-4421-9f0e-4479115ac056 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.466911 Aug 29 04:55:07.405294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:07.405725 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 691/1267] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:06 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:07.410059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:07.410941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-891d6393-b545-499f-9504-2b4b4c9ae485 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:07.412010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-891d6393-b545-499f-9504-2b4b4c9ae485 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:07.421247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-891d6393-b545-499f-9504-2b4b4c9ae485 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:07.422097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-891d6393-b545-499f-9504-2b4b4c9ae485 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:07.423114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-891d6393-b545-499f-9504-2b4b4c9ae485 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:07.426214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-891d6393-b545-499f-9504-2b4b4c9ae485 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:07.426683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-891d6393-b545-499f-9504-2b4b4c9ae485 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:07.427112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-891d6393-b545-499f-9504-2b4b4c9ae485 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:07.697286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:07.707384 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-47f52ec1-3e80-4a44-bc99-8f1a45df7668 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1319 microversion: 2.1 time: 0.341110 Aug 29 04:55:07.722474 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 577/1268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:07 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:07.736641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:07.738683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:07.764019 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-891d6393-b545-499f-9504-2b4b4c9ae485 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1612 microversion: 2.1 time: 0.356992 Aug 29 04:55:07.766548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:07.780485 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 692/1269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:07 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1612 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:07.780953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:07.780953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:07.780953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:07.780953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:07.784450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:07.799031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:07.800074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:07.805326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:07.828541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:07.829428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:07.830089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:07.831236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:07.831863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:07.832457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:08.010877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:08.022612 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-921c414b-151b-4ff3-8b2a-2a17b5c6e23e tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1514 microversion: 2.1 time: 0.308899 Aug 29 04:55:08.023458 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 578/1270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:07 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:08.040465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:08.041986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:08.060030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:08.060670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:08.062292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:08.064593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:08.066424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:08.067821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:08.086251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:08.095189 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-db3aceb4-7ea9-4dad-b597-fffaa932c41e tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1470 microversion: 2.1 time: 0.319995 Aug 29 04:55:08.108612 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 693/1271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:07 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1470 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:08.192408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'aea0e5ec42e141939ae4050a3868a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d225bc4b57845e990e62a214d8e7532', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:08.193271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] flavor_id is None. Assuming migration. {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 04:55:08.193864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 04:55:08.428030 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-80e12071-cd43-4502-9aeb-f0cc187e4e46 tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b/action" status: 202 len: 0 microversion: 2.1 time: 0.396920 Aug 29 04:55:08.429378 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 579/1272] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:55:08 2022] POST /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:55:08.436509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:08.436768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:08.437561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:08.437718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:08.444494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:08.445286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:08.445876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:08.447709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:08.448484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:08.449101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:08.457242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:08.457844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:08.460666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:08.461703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:08.462647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:08.463246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:08.826686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:08.835534 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d1a68a9-e8ce-49b3-b538-76df76560bd3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1470 microversion: 2.1 time: 0.401985 Aug 29 04:55:08.853935 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 580/1273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:08 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1470 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:08.861656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:08.862488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:08.863222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:08.869418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:08.870149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:08.870806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:08.872551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:08.873858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:08.874502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:08.909097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:08.911442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:08.914234 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc55bb71-9e1d-4d59-bdc6-d81ea4cf103d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.485960 Aug 29 04:55:08.916050 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 694/1274] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:08 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:55:09.051712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:09.054259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:09.084678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:09.086035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:09.086486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:09.091670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:09.092496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:09.093890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:09.146419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:09.157024 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-93a0ec56-be60-405d-9b9b-620a81b6c489 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1319 microversion: 2.1 time: 0.300656 Aug 29 04:55:09.161007 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 581/1275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:08 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:09.170111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:09.170916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:09.177834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:09.178608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:09.179230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:09.180098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:09.180831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:09.181562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:09.578478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:09.590981 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-56423d2d-4701-464b-bd86-514d06ecc557 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1470 microversion: 2.1 time: 0.428604 Aug 29 04:55:09.593365 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 582/1276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:09 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1470 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:09.758982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:09.769766 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3d28061c-78fd-4ae6-9170-d6fd723d1455 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1514 microversion: 2.1 time: 0.724414 Aug 29 04:55:09.775999 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 695/1277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:09 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1514 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:09.857968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:09.858587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:09.864948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:09.865689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:09.866579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:09.867514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:09.868204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:09.868829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:09.909192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:09.940578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:09.941652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:09.949332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:09.950117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:09.950792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:09.951866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:09.952912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:09.953574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:10.667966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:10.686546 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-024fd40e-7352-4dda-8db8-a1e73867f93b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1470 microversion: 2.1 time: 0.834616 Aug 29 04:55:10.689929 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 583/1278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:09 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1470 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:10.701753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:10.704825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:10.717362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:10.717865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:10.718303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:10.719072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:10.719530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:10.723847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:10.812310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:10.835737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:10.837611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:10.838802 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-00ab3279-40c4-4558-9e13-9358a490fc11 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.903124 Aug 29 04:55:10.844079 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 696/1279] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:09 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:55:10.858249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:10.859053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:10.874499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:10.875651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:10.876429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:10.877590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:10.878449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:10.879099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:11.894036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:11.918792 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-416f08d0-61b0-4ca4-8977-edf8efb27414 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1319 microversion: 2.1 time: 1.223875 Aug 29 04:55:11.923576 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 584/1280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:10 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1319 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:11.954064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:11.955795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:11.973559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:11.974068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:11.977666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:11.981622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:11.982153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:11.982683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.073130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.073934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.074931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.075618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lazy-loading 'fault' on Instance uuid 10e4c604-f8ec-4543-87ae-906f5e0fbb2f {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:12.120733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 1b14f0ef-853d-4876-888d-045a86ffd64a {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:12.145010 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dee472f5-e0d2-430e-b867-ec2bf85882ab tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 2422 microversion: 2.25 time: 1.299565 Aug 29 04:55:12.145618 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 697/1281] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:10 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 2422 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:12.170926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:12.171550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:12.202343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.203038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.205702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.206716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.207337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.212753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.256378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02a1e5093784394a6dd23c5d5ff51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f1750a840a4c9e91529b3f71830c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:12.265873 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-651b5548-21d1-4879-a4db-58ae7d6b61d4 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 200 len: 1304 microversion: 2.1 time: 0.340565 Aug 29 04:55:12.279957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.281264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.281518 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 585/1282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:11 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 1304 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:12.284599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.285077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lazy-loading 'fault' on Instance uuid 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:12.288455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-efeb243f-0219-490c-a2b3-f94be11f4c73 req-751a9b40-bfc3-46b6-97b7-7695f36396b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e4c604-f8ec-4543-87ae-906f5e0fbb2f", "name": "network-vif-deleted", "tag": "a629769f-7290-46cd-9c9d-933b910b2c27"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:12.305513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-efeb243f-0219-490c-a2b3-f94be11f4c73 req-751a9b40-bfc3-46b6-97b7-7695f36396b6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.306858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-efeb243f-0219-490c-a2b3-f94be11f4c73 req-751a9b40-bfc3-46b6-97b7-7695f36396b6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.307488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-efeb243f-0219-490c-a2b3-f94be11f4c73 req-751a9b40-bfc3-46b6-97b7-7695f36396b6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.336621 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-efeb243f-0219-490c-a2b3-f94be11f4c73 req-751a9b40-bfc3-46b6-97b7-7695f36396b6 service nova] Creating event network-vif-deleted:a629769f-7290-46cd-9c9d-933b910b2c27 for instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f on n-h2-854119-9 Aug 29 04:55:12.343987 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-efeb243f-0219-490c-a2b3-f94be11f4c73 req-751a9b40-bfc3-46b6-97b7-7695f36396b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059790 Aug 29 04:55:12.346569 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 586/1283] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:12.351837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d6ad8851-a665-47b7-a154-f28e60961c98 req-009ce800-bb0a-41b4-be76-ae17d47d0f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9bae47-9a30-48f5-b86d-ae9fa9c52403", "name": "network-vif-deleted", "tag": "72f1d871-74e2-445e-a041-82dcc368be0c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:12.367565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:12.376621 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3f4596f9-2350-4fb5-a15b-e43899ade674 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 200 len: 1308 microversion: 2.1 time: 0.209494 Aug 29 04:55:12.379542 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 698/1284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:12 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:12.383345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d6ad8851-a665-47b7-a154-f28e60961c98 req-009ce800-bb0a-41b4-be76-ae17d47d0f5c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.383869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d6ad8851-a665-47b7-a154-f28e60961c98 req-009ce800-bb0a-41b4-be76-ae17d47d0f5c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.384325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d6ad8851-a665-47b7-a154-f28e60961c98 req-009ce800-bb0a-41b4-be76-ae17d47d0f5c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.384893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:12.385514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:12.404552 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d6ad8851-a665-47b7-a154-f28e60961c98 req-009ce800-bb0a-41b4-be76-ae17d47d0f5c service nova] Creating event network-vif-deleted:72f1d871-74e2-445e-a041-82dcc368be0c for instance 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 on n-h2-854119-9 Aug 29 04:55:12.406173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.406735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.407686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.408438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.408889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.409491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.412822 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d6ad8851-a665-47b7-a154-f28e60961c98 req-009ce800-bb0a-41b4-be76-ae17d47d0f5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064627 Aug 29 04:55:12.413883 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 587/1285] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:12.450813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:12.451795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:12.473986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.477602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.478107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.479924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.486074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.487072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.829942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:12.838623 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51a7459d-ffc0-4593-9700-60fa6ec846af tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1470 microversion: 2.1 time: 0.457365 Aug 29 04:55:12.839355 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 699/1286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:12 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1470 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:12.844272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-9", "block_migration": "auto"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:12.853923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:12.861924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.862882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.863537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.864525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:12.865193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:12.865822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:12.888580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:12.932064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'flavor' on Instance uuid 1b14f0ef-853d-4876-888d-045a86ffd64a {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:12.950083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Going to try to live migrate instance to n-h2-854119-9 {{(pid=128872) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 04:55:13.421525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:13.442017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:13.446104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:13.449963 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-00211fe0-b014-4595-b352-43d4aacbb0ce tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 1.009910 Aug 29 04:55:13.454889 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 588/1287] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:12 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:13.472958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:13.473589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:13.494125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:13.503626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:13.507459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:13.508527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:13.509153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:13.509759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:13.838512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:13.847160 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fbb957a0-2619-4dc3-969d-3376a99b7b46 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1319 microversion: 2.1 time: 0.391020 Aug 29 04:55:13.850780 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 589/1288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:13 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:13.863200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:13.864051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] [instance: 10e4c604-f8ec-4543-87ae-906f5e0fbb2f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:13.875226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:13.875936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:13.878359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:13.879289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:13.879911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:13.880532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:13.906886 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] HTTP exception thrown: Instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f could not be found. Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Request method failure captured: Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f HTTP/1.1 Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEYNJLQHji1DbBol6aNAjCtucALD8304ZlpDNZxCjMoAkFDTh0l0yemrbpinlJlRz5Ff43ioX9PU5mj8VuP7Uc5Ik6tkpK_I1gl9SQdD67qGcyJYtkKpR1RtmSJgP3SdD6YOjC5mRQ1BwEtPqNK5k6moX3WVEQNj71Eo1PjNN4fsxUI Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 13f1750a840a4c9e91529b3f71830c8a Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminTestJSON-1927656443 Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:55:13.917207 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f1750a840a4c9e91529b3f71830c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f1750a840a4c9e91529b3f71830c8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f1750a840a4c9e91529b3f71830c8a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f1750a840a4c9e91529b3f71830c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminTestJSON-1927656443 Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 13f1750a840a4c9e91529b3f71830c8a Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminTestJSON-1927656443 Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminTestJSON-1927656443-project Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c02a1e5093784394a6dd23c5d5ff51d6 Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminTestJSON-1927656443-project Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f could not be found. Aug 29 04:55:13.918832 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '10e4c604-f8ec-4543-87ae-906f5e0fbb2f'} Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f could not be found. Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:13.919718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f could not be found. Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f could not be found. Aug 29 04:55:13.920989 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.922138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] Returning 404 to user: Instance 10e4c604-f8ec-4543-87ae-906f5e0fbb2f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:13.922138 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a19c4de9-0ed3-4885-9a4d-dc1886eb2fe3 tempest-ServersAdminTestJSON-1927656443 tempest-ServersAdminTestJSON-1927656443-project] 10.222.0.20 "GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f" status: 404 len: 111 microversion: 2.1 time: 0.066920 Aug 29 04:55:13.922722 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 590/1289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:13 2022] GET /compute/v2.1/servers/10e4c604-f8ec-4543-87ae-906f5e0fbb2f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:13.927846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:13.928492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: 0c9bae47-9a30-48f5-b86d-ae9fa9c52403] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:13.935222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:13.935927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:13.936572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:13.937576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:13.938239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:13.938889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:13.956193 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] HTTP exception thrown: Instance 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 could not be found. Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Request method failure captured: Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 HTTP/1.1 Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEX8rYfESjXsvuXHIhvIj4ddxTP7vHktDMrhgzTxuoz5n451XwV2FxLo7GULJ3aXwoufuSV7BLPGj3j6Uvl1e1GLr8YDRZp9-sJas1G-oAzfDIXMszJ1_OY9sNWSwZMkOOyYVsH6Xhj0djJ8t7mbyf-lASfQs4y-dKv3inFGPbrlj6I Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 9e4aeab40a6546e799cb321f5978468f Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesAdminNegativeTest-679021692 Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:55:13.958416 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e4aeab40a6546e799cb321f5978468f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e4aeab40a6546e799cb321f5978468f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e4aeab40a6546e799cb321f5978468f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e4aeab40a6546e799cb321f5978468f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesAdminNegativeTest-679021692 Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 9e4aeab40a6546e799cb321f5978468f Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-679021692 Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesAdminNegativeTest-679021692-project Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 3b0266d5991442649190b2f052809d2c Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesAdminNegativeTest-679021692-project Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 could not be found. Aug 29 04:55:13.959808 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '0c9bae47-9a30-48f5-b86d-ae9fa9c52403'} Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 could not be found. Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:13.961039 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 could not be found. Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 could not be found. Aug 29 04:55:13.963138 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:13.969275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Returning 404 to user: Instance 0c9bae47-9a30-48f5-b86d-ae9fa9c52403 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:13.971307 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c75630ad-d15d-4764-9491-1875c6fc70d1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403" status: 404 len: 111 microversion: 2.1 time: 0.047590 Aug 29 04:55:13.976258 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 591/1290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:13 2022] GET /compute/v2.1/servers/0c9bae47-9a30-48f5-b86d-ae9fa9c52403 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:13.984310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-12959e91-95ac-4836-84bb-495c65537017 req-34595b66-2962-4eef-a231-f7c5c3345996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1f871d-98e2-414a-bd84-3b0aa7d76005", "name": "network-vif-plugged", "status": "completed", "tag": "72a6d2c7-5af9-4dcf-bf51-f91734958b68"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:13.997533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-12959e91-95ac-4836-84bb-495c65537017 req-34595b66-2962-4eef-a231-f7c5c3345996 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:13.998264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-12959e91-95ac-4836-84bb-495c65537017 req-34595b66-2962-4eef-a231-f7c5c3345996 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:13.998939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-12959e91-95ac-4836-84bb-495c65537017 req-34595b66-2962-4eef-a231-f7c5c3345996 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:14.017055 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-12959e91-95ac-4836-84bb-495c65537017 req-34595b66-2962-4eef-a231-f7c5c3345996 service nova] Creating event network-vif-plugged:72a6d2c7-5af9-4dcf-bf51-f91734958b68 for instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 on n-h2-854119-9 Aug 29 04:55:14.023285 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-12959e91-95ac-4836-84bb-495c65537017 req-34595b66-2962-4eef-a231-f7c5c3345996 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044895 Aug 29 04:55:14.024549 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 592/1291] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:14.030443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:14.031605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:14.039588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:14.040616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:14.041371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:14.042312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:14.043035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:14.043664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:14.477042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:14.489604 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-43b78d5e-b2bd-49d8-bf17-acf1769a7990 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1475 microversion: 2.1 time: 0.463486 Aug 29 04:55:14.492038 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 593/1292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:14 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1475 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:14.511782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:14.512705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:14.530034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:14.533479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:14.534115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:14.535034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:14.536877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:14.538066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:15.114222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:15.129785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:15.135365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:15.137197 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c0ded2e7-5723-4ad6-92c1-78b862e736b8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.630789 Aug 29 04:55:15.140703 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 594/1293] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:14 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:15.145679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:15.148506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:15.162965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:15.165527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:15.168726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:15.169744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:15.170416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:15.171050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:15.337001 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-32d0b6f4-275b-4c16-a87f-07b1282dd787 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/action" status: 202 len: 0 microversion: 2.25 time: 2.496102 Aug 29 04:55:15.340713 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 700/1294] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 04:55:12 2022] POST /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/action => generated 0 bytes in 2498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:55:15.347245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:15.356301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:15.391313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:15.391666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:15.392370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:15.393832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:15.394926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:15.396843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:15.434696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:15.443825 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ebf3af9c-dee9-405c-9c79-586522bdccf7 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1319 microversion: 2.1 time: 0.301700 Aug 29 04:55:15.457217 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 595/1295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:15 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:15.516283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:15.516834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:15.527088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:15.527616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:15.530267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:15.531346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:15.536679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:15.537412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:15.991897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:16.017098 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-efc4987e-0210-4791-aeec-3d4fa5449b60 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1475 microversion: 2.1 time: 0.505877 Aug 29 04:55:16.017710 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 596/1296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:15 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1475 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:16.161099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:16.162115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:16.175864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:16.180811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:16.181783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:16.185167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:16.186461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:16.187149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:16.499376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:16.520354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:16.524834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:16.533341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b98bdd89-45a8-48b2-acd9-09b18940a601 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 1.190179 Aug 29 04:55:16.535551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 701/1297] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:15 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:16.563629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:16.564371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:16.576256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:16.579102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:16.579657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:16.580479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:16.581501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:16.582828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:17.271731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:17.286995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:17.291083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:17.292586 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ebeb64ec-3dbe-47d4-a1a6-6dd0a5fd6ff6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 1.135788 Aug 29 04:55:17.296847 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 597/1298] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:16 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:55:17.306354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:17.308752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:17.324609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:17.326849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:17.329919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:17.331033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:17.331656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:17.337564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:17.339900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:17.352833 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cedd8dfa-4948-4d2d-a30f-3be470b135a8 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1469 microversion: 2.1 time: 0.803061 Aug 29 04:55:17.354168 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 702/1299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:16 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1469 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:17.877072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:17.878274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:17.889541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:17.892033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:17.892690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:17.893590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:17.894188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:17.894745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:17.965119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:55:18.158092 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d6933a0-5721-4668-9028-a6e6cfcb58a8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 204 len: 0 microversion: 2.1 time: 0.784344 Aug 29 04:55:18.161841 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 703/1300] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:55:17 2022] DELETE /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:55:18.175367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:18.176849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:18.191819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:18.194909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:18.199987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:18.205342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:18.206071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:18.206568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:18.388985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:18.405718 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1ae2037-6d7f-4071-a59c-1b2771b1a87f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1475 microversion: 2.1 time: 1.103050 Aug 29 04:55:18.407234 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 598/1301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:17 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1475 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:18.412590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:18.416072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:18.432352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:18.436529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:18.439355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:18.441585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:18.443188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:18.444295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:18.513637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:18.530065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:18.533886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:18.541151 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e889487-9f98-4c56-88db-33cfd0167eca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.372134 Aug 29 04:55:18.544106 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 704/1302] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:18 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:18.555305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:18.556232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:18.573868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:18.575069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:18.575684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:18.577155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:18.579144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:18.580082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:19.060137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:19.074157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:19.075606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:19.076823 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-214ed4fb-c452-4673-a790-6dbf7c3e6bb8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.531497 Aug 29 04:55:19.077703 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 705/1303] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:18 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:19.434536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:19.435173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:19.447542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:19.448040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:19.448507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:19.449226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:19.449955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:19.450601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:19.573271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:19.588975 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28cf21de-bb69-4145-9e92-66e67db22d2f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1475 microversion: 2.1 time: 1.180324 Aug 29 04:55:19.589876 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 599/1304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:18 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1475 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:19.604723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:19.605836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:19.616216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:19.618214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:19.618713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:19.619473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:19.619940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:19.620389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:19.845169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:19.861633 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-068e73f9-b4b8-402f-b44f-bee0dc548692 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1475 microversion: 2.1 time: 0.429757 Aug 29 04:55:19.863014 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 706/1305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:19 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1475 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:19.876019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:19.882472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:19.903379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:19.904360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:19.905442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:19.907760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:19.908489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:19.915642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:19.952633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:55:20.045621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:20.061087 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-67adba21-5dda-4f54-9910-1a3a361f5e58 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 204 len: 0 microversion: 2.1 time: 0.196347 Aug 29 04:55:20.062872 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 707/1306] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:55:19 2022] DELETE /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:55:20.064780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:20.066783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:20.069217 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-75434f73-b4b4-4ab1-a128-6ebbb904a381 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.477738 Aug 29 04:55:20.080206 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 600/1307] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:19 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:20.080428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:20.080428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:20.089826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:20.090687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:20.091727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:20.092674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:20.093313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:20.094008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:20.111635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:20.113703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:20.140538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:20.141132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:20.141573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:20.142314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:20.146870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:20.147549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:20.671608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:20.691177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:20.697290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:20.699753 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5b640493-5dc5-4959-a351-d1782b802198 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.598377 Aug 29 04:55:20.702139 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 601/1308] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:20 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:55:20.759873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:20.773458 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b8d47b3b-79c8-4d27-9cb5-4c1e4f33b5b1 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1683 microversion: 2.1 time: 0.701079 Aug 29 04:55:20.775367 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 708/1309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:20 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1683 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:20.790901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:20.791623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:20.807106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:20.807818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:20.808391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:20.809217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:20.809770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:20.810418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:21.004109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1876992280", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:21.092828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:55:21.396146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:21.417826 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8e0b2b9a-bdd8-4b71-a4cc-921e7afdd4ff tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 200 len: 1475 microversion: 2.1 time: 0.639822 Aug 29 04:55:21.419705 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 709/1310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:20 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 1475 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:21.430580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:21.432928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:21.448288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:21.450121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:21.451565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:21.454232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:21.456070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:21.458282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:21.890666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:55:21.891897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:55:21.892621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:55:21.893265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:55:21.893900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:55:21.908692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:21.909186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:21.909622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:21.912702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:21.913207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:21.913903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:21.941706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Getting quotas for project 73dd0dd815d24a1b810cad3110a45ddd. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:55:21.950456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Getting quotas for user d895f1e9e257458395b4f38d08ee0b14 and project 73dd0dd815d24a1b810cad3110a45ddd. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:55:21.967971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:55:21.970655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:55:22.010181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:22.020450 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76629264-27c2-4840-94c6-460a7c2af0c8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1475 microversion: 2.1 time: 0.599253 Aug 29 04:55:22.028982 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 710/1311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:21 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1475 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:22.048914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:22.051118 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-209a7f22-f30a-45bb-a0e9-522f0e4f6cac tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.347629 Aug 29 04:55:22.051951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:22.053762 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 602/1312] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:55:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:55:22.060475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3d287dac-6435-4a75-9358-ff13bdc77ec9 req-cda0f265-5a2b-4191-9f02-06c71897a398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-plugged", "status": "completed", "tag": "e51c89e9-9080-422f-9836-19aa7e66d035"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:22.067058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:22.067821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:22.068451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:22.073936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:22.074670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:22.075251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:22.089507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3d287dac-6435-4a75-9358-ff13bdc77ec9 req-cda0f265-5a2b-4191-9f02-06c71897a398 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:22.090247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3d287dac-6435-4a75-9358-ff13bdc77ec9 req-cda0f265-5a2b-4191-9f02-06c71897a398 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:22.090857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3d287dac-6435-4a75-9358-ff13bdc77ec9 req-cda0f265-5a2b-4191-9f02-06c71897a398 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:22.128915 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3d287dac-6435-4a75-9358-ff13bdc77ec9 req-cda0f265-5a2b-4191-9f02-06c71897a398 service nova] Creating event network-vif-plugged:e51c89e9-9080-422f-9836-19aa7e66d035 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:55:22.150466 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3d287dac-6435-4a75-9358-ff13bdc77ec9 req-cda0f265-5a2b-4191-9f02-06c71897a398 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095248 Aug 29 04:55:22.151088 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 603/1313] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:22.175257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-24ad813c-f369-453f-90fe-40532990a54f req-b997f0ac-3f40-4211-8dc0-728ae1aeb293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1f871d-98e2-414a-bd84-3b0aa7d76005", "name": "network-vif-deleted", "tag": "72a6d2c7-5af9-4dcf-bf51-f91734958b68"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:22.189021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-24ad813c-f369-453f-90fe-40532990a54f req-b997f0ac-3f40-4211-8dc0-728ae1aeb293 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:22.189777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-24ad813c-f369-453f-90fe-40532990a54f req-b997f0ac-3f40-4211-8dc0-728ae1aeb293 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:22.191828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-24ad813c-f369-453f-90fe-40532990a54f req-b997f0ac-3f40-4211-8dc0-728ae1aeb293 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:22.197189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:22.206643 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-24ad813c-f369-453f-90fe-40532990a54f req-b997f0ac-3f40-4211-8dc0-728ae1aeb293 service nova] Creating event network-vif-deleted:72a6d2c7-5af9-4dcf-bf51-f91734958b68 for instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 on n-h2-854119-9 Aug 29 04:55:22.212674 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-24ad813c-f369-453f-90fe-40532990a54f req-b997f0ac-3f40-4211-8dc0-728ae1aeb293 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055193 Aug 29 04:55:22.213653 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 604/1314] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:22.224775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:22.237222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:22.252075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:22.252562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:22.252995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:22.253772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:22.254282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:22.254692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:22.879689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:22.898575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:22.902407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:22.906645 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a7a966e4-af2d-454b-a738-16d848eb9ffe tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.690438 Aug 29 04:55:22.908834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 605/1315] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:22 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:22.935002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:22.935872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:22.951315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:22.958105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:22.958916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:22.961745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:22.965432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:22.968872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:23.196508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:23.206794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:23.213277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:23.222174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:23.223731 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dfc09256-d50e-42f7-90f6-9a5694c3138c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 1.188861 Aug 29 04:55:23.247394 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 711/1316] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:22 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:23.259286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cfa6893e-c868-41be-adc3-f0f9ac67ca2b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:23.260363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cfa6893e-c868-41be-adc3-f0f9ac67ca2b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:23.377455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cfa6893e-c868-41be-adc3-f0f9ac67ca2b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:23.385495 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cfa6893e-c868-41be-adc3-f0f9ac67ca2b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1222 microversion: 2.1 time: 0.136564 Aug 29 04:55:23.389490 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 712/1317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:23 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:23.407521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:23.408605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:23.423212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:23.424230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:23.424918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:23.427722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:23.428529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:23.429185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:23.459157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:23.470874 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ad08104c-1f21-4977-bbc0-108b960b2cac tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1683 microversion: 2.1 time: 0.560706 Aug 29 04:55:23.488048 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 606/1318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:22 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1683 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:23.498064 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] HTTP exception thrown: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Request method failure captured: Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 HTTP/1.1 Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEaf3anQTisY7pF0Eg90bQMz2w3vS7UWIsihPqLwjHqMMqImGXIh8m8G6VnPUHT6ihkhG-CjFJ_AYUIrhLAflwj-E6mdFv94v1oFGXRh6_AdF5I8t5KX_R0Za7cK_lD8kfpVXOJ51wFCZ-3WbhTQ9-Zykrqa9dOppu1wZZM40kwX9pE Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:55:23.500022 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_202ee9ec794b40439b2c5aa9ab4f2dcb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 730821ec74eb48ab8e474db8bbcf97b7 Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:23.501472 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7c1f871d-98e2-414a-bd84-3b0aa7d76005'} Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:23.502251 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:23.503507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:55:23.521123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Returning 404 to user: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:23.522322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:23.523426 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-68d8bd3e-b1b4-4cea-9b10-9d61bf26a95f tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 404 len: 111 microversion: 2.1 time: 0.130528 Aug 29 04:55:23.524800 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 713/1319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:23 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:23.525135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:23.531669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:23.532461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:23.533121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:23.534021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:23.544930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:23.545687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:23.883094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1188908951", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:23.987408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:55:24.137261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:24.153174 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-91e94be9-ba44-4b94-bae8-d9dc748827c0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1475 microversion: 2.1 time: 0.659532 Aug 29 04:55:24.172688 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 607/1320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:23 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1475 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:24.194277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:24.198879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:24.237596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:24.237736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:24.246319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:24.250222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:24.251528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:24.255936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:25.253738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:55:25.254297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:55:25.254523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:55:25.255112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:55:25.255677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:55:25.282504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:25.282989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:25.283424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:25.284193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:25.284655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:25.285078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:25.377876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Getting quotas for project 202ee9ec794b40439b2c5aa9ab4f2dcb. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:55:25.383524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Getting quotas for user 730821ec74eb48ab8e474db8bbcf97b7 and project 202ee9ec794b40439b2c5aa9ab4f2dcb. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:55:25.417882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:55:25.420696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:55:25.507205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c08298de-2693-45e5-9a73-db8edccda136 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.628039 Aug 29 04:55:25.513462 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 714/1321] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:55:25.528012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-plugged", "status": "completed", "tag": "3372f051-9c0d-493f-b763-67cf604a724d"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-plugged", "status": "completed", "tag": "e6173923-7d90-4415-821f-4e432a713b3e"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-plugged", "status": "completed", "tag": "9da0fa16-4ab8-435c-abe2-442d313636cf"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-plugged", "status": "completed", "tag": "56f6927d-5229-47b9-8f1f-2f0466f24ad6"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-plugged", "status": "completed", "tag": "398b88bc-ab6b-4fae-9575-780d3764d159"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:25.549900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:25.550681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:25.559255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:25.589474 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] Creating event network-vif-plugged:3372f051-9c0d-493f-b763-67cf604a724d for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:55:25.590365 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] Creating event network-vif-plugged:e6173923-7d90-4415-821f-4e432a713b3e for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:55:25.597616 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] Creating event network-vif-plugged:9da0fa16-4ab8-435c-abe2-442d313636cf for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:55:25.605900 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] Creating event network-vif-plugged:56f6927d-5229-47b9-8f1f-2f0466f24ad6 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:55:25.621520 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] Creating event network-vif-plugged:398b88bc-ab6b-4fae-9575-780d3764d159 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:55:25.637219 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-893b9742-f964-4538-9dbb-264910ba1059 req-f477129b-cb5c-4e02-8426-271ef3e31b36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.128107 Aug 29 04:55:25.640493 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 715/1322] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:25.666645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:25.667403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:25.687773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:25.688438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:25.690704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:25.691500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:25.693122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:25.693747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:25.753912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:25.773460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:25.779260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:25.781222 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5cb50458-5d48-4d10-8c0e-a49178fe295c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 1.606217 Aug 29 04:55:25.799447 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 608/1323] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:24 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:25.812187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:25.813607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:25.821027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:25.821998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:25.822646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:25.825097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:25.825820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:25.827510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:25.959762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:26.056581 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95f7bb6f-4163-423c-a1c5-7da1b3aec325 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1280 microversion: 2.1 time: 0.249901 Aug 29 04:55:26.068458 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 609/1324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:25 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1280 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:26.110903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:26.114083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:26.151051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:26.151713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:26.164758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:26.165757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:26.168708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:26.172800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:26.287761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:26.301514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:26.303361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:26.313356 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-64961492-bc2d-46cc-86ce-fa62d9517128 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.671391 Aug 29 04:55:26.324667 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 716/1325] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:25 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:26.336534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:26.343680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:26.359495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:26.360675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:26.364688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:26.365633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:26.366262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:26.366858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:26.515667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:26.546758 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-718222be-461c-4794-80b9-fecd3aca5cbd tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1615 microversion: 2.1 time: 0.488512 Aug 29 04:55:26.547890 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 610/1326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:26 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1615 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:26.553293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aa46ecdf-e87e-49d1-8beb-c4337efa3d14 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:26.554619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aa46ecdf-e87e-49d1-8beb-c4337efa3d14 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:26.790613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:26.812676 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7c3ec5c0-23ec-4348-a71b-896c8a6dafd9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1475 microversion: 2.1 time: 0.477574 Aug 29 04:55:26.813605 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 717/1327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:26 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1475 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:26.826113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:26.827301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:26.876586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:26.877358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:26.878389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:26.885771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:26.886644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:26.887248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:26.929450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa46ecdf-e87e-49d1-8beb-c4337efa3d14 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:26.937859 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aa46ecdf-e87e-49d1-8beb-c4337efa3d14 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1220 microversion: 2.1 time: 0.388535 Aug 29 04:55:26.957210 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 611/1328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:26 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1220 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:27.082618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:27.083314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:27.093308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:27.098338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:27.098842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:27.105845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:27.106634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:27.107116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:27.107553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:27.300743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:27.317733 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a13d0256-51de-4056-ae0c-12b73b68ba7d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1280 microversion: 2.1 time: 0.237604 Aug 29 04:55:27.329024 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 612/1329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:27 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:27.348953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:27.350692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:27.367770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:27.371696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:27.372586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:27.374278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:27.376964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:27.380567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:27.382126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:27.386603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:27.393258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:27.394924 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a9b4e68-e743-441b-af51-4ce283f47154 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.580179 Aug 29 04:55:27.398214 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 718/1330] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:26 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:27.568256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:27.569211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:27.595188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:27.595999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:27.596475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:27.599217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:27.599685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:27.600110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:27.776489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:27.787171 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7eb2b824-bd29-45d5-93df-33e0dca12925 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1615 microversion: 2.1 time: 0.223254 Aug 29 04:55:27.796009 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 719/1331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:27 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1615 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:27.813076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fb6570af-479f-4c25-b64c-f5824f133515 req-c51485cd-c0e3-40e9-a695-8ec7a7ed45a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-plugged", "status": "completed", "tag": "1e83970a-7e64-4b23-bf48-2452589a5692"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:27.825773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:27.830767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb6570af-479f-4c25-b64c-f5824f133515 req-c51485cd-c0e3-40e9-a695-8ec7a7ed45a4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:27.832367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb6570af-479f-4c25-b64c-f5824f133515 req-c51485cd-c0e3-40e9-a695-8ec7a7ed45a4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:27.833216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb6570af-479f-4c25-b64c-f5824f133515 req-c51485cd-c0e3-40e9-a695-8ec7a7ed45a4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:27.868290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fb6570af-479f-4c25-b64c-f5824f133515 req-c51485cd-c0e3-40e9-a695-8ec7a7ed45a4 service nova] Creating event network-vif-plugged:1e83970a-7e64-4b23-bf48-2452589a5692 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:55:27.887633 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fb6570af-479f-4c25-b64c-f5824f133515 req-c51485cd-c0e3-40e9-a695-8ec7a7ed45a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089903 Aug 29 04:55:27.888562 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 720/1332] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:27.917402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:27.924377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:27.946983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:27.949459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:27.953283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:27.956830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:27.959166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:27.961045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:27.989119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:28.011772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:28.017051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:28.028278 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7eb47753-6b14-421d-8037-7001a6dc96a6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.689878 Aug 29 04:55:28.028892 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 613/1333] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:27 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:28.041072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:28.047154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:28.067351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:28.067850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:28.078829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:28.081981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:28.082788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:28.083389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:28.517829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:28.527334 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-88057683-addd-4f0c-80fd-fca81e5476d3 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1272 microversion: 2.1 time: 0.495139 Aug 29 04:55:28.528815 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 614/1334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:28 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1272 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:28.535178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6df66f6d-c3a4-4b30-9cfa-0fffcf30260a req-d9e763f0-3596-495e-a324-23bd8707e827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b8c9c9-249d-412e-86ca-35d59cbdd971", "name": "network-vif-deleted", "tag": "71d3554f-991d-4013-bd32-c59c58bd7bf3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:28.547683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6df66f6d-c3a4-4b30-9cfa-0fffcf30260a req-d9e763f0-3596-495e-a324-23bd8707e827 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:28.548379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6df66f6d-c3a4-4b30-9cfa-0fffcf30260a req-d9e763f0-3596-495e-a324-23bd8707e827 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:28.549380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6df66f6d-c3a4-4b30-9cfa-0fffcf30260a req-d9e763f0-3596-495e-a324-23bd8707e827 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:28.563628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6df66f6d-c3a4-4b30-9cfa-0fffcf30260a req-d9e763f0-3596-495e-a324-23bd8707e827 service nova] Creating event network-vif-deleted:71d3554f-991d-4013-bd32-c59c58bd7bf3 for instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 on n-h1-854119-9 Aug 29 04:55:28.569491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6df66f6d-c3a4-4b30-9cfa-0fffcf30260a req-d9e763f0-3596-495e-a324-23bd8707e827 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038516 Aug 29 04:55:28.571139 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 615/1335] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:28.581612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:28.590814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:28.606606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:28.607875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:28.609023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:28.610182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:28.611195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:28.613095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:28.904509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:28.919735 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a07ccdea-c385-49fa-aca2-81f2941398d4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1280 microversion: 2.1 time: 0.346987 Aug 29 04:55:28.920669 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 616/1336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:28 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1280 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:28.928417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:28.932373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:28.951591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:28.952902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:28.953537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:28.954465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:28.955114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:28.955750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:29.149767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:29.158139 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d1c93b3f-3ecb-4081-b971-f7d8b4b71098 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1475 microversion: 2.1 time: 1.267397 Aug 29 04:55:29.178150 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 721/1337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:27 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1475 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:29.194955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:29.195600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:29.212340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:29.213113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:29.213718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:29.216499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:29.218290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:29.220348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:29.283710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:29.284744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:29.286376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:29.298895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lazy-loading 'fault' on Instance uuid c1b8c9c9-249d-412e-86ca-35d59cbdd971 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:29.623630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0266d5991442649190b2f052809d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aeab40a6546e799cb321f5978468f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:29.631883 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-029cb5da-20d8-4674-966d-68109695aa95 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 200 len: 1332 microversion: 2.1 time: 0.450697 Aug 29 04:55:29.643734 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 722/1338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:29 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 1332 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:29.643734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:29.643734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:29.673555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:29.674498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:29.679090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:29.680342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:29.681043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:29.681723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:29.739780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:29.761401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:29.766402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:29.773213 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff7da730-00ef-4b8d-9b42-423b024e8dcf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 0.849617 Aug 29 04:55:29.776454 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 617/1339] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:28 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:29.795124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:29.797901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:29.822776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:29.823534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:29.824233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:29.826518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:29.828217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:29.829154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:30.088939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:30.132467 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d2690580-1a39-443d-b9fd-19bd66ccb4c9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1278 microversion: 2.1 time: 0.354498 Aug 29 04:55:30.134332 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 618/1340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:29 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1278 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:30.144292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:30.145302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:30.153432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:30.154288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:30.154960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:30.155966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:30.156664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:30.157311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:30.219190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:30.230709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:30.233008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:30.241336 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-966bb806-56bb-46e8-9175-9ba268b32983 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.602568 Aug 29 04:55:30.259130 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 723/1341] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:29 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:30.417456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:30.418350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:30.427607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:30.438395 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c38e6ce3-9743-4c52-a746-0debe3d6cf3b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1322 microversion: 2.1 time: 0.301142 Aug 29 04:55:30.439839 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 619/1342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:30 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:30.443221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:30.443736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:30.444212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:30.444954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:30.445398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:30.445810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:30.660907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:30.661905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] [instance: c1b8c9c9-249d-412e-86ca-35d59cbdd971] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:30.669602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:30.670413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:30.671047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:30.672378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:30.672963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:30.673599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:30.693126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:30.703082 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] HTTP exception thrown: Instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 could not be found. Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Request method failure captured: Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 HTTP/1.1 Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEX8rYfESjXsvuXHIhvIj4ddxTP7vHktDMrhgzTxuoz5n451XwV2FxLo7GULJ3aXwoufuSV7BLPGj3j6Uvl1e1GLr8YDRZp9-sJas1G-oAzfDIXMszJ1_OY9sNWSwZMkOOyYVsH6Xhj0djJ8t7mbyf-lASfQs4y-dKv3inFGPbrlj6I Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 9e4aeab40a6546e799cb321f5978468f Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesAdminNegativeTest-679021692 Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:55:30.704833 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e4aeab40a6546e799cb321f5978468f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e4aeab40a6546e799cb321f5978468f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e4aeab40a6546e799cb321f5978468f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e4aeab40a6546e799cb321f5978468f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesAdminNegativeTest-679021692 Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 9e4aeab40a6546e799cb321f5978468f Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-679021692 Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesAdminNegativeTest-679021692-project Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 3b0266d5991442649190b2f052809d2c Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesAdminNegativeTest-679021692-project Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 could not be found. Aug 29 04:55:30.706366 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'c1b8c9c9-249d-412e-86ca-35d59cbdd971'} Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 could not be found. Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:30.707166 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 could not be found. Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 could not be found. Aug 29 04:55:30.708918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:30.713947 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09f6afbc-c6a7-4b41-ad72-2729d14c26dd tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1475 microversion: 2.1 time: 0.452999 Aug 29 04:55:30.716164 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 724/1343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:30 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1475 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:30.716313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Returning 404 to user: Instance c1b8c9c9-249d-412e-86ca-35d59cbdd971 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:30.716512 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d185c39c-39b0-4b94-9d96-7d6fd68be9b8 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971" status: 404 len: 111 microversion: 2.1 time: 0.059735 Aug 29 04:55:30.717224 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 620/1344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:30 2022] GET /compute/v2.1/servers/c1b8c9c9-249d-412e-86ca-35d59cbdd971 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:30.725686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43a4cadf-bc07-402d-aa74-4de899b039f2 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] Calling method '.version_select at 0x7f1ab9123af0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:30.748326 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43a4cadf-bc07-402d-aa74-4de899b039f2 tempest-VolumesAdminNegativeTest-679021692 tempest-VolumesAdminNegativeTest-679021692-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109706827" status: 202 len: 0 microversion: 2.1 time: 0.026572 Aug 29 04:55:30.764175 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 725/1345] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 04:55:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109706827 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:55:30.803362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:30.805111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:30.811918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:30.812688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:30.813535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:30.815585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:30.816236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:30.816827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:31.166500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:31.168371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:31.180028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:31.180958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:31.181700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:31.184036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:31.185415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:31.186086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:31.867802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:31.877395 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40b19d8d-b5db-4dd6-ac8a-54cfcb65c9fe tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 0.717734 Aug 29 04:55:31.885048 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 726/1346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:31 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:31.895056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:31.905362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:31.916525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:31.918254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:31.919564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:31.920468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:31.921364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:31.921923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:31.928830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:32.100085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:32.139648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:32.141814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:32.145471 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd61ca58-3ea2-464f-a985-3eb05e86584a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1869 microversion: 2.32 time: 1.346667 Aug 29 04:55:32.148213 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 621/1347] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:30 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1869 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:32.182213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:32.185884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:32.215079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:32.216947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:32.219833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:32.222477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:32.223335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:32.224675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:32.382099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:32.393756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:32.395384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:32.407260 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5b1be161-dbcd-4d44-84d1-83f70a334aa1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.528198 Aug 29 04:55:32.408053 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 727/1348] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:31 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:32.413010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:32.413808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:32.431216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:32.431995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:32.432618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:32.433472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:32.434066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:32.434656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:32.727367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:32.740728 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28ea566c-f7eb-4d99-bd93-782fef1f3d4a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1322 microversion: 2.1 time: 0.587341 Aug 29 04:55:32.749018 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 622/1349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:32 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:32.832819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:32.848592 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40c8c01a-f7d1-4f52-abce-d36d94222b20 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1474 microversion: 2.1 time: 0.439048 Aug 29 04:55:32.857492 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 728/1350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:32 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1474 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:32.907302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:32.908006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:32.924526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:32.926626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:32.928297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:32.930436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:32.934861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:32.935513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:32.940843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8adcd130-dc6b-4a08-bb0f-4dc07771c340 req-84f576c4-de02-4171-9b49-0c4c54759772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a", "tag": "35eee654-3e7e-41a0-9f06-2a811dfa3710"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:32.960440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8adcd130-dc6b-4a08-bb0f-4dc07771c340 req-84f576c4-de02-4171-9b49-0c4c54759772 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:32.961313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8adcd130-dc6b-4a08-bb0f-4dc07771c340 req-84f576c4-de02-4171-9b49-0c4c54759772 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:32.963944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8adcd130-dc6b-4a08-bb0f-4dc07771c340 req-84f576c4-de02-4171-9b49-0c4c54759772 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:32.984798 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8adcd130-dc6b-4a08-bb0f-4dc07771c340 req-84f576c4-de02-4171-9b49-0c4c54759772 service nova] Creating event network-changed:35eee654-3e7e-41a0-9f06-2a811dfa3710 for instance 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a on n-h2-854119-9 Aug 29 04:55:32.992076 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8adcd130-dc6b-4a08-bb0f-4dc07771c340 req-84f576c4-de02-4171-9b49-0c4c54759772 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179661 Aug 29 04:55:32.994243 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 623/1351] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:33.002557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7bfaaf15-3d21-46c7-9eea-b6fef8592536 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:33.003444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7bfaaf15-3d21-46c7-9eea-b6fef8592536 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:33.013103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf15-3d21-46c7-9eea-b6fef8592536 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:33.014387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf15-3d21-46c7-9eea-b6fef8592536 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:33.015083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf15-3d21-46c7-9eea-b6fef8592536 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:33.015965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf15-3d21-46c7-9eea-b6fef8592536 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:33.023106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf15-3d21-46c7-9eea-b6fef8592536 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:33.024893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bfaaf15-3d21-46c7-9eea-b6fef8592536 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:33.060510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:33.336825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:33.366636 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-67c04ff5-5a7d-4935-a136-3b2037658461 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 0.463216 Aug 29 04:55:33.367311 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 729/1352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:32 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:33.376581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:33.385145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:33.391571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:33.391947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:33.397107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:33.398263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:33.399016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:33.399659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:33.479090 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7bfaaf15-3d21-46c7-9eea-b6fef8592536 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1814 microversion: 2.1 time: 0.482840 Aug 29 04:55:33.490413 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 624/1353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:32 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1814 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:33.515034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:33.516882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:33.549165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:33.549679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:33.550110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:33.551420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:33.552042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:33.552692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:33.936344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:33.953653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:33.955902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:33.960697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:33.964491 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-88c83312-3431-4d80-8306-064df2e6bfaf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 2820 microversion: 2.32 time: 0.595621 Aug 29 04:55:33.966054 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 730/1354] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:33 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 2820 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:33.973698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:33.977576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:33.981306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e33cf17-2678-416e-8e2a-3203cdb03637 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.488150 Aug 29 04:55:33.983082 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 625/1355] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:33 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:33.992981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e140607-b7e8-458d-9529-d0eaf0398373 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:33.997204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c8663ac8-14a2-4d0a-abb8-51fe1d2f6d9d req-5f1dbd4e-284c-4a73-9d34-48c0cbd27bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a99c1b-98ad-4d46-9be1-6d36ec32604b", "name": "network-vif-unplugged", "status": "completed", "tag": "bf0358be-94b3-48f2-9869-3120396522f3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:34.008953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e140607-b7e8-458d-9529-d0eaf0398373 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.009445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e140607-b7e8-458d-9529-d0eaf0398373 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.012592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e140607-b7e8-458d-9529-d0eaf0398373 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.013613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e140607-b7e8-458d-9529-d0eaf0398373 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.014859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c8663ac8-14a2-4d0a-abb8-51fe1d2f6d9d req-5f1dbd4e-284c-4a73-9d34-48c0cbd27bb9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.015674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c8663ac8-14a2-4d0a-abb8-51fe1d2f6d9d req-5f1dbd4e-284c-4a73-9d34-48c0cbd27bb9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.016339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c8663ac8-14a2-4d0a-abb8-51fe1d2f6d9d req-5f1dbd4e-284c-4a73-9d34-48c0cbd27bb9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.016458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e140607-b7e8-458d-9529-d0eaf0398373 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.016865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e140607-b7e8-458d-9529-d0eaf0398373 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.034089 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c8663ac8-14a2-4d0a-abb8-51fe1d2f6d9d req-5f1dbd4e-284c-4a73-9d34-48c0cbd27bb9 service nova] Creating event network-vif-unplugged:bf0358be-94b3-48f2-9869-3120396522f3 for instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b on n-h2-854119-9 Aug 29 04:55:34.063171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-c8663ac8-14a2-4d0a-abb8-51fe1d2f6d9d req-5f1dbd4e-284c-4a73-9d34-48c0cbd27bb9 service nova] Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:55:34.077044 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e140607-b7e8-458d-9529-d0eaf0398373 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092015 Aug 29 04:55:34.079825 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 626/1356] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Aug 29 04:55:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:34.093788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:34.094612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:34.099319 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c8663ac8-14a2-4d0a-abb8-51fe1d2f6d9d req-5f1dbd4e-284c-4a73-9d34-48c0cbd27bb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130052 Aug 29 04:55:34.101769 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 731/1357] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:34.108822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.110958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.112640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.114274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.115438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.117886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.157720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:34.165773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:34.188815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.193120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.194553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.195996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.205186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.205935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.537353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:34.548086 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0d9c5342-7a4d-477e-bd6c-c69c86c0c6ef tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1322 microversion: 2.1 time: 0.465828 Aug 29 04:55:34.548721 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 627/1358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:34 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:34.554135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b442bff-c997-4519-a3c6-192509f1c867 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:34.554908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b442bff-c997-4519-a3c6-192509f1c867 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:34.565193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:34.570572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b442bff-c997-4519-a3c6-192509f1c867 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.571087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b442bff-c997-4519-a3c6-192509f1c867 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.571533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b442bff-c997-4519-a3c6-192509f1c867 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.572296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b442bff-c997-4519-a3c6-192509f1c867 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.572759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b442bff-c997-4519-a3c6-192509f1c867 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.573202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b442bff-c997-4519-a3c6-192509f1c867 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.577134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0df2bfc6-caf8-44b0-8ce5-a6ba589ddec1 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1474 microversion: 2.1 time: 0.473638 Aug 29 04:55:34.590011 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 732/1359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:34 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1474 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:34.600910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:34.601981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:34.613394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.614470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.616429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.617472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:34.618183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:34.618812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:34.626449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:34.802235 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b442bff-c997-4519-a3c6-192509f1c867 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.251765 Aug 29 04:55:34.806109 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 628/1360] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 29 04:55:34 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf/os-interface => generated 1832 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:35.010816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:35.011513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:35.024632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:35.025466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:35.030567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:35.031628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:35.032465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:35.033102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:35.313804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:35.412596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:35.692170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:35.704731 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6493995b-6d4d-42f4-af16-b53a7cdf542a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 1.113099 Aug 29 04:55:35.705637 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 733/1361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:34 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:35.710383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0e8a053c-4b07-433e-86bf-fac9b0f675d9 req-1c07e709-c9d2-435b-a458-270a8090c609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb32ec9-a6a8-488a-afc8-65c5644fdc84", "tag": "ee7e2f15-5164-48b6-9723-be810600d153"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:35.733614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0e8a053c-4b07-433e-86bf-fac9b0f675d9 req-1c07e709-c9d2-435b-a458-270a8090c609 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:35.734104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0e8a053c-4b07-433e-86bf-fac9b0f675d9 req-1c07e709-c9d2-435b-a458-270a8090c609 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:35.734535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0e8a053c-4b07-433e-86bf-fac9b0f675d9 req-1c07e709-c9d2-435b-a458-270a8090c609 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:35.766368 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0e8a053c-4b07-433e-86bf-fac9b0f675d9 req-1c07e709-c9d2-435b-a458-270a8090c609 service nova] Creating event network-changed:ee7e2f15-5164-48b6-9723-be810600d153 for instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 on n-h2-854119-9 Aug 29 04:55:35.771501 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0e8a053c-4b07-433e-86bf-fac9b0f675d9 req-1c07e709-c9d2-435b-a458-270a8090c609 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064436 Aug 29 04:55:35.772446 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 734/1362] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:35.777663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:35.778353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:35.796101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:35.796640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:35.797320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:35.801836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:35.802645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:35.803275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:35.818511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:35.835021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:35.839140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:35.842206 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-afc74836-a7d4-4146-b785-10f80599740c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.833669 Aug 29 04:55:35.856145 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 629/1363] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:35 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:55:35.856145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:35.856145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:35.871415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:35.874833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:35.875471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:35.876229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:35.876679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:35.879398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:36.312904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:36.315910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:36.333807 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12eb47f9-b92f-4c2c-803f-36bb1e5598d2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1474 microversion: 2.1 time: 0.489268 Aug 29 04:55:36.349570 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 630/1364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:35 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1474 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:36.356438 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f0e5d6b-e236-4a3f-96e5-dcde72b59e9a tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1322 microversion: 2.1 time: 0.582140 Aug 29 04:55:36.372221 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 735/1365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:35 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:36.376024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-efc9f8bd-8b2a-49aa-9736-9673ca4030fc req-b46fb2b1-7c53-43ff-b9a4-7e4127a09367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a99c1b-98ad-4d46-9be1-6d36ec32604b", "tag": "bf0358be-94b3-48f2-9869-3120396522f3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:36.436251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-efc9f8bd-8b2a-49aa-9736-9673ca4030fc req-b46fb2b1-7c53-43ff-b9a4-7e4127a09367 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:36.437090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-efc9f8bd-8b2a-49aa-9736-9673ca4030fc req-b46fb2b1-7c53-43ff-b9a4-7e4127a09367 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:36.437663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-efc9f8bd-8b2a-49aa-9736-9673ca4030fc req-b46fb2b1-7c53-43ff-b9a4-7e4127a09367 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:36.454736 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-efc9f8bd-8b2a-49aa-9736-9673ca4030fc req-b46fb2b1-7c53-43ff-b9a4-7e4127a09367 service nova] Creating event network-changed:bf0358be-94b3-48f2-9869-3120396522f3 for instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b on n-h2-854119-9 Aug 29 04:55:36.462839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-efc9f8bd-8b2a-49aa-9736-9673ca4030fc req-b46fb2b1-7c53-43ff-b9a4-7e4127a09367 service nova] Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:55:36.476002 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-efc9f8bd-8b2a-49aa-9736-9673ca4030fc req-b46fb2b1-7c53-43ff-b9a4-7e4127a09367 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124782 Aug 29 04:55:36.477226 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 631/1366] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:36.729892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:36.730509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:36.740702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:36.752101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:36.752847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:36.753506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:36.753963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:36.754494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:36.867302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:36.868015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:36.898167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:36.898678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:36.899331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:36.899817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:36.904482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:36.904892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:36.938086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:37.888247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:37.905048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-edb7983c-dbb0-496f-9826-f2436f779721 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 1.179090 Aug 29 04:55:37.928376 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 736/1367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:36 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:37.933823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-74ec36f6-1d54-492b-b6dd-7fc219b39f4e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faef6c3f-bdaa-4c36-aca5-69ebc79946d4", "device": "/dev/xvdb"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:37.936615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-74ec36f6-1d54-492b-b6dd-7fc219b39f4e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:37.954984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ec36f6-1d54-492b-b6dd-7fc219b39f4e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:37.955731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ec36f6-1d54-492b-b6dd-7fc219b39f4e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:37.956398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ec36f6-1d54-492b-b6dd-7fc219b39f4e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:37.957286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ec36f6-1d54-492b-b6dd-7fc219b39f4e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:37.957887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ec36f6-1d54-492b-b6dd-7fc219b39f4e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:37.958456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ec36f6-1d54-492b-b6dd-7fc219b39f4e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:38.057445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:38.083880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:38.086352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:38.087183 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-24e91803-fe1b-48ab-96d7-4ccceaf956b9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 1.225511 Aug 29 04:55:38.092479 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 632/1368] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:36 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:55:38.114591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:38.116266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:38.126617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:38.128450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:38.129235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:38.130176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:38.131626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:38.132366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:38.395120 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-74ec36f6-1d54-492b-b6dd-7fc219b39f4e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "POST /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464134 Aug 29 04:55:38.396464 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 737/1369] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 04:55:37 2022] POST /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:38.417457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:38.421199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:38.446429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:38.446930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:38.447483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:38.448060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:38.456783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:38.457239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:39.663288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:39.677511 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf739f12-df34-4de0-8697-f15cc6436dda tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1322 microversion: 2.1 time: 1.277110 Aug 29 04:55:39.692422 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 738/1370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:38 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1322 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:39.702710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:39.703325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:39.727350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:39.727861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:39.728330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:39.729049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:39.729499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:39.729922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:39.766253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:39.781266 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4128f9d0-dded-4424-82bc-05c3de946b5a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1474 microversion: 2.1 time: 1.687140 Aug 29 04:55:39.782303 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 633/1371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:38 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1474 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:39.792454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5bb614bc-ab35-4ff6-a359-cb3df4b2fa1f req-6c45486c-5550-4e77-9399-21b1cecb3782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "tag": "9da0fa16-4ab8-435c-abe2-442d313636cf"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:39.817455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5bb614bc-ab35-4ff6-a359-cb3df4b2fa1f req-6c45486c-5550-4e77-9399-21b1cecb3782 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:39.817949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5bb614bc-ab35-4ff6-a359-cb3df4b2fa1f req-6c45486c-5550-4e77-9399-21b1cecb3782 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:39.818383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5bb614bc-ab35-4ff6-a359-cb3df4b2fa1f req-6c45486c-5550-4e77-9399-21b1cecb3782 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:39.850190 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5bb614bc-ab35-4ff6-a359-cb3df4b2fa1f req-6c45486c-5550-4e77-9399-21b1cecb3782 service nova] Creating event network-changed:9da0fa16-4ab8-435c-abe2-442d313636cf for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:55:39.859828 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5bb614bc-ab35-4ff6-a359-cb3df4b2fa1f req-6c45486c-5550-4e77-9399-21b1cecb3782 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072365 Aug 29 04:55:39.860862 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 634/1372] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:39.871405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:39.875019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:39.888716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:39.890781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:39.892559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:39.894542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:39.897614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:39.898305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:40.915926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:40.930332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:40.936456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:40.939597 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd890236-c954-444a-93b9-92b7abcc8525 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 1.076283 Aug 29 04:55:40.940433 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 635/1373] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:39 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:40.954229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e0112e8f-1239-485f-9fa2-78302c06ec10 req-eb5eba2b-cd05-4399-9396-20686bf4b4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a", "name": "network-vif-plugged", "status": "completed", "tag": "35eee654-3e7e-41a0-9f06-2a811dfa3710"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:40.980959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e0112e8f-1239-485f-9fa2-78302c06ec10 req-eb5eba2b-cd05-4399-9396-20686bf4b4dd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:40.981443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e0112e8f-1239-485f-9fa2-78302c06ec10 req-eb5eba2b-cd05-4399-9396-20686bf4b4dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:40.981870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e0112e8f-1239-485f-9fa2-78302c06ec10 req-eb5eba2b-cd05-4399-9396-20686bf4b4dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:41.009971 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e0112e8f-1239-485f-9fa2-78302c06ec10 req-eb5eba2b-cd05-4399-9396-20686bf4b4dd service nova] Creating event network-vif-plugged:35eee654-3e7e-41a0-9f06-2a811dfa3710 for instance 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a on n-h2-854119-9 Aug 29 04:55:41.025289 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e0112e8f-1239-485f-9fa2-78302c06ec10 req-eb5eba2b-cd05-4399-9396-20686bf4b4dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082134 Aug 29 04:55:41.025909 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 636/1374] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:41.039230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:41.040365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:41.055740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:41.059921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:41.060747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:41.065063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:41.066258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:41.066957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:41.083920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:41.093252 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-77be325a-1de2-4488-8c89-b7e36c73113b tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 1.394887 Aug 29 04:55:41.101892 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 739/1375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:39 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:41.150481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:41.152455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:41.184718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:41.185220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:41.185659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:41.186371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:41.207962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:41.208449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:42.502285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:42.515415 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fd551469-251e-41c1-8f09-6f8e05fd1a98 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1322 microversion: 2.1 time: 1.486132 Aug 29 04:55:42.516382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:42.517662 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 637/1376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:41 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1322 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:42.542012 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-588fc275-fd5d-4807-9665-2850630ef3ee tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1474 microversion: 2.1 time: 1.436592 Aug 29 04:55:42.547257 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 740/1377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:41 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1474 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:42.547674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:42.548334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:42.557083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:42.558071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:42.566263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:42.566768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:42.567206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:42.567925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:42.568414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:42.568969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:42.570940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:42.576252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:42.577456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:42.578449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:42.579119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:42.580641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:43.367115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:43.382767 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6cc5863b-fedf-434a-8e65-0e28056084f9 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 0.833444 Aug 29 04:55:43.383366 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 741/1378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:42 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:43.403252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-14852028-cdef-4ad5-9598-2e447e6833f4 req-8a41f944-b152-49fc-a153-2f209e97f575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b14f0ef-853d-4876-888d-045a86ffd64a", "name": "network-vif-unplugged", "status": "completed", "tag": "cb07cff6-85cd-45cb-b12a-e416d047ddfb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:43.436176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-14852028-cdef-4ad5-9598-2e447e6833f4 req-8a41f944-b152-49fc-a153-2f209e97f575 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:43.445167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:43.455525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-14852028-cdef-4ad5-9598-2e447e6833f4 req-8a41f944-b152-49fc-a153-2f209e97f575 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:43.462479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-14852028-cdef-4ad5-9598-2e447e6833f4 req-8a41f944-b152-49fc-a153-2f209e97f575 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:43.470085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:43.486941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:43.495338 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dcb4e8b7-6de9-47a7-af41-abcaf9bc4092 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.972870 Aug 29 04:55:43.503491 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 638/1379] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:42 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:43.525158 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-14852028-cdef-4ad5-9598-2e447e6833f4 req-8a41f944-b152-49fc-a153-2f209e97f575 service nova] Creating event network-vif-unplugged:cb07cff6-85cd-45cb-b12a-e416d047ddfb for instance 1b14f0ef-853d-4876-888d-045a86ffd64a on n-h1-854119-9 Aug 29 04:55:43.541190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:43.542035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:43.562663 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-14852028-cdef-4ad5-9598-2e447e6833f4 req-8a41f944-b152-49fc-a153-2f209e97f575 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.177737 Aug 29 04:55:43.566728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:43.567216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:43.567661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:43.568405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:43.568943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:43.569406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:43.574199 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 742/1380] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:43.593976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:43.594823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:43.610975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:43.612161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:43.612606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:43.613934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:43.614437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:43.618248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:44.025817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:44.258453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:44.270027 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c4bdbd03-cba8-4f58-af7d-60bfa996fd45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1322 microversion: 2.1 time: 0.734777 Aug 29 04:55:44.272202 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 639/1381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:43 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:44.390866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:44.401621 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8b47a34e-7757-46cc-9221-c33d018ed856 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1474 microversion: 2.1 time: 0.826012 Aug 29 04:55:44.408656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:44.409524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:44.417566 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 743/1382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:43 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1474 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:44.422941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:44.423658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:44.425647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:44.426552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:44.429378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:44.430776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:44.529346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:44.530341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:44.542172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:44.545598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:44.546257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:44.547234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:44.547767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:44.549610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:44.971351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:44.987480 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9180223d-11a0-4f9a-a67a-3d834b8a7630 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 0.580388 Aug 29 04:55:44.988452 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 640/1383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:44 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:45.055530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:45.072073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:45.072073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:45.073508 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-671dab47-a70e-4f28-bc80-fed3669555d8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.549849 Aug 29 04:55:45.084213 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 744/1384] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:44 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:55:45.291936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:45.292587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:45.305977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:45.306573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:45.307084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:45.307804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:45.308289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:45.308946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:45.423784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:45.424819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:45.440077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:45.442339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:45.443011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:45.445109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:45.446410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:45.447077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:45.570655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:45.595530 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b729ceb6-f945-4301-8707-3ad455231bc1 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1471 microversion: 2.1 time: 0.301853 Aug 29 04:55:45.598733 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 641/1385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:45 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:45.603871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ba18422d-6b3f-4044-a0ac-0503b1e6a6f0 req-f54da57b-cbaf-4fef-a9e5-9c2550079e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b14f0ef-853d-4876-888d-045a86ffd64a", "tag": "cb07cff6-85cd-45cb-b12a-e416d047ddfb"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:45.618714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ba18422d-6b3f-4044-a0ac-0503b1e6a6f0 req-f54da57b-cbaf-4fef-a9e5-9c2550079e08 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:45.619513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ba18422d-6b3f-4044-a0ac-0503b1e6a6f0 req-f54da57b-cbaf-4fef-a9e5-9c2550079e08 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:45.620283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ba18422d-6b3f-4044-a0ac-0503b1e6a6f0 req-f54da57b-cbaf-4fef-a9e5-9c2550079e08 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:45.635714 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ba18422d-6b3f-4044-a0ac-0503b1e6a6f0 req-f54da57b-cbaf-4fef-a9e5-9c2550079e08 service nova] Creating event network-changed:cb07cff6-85cd-45cb-b12a-e416d047ddfb for instance 1b14f0ef-853d-4876-888d-045a86ffd64a on n-h1-854119-9 Aug 29 04:55:45.644070 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ba18422d-6b3f-4044-a0ac-0503b1e6a6f0 req-f54da57b-cbaf-4fef-a9e5-9c2550079e08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042494 Aug 29 04:55:45.645636 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 642/1386] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:45.731845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:45.746921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e97895bc-c337-4938-a533-b927e6eab7d4 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:45.747584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e97895bc-c337-4938-a533-b927e6eab7d4 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] [instance: a18b6a3e-b8e1-49ed-89dd-8938128b4c5d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:45.751924 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-68991c3a-e5a1-429f-a239-c80899d1a7ac tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1472 microversion: 2.1 time: 0.332203 Aug 29 04:55:45.752569 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 745/1387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:45 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:45.757553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e97895bc-c337-4938-a533-b927e6eab7d4 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] HTTP exception thrown: Instance a18b6a3e-b8e1-49ed-89dd-8938128b4c5d could not be found. Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e97895bc-c337-4938-a533-b927e6eab7d4 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Request method failure captured: Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/a18b6a3e-b8e1-49ed-89dd-8938128b4c5d/action HTTP/1.1 Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 15 Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEa4sjQU8I_KA4zd-GO7r4sitoXKeNp7jVGk82hooXHsD_EXlvVpknsjZm2idS-uIHRyQyNqRxtJO4xJDhH5TNDH5BikPyhGLWrGgdjN5r_ZpeKEffhV8sIompojQUajqZgITB4JVcuYPAZOxOLyd_RtZuoTlrrZ-7N9E3R7WktoyI8 Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:55:45.767969 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/340a103dd945426ab147d43d47858150"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_340a103dd945426ab147d43d47858150", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 31642a313b6b433d867fb2b051497d9d Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: {"migrate": {}} Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:45.769615 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance a18b6a3e-b8e1-49ed-89dd-8938128b4c5d could not be found. Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'a18b6a3e-b8e1-49ed-89dd-8938128b4c5d', 'body': {'migrate': {}}} Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a18b6a3e-b8e1-49ed-89dd-8938128b4c5d could not be found. Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:45.770446 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a18b6a3e-b8e1-49ed-89dd-8938128b4c5d could not be found. Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a18b6a3e-b8e1-49ed-89dd-8938128b4c5d could not be found. Aug 29 04:55:45.772615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:45.774706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e97895bc-c337-4938-a533-b927e6eab7d4 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Returning 404 to user: Instance a18b6a3e-b8e1-49ed-89dd-8938128b4c5d could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:45.774706 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e97895bc-c337-4938-a533-b927e6eab7d4 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a18b6a3e-b8e1-49ed-89dd-8938128b4c5d/action" status: 404 len: 111 microversion: 2.1 time: 0.125387 Aug 29 04:55:45.783557 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 643/1388] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:55:45 2022] POST /compute/v2.1/servers/a18b6a3e-b8e1-49ed-89dd-8938128b4c5d/action => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:45.966229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-850207299", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:46.010762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:46.022894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:46.046224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:46.047376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:46.049869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:46.051154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:46.053717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:46.054524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:46.078492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:55:46.378094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:46.386200 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7ba4a985-c0d7-4967-8357-c60d1e06c8cf tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 0.379567 Aug 29 04:55:46.396155 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 644/1389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:46 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:46.409547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:46.416627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:46.446553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:46.447052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:46.452315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:46.453147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:46.453634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:46.454071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:46.506309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:46.924674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:46.939440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:46.943642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:46.949575 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-47c5a00e-649b-43bc-8c8e-0f5ae281f990 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.561252 Aug 29 04:55:46.965149 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 645/1390] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:46 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:46.975991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:46.976642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:46.994209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:46.996085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:46.996733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:46.997624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:46.998671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:46.999822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:47.016244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:55:47.016849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:55:47.017131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:55:47.017542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:55:47.017964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:55:47.057611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:47.058370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:47.062067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:47.065031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:47.067188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:47.067812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:47.124515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Getting quotas for project 73dd0dd815d24a1b810cad3110a45ddd. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:55:47.136615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Getting quotas for user d895f1e9e257458395b4f38d08ee0b14 and project 73dd0dd815d24a1b810cad3110a45ddd. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:55:47.152755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:55:47.155504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:55:47.265174 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9e27bc8e-a472-4ab7-8a10-ada3e812ca04 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302929 Aug 29 04:55:47.273254 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 746/1391] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:55:47.278681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7bcfbf6f-c32b-4805-a2d9-51ab1c71d35f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:47.279516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7bcfbf6f-c32b-4805-a2d9-51ab1c71d35f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:47.352495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7bcfbf6f-c32b-4805-a2d9-51ab1c71d35f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:47.365205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7bcfbf6f-c32b-4805-a2d9-51ab1c71d35f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1221 microversion: 2.1 time: 0.087671 Aug 29 04:55:47.378431 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 747/1392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:47 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:47.378755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:47.387707 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ba43d6a1-5d17-4d7a-bd4b-fb66f48157e5 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1472 microversion: 2.1 time: 0.420635 Aug 29 04:55:47.400210 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 646/1393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:46 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:47.415201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:47.416183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:47.432362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:47.432866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:47.433289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:47.433998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:47.434441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:47.434856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:47.981165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:47.982761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:47.994234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:47.997070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:47.998908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:48.001816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:48.004051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:48.007015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:48.109276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:48.119851 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18cae04d-5150-4b8b-8579-3995d6106a84 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 0.708951 Aug 29 04:55:48.139154 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 748/1394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:47 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:48.499555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:48.524919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:48.526194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:48.527408 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6992e96a-e223-4272-8548-3aaa2ed73657 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.552029 Aug 29 04:55:48.527967 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 647/1395] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:47 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:55:48.567288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:48.570726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:48.599463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:48.605697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:48.606314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:48.607229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:48.607852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:48.608466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:48.614417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f721503b-07fb-46a7-ac47-3921b60fbd48 req-66fb3194-c0ec-4f5f-9355-143621435d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb32ec9-a6a8-488a-afc8-65c5644fdc84", "name": "network-vif-plugged", "status": "completed", "tag": "ee7e2f15-5164-48b6-9723-be810600d153"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:48.630948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f721503b-07fb-46a7-ac47-3921b60fbd48 req-66fb3194-c0ec-4f5f-9355-143621435d61 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:48.631426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f721503b-07fb-46a7-ac47-3921b60fbd48 req-66fb3194-c0ec-4f5f-9355-143621435d61 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:48.637227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f721503b-07fb-46a7-ac47-3921b60fbd48 req-66fb3194-c0ec-4f5f-9355-143621435d61 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:48.659539 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f721503b-07fb-46a7-ac47-3921b60fbd48 req-66fb3194-c0ec-4f5f-9355-143621435d61 service nova] Creating event network-vif-plugged:ee7e2f15-5164-48b6-9723-be810600d153 for instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 on n-h2-854119-9 Aug 29 04:55:48.665097 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f721503b-07fb-46a7-ac47-3921b60fbd48 req-66fb3194-c0ec-4f5f-9355-143621435d61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.362215 Aug 29 04:55:48.666183 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 749/1396] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:55:48.777170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:48.778082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c67eb072-1987-4710-8f4f-9a5930d2d4ac tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:48.790040 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ae571955-4eb8-4414-a235-a02a51842170 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1273 microversion: 2.1 time: 0.241830 Aug 29 04:55:48.791490 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 648/1397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:48 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:48.809131 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c67eb072-1987-4710-8f4f-9a5930d2d4ac tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.127287 Aug 29 04:55:48.814933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:48.816854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:48.819292 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 750/1398] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:55:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:48.825352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-870900be-d4c8-4e4a-8c85-dbebbfee9b42 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:48.828571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:48.829257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:48.830039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:48.841471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:48.843642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:48.846411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:48.860007 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-870900be-d4c8-4e4a-8c85-dbebbfee9b42 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.038560 Aug 29 04:55:48.860968 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 751/1399] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 04:55:48 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:48.882914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b1aa4cd9-8d6f-4475-9c57-11612009c0f8 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:48.896965 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b1aa4cd9-8d6f-4475-9c57-11612009c0f8 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019794 Aug 29 04:55:48.898814 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 752/1400] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:55:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:48.912697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97b83b75-f06d-43d6-be1f-6e80a3821ebb tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:48.923887 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-97b83b75-f06d-43d6-be1f-6e80a3821ebb tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016386 Aug 29 04:55:48.925235 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 753/1401] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:55:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:48.941011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e89d79cf-5efd-4989-9b35-b320d1a7cec1 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:48.978795 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e89d79cf-5efd-4989-9b35-b320d1a7cec1 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.043705 Aug 29 04:55:48.980155 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 754/1402] 10.222.0.20 () {58 vars in 1165 bytes} [Mon Aug 29 04:55:48 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:49.004348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0a80174-f825-4e16-ad1d-9ad69044e591 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:49.021842 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0a80174-f825-4e16-ad1d-9ad69044e591 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023407 Aug 29 04:55:49.033651 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 755/1403] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:55:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:49.042241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-34ec6f42-c7bd-44f8-81ed-30588bab329f tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:49.082133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:49.093062 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42a551a8-0b0e-4316-b0a5-8e9ded5ed8c3 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1469 microversion: 2.1 time: 0.299594 Aug 29 04:55:49.093898 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 649/1404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:48 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:49.107461 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-34ec6f42-c7bd-44f8-81ed-30588bab329f tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.072333 Aug 29 04:55:49.113375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-02dbc8ad-b1f0-47d3-9a7a-c449de80d757 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:49.114267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-02dbc8ad-b1f0-47d3-9a7a-c449de80d757 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:49.116566 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 756/1405] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Aug 29 04:55:49 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:49.121025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02dbc8ad-b1f0-47d3-9a7a-c449de80d757 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.121675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02dbc8ad-b1f0-47d3-9a7a-c449de80d757 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.122209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02dbc8ad-b1f0-47d3-9a7a-c449de80d757 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:49.123010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02dbc8ad-b1f0-47d3-9a7a-c449de80d757 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.123560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02dbc8ad-b1f0-47d3-9a7a-c449de80d757 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.124173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02dbc8ad-b1f0-47d3-9a7a-c449de80d757 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:49.132840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f3db85fd-f114-4449-97ee-9f314bac3ebc tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:49.145661 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f3db85fd-f114-4449-97ee-9f314bac3ebc tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.016646 Aug 29 04:55:49.146490 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 757/1406] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 04:55:49 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:55:49.151466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:49.152416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:49.161978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.162703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.163291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:49.164283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.165303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.165957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:49.280396 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-02dbc8ad-b1f0-47d3-9a7a-c449de80d757 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "POST /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b/action" status: 202 len: 0 microversion: 2.1 time: 0.170465 Aug 29 04:55:49.281742 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 650/1407] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:55:49 2022] POST /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:55:49.299790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-57f24657-7ef4-4220-9bd7-127748a4035b tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:49.313520 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-57f24657-7ef4-4220-9bd7-127748a4035b tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030221 Aug 29 04:55:49.315282 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 651/1408] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:55:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:49.327696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:49.328913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:49.340926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.341995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.342708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:49.343702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.344602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.345581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:49.844628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:49.852995 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21d6526a-d16e-41fa-9f5b-c44a129c5fd1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1320 microversion: 2.1 time: 0.705349 Aug 29 04:55:49.853587 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 758/1409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:49 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1320 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:49.858955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b0ec1322-9dd5-49ed-ac17-766ab5b69318 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:49.904984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:49.926025 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0876ed0c-e4a2-4156-8c31-e5d0447dea8d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.608475 Aug 29 04:55:49.927850 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 652/1410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:49 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:49.944131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:49.945091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:49.954692 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b0ec1322-9dd5-49ed-ac17-766ab5b69318 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.099818 Aug 29 04:55:49.956621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.957191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.957714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:49.958479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.959037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.959518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:49.960621 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 759/1411] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 29 04:55:49 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:49.965665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:49.966747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:49.970536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:49.976981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.977665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.978443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:49.979370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:49.979972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:49.980568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:50.121734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:50.131450 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-748be673-7189-499d-b588-8d606b4f35eb tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1279 microversion: 2.1 time: 0.169523 Aug 29 04:55:50.152054 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 760/1412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:49 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:50.157420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-837b800e-b160-4917-9193-bb500d2d6aa6 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.170599 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-837b800e-b160-4917-9193-bb500d2d6aa6 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017065 Aug 29 04:55:50.171706 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 761/1413] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:50.185695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6cfb5f6a-3c41-4d8a-94e1-5151aee2f9db tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.208311 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6cfb5f6a-3c41-4d8a-94e1-5151aee2f9db tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.029205 Aug 29 04:55:50.209516 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 762/1414] 10.222.0.20 () {58 vars in 1144 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:50.229591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ccacfcb-d22d-4441-b352-ec45e2fe1924 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.239777 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ccacfcb-d22d-4441-b352-ec45e2fe1924 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015620 Aug 29 04:55:50.240785 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 763/1415] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:55:50.254231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f867380-8881-41fe-ad6a-d80f8f8942fa tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.271989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:50.275811 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6f867380-8881-41fe-ad6a-d80f8f8942fa tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.026688 Aug 29 04:55:50.277186 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 764/1416] 10.222.0.20 () {58 vars in 1148 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:50.281782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:50.289522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:50.290936 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f2df6271-a61e-4aeb-8296-b03bafda64bc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.361818 Aug 29 04:55:50.299806 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 653/1417] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:49 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:50.300005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3c911d56-c12f-4bf3-b6f2-87e533a6c8ee tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.311239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3c911d56-c12f-4bf3-b6f2-87e533a6c8ee tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.024625 Aug 29 04:55:50.312530 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 765/1418] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:50.330136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b79ef57d-40cd-464a-824d-471a2b003e76 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.341954 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b79ef57d-40cd-464a-824d-471a2b003e76 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016016 Aug 29 04:55:50.349788 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 654/1419] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:50.356525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68289a19-f159-4bf5-ad8b-de6c9d2c3eca tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.388988 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-68289a19-f159-4bf5-ad8b-de6c9d2c3eca tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.038037 Aug 29 04:55:50.399265 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 766/1420] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:50.403558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4851492e-fd10-4757-8939-ddfd873fead3 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.428905 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4851492e-fd10-4757-8939-ddfd873fead3 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029374 Aug 29 04:55:50.440228 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 655/1421] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:50.466576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff674f00-d8be-4664-8c90-fb66165739c2 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.481551 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff674f00-d8be-4664-8c90-fb66165739c2 tempest-FlavorsV2TestJSON-885938792 tempest-FlavorsV2TestJSON-885938792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026359 Aug 29 04:55:50.489726 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 767/1422] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:50.819224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-331048af-dfff-4804-a07b-45530d70d3db req-3618e1cb-ff03-403d-a28a-68728aa6e76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a99c1b-98ad-4d46-9be1-6d36ec32604b", "name": "network-vif-plugged", "status": "completed", "tag": "bf0358be-94b3-48f2-9869-3120396522f3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:50.837673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-331048af-dfff-4804-a07b-45530d70d3db req-3618e1cb-ff03-403d-a28a-68728aa6e76d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:50.840660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-331048af-dfff-4804-a07b-45530d70d3db req-3618e1cb-ff03-403d-a28a-68728aa6e76d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:50.842621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-331048af-dfff-4804-a07b-45530d70d3db req-3618e1cb-ff03-403d-a28a-68728aa6e76d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:50.875101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.876232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:50.877778 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-331048af-dfff-4804-a07b-45530d70d3db req-3618e1cb-ff03-403d-a28a-68728aa6e76d service nova] Creating event network-vif-plugged:bf0358be-94b3-48f2-9869-3120396522f3 for instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b on n-h2-854119-9 Aug 29 04:55:50.887198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:50.887697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:50.888183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:50.888858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:50.889340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:50.889763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:50.894411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-331048af-dfff-4804-a07b-45530d70d3db req-3618e1cb-ff03-403d-a28a-68728aa6e76d service nova] Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:55:50.908787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:50.928081 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-331048af-dfff-4804-a07b-45530d70d3db req-3618e1cb-ff03-403d-a28a-68728aa6e76d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112682 Aug 29 04:55:50.929298 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 656/1423] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:50.950285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:50.951208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:50.963034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:50.963626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:50.965056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:50.966413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:50.971774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:50.974030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.250728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:51.263580 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7c3cbdf8-9076-41f4-8926-abb5474cba32 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1470 microversion: 2.1 time: 0.393068 Aug 29 04:55:51.264352 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 768/1424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1470 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:51.274714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:51.278741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:51.291966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:51.295223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:51.296174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.298278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:51.300782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:51.301456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.440697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:51.454314 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8818313a-b19e-4922-aee5-2974ec26b415 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1279 microversion: 2.1 time: 0.187433 Aug 29 04:55:51.455616 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 769/1425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:51 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:51.461729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a480d45c-6d1f-4037-9c7f-6e10b137d2d8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:51.464021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a480d45c-6d1f-4037-9c7f-6e10b137d2d8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:51.473086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:51.481804 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b7b5e2aa-d6a9-4dd0-863a-3a02fb4ffba8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.536218 Aug 29 04:55:51.482879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a480d45c-6d1f-4037-9c7f-6e10b137d2d8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:51.483545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a480d45c-6d1f-4037-9c7f-6e10b137d2d8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:51.483979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a480d45c-6d1f-4037-9c7f-6e10b137d2d8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.484717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a480d45c-6d1f-4037-9c7f-6e10b137d2d8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:51.485166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a480d45c-6d1f-4037-9c7f-6e10b137d2d8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:51.485993 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 657/1426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:50 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:51.493732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a480d45c-6d1f-4037-9c7f-6e10b137d2d8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.528864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:51.529542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:51.542418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:51.542906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:51.546334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.548639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:51.554575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:51.555702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.652534 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a480d45c-6d1f-4037-9c7f-6e10b137d2d8 tempest-DeleteServersAdminTestJSON-264872058 tempest-DeleteServersAdminTestJSON-264872058-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84/action" status: 202 len: 0 microversion: 2.1 time: 0.195097 Aug 29 04:55:51.653497 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 770/1427] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:55:51 2022] POST /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:55:51.675780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:51.677577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:51.686055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:51.688018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:51.688653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.689583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:51.691001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:51.691597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.831690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:51.832628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:51.836396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:51.837576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lazy-loading 'fault' on Instance uuid 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:51.948074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:51.963045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:51.964584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:51.967603 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0de9ad31-3264-4719-9116-187fd270753f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.447867 Aug 29 04:55:51.970675 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 658/1428] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:51 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:52.226961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:52.240978 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8add97af-c612-4f41-b007-07b86a652ab1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1453 microversion: 2.1 time: 0.582948 Aug 29 04:55:52.242593 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 771/1429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:51 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1453 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:52.266276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:52.267391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:52.270334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:52.285533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:52.286237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:52.286737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:52.287669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:52.288307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:52.288893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:52.332268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:55:52.475608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:52.476460 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-78dd8998-1f9c-42c5-9b34-70e6c471cf34 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 204 len: 0 microversion: 2.1 time: 0.214147 Aug 29 04:55:52.477089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:52.477336 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 659/1430] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:55:52 2022] DELETE /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:55:52.487081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:52.488232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:52.494493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:52.495072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:52.495570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:52.496358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:52.496863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:52.497481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:52.500805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:52.501304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:52.501732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:52.502435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:52.502884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:52.505780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:52.542896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:52.543608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:52.544642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:52.545085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lazy-loading 'fault' on Instance uuid 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:52.870235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:52.882647 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3115c684-64b7-40d1-8d01-fc7a2e346948 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1459 microversion: 2.1 time: 0.400390 Aug 29 04:55:52.888509 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 660/1431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:52 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1459 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:52.913105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:52.914308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:52.914933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:52.919680 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07e06390-6838-4bd3-9560-b4de83341aa5 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1321 microversion: 2.1 time: 0.448658 Aug 29 04:55:52.921841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:52.922543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:52.923156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:52.924057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:52.924709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:52.925579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:52.940238 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 772/1432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:52 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:52.971561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:55:53.172594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-930061424", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:53.291473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:55:53.301509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:53.318691 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-456ccb37-c07a-4ddb-a05e-18729d0d491a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.426412 Aug 29 04:55:53.322694 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 661/1433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:52 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:53.340996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:53.342150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:53.358196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:53.360582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:53.361292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:53.364265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:53.365034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:53.365678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:53.694578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:53.714803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:53.716328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:53.717680 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b72802f8-58f4-4669-8c50-79aed13bdced tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.393802 Aug 29 04:55:53.720169 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 662/1434] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:53 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:53.726107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5708e2c7-1986-4923-9be3-ce298129cacd req-cff0f454-504d-4c96-b297-2475265ef378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5b7f5b-58d0-4534-9f54-c4a28267e57f", "tag": "922503f7-4262-491b-a394-f86645433ee4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:53.748994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5708e2c7-1986-4923-9be3-ce298129cacd req-cff0f454-504d-4c96-b297-2475265ef378 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:53.749665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5708e2c7-1986-4923-9be3-ce298129cacd req-cff0f454-504d-4c96-b297-2475265ef378 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:53.750341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5708e2c7-1986-4923-9be3-ce298129cacd req-cff0f454-504d-4c96-b297-2475265ef378 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:53.764476 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5708e2c7-1986-4923-9be3-ce298129cacd req-cff0f454-504d-4c96-b297-2475265ef378 service nova] Creating event network-changed:922503f7-4262-491b-a394-f86645433ee4 for instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f on n-h1-854119-9 Aug 29 04:55:53.773185 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5708e2c7-1986-4923-9be3-ce298129cacd req-cff0f454-504d-4c96-b297-2475265ef378 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052997 Aug 29 04:55:53.774249 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 663/1435] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:53.781602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:55:53.782614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:55:53.783946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:55:53.784535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:55:53.785109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:55:53.803835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:53.804761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:53.805368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:53.806287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:53.806909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:53.807533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:53.854579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Getting quotas for project 6baeb53030d84c5e8999a9653663ab34. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:55:53.863958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Getting quotas for user 236a9aeeb6f6493797a3c8fe6d6581d8 and project 6baeb53030d84c5e8999a9653663ab34. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:55:53.900447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:55:53.906741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:53.908322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:53.928720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:55:53.932682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:53.933293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:53.933884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:53.934824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:53.936609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:53.937317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:54.006705 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18e158ba-860f-466d-b287-d5c60a7c9971 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064143 Aug 29 04:55:54.009259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:54.009741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:54.010174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:54.010622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lazy-loading 'fault' on Instance uuid 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:54.016419 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 773/1436] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:55:54.022744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:54.023455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:54.032588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:54.033181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:54.033854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:54.048539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:54.049792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:54.050458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:54.481360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:54.489109 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5bf4417c-dd52-470c-b9a6-3c4876e568ee tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1321 microversion: 2.1 time: 0.470808 Aug 29 04:55:54.489690 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 774/1437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:54 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:54.499357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:54.508545 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f510e27e-03fe-470d-928c-24558cfc9cfa tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1459 microversion: 2.1 time: 0.606106 Aug 29 04:55:54.509317 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 664/1438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:53 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1459 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:54.523574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0358a7ea-7ce6-4d6b-921c-60636eddc3f3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:54.526035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0358a7ea-7ce6-4d6b-921c-60636eddc3f3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:54.552256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:54.553312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:54.561373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:54.562147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:54.562780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:54.565029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:54.565769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:54.566917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:54.676942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0358a7ea-7ce6-4d6b-921c-60636eddc3f3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:54.685243 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0358a7ea-7ce6-4d6b-921c-60636eddc3f3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1216 microversion: 2.1 time: 0.194513 Aug 29 04:55:54.692196 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 775/1439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:54 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1216 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:54.714174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6781e8a-4dc5-4811-bcd6-1a4d4c013e73 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:54.715061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6781e8a-4dc5-4811-bcd6-1a4d4c013e73 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:54.748721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6781e8a-4dc5-4811-bcd6-1a4d4c013e73 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:54.751064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6781e8a-4dc5-4811-bcd6-1a4d4c013e73 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:54.751730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6781e8a-4dc5-4811-bcd6-1a4d4c013e73 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:54.754531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6781e8a-4dc5-4811-bcd6-1a4d4c013e73 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:54.755244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6781e8a-4dc5-4811-bcd6-1a4d4c013e73 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:54.758860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6781e8a-4dc5-4811-bcd6-1a4d4c013e73 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:55.021147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:55.035173 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86d4262a-95be-4bf3-8b0a-64d7a5500ba0 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.508863 Aug 29 04:55:55.035754 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 665/1440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:54 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:55.040488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:55.044040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:55.059493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:55.060321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:55.061060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:55.061968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:55.062575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:55.063155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:55.086834 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6781e8a-4dc5-4811-bcd6-1a4d4c013e73 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1860 microversion: 2.1 time: 0.383492 Aug 29 04:55:55.087458 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 776/1441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:54 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1860 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:55.114050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-9", "block_migration": true, "disk_over_commit": false}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:55.121496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:55.136778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:55.137491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:55.137999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:55.138783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:55.139444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:55.141635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:55.202002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lazy-loading 'flavor' on Instance uuid d7c9b159-0dc2-4520-95ea-01bea5848a83 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:55.226501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Going to try to live migrate instance to n-h2-854119-9 {{(pid=128872) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 04:55:55.743509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:55.754226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:55.756025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:55.757595 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87be0d83-f61d-4f8c-8842-eb72ecac7168 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.720590 Aug 29 04:55:55.773389 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 666/1442] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:55 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:55.779640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:55.780393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:55.790448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:55.791170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:55.791777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:55.792529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:55.793010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:55.793429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.000113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:56.008469 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-570b5936-8374-4cd6-a651-59edd40f5d09 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1321 microversion: 2.1 time: 0.233557 Aug 29 04:55:56.009096 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 667/1443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:55 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:56.013492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:56.014100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:56.020136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.020630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.021065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.022045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.022704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.023015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.060494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.060980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.061508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.062052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lazy-loading 'fault' on Instance uuid 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:55:56.128518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730821ec74eb48ab8e474db8bbcf97b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202ee9ec794b40439b2c5aa9ab4f2dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:56.137814 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3a32d1f4-27f7-4195-89ac-3c407c83d084 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 200 len: 1417 microversion: 2.1 time: 0.127550 Aug 29 04:55:56.138486 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 668/1444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:56 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 1417 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:56.279456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5a149594-77c3-4446-a96e-a9acdd9c5c40 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Action: 'create', calling method: .version_select at 0x7f1ab9d98700>, body: {"keypair": {"name": "tempest-keypair-908197294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlazx2NOtHUq/2b2lxKTzyT0Jqv6DNsglSEOgGsRrGJjK29hl1iKHB2gFppbEJ468FeCJYczIh4jtmFbfFr+JEBjhnquyipI1htkUzBxGbzLmw6L1NhXpP59E656eV9Ew=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:56.296860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-5a149594-77c3-4446-a96e-a9acdd9c5c40 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Getting quotas for project 22dc7feeb2544557b122e2423a9ce97f. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:55:56.301874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-5a149594-77c3-4446-a96e-a9acdd9c5c40 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Getting quotas for user cd25804068a64f5fb3407c0351be09c1 and project 22dc7feeb2544557b122e2423a9ce97f. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:55:56.327212 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5a149594-77c3-4446-a96e-a9acdd9c5c40 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187267 Aug 29 04:55:56.327831 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 669/1445] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:55:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:56.332497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:56.333249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:56.344745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.345342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.346389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.347532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.348210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.348888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.430543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:56.439511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4bcef4ab-adde-4215-8784-1d0d22cd6582 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1220 microversion: 2.1 time: 0.110453 Aug 29 04:55:56.440225 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 670/1446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:56 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:56.447093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:56.447093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:56.457410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.458333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.459087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.464274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.464274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.464274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.629775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:56.638361 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-50bfa883-f5ed-4cab-ad92-269fb73e8331 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.196943 Aug 29 04:55:56.638935 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 671/1447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:56 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:56.655799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-632b1c08-6b34-409d-aafd-b259ae3f6474 req-1e61d2d1-288c-4ba0-b73b-db824234f6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb32ec9-a6a8-488a-afc8-65c5644fdc84", "name": "network-vif-deleted", "tag": "ee7e2f15-5164-48b6-9723-be810600d153"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:56.666646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-632b1c08-6b34-409d-aafd-b259ae3f6474 req-1e61d2d1-288c-4ba0-b73b-db824234f6f3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.667057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-632b1c08-6b34-409d-aafd-b259ae3f6474 req-1e61d2d1-288c-4ba0-b73b-db824234f6f3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.667586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-632b1c08-6b34-409d-aafd-b259ae3f6474 req-1e61d2d1-288c-4ba0-b73b-db824234f6f3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.681280 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-632b1c08-6b34-409d-aafd-b259ae3f6474 req-1e61d2d1-288c-4ba0-b73b-db824234f6f3 service nova] Creating event network-vif-deleted:ee7e2f15-5164-48b6-9723-be810600d153 for instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 on n-h2-854119-9 Aug 29 04:55:56.686671 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-632b1c08-6b34-409d-aafd-b259ae3f6474 req-1e61d2d1-288c-4ba0-b73b-db824234f6f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046157 Aug 29 04:55:56.687555 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 672/1448] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:55:56.785980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:56.786663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:56.793261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.794353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.794800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.795670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:56.796146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:56.796572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:56.930455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:56.939746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:56.941317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:56.942495 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-81747d6f-857f-4e86-9443-ba9c527f8522 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.161246 Aug 29 04:55:56.943307 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 673/1449] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:56 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:57.030839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:57.044230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:57.053476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.054308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.055062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.056085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.056573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.056989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.215065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:57.223891 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8af1c52c-51ca-45d2-9388-c364c9e9a1b4 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1321 microversion: 2.1 time: 0.197660 Aug 29 04:55:57.224590 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 674/1450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:57 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:55:57.249023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:57.249785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:57.257297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.258115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.258778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.259726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.260400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.261018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.279593 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] HTTP exception thrown: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Request method failure captured: Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 HTTP/1.1 Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEaf3anQTisY7pF0Eg90bQMz2w3vS7UWIsihPqLwjHqMMqImGXIh8m8G6VnPUHT6ihkhG-CjFJ_AYUIrhLAflwj-E6mdFv94v1oFGXRh6_AdF5I8t5KX_R0Za7cK_lD8kfpVXOJ51wFCZ-3WbhTQ9-Zykrqa9dOppu1wZZM40kwX9pE Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:55:57.282075 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_202ee9ec794b40439b2c5aa9ab4f2dcb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 730821ec74eb48ab8e474db8bbcf97b7 Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.283974 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8cb32ec9-a6a8-488a-afc8-65c5644fdc84'} Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:57.284972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.289840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Returning 404 to user: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:57.290838 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2928b37f-eea2-41b1-95f3-db8cb5810e19 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 404 len: 111 microversion: 2.1 time: 0.064939 Aug 29 04:55:57.296568 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 675/1451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:57 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:57.302580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:57.303379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:57.311309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.312193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.313240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.314183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.314843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.315421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.333591 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] HTTP exception thrown: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Request method failure captured: Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 HTTP/1.1 Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEaf3anQTisY7pF0Eg90bQMz2w3vS7UWIsihPqLwjHqMMqImGXIh8m8G6VnPUHT6ihkhG-CjFJ_AYUIrhLAflwj-E6mdFv94v1oFGXRh6_AdF5I8t5KX_R0Za7cK_lD8kfpVXOJ51wFCZ-3WbhTQ9-Zykrqa9dOppu1wZZM40kwX9pE Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:55:57.335530 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_202ee9ec794b40439b2c5aa9ab4f2dcb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 730821ec74eb48ab8e474db8bbcf97b7 Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.337222 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8cb32ec9-a6a8-488a-afc8-65c5644fdc84'} Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:57.338147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.339677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.342729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Returning 404 to user: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:57.343827 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee509b6e-3b93-48d1-990e-5dbc391189f1 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 404 len: 111 microversion: 2.1 time: 0.045939 Aug 29 04:55:57.347852 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 676/1452] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:55:57 2022] DELETE /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:57.354042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:57.354997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 8cb32ec9-a6a8-488a-afc8-65c5644fdc84] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:57.363225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.363980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.364627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.365637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.366300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.366894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.385934 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] HTTP exception thrown: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Request method failure captured: Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 HTTP/1.1 Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEaf3anQTisY7pF0Eg90bQMz2w3vS7UWIsihPqLwjHqMMqImGXIh8m8G6VnPUHT6ihkhG-CjFJ_AYUIrhLAflwj-E6mdFv94v1oFGXRh6_AdF5I8t5KX_R0Za7cK_lD8kfpVXOJ51wFCZ-3WbhTQ9-Zykrqa9dOppu1wZZM40kwX9pE Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:55:57.387895 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_202ee9ec794b40439b2c5aa9ab4f2dcb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 730821ec74eb48ab8e474db8bbcf97b7 Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.389724 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8cb32ec9-a6a8-488a-afc8-65c5644fdc84'} Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:57.390677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. Aug 29 04:55:57.392110 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.395900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Returning 404 to user: Instance 8cb32ec9-a6a8-488a-afc8-65c5644fdc84 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:57.397069 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1f6f0e1-2807-4fbe-a5b6-66a6c0f956f6 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84" status: 404 len: 111 microversion: 2.1 time: 0.047931 Aug 29 04:55:57.397894 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 677/1453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:57 2022] GET /compute/v2.1/servers/8cb32ec9-a6a8-488a-afc8-65c5644fdc84 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:57.410770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:57.411572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:57.420827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.421662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.422262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.423203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.423864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.424695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.441913 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] HTTP exception thrown: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Request method failure captured: Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 HTTP/1.1 Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEaf3anQTisY7pF0Eg90bQMz2w3vS7UWIsihPqLwjHqMMqImGXIh8m8G6VnPUHT6ihkhG-CjFJ_AYUIrhLAflwj-E6mdFv94v1oFGXRh6_AdF5I8t5KX_R0Za7cK_lD8kfpVXOJ51wFCZ-3WbhTQ9-Zykrqa9dOppu1wZZM40kwX9pE Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:55:57.443982 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_202ee9ec794b40439b2c5aa9ab4f2dcb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 730821ec74eb48ab8e474db8bbcf97b7 Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.445908 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7c1f871d-98e2-414a-bd84-3b0aa7d76005'} Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:57.446854 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.448311 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.456292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Returning 404 to user: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:57.457460 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be0d4294-8726-4455-9a8a-7a10d07adc54 tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 404 len: 111 microversion: 2.1 time: 0.054829 Aug 29 04:55:57.459405 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 678/1454] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:55:57 2022] DELETE /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:57.468972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:57.469909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:57.478100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.478770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.479423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.480320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.481054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.482200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.629849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:57.638432 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab0c6adb-89bf-4682-acfb-24f58d295e2a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1212 microversion: 2.1 time: 0.177664 Aug 29 04:55:57.639880 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 679/1455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:57 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1212 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:57.646089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:57.647139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] [instance: 7c1f871d-98e2-414a-bd84-3b0aa7d76005] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:57.653634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.654544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.655252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.656364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.657273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.657927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.683017 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] HTTP exception thrown: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Request method failure captured: Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 HTTP/1.1 Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEaf3anQTisY7pF0Eg90bQMz2w3vS7UWIsihPqLwjHqMMqImGXIh8m8G6VnPUHT6ihkhG-CjFJ_AYUIrhLAflwj-E6mdFv94v1oFGXRh6_AdF5I8t5KX_R0Za7cK_lD8kfpVXOJ51wFCZ-3WbhTQ9-Zykrqa9dOppu1wZZM40kwX9pE Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:55:57.689886 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_202ee9ec794b40439b2c5aa9ab4f2dcb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/202ee9ec794b40439b2c5aa9ab4f2dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 202ee9ec794b40439b2c5aa9ab4f2dcb Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-454960244 Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 730821ec74eb48ab8e474db8bbcf97b7 Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersAdminTestJSON-454960244-project Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.691225 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7c1f871d-98e2-414a-bd84-3b0aa7d76005'} Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:55:57.692064 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. Aug 29 04:55:57.693325 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:55:57.699766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] Returning 404 to user: Instance 7c1f871d-98e2-414a-bd84-3b0aa7d76005 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:55:57.701040 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c0e2eea4-2d9d-4618-b531-5f44ec6f788a tempest-DeleteServersAdminTestJSON-454960244 tempest-DeleteServersAdminTestJSON-454960244-project] 10.222.0.20 "GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005" status: 404 len: 111 microversion: 2.1 time: 0.059018 Aug 29 04:55:57.704240 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 680/1456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:57 2022] GET /compute/v2.1/servers/7c1f871d-98e2-414a-bd84-3b0aa7d76005 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:55:57.715552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:57.718923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:57.734622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.735206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.735785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:57.737034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:57.738197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:57.738786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:58.231286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:58.245377 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-618637d7-7a23-49e7-8e19-97ef5d238729 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.539180 Aug 29 04:55:58.246208 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 681/1457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:57 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:58.254438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1448760473", "imageRef": "1acf1128-bcd7-4b29-8a3e-8fc1a3a371ea", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9d3a299d-049e-4fc7-8db1-861a08b3abd1"}], "security_groups": [{"name": "tempest-securitygroup--1329231382"}], "key_name": "tempest-keypair-908197294", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:55:58.602424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] validate_networks() for [('9d3a299d-049e-4fc7-8db1-861a08b3abd1', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:55:58.856540 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-831c369e-0fa9-4671-8390-1e31a59a93c8 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/action" status: 202 len: 0 microversion: 2.1 time: 3.749862 Aug 29 04:55:58.857172 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 777/1458] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:55:55 2022] POST /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/action => generated 0 bytes in 3751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:55:58.863982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:58.865006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:58.898897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:58.900870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:58.902077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:58.904625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:58.906159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:58.907390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:59.428709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:59.438986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:59.440576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:59.442084 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b44d5102-cb85-4bf4-b3b7-1e955d0ab68f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.583080 Aug 29 04:55:59.442856 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 778/1459] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:55:58 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:55:59.447972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:59.448929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:59.456905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:59.457781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:59.458561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:59.459484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:59.460268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:59.460854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:59.874571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:55:59.887487 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef5b3c9a-1e4f-4f62-86bd-f72daa0ac7e7 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1321 microversion: 2.1 time: 0.442559 Aug 29 04:55:59.888636 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 779/1460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:59 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:55:59.914541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:55:59.915757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:55:59.928298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:59.929538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:59.930771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:55:59.931756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:55:59.932864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:55:59.933672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:00.355155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:56:00.355711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:56:00.356165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:56:00.356773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:56:00.357185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:56:00.373890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:00.375143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:00.375880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:00.377989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:00.378613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:00.379770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:00.409844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Getting quotas for project 22dc7feeb2544557b122e2423a9ce97f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:56:00.415246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Getting quotas for user cd25804068a64f5fb3407c0351be09c1 and project 22dc7feeb2544557b122e2423a9ce97f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:56:00.430449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:56:00.433829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1acf1128-bcd7-4b29-8a3e-8fc1a3a371ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:56:00.523236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:00.531411 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6afb7b44-1d53-4ec6-b641-e7fd81d0b2d6 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.283720 Aug 29 04:56:00.533778 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 682/1461] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:55:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:56:00.546560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:00.547527 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2a0b0360-ac89-406b-8cd5-a4e011e7fbff tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1316 microversion: 2.1 time: 0.657247 Aug 29 04:56:00.548475 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 780/1462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:55:59 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:00.550464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:00.560432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:00.561545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:00.562083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:00.562891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:00.564316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:00.565322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:00.569942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f57e16ec-b874-4d79-b8ac-b0b887120715 req-b012cd2a-400d-418f-a1bc-feb575b8d27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a99c1b-98ad-4d46-9be1-6d36ec32604b", "name": "network-vif-unplugged", "status": "completed", "tag": "bf0358be-94b3-48f2-9869-3120396522f3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:00.594795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f57e16ec-b874-4d79-b8ac-b0b887120715 req-b012cd2a-400d-418f-a1bc-feb575b8d27f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:00.595538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f57e16ec-b874-4d79-b8ac-b0b887120715 req-b012cd2a-400d-418f-a1bc-feb575b8d27f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:00.597758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f57e16ec-b874-4d79-b8ac-b0b887120715 req-b012cd2a-400d-418f-a1bc-feb575b8d27f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:00.635379 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f57e16ec-b874-4d79-b8ac-b0b887120715 req-b012cd2a-400d-418f-a1bc-feb575b8d27f service nova] Creating event network-vif-unplugged:bf0358be-94b3-48f2-9869-3120396522f3 for instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b on n-h1-854119-9 Aug 29 04:56:00.649609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-f57e16ec-b874-4d79-b8ac-b0b887120715 req-b012cd2a-400d-418f-a1bc-feb575b8d27f service nova] Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:56:00.675901 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f57e16ec-b874-4d79-b8ac-b0b887120715 req-b012cd2a-400d-418f-a1bc-feb575b8d27f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113592 Aug 29 04:56:00.677126 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 781/1463] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:00.685142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:00.686314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:00.694265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:00.695141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:00.695734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:00.697401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:00.698018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:00.698598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:01.054248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:01.061236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:01.064106 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-285a70ef-6b1d-4085-aec6-ca6651ab4649 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.525798 Aug 29 04:56:01.080495 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 683/1464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:00 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:01.172192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:01.180088 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9141dc7-56e3-4ebf-be81-b8cfdfc43be9 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.501526 Aug 29 04:56:01.185169 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 782/1465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:00 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:01.193580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d21b11e-0277-4df3-bcfa-580b71cd3ef4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:01.197090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d21b11e-0277-4df3-bcfa-580b71cd3ef4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:01.315738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4d21b11e-0277-4df3-bcfa-580b71cd3ef4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:01.324879 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d21b11e-0277-4df3-bcfa-580b71cd3ef4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1245 microversion: 2.1 time: 0.138366 Aug 29 04:56:01.327419 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 783/1466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:01 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1245 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:01.337080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:01.339288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:01.351864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:01.354576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:01.355049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:01.355776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:01.358641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:01.359119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:01.370423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:01.503332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:01.503943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:01.536890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:01.538530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:01.539067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:01.541229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:01.542572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:01.543736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:01.792113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:01.808969 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a653c2d-219a-4c4f-9e81-f27c92e0ff38 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1321 microversion: 2.1 time: 0.479155 Aug 29 04:56:01.810122 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 784/1467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:01 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:01.913799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:01.930817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:01.933508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:01.935251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-885178f2-d710-42d2-9bb3-d36f3d1a84b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1814 microversion: 2.25 time: 0.853676 Aug 29 04:56:01.936625 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 684/1468] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:01 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1814 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:01.955751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:01.958166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:01.971636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:01.976261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:01.976830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:01.977648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:01.978097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:01.978751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.079092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-53d07325-ff37-4098-a791-f69fec1097c7 req-3788b221-61e7-4a9a-aca3-61472a09e78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154", "tag": "39ed18ba-56f8-4c3d-a711-deebbf9109d3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:02.103022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-53d07325-ff37-4098-a791-f69fec1097c7 req-3788b221-61e7-4a9a-aca3-61472a09e78a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.103647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-53d07325-ff37-4098-a791-f69fec1097c7 req-3788b221-61e7-4a9a-aca3-61472a09e78a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.105455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-53d07325-ff37-4098-a791-f69fec1097c7 req-3788b221-61e7-4a9a-aca3-61472a09e78a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.119625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-53d07325-ff37-4098-a791-f69fec1097c7 req-3788b221-61e7-4a9a-aca3-61472a09e78a service nova] Creating event network-changed:39ed18ba-56f8-4c3d-a711-deebbf9109d3 for instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 on n-h1-854119-9 Aug 29 04:56:02.125410 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-53d07325-ff37-4098-a791-f69fec1097c7 req-3788b221-61e7-4a9a-aca3-61472a09e78a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313618 Aug 29 04:56:02.126244 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 785/1469] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:02.136262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f867bdc5-3da8-454f-aca2-5231826305b7 req-e49a9f7d-f291-48ca-ac24-36828f25f223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a99c1b-98ad-4d46-9be1-6d36ec32604b", "tag": "bf0358be-94b3-48f2-9869-3120396522f3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:02.146794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f867bdc5-3da8-454f-aca2-5231826305b7 req-e49a9f7d-f291-48ca-ac24-36828f25f223 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.147597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f867bdc5-3da8-454f-aca2-5231826305b7 req-e49a9f7d-f291-48ca-ac24-36828f25f223 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.148030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f867bdc5-3da8-454f-aca2-5231826305b7 req-e49a9f7d-f291-48ca-ac24-36828f25f223 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.163619 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f867bdc5-3da8-454f-aca2-5231826305b7 req-e49a9f7d-f291-48ca-ac24-36828f25f223 service nova] Creating event network-changed:bf0358be-94b3-48f2-9869-3120396522f3 for instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b on n-h1-854119-9 Aug 29 04:56:02.172631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-f867bdc5-3da8-454f-aca2-5231826305b7 req-e49a9f7d-f291-48ca-ac24-36828f25f223 service nova] Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 04:56:02.191296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:02.193183 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f867bdc5-3da8-454f-aca2-5231826305b7 req-e49a9f7d-f291-48ca-ac24-36828f25f223 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060729 Aug 29 04:56:02.194322 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 786/1470] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:02.200778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:02.201842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:02.204655 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b806343-fd13-4694-9a12-bd7ce882e25b tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1316 microversion: 2.1 time: 0.266470 Aug 29 04:56:02.205493 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 685/1471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:01 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:02.211981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:02.213076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:02.221805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.222569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.226368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.226368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.226368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.226368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.227988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.229105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.230439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.231034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.233871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.236970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.454572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:02.463573 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8494d1df-3c78-4594-873e-6ee650846a67 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.256870 Aug 29 04:56:02.464324 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 686/1472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:02 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:02.469639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:02.470289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:02.477697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.478234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.478803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.479533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.480184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.480613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.482451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:02.491534 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-805e4872-f741-45c8-a2ea-b60b2a2fa666 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.296005 Aug 29 04:56:02.492096 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 787/1473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:02 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:02.553324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:02.562209 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b5c45fbc-9caf-4f83-b11b-36112d5c3ca1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1297 microversion: 2.1 time: 0.096745 Aug 29 04:56:02.562797 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 687/1474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:02 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:02.624685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-443cdcf2-12db-4bfc-a17a-1b415e0964d0 tempest-FlavorsV261TestJSON-2082831330 tempest-FlavorsV261TestJSON-2082831330-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1020736933", "id": 1496107786, "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:02.646213 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-443cdcf2-12db-4bfc-a17a-1b415e0964d0 tempest-FlavorsV261TestJSON-2082831330 tempest-FlavorsV261TestJSON-2082831330-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.143523 Aug 29 04:56:02.646981 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 788/1475] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 04:56:02 2022] POST /compute/v2.1/flavors => generated 468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:02.698423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-85d40661-9905-41fe-b2a3-2e92d82395da req-d7fcdc4e-ca63-412c-8306-6324e7f0aefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5b7f5b-58d0-4534-9f54-c4a28267e57f", "name": "network-vif-plugged", "status": "completed", "tag": "922503f7-4262-491b-a394-f86645433ee4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:02.711599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-85d40661-9905-41fe-b2a3-2e92d82395da req-d7fcdc4e-ca63-412c-8306-6324e7f0aefd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.712101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-85d40661-9905-41fe-b2a3-2e92d82395da req-d7fcdc4e-ca63-412c-8306-6324e7f0aefd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.712596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-85d40661-9905-41fe-b2a3-2e92d82395da req-d7fcdc4e-ca63-412c-8306-6324e7f0aefd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.726455 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-85d40661-9905-41fe-b2a3-2e92d82395da req-d7fcdc4e-ca63-412c-8306-6324e7f0aefd service nova] Creating event network-vif-plugged:922503f7-4262-491b-a394-f86645433ee4 for instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f on n-h1-854119-9 Aug 29 04:56:02.734239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-85d40661-9905-41fe-b2a3-2e92d82395da req-d7fcdc4e-ca63-412c-8306-6324e7f0aefd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041858 Aug 29 04:56:02.734884 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 789/1476] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:02.794462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4581b2c-09fe-49f5-812c-282a9a44fa64 tempest-FlavorsV261TestJSON-1761666033 tempest-FlavorsV261TestJSON-1761666033-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:02.810817 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4581b2c-09fe-49f5-812c-282a9a44fa64 tempest-FlavorsV261TestJSON-1761666033 tempest-FlavorsV261TestJSON-1761666033-project] 10.222.0.20 "GET /compute/v2.1/flavors/1496107786" status: 200 len: 468 microversion: 2.61 time: 0.154209 Aug 29 04:56:02.812953 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 688/1477] 10.222.0.20 () {60 vars in 1199 bytes} [Mon Aug 29 04:56:02 2022] GET /compute/v2.1/flavors/1496107786 => generated 468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:02.832307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-abf692d4-6d51-4680-a590-0d791c184f3d tempest-FlavorsV261TestJSON-2082831330 tempest-FlavorsV261TestJSON-2082831330-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:02.837265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:02.838113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:02.845861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.846621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.847887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.849169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.849784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.850383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.890763 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-abf692d4-6d51-4680-a590-0d791c184f3d tempest-FlavorsV261TestJSON-2082831330 tempest-FlavorsV261TestJSON-2082831330-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1496107786" status: 200 len: 469 microversion: 2.61 time: 0.068623 Aug 29 04:56:02.891746 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 790/1478] 10.222.0.20 () {62 vars in 1219 bytes} [Mon Aug 29 04:56:02 2022] PUT /compute/v2.1/flavors/1496107786 => generated 469 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:02.912780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d810f614-25f1-4758-8593-060c7a81c5e7 tempest-FlavorsV261TestJSON-1761666033 tempest-FlavorsV261TestJSON-1761666033-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:02.953389 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d810f614-25f1-4758-8593-060c7a81c5e7 tempest-FlavorsV261TestJSON-1761666033 tempest-FlavorsV261TestJSON-1761666033-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.053001 Aug 29 04:56:02.953974 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 791/1479] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:56:02 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:56:02.973493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:02.974327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:02.982295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.982911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.983361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:02.984182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:02.985188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:02.985623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.130955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:03.141810 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ffe47ed3-9624-459d-86e7-1583df3cb34f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1321 microversion: 2.1 time: 0.308403 Aug 29 04:56:03.143097 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 689/1480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:02 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:03.155549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-db2876c1-06da-4a5b-9166-b79720193aa0 tempest-FlavorsV261TestJSON-1761666033 tempest-FlavorsV261TestJSON-1761666033-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:03.163162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:03.197453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-db2876c1-06da-4a5b-9166-b79720193aa0 tempest-FlavorsV261TestJSON-1761666033 tempest-FlavorsV261TestJSON-1761666033-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.051536 Aug 29 04:56:03.198500 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 690/1481] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 29 04:56:03 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:03.217315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-594d7d7b-5cfa-43b0-9d04-a239e6115cc6 tempest-FlavorsV261TestJSON-2082831330 tempest-FlavorsV261TestJSON-2082831330-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:03.236190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:03.244322 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-594d7d7b-5cfa-43b0-9d04-a239e6115cc6 tempest-FlavorsV261TestJSON-2082831330 tempest-FlavorsV261TestJSON-2082831330-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1496107786" status: 202 len: 0 microversion: 2.61 time: 0.031051 Aug 29 04:56:03.244967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:03.246391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:03.248320 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 691/1482] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Aug 29 04:56:03 2022] DELETE /compute/v2.1/flavors/1496107786 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:56:03.250281 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-32a51110-6595-4ebd-ae21-a4b3f0702640 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1804 microversion: 2.25 time: 0.280822 Aug 29 04:56:03.252854 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 792/1483] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:02 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1804 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:03.259470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:03.260091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:03.265917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c3cd259d-c4a9-458e-80a8-4b61b4fe8806 tempest-FlavorsV261TestJSON-2082831330 tempest-FlavorsV261TestJSON-2082831330-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:03.271881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:03.272422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:03.272855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.273757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:03.274371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:03.274953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.293516 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c3cd259d-c4a9-458e-80a8-4b61b4fe8806 tempest-FlavorsV261TestJSON-2082831330 tempest-FlavorsV261TestJSON-2082831330-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.035901 Aug 29 04:56:03.307985 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 793/1484] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:56:03 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:03.319082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cb2e20e3-097e-4087-bff8-1a2cf284e4a0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '.version_select at 0x7f1abd946dc0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:03.324355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb2e20e3-097e-4087-bff8-1a2cf284e4a0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:03.325889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb2e20e3-097e-4087-bff8-1a2cf284e4a0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:03.327153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb2e20e3-097e-4087-bff8-1a2cf284e4a0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.343533 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cb2e20e3-097e-4087-bff8-1a2cf284e4a0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 4714 microversion: 2.25 time: 0.033958 Aug 29 04:56:03.344584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 794/1485] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Aug 29 04:56:03 2022] GET /compute/v2.1/os-migrations => generated 4714 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:03.365105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:03.365797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:03.374847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:03.375968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:03.377696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.378578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:03.379219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:03.379798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.562041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:03.592070 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4606ddfc-9cce-461f-b0b1-4bcfbd8aaacd tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1316 microversion: 2.1 time: 0.341867 Aug 29 04:56:03.600744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 1b14f0ef-853d-4876-888d-045a86ffd64a {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:56:03.606349 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 692/1486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:03 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:03.613484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:03.614104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:03.618432 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-95c534b5-84a2-4fdc-a566-83ce441638a3 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 2422 microversion: 2.25 time: 0.260859 Aug 29 04:56:03.619258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 795/1487] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:03 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 2422 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:56:03.635086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:03.635710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:03.636169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.636892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:03.637349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:03.637774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.638373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:03.639225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:03.641484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:03.659164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:03.661168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:03.662491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.664908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:03.666504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:03.668088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:03.816647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:04.005955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:04.014968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:04.023831 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-52447ee0-1e0e-416a-882d-69f84dcfbe15 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.403223 Aug 29 04:56:04.025565 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd000268-1817-4244-9855-a16e447061d8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.417910 Aug 29 04:56:04.041353 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 796/1488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:03 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:04.042216 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 693/1489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:03 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:04.047475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:04.047772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:04.048561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:04.048813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:04.057258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:04.057911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:04.058330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:04.058471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:04.058892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:04.059552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:04.059853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:04.060495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:04.061260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:04.062834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:04.063687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:04.064554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:04.668718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 1b14f0ef-853d-4876-888d-045a86ffd64a {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:56:04.696723 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-96bdc674-9110-4df8-bba0-e9b804e14ced tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 2422 microversion: 2.25 time: 0.652979 Aug 29 04:56:04.697765 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 694/1490] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:04 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 2422 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:04.718723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:04.721588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:04.737458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:04.738444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:04.739097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:04.739978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:04.740549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:04.741063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:04.982690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:05.007571 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9ab53ad3-0ccb-4193-b7fe-c2ca6d03824a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.963198 Aug 29 04:56:05.009699 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 797/1491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:04 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:05.030972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:05.032745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:05.052734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:05.053679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:05.054784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:05.055876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:05.056692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:05.057393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:05.202763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:05.220267 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3bf0b30b-7447-437d-ac86-035e8ed5368b tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1321 microversion: 2.1 time: 0.519416 Aug 29 04:56:05.222714 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 695/1492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:04 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:05.229310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:05.230074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:05.239292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:05.241410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:05.242224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:05.243283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:05.244288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:05.245084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:05.417886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:05.438979 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea22e530-7087-4c96-b9ca-0b7ac928eb8e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1316 microversion: 2.1 time: 0.427332 Aug 29 04:56:05.456560 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 798/1493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:05 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:05.474783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:05.475084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lazy-loading 'services' on Instance uuid 1b14f0ef-853d-4876-888d-045a86ffd64a {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:56:05.479478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:05.506856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:05.507669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:05.509260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:05.512713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:05.513272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:05.513895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:05.748393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f920ecd5-4304-4b2c-a379-790acae9bd5d tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments/3f33be1d-6cfe-40ea-aeb5-e9a74ca12685" status: 202 len: 0 microversion: 2.25 time: 0.514987 Aug 29 04:56:05.750836 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 696/1494] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Aug 29 04:56:05 2022] DELETE /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments/3f33be1d-6cfe-40ea-aeb5-e9a74ca12685 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:56:05.793940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:05.794697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:05.813797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:05.814734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:05.815175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:05.815927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:05.816399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:05.816823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:05.951003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:05.969692 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b23c03c9-7d8d-4a2f-a89a-b6e8d7293ae2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.510387 Aug 29 04:56:06.008542 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 799/1495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:05 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:06.015442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3434dc2b-14d5-49bc-87e7-3c7349ecbad3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:06.029593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3434dc2b-14d5-49bc-87e7-3c7349ecbad3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:06.045875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3434dc2b-14d5-49bc-87e7-3c7349ecbad3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:06.055339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3434dc2b-14d5-49bc-87e7-3c7349ecbad3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:06.055790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3434dc2b-14d5-49bc-87e7-3c7349ecbad3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:06.060255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3434dc2b-14d5-49bc-87e7-3c7349ecbad3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:06.061256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3434dc2b-14d5-49bc-87e7-3c7349ecbad3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:06.061695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3434dc2b-14d5-49bc-87e7-3c7349ecbad3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:06.109124 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3434dc2b-14d5-49bc-87e7-3c7349ecbad3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098032 Aug 29 04:56:06.120739 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 800/1496] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:06 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:06.133398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:06.133895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:06.134386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:06.144215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af1ac5f8-c6d7-46ea-9774-3d41ded0364a tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.388564 Aug 29 04:56:06.144474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:06.145123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:06.145933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:06.147163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:06.147771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:06.148371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:06.158092 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 697/1497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:05 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:06.164204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-27f0a830-4dbc-425a-b9bd-778a5316b46c req-e94d68b7-8af2-4498-9d92-4b07478ea4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e3b162-b20c-46a9-9839-dca9a18ce982", "tag": "a062dfc6-5a22-4087-960a-ef508765cdb8"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:06.174971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-27f0a830-4dbc-425a-b9bd-778a5316b46c req-e94d68b7-8af2-4498-9d92-4b07478ea4bc service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:06.175865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-27f0a830-4dbc-425a-b9bd-778a5316b46c req-e94d68b7-8af2-4498-9d92-4b07478ea4bc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:06.176544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-27f0a830-4dbc-425a-b9bd-778a5316b46c req-e94d68b7-8af2-4498-9d92-4b07478ea4bc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:06.190384 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-27f0a830-4dbc-425a-b9bd-778a5316b46c req-e94d68b7-8af2-4498-9d92-4b07478ea4bc service nova] Creating event network-changed:a062dfc6-5a22-4087-960a-ef508765cdb8 for instance f1e3b162-b20c-46a9-9839-dca9a18ce982 on n-h2-854119-9 Aug 29 04:56:06.196661 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-27f0a830-4dbc-425a-b9bd-778a5316b46c req-e94d68b7-8af2-4498-9d92-4b07478ea4bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037016 Aug 29 04:56:06.197957 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 698/1498] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:06.246068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:06.247997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:06.259286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:06.260383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:06.261193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:06.262443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:06.264613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:06.265850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:06.460928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:06.479065 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-107c3ef9-1201-4930-aad7-d58239e122c8 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.356731 Aug 29 04:56:06.480866 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 801/1499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:06 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:06.493732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:06.495793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:06.508253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:06.509085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:06.510420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:06.515083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:06.515842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:06.516500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:06.657481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:06.667716 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fef6ec3b-9ab5-4a04-b26f-a97b1c3beed2 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1321 microversion: 2.1 time: 0.428373 Aug 29 04:56:06.668801 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 699/1500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:06 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:06.775174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:06.787230 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aeca1254-db2a-420d-be1d-45fba5700d95 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1316 microversion: 2.1 time: 0.305038 Aug 29 04:56:06.787853 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 802/1501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:06 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:06.999605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:07.000275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:07.018811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.019773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.023751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.027963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.028569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.029080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.151000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-684f41af-894d-4c1e-8ec3-d0041bc31b95 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:07.160380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-684f41af-894d-4c1e-8ec3-d0041bc31b95 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:07.172436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-684f41af-894d-4c1e-8ec3-d0041bc31b95 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.182380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-684f41af-894d-4c1e-8ec3-d0041bc31b95 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.187639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-684f41af-894d-4c1e-8ec3-d0041bc31b95 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.191215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-684f41af-894d-4c1e-8ec3-d0041bc31b95 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.194822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-684f41af-894d-4c1e-8ec3-d0041bc31b95 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.237265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-684f41af-894d-4c1e-8ec3-d0041bc31b95 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.329401 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-684f41af-894d-4c1e-8ec3-d0041bc31b95 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.202508 Aug 29 04:56:07.337087 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 803/1502] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:07 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:07.342413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:07.347355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:07.360234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.360738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.361172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.361880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.362333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.362758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.365024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:07.382123 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a09bff41-7d0c-43f9-86d3-1b76ff00430e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.392377 Aug 29 04:56:07.383133 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 700/1503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:06 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:07.503113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:07.504235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:07.520966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.523288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.525334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.526140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.528588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.529115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.626607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:07.634710 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f3947a1e-7eb0-4c0a-9131-36ea281ef03f tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.296266 Aug 29 04:56:07.635292 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 804/1504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:07 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:07.689810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:07.690426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:07.693634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:07.702641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b917943f-6721-47cf-bf3d-14a0017176d7 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.203243 Aug 29 04:56:07.703476 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 701/1505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:07 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:07.703931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.704444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.705081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.705959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.706551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.707113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.813203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:07.813934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:07.823416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.824670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.826076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:07.827371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:07.828088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:07.834495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.306644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:08.332800 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2fdd0048-b6eb-4029-9bd9-ba9d9f2969ea tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1471 microversion: 2.1 time: 0.641361 Aug 29 04:56:08.333920 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 805/1506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:07 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1471 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:08.353863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-48012a38-6b9a-45f3-8e8b-cac6f7f045ec tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:08.355994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:08.357026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-48012a38-6b9a-45f3-8e8b-cac6f7f045ec tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:08.363791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48012a38-6b9a-45f3-8e8b-cac6f7f045ec tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.364632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48012a38-6b9a-45f3-8e8b-cac6f7f045ec tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.365303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48012a38-6b9a-45f3-8e8b-cac6f7f045ec tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.366230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48012a38-6b9a-45f3-8e8b-cac6f7f045ec tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.366782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48012a38-6b9a-45f3-8e8b-cac6f7f045ec tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.367676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48012a38-6b9a-45f3-8e8b-cac6f7f045ec tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.368578 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ceaea825-1034-4673-812c-1117cfee79fa tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1316 microversion: 2.1 time: 0.559530 Aug 29 04:56:08.375295 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 702/1507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:07 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:08.380047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:08.381062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:08.400006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:08.410127 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-48012a38-6b9a-45f3-8e8b-cac6f7f045ec tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060358 Aug 29 04:56:08.415506 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 806/1508] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:08 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:08.417323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:08.418039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:08.425145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.425551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.425699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.426063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.426244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.426748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.426869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.427212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.427631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.427750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.428298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.428792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.441037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:08.469802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lazy-loading 'flavor' on Instance uuid 7f5b7f5b-58d0-4534-9f54-c4a28267e57f {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:56:08.563859 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c0614e17-a93d-46de-99ea-7583ad8dcecd tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f/action" status: 202 len: 0 microversion: 2.1 time: 0.187351 Aug 29 04:56:08.564637 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 703/1509] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:56:08 2022] POST /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:56:08.574417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f607022-2b64-4f01-8e92-8fe57eaf17b9 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:08.576002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0f607022-2b64-4f01-8e92-8fe57eaf17b9 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:08.586028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f607022-2b64-4f01-8e92-8fe57eaf17b9 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.586891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f607022-2b64-4f01-8e92-8fe57eaf17b9 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.587570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f607022-2b64-4f01-8e92-8fe57eaf17b9 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.588518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f607022-2b64-4f01-8e92-8fe57eaf17b9 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.589049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f607022-2b64-4f01-8e92-8fe57eaf17b9 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.589464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f607022-2b64-4f01-8e92-8fe57eaf17b9 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.625279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:08.636296 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9491db8b-75f2-409b-85d8-2215aef4cd77 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.222879 Aug 29 04:56:08.637382 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 807/1510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:08 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:08.657542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:08.661316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:08.676072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.678365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.679052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.681635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.682105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.682536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.926470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:08.948439 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-66d72ce0-aee9-42ec-8344-66d78aaf49e8 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.294951 Aug 29 04:56:08.953074 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 808/1511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:08 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:08.969568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:08.971273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:08.987877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.989305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.991336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:08.993217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:08.994239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:08.996744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.049428 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f607022-2b64-4f01-8e92-8fe57eaf17b9 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1630 microversion: 2.1 time: 0.479975 Aug 29 04:56:09.052169 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 704/1512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:08 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1630 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:09.203904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:09.211875 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae9d4e8b-04a0-435d-895c-5217041d3000 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.257331 Aug 29 04:56:09.212719 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 809/1513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:08 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:09.272281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Calling method '.version_select at 0x7f1ab9d0edc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:09.274036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.274513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.275008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.294778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.295594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.296100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.307179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.307545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.308203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.314616 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cfa4c9d8-409e-4ba1-ac51-e465a2a7e759 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.196703 Aug 29 04:56:09.315401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 705/1514] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 04:56:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:09.325772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11c0cf3f-6b45-4a24-81af-ce4fa09ee985 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Calling method '.version_select at 0x7f1ab91c5ee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:09.327952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11c0cf3f-6b45-4a24-81af-ce4fa09ee985 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.328661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11c0cf3f-6b45-4a24-81af-ce4fa09ee985 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.329101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11c0cf3f-6b45-4a24-81af-ce4fa09ee985 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.345798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11c0cf3f-6b45-4a24-81af-ce4fa09ee985 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.346276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11c0cf3f-6b45-4a24-81af-ce4fa09ee985 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.346699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11c0cf3f-6b45-4a24-81af-ce4fa09ee985 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.353089 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11c0cf3f-6b45-4a24-81af-ce4fa09ee985 tempest-HypervisorAdminV228Test-189282647 tempest-HypervisorAdminV228Test-189282647-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.031024 Aug 29 04:56:09.353665 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 810/1515] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 04:56:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:09.392067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:09.393598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:09.404155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.404728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.405183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.405834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.406288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.406718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.427377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0a8c6742-bc38-41b0-a05d-7ad2ae42d22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:09.429803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0a8c6742-bc38-41b0-a05d-7ad2ae42d22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:09.439294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a8c6742-bc38-41b0-a05d-7ad2ae42d22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.441095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a8c6742-bc38-41b0-a05d-7ad2ae42d22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.443423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a8c6742-bc38-41b0-a05d-7ad2ae42d22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.444469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a8c6742-bc38-41b0-a05d-7ad2ae42d22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.446867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a8c6742-bc38-41b0-a05d-7ad2ae42d22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.447515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a8c6742-bc38-41b0-a05d-7ad2ae42d22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.484727 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0a8c6742-bc38-41b0-a05d-7ad2ae42d22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065365 Aug 29 04:56:09.485892 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 811/1516] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:09 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 04:56:09.574215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:09.584626 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9298493e-4bc4-42d9-8df0-45d747c53140 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1316 microversion: 2.1 time: 0.197137 Aug 29 04:56:09.585222 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 706/1517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:09 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:09.659934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:09.661608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:09.681975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-29bef8ba-da95-4fbf-9e44-b03229f0a3b7 req-8a8a8330-7fe4-482e-8805-f5ca07ddcb68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154", "name": "network-vif-plugged", "status": "completed", "tag": "39ed18ba-56f8-4c3d-a711-deebbf9109d3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:09.700230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.702621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.704094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.706515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.712257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.712257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.713621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-29bef8ba-da95-4fbf-9e44-b03229f0a3b7 req-8a8a8330-7fe4-482e-8805-f5ca07ddcb68 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.717720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-29bef8ba-da95-4fbf-9e44-b03229f0a3b7 req-8a8a8330-7fe4-482e-8805-f5ca07ddcb68 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:09.718156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-29bef8ba-da95-4fbf-9e44-b03229f0a3b7 req-8a8a8330-7fe4-482e-8805-f5ca07ddcb68 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:09.730922 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-29bef8ba-da95-4fbf-9e44-b03229f0a3b7 req-8a8a8330-7fe4-482e-8805-f5ca07ddcb68 service nova] Creating event network-vif-plugged:39ed18ba-56f8-4c3d-a711-deebbf9109d3 for instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 on n-h1-854119-9 Aug 29 04:56:09.735934 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-29bef8ba-da95-4fbf-9e44-b03229f0a3b7 req-8a8a8330-7fe4-482e-8805-f5ca07ddcb68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061864 Aug 29 04:56:09.736605 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 707/1518] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:09.973812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:09.975140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:09.995955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:09.997867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.000654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.001610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:10.004029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.004521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.342522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:10.356626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9fe787d-6a07-48bd-ba38-29e5766f1ccf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.701640 Aug 29 04:56:10.362200 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 812/1519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:09 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:10.377066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2d4c88a-32c0-4d28-93f1-e5b7d07e4419 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:10.378025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d2d4c88a-32c0-4d28-93f1-e5b7d07e4419 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:10.392579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2d4c88a-32c0-4d28-93f1-e5b7d07e4419 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:10.393635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2d4c88a-32c0-4d28-93f1-e5b7d07e4419 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.394476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2d4c88a-32c0-4d28-93f1-e5b7d07e4419 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.395471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2d4c88a-32c0-4d28-93f1-e5b7d07e4419 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:10.396111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2d4c88a-32c0-4d28-93f1-e5b7d07e4419 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.396825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2d4c88a-32c0-4d28-93f1-e5b7d07e4419 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.397626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:10.422822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=10 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:10.572604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:10.585855 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f17f8923-dece-4d3b-9be2-bc168b7ac534 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1468 microversion: 2.1 time: 0.618625 Aug 29 04:56:10.592767 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 708/1520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:09 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1468 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:10.603767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:10.604757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:10.618943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:10.619688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.620343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.621347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:10.621952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.625318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.723551 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2d4c88a-32c0-4d28-93f1-e5b7d07e4419 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1630 microversion: 2.1 time: 0.358743 Aug 29 04:56:10.725254 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 813/1521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:10 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1630 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:10.732438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f77d295c-062c-46ee-9662-9582bd87677b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:10.749454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f77d295c-062c-46ee-9662-9582bd87677b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:10.776795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f77d295c-062c-46ee-9662-9582bd87677b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:10.777610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f77d295c-062c-46ee-9662-9582bd87677b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.780557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f77d295c-062c-46ee-9662-9582bd87677b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.782026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f77d295c-062c-46ee-9662-9582bd87677b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:10.782656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f77d295c-062c-46ee-9662-9582bd87677b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.789281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f77d295c-062c-46ee-9662-9582bd87677b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.863603 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f77d295c-062c-46ee-9662-9582bd87677b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134763 Aug 29 04:56:10.868015 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 814/1522] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:10 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:10.882200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:10.883494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:10.891387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:10.892113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.892721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.893780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:10.894238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:10.894664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:10.942778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:10.982376 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9c35bd81-020a-49cc-bf6c-f135adba8e4f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.388067 Aug 29 04:56:10.989488 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 709/1523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:10 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:11.138919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:11.149968 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f4886f69-e68b-41fb-bf97-24a626ea50b3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1316 microversion: 2.1 time: 0.272703 Aug 29 04:56:11.150936 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 815/1524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:10 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:11.385671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:11.386899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:11.411451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:11.414647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:11.417281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:11.419154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:11.421134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:11.422698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:11.606729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:11.607951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:11.610592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=18 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:11.618056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:11.618768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:11.619368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:11.621059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:11.621725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:11.622308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:11.743863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:11.761993 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e335cb79-ef71-4a65-ac4f-63e693287455 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.379481 Aug 29 04:56:11.763002 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 710/1525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:11 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:11.770757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed472de9-9ad3-4cb2-a040-0d35fb0fa036 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:11.776660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed472de9-9ad3-4cb2-a040-0d35fb0fa036 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:11.789622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed472de9-9ad3-4cb2-a040-0d35fb0fa036 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:11.790424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed472de9-9ad3-4cb2-a040-0d35fb0fa036 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:11.811717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed472de9-9ad3-4cb2-a040-0d35fb0fa036 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:11.820380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed472de9-9ad3-4cb2-a040-0d35fb0fa036 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:11.822246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed472de9-9ad3-4cb2-a040-0d35fb0fa036 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:11.823575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed472de9-9ad3-4cb2-a040-0d35fb0fa036 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:11.910032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:11.940944 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8cdc88fe-d622-4789-b6d0-e4c102e7a396 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1461 microversion: 2.1 time: 0.336083 Aug 29 04:56:11.943177 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 816/1526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:11 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1461 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:11.964704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4cf8e4d-1988-4900-8aa2-0aed2dbc49ef tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:11.970792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a4cf8e4d-1988-4900-8aa2-0aed2dbc49ef tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:11.985735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4cf8e4d-1988-4900-8aa2-0aed2dbc49ef tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:11.986333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4cf8e4d-1988-4900-8aa2-0aed2dbc49ef tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:11.986848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4cf8e4d-1988-4900-8aa2-0aed2dbc49ef tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:11.989569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4cf8e4d-1988-4900-8aa2-0aed2dbc49ef tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:11.990134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4cf8e4d-1988-4900-8aa2-0aed2dbc49ef tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:11.991347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4cf8e4d-1988-4900-8aa2-0aed2dbc49ef tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:12.062779 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed472de9-9ad3-4cb2-a040-0d35fb0fa036 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1613 microversion: 2.1 time: 0.298386 Aug 29 04:56:12.068374 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 711/1527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:11 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1613 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:12.076869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9e75da64-5596-4e23-8209-993d47e6d61e tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:12.077864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9e75da64-5596-4e23-8209-993d47e6d61e tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:12.092656 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a4cf8e4d-1988-4900-8aa2-0aed2dbc49ef tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.145853 Aug 29 04:56:12.093555 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 817/1528] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:11 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:12.096486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e75da64-5596-4e23-8209-993d47e6d61e tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:12.098750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e75da64-5596-4e23-8209-993d47e6d61e tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:12.100552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e75da64-5596-4e23-8209-993d47e6d61e tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:12.101461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e75da64-5596-4e23-8209-993d47e6d61e tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:12.102063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:12.102744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:12.102920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e75da64-5596-4e23-8209-993d47e6d61e tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:12.103510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e75da64-5596-4e23-8209-993d47e6d61e tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:12.117817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:12.130465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:12.133043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:12.134016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:12.136637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:12.138594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:12.515490 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9e75da64-5596-4e23-8209-993d47e6d61e tempest-MigrationsAdminTest-1168929290 tempest-MigrationsAdminTest-1168929290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1612 microversion: 2.1 time: 0.440115 Aug 29 04:56:12.516150 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 712/1529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:12 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1612 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:12.551170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:12.553587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:12.578518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:12.584827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:12.586605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:12.589206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:12.589854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:12.591573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:12.641247 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] HTTP exception thrown: Cannot 'migrate' instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f while it is in vm_state suspended Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Request method failure captured: Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f/action HTTP/1.1 Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 15 Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEa4sjQU8I_KA4zd-GO7r4sitoXKeNp7jVGk82hooXHsD_EXlvVpknsjZm2idS-uIHRyQyNqRxtJO4xJDhH5TNDH5BikPyhGLWrGgdjN5r_ZpeKEffhV8sIompojQUajqZgITB4JVcuYPAZOxOLyd_RtZuoTlrrZ-7N9E3R7WktoyI8 Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:12.643265 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/340a103dd945426ab147d43d47858150"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_340a103dd945426ab147d43d47858150", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 31642a313b6b433d867fb2b051497d9d Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: {"migrate": {}} Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:12.644924 n-d-854119-9 devstack@n-api.service[128871]: exception: Cannot 'migrate' instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f while it is in vm_state suspended Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7f5b7f5b-58d0-4534-9f54-c4a28267e57f', 'body': {'migrate': {}}} Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f in vm_state suspended. Cannot resize while the instance is in this state. Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:12.645937 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f while it is in vm_state suspended Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:12.647465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:12.649241 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:12.649241 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:12.649241 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f while it is in vm_state suspended Aug 29 04:56:12.649241 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:12.650745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Returning 409 to user: Cannot 'migrate' instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f while it is in vm_state suspended {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:12.651946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b0e3d7ae-5d2e-48fb-8276-bf4aadb54fde tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f/action" status: 409 len: 148 microversion: 2.1 time: 0.128551 Aug 29 04:56:12.653013 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 713/1530] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:56:12 2022] POST /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f/action => generated 148 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:56:12.663269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:12.664295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:12.674134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:12.674812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:12.675433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:12.676367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:12.677000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:12.677576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.088448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:13.104102 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-269de988-1146-4ca2-ade0-8bd0c57f56a4 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 1.009556 Aug 29 04:56:13.105400 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 818/1531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:12 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:13.115652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:13.121210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:13.129690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:13.157404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.158123 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f7eaa73-bb3e-4cb2-866e-125cd799c148 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1316 microversion: 2.1 time: 0.494073 Aug 29 04:56:13.158972 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 714/1532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:12 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:13.159746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.165258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.166247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.166884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.167463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.171569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6bd3ec2e-50d4-4a11-8791-12231bf623f7 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6bd3ec2e-50d4-4a11-8791-12231bf623f7 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Request method failure captured: Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a/action HTTP/1.1 Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 39 Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEa4sjQU8I_KA4zd-GO7r4sitoXKeNp7jVGk82hooXHsD_EXlvVpknsjZm2idS-uIHRyQyNqRxtJO4xJDhH5TNDH5BikPyhGLWrGgdjN5r_ZpeKEffhV8sIompojQUajqZgITB4JVcuYPAZOxOLyd_RtZuoTlrrZ-7N9E3R7WktoyI8 Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:13.179377 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/340a103dd945426ab147d43d47858150"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_340a103dd945426ab147d43d47858150", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 31642a313b6b433d867fb2b051497d9d Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: {"os-resetState": {"state": "invalid"}} Aug 29 04:56:13.181995 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:13.183145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:56:13.190614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 04:56:13.193214 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.198510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6bd3ec2e-50d4-4a11-8791-12231bf623f7 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:13.201772 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6bd3ec2e-50d4-4a11-8791-12231bf623f7 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a/action" status: 400 len: 144 microversion: 2.1 time: 0.038520 Aug 29 04:56:13.206789 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 715/1533] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:56:13 2022] POST /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a/action => generated 144 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:56:13.225003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:13.225616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:13.260399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.261247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.261787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.262530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.262986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.263407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.272766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:56:13.519584 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-673f67ed-c449-418f-90c8-de15fd0a277d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 204 len: 0 microversion: 2.1 time: 0.412282 Aug 29 04:56:13.520501 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 819/1534] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:56:13 2022] DELETE /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:56:13.533631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a83581e-c33f-4d18-a69f-a1a4c5889db2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:13.536933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a83581e-c33f-4d18-a69f-a1a4c5889db2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:13.559027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a83581e-c33f-4d18-a69f-a1a4c5889db2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.559524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a83581e-c33f-4d18-a69f-a1a4c5889db2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.560097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a83581e-c33f-4d18-a69f-a1a4c5889db2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.562469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a83581e-c33f-4d18-a69f-a1a4c5889db2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.563142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a83581e-c33f-4d18-a69f-a1a4c5889db2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.563915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a83581e-c33f-4d18-a69f-a1a4c5889db2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.607609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:13.625438 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b9a49b5d-10c5-4dca-98ba-e8a0433dc01e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.411516 Aug 29 04:56:13.626593 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 716/1535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:13 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:13.631864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-288faa1e-5921-4d17-98fe-3588f92e4a33 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-288faa1e-5921-4d17-98fe-3588f92e4a33 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Request method failure captured: Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a/action HTTP/1.1 Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 31 Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEa4sjQU8I_KA4zd-GO7r4sitoXKeNp7jVGk82hooXHsD_EXlvVpknsjZm2idS-uIHRyQyNqRxtJO4xJDhH5TNDH5BikPyhGLWrGgdjN5r_ZpeKEffhV8sIompojQUajqZgITB4JVcuYPAZOxOLyd_RtZuoTlrrZ-7N9E3R7WktoyI8 Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:13.636210 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/340a103dd945426ab147d43d47858150"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_340a103dd945426ab147d43d47858150", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 31642a313b6b433d867fb2b051497d9d Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: {"os-resetState": {"state": 1}} Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:13.637819 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a', 'body': {'os-resetState': {'state': 1}}} Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 1 Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:13.638974 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 04:56:13.640665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.643011 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a83581e-c33f-4d18-a69f-a1a4c5889db2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.121034 Aug 29 04:56:13.643172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-288faa1e-5921-4d17-98fe-3588f92e4a33 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:13.643632 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 820/1536] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:13 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:13.644616 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-288faa1e-5921-4d17-98fe-3588f92e4a33 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a/action" status: 400 len: 120 microversion: 2.1 time: 0.016607 Aug 29 04:56:13.645168 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 717/1537] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:56:13 2022] POST /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:56:13.655384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-21770122-42fb-44a5-bbea-7b586563d501 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:13.657273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:13.657921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:13.658464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-21770122-42fb-44a5-bbea-7b586563d501 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Failed to fetch instance by id 999 {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 04:56:13.659177 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-21770122-42fb-44a5-bbea-7b586563d501 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 29 04:56:13.664735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-21770122-42fb-44a5-bbea-7b586563d501 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Request method failure captured: Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 37 Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEa4sjQU8I_KA4zd-GO7r4sitoXKeNp7jVGk82hooXHsD_EXlvVpknsjZm2idS-uIHRyQyNqRxtJO4xJDhH5TNDH5BikPyhGLWrGgdjN5r_ZpeKEffhV8sIompojQUajqZgITB4JVcuYPAZOxOLyd_RtZuoTlrrZ-7N9E3R7WktoyI8 Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:13.664963 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/340a103dd945426ab147d43d47858150"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_340a103dd945426ab147d43d47858150", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340a103dd945426ab147d43d47858150"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 340a103dd945426ab147d43d47858150 Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-367700458 Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 31642a313b6b433d867fb2b051497d9d Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-367700458-project-admin Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: {"os-resetState": {"state": "error"}} Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:13.666583 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 999 could not be found. Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:13.667586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 04:56:13.669752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:13.671979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.671979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.671979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.671979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.672647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.672827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-21770122-42fb-44a5-bbea-7b586563d501 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:13.675746 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-21770122-42fb-44a5-bbea-7b586563d501 tempest-ServersAdminNegativeTestJSON-367700458 tempest-ServersAdminNegativeTestJSON-367700458-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.021339 Aug 29 04:56:13.676782 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 718/1538] 10.222.0.20 () {60 vars in 1179 bytes} [Mon Aug 29 04:56:13 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:56:13.688750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:13.689416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:13.698020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.698883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.700078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.701071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.702608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.703244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.743001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:56:13.856741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:13.867351 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f3497f68-f118-4d26-a5ef-cdd758deee93 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1467 microversion: 2.1 time: 0.216153 Aug 29 04:56:13.869075 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 821/1539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:13 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1467 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:13.880671 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2fa1bd3-32d4-4afc-9446-aa6a3a6f4e32 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 204 len: 0 microversion: 2.1 time: 0.198593 Aug 29 04:56:13.881717 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 719/1540] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:56:13 2022] DELETE /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:56:13.889803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:13.890646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:13.903996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.904940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.905585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.906273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:13.906760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:13.907438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:13.921557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:14.075044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:14.088075 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab0e9e8c-7fea-4473-ae1d-e1032a0b2f45 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1468 microversion: 2.1 time: 0.202343 Aug 29 04:56:14.097931 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 822/1541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:13 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1468 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:14.131253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:14.131959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:14.138357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.138914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.139352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.140054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.140559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.140981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.164398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:14.184405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:14.185382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:14.200907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.202067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.202970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.204014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.204737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.205381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.345590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:14.361398 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4544d783-13d5-4edb-bab2-d7b437d5c7bf tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.235311 Aug 29 04:56:14.368298 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 720/1542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:14 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:14.446233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:14.478456 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5ab26f9e-e82b-4fc4-8262-ddd028e47c0e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1466 microversion: 2.1 time: 0.297940 Aug 29 04:56:14.479867 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 823/1543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:14 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1466 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:14.505976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1454579961", "metadata": {"image_type": "test"}}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:14.509455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:14.519657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.520563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.521647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.522966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.523611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.524480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.582621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Getting quotas for project 6baeb53030d84c5e8999a9653663ab34. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:56:14.589128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Getting quotas for user 236a9aeeb6f6493797a3c8fe6d6581d8 and project 6baeb53030d84c5e8999a9653663ab34. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:56:14.779216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6dff04ef-e43c-43c2-a535-ed7fd89c5c7a tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Calling method '.version_select at 0x7f1abd849310>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:14.781481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6dff04ef-e43c-43c2-a535-ed7fd89c5c7a tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '76c08502a5ca4964906076a9206a9c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f6eee58ae4b10b9800757f8bf5879', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6dff04ef-e43c-43c2-a535-ed7fd89c5c7a tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Request method failure captured: Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEbtALEHGXdYrX5qDCjcrvuuItCNINjk3uhPsY37TF2wWUcyVd0F3XHOFxF3rTQFdTu4VjKKiJaAKVIpFjOuBV6sPhP_r9lzWgHAeuaccpO3A_jEAVZLKlRtBabQqv_cf7sZ6aEcoHO0QEhPP_5OXtBaflor-qyCiYmXV4kMhOYcSrk Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:14.783424 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff8f6eee58ae4b10b9800757f8bf5879", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 76c08502a5ca4964906076a9206a9c8b Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: action_args: {} Aug 29 04:56:14.785367 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:56:14.786530 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 04:56:14.788454 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:14.790008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6dff04ef-e43c-43c2-a535-ed7fd89c5c7a tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:14.790008 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6dff04ef-e43c-43c2-a535-ed7fd89c5c7a tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.243244 Aug 29 04:56:14.790008 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 824/1544] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 29 04:56:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 245 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:14.790775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-587af3ae-ac2a-4961-8b55-90eab9545c09 req-2f0d5eec-becd-47b6-ba26-de372abc5fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a99c1b-98ad-4d46-9be1-6d36ec32604b", "name": "network-vif-plugged", "status": "completed", "tag": "bf0358be-94b3-48f2-9869-3120396522f3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:14.803978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-587af3ae-ac2a-4961-8b55-90eab9545c09 req-2f0d5eec-becd-47b6-ba26-de372abc5fcd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.804477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-587af3ae-ac2a-4961-8b55-90eab9545c09 req-2f0d5eec-becd-47b6-ba26-de372abc5fcd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.804903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-587af3ae-ac2a-4961-8b55-90eab9545c09 req-2f0d5eec-becd-47b6-ba26-de372abc5fcd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.817400 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-587af3ae-ac2a-4961-8b55-90eab9545c09 req-2f0d5eec-becd-47b6-ba26-de372abc5fcd service nova] Creating event network-vif-plugged:bf0358be-94b3-48f2-9869-3120396522f3 for instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b on n-h1-854119-9 Aug 29 04:56:14.822972 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-587af3ae-ac2a-4961-8b55-90eab9545c09 req-2f0d5eec-becd-47b6-ba26-de372abc5fcd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035846 Aug 29 04:56:14.823854 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 825/1545] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:14.830375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ffc8767d-d284-4487-8fe0-c3eaa5fa4118 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:14.833211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ffc8767d-d284-4487-8fe0-c3eaa5fa4118 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:14.840204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffc8767d-d284-4487-8fe0-c3eaa5fa4118 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.840632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffc8767d-d284-4487-8fe0-c3eaa5fa4118 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.841106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffc8767d-d284-4487-8fe0-c3eaa5fa4118 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.842121 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f86aef3-dbec-4a2c-9a0f-c4d18bca6fa9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "POST /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154/action" status: 202 len: 0 microversion: 2.1 time: 0.341856 Aug 29 04:56:14.842568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffc8767d-d284-4487-8fe0-c3eaa5fa4118 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.842568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffc8767d-d284-4487-8fe0-c3eaa5fa4118 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.843049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffc8767d-d284-4487-8fe0-c3eaa5fa4118 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.843177 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 721/1546] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:56:14 2022] POST /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 04:56:14.848283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:14.848987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:14.856714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.857258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.857684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.858396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.858852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.859272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.879340 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ffc8767d-d284-4487-8fe0-c3eaa5fa4118 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053966 Aug 29 04:56:14.880060 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 826/1547] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:14 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:14.885254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59d25c2c-4072-4981-9d0f-268509571905 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Calling method '.version_select at 0x7f1abd857820>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:14.887487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-59d25c2c-4072-4981-9d0f-268509571905 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '76c08502a5ca4964906076a9206a9c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f6eee58ae4b10b9800757f8bf5879', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59d25c2c-4072-4981-9d0f-268509571905 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Request method failure captured: Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEbtALEHGXdYrX5qDCjcrvuuItCNINjk3uhPsY37TF2wWUcyVd0F3XHOFxF3rTQFdTu4VjKKiJaAKVIpFjOuBV6sPhP_r9lzWgHAeuaccpO3A_jEAVZLKlRtBabQqv_cf7sZ6aEcoHO0QEhPP_5OXtBaflor-qyCiYmXV4kMhOYcSrk Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:14.889467 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff8f6eee58ae4b10b9800757f8bf5879", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 76c08502a5ca4964906076a9206a9c8b Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: action_args: {} Aug 29 04:56:14.890856 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:56:14.891704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 04:56:14.892912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:14.895630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59d25c2c-4072-4981-9d0f-268509571905 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:14.896716 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59d25c2c-4072-4981-9d0f-268509571905 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.015168 Aug 29 04:56:14.897565 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 827/1548] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:56:14 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:14.902061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c0d32ce-d3c9-4284-913c-91f91a54a961 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd849940>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:14.955026 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c0d32ce-d3c9-4284-913c-91f91a54a961 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.056357 Aug 29 04:56:14.955859 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 828/1549] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:14 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:14.960935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:14.961933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:14.970147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.970633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.971119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:14.971951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:14.972400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:14.972865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.056806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:15.068440 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf02e29e-f080-40c3-83c2-027abd4a1c19 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.223799 Aug 29 04:56:15.069212 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 722/1550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:14 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:15.074025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71dadacc-1b82-4662-9dc6-ed87030d7402 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Calling method '.version_select at 0x7f1ab96601f0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.076114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71dadacc-1b82-4662-9dc6-ed87030d7402 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '76c08502a5ca4964906076a9206a9c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f6eee58ae4b10b9800757f8bf5879', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71dadacc-1b82-4662-9dc6-ed87030d7402 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Request method failure captured: Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEbtALEHGXdYrX5qDCjcrvuuItCNINjk3uhPsY37TF2wWUcyVd0F3XHOFxF3rTQFdTu4VjKKiJaAKVIpFjOuBV6sPhP_r9lzWgHAeuaccpO3A_jEAVZLKlRtBabQqv_cf7sZ6aEcoHO0QEhPP_5OXtBaflor-qyCiYmXV4kMhOYcSrk Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:15.078261 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff8f6eee58ae4b10b9800757f8bf5879", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 76c08502a5ca4964906076a9206a9c8b Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: action_args: {} Aug 29 04:56:15.079619 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:56:15.080511 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 04:56:15.081703 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.082757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71dadacc-1b82-4662-9dc6-ed87030d7402 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:15.082757 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71dadacc-1b82-4662-9dc6-ed87030d7402 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009084 Aug 29 04:56:15.082757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 723/1551] 10.222.0.20 () {58 vars in 1179 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:15.130694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:15.139441 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d5960598-8c9d-4719-ad9e-0b4282daa292 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1467 microversion: 2.1 time: 0.182031 Aug 29 04:56:15.148572 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 829/1552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:14 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1467 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:15.155415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.156424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:15.160389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Calling method '.version_select at 0x7f1ab9a21280>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.162135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.162688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.163313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.164347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.164998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.165436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.166298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.166781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.167320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.178295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.178783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.179216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.189811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.190305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.190901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.197191 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af0179f8-39e6-4b14-b505-0c8e4e560780 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.108618 Aug 29 04:56:15.198126 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 724/1553] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:15.209438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b55a5d50-db01-4d94-a42f-138cb23dc678 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Calling method '.version_select at 0x7f1ab9fc7dc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.211556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b55a5d50-db01-4d94-a42f-138cb23dc678 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '76c08502a5ca4964906076a9206a9c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f6eee58ae4b10b9800757f8bf5879', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b55a5d50-db01-4d94-a42f-138cb23dc678 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Request method failure captured: Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEbtALEHGXdYrX5qDCjcrvuuItCNINjk3uhPsY37TF2wWUcyVd0F3XHOFxF3rTQFdTu4VjKKiJaAKVIpFjOuBV6sPhP_r9lzWgHAeuaccpO3A_jEAVZLKlRtBabQqv_cf7sZ6aEcoHO0QEhPP_5OXtBaflor-qyCiYmXV4kMhOYcSrk Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:15.213462 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff8f6eee58ae4b10b9800757f8bf5879", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 76c08502a5ca4964906076a9206a9c8b Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '1'} Aug 29 04:56:15.215028 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:56:15.215846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 04:56:15.217091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.218151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b55a5d50-db01-4d94-a42f-138cb23dc678 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:15.218151 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b55a5d50-db01-4d94-a42f-138cb23dc678 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009776 Aug 29 04:56:15.219523 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 725/1554] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:56:15.224840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3fc9d465-a91f-48db-b372-f1ed4d9358c1 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Calling method '.version_select at 0x7f1ab99da4c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.226557 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-3fc9d465-a91f-48db-b372-f1ed4d9358c1 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] HTTP exception thrown: Hypervisor with ID '04887712-0fba-483d-abe4-a0f059cd744a' could not be found. Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3fc9d465-a91f-48db-b372-f1ed4d9358c1 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Request method failure captured: Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hypervisors/04887712-0fba-483d-abe4-a0f059cd744a/uptime HTTP/1.1 Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEbugJ5o_3Cq_DMVTs-NMXaDVYpAIlPMEffuCgN77tRBK4OCv6aXlVGUgEd7HSmputiiPPvLnv1O5Sdqf2G1qjRmZMbSAMjAQj6nt9Rki0T_cwch283D0cMuxLmoF-3WtpSWH98QwV1aqXo7f-VLqgM7aESx8ATDsM8pv6IQaf1B158 Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 1587665130664c4393d5b88382396063 Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2078299633 Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:15.239065 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1587665130664c4393d5b88382396063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1587665130664c4393d5b88382396063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1587665130664c4393d5b88382396063", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1587665130664c4393d5b88382396063"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2078299633 Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 1587665130664c4393d5b88382396063 Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2078299633 Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 7cb216a3225d41c7b059c54c74b2d43b Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: exception: Hypervisor with ID '04887712-0fba-483d-abe4-a0f059cd744a' could not be found. Aug 29 04:56:15.241127 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '04887712-0fba-483d-abe4-a0f059cd744a'} Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '04887712-0fba-483d-abe4-a0f059cd744a' Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 04:56:15.242335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '04887712-0fba-483d-abe4-a0f059cd744a' could not be found. Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.244221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.245874 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.245874 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.245874 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.245874 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:15.245874 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:15.245874 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '04887712-0fba-483d-abe4-a0f059cd744a' could not be found. Aug 29 04:56:15.245874 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.245874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3fc9d465-a91f-48db-b372-f1ed4d9358c1 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Returning 404 to user: Hypervisor with ID '04887712-0fba-483d-abe4-a0f059cd744a' could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:15.246478 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3fc9d465-a91f-48db-b372-f1ed4d9358c1 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/04887712-0fba-483d-abe4-a0f059cd744a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025174 Aug 29 04:56:15.250424 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 726/1555] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/os-hypervisors/04887712-0fba-483d-abe4-a0f059cd744a/uptime => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:15.256172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Calling method '.version_select at 0x7f1ab9bc5b80>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.258003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.258460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.258897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.272799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.273280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.273955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.284704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.285392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.285989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.293055 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf280590-1549-4bf2-99ef-ba3d8c17d08e tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041426 Aug 29 04:56:15.294178 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 727/1556] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:15.306226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-75e37bf8-f3d8-4464-9330-663491a80134 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Calling method '.version_select at 0x7f1ab99dae50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.308077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-75e37bf8-f3d8-4464-9330-663491a80134 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '76c08502a5ca4964906076a9206a9c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f6eee58ae4b10b9800757f8bf5879', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-75e37bf8-f3d8-4464-9330-663491a80134 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Request method failure captured: Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEbtALEHGXdYrX5qDCjcrvuuItCNINjk3uhPsY37TF2wWUcyVd0F3XHOFxF3rTQFdTu4VjKKiJaAKVIpFjOuBV6sPhP_r9lzWgHAeuaccpO3A_jEAVZLKlRtBabQqv_cf7sZ6aEcoHO0QEhPP_5OXtBaflor-qyCiYmXV4kMhOYcSrk Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:15.310211 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff8f6eee58ae4b10b9800757f8bf5879", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff8f6eee58ae4b10b9800757f8bf5879"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ff8f6eee58ae4b10b9800757f8bf5879 Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-808787286 Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 76c08502a5ca4964906076a9206a9c8b Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-808787286-project Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '1'} Aug 29 04:56:15.311881 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:56:15.313470 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 04:56:15.314968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.316479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-75e37bf8-f3d8-4464-9330-663491a80134 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:15.316479 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-75e37bf8-f3d8-4464-9330-663491a80134 tempest-HypervisorAdminNegativeTestJSON-808787286 tempest-HypervisorAdminNegativeTestJSON-808787286-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.013134 Aug 29 04:56:15.320382 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 728/1557] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:15.325273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c87b8106-c93e-415f-af69-135be4085b16 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Calling method '.version_select at 0x7f1ab9cde040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.327267 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-c87b8106-c93e-415f-af69-135be4085b16 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] HTTP exception thrown: Hypervisor with ID 'c2646a56-c972-4478-831d-e12653d55830' could not be found. Aug 29 04:56:15.327428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c87b8106-c93e-415f-af69-135be4085b16 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Request method failure captured: Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-hypervisors/c2646a56-c972-4478-831d-e12653d55830 HTTP/1.1 Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEbugJ5o_3Cq_DMVTs-NMXaDVYpAIlPMEffuCgN77tRBK4OCv6aXlVGUgEd7HSmputiiPPvLnv1O5Sdqf2G1qjRmZMbSAMjAQj6nt9Rki0T_cwch283D0cMuxLmoF-3WtpSWH98QwV1aqXo7f-VLqgM7aESx8ATDsM8pv6IQaf1B158 Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 1587665130664c4393d5b88382396063 Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2078299633 Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:15.329433 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1587665130664c4393d5b88382396063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1587665130664c4393d5b88382396063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1587665130664c4393d5b88382396063", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1587665130664c4393d5b88382396063"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2078299633 Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 1587665130664c4393d5b88382396063 Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2078299633 Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 7cb216a3225d41c7b059c54c74b2d43b Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: exception: Hypervisor with ID 'c2646a56-c972-4478-831d-e12653d55830' could not be found. Aug 29 04:56:15.331344 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'c2646a56-c972-4478-831d-e12653d55830'} Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c2646a56-c972-4478-831d-e12653d55830' Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 04:56:15.332307 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 04:56:15.334261 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c2646a56-c972-4478-831d-e12653d55830' could not be found. Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c2646a56-c972-4478-831d-e12653d55830' could not be found. Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c87b8106-c93e-415f-af69-135be4085b16 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] Returning 404 to user: Hypervisor with ID 'c2646a56-c972-4478-831d-e12653d55830' could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c87b8106-c93e-415f-af69-135be4085b16 tempest-HypervisorAdminNegativeTestJSON-2078299633 tempest-HypervisorAdminNegativeTestJSON-2078299633-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/c2646a56-c972-4478-831d-e12653d55830" status: 404 len: 123 microversion: 2.1 time: 0.010382 Aug 29 04:56:15.335472 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 729/1558] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/os-hypervisors/c2646a56-c972-4478-831d-e12653d55830 => generated 123 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:15.338664 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-689391a7-0f7b-433b-ab59-9f357c5ff91d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1468 microversion: 2.1 time: 0.196390 Aug 29 04:56:15.348097 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 830/1559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:15.385611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.386519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:15.393036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.393517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.394127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.394828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.395280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.395701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.549739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:15.559823 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95b556ca-2f6f-4fca-a743-c804c16da6be tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.178264 Aug 29 04:56:15.560457 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 730/1560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:15.897937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5de433c-4763-45d1-b939-345bea2aaffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.902229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f5de433c-4763-45d1-b939-345bea2aaffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:15.918499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5de433c-4763-45d1-b939-345bea2aaffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.919290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5de433c-4763-45d1-b939-345bea2aaffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.919935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5de433c-4763-45d1-b939-345bea2aaffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.920926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5de433c-4763-45d1-b939-345bea2aaffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:15.921523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5de433c-4763-45d1-b939-345bea2aaffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:15.922146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5de433c-4763-45d1-b939-345bea2aaffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:15.972210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b74e6945-aeb7-4963-826a-2dcebc802e7c tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1ab9ce71f0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:15.975444 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5de433c-4763-45d1-b939-345bea2aaffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.087396 Aug 29 04:56:15.990541 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 831/1561] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 04:56:16.028202 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b74e6945-aeb7-4963-826a-2dcebc802e7c tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.062176 Aug 29 04:56:16.028814 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 731/1562] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:15 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:16.092739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:16.093646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:16.112480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:16.113607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:16.114371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:16.116240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:16.118845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:16.119461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:16.161488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:16.162076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:16.175443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:16.176401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:16.176401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:16.177120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:16.177578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:16.178008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:16.338063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:16.350741 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-439a0bed-a281-435f-880e-efa1eebd2c4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.263725 Aug 29 04:56:16.351333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 832/1563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:16 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:16.365997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:16.367276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:16.380321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:16.381019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:16.387288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:16.389174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:16.389890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:16.390489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:16.479500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:16.493659 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9d311cde-b391-49e5-9f26-3bf42741aac6 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1467 microversion: 2.1 time: 0.336766 Aug 29 04:56:16.495359 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 732/1564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:16 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1467 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:16.583024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:16.583649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:16.598493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:16.601763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:16.602921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:16.604049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:16.605041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:16.606138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:16.973161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:17.000199 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c40f2c0f-9a45-462b-b081-5339ffb2cedd tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1468 microversion: 2.1 time: 0.640511 Aug 29 04:56:17.021807 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 833/1565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:16 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1468 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:17.042541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f370c167-257e-4a7c-936b-4fc6356398a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:17.046583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f370c167-257e-4a7c-936b-4fc6356398a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:17.090980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f370c167-257e-4a7c-936b-4fc6356398a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:17.092069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f370c167-257e-4a7c-936b-4fc6356398a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:17.092797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f370c167-257e-4a7c-936b-4fc6356398a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:17.095118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f370c167-257e-4a7c-936b-4fc6356398a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:17.095844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f370c167-257e-4a7c-936b-4fc6356398a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:17.096848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f370c167-257e-4a7c-936b-4fc6356398a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:17.110487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:17.118746 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b28efc6f-f8a4-41b8-aa6e-88d7958ee44e tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.541270 Aug 29 04:56:17.131480 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 733/1566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:16 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:17.138483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28596069-e530-4c90-a10f-d88ed0248b97 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1ab9cf9310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:17.156436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f370c167-257e-4a7c-936b-4fc6356398a3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132840 Aug 29 04:56:17.157567 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 834/1567] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:17 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:17.190263 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28596069-e530-4c90-a10f-d88ed0248b97 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.055272 Aug 29 04:56:17.206673 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 734/1568] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:17 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:17.377203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:17.377903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:17.388729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:17.390459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:17.392019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:17.394321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:17.396068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:17.397815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:17.502830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-801f5579-1c44-4375-ba07-0d7b2199a967 req-04a9bf0e-a8f9-45e9-b4af-587f853e97ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a99c1b-98ad-4d46-9be1-6d36ec32604b", "name": "network-vif-deleted", "tag": "bf0358be-94b3-48f2-9869-3120396522f3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:17.544626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-801f5579-1c44-4375-ba07-0d7b2199a967 req-04a9bf0e-a8f9-45e9-b4af-587f853e97ca service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:17.546885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-801f5579-1c44-4375-ba07-0d7b2199a967 req-04a9bf0e-a8f9-45e9-b4af-587f853e97ca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:17.547522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-801f5579-1c44-4375-ba07-0d7b2199a967 req-04a9bf0e-a8f9-45e9-b4af-587f853e97ca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:17.589179 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-801f5579-1c44-4375-ba07-0d7b2199a967 req-04a9bf0e-a8f9-45e9-b4af-587f853e97ca service nova] Creating event network-vif-deleted:bf0358be-94b3-48f2-9869-3120396522f3 for instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b on n-h1-854119-9 Aug 29 04:56:17.610489 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-801f5579-1c44-4375-ba07-0d7b2199a967 req-04a9bf0e-a8f9-45e9-b4af-587f853e97ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110453 Aug 29 04:56:17.611442 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 735/1569] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:17.619669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:17.632811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:17.646956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:17.654488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:17.656160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:17.657110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:17.659778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:17.668532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:17.742462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:17.786259 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f42723fe-2739-4056-95a7-268fb898cd34 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.411494 Aug 29 04:56:17.797124 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 835/1570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:17 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:17.999728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fd1a2591-f051-43c5-855c-e4a24517c2d6 req-193ab6dd-6905-48ed-b708-ecabe0e99102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5b7f5b-58d0-4534-9f54-c4a28267e57f", "name": "network-vif-deleted", "tag": "922503f7-4262-491b-a394-f86645433ee4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:18.002090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:18.013661 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4765a91-74a7-4775-a5b9-6e3c2edb659e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 200 len: 1297 microversion: 2.1 time: 0.398232 Aug 29 04:56:18.014276 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 736/1571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:17 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 1297 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:18.033918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:18.037367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:18.040807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:18.047223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.048423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.049077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:18.050045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.050670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.051275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:18.052630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fd1a2591-f051-43c5-855c-e4a24517c2d6 req-193ab6dd-6905-48ed-b708-ecabe0e99102 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.053112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fd1a2591-f051-43c5-855c-e4a24517c2d6 req-193ab6dd-6905-48ed-b708-ecabe0e99102 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.063570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fd1a2591-f051-43c5-855c-e4a24517c2d6 req-193ab6dd-6905-48ed-b708-ecabe0e99102 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:18.094250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.094776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.095208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:18.095726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lazy-loading 'fault' on Instance uuid 7f5b7f5b-58d0-4534-9f54-c4a28267e57f {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:56:18.124047 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fd1a2591-f051-43c5-855c-e4a24517c2d6 req-193ab6dd-6905-48ed-b708-ecabe0e99102 service nova] Creating event network-vif-deleted:922503f7-4262-491b-a394-f86645433ee4 for instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f on n-h1-854119-9 Aug 29 04:56:18.145204 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fd1a2591-f051-43c5-855c-e4a24517c2d6 req-193ab6dd-6905-48ed-b708-ecabe0e99102 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147097 Aug 29 04:56:18.149570 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 836/1572] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:56:18.163516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:18.164265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:18.189476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.190879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.192170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:18.193932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.195849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.196588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:18.233412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:18.255220 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d59010ff-094f-41bd-8947-d11c9fbfa21d tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 200 len: 1311 microversion: 2.1 time: 0.217357 Aug 29 04:56:18.256562 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 737/1573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:18 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 1311 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:18.262430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3bc64c86-7b5c-47cd-a3fc-16f0cae508eb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:18.272970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3bc64c86-7b5c-47cd-a3fc-16f0cae508eb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:18.297698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc64c86-7b5c-47cd-a3fc-16f0cae508eb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.298387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc64c86-7b5c-47cd-a3fc-16f0cae508eb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.298922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc64c86-7b5c-47cd-a3fc-16f0cae508eb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:18.300629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc64c86-7b5c-47cd-a3fc-16f0cae508eb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.301187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc64c86-7b5c-47cd-a3fc-16f0cae508eb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.301735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc64c86-7b5c-47cd-a3fc-16f0cae508eb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:18.350155 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3bc64c86-7b5c-47cd-a3fc-16f0cae508eb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091843 Aug 29 04:56:18.353011 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 738/1574] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:18 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:56:18.363278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b45078b6-fb71-4dc2-901d-8ce1004d7467 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1ab9cd1ee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:18.444035 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b45078b6-fb71-4dc2-901d-8ce1004d7467 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.089163 Aug 29 04:56:18.444886 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 739/1575] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:18 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:18.545398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:18.561174 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f55513ee-ef89-4522-ab01-aadeb8e399ca tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.409945 Aug 29 04:56:18.563768 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 837/1576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:18 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:18.821497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:18.822397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:18.833235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.834036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.834687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:18.835602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:18.836498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:18.837145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.000720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:19.012007 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-65fb56b6-a34b-4a07-92b5-cbebbfbe2fb2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.197114 Aug 29 04:56:19.012751 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 740/1577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:18 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:19.041630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:19.042250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 85a99c1b-98ad-4d46-9be1-6d36ec32604b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:19.050346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.050836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.051267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.052183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.053053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.053542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.075264 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] HTTP exception thrown: Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b could not be found. Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Request method failure captured: Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b HTTP/1.1 Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWQpR8N-dgIdrYZKNehBv386hIuzwDZVjud4eNKGReTfSDZh3qktjqbNi7vLP1La1xb2PlKKddPKNO26QHY-rMzrRnKXCQ0cOQdfXRkd1wXpaJgeZgMCrxU6wh26uWfcSRwGzUYvjj61-SWp1FNxbbZU48RiTETHfcr7OqkUI9iuCg Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 750d30e9d0ec4122a143ec01fd2c1a94 Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:19.077342 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_750d30e9d0ec4122a143ec01fd2c1a94", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 750d30e9d0ec4122a143ec01fd2c1a94 Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-MigrationsAdminTest-1258804824-project Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4fbcb22f6bfb44e7b149c0b9e06014b8 Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-MigrationsAdminTest-1258804824-project Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b could not be found. Aug 29 04:56:19.078760 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '85a99c1b-98ad-4d46-9be1-6d36ec32604b'} Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b could not be found. Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:19.079596 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b could not be found. Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b could not be found. Aug 29 04:56:19.081519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.084030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Returning 404 to user: Instance 85a99c1b-98ad-4d46-9be1-6d36ec32604b could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:19.084030 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-42f451a8-14bf-4d96-a3b3-ad5e35f86f39 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b" status: 404 len: 111 microversion: 2.1 time: 0.043655 Aug 29 04:56:19.084030 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 838/1578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:19 2022] GET /compute/v2.1/servers/85a99c1b-98ad-4d46-9be1-6d36ec32604b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:19.087593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:19.088096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:19.094772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.094900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.095324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.096089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.096572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.096995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.124049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:56:19.182333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:19.237365 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d088ab4-e881-42bc-ac71-8a2808902f03 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 204 len: 0 microversion: 2.1 time: 0.153286 Aug 29 04:56:19.240456 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 741/1579] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:56:19 2022] DELETE /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:56:19.246901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:19.247821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:19.254569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.255334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.256016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.257015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.257550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.258080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.283585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:19.284359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7f5b7f5b-58d0-4534-9f54-c4a28267e57f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:19.295375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.295925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.296432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.297141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.299587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.300690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.322203 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] HTTP exception thrown: Instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f could not be found. Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Request method failure captured: Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f HTTP/1.1 Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEa3Dgibms87r8i1ODF20W9T-ZluWTffLmj2UZZynqxnmzjohvWZzh_rtKw80s_2_uZBT9GTFRyfdky_mWc5cVOYmaDFyn78BTERlxqvBj2Yk5cS8rzTxsUUA4ojR5OmiQVsEmGpXV51_sgZSEbTk9eEBHJTfVgHc-rjDIHteVVMVkI Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 73dd0dd815d24a1b810cad3110a45ddd Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-181045900 Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:19.324108 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73dd0dd815d24a1b810cad3110a45ddd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73dd0dd815d24a1b810cad3110a45ddd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73dd0dd815d24a1b810cad3110a45ddd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73dd0dd815d24a1b810cad3110a45ddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-181045900 Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 73dd0dd815d24a1b810cad3110a45ddd Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-181045900 Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminNegativeTestJSON-181045900-project Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d895f1e9e257458395b4f38d08ee0b14 Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-181045900-project Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f could not be found. Aug 29 04:56:19.325580 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7f5b7f5b-58d0-4534-9f54-c4a28267e57f'} Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f could not be found. Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:19.326822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f could not be found. Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f could not be found. Aug 29 04:56:19.328112 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:19.330021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Returning 404 to user: Instance 7f5b7f5b-58d0-4534-9f54-c4a28267e57f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:19.330021 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fe6b7fac-87cd-48a2-8dc8-2aeda9ed2e1f tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f" status: 404 len: 111 microversion: 2.1 time: 0.048944 Aug 29 04:56:19.330347 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 742/1580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:19 2022] GET /compute/v2.1/servers/7f5b7f5b-58d0-4534-9f54-c4a28267e57f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:56:19.335897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:19.336474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:19.343414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.343895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.344360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.345055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.345683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.346297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.380073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:56:19.415278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:19.423296 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7c9f263a-cb6f-4c9b-ad6b-d881035a940e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1534 microversion: 2.1 time: 0.180664 Aug 29 04:56:19.424418 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 839/1581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:19 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1534 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:19.429430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93570d3d-0a16-46a3-929b-d133c4b6fffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:19.431754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-93570d3d-0a16-46a3-929b-d133c4b6fffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:19.438271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93570d3d-0a16-46a3-929b-d133c4b6fffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.438796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93570d3d-0a16-46a3-929b-d133c4b6fffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.439455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93570d3d-0a16-46a3-929b-d133c4b6fffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.440073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93570d3d-0a16-46a3-929b-d133c4b6fffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.440585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93570d3d-0a16-46a3-929b-d133c4b6fffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.441135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93570d3d-0a16-46a3-929b-d133c4b6fffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.476904 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-93570d3d-0a16-46a3-929b-d133c4b6fffa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.051171 Aug 29 04:56:19.477909 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 840/1582] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:56:19 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:19.497039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-82c08b39-2356-4e59-a31f-f30345de52e3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd896430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:19.509134 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9e8e15fd-1ed7-4504-85a2-f6b38fa6893c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 204 len: 0 microversion: 2.1 time: 0.177407 Aug 29 04:56:19.509785 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 743/1583] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:56:19 2022] DELETE /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:56:19.521833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:19.522589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:19.531420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.531914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.532374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.533220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.533838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.534246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.601274 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-82c08b39-2356-4e59-a31f-f30345de52e3 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.122028 Aug 29 04:56:19.601866 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 841/1584] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:19 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:19.616147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:19.616802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:19.623665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.624166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.624602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.625430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:19.625769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:19.626184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:19.805035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:19.813298 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2569c7ca-e233-4ede-af43-ba28e82ee14c tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1477 microversion: 2.1 time: 0.298768 Aug 29 04:56:19.813867 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 744/1585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:19 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:19.867726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:19.877472 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17764f0d-b43b-4087-b1dc-5711c2af62a1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.273798 Aug 29 04:56:19.880410 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 842/1586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:19 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:20.038961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:20.040230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:20.049951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.051035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.051798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.053037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.053745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.054271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.232563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:20.241225 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-321c6f1b-3b87-4c66-9aee-ace476d22655 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.208289 Aug 29 04:56:20.242558 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 745/1587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:20 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:20.444862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:20.445705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:20.467244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.467747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.468207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.468915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.469556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.470139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.663778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:20.673961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07bf518e-0102-4820-89e3-eae548dbc73d tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1534 microversion: 2.1 time: 0.233253 Aug 29 04:56:20.675439 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 843/1588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:20 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1534 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:20.681353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8e52fd13-12a6-429c-b872-60ce981ddf23 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1ab93545e0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:20.738293 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8e52fd13-12a6-429c-b872-60ce981ddf23 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.061215 Aug 29 04:56:20.739216 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 844/1589] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:20 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:20.821087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9d7c940>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:20.825631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.827251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.829744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.834685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:20.835656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:20.838510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.839252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.839680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.843204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.843695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.844259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.845033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.845505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.846767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.847819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] HTTP exception thrown: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Request method failure captured: Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/os-services/834955e6-4b11-448c-92e7-2bbf897d83d7 HTTP/1.1 Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 56 Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEb0a6bb-IqShH5zkB3vCMC3yw4T_jPnH8AoEweQJaiynuztoD46wQBKFzgyVsxUWWWGPbzlqUKEPyly4vIBZbFqOKon9TRsSMXFBTkwYj79mJLBvp2bh0Of3nqJvXYgkMRX0aUXccczrPo1TW2n7LOwVX0HTYcGU6BR_s9IKI81mRk Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: a7ad1278513f486dbb7701c85613e3f5 Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1444578955 Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:20.857030 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7ad1278513f486dbb7701c85613e3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a7ad1278513f486dbb7701c85613e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a7ad1278513f486dbb7701c85613e3f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7ad1278513f486dbb7701c85613e3f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1444578955 Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: a7ad1278513f486dbb7701c85613e3f5 Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1444578955 Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: eee137270776416c8fec47c8ab9b8ac1 Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:20.858680 n-d-854119-9 devstack@n-api.service[128871]: exception: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '834955e6-4b11-448c-92e7-2bbf897d83d7', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.859562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:20.860965 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:20.862251 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:20.862251 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.862251 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.864647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Returning 404 to user: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:20.865813 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6114121b-4f07-430f-b257-58144ae7546e tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/834955e6-4b11-448c-92e7-2bbf897d83d7" status: 404 len: 110 microversion: 2.53 time: 0.270308 Aug 29 04:56:20.871525 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 746/1590] 10.222.0.20 () {62 vars in 1309 bytes} [Mon Aug 29 04:56:20 2022] PUT /compute/v2.1/os-services/834955e6-4b11-448c-92e7-2bbf897d83d7 => generated 110 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:56:20.877601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Action: 'update', calling method: .version_select at 0x7f1aba025af0>, body: {"status": "disabled"} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:20.881233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.881727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.882184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.891343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.892234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.892929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.899842 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] HTTP exception thrown: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Request method failure captured: Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/os-services/834955e6-4b11-448c-92e7-2bbf897d83d7 HTTP/1.1 Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 22 Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEb0a6bb-IqShH5zkB3vCMC3yw4T_jPnH8AoEweQJaiynuztoD46wQBKFzgyVsxUWWWGPbzlqUKEPyly4vIBZbFqOKon9TRsSMXFBTkwYj79mJLBvp2bh0Of3nqJvXYgkMRX0aUXccczrPo1TW2n7LOwVX0HTYcGU6BR_s9IKI81mRk Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: a7ad1278513f486dbb7701c85613e3f5 Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1444578955 Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:20.901780 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7ad1278513f486dbb7701c85613e3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a7ad1278513f486dbb7701c85613e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a7ad1278513f486dbb7701c85613e3f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7ad1278513f486dbb7701c85613e3f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1444578955 Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: a7ad1278513f486dbb7701c85613e3f5 Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1444578955 Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: eee137270776416c8fec47c8ab9b8ac1 Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: {"status": "disabled"} Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: exception: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.903294 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '834955e6-4b11-448c-92e7-2bbf897d83d7', 'body': {'status': 'disabled'}} Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:20.909125 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:20.910431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:20.911726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:20.911726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:20.911726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Returning 404 to user: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:20.911726 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8604f105-544d-46c8-9a11-4175e3aacee5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/834955e6-4b11-448c-92e7-2bbf897d83d7" status: 404 len: 110 microversion: 2.53 time: 0.030725 Aug 29 04:56:20.911726 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 747/1591] 10.222.0.20 () {62 vars in 1309 bytes} [Mon Aug 29 04:56:20 2022] PUT /compute/v2.1/os-services/834955e6-4b11-448c-92e7-2bbf897d83d7 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:56:20.911726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:20.913786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:20.916853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.917352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.917790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:20.918631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:20.919091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:20.919623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.114264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:21.123221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:21.125002 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-751f69f9-d6b1-4c16-acd4-0f2f50364c10 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.219446 Aug 29 04:56:21.130692 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 748/1592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:20 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:21.134716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:21.137364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9a29ee0>, body: {"status": "enabled"} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:21.138055 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bcccf470-dbaf-496f-b54c-ff0b46175a14 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1477 microversion: 2.1 time: 0.306907 Aug 29 04:56:21.144479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.145251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.146059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.152255 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 845/1593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:20 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1477 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:21.153902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.154460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.154970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.161582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] HTTP exception thrown: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Request method failure captured: Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/os-services/834955e6-4b11-448c-92e7-2bbf897d83d7 HTTP/1.1 Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 21 Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEb0a6bb-IqShH5zkB3vCMC3yw4T_jPnH8AoEweQJaiynuztoD46wQBKFzgyVsxUWWWGPbzlqUKEPyly4vIBZbFqOKon9TRsSMXFBTkwYj79mJLBvp2bh0Of3nqJvXYgkMRX0aUXccczrPo1TW2n7LOwVX0HTYcGU6BR_s9IKI81mRk Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: a7ad1278513f486dbb7701c85613e3f5 Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1444578955 Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:21.163730 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7ad1278513f486dbb7701c85613e3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a7ad1278513f486dbb7701c85613e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a7ad1278513f486dbb7701c85613e3f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7ad1278513f486dbb7701c85613e3f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1444578955 Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: a7ad1278513f486dbb7701c85613e3f5 Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1444578955 Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: eee137270776416c8fec47c8ab9b8ac1 Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: {"status": "enabled"} Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: exception: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:21.165298 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '834955e6-4b11-448c-92e7-2bbf897d83d7', 'body': {'status': 'enabled'}} Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:21.166239 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:21.167584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:21.168882 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. Aug 29 04:56:21.168882 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.170983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Returning 404 to user: Service 834955e6-4b11-448c-92e7-2bbf897d83d7 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:21.172274 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b8e53dc5-2de7-45fa-98d2-67c490a00192 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/834955e6-4b11-448c-92e7-2bbf897d83d7" status: 404 len: 110 microversion: 2.53 time: 0.040264 Aug 29 04:56:21.178617 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 749/1594] 10.222.0.20 () {62 vars in 1309 bytes} [Mon Aug 29 04:56:21 2022] PUT /compute/v2.1/os-services/834955e6-4b11-448c-92e7-2bbf897d83d7 => generated 110 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:56:21.187814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0eff163-0df1-4df3-a267-35774da0b70a tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.193917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0eff163-0df1-4df3-a267-35774da0b70a tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.194970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0eff163-0df1-4df3-a267-35774da0b70a tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.195643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0eff163-0df1-4df3-a267-35774da0b70a tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.196502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0eff163-0df1-4df3-a267-35774da0b70a tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.197164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0eff163-0df1-4df3-a267-35774da0b70a tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.199899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0eff163-0df1-4df3-a267-35774da0b70a tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.244004 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0eff163-0df1-4df3-a267-35774da0b70a tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063150 Aug 29 04:56:21.244750 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 846/1595] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:56:21.256912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-901a9f62-26a8-4479-915e-4e0033e38827 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.263420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-901a9f62-26a8-4479-915e-4e0033e38827 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.264218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-901a9f62-26a8-4479-915e-4e0033e38827 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.264921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-901a9f62-26a8-4479-915e-4e0033e38827 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.266148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-901a9f62-26a8-4479-915e-4e0033e38827 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.266846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-901a9f62-26a8-4479-915e-4e0033e38827 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.266972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.267564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:21.269677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:21.270322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-901a9f62-26a8-4479-915e-4e0033e38827 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.277368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.278336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.279013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.279942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.280624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.281490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.327717 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-901a9f62-26a8-4479-915e-4e0033e38827 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.074275 Aug 29 04:56:21.329890 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 750/1596] 10.222.0.20 () {60 vars in 1211 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:21.344309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71b67dea-1d52-46d0-a03b-ed79f26b67d5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.356159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b67dea-1d52-46d0-a03b-ed79f26b67d5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.357173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b67dea-1d52-46d0-a03b-ed79f26b67d5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.357997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b67dea-1d52-46d0-a03b-ed79f26b67d5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.359405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b67dea-1d52-46d0-a03b-ed79f26b67d5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.360550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b67dea-1d52-46d0-a03b-ed79f26b67d5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.361181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b67dea-1d52-46d0-a03b-ed79f26b67d5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.406673 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71b67dea-1d52-46d0-a03b-ed79f26b67d5 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.068271 Aug 29 04:56:21.415769 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 751/1597] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:21.420996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-495f46dc-3738-414a-8de5-4fd54be32082 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.425651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-495f46dc-3738-414a-8de5-4fd54be32082 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.426400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-495f46dc-3738-414a-8de5-4fd54be32082 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.427059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-495f46dc-3738-414a-8de5-4fd54be32082 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.428031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-495f46dc-3738-414a-8de5-4fd54be32082 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.428750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-495f46dc-3738-414a-8de5-4fd54be32082 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.429373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-495f46dc-3738-414a-8de5-4fd54be32082 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.459443 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-495f46dc-3738-414a-8de5-4fd54be32082 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-854119-9&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.041998 Aug 29 04:56:21.460220 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 752/1598] 10.222.0.20 () {60 vars in 1235 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/os-services?host=n-d-854119-9&binary=xxx => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:21.472211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b035d85c-290a-4ed5-921e-a5451fdf9d43 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.476001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b035d85c-290a-4ed5-921e-a5451fdf9d43 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.476967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b035d85c-290a-4ed5-921e-a5451fdf9d43 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.477837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b035d85c-290a-4ed5-921e-a5451fdf9d43 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.478763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b035d85c-290a-4ed5-921e-a5451fdf9d43 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.479557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b035d85c-290a-4ed5-921e-a5451fdf9d43 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.480294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b035d85c-290a-4ed5-921e-a5451fdf9d43 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.508101 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b035d85c-290a-4ed5-921e-a5451fdf9d43 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.039702 Aug 29 04:56:21.516213 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 753/1599] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:21.528337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4c0a7b58-1470-407d-9a1c-2a80b2237527 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.535455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0a7b58-1470-407d-9a1c-2a80b2237527 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.535976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0a7b58-1470-407d-9a1c-2a80b2237527 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.536419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0a7b58-1470-407d-9a1c-2a80b2237527 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.537166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0a7b58-1470-407d-9a1c-2a80b2237527 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.537923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0a7b58-1470-407d-9a1c-2a80b2237527 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.538833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0a7b58-1470-407d-9a1c-2a80b2237527 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.566162 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4c0a7b58-1470-407d-9a1c-2a80b2237527 tempest-ServicesAdminNegativeV253TestJSON-1444578955 tempest-ServicesAdminNegativeV253TestJSON-1444578955-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.048563 Aug 29 04:56:21.567093 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 754/1600] 10.222.0.20 () {60 vars in 1239 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:21.690174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f0ee36f-e9e3-4a5a-aa2a-73856512370f tempest-ServicesAdminNegativeV253TestJSON-478220343 tempest-ServicesAdminNegativeV253TestJSON-478220343-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.695116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f0ee36f-e9e3-4a5a-aa2a-73856512370f tempest-ServicesAdminNegativeV253TestJSON-478220343 tempest-ServicesAdminNegativeV253TestJSON-478220343-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b30aab7fbd1141d78ba75a0a84f9887a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e50f989db934b1783bcc53458e1566b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f0ee36f-e9e3-4a5a-aa2a-73856512370f tempest-ServicesAdminNegativeV253TestJSON-478220343 tempest-ServicesAdminNegativeV253TestJSON-478220343-project] Request method failure captured: Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEbzzq-oPqAoNxzSvKySUcywRZ8dgruFkGPuFmQlBTF4mVUzm_Oem6lpkO3xvbqo3USEGjnoPdqAZyM-uJy0hFpQwEv-l5DwNiyRsGVqwl18TIXZT_xsyepx-qF2l_crWdS63z_ndahsPJck0SDxYa4fsz5LeWOfi0NwXKrnq5SAL2c Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0e50f989db934b1783bcc53458e1566b Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-478220343 Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:21.697406 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e50f989db934b1783bcc53458e1566b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e50f989db934b1783bcc53458e1566b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e50f989db934b1783bcc53458e1566b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e50f989db934b1783bcc53458e1566b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-478220343 Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0e50f989db934b1783bcc53458e1566b Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-478220343 Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServicesAdminNegativeV253TestJSON-478220343-project Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: b30aab7fbd1141d78ba75a0a84f9887a Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-478220343-project Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 04:56:21.698846 n-d-854119-9 devstack@n-api.service[128871]: action_args: {} Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:56:21.699650 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 04:56:21.700918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:21.704986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f0ee36f-e9e3-4a5a-aa2a-73856512370f tempest-ServicesAdminNegativeV253TestJSON-478220343 tempest-ServicesAdminNegativeV253TestJSON-478220343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:21.706268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:21.707686 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f0ee36f-e9e3-4a5a-aa2a-73856512370f tempest-ServicesAdminNegativeV253TestJSON-478220343 tempest-ServicesAdminNegativeV253TestJSON-478220343-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.132666 Aug 29 04:56:21.708920 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 755/1601] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 134 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Aug 29 04:56:21.714174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.715689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:21.719614 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8a4efac0-cc55-4a05-b032-2992ab1883ca tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.456413 Aug 29 04:56:21.733308 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 847/1602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:21.737249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.737693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.738302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.740312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:21.740790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:21.741222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:21.753680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ae66174-d6e3-4a56-8c6e-e87a09e5b1c2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd87aa60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:21.820231 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ae66174-d6e3-4a56-8c6e-e87a09e5b1c2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.070285 Aug 29 04:56:21.821234 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 848/1603] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:21.968395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:21.984555 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-25d9aefa-635d-4afc-a31d-fad74e356f50 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 200 len: 1534 microversion: 2.1 time: 0.273418 Aug 29 04:56:21.986819 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 756/1604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:21 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 1534 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:22.149877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:22.150921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:22.160035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:22.161326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:22.194410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:22.194947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:22.195986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:22.196588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:22.197978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:22.199348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:22.200228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:22.201999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:22.202896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:22.203129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:22.204693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:22.205802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:23.613840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:23.623674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:23.629015 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4835a685-5985-46fa-9726-d0e9bcfc17dd tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 1.481764 Aug 29 04:56:23.630370 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 849/1605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:22 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:23.642310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-551df0de-7eaf-4fa5-bd52-bb8f807d9540 req-1f471201-4e44-43dc-8ab6-f4acb3cf2349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b820ba-bc27-4a3b-81a0-43a45340f60b", "name": "network-vif-deleted", "tag": "bbab69b1-3249-4a95-ba39-0f3c3196a9e2"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:23.645469 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-96ebabdb-0b77-4baa-ad08-0187bbede8c9 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1477 microversion: 2.1 time: 1.489946 Aug 29 04:56:23.646070 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 757/1606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:22 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1477 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:23.651021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:23.651634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:23.673268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:23.674019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:23.674748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:23.675667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:23.676385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:23.677069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:23.678102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-551df0de-7eaf-4fa5-bd52-bb8f807d9540 req-1f471201-4e44-43dc-8ab6-f4acb3cf2349 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:23.679165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-551df0de-7eaf-4fa5-bd52-bb8f807d9540 req-1f471201-4e44-43dc-8ab6-f4acb3cf2349 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:23.679831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-551df0de-7eaf-4fa5-bd52-bb8f807d9540 req-1f471201-4e44-43dc-8ab6-f4acb3cf2349 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:23.696977 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-551df0de-7eaf-4fa5-bd52-bb8f807d9540 req-1f471201-4e44-43dc-8ab6-f4acb3cf2349 service nova] Creating event network-vif-deleted:bbab69b1-3249-4a95-ba39-0f3c3196a9e2 for instance 20b820ba-bc27-4a3b-81a0-43a45340f60b on n-h1-854119-9 Aug 29 04:56:23.706183 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-551df0de-7eaf-4fa5-bd52-bb8f807d9540 req-1f471201-4e44-43dc-8ab6-f4acb3cf2349 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072112 Aug 29 04:56:23.708024 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 850/1607] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:23.717497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-367a21ce-107f-489c-91f6-a770424c6290 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd849160>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:23.956225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:23.968730 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-96de157f-e510-4a38-af37-7bf5c5f0fdac tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.321604 Aug 29 04:56:23.969351 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 758/1608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:23 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:23.985532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:23.986480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 20b820ba-bc27-4a3b-81a0-43a45340f60b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:23.996572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:23.997742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:24.000695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:24.001730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:24.002418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:24.003080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:24.057229 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] HTTP exception thrown: Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b could not be found. Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Request method failure captured: Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b HTTP/1.1 Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWQpR8N-dgIdrYZKNehBv386hIuzwDZVjud4eNKGReTfSDZh3qktjqbNi7vLP1La1xb2PlKKddPKNO26QHY-rMzrRnKXCQ0cOQdfXRkd1wXpaJgeZgMCrxU6wh26uWfcSRwGzUYvjj61-SWp1FNxbbZU48RiTETHfcr7OqkUI9iuCg Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 750d30e9d0ec4122a143ec01fd2c1a94 Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:24.061446 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_750d30e9d0ec4122a143ec01fd2c1a94", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 750d30e9d0ec4122a143ec01fd2c1a94 Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-MigrationsAdminTest-1258804824-project Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4fbcb22f6bfb44e7b149c0b9e06014b8 Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-MigrationsAdminTest-1258804824-project Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b could not be found. Aug 29 04:56:24.063087 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '20b820ba-bc27-4a3b-81a0-43a45340f60b'} Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b could not be found. Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:24.063875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b could not be found. Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b could not be found. Aug 29 04:56:24.065497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:24.069602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Returning 404 to user: Instance 20b820ba-bc27-4a3b-81a0-43a45340f60b could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:24.074290 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec6736a7-7beb-4c9d-9c53-b924d74868bf tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b" status: 404 len: 111 microversion: 2.1 time: 0.101458 Aug 29 04:56:24.087872 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 759/1609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:23 2022] GET /compute/v2.1/servers/20b820ba-bc27-4a3b-81a0-43a45340f60b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:24.113639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-52460602-0c37-4eb4-8105-d82f314ba0cb req-b99ccaab-887b-410c-bdfb-2b7d4d522273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154", "name": "network-vif-plugged", "status": "completed", "tag": "39ed18ba-56f8-4c3d-a711-deebbf9109d3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:24.206652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-52460602-0c37-4eb4-8105-d82f314ba0cb req-b99ccaab-887b-410c-bdfb-2b7d4d522273 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:24.207143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-52460602-0c37-4eb4-8105-d82f314ba0cb req-b99ccaab-887b-410c-bdfb-2b7d4d522273 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:24.218424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-52460602-0c37-4eb4-8105-d82f314ba0cb req-b99ccaab-887b-410c-bdfb-2b7d4d522273 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:24.313824 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-52460602-0c37-4eb4-8105-d82f314ba0cb req-b99ccaab-887b-410c-bdfb-2b7d4d522273 service nova] Creating event network-vif-plugged:39ed18ba-56f8-4c3d-a711-deebbf9109d3 for instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 on n-h1-854119-9 Aug 29 04:56:24.330338 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-52460602-0c37-4eb4-8105-d82f314ba0cb req-b99ccaab-887b-410c-bdfb-2b7d4d522273 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237485 Aug 29 04:56:24.336694 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 760/1610] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:24.356194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7609b1fd-0d34-47be-959d-982c9b3e3fc2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '.version_select at 0x7f1ab9b953a0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:24.447301 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7609b1fd-0d34-47be-959d-982c9b3e3fc2 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-875221044" status: 202 len: 0 microversion: 2.1 time: 0.107520 Aug 29 04:56:24.452045 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 761/1611] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 04:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-875221044 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:56:24.482625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-441c570c-eb43-4300-abd0-1584624c906e req-5ce41664-ecf8-474a-b1e2-bc18b9cf06d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a", "name": "network-vif-deleted", "tag": "35eee654-3e7e-41a0-9f06-2a811dfa3710"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:24.504462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-441c570c-eb43-4300-abd0-1584624c906e req-5ce41664-ecf8-474a-b1e2-bc18b9cf06d8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:24.505353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-441c570c-eb43-4300-abd0-1584624c906e req-5ce41664-ecf8-474a-b1e2-bc18b9cf06d8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:24.506080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-441c570c-eb43-4300-abd0-1584624c906e req-5ce41664-ecf8-474a-b1e2-bc18b9cf06d8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:24.521258 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-441c570c-eb43-4300-abd0-1584624c906e req-5ce41664-ecf8-474a-b1e2-bc18b9cf06d8 service nova] Creating event network-vif-deleted:35eee654-3e7e-41a0-9f06-2a811dfa3710 for instance 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a on n-h2-854119-9 Aug 29 04:56:24.531382 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-441c570c-eb43-4300-abd0-1584624c906e req-5ce41664-ecf8-474a-b1e2-bc18b9cf06d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077336 Aug 29 04:56:24.532445 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 762/1612] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:24.652362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:24.655477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:24.670239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:24.673166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:24.674071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:24.675207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:24.677157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:24.677913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:25.095537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:25.110832 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-43cbd257-9b0b-43e2-8991-3e8aa0141494 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.463068 Aug 29 04:56:25.111758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 763/1613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:24 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:25.124547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:25.125988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:25.135192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:25.135983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:25.136683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:25.137925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:25.138653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:25.139984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:25.193826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:25.195618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:25.196957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:25.198149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lazy-loading 'fault' on Instance uuid 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:56:25.285254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd895f1e9e257458395b4f38d08ee0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dd0dd815d24a1b810cad3110a45ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:25.300210 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f655ef29-112c-4586-a468-e5fb7e424cec tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 200 len: 1312 microversion: 2.1 time: 0.185578 Aug 29 04:56:25.305719 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 764/1614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:25 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:25.322874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:25.323627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:25.344894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:25.346502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:25.352496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:25.354114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:25.358057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:25.360598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:25.701363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:25.725170 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b3b3f8f-200c-4019-80dd-7f767c6cedb9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.406681 Aug 29 04:56:25.725665 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 765/1615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:25 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:26.020520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:26.021072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:26.030867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.037498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.038889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.045525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.046026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.046813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.082188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:26.111266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:56:26.270006 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b84477c-2c14-499d-80f8-bb667fdac54e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 204 len: 0 microversion: 2.1 time: 0.253175 Aug 29 04:56:26.273639 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 766/1616] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:56:26 2022] DELETE /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:56:26.278067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:26.279176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:26.287812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.288869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.289556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.290558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.291251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.291866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.511693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:26.527658 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d8fcad7d-3bfb-4d43-a085-67cfac91aa0c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.255248 Aug 29 04:56:26.541475 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 767/1617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:26 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:26.552282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:26.553270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:26.561948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.562878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.563698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.564784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.565412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.565997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.755559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:26.773133 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fbe0a420-04f6-4091-8e4d-62593513114b tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1468 microversion: 2.1 time: 0.225550 Aug 29 04:56:26.773976 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 768/1618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:26 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1468 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:26.778693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:26.779490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] [instance: 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:26.786109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.786862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.787453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.788494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.788945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.789361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.807959 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] HTTP exception thrown: Instance 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a could not be found. Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Request method failure captured: Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a HTTP/1.1 Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEa3Dgibms87r8i1ODF20W9T-ZluWTffLmj2UZZynqxnmzjohvWZzh_rtKw80s_2_uZBT9GTFRyfdky_mWc5cVOYmaDFyn78BTERlxqvBj2Yk5cS8rzTxsUUA4ojR5OmiQVsEmGpXV51_sgZSEbTk9eEBHJTfVgHc-rjDIHteVVMVkI Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 73dd0dd815d24a1b810cad3110a45ddd Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-181045900 Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:26.809811 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73dd0dd815d24a1b810cad3110a45ddd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73dd0dd815d24a1b810cad3110a45ddd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73dd0dd815d24a1b810cad3110a45ddd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73dd0dd815d24a1b810cad3110a45ddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-181045900 Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 73dd0dd815d24a1b810cad3110a45ddd Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-181045900 Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminNegativeTestJSON-181045900-project Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d895f1e9e257458395b4f38d08ee0b14 Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-181045900-project Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a could not be found. Aug 29 04:56:26.811843 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a'} Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a could not be found. Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:26.813000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a could not be found. Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a could not be found. Aug 29 04:56:26.814530 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:26.817170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] Returning 404 to user: Instance 7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:26.818235 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5afc5043-d8c9-4c7f-871c-ceca33567798 tempest-ServersAdminNegativeTestJSON-181045900 tempest-ServersAdminNegativeTestJSON-181045900-project] 10.222.0.20 "GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a" status: 404 len: 111 microversion: 2.1 time: 0.043200 Aug 29 04:56:26.822288 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 769/1619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:26 2022] GET /compute/v2.1/servers/7ed725ec-7d73-4af6-88ef-64fcb5eb2b7a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:26.827416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-00830f3d-9ccc-4a53-8109-8768556ab3a0 req-27f7c65b-3292-4799-916a-a1fab1054607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e3b162-b20c-46a9-9839-dca9a18ce982", "name": "network-vif-plugged", "status": "completed", "tag": "a062dfc6-5a22-4087-960a-ef508765cdb8"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:26.848912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-00830f3d-9ccc-4a53-8109-8768556ab3a0 req-27f7c65b-3292-4799-916a-a1fab1054607 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.852397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-00830f3d-9ccc-4a53-8109-8768556ab3a0 req-27f7c65b-3292-4799-916a-a1fab1054607 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.853025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-00830f3d-9ccc-4a53-8109-8768556ab3a0 req-27f7c65b-3292-4799-916a-a1fab1054607 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.887357 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-00830f3d-9ccc-4a53-8109-8768556ab3a0 req-27f7c65b-3292-4799-916a-a1fab1054607 service nova] Creating event network-vif-plugged:a062dfc6-5a22-4087-960a-ef508765cdb8 for instance f1e3b162-b20c-46a9-9839-dca9a18ce982 on n-h2-854119-9 Aug 29 04:56:26.893826 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-00830f3d-9ccc-4a53-8109-8768556ab3a0 req-27f7c65b-3292-4799-916a-a1fab1054607 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070275 Aug 29 04:56:26.904990 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 770/1620] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:26.912241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:26.913635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:26.927056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.928071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.928759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:26.929625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:26.930230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:26.930837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:27.280366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:27.305473 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9195ec5f-e93b-402e-aa5c-4643a2a7d116 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.397502 Aug 29 04:56:27.312020 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 771/1621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:26 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:27.560850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:27.562338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:27.570525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:27.571505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:27.572505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:27.573852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:27.574739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:27.577301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:27.840079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:27.852673 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09ebdf71-aaa9-49e8-b3fd-540c2594600a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1371 microversion: 2.1 time: 0.302954 Aug 29 04:56:27.853835 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 772/1622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:27 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:27.873778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:27.874664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:27.880706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:27.881204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:27.881640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:27.882350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:27.882805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:27.883226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:28.360785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:28.371586 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-629cc736-5f08-4e35-b64a-748adbd85f53 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 200 len: 1468 microversion: 2.1 time: 0.516351 Aug 29 04:56:28.372320 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 773/1623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:27 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 1468 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:29.024262 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4bb4f52c-4ddd-40c6-a9cc-1c2047fa3c3a tempest-TenantUsagesNegativeTestJSON-862051982 tempest-TenantUsagesNegativeTestJSON-862051982-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T04%3A56%3A27.891198&end=2022-08-30T04%3A56%3A27.891198" status: 404 len: 112 microversion: - time: 0.649987 Aug 29 04:56:29.024883 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 774/1624] 10.222.0.20 () {58 vars in 1316 bytes} [Mon Aug 29 04:56:28 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T04%3A56%3A27.891198&end=2022-08-30T04%3A56%3A27.891198 => generated 112 bytes in 652 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 04:56:29.033812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:29.037810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:29.062022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:29.068816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:29.071588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:29.072914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:29.084409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:29.085280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:29.422739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:29.432327 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8f89187-c2d7-413e-a873-bbde1b64a490 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.406451 Aug 29 04:56:29.433962 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 775/1625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:29 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:29.456651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:29.457489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:29.463986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:29.483552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:29.484848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:29.486274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:29.487628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:29.491239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:29.491774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:29.739177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:29.752785 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a9994b3-97af-4ea8-961f-3c403117f80c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1558 microversion: 2.1 time: 0.306568 Aug 29 04:56:29.753662 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 776/1626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:29 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1558 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:29.774861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c98f8f7f-37c5-4e5a-b338-e1ad84f79ae4 req-54c88a34-ea05-4230-bf66-6bed7c9aebd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9c6427-61b8-4bc8-8916-7f16bfab3481", "name": "network-vif-deleted", "tag": "d1e67a19-a229-4469-8585-f4f9bb1b7a2f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:29.793707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c98f8f7f-37c5-4e5a-b338-e1ad84f79ae4 req-54c88a34-ea05-4230-bf66-6bed7c9aebd7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:29.795521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c98f8f7f-37c5-4e5a-b338-e1ad84f79ae4 req-54c88a34-ea05-4230-bf66-6bed7c9aebd7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:29.796200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c98f8f7f-37c5-4e5a-b338-e1ad84f79ae4 req-54c88a34-ea05-4230-bf66-6bed7c9aebd7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:29.817566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c98f8f7f-37c5-4e5a-b338-e1ad84f79ae4 req-54c88a34-ea05-4230-bf66-6bed7c9aebd7 service nova] Creating event network-vif-deleted:d1e67a19-a229-4469-8585-f4f9bb1b7a2f for instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 on n-h1-854119-9 Aug 29 04:56:29.833878 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c98f8f7f-37c5-4e5a-b338-e1ad84f79ae4 req-54c88a34-ea05-4230-bf66-6bed7c9aebd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063083 Aug 29 04:56:29.838216 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 777/1627] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:29.848963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5828463a-8abc-4c51-a80b-9525715425bf tempest-TenantUsagesNegativeTestJSON-862051982 tempest-TenantUsagesNegativeTestJSON-862051982-project-admin] Calling method '.version_select at 0x7f1ab956e940>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:29.875448 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5828463a-8abc-4c51-a80b-9525715425bf tempest-TenantUsagesNegativeTestJSON-862051982 tempest-TenantUsagesNegativeTestJSON-862051982-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5828463a-8abc-4c51-a80b-9525715425bf tempest-TenantUsagesNegativeTestJSON-862051982 tempest-TenantUsagesNegativeTestJSON-862051982-project-admin] Request method failure captured: Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-simple-tenant-usage/886e0e7fb9214c76a0c41f5473f06dc1?start=2022-08-30T04%3A56%3A27.891198&end=2022-08-28T04%3A56%3A27.891198 HTTP/1.1 Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEb7pfc3zaw2wxN3-JHsCmfYH5XKtvEzLLHNp5WQ9J_WE_41-A2ejsvC06icE1eNVI5fsz8wvyb0Fx_cc68Xu7jmPigXzwl5z66ra0IBw-HAZav7pIpTR-j-45owRdWYEbUnPx97ntIlRWM0t_JizL7TWW7iSIXKMIM7PHnOObgT7CE Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 225cc79574704542a58ea3e0e01f5e34 Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-862051982 Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 04:56:29.904708 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/225cc79574704542a58ea3e0e01f5e34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/225cc79574704542a58ea3e0e01f5e34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_225cc79574704542a58ea3e0e01f5e34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/225cc79574704542a58ea3e0e01f5e34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-862051982 Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 225cc79574704542a58ea3e0e01f5e34 Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-862051982 Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TenantUsagesNegativeTestJSON-862051982-project-admin Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ae03d72dfc80464e87ac4d724f222767 Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-862051982-project-admin Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid start time. The start time cannot occur after the end time. Aug 29 04:56:29.906533 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '886e0e7fb9214c76a0c41f5473f06dc1'} Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 04:56:29.912520 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5828463a-8abc-4c51-a80b-9525715425bf tempest-TenantUsagesNegativeTestJSON-862051982 tempest-TenantUsagesNegativeTestJSON-862051982-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:29.915468 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5828463a-8abc-4c51-a80b-9525715425bf tempest-TenantUsagesNegativeTestJSON-862051982 tempest-TenantUsagesNegativeTestJSON-862051982-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/886e0e7fb9214c76a0c41f5473f06dc1?start=2022-08-30T04%3A56%3A27.891198&end=2022-08-28T04%3A56%3A27.891198" status: 400 len: 111 microversion: 2.1 time: 0.066781 Aug 29 04:56:29.916592 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 778/1628] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Aug 29 04:56:29 2022] GET /compute/v2.1/os-simple-tenant-usage/886e0e7fb9214c76a0c41f5473f06dc1?start=2022-08-30T04%3A56%3A27.891198&end=2022-08-28T04%3A56%3A27.891198 => generated 111 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:56:29.931787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:29.932542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: dd9c6427-61b8-4bc8-8916-7f16bfab3481] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:29.959635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:29.961907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:29.962685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:29.963773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:29.965903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:29.967191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:29.996559 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] HTTP exception thrown: Instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 could not be found. Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Request method failure captured: Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 HTTP/1.1 Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWQpR8N-dgIdrYZKNehBv386hIuzwDZVjud4eNKGReTfSDZh3qktjqbNi7vLP1La1xb2PlKKddPKNO26QHY-rMzrRnKXCQ0cOQdfXRkd1wXpaJgeZgMCrxU6wh26uWfcSRwGzUYvjj61-SWp1FNxbbZU48RiTETHfcr7OqkUI9iuCg Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 750d30e9d0ec4122a143ec01fd2c1a94 Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:29.999995 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_750d30e9d0ec4122a143ec01fd2c1a94", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 750d30e9d0ec4122a143ec01fd2c1a94 Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-MigrationsAdminTest-1258804824-project Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4fbcb22f6bfb44e7b149c0b9e06014b8 Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-MigrationsAdminTest-1258804824-project Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 could not be found. Aug 29 04:56:30.001973 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'dd9c6427-61b8-4bc8-8916-7f16bfab3481'} Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 could not be found. Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:30.003048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 could not be found. Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 could not be found. Aug 29 04:56:30.007377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:30.010402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Returning 404 to user: Instance dd9c6427-61b8-4bc8-8916-7f16bfab3481 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:30.010402 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28a57150-6a84-4482-ad78-3cd4283fab86 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481" status: 404 len: 111 microversion: 2.1 time: 0.091729 Aug 29 04:56:30.010402 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 779/1629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:29 2022] GET /compute/v2.1/servers/dd9c6427-61b8-4bc8-8916-7f16bfab3481 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:30.014818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b25fcd20-2897-4261-a358-9ed44238e2f1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:30.021560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b25fcd20-2897-4261-a358-9ed44238e2f1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:30.031815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25fcd20-2897-4261-a358-9ed44238e2f1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:30.032480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25fcd20-2897-4261-a358-9ed44238e2f1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:30.035901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25fcd20-2897-4261-a358-9ed44238e2f1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:30.035901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25fcd20-2897-4261-a358-9ed44238e2f1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:30.036591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25fcd20-2897-4261-a358-9ed44238e2f1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:30.039471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25fcd20-2897-4261-a358-9ed44238e2f1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:30.149495 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b25fcd20-2897-4261-a358-9ed44238e2f1 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144448 Aug 29 04:56:30.150468 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 780/1630] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 04:56:30 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:30.520673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d65a67ff-90a4-40f5-923a-78a608f02652 tempest-TenantUsagesNegativeTestJSON-1715067852 tempest-TenantUsagesNegativeTestJSON-1715067852-project] Calling method '.version_select at 0x7f1ab951f5e0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:30.523437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d65a67ff-90a4-40f5-923a-78a608f02652 tempest-TenantUsagesNegativeTestJSON-1715067852 tempest-TenantUsagesNegativeTestJSON-1715067852-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '99d089b2ffd0480e924efdbf02110865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886e0e7fb9214c76a0c41f5473f06dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d65a67ff-90a4-40f5-923a-78a608f02652 tempest-TenantUsagesNegativeTestJSON-1715067852 tempest-TenantUsagesNegativeTestJSON-1715067852-project] Request method failure captured: Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T04%3A56%3A27.891198&end=2022-08-30T04%3A56%3A27.891198&detailed=1 HTTP/1.1 Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEb64pUg-Uy0SahPOY85X9SFgsv7u-LYg11dx4oMHjMKSkJTF4I_b28JkBbFXtPDwZUJttCgry8aPZy3EVhyvwwDgmigko781nHlUTLIBWzAdFxNSG-JcfhAGfabmiH3mQ-IeGL-D0pmHPUc1i9SNrtY2S0ZpoW0g6AhcvYjgjYKieQ Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 886e0e7fb9214c76a0c41f5473f06dc1 Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1715067852 Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:30.525570 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/886e0e7fb9214c76a0c41f5473f06dc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/886e0e7fb9214c76a0c41f5473f06dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_886e0e7fb9214c76a0c41f5473f06dc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/886e0e7fb9214c76a0c41f5473f06dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1715067852 Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 886e0e7fb9214c76a0c41f5473f06dc1 Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1715067852 Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TenantUsagesNegativeTestJSON-1715067852-project Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 99d089b2ffd0480e924efdbf02110865 Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1715067852-project Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: action_args: {} Aug 29 04:56:30.527271 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:56:30.528606 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:56:30.531910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:56:30.533659 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 04:56:30.533659 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:30.533659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d65a67ff-90a4-40f5-923a-78a608f02652 tempest-TenantUsagesNegativeTestJSON-1715067852 tempest-TenantUsagesNegativeTestJSON-1715067852-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:30.533659 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d65a67ff-90a4-40f5-923a-78a608f02652 tempest-TenantUsagesNegativeTestJSON-1715067852 tempest-TenantUsagesNegativeTestJSON-1715067852-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T04%3A56%3A27.891198&end=2022-08-30T04%3A56%3A27.891198&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.367152 Aug 29 04:56:30.533659 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 781/1631] 10.222.0.20 () {58 vars in 1335 bytes} [Mon Aug 29 04:56:30 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T04%3A56%3A27.891198&end=2022-08-30T04%3A56%3A27.891198&detailed=1 => generated 123 bytes in 368 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:30.557764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:30.558269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:30.574604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:30.575097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:30.575569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:30.576848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:30.580615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:30.581689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:30.613227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:56:30.757696 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39d1508c-6f30-4e03-a416-a7d9892bb569 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 204 len: 0 microversion: 2.1 time: 0.214400 Aug 29 04:56:30.758858 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 782/1632] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:56:30 2022] DELETE /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:56:30.771692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:30.773565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:30.795861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:30.798112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:30.799716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:30.802992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:30.803658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:30.804549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:31.176453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:31.207314 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-94fc71a4-e039-4037-a378-8d8a3db3fb59 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.447039 Aug 29 04:56:31.210051 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 783/1633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:30 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:31.214603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:31.225171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:31.230159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:31.251605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:31.253419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:31.254242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:31.257701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:31.258388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:31.260843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:31.488001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:31.501139 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1413cb8b-4bb6-403f-a9eb-58aa177b0e09 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1467 microversion: 2.1 time: 0.285034 Aug 29 04:56:31.502078 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 784/1634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:31 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1467 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:31.549511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:31.550444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:31.552773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=16 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:31.566433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:31.567276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:31.577127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:31.578157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:31.579606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:31.584092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:31.986029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:31.990445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:32.005841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:32.013852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:32.018196 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-370a03ab-5e1d-46f0-9622-49b4b6374db7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 2939 microversion: 2.32 time: 0.472581 Aug 29 04:56:32.033221 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 785/1635] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:31 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 2939 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:56:32.057488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-484fda83-48ad-4684-9dd9-a8ca67dee6b9 req-80dfaf54-18f5-4555-9b62-8f5217c80be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e3b162-b20c-46a9-9839-dca9a18ce982", "tag": "a062dfc6-5a22-4087-960a-ef508765cdb8"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:32.082674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-484fda83-48ad-4684-9dd9-a8ca67dee6b9 req-80dfaf54-18f5-4555-9b62-8f5217c80be1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:32.085968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-484fda83-48ad-4684-9dd9-a8ca67dee6b9 req-80dfaf54-18f5-4555-9b62-8f5217c80be1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:32.088874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-484fda83-48ad-4684-9dd9-a8ca67dee6b9 req-80dfaf54-18f5-4555-9b62-8f5217c80be1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:32.104939 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-484fda83-48ad-4684-9dd9-a8ca67dee6b9 req-80dfaf54-18f5-4555-9b62-8f5217c80be1 service nova] Creating event network-changed:a062dfc6-5a22-4087-960a-ef508765cdb8 for instance f1e3b162-b20c-46a9-9839-dca9a18ce982 on n-h2-854119-9 Aug 29 04:56:32.112047 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-484fda83-48ad-4684-9dd9-a8ca67dee6b9 req-80dfaf54-18f5-4555-9b62-8f5217c80be1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077173 Aug 29 04:56:32.112979 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 786/1636] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:32.119057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74331046-4382-4e0b-b696-2252ecf88039 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:32.119558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-74331046-4382-4e0b-b696-2252ecf88039 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:32.126876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74331046-4382-4e0b-b696-2252ecf88039 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:32.127471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74331046-4382-4e0b-b696-2252ecf88039 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:32.128198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74331046-4382-4e0b-b696-2252ecf88039 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:32.129231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74331046-4382-4e0b-b696-2252ecf88039 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:32.129781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74331046-4382-4e0b-b696-2252ecf88039 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:32.130219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74331046-4382-4e0b-b696-2252ecf88039 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:32.336970 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-74331046-4382-4e0b-b696-2252ecf88039 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.222494 Aug 29 04:56:32.339125 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 787/1637] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 29 04:56:32 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf/os-interface => generated 1832 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:32.775863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7817e81e-cc2e-473c-b35c-d8e0cbc37428 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:32.782909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7817e81e-cc2e-473c-b35c-d8e0cbc37428 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:32.783476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7817e81e-cc2e-473c-b35c-d8e0cbc37428 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:32.783914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7817e81e-cc2e-473c-b35c-d8e0cbc37428 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:32.791908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7817e81e-cc2e-473c-b35c-d8e0cbc37428 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:32.792771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7817e81e-cc2e-473c-b35c-d8e0cbc37428 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:32.793460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7817e81e-cc2e-473c-b35c-d8e0cbc37428 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:32.875203 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7817e81e-cc2e-473c-b35c-d8e0cbc37428 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.534812 Aug 29 04:56:32.876434 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 788/1638] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:56:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:32.883415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:32.884417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:32.893497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:32.895359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:32.895969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:32.896881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:32.897500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:32.909871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:33.599137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:33.610513 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d37b567-07fb-452c-907e-9070dbc0f4da tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.732611 Aug 29 04:56:33.614890 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 789/1639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:32 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:33.638106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:33.638808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:33.666082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:33.670314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:33.671696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:33.672971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:33.675591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:33.676759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=5 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:33.677590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:33.687638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=17 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:34.182475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:34.193079 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2c6b15b4-053c-432c-9148-c489ed4eaa1e tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1467 microversion: 2.1 time: 0.577163 Aug 29 04:56:34.201305 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 790/1640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:33 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1467 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:34.215982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24e37689-82c3-4408-8275-1f84f51ce4c8 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:34.220100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e37689-82c3-4408-8275-1f84f51ce4c8 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:34.220888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e37689-82c3-4408-8275-1f84f51ce4c8 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:34.221564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e37689-82c3-4408-8275-1f84f51ce4c8 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:34.223170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e37689-82c3-4408-8275-1f84f51ce4c8 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:34.226987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e37689-82c3-4408-8275-1f84f51ce4c8 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:34.227782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24e37689-82c3-4408-8275-1f84f51ce4c8 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:34.296556 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-24e37689-82c3-4408-8275-1f84f51ce4c8 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.093783 Aug 29 04:56:34.303152 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 791/1641] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 29 04:56:34 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:34.314937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-17bcd6b5-acac-4bae-8c98-00e51bcde839 req-ff32eb38-3284-49fe-ab76-7cb1fe730097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c9b159-0dc2-4520-95ea-01bea5848a83", "name": "network-vif-unplugged", "status": "completed", "tag": "ab2261dd-06cc-4525-b84d-5964ae7d42b7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:34.352374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-17bcd6b5-acac-4bae-8c98-00e51bcde839 req-ff32eb38-3284-49fe-ab76-7cb1fe730097 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:34.360855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-17bcd6b5-acac-4bae-8c98-00e51bcde839 req-ff32eb38-3284-49fe-ab76-7cb1fe730097 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:34.361462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-17bcd6b5-acac-4bae-8c98-00e51bcde839 req-ff32eb38-3284-49fe-ab76-7cb1fe730097 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:34.392397 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-17bcd6b5-acac-4bae-8c98-00e51bcde839 req-ff32eb38-3284-49fe-ab76-7cb1fe730097 service nova] Creating event network-vif-unplugged:ab2261dd-06cc-4525-b84d-5964ae7d42b7 for instance d7c9b159-0dc2-4520-95ea-01bea5848a83 on n-h1-854119-9 Aug 29 04:56:34.436469 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-17bcd6b5-acac-4bae-8c98-00e51bcde839 req-ff32eb38-3284-49fe-ab76-7cb1fe730097 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108653 Aug 29 04:56:34.441375 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 792/1642] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:34.446788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a861e3f-8a0e-47c6-a662-208dd335ccbd tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:34.464105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a861e3f-8a0e-47c6-a662-208dd335ccbd tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:34.474131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a861e3f-8a0e-47c6-a662-208dd335ccbd tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:34.475899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a861e3f-8a0e-47c6-a662-208dd335ccbd tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:34.479428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a861e3f-8a0e-47c6-a662-208dd335ccbd tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:34.488823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a861e3f-8a0e-47c6-a662-208dd335ccbd tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:34.489599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a861e3f-8a0e-47c6-a662-208dd335ccbd tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:34.588628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a861e3f-8a0e-47c6-a662-208dd335ccbd tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.145579 Aug 29 04:56:34.593626 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 793/1643] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:56:34 2022] GET /compute/v2.1/os-services => generated 944 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:34.605018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-02d7bfb3-e970-4e4a-a363-3c5b1f5d8a54 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:34.610710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02d7bfb3-e970-4e4a-a363-3c5b1f5d8a54 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:34.616384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02d7bfb3-e970-4e4a-a363-3c5b1f5d8a54 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:34.616770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02d7bfb3-e970-4e4a-a363-3c5b1f5d8a54 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:34.617582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02d7bfb3-e970-4e4a-a363-3c5b1f5d8a54 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:34.621469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02d7bfb3-e970-4e4a-a363-3c5b1f5d8a54 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:34.622013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02d7bfb3-e970-4e4a-a363-3c5b1f5d8a54 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:34.689553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-02d7bfb3-e970-4e4a-a363-3c5b1f5d8a54 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-854119-9&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.092004 Aug 29 04:56:34.691545 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 794/1644] 10.222.0.20 () {58 vars in 1194 bytes} [Mon Aug 29 04:56:34 2022] GET /compute/v2.1/os-services?host=n-d-854119-9&binary=xxx => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 04:56:34.703595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:34.704363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:34.733537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:34.734028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:34.734454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:34.737530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:34.738047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:34.738489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:35.156702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:35.182970 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03f85db2-bf3a-49a6-b9a4-f85a7fc5a8f3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.490223 Aug 29 04:56:35.188272 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 795/1645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:34 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:35.198373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-35f5f02c-0f8c-4c37-9d8e-961329e21904 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:35.202964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f5f02c-0f8c-4c37-9d8e-961329e21904 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:35.203824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f5f02c-0f8c-4c37-9d8e-961329e21904 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:35.204568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f5f02c-0f8c-4c37-9d8e-961329e21904 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:35.205745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f5f02c-0f8c-4c37-9d8e-961329e21904 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:35.206710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f5f02c-0f8c-4c37-9d8e-961329e21904 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:35.207750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f5f02c-0f8c-4c37-9d8e-961329e21904 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:35.306238 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-35f5f02c-0f8c-4c37-9d8e-961329e21904 tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.111521 Aug 29 04:56:35.307661 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 796/1646] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:56:35 2022] GET /compute/v2.1/os-services => generated 944 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:35.312742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ea873183-9bb1-4f30-aa82-100c22dccdaa req-04c33257-42e6-4144-89aa-acd1842cafb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ffbebb-969a-4762-a339-032f7da39897", "name": "network-vif-deleted", "tag": "e3cc9390-436f-423e-9d4e-3f5a7740bcc5"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:35.350964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ea873183-9bb1-4f30-aa82-100c22dccdaa req-04c33257-42e6-4144-89aa-acd1842cafb4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:35.358914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ea873183-9bb1-4f30-aa82-100c22dccdaa req-04c33257-42e6-4144-89aa-acd1842cafb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:35.362475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ea873183-9bb1-4f30-aa82-100c22dccdaa req-04c33257-42e6-4144-89aa-acd1842cafb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:35.377971 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ea873183-9bb1-4f30-aa82-100c22dccdaa req-04c33257-42e6-4144-89aa-acd1842cafb4 service nova] Creating event network-vif-deleted:e3cc9390-436f-423e-9d4e-3f5a7740bcc5 for instance 53ffbebb-969a-4762-a339-032f7da39897 on n-h1-854119-9 Aug 29 04:56:35.384356 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ea873183-9bb1-4f30-aa82-100c22dccdaa req-04c33257-42e6-4144-89aa-acd1842cafb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075106 Aug 29 04:56:35.385635 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 797/1647] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:35.396719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:35.397769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:35.414097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:35.416829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:35.417343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:35.418628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:35.419543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:35.420021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:35.527127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:35.528223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:35.529391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:35.530561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lazy-loading 'fault' on Instance uuid 53ffbebb-969a-4762-a339-032f7da39897 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:56:35.630412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbcb22f6bfb44e7b149c0b9e06014b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750d30e9d0ec4122a143ec01fd2c1a94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:35.639166 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c920d563-8aa9-4a10-8c80-362a5cb4534c tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 200 len: 1302 microversion: 2.1 time: 0.247015 Aug 29 04:56:35.656688 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 798/1648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:35 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 1302 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:35.662341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f89fab22-ac5b-49a7-8573-2f3e20d65f6d tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:35.666490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f89fab22-ac5b-49a7-8573-2f3e20d65f6d tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:35.667190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f89fab22-ac5b-49a7-8573-2f3e20d65f6d tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:35.667848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f89fab22-ac5b-49a7-8573-2f3e20d65f6d tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:35.668852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f89fab22-ac5b-49a7-8573-2f3e20d65f6d tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:35.669887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f89fab22-ac5b-49a7-8573-2f3e20d65f6d tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:35.670521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f89fab22-ac5b-49a7-8573-2f3e20d65f6d tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:35.705405 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f89fab22-ac5b-49a7-8573-2f3e20d65f6d tempest-ServicesAdminNegativeTestJSON-642407711 tempest-ServicesAdminNegativeTestJSON-642407711-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.047505 Aug 29 04:56:35.706240 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 799/1649] 10.222.0.20 () {58 vars in 1198 bytes} [Mon Aug 29 04:56:35 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:56:36.270953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b3da3fb0-b99e-4d14-8e3a-d84fa7a722f3 tempest-ServicesAdminNegativeTestJSON-486858609 tempest-ServicesAdminNegativeTestJSON-486858609-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:36.274996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b3da3fb0-b99e-4d14-8e3a-d84fa7a722f3 tempest-ServicesAdminNegativeTestJSON-486858609 tempest-ServicesAdminNegativeTestJSON-486858609-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '76db8ff13ac3484fa8edce8274a4d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914ec481c9445a6a13727c499289c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b3da3fb0-b99e-4d14-8e3a-d84fa7a722f3 tempest-ServicesAdminNegativeTestJSON-486858609 tempest-ServicesAdminNegativeTestJSON-486858609-project] Request method failure captured: Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEb-MiucwyHzUCJ6wzhHKpdrL8L1ggGGywafLZA68xuiyuQzTHP2XxkrDLXLdQ-T4CWWiELIcf9nJNbev3fMCHTagjQUAaWeDetOFnk6V2yeEEvVd0X2OzLnGKjDAUUTVT9pr1230LGl30YPZY4k6UvDjuCMQS9LwQyMb4JLdGyio1o Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 7914ec481c9445a6a13727c499289c0f Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-486858609 Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:36.279745 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7914ec481c9445a6a13727c499289c0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7914ec481c9445a6a13727c499289c0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7914ec481c9445a6a13727c499289c0f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7914ec481c9445a6a13727c499289c0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-486858609 Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 7914ec481c9445a6a13727c499289c0f Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-486858609 Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServicesAdminNegativeTestJSON-486858609-project Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 76db8ff13ac3484fa8edce8274a4d871 Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-486858609-project Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 04:56:36.281286 n-d-854119-9 devstack@n-api.service[128871]: action_args: {} Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 04:56:36.282144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 04:56:36.283394 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:36.287803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b3da3fb0-b99e-4d14-8e3a-d84fa7a722f3 tempest-ServicesAdminNegativeTestJSON-486858609 tempest-ServicesAdminNegativeTestJSON-486858609-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:36.288698 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b3da3fb0-b99e-4d14-8e3a-d84fa7a722f3 tempest-ServicesAdminNegativeTestJSON-486858609 tempest-ServicesAdminNegativeTestJSON-486858609-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.573611 Aug 29 04:56:36.291012 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 800/1650] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:56:35 2022] GET /compute/v2.1/os-services => generated 112 bytes in 576 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:36.307224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:36.308021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:36.328735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:36.330101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:36.330772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:36.331697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:36.332857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:36.333538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:36.568061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:36.578160 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1a0e719-346f-4387-b8d8-1011547cb904 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.282588 Aug 29 04:56:36.592146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 801/1651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:36 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:36.599202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-03ce242a-6d6f-4c62-875a-e8e3dd0e29fb req-9c34ced8-61a8-497b-b285-79ff0d6b19c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c9b159-0dc2-4520-95ea-01bea5848a83", "tag": "ab2261dd-06cc-4525-b84d-5964ae7d42b7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:36.611084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-03ce242a-6d6f-4c62-875a-e8e3dd0e29fb req-9c34ced8-61a8-497b-b285-79ff0d6b19c4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:36.611562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-03ce242a-6d6f-4c62-875a-e8e3dd0e29fb req-9c34ced8-61a8-497b-b285-79ff0d6b19c4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:36.612033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-03ce242a-6d6f-4c62-875a-e8e3dd0e29fb req-9c34ced8-61a8-497b-b285-79ff0d6b19c4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:36.625430 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-03ce242a-6d6f-4c62-875a-e8e3dd0e29fb req-9c34ced8-61a8-497b-b285-79ff0d6b19c4 service nova] Creating event network-changed:ab2261dd-06cc-4525-b84d-5964ae7d42b7 for instance d7c9b159-0dc2-4520-95ea-01bea5848a83 on n-h1-854119-9 Aug 29 04:56:36.632144 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-03ce242a-6d6f-4c62-875a-e8e3dd0e29fb req-9c34ced8-61a8-497b-b285-79ff0d6b19c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050144 Aug 29 04:56:36.633795 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 802/1652] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:37.103109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b2e2e48-28fb-4919-bb47-f9e6aabeb446 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Calling method '.version_select at 0x7f1ab9653c10>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:39.595000 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-7b2e2e48-28fb-4919-bb47-f9e6aabeb446 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] HTTP exception thrown: Image not found. Aug 29 04:56:39.615795 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-367a21ce-107f-489c-91f6-a770424c6290 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 15.904300 Aug 29 04:56:39.616542 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 851/1653] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:23 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 15908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:39.627833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:39.633251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] [instance: 53ffbebb-969a-4762-a339-032f7da39897] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b2e2e48-28fb-4919-bb47-f9e6aabeb446 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Request method failure captured: Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/images/972fb4c0-ffae-40ec-941d-255bb54964d4/metadata/os_distro HTTP/1.1 Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcEdFE8SJTQFkAF2MIpY4HPv4KPtQ1w1UT3n0SZowVTztNMczhaRVlumo_BKaMiRWgcRNywnD9hLsFi4_5VVJTsKzvJjJpiEbY8tXZEvXMQESOBdDpHZw8e2mT6yKY2PI-YpmwyhQ0lp1FQiCjoADY2jDj11lUGK6H2B8obK7KR5Yk Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:56:39.635809 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e7fa5ab609cc44e8846bb37d271acd6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4a3e05036f02481cbb7cc37862b57533 Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'image_id': '972fb4c0-ffae-40ec-941d-255bb54964d4', 'id': 'os_distro'} Aug 29 04:56:39.637621 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:39.642966 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 972fb4c0-ffae-40ec-941d-255bb54964d4 Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:39.644551 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 972fb4c0-ffae-40ec-941d-255bb54964d4 could not be found. Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:39.646149 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.648464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b2e2e48-28fb-4919-bb47-f9e6aabeb446 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:39.653070 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b2e2e48-28fb-4919-bb47-f9e6aabeb446 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] 10.222.0.20 "DELETE /compute/v2.1/images/972fb4c0-ffae-40ec-941d-255bb54964d4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 3.002156 Aug 29 04:56:39.653070 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 803/1654] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Aug 29 04:56:36 2022] DELETE /compute/v2.1/images/972fb4c0-ffae-40ec-941d-255bb54964d4/metadata/os_distro => generated 62 bytes in 3004 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:56:39.653070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:39.653070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:39.662551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:39.663062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:39.663501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:39.665086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:39.666333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:39.666476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:39.666756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:39.666930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:39.671120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:39.672049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:39.674300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:39.674942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:39.712079 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] HTTP exception thrown: Instance 53ffbebb-969a-4762-a339-032f7da39897 could not be found. Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Request method failure captured: Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 HTTP/1.1 Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWQpR8N-dgIdrYZKNehBv386hIuzwDZVjud4eNKGReTfSDZh3qktjqbNi7vLP1La1xb2PlKKddPKNO26QHY-rMzrRnKXCQ0cOQdfXRkd1wXpaJgeZgMCrxU6wh26uWfcSRwGzUYvjj61-SWp1FNxbbZU48RiTETHfcr7OqkUI9iuCg Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 750d30e9d0ec4122a143ec01fd2c1a94 Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:39.713995 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_750d30e9d0ec4122a143ec01fd2c1a94", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/750d30e9d0ec4122a143ec01fd2c1a94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 750d30e9d0ec4122a143ec01fd2c1a94 Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-MigrationsAdminTest-1258804824 Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-MigrationsAdminTest-1258804824-project Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4fbcb22f6bfb44e7b149c0b9e06014b8 Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-MigrationsAdminTest-1258804824-project Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 53ffbebb-969a-4762-a339-032f7da39897 could not be found. Aug 29 04:56:39.715796 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '53ffbebb-969a-4762-a339-032f7da39897'} Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ffbebb-969a-4762-a339-032f7da39897 could not be found. Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:39.716663 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ffbebb-969a-4762-a339-032f7da39897 could not be found. Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ffbebb-969a-4762-a339-032f7da39897 could not be found. Aug 29 04:56:39.717995 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.722855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] Returning 404 to user: Instance 53ffbebb-969a-4762-a339-032f7da39897 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:39.725540 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ff75b81-fc7c-4843-b460-74fbbf691d28 tempest-MigrationsAdminTest-1258804824 tempest-MigrationsAdminTest-1258804824-project] 10.222.0.20 "GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897" status: 404 len: 111 microversion: 2.1 time: 0.107412 Aug 29 04:56:39.730438 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 852/1655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:39 2022] GET /compute/v2.1/servers/53ffbebb-969a-4762-a339-032f7da39897 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:56:39.738155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0789567e-4bf9-4c3e-b65d-4ed3fad98546 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Calling method '.version_select at 0x7f1abd8520d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:39.828061 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-0789567e-4bf9-4c3e-b65d-4ed3fad98546 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] HTTP exception thrown: Image not found. Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0789567e-4bf9-4c3e-b65d-4ed3fad98546 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Request method failure captured: Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/images/e11c7dca-4576-4bc9-b717-c476088e9dec/metadata/os_version HTTP/1.1 Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEcEdFE8SJTQFkAF2MIpY4HPv4KPtQ1w1UT3n0SZowVTztNMczhaRVlumo_BKaMiRWgcRNywnD9hLsFi4_5VVJTsKzvJjJpiEbY8tXZEvXMQESOBdDpHZw8e2mT6yKY2PI-YpmwyhQ0lp1FQiCjoADY2jDj11lUGK6H2B8obK7KR5Yk Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:39.844599 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e7fa5ab609cc44e8846bb37d271acd6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4a3e05036f02481cbb7cc37862b57533 Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'image_id': 'e11c7dca-4576-4bc9-b717-c476088e9dec', 'id': 'os_version'} Aug 29 04:56:39.848518 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:39.850762 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e11c7dca-4576-4bc9-b717-c476088e9dec Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:39.858213 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e11c7dca-4576-4bc9-b717-c476088e9dec could not be found. Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:39.862297 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 04:56:39.870599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:39.897512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0789567e-4bf9-4c3e-b65d-4ed3fad98546 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:39.904848 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0789567e-4bf9-4c3e-b65d-4ed3fad98546 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] 10.222.0.20 "GET /compute/v2.1/images/e11c7dca-4576-4bc9-b717-c476088e9dec/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.172669 Aug 29 04:56:39.944790 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 853/1656] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Aug 29 04:56:39 2022] GET /compute/v2.1/images/e11c7dca-4576-4bc9-b717-c476088e9dec/metadata/os_version => generated 62 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:56:40.000348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-29eb1378-9ac3-4a21-90e7-c01c0003127d tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Calling method '.version_select at 0x7f1abd8af8b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:40.054888 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-29eb1378-9ac3-4a21-90e7-c01c0003127d tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] HTTP exception thrown: Image not found. Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-29eb1378-9ac3-4a21-90e7-c01c0003127d tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Request method failure captured: Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/images/d8fa82e6-dac7-495a-b4d7-50d93e54374a/metadata HTTP/1.1 Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEcEdFE8SJTQFkAF2MIpY4HPv4KPtQ1w1UT3n0SZowVTztNMczhaRVlumo_BKaMiRWgcRNywnD9hLsFi4_5VVJTsKzvJjJpiEbY8tXZEvXMQESOBdDpHZw8e2mT6yKY2PI-YpmwyhQ0lp1FQiCjoADY2jDj11lUGK6H2B8obK7KR5Yk Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:40.060597 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e7fa5ab609cc44e8846bb37d271acd6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4a3e05036f02481cbb7cc37862b57533 Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'image_id': 'd8fa82e6-dac7-495a-b4d7-50d93e54374a'} Aug 29 04:56:40.063541 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:40.065455 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d8fa82e6-dac7-495a-b4d7-50d93e54374a Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:40.068169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8fa82e6-dac7-495a-b4d7-50d93e54374a could not be found. Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:40.070738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 04:56:40.077592 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.083102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-29eb1378-9ac3-4a21-90e7-c01c0003127d tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:40.085597 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-29eb1378-9ac3-4a21-90e7-c01c0003127d tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] 10.222.0.20 "GET /compute/v2.1/images/d8fa82e6-dac7-495a-b4d7-50d93e54374a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.128335 Aug 29 04:56:40.087510 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 854/1657] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 04:56:39 2022] GET /compute/v2.1/images/d8fa82e6-dac7-495a-b4d7-50d93e54374a/metadata => generated 62 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:56:40.106525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-acac1443-3989-4d2a-ba58-e747dd6806a4 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Action: 'update_all', calling method: .version_select at 0x7f1abd852280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:40.141619 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-acac1443-3989-4d2a-ba58-e747dd6806a4 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] HTTP exception thrown: Image not found. Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-acac1443-3989-4d2a-ba58-e747dd6806a4 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Request method failure captured: Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/images/5a7d0d1e-42ea-4ae1-b91e-0428d1a1729f/metadata HTTP/1.1 Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 57 Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEcEdFE8SJTQFkAF2MIpY4HPv4KPtQ1w1UT3n0SZowVTztNMczhaRVlumo_BKaMiRWgcRNywnD9hLsFi4_5VVJTsKzvJjJpiEbY8tXZEvXMQESOBdDpHZw8e2mT6yKY2PI-YpmwyhQ0lp1FQiCjoADY2jDj11lUGK6H2B8obK7KR5Yk Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:40.143990 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e7fa5ab609cc44e8846bb37d271acd6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4a3e05036f02481cbb7cc37862b57533 Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:56:40.145480 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'image_id': '5a7d0d1e-42ea-4ae1-b91e-0428d1a1729f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:40.146349 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a7d0d1e-42ea-4ae1-b91e-0428d1a1729f Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:40.147670 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a7d0d1e-42ea-4ae1-b91e-0428d1a1729f could not be found. Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:40.148963 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 04:56:40.150361 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.151783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-acac1443-3989-4d2a-ba58-e747dd6806a4 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:40.154603 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-acac1443-3989-4d2a-ba58-e747dd6806a4 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] 10.222.0.20 "PUT /compute/v2.1/images/5a7d0d1e-42ea-4ae1-b91e-0428d1a1729f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058686 Aug 29 04:56:40.159810 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 855/1658] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 04:56:40 2022] PUT /compute/v2.1/images/5a7d0d1e-42ea-4ae1-b91e-0428d1a1729f/metadata => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:56:40.168401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39cf6254-2091-4d53-8fa4-c9eb16d07da7 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Action: 'update', calling method: .version_select at 0x7f1abd8cd040>, body: {"meta": {"os_distro": "alt"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:40.203402 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-39cf6254-2091-4d53-8fa4-c9eb16d07da7 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] HTTP exception thrown: Image not found. Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39cf6254-2091-4d53-8fa4-c9eb16d07da7 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Request method failure captured: Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/images/5c37194d-eb5c-467e-8e24-392b4951151a/metadata/os_distro HTTP/1.1 Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 30 Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEcEdFE8SJTQFkAF2MIpY4HPv4KPtQ1w1UT3n0SZowVTztNMczhaRVlumo_BKaMiRWgcRNywnD9hLsFi4_5VVJTsKzvJjJpiEbY8tXZEvXMQESOBdDpHZw8e2mT6yKY2PI-YpmwyhQ0lp1FQiCjoADY2jDj11lUGK6H2B8obK7KR5Yk Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:40.207727 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e7fa5ab609cc44e8846bb37d271acd6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4a3e05036f02481cbb7cc37862b57533 Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: {"meta": {"os_distro": "alt"}} Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 04:56:40.209651 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'image_id': '5c37194d-eb5c-467e-8e24-392b4951151a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:40.210734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5c37194d-eb5c-467e-8e24-392b4951151a Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:40.213793 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c37194d-eb5c-467e-8e24-392b4951151a could not be found. Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:40.215390 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 04:56:40.218166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.221544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:40.222645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39cf6254-2091-4d53-8fa4-c9eb16d07da7 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:40.226374 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39cf6254-2091-4d53-8fa4-c9eb16d07da7 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] 10.222.0.20 "PUT /compute/v2.1/images/5c37194d-eb5c-467e-8e24-392b4951151a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.063903 Aug 29 04:56:40.227835 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 856/1659] 10.222.0.20 () {60 vars in 1310 bytes} [Mon Aug 29 04:56:40 2022] PUT /compute/v2.1/images/5c37194d-eb5c-467e-8e24-392b4951151a/metadata/os_distro => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:56:40.238392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-171765f8-376c-4f83-a2ca-bfb2e4552bc8 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Action: 'create', calling method: .version_select at 0x7f1abd852820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:40.245997 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-66f9d4c8-9f8d-4a7d-9e89-8d96181e580a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.606594 Aug 29 04:56:40.246589 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 804/1660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:39 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:40.273620 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-171765f8-376c-4f83-a2ca-bfb2e4552bc8 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] HTTP exception thrown: Image not found. Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-171765f8-376c-4f83-a2ca-bfb2e4552bc8 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Request method failure captured: Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/images/4a029d31-dd30-4dfd-b87b-a3179b216704/metadata HTTP/1.1 Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 57 Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEcEdFE8SJTQFkAF2MIpY4HPv4KPtQ1w1UT3n0SZowVTztNMczhaRVlumo_BKaMiRWgcRNywnD9hLsFi4_5VVJTsKzvJjJpiEbY8tXZEvXMQESOBdDpHZw8e2mT6yKY2PI-YpmwyhQ0lp1FQiCjoADY2jDj11lUGK6H2B8obK7KR5Yk Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:40.275946 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e7fa5ab609cc44e8846bb37d271acd6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e7fa5ab609cc44e8846bb37d271acd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e7fa5ab609cc44e8846bb37d271acd6f Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447 Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4a3e05036f02481cbb7cc37862b57533 Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1916219447-project Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 04:56:40.277578 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'image_id': '4a029d31-dd30-4dfd-b87b-a3179b216704', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:40.278729 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4a029d31-dd30-4dfd-b87b-a3179b216704 Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:40.280107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4a029d31-dd30-4dfd-b87b-a3179b216704 could not be found. Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:40.281587 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 04:56:40.283070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:40.284742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-171765f8-376c-4f83-a2ca-bfb2e4552bc8 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:40.284742 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-171765f8-376c-4f83-a2ca-bfb2e4552bc8 tempest-ImagesMetadataNegativeTestJSON-1916219447 tempest-ImagesMetadataNegativeTestJSON-1916219447-project] 10.222.0.20 "POST /compute/v2.1/images/4a029d31-dd30-4dfd-b87b-a3179b216704/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047024 Aug 29 04:56:40.288605 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 857/1661] 10.222.0.20 () {60 vars in 1281 bytes} [Mon Aug 29 04:56:40 2022] POST /compute/v2.1/images/4a029d31-dd30-4dfd-b87b-a3179b216704/metadata => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:56:40.630948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-96cf8ea2-619f-46bc-bf63-deeeef040a43 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1ab9787550>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:40.710205 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-96cf8ea2-619f-46bc-bf63-deeeef040a43 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.082937 Aug 29 04:56:40.719295 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 805/1662] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:40 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:41.269917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:41.270708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:41.285315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:41.286209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:41.286880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:41.288113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:41.288813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:41.289496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:41.726962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b465ffef-593d-4c54-b5a9-4941985851a6 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd8e53a0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:41.788906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:41.805220 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4846c1c7-82a8-4e06-a01f-6fc7c265dd2f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.540705 Aug 29 04:56:41.808625 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 858/1663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:41 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:41.827630 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b465ffef-593d-4c54-b5a9-4941985851a6 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.105383 Aug 29 04:56:41.828919 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 806/1664] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:41 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:42.834446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:42.836166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:42.847725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cfff6b67-00ab-412b-a661-87c93760e670 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1ab9653b80>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:42.895398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:42.897405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:42.899619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:42.902150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:42.905938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:42.909582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:42.974461 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cfff6b67-00ab-412b-a661-87c93760e670 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1422 microversion: 2.1 time: 0.135289 Aug 29 04:56:42.975273 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 807/1665] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:42 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:43.372047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:43.380418 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-372fb2c6-e81a-4344-9a77-434798d05f7a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.553553 Aug 29 04:56:43.400336 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 859/1666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:42 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:43.989986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7453a008-7dc3-4b79-a229-aa4929ad4d68 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd8f38b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:44.106594 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7453a008-7dc3-4b79-a229-aa4929ad4d68 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1431 microversion: 2.1 time: 0.121429 Aug 29 04:56:44.107372 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 808/1667] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:43 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1431 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:44.123852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-26f6ae83-8122-4c25-82f3-09d315fdb771 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd90a8b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:44.195337 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-26f6ae83-8122-4c25-82f3-09d315fdb771 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 200 len: 1431 microversion: 2.1 time: 0.078321 Aug 29 04:56:44.198263 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 860/1668] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:44 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 1431 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:44.210483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:44.211340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:44.223158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:44.223757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:44.225541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:44.226888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:44.229636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:44.230461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:44.407296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:44.407897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:44.422518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:44.423632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:44.427364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:44.428394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:44.429429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:44.432566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:44.888651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:44.900509 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9c771820-6757-4c46-9105-f79e6dd60984 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1466 microversion: 2.1 time: 0.694697 Aug 29 04:56:44.908547 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 809/1669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:44 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1466 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:44.932534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2f5e8c8-f000-4cba-901b-4ea448c42066 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd8f1670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:45.003336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:45.026672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f61b8c5c-8416-4d2d-9dab-f4e9c4128472 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.624604 Aug 29 04:56:45.027258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 861/1670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:44 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:45.042442 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2f5e8c8-f000-4cba-901b-4ea448c42066 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/6e3fd38c-90a0-4677-991e-152affedd0a1" status: 200 len: 784 microversion: 2.1 time: 0.115618 Aug 29 04:56:45.044185 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 810/1671] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:44 2022] GET /compute/v2.1/images/6e3fd38c-90a0-4677-991e-152affedd0a1 => generated 784 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:45.057029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-775bd0b3-f5c9-4756-a329-9979fb444373 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:45.080772 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-775bd0b3-f5c9-4756-a329-9979fb444373 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028079 Aug 29 04:56:45.083912 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 862/1672] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:56:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:45.095135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-df0fdaf3-68e3-47cf-8349-a933a0c810d1 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd8f3700>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:45.686887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:45.957064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-edeb862e-0595-4504-8bea-47353fbd4b36 tempest-QuotaClassesAdminTestJSON-1049531284 tempest-QuotaClassesAdminTestJSON-1049531284-project-admin] Calling method '.version_select at 0x7f1abd8cd040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:45.993734 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-edeb862e-0595-4504-8bea-47353fbd4b36 tempest-QuotaClassesAdminTestJSON-1049531284 tempest-QuotaClassesAdminTestJSON-1049531284-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.369281 Aug 29 04:56:45.997141 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 863/1673] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Aug 29 04:56:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:46.021139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57e7471e-f5a2-4d97-8310-0bf876d9b049 tempest-QuotaClassesAdminTestJSON-1049531284 tempest-QuotaClassesAdminTestJSON-1049531284-project-admin] Action: 'update', calling method: .version_select at 0x7f1abd89b940>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:46.455395 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-df0fdaf3-68e3-47cf-8349-a933a0c810d1 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "DELETE /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 204 len: 0 microversion: 2.1 time: 1.364027 Aug 29 04:56:46.456039 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57e7471e-f5a2-4d97-8310-0bf876d9b049 tempest-QuotaClassesAdminTestJSON-1049531284 tempest-QuotaClassesAdminTestJSON-1049531284-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.451385 Aug 29 04:56:46.456722 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 811/1674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:45 2022] DELETE /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 0 bytes in 1366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:56:46.457086 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 864/1675] 10.222.0.20 () {60 vars in 1206 bytes} [Mon Aug 29 04:56:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:46.465097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ce417cc-a8a0-44ee-a42f-a95c99c0fad6 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd8cdd30>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:46.468067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:46.468817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:46.478493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:46.499956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:46.500657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:46.501518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:46.502082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:46.502705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:46.508657 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-5ce417cc-a8a0-44ee-a42f-a95c99c0fad6 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] HTTP exception thrown: Image not found. Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ce417cc-a8a0-44ee-a42f-a95c99c0fad6 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Request method failure captured: Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b HTTP/1.1 Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEbYl90PzS4I2eyVqT-PhVKT6cXiPfxIPpvMd-MSfOpHC_ZG7dB5-iwYkqkHRVlEpDxh_ebDJXW-ytbRobJ5-NqI1xjsXllC3D2X4sqAxQwD1Up5zXdDnl3DYkOg55xVBJAfur1LWiA2r0IbJFJYoMajOo49P3a2pWyklCQOUwEFH60 Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6baeb53030d84c5e8999a9653663ab34 Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerTestJSON-884282419 Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:56:46.523648 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6baeb53030d84c5e8999a9653663ab34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6baeb53030d84c5e8999a9653663ab34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6baeb53030d84c5e8999a9653663ab34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6baeb53030d84c5e8999a9653663ab34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerTestJSON-884282419 Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6baeb53030d84c5e8999a9653663ab34 Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-884282419 Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerTestJSON-884282419-project Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 236a9aeeb6f6493797a3c8fe6d6581d8 Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerTestJSON-884282419-project Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'c8b458c4-5e79-4f57-9599-2a6d6251099b'} Aug 29 04:56:46.525709 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:46.526850 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c8b458c4-5e79-4f57-9599-2a6d6251099b Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:56:46.532350 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8b458c4-5e79-4f57-9599-2a6d6251099b could not be found. Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:56:46.533957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ce417cc-a8a0-44ee-a42f-a95c99c0fad6 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:56:46.535497 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5ce417cc-a8a0-44ee-a42f-a95c99c0fad6 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 404 len: 62 microversion: 2.1 time: 0.064342 Aug 29 04:56:46.538948 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 865/1676] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:46 2022] GET /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:56:46.538948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-94b9b616-9b87-450e-a1ff-6aeb7dbf0ef9 tempest-QuotaClassesAdminTestJSON-1049531284 tempest-QuotaClassesAdminTestJSON-1049531284-project-admin] Calling method '.version_select at 0x7f1abd8529d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:46.556020 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-94b9b616-9b87-450e-a1ff-6aeb7dbf0ef9 tempest-QuotaClassesAdminTestJSON-1049531284 tempest-QuotaClassesAdminTestJSON-1049531284-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.028676 Aug 29 04:56:46.557044 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 866/1677] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Aug 29 04:56:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:46.561888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d68d1d8d-4219-4499-890e-edede73019cf tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1574645302"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:46.570503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d68d1d8d-4219-4499-890e-edede73019cf tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:46.591747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68d1d8d-4219-4499-890e-edede73019cf tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:46.592278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68d1d8d-4219-4499-890e-edede73019cf tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:46.592719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68d1d8d-4219-4499-890e-edede73019cf tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:46.593429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68d1d8d-4219-4499-890e-edede73019cf tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:46.593883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68d1d8d-4219-4499-890e-edede73019cf tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:46.594307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d68d1d8d-4219-4499-890e-edede73019cf tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:46.779792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:46.798463 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b8e7de9-1bff-44fb-ab8e-80e3089b2feb tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.332862 Aug 29 04:56:46.800802 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 812/1678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:46 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:46.815530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd89da84-220d-4090-9a5f-ec0e46df99bb tempest-QuotaClassesAdminTestJSON-1049531284 tempest-QuotaClassesAdminTestJSON-1049531284-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9787310>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:47.029263 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d68d1d8d-4219-4499-890e-edede73019cf tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "POST /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154/action" status: 202 len: 0 microversion: 2.1 time: 0.470846 Aug 29 04:56:47.032846 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 867/1679] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:56:46 2022] POST /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 04:56:47.043647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-abf02a60-477c-4b0e-b322-8f6609bc7ea5 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd896430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:47.101659 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-abf02a60-477c-4b0e-b322-8f6609bc7ea5 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.062370 Aug 29 04:56:47.111404 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 868/1680] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:47 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:47.130159 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd89da84-220d-4090-9a5f-ec0e46df99bb tempest-QuotaClassesAdminTestJSON-1049531284 tempest-QuotaClassesAdminTestJSON-1049531284-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.325786 Aug 29 04:56:47.132640 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 813/1681] 10.222.0.20 () {60 vars in 1206 bytes} [Mon Aug 29 04:56:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:47.829369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:47.830746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:47.851256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:47.852695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:47.854443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:47.856468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:47.857929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:47.858638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:48.119000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b75e477d-b231-47eb-8817-cdd26824ab7c tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd8f34c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:48.191998 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b75e477d-b231-47eb-8817-cdd26824ab7c tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.077866 Aug 29 04:56:48.194561 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 814/1682] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:48 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:48.615983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:48.641665 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a741133-7c94-4a30-90f7-66c6b0e789a2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 0.817956 Aug 29 04:56:48.658870 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 869/1683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:47 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:48.749675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-eb5a278d-63c3-4f6a-a112-aa919c3d6fad req-435f75a4-9313-4091-b41b-cf3fe21f0f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154", "name": "network-vif-unplugged", "status": "completed", "tag": "39ed18ba-56f8-4c3d-a711-deebbf9109d3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:48.769567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=13 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:48.811218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eb5a278d-63c3-4f6a-a112-aa919c3d6fad req-435f75a4-9313-4091-b41b-cf3fe21f0f22 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:48.811941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eb5a278d-63c3-4f6a-a112-aa919c3d6fad req-435f75a4-9313-4091-b41b-cf3fe21f0f22 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:48.812569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eb5a278d-63c3-4f6a-a112-aa919c3d6fad req-435f75a4-9313-4091-b41b-cf3fe21f0f22 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:48.863508 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-eb5a278d-63c3-4f6a-a112-aa919c3d6fad req-435f75a4-9313-4091-b41b-cf3fe21f0f22 service nova] Creating event network-vif-unplugged:39ed18ba-56f8-4c3d-a711-deebbf9109d3 for instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 on n-h1-854119-9 Aug 29 04:56:48.902032 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-eb5a278d-63c3-4f6a-a112-aa919c3d6fad req-435f75a4-9313-4091-b41b-cf3fe21f0f22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145272 Aug 29 04:56:48.906542 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 815/1684] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:49.207735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4f11c494-b246-4156-8f3e-27ce7104a618 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd7e8670>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:49.335258 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4f11c494-b246-4156-8f3e-27ce7104a618 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.129308 Aug 29 04:56:49.336566 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 870/1685] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:49 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:50.110576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:50.111283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:50.118509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:50.123565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:50.124165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:50.124924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:50.125400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:50.125831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:50.355241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b3a579fb-ef0d-4cc9-9de5-955d0ac532fe tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd87a1f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:50.443672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b3a579fb-ef0d-4cc9-9de5-955d0ac532fe tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.095983 Aug 29 04:56:50.457207 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 871/1686] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:50 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:51.269671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:51.279214 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-210c119a-d34f-4861-9405-8f2981642e04 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 1.612463 Aug 29 04:56:51.292589 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 816/1687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:49 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:51.463858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-616eaae2-6b24-44ec-b381-c2c26d1b342d tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd8cd430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:51.525572 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-616eaae2-6b24-44ec-b381-c2c26d1b342d tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.066491 Aug 29 04:56:51.531251 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 872/1688] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:51 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:52.309326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:52.309945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:52.324185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:52.328527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:52.332960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:52.333812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:52.334300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:52.334732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:52.504943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-403426563", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a8766693-25d9-4aae-b9cf-1bcb5ffe843b"}], "block_device_mapping_v2": [{"uuid": "acb8b447-feb6-4a85-945b-1437459d91c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:52.696228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] validate_networks() for [('a8766693-25d9-4aae-b9cf-1bcb5ffe843b', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:56:53.311016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:53.320269 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-57c9c05d-3aef-419b-ba1a-426391b6260c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1719 microversion: 2.1 time: 1.014809 Aug 29 04:56:53.321509 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 817/1689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:52 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1719 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:56:53.326678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab698a31-dd51-41c0-9b35-ee500aa80e4d tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1ab956e940>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:53.411941 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab698a31-dd51-41c0-9b35-ee500aa80e4d tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.089111 Aug 29 04:56:53.412586 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 818/1690] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:53 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:53.725458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-159405453", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "c1c2b0fe-774a-41d7-804b-9b252b4c0fcb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:53.798998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] validate_networks() for [('c1c2b0fe-774a-41d7-804b-9b252b4c0fcb', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:56:54.261146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:56:54.261659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:56:54.262363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:56:54.262965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:56:54.263785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:56:54.275206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:54.275905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:54.276591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:54.277588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:54.278302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:54.278728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:54.298027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for project 2864fc0a731f4945a27e68889572000f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:56:54.303522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Getting quotas for user 62ea00a8210b4ede95e54c53e7445794 and project 2864fc0a731f4945a27e68889572000f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:56:54.384780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:56:54.386890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='acb8b447-feb6-4a85-945b-1437459d91c8',volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:56:54.584032 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-402009be-ad35-4294-9877-26018e28f264 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.086121 Aug 29 04:56:54.596187 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 873/1691] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 04:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 04:56:54.623701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:56:54.624254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:56:54.625168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:56:54.625556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ed6d4efc-8cf5-4493-9cf4-2676a65cdc27 req-548d52d6-28de-482d-95db-b8fff846b890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154", "name": "network-vif-plugged", "status": "completed", "tag": "39ed18ba-56f8-4c3d-a711-deebbf9109d3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:54.625692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:56:54.626025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:56:54.635601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:54.636499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:54.637323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:54.638306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:54.638989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:54.639632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:54.650511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ed6d4efc-8cf5-4493-9cf4-2676a65cdc27 req-548d52d6-28de-482d-95db-b8fff846b890 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:54.651342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ed6d4efc-8cf5-4493-9cf4-2676a65cdc27 req-548d52d6-28de-482d-95db-b8fff846b890 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:54.651947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ed6d4efc-8cf5-4493-9cf4-2676a65cdc27 req-548d52d6-28de-482d-95db-b8fff846b890 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:54.668830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Getting quotas for project e88260cc20924f92a617cc231ad24f77. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:56:54.669183 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ed6d4efc-8cf5-4493-9cf4-2676a65cdc27 req-548d52d6-28de-482d-95db-b8fff846b890 service nova] Creating event network-vif-plugged:39ed18ba-56f8-4c3d-a711-deebbf9109d3 for instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 on n-h1-854119-9 Aug 29 04:56:54.674924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Getting quotas for user da246be637924c248fa3746468546f00 and project e88260cc20924f92a617cc231ad24f77. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:56:54.676571 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ed6d4efc-8cf5-4493-9cf4-2676a65cdc27 req-548d52d6-28de-482d-95db-b8fff846b890 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081841 Aug 29 04:56:54.677685 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 874/1692] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:54.698651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:56:54.703046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:56:54.783375 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-987d551d-68a2-4f5f-aeeb-41f6e4f9763d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.369256 Aug 29 04:56:54.785011 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 819/1693] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:56:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:56:54.900420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-549422811", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": "none"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:55.026537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:56:55.026971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:56:55.027444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:56:55.028076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:56:55.028966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:56:55.035715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de81758d-2a7a-4038-b072-9148a2480fc8 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd800280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1056375233", "description": "tempest-description-211227064"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:55.046305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:55.048016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:55.049301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:55.050189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:55.050932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:55.051437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:55.100791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Getting quotas for project bc5ed0bbe92a48909999b101bb4a77dd. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:56:55.108930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Getting quotas for user 2a312c39cfc84c45bb78f68ce39c237a and project bc5ed0bbe92a48909999b101bb4a77dd. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:56:55.138095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:56:55.140357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:56:55.221305 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87241bbc-4181-4fb6-ac16-08e9f8cd9a73 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.434376 Aug 29 04:56:55.222549 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 820/1694] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 04:56:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 04:56:55.240688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:55.242605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:55.281268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:55.281877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:55.282335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:55.289780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:55.290482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:55.291029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:55.421291 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de81758d-2a7a-4038-b072-9148a2480fc8 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.742108 Aug 29 04:56:55.423234 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 875/1695] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:56:54 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:55.431717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1235de2-00bb-48e8-a4fd-d042bd076774 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd87b820>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:55.600833 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1235de2-00bb-48e8-a4fd-d042bd076774 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.174286 Aug 29 04:56:55.601406 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 876/1696] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:55 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:55.632000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:55.638191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:55.671576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:55.674415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:55.676351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:55.680025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:55.681958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:55.683592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:55.780711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:55.791668 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-438545eb-dbfa-4dc0-abfb-a2248fd64efc tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1709 microversion: 2.1 time: 0.560961 Aug 29 04:56:55.815030 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 821/1697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:55 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1709 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:55.830588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e19c034-0684-4a89-b2fd-cf0ce008efc8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:55.831488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e19c034-0684-4a89-b2fd-cf0ce008efc8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:55.863795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:55.888411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:55.895431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:55.899650 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-886a1459-c99c-479c-87a0-67af448ba334 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1176 microversion: 2.25 time: 0.287566 Aug 29 04:56:55.901773 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 877/1698] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:55 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1176 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:55.918852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-353636a8-9cef-47ba-a068-066e5fb72170 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:55.936995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-353636a8-9cef-47ba-a068-066e5fb72170 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:56.013333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7e19c034-0684-4a89-b2fd-cf0ce008efc8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:56.023200 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e19c034-0684-4a89-b2fd-cf0ce008efc8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1207 microversion: 2.1 time: 0.199632 Aug 29 04:56:56.023918 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 822/1699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:55 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1207 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:56.046149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9fae685d-9223-4e7e-a8ad-420b08de9988 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd8e7430>, body: {"security_group_rule": {"parent_group_id": "30fb014e-71ba-4921-bef8-91aa00b96513", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:56.184759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-353636a8-9cef-47ba-a068-066e5fb72170 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:56.197516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-353636a8-9cef-47ba-a068-066e5fb72170 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:56.201676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-353636a8-9cef-47ba-a068-066e5fb72170 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:56.216352 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-353636a8-9cef-47ba-a068-066e5fb72170 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "PUT /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1358 microversion: 2.75 time: 0.313080 Aug 29 04:56:56.236566 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 878/1700] 10.222.0.20 () {62 vars in 1297 bytes} [Mon Aug 29 04:56:55 2022] PUT /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1358 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:56.246704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-036c0b2c-a04c-4190-a2e1-081791c6e0cb tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '.version_select at 0x7f1abd8cd8b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:56.257290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-036c0b2c-a04c-4190-a2e1-081791c6e0cb tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:56.262302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-036c0b2c-a04c-4190-a2e1-081791c6e0cb tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:56.263805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-036c0b2c-a04c-4190-a2e1-081791c6e0cb tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:56.294412 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-036c0b2c-a04c-4190-a2e1-081791c6e0cb tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2321 microversion: 2.1 time: 0.047675 Aug 29 04:56:56.295098 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 879/1701] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:56:56 2022] GET /compute/v2.1/os-migrations => generated 2321 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:56.308937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b37e3623-4bc5-476e-bc15-b71fc575b140 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:56.309738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b37e3623-4bc5-476e-bc15-b71fc575b140 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:56.426713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b37e3623-4bc5-476e-bc15-b71fc575b140 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:56.438535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b37e3623-4bc5-476e-bc15-b71fc575b140 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:56.440143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b37e3623-4bc5-476e-bc15-b71fc575b140 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:56.454928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=12,nova_api:INSERT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:56.472216 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b37e3623-4bc5-476e-bc15-b71fc575b140 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1358 microversion: 2.75 time: 0.172115 Aug 29 04:56:56.473380 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 880/1702] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:56 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:56.480422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b1743ad1-e151-4357-a367-a9e8a8500a9d tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:56.481091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b1743ad1-e151-4357-a367-a9e8a8500a9d tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:56.488105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1743ad1-e151-4357-a367-a9e8a8500a9d tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:56.491967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1743ad1-e151-4357-a367-a9e8a8500a9d tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:56.496799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1743ad1-e151-4357-a367-a9e8a8500a9d tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:56.502244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1743ad1-e151-4357-a367-a9e8a8500a9d tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:56.505270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1743ad1-e151-4357-a367-a9e8a8500a9d tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:56.505917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1743ad1-e151-4357-a367-a9e8a8500a9d tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:56.800060 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9fae685d-9223-4e7e-a8ad-420b08de9988 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.775003 Aug 29 04:56:56.801401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 823/1703] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:56:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:56.806516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a8dfc76-41a1-4154-a861-172aca5240f7 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd88d310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:56.913793 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a8dfc76-41a1-4154-a861-172aca5240f7 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.111000 Aug 29 04:56:56.914767 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 824/1704] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:56 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:56.933487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a9ca9e7-6ca0-4e20-a1a9-9b3b5f5882ba tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd8e79d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-270590449", "description": "tempest-description-72601789"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:57.066579 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b1743ad1-e151-4357-a367-a9e8a8500a9d tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1860 microversion: 2.1 time: 0.591881 Aug 29 04:56:57.067295 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 881/1705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:56 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1860 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:57.098261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:57.099540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:57.133302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:57.134919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:57.134919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:57.136025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:57.139033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:57.140983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:57.790770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:57.808961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:57.810843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:57.816776 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e26c1bf5-9d23-4584-894c-751a5b27cc31 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1250 microversion: 2.25 time: 0.748406 Aug 29 04:56:57.821357 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 882/1706] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:57 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1250 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:57.836293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:57.850305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:57.879564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:57.883735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:57.884624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:57.885923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:57.887781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:57.892354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:57.970956 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4a9ca9e7-6ca0-4e20-a1a9-9b3b5f5882ba tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.054708 Aug 29 04:56:57.980053 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 825/1707] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:56:56 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:57.988428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e313530-1c8d-4e0a-b0a4-d486c04ece99 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:57.989505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0e313530-1c8d-4e0a-b0a4-d486c04ece99 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:58.042652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e313530-1c8d-4e0a-b0a4-d486c04ece99 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:58.044916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e313530-1c8d-4e0a-b0a4-d486c04ece99 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:58.049892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e313530-1c8d-4e0a-b0a4-d486c04ece99 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:58.051077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e313530-1c8d-4e0a-b0a4-d486c04ece99 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:58.051773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e313530-1c8d-4e0a-b0a4-d486c04ece99 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:58.052507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e313530-1c8d-4e0a-b0a4-d486c04ece99 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:58.067895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:56:58.133564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:58.149938 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-87140cff-6503-4ac5-b43b-8789609f561f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1277 microversion: 2.1 time: 0.326052 Aug 29 04:56:58.164843 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 883/1708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:57 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1277 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:58.184461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:58.188423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:58.204371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:58.206134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:58.208488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:58.209427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:58.212884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:58.213536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:58.647993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:58.662116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:58.665550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:58.672870 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb6a31fb-2d12-49f5-a2bb-6c1ef84bf816 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1418 microversion: 2.75 time: 0.506325 Aug 29 04:56:58.674809 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 884/1709] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:58 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1418 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:56:58.696771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4cc2cbf0-0237-4975-9f8a-618c2ca2c0f0 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd857790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:58.794612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4cc2cbf0-0237-4975-9f8a-618c2ca2c0f0 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.114618 Aug 29 04:56:58.797279 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 885/1710] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:56:58 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:58.810687 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e313530-1c8d-4e0a-b0a4-d486c04ece99 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1860 microversion: 2.1 time: 0.825541 Aug 29 04:56:58.819436 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 826/1711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:57 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1860 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:56:58.823367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fe837a12-100c-4071-9c20-ff9ca775bd94 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd7daca0>, body: {"security_group_rule": {"parent_group_id": "5d4d4fa6-2a41-4649-b1c5-2a6ba1b1b98e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:56:58.848870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:58.849579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:58.861721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:58.862554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:58.864366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:58.865373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:58.868431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:58.869162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:59.202102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:59.213414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:59.226159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:56:59.233028 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ee2ce2e-b501-4b12-b1db-745d44718cfe tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1250 microversion: 2.25 time: 0.391903 Aug 29 04:56:59.240308 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 827/1712] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:58 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1250 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:56:59.254663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:59.263779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:59.282737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:59.286202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:59.298399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:59.299314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:59.300802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:59.304774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:59.513185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lazy-loading 'services' on Instance uuid d7c9b159-0dc2-4520-95ea-01bea5848a83 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:56:59.706291 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6592229c-eabe-4b36-88a3-92f9c2c8fcc7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments/faef6c3f-bdaa-4c36-aca5-69ebc79946d4" status: 202 len: 0 microversion: 2.1 time: 0.461877 Aug 29 04:56:59.707213 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 828/1713] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 04:56:59 2022] DELETE /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments/faef6c3f-bdaa-4c36-aca5-69ebc79946d4 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:56:59.736614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:59.737676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:59.754956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:59.773606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:59.774403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:59.777641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:59.778355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:59.780891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:59.825418 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fe837a12-100c-4071-9c20-ff9ca775bd94 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.019195 Aug 29 04:56:59.834635 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 886/1714] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:56:58 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:56:59.839713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:56:59.840546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:56:59.882752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:59.886151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:59.888732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:56:59.892201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:56:59.898148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:56:59.899263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:00.183507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:00.215744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:00.217404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:00.239029 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a22dc903-bbca-4148-8be7-9dc8f75bc43d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1416 microversion: 2.75 time: 0.403106 Aug 29 04:57:00.268801 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 887/1715] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:56:59 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1416 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:00.289588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6ed45223-5321-4802-aa18-fe1557fa5727 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:00.291925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6ed45223-5321-4802-aa18-fe1557fa5727 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:00.318087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ed45223-5321-4802-aa18-fe1557fa5727 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:00.318593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ed45223-5321-4802-aa18-fe1557fa5727 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:00.319025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ed45223-5321-4802-aa18-fe1557fa5727 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:00.322943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ed45223-5321-4802-aa18-fe1557fa5727 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:00.323426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ed45223-5321-4802-aa18-fe1557fa5727 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:00.323858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ed45223-5321-4802-aa18-fe1557fa5727 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:00.400309 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6ed45223-5321-4802-aa18-fe1557fa5727 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130252 Aug 29 04:57:00.400901 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 888/1716] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:57:00 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:00.405564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6096bffe-c53f-4820-b072-b9f4413dfcd5 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd7f3310>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:00.506241 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6096bffe-c53f-4820-b072-b9f4413dfcd5 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.104277 Aug 29 04:57:00.509425 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 889/1717] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:00 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:00.529791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11833daa-0181-42fa-9bbe-078b24b490e8 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd7fbe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2134268548", "description": "tempest-description-873119525"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:00.922717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:00.943065 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e801b0a-5726-4c94-a1c5-b1967791615b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1307 microversion: 2.1 time: 1.234271 Aug 29 04:57:00.944020 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 829/1718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:56:59 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1307 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:00.960258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:00.962710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:00.977509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:00.979834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:00.980316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:00.981386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:00.985469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:00.986171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:01.216373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:01.225721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:01.227298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:01.228571 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-217e613d-f5c2-4909-acf6-47cbb0f524b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1292 microversion: 2.25 time: 0.281378 Aug 29 04:57:01.230586 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 830/1719] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:00 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1292 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:01.270903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:01.271950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:01.284386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:01.288197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:01.289002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:01.290017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:01.290740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:01.292590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:01.302210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11833daa-0181-42fa-9bbe-078b24b490e8 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.779140 Aug 29 04:57:01.303447 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 890/1720] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:57:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:01.316691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-973d7ca4-1c91-446b-a920-087a13fbcb50 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd7f0550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1774343615", "description": "tempest-description-1792116621"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:01.570600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:01.592695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:01.595520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:01.605839 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee79b408-d239-4bd3-aec3-921a7ef7ac0e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1416 microversion: 2.75 time: 0.338755 Aug 29 04:57:01.616152 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 831/1721] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:01 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1416 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:57:01.616152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-134c4415-ba8a-4f58-a59a-ec64bf06f2c0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:01.616152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-134c4415-ba8a-4f58-a59a-ec64bf06f2c0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:01.624680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-134c4415-ba8a-4f58-a59a-ec64bf06f2c0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:01.624680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-134c4415-ba8a-4f58-a59a-ec64bf06f2c0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:01.624680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-134c4415-ba8a-4f58-a59a-ec64bf06f2c0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:01.624680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-134c4415-ba8a-4f58-a59a-ec64bf06f2c0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:01.625130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-134c4415-ba8a-4f58-a59a-ec64bf06f2c0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:01.625130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-134c4415-ba8a-4f58-a59a-ec64bf06f2c0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:01.663630 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-134c4415-ba8a-4f58-a59a-ec64bf06f2c0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055399 Aug 29 04:57:01.671772 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 832/1722] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:57:01 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:01.679579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ace8c0a6-9e0f-4665-a07e-e45d014c12ae tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1ab9a8b280>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:01.766893 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ace8c0a6-9e0f-4665-a07e-e45d014c12ae tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.092252 Aug 29 04:57:01.772797 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 833/1723] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:01 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:01.930439 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-973d7ca4-1c91-446b-a920-087a13fbcb50 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.617699 Aug 29 04:57:01.931184 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 891/1724] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:57:01 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:57:01.944255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a17e4698-45ff-4e2f-9c2f-d45ae95e31ab tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd9263a0>, body: {"security_group_rule": {"parent_group_id": "ed2098e4-46eb-409d-859a-44b427d970a3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a8fc0985-2348-435b-a077-e6d13fb21791"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:01.967244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:01.968223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:01.982618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:01.991946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:01.992549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:01.993329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:01.993801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:01.994226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:02.284062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:02.292423 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3dcb5971-a6fa-471e-8c07-40f65ea4ad2e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1307 microversion: 2.1 time: 0.329320 Aug 29 04:57:02.293073 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 892/1725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:01 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:02.305593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:02.306249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:02.321976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:02.322393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:02.322826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:02.326117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:02.326600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:02.327033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:02.613828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:02.617501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:02.629118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:02.634369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:02.637718 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a85d36c5-a91a-4dd4-97d8-11fc62d4293c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1292 microversion: 2.25 time: 0.342736 Aug 29 04:57:02.643405 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 893/1726] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:02 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1292 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:02.650522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:02.651285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:02.670331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:02.671772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:02.672889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:02.674748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:02.676505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:02.677778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:02.849931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:02.918015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:02.922049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:02.944715 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ffe6388f-76d0-47ab-83ab-3419b643ecb4 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1416 microversion: 2.75 time: 0.300071 Aug 29 04:57:02.949279 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 894/1727] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:02 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1416 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:02.957531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-be069c5d-7c6c-4a19-983f-cf61d1ccdb06 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:02.960277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-be069c5d-7c6c-4a19-983f-cf61d1ccdb06 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:02.993193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be069c5d-7c6c-4a19-983f-cf61d1ccdb06 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:02.995563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be069c5d-7c6c-4a19-983f-cf61d1ccdb06 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:02.996274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be069c5d-7c6c-4a19-983f-cf61d1ccdb06 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:03.000943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be069c5d-7c6c-4a19-983f-cf61d1ccdb06 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:03.002558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be069c5d-7c6c-4a19-983f-cf61d1ccdb06 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:03.009669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be069c5d-7c6c-4a19-983f-cf61d1ccdb06 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:03.078953 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-be069c5d-7c6c-4a19-983f-cf61d1ccdb06 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128206 Aug 29 04:57:03.081759 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 895/1728] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:57:02 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:03.090439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66888e8b-a69e-4183-8514-478d2c7d3978 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd7f00d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:03.138517 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a17e4698-45ff-4e2f-9c2f-d45ae95e31ab tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.198127 Aug 29 04:57:03.140417 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 834/1729] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:57:01 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:03.146443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7a00b888-333d-4872-ad38-7e63c235a92d req-b4411fde-59dd-4eb6-85a2-522cd4626f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edb1989-4869-4968-ba61-d2fd91304761", "tag": "807392e6-35c9-4185-be60-e876c6285ebe"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:03.172003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7a00b888-333d-4872-ad38-7e63c235a92d req-b4411fde-59dd-4eb6-85a2-522cd4626f82 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:03.185161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7a00b888-333d-4872-ad38-7e63c235a92d req-b4411fde-59dd-4eb6-85a2-522cd4626f82 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:03.185615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7a00b888-333d-4872-ad38-7e63c235a92d req-b4411fde-59dd-4eb6-85a2-522cd4626f82 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:03.190164 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-66888e8b-a69e-4183-8514-478d2c7d3978 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.103414 Aug 29 04:57:03.191557 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 896/1730] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:03 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:03.196832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bda9c6d8-78cc-48c5-b822-f6d9035f606a tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd7f3af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-45524969", "description": "tempest-description-1715967391"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:03.210235 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7a00b888-333d-4872-ad38-7e63c235a92d req-b4411fde-59dd-4eb6-85a2-522cd4626f82 service nova] Creating event network-changed:807392e6-35c9-4185-be60-e876c6285ebe for instance 0edb1989-4869-4968-ba61-d2fd91304761 on n-h1-854119-9 Aug 29 04:57:03.217541 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7a00b888-333d-4872-ad38-7e63c235a92d req-b4411fde-59dd-4eb6-85a2-522cd4626f82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075468 Aug 29 04:57:03.218697 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 835/1731] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:03.318736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:03.319440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:03.337466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:03.338075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:03.346961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:03.347994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:03.348710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:03.349357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:03.838634 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bda9c6d8-78cc-48c5-b822-f6d9035f606a tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.645707 Aug 29 04:57:03.846814 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 897/1732] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:57:03 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:03.846814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-44925af6-960f-4ea1-886f-0f79aaaf1916 req-4190afed-7887-4ef6-b136-7a7fa259ff9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901a2798-d6c4-4d96-8a72-a0828794e98c", "tag": "7336574f-6a84-480f-9e96-5a47d4706f1b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:03.857502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-44925af6-960f-4ea1-886f-0f79aaaf1916 req-4190afed-7887-4ef6-b136-7a7fa259ff9b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:03.857990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-44925af6-960f-4ea1-886f-0f79aaaf1916 req-4190afed-7887-4ef6-b136-7a7fa259ff9b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:03.860397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-44925af6-960f-4ea1-886f-0f79aaaf1916 req-4190afed-7887-4ef6-b136-7a7fa259ff9b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:03.879353 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-44925af6-960f-4ea1-886f-0f79aaaf1916 req-4190afed-7887-4ef6-b136-7a7fa259ff9b service nova] Creating event network-changed:7336574f-6a84-480f-9e96-5a47d4706f1b for instance 901a2798-d6c4-4d96-8a72-a0828794e98c on n-h1-854119-9 Aug 29 04:57:03.885724 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-44925af6-960f-4ea1-886f-0f79aaaf1916 req-4190afed-7887-4ef6-b136-7a7fa259ff9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044474 Aug 29 04:57:03.889435 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 898/1733] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:03.895401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:03.896411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:03.904272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:03.904999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:03.905626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:03.910597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:03.915855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:03.922354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:03.925069 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fb4b8f20-28f0-42a0-9851-2249b48ba547 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1307 microversion: 2.1 time: 0.611295 Aug 29 04:57:03.925745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:03.929780 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 836/1734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:03 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1307 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:03.934847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de4906bc-306f-461f-bf46-18dd6b9b7c19 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd88ae50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1249858399", "description": "tempest-description-1850236188"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:04.175329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:04.192798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:04.195328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:04.201853 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-787f271a-2ed6-406b-abe6-42fcd66ec2cc tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1292 microversion: 2.25 time: 0.311128 Aug 29 04:57:04.203051 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 899/1735] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:03 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1292 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:04.209802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:04.210648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:04.232993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.233800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.234456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:04.235514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.236169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.237449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:04.288422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:04.342187 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de4906bc-306f-461f-bf46-18dd6b9b7c19 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.405693 Aug 29 04:57:04.343970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:04.353793 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 837/1736] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:57:03 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:04.369603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3d1514c-fc64-4d77-994a-43193c790946 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:04.372539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e3d1514c-fc64-4d77-994a-43193c790946 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:04.379594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:04.381918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:04.388812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3d1514c-fc64-4d77-994a-43193c790946 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.389321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3d1514c-fc64-4d77-994a-43193c790946 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.389742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3d1514c-fc64-4d77-994a-43193c790946 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:04.390458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3d1514c-fc64-4d77-994a-43193c790946 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.391052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3d1514c-fc64-4d77-994a-43193c790946 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.391188 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0fc4ac9b-b998-4bb6-8cc4-594fc623e43e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1437 microversion: 2.75 time: 0.186200 Aug 29 04:57:04.391707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3d1514c-fc64-4d77-994a-43193c790946 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:04.392303 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 900/1737] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:04 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1437 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:04.399899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9e81ebd-ec5e-440f-9b7f-e699d82baf45 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd857790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:04.442519 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3d1514c-fc64-4d77-994a-43193c790946 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085840 Aug 29 04:57:04.450511 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 838/1738] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:57:04 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:04.457244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b8e8d73-57a5-4bc9-8233-589cbcda2bf7 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd88adc0>, body: {"security_group_rule": {"parent_group_id": "644bca3e-4a1a-4a1f-b1e3-e960c3aaaf6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5f3d134b-51fc-4895-8d30-96d21bad8bfd"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:04.485888 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9e81ebd-ec5e-440f-9b7f-e699d82baf45 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.090402 Aug 29 04:57:04.486511 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 901/1739] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:04 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:04.500193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:04.504710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:04.514118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.516824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.519873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:04.520743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.521484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.521969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:04.635230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:57:04.636033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:57:04.637173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:57:04.638050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:57:04.638807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:57:04.762448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:04.778558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.780880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.782333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:04.784949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.787898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.790887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:04.814955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b8e8d73-57a5-4bc9-8233-589cbcda2bf7 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.362640 Aug 29 04:57:04.816326 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 839/1740] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:57:04 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:04.828042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b97a49f5-6857-4aad-92c8-c8473105e4ee tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1abd926160>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:04.931887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:04.941777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:04.947830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:04.961608 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6e0da20-aded-454e-97c2-7cbe4e668b2c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "POST /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28/action" status: 202 len: 1494 microversion: 2.75 time: 0.467427 Aug 29 04:57:04.963137 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 902/1741] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 04:57:04 2022] POST /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28/action => generated 1494 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 04:57:04.978444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:04.979494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:04.990358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.991462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.991914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:04.993781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:04.994245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:04.994668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:05.077319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:05.227436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:05.240029 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3d747119-7fe4-46d4-a29f-e62ad44efbbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1307 microversion: 2.1 time: 0.274944 Aug 29 04:57:05.255230 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 903/1742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:04 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:05.263482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:05.267099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:05.281212 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b97a49f5-6857-4aad-92c8-c8473105e4ee tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5f3d134b-51fc-4895-8d30-96d21bad8bfd" status: 202 len: 0 microversion: 2.1 time: 0.458081 Aug 29 04:57:05.282007 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 840/1743] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:57:04 2022] DELETE /compute/v2.1/os-security-groups/5f3d134b-51fc-4895-8d30-96d21bad8bfd => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:57:05.286838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:05.287473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:05.288092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:05.289750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:05.290375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:05.292268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:05.293945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:05.295861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:05.312191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:05.312687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:05.313311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:05.314266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:05.314877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:05.316004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:05.440154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:05.457431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:05.462747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:05.473272 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a99bf2cc-7a93-4c36-939b-e80ae982e24e tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.216594 Aug 29 04:57:05.474650 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 904/1744] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:05 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:05.482538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b2a1440b-dbff-487b-8cd9-e449ad8afae9 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1abd7dac10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:05.559464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:05.574509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:05.576364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:05.577509 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6111206-c701-4f5a-8b3e-742f47f99588 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1292 microversion: 2.25 time: 0.294577 Aug 29 04:57:05.587746 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b2a1440b-dbff-487b-8cd9-e449ad8afae9 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/644bca3e-4a1a-4a1f-b1e3-e960c3aaaf6b" status: 200 len: 246 microversion: 2.1 time: 0.111277 Aug 29 04:57:05.596880 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 905/1745] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 04:57:05 2022] GET /compute/v2.1/os-security-groups/644bca3e-4a1a-4a1f-b1e3-e960c3aaaf6b => generated 246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:05.596880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e546a1d4-3765-4fb3-a67a-f6f2eaa8bcd9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:05.597792 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 841/1746] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:05 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1292 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:05.597920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e546a1d4-3765-4fb3-a67a-f6f2eaa8bcd9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:05.603318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ced76ef-4bc1-4d6e-82ff-abdeccd25837 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd9260d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:05.610426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e546a1d4-3765-4fb3-a67a-f6f2eaa8bcd9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:05.611397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e546a1d4-3765-4fb3-a67a-f6f2eaa8bcd9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:05.612167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e546a1d4-3765-4fb3-a67a-f6f2eaa8bcd9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:05.612987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e546a1d4-3765-4fb3-a67a-f6f2eaa8bcd9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:05.613541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e546a1d4-3765-4fb3-a67a-f6f2eaa8bcd9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:05.614057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e546a1d4-3765-4fb3-a67a-f6f2eaa8bcd9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:05.651835 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e546a1d4-3765-4fb3-a67a-f6f2eaa8bcd9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062194 Aug 29 04:57:05.656768 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 906/1747] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:57:05 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:05.659108 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3ced76ef-4bc1-4d6e-82ff-abdeccd25837 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.060552 Aug 29 04:57:05.660293 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 842/1748] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:05 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:05.662060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed3238f7-98aa-4a7d-bed6-f799d194f9dc tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd857790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-784546062", "description": "tempest-description-1565844358"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:05.838648 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed3238f7-98aa-4a7d-bed6-f799d194f9dc tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.180704 Aug 29 04:57:05.839290 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 907/1749] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:57:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:05.852072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-48eebe34-5bba-4bb0-8fe7-907d8883b533 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd83eee0>, body: {"security_group_rule": {"parent_group_id": "d0c515a5-0d58-445d-80b6-fbfd0749cf34", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:06.020947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=16 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:06.090933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-48eebe34-5bba-4bb0-8fe7-907d8883b533 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.242519 Aug 29 04:57:06.091969 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 843/1750] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:57:05 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:57:06.103382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22225878-6b03-45fa-8eb6-239f35eb4f41 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Action: 'create', calling method: .version_select at 0x7f1abd8575e0>, body: {"security_group_rule": {"parent_group_id": "d0c515a5-0d58-445d-80b6-fbfd0749cf34", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:06.261782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:06.262589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:06.276199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:06.278116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:06.284485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:06.285699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:06.286608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:06.287726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:06.431324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=7 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:06.856609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:06.874854 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22225878-6b03-45fa-8eb6-239f35eb4f41 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.774110 Aug 29 04:57:06.875745 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 908/1751] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:57:06 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:06.897646 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b6e4d37-4707-4445-bf42-9ddc482dffd4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1307 microversion: 2.1 time: 0.639843 Aug 29 04:57:06.913114 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 844/1752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:06 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1307 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:06.919131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:06.919768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:06.921517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:06.922788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:06.930549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:06.931906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:06.933037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:06.933966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:06.935246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:06.936036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:06.951421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:06.951953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:06.955136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:06.959640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:06.960208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:06.960665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:07.240504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:07.253177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:07.267173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:07.271184 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b636ca19-0c78-4e53-a088-c5af71b64034 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1292 microversion: 2.25 time: 0.356611 Aug 29 04:57:07.272301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:07.273717 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 845/1753] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:06 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1292 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:07.284052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6dfa68b0-b0bf-4bf2-88ae-ac2f0e7c6faf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:07.292755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6dfa68b0-b0bf-4bf2-88ae-ac2f0e7c6faf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:07.297361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:07.304232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:07.318165 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21b067d3-86a1-4360-9ffd-e27502c40164 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.432420 Aug 29 04:57:07.320804 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 909/1754] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:06 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:07.328156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfa68b0-b0bf-4bf2-88ae-ac2f0e7c6faf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:07.328660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfa68b0-b0bf-4bf2-88ae-ac2f0e7c6faf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:07.329092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfa68b0-b0bf-4bf2-88ae-ac2f0e7c6faf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:07.329806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfa68b0-b0bf-4bf2-88ae-ac2f0e7c6faf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:07.334189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da2b209d-efdc-42dc-8970-d426bbc183fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd857160>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:07.339296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfa68b0-b0bf-4bf2-88ae-ac2f0e7c6faf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:07.341032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfa68b0-b0bf-4bf2-88ae-ac2f0e7c6faf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:07.418869 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6dfa68b0-b0bf-4bf2-88ae-ac2f0e7c6faf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137939 Aug 29 04:57:07.421953 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 846/1755] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:57:07 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:07.424251 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da2b209d-efdc-42dc-8970-d426bbc183fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.097557 Aug 29 04:57:07.427877 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 910/1756] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:07 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:07.440413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c13ebddc-fd53-4ecc-a677-81e122eb2902 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1abd84b790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:07.678062 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c13ebddc-fd53-4ecc-a677-81e122eb2902 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/d0c515a5-0d58-445d-80b6-fbfd0749cf34" status: 200 len: 664 microversion: 2.1 time: 0.254697 Aug 29 04:57:07.679371 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 847/1757] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 04:57:07 2022] GET /compute/v2.1/os-security-groups/d0c515a5-0d58-445d-80b6-fbfd0749cf34 => generated 664 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:07.708805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-46277f90-a8c5-4bd4-b78d-aa3e7e317f22 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1abd852040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:07.920381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:07.920990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:07.933526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:07.934125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:07.934677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:07.935503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:07.935950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:07.938917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:08.419404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:08.430604 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-46277f90-a8c5-4bd4-b78d-aa3e7e317f22 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/a37e91c6-aab7-4b3c-98d3-f506c38f5772" status: 202 len: 0 microversion: 2.1 time: 0.739900 Aug 29 04:57:08.432224 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 911/1758] 10.222.0.20 () {58 vars in 1287 bytes} [Mon Aug 29 04:57:07 2022] DELETE /compute/v2.1/os-security-group-rules/a37e91c6-aab7-4b3c-98d3-f506c38f5772 => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:57:08.432714 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a7c75bb6-0c6e-481a-8a51-030bcedbe34d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1307 microversion: 2.1 time: 0.516045 Aug 29 04:57:08.434520 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 848/1759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:07 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1307 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:08.446967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:08.447477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:08.448723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:08.449553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:08.463992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:08.465399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:08.466124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:08.467171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:08.467601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:08.468094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:08.468542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:08.469183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:08.470800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:08.471583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:08.472439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:08.472875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:09.083617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:09.098761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:09.103943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:09.113623 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e9ffe9c9-db91-4406-805b-3157fb3ce3d3 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.676767 Aug 29 04:57:09.116146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 849/1760] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:08 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:09.122004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8140dbe1-f15b-4b7c-abff-332b62dd143a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:09.124380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8140dbe1-f15b-4b7c-abff-332b62dd143a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:09.135294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbe1-f15b-4b7c-abff-332b62dd143a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:09.135294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbe1-f15b-4b7c-abff-332b62dd143a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:09.135294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbe1-f15b-4b7c-abff-332b62dd143a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:09.135294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbe1-f15b-4b7c-abff-332b62dd143a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:09.135719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbe1-f15b-4b7c-abff-332b62dd143a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:09.135719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbe1-f15b-4b7c-abff-332b62dd143a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:09.201451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:09.215427 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8140dbe1-f15b-4b7c-abff-332b62dd143a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097943 Aug 29 04:57:09.216435 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 850/1761] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:57:09 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:57:09.222508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-00f0ea75-4519-4f3c-81ff-050c91cb68e8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd884f70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:09.298925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-00f0ea75-4519-4f3c-81ff-050c91cb68e8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.081121 Aug 29 04:57:09.308779 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 851/1762] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:09 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:09.314413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1fd5b2db-ee51-477e-8bb8-1d0f62cc9a77 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1abd8f1b80>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:09.360313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:09.374979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:09.377909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:09.384513 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f0e0a7e1-2595-415a-95b5-2b74190149e3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1292 microversion: 2.25 time: 0.948001 Aug 29 04:57:09.385739 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 912/1763] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:08 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1292 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:09.455647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:09.456583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:09.464585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:09.465619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:09.470614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:09.471665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:09.472403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:09.472966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:09.859768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:09.870562 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3e33cfd7-4dcf-49db-b5bf-dc40f69bf646 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1307 microversion: 2.1 time: 0.420046 Aug 29 04:57:09.874380 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 913/1764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:09 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1307 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:09.899394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b3032181-a137-478a-8ee0-eac37dbc24e2 req-5873004f-d4c2-44d5-a00d-12f0708d229b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edb1989-4869-4968-ba61-d2fd91304761", "name": "network-vif-plugged", "status": "completed", "tag": "807392e6-35c9-4185-be60-e876c6285ebe"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:09.911121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b3032181-a137-478a-8ee0-eac37dbc24e2 req-5873004f-d4c2-44d5-a00d-12f0708d229b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:09.911905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b3032181-a137-478a-8ee0-eac37dbc24e2 req-5873004f-d4c2-44d5-a00d-12f0708d229b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:09.912587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b3032181-a137-478a-8ee0-eac37dbc24e2 req-5873004f-d4c2-44d5-a00d-12f0708d229b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:09.926729 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1fd5b2db-ee51-477e-8bb8-1d0f62cc9a77 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/d0c515a5-0d58-445d-80b6-fbfd0749cf34" status: 202 len: 0 microversion: 2.1 time: 0.616153 Aug 29 04:57:09.929239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b3032181-a137-478a-8ee0-eac37dbc24e2 req-5873004f-d4c2-44d5-a00d-12f0708d229b service nova] Creating event network-vif-plugged:807392e6-35c9-4185-be60-e876c6285ebe for instance 0edb1989-4869-4968-ba61-d2fd91304761 on n-h1-854119-9 Aug 29 04:57:09.929892 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 852/1765] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:57:09 2022] DELETE /compute/v2.1/os-security-groups/d0c515a5-0d58-445d-80b6-fbfd0749cf34 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:57:09.935499 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b3032181-a137-478a-8ee0-eac37dbc24e2 req-5873004f-d4c2-44d5-a00d-12f0708d229b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040692 Aug 29 04:57:09.936729 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 914/1766] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:09.939415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1256744f-eb04-4813-99e1-3846933d8f1a tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1abd84be50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:10.036141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-1256744f-eb04-4813-99e1-3846933d8f1a tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f3d134b-51fc-4895-8d30-96d21bad8bfd does not exist", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 04:57:10.038245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.security_group_api [None req-1256744f-eb04-4813-99e1-3846933d8f1a tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Neutron security group 5f3d134b-51fc-4895-8d30-96d21bad8bfd not found {{(pid=128871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 04:57:10.040330 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-1256744f-eb04-4813-99e1-3846933d8f1a tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] HTTP exception thrown: Security group 5f3d134b-51fc-4895-8d30-96d21bad8bfd does not exist Aug 29 04:57:10.040330 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-d7e0cd73-424e-4463-85a3-e4f2da8c7f23'] Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1256744f-eb04-4813-99e1-3846933d8f1a tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Request method failure captured: Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/os-security-groups/5f3d134b-51fc-4895-8d30-96d21bad8bfd HTTP/1.1 Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcVQs_9jEZIGgKLQF_REclBNGhIY2coiE-2sJBakrph6I8NTjvB8oQXJXZk3irDqmFDdcXYhYUqMELFnNhW8yvmNVz5Y0XMcS0xnrGgabkBeUyqTX4cnK6auAymt6_p5n8W2STGV2k2OxOFDxZy07OWP7-rQ8BRijCekl67tVo0mkg Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd13188e82f34c5db7efd03391c04d96 Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-768150528 Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:10.059091 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd13188e82f34c5db7efd03391c04d96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd13188e82f34c5db7efd03391c04d96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd13188e82f34c5db7efd03391c04d96", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd13188e82f34c5db7efd03391c04d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupRulesTestJSON-768150528 Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd13188e82f34c5db7efd03391c04d96 Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-768150528 Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupRulesTestJSON-768150528-project Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6f08db2ff89146359fb64a6624e98244 Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupRulesTestJSON-768150528-project Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: exception: Security group 5f3d134b-51fc-4895-8d30-96d21bad8bfd does not exist Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-d7e0cd73-424e-4463-85a3-e4f2da8c7f23'] Aug 29 04:57:10.060784 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '5f3d134b-51fc-4895-8d30-96d21bad8bfd'} Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:57:10.061794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f3d134b-51fc-4895-8d30-96d21bad8bfd does not exist Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7e0cd73-424e-4463-85a3-e4f2da8c7f23'] Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 04:57:10.063147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f3d134b-51fc-4895-8d30-96d21bad8bfd does not exist Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7e0cd73-424e-4463-85a3-e4f2da8c7f23'] Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f3d134b-51fc-4895-8d30-96d21bad8bfd does not exist Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7e0cd73-424e-4463-85a3-e4f2da8c7f23'] Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:10.064415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f3d134b-51fc-4895-8d30-96d21bad8bfd does not exist Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7e0cd73-424e-4463-85a3-e4f2da8c7f23'] Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1256744f-eb04-4813-99e1-3846933d8f1a tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Returning 404 to user: Security group 5f3d134b-51fc-4895-8d30-96d21bad8bfd does not exist Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-d7e0cd73-424e-4463-85a3-e4f2da8c7f23'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1256744f-eb04-4813-99e1-3846933d8f1a tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5f3d134b-51fc-4895-8d30-96d21bad8bfd" status: 404 len: 194 microversion: 2.1 time: 0.128554 Aug 29 04:57:10.065814 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 853/1767] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:57:09 2022] DELETE /compute/v2.1/os-security-groups/5f3d134b-51fc-4895-8d30-96d21bad8bfd => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:57:10.073547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16bb5692-4926-4e18-8c3f-530dfb302fe1 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1ab8b3c3a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:10.146990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:10.147609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:10.158114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:10.166805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:10.167365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:10.168183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:10.168830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:10.169258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:10.390226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:10.407006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:10.408932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:10.425224 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-37219524-e7c4-4588-98c5-3bd0856c81c7 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.283150 Aug 29 04:57:10.433403 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 854/1768] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:10 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:10.447295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c3c1e5a0-b745-4ed5-883c-6d8650d9ef4c tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd884e50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:10.517198 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c3c1e5a0-b745-4ed5-883c-6d8650d9ef4c tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1427 microversion: 2.1 time: 0.082416 Aug 29 04:57:10.517879 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 855/1769] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:10 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:10.528015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:10.532092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:10.543338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:10.544233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:10.546684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:10.547810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:10.548517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:10.549728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:10.837985 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16bb5692-4926-4e18-8c3f-530dfb302fe1 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/644bca3e-4a1a-4a1f-b1e3-e960c3aaaf6b" status: 202 len: 0 microversion: 2.1 time: 0.768856 Aug 29 04:57:10.838575 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 915/1770] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:57:10 2022] DELETE /compute/v2.1/os-security-groups/644bca3e-4a1a-4a1f-b1e3-e960c3aaaf6b => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:57:10.849592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb45e297-1e1e-4571-9170-940a4d932474 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1ab8b2d1f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:10.864765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:10.888416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:10.890919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:10.892190 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2df9d277-50db-437c-80c0-230b9221ab2f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1292 microversion: 2.25 time: 0.373107 Aug 29 04:57:10.893335 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 856/1771] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:10 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1292 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:10.907806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:10.908792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:10.918910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:10.921506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:10.922583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:10.926161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:10.926878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:10.927536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:11.261874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:11.275196 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6afe08ef-bf1e-4e3a-afde-a860ba809dbf tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1307 microversion: 2.1 time: 0.380485 Aug 29 04:57:11.293930 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 857/1772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:10 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1307 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:11.416534 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb45e297-1e1e-4571-9170-940a4d932474 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a8fc0985-2348-435b-a077-e6d13fb21791" status: 202 len: 0 microversion: 2.1 time: 0.572800 Aug 29 04:57:11.418036 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 916/1773] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:57:10 2022] DELETE /compute/v2.1/os-security-groups/a8fc0985-2348-435b-a077-e6d13fb21791 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:57:11.425462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-355b01a7-b5ad-4e8d-98a3-5678699bb473 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1abd86ef70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:11.463002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:11.465603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:11.477821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:11.478643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:11.479289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:11.481590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:11.482680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:11.483492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:11.646934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:11.660756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:11.671841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:11.686735 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4658032c-bcca-4b1b-b804-9fdcb338e66d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.232573 Aug 29 04:57:11.687392 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 917/1774] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:11 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:11.700280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-380f7ad1-2d93-4f1b-8cec-808a1bc2ff70 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1ab8b3c1f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:11.998391 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-355b01a7-b5ad-4e8d-98a3-5678699bb473 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ed2098e4-46eb-409d-859a-44b427d970a3" status: 202 len: 0 microversion: 2.1 time: 0.576363 Aug 29 04:57:11.999863 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 858/1775] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:57:11 2022] DELETE /compute/v2.1/os-security-groups/ed2098e4-46eb-409d-859a-44b427d970a3 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:57:12.005353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:12.006410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:12.027046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:12.028250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:12.029016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:12.030010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:12.030850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:12.031497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:12.207184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:12.217272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:12.218912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:12.220150 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28f3406e-2c92-4ffc-846a-392e006232a9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.218900 Aug 29 04:57:12.220808 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 859/1776] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:12 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:12.225659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-19b49f52-b546-4825-9c7a-0df76076ea99 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1abd84b5e0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:12.474521 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-19b49f52-b546-4825-9c7a-0df76076ea99 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5d4d4fa6-2a41-4649-b1c5-2a6ba1b1b98e" status: 202 len: 0 microversion: 2.1 time: 0.252161 Aug 29 04:57:12.478819 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 860/1777] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:57:12 2022] DELETE /compute/v2.1/os-security-groups/5d4d4fa6-2a41-4649-b1c5-2a6ba1b1b98e => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:57:12.486647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:12.487821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:12.498369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:12.499999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:12.501160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:12.502227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:12.502869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:12.503472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:12.678654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:12.687592 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-edf72a48-d7a0-43da-9caf-8a37512dfe68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1487 microversion: 2.1 time: 0.207361 Aug 29 04:57:12.688166 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 861/1778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:12 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1487 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:12.693861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c73e2925-fbc7-4a64-9e47-2700446bb550 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] Calling method '.version_select at 0x7f1abd84b040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:12.976405 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c73e2925-fbc7-4a64-9e47-2700446bb550 tempest-SecurityGroupRulesTestJSON-768150528 tempest-SecurityGroupRulesTestJSON-768150528-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/30fb014e-71ba-4921-bef8-91aa00b96513" status: 202 len: 0 microversion: 2.1 time: 0.286957 Aug 29 04:57:12.977250 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 862/1779] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:57:12 2022] DELETE /compute/v2.1/os-security-groups/30fb014e-71ba-4921-bef8-91aa00b96513 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:57:12.983905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-acbe4e25-8b80-49cc-aef1-ad79bb1c4d7b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:12.984733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-acbe4e25-8b80-49cc-aef1-ad79bb1c4d7b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:13.011137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acbe4e25-8b80-49cc-aef1-ad79bb1c4d7b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:13.013687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acbe4e25-8b80-49cc-aef1-ad79bb1c4d7b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:13.029089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acbe4e25-8b80-49cc-aef1-ad79bb1c4d7b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:13.031046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acbe4e25-8b80-49cc-aef1-ad79bb1c4d7b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:13.034202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acbe4e25-8b80-49cc-aef1-ad79bb1c4d7b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:13.035021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acbe4e25-8b80-49cc-aef1-ad79bb1c4d7b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:13.146514 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-acbe4e25-8b80-49cc-aef1-ad79bb1c4d7b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761/action" status: 202 len: 0 microversion: 2.1 time: 0.167785 Aug 29 04:57:13.151640 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 863/1780] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:57:12 2022] POST /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:57:13.158835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:13.160146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:13.172061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:13.173082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:13.174238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:13.178200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:13.179036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:13.179705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:13.368608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:13.379295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:13.384579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:13.395021 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b09a1dd-80ba-4a2f-b861-3d4e28676b81 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.241454 Aug 29 04:57:13.399611 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 864/1781] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:13 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:13.414001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:13.414657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:13.445681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:13.447922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:13.448447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:13.448914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:13.449636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:13.456187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:13.456890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:13.737466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:13.748217 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7092838-0462-4ad5-8038-eee586b732ea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1492 microversion: 2.1 time: 0.342767 Aug 29 04:57:13.749142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 865/1782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:13 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1492 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:13.753880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:13.754486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:13.761717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:13.762220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:13.762654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:13.763532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:13.763819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:13.764282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:13.983793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:14.002926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:14.004534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:14.005675 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3714390d-bf86-4b2f-a6c7-386b4817a307 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.255532 Aug 29 04:57:14.006551 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 866/1783] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:13 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:14.427896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:14.429644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:14.444986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:14.445401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:14.447690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:14.448451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:14.448982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:14.449411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:14.754622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:14.791610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:14.794086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:14.816045 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bdc5d59e-c2b3-4718-9a87-dd3e952fb21c tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.392419 Aug 29 04:57:14.848323 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 867/1784] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:14 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:57:14.859373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:14.860665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:14.878514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:14.888343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:14.889755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:14.893459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:14.893966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:14.894390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:15.110976 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-380f7ad1-2d93-4f1b-8cec-808a1bc2ff70 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1436 microversion: 2.1 time: 3.421778 Aug 29 04:57:15.111551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 918/1785] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:11 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1436 bytes in 3423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:15.121648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:15.123974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:15.135357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:15.135902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:15.136456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:15.137488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:15.138196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:15.138625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:15.277590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:15.287822 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-deb2832c-6298-45cc-ba31-b83a160cac84 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 200 len: 1472 microversion: 2.1 time: 0.436400 Aug 29 04:57:15.302606 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 868/1786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:14 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:15.313506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b056a97a-f2b7-4b68-9f14-556b451e61f9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd884820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:15.372327 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b056a97a-f2b7-4b68-9f14-556b451e61f9 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 200 len: 1436 microversion: 2.1 time: 0.067864 Aug 29 04:57:15.373186 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 869/1787] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:15 2022] GET /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 1436 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:15.379223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5545d42a-7b0a-43ba-97cb-a00a9b0e3024 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1866141635"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:15.382141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5545d42a-7b0a-43ba-97cb-a00a9b0e3024 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:15.389780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5545d42a-7b0a-43ba-97cb-a00a9b0e3024 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:15.390931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5545d42a-7b0a-43ba-97cb-a00a9b0e3024 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:15.391583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5545d42a-7b0a-43ba-97cb-a00a9b0e3024 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:15.392772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5545d42a-7b0a-43ba-97cb-a00a9b0e3024 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:15.393439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5545d42a-7b0a-43ba-97cb-a00a9b0e3024 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:15.394242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5545d42a-7b0a-43ba-97cb-a00a9b0e3024 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:15.508881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:15.529971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:15.534617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:15.543581 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07a197d8-61af-41da-8692-61781674e992 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.425537 Aug 29 04:57:15.546722 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 919/1788] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:15 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:15.558257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:15.562381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:15.578932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:15.581948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:15.582932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:15.594975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:15.598073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:15.599145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:15.646183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:15.797579 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5545d42a-7b0a-43ba-97cb-a00a9b0e3024 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761/action" status: 202 len: 0 microversion: 2.1 time: 0.416147 Aug 29 04:57:15.800651 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 870/1789] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:57:15 2022] POST /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 04:57:15.829883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-36b7a22d-88b1-4abf-93bc-87500b43c6a6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd81d3a0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:15.928764 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-36b7a22d-88b1-4abf-93bc-87500b43c6a6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.120080 Aug 29 04:57:15.930436 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 871/1790] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:15 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:15.935915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:15.937008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:15.958847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:15.960277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:15.962309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:15.966503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:15.968514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:15.969756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:16.146669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:16.164283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:16.165768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:16.171812 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-99782429-2315-42c2-9429-0c756a06cfb8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.240120 Aug 29 04:57:16.172985 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 872/1791] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:15 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:16.298202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:16.307361 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-01878421-70b8-4ae5-bed4-ba27b55ac85a tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1479 microversion: 2.1 time: 0.756171 Aug 29 04:57:16.321651 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 920/1792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:15 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1479 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:16.569626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:16.570237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:16.577921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:16.578229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:16.578671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:16.579375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:16.579823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:16.580276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:16.772508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:16.782886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:16.784568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:16.785714 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4c7b5c5e-6c2d-4931-9f83-faf33629ac98 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.220137 Aug 29 04:57:16.786603 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 873/1793] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:16 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:16.945735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-816b8f8e-622a-476a-bd74-f083c35998f8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd7fd4c0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:17.013424 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-816b8f8e-622a-476a-bd74-f083c35998f8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.073758 Aug 29 04:57:17.014037 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 921/1794] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:16 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:17.203122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:17.222046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:17.241506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:17.245432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:17.248074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:17.250093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:17.250572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:17.251005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:17.292975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:17.330731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:17.331956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:17.353154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:17.353653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:17.354091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:17.355297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:17.355773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:17.356218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:17.385115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:17.394502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:17.396926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:17.407713 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd8f8ce0-58a8-4468-a2f2-49fc3de51802 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.214196 Aug 29 04:57:17.409386 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 874/1795] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:17 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:17.589355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:17.599015 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed8ec940-91da-4daf-8d93-4cab155da9b8 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1466 microversion: 2.1 time: 0.272291 Aug 29 04:57:17.619285 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 922/1796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:17 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1466 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:17.627988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7631f079-e5ab-4ccb-931c-81390b3b555e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd820430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:17.813304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:17.813926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:17.832615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:17.833442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:17.833883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:17.835072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:17.835471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:17.836700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:18.028048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:18.040394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:18.047555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:18.049791 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dce7070b-6a9b-4970-b40e-0857b7502c2c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.240825 Aug 29 04:57:18.069269 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 923/1797] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:17 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:18.080353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-be3edc95-fe73-4502-9779-daad33456309 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8b2dc10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:18.299681 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7631f079-e5ab-4ccb-931c-81390b3b555e tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "DELETE /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37" status: 204 len: 0 microversion: 2.1 time: 0.675606 Aug 29 04:57:18.301870 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 875/1798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:17 2022] DELETE /compute/v2.1/images/a7bd8dac-1a99-49a3-91bf-a269f0e31c37 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:57:18.314810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54a42728-396c-47db-864e-fe984ce68f2f tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '.version_select at 0x7f1abd88ab80>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:18.378944 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-54a42728-396c-47db-864e-fe984ce68f2f tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] HTTP exception thrown: Image not found. Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54a42728-396c-47db-864e-fe984ce68f2f tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Request method failure captured: Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b HTTP/1.1 Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEbYl90PzS4I2eyVqT-PhVKT6cXiPfxIPpvMd-MSfOpHC_ZG7dB5-iwYkqkHRVlEpDxh_ebDJXW-ytbRobJ5-NqI1xjsXllC3D2X4sqAxQwD1Up5zXdDnl3DYkOg55xVBJAfur1LWiA2r0IbJFJYoMajOo49P3a2pWyklCQOUwEFH60 Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6baeb53030d84c5e8999a9653663ab34 Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesOneServerTestJSON-884282419 Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:18.381175 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6baeb53030d84c5e8999a9653663ab34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6baeb53030d84c5e8999a9653663ab34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6baeb53030d84c5e8999a9653663ab34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6baeb53030d84c5e8999a9653663ab34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesOneServerTestJSON-884282419 Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6baeb53030d84c5e8999a9653663ab34 Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-884282419 Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesOneServerTestJSON-884282419-project Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 236a9aeeb6f6493797a3c8fe6d6581d8 Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesOneServerTestJSON-884282419-project Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'c8b458c4-5e79-4f57-9599-2a6d6251099b'} Aug 29 04:57:18.383051 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c8b458c4-5e79-4f57-9599-2a6d6251099b to delete Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:18.384216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8b458c4-5e79-4f57-9599-2a6d6251099b could not be found. Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:18.385907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 04:57:18.387717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:18.392851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54a42728-396c-47db-864e-fe984ce68f2f tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:18.394089 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54a42728-396c-47db-864e-fe984ce68f2f tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "DELETE /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b" status: 404 len: 62 microversion: 2.1 time: 0.087138 Aug 29 04:57:18.395149 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-be3edc95-fe73-4502-9779-daad33456309 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.323499 Aug 29 04:57:18.402541 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 924/1799] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:18 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:18.402755 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 876/1800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:18 2022] DELETE /compute/v2.1/images/c8b458c4-5e79-4f57-9599-2a6d6251099b => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:57:18.405342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:18.409658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:18.419790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:18.420285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:18.420701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:18.421431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:18.421859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:18.422274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:18.435557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:18.436280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:18.450821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:18.451229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:57:18.452093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:18.453319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:18.454407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:18.455631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:18.456072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:18.545087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:18.555307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:18.556523 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-917f86d0-4c34-4cc5-9d2b-839c42366188 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 204 len: 0 microversion: 2.1 time: 0.156655 Aug 29 04:57:18.557341 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 925/1801] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:57:18 2022] DELETE /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:57:18.558108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:18.564588 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9762a1b8-e228-4dbb-b2e5-02bc590c116d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.134720 Aug 29 04:57:18.566925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:18.567633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:18.574053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:18.574806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:18.575997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:18.577295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:18.577950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:18.578553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:18.582231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 877/1802] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:18 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:18.727051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:18.736490 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dead3795-20f6-4916-ab8a-d0b0fe5163f4 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1472 microversion: 2.1 time: 0.174577 Aug 29 04:57:18.737069 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 926/1803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:18 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:19.076014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:19.077101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:19.084693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:19.085304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:19.086006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:19.087205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:19.087885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:19.088484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:19.247012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:19.269335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:19.271332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:19.272580 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0c11297-bb05-4ca5-9834-2d40a6298d83 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.200981 Aug 29 04:57:19.288520 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 878/1804] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:19 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:19.410307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-000f9d93-9846-4455-b909-e7c9c3ae01c5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd87a790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:19.473125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ac631f4c-84ca-44ca-b0af-d2fcda367009 req-1fd2198f-6d38-4ce0-8fcc-81a75c126c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154", "name": "network-vif-unplugged", "status": "completed", "tag": "39ed18ba-56f8-4c3d-a711-deebbf9109d3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:19.485459 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-000f9d93-9846-4455-b909-e7c9c3ae01c5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.079007 Aug 29 04:57:19.486151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ac631f4c-84ca-44ca-b0af-d2fcda367009 req-1fd2198f-6d38-4ce0-8fcc-81a75c126c81 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:19.486886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ac631f4c-84ca-44ca-b0af-d2fcda367009 req-1fd2198f-6d38-4ce0-8fcc-81a75c126c81 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:19.487568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ac631f4c-84ca-44ca-b0af-d2fcda367009 req-1fd2198f-6d38-4ce0-8fcc-81a75c126c81 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:19.487703 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 927/1805] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:19 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:19.501887 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ac631f4c-84ca-44ca-b0af-d2fcda367009 req-1fd2198f-6d38-4ce0-8fcc-81a75c126c81 service nova] Creating event network-vif-unplugged:39ed18ba-56f8-4c3d-a711-deebbf9109d3 for instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 on n-h1-854119-9 Aug 29 04:57:19.508239 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ac631f4c-84ca-44ca-b0af-d2fcda367009 req-1fd2198f-6d38-4ce0-8fcc-81a75c126c81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039068 Aug 29 04:57:19.509233 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 879/1806] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:57:19.592152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:19.592753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:19.599818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:19.600327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:19.600694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:19.601579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:19.602206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:19.602634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:19.692690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:19.705465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:19.708955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:19.716801 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6a3d399-6f80-4e62-b7b6-f9bc30920dfa tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.129441 Aug 29 04:57:19.718230 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 928/1807] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:19 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:19.761428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:19.762199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:19.773783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:19.774277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:19.774713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:19.775426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:19.775904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:19.776419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:19.938327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:19.951592 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ffbe302e-9323-4b7a-9ea5-088c6dff2625 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1472 microversion: 2.1 time: 0.195166 Aug 29 04:57:19.957500 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 880/1808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:19 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:20.295012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:20.295621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:20.302514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:20.303230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:20.303831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:20.304988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:20.305823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:20.306426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:20.488879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:20.500003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:20.502525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:20.503904 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ebbed2c8-7546-4b02-b0d9-ea70e67e7693 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.212897 Aug 29 04:57:20.504702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d38eacf-c744-4354-a3b7-5d65eeaa71d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd8200d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:20.517144 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 929/1809] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:20 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:20.579473 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d38eacf-c744-4354-a3b7-5d65eeaa71d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.080112 Aug 29 04:57:20.587438 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 881/1810] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:20 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:20.744419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:20.745445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:20.753520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:20.755838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:20.756332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:20.757049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:20.757501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:20.757919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:20.846554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:20.855243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:20.856710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:20.862827 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e3cbbb1c-4da0-4c27-a7fe-c481a7258f70 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.123742 Aug 29 04:57:20.863719 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 930/1811] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:20 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:20.986784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:20.987433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:20.995150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:20.995651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:20.996084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:20.996831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:20.997464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:20.998082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:21.163360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:21.172624 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2746e12b-a029-4914-88a8-3154c9d059b2 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1472 microversion: 2.1 time: 0.194752 Aug 29 04:57:21.173584 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 882/1812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:20 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:21.531413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:21.532814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:21.534137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3ce8ff54-a5a9-4082-bc19-7cbf65db5f10 req-ff2220d7-8ed6-4588-ba71-6126fc07dc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edb1989-4869-4968-ba61-d2fd91304761", "name": "network-vif-plugged", "status": "completed", "tag": "807392e6-35c9-4185-be60-e876c6285ebe"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:21.548395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:21.549401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:21.549847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:21.551366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:21.553334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:21.554208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:21.555620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ce8ff54-a5a9-4082-bc19-7cbf65db5f10 req-ff2220d7-8ed6-4588-ba71-6126fc07dc09 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:21.557699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ce8ff54-a5a9-4082-bc19-7cbf65db5f10 req-ff2220d7-8ed6-4588-ba71-6126fc07dc09 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:21.558990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ce8ff54-a5a9-4082-bc19-7cbf65db5f10 req-ff2220d7-8ed6-4588-ba71-6126fc07dc09 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:21.578198 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3ce8ff54-a5a9-4082-bc19-7cbf65db5f10 req-ff2220d7-8ed6-4588-ba71-6126fc07dc09 service nova] Creating event network-vif-plugged:807392e6-35c9-4185-be60-e876c6285ebe for instance 0edb1989-4869-4968-ba61-d2fd91304761 on n-h1-854119-9 Aug 29 04:57:21.601450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3ce8ff54-a5a9-4082-bc19-7cbf65db5f10 req-ff2220d7-8ed6-4588-ba71-6126fc07dc09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070732 Aug 29 04:57:21.603639 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 883/1813] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:57:21.618245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f5ee1cc-c380-4794-a2ed-e6d264fe244b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9787d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:21.735363 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1f5ee1cc-c380-4794-a2ed-e6d264fe244b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.130085 Aug 29 04:57:21.736377 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 884/1814] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:21 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:21.784341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:21.794328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:21.797697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:21.811785 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b57ae39-b85d-4642-88e6-8b1c7d812dc4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.273821 Aug 29 04:57:21.811785 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 931/1815] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:21 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:21.897435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:21.898185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:21.907653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:21.908316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:21.908751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:21.909470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:21.909928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:21.910350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:22.033819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:22.046835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:22.049372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:22.059768 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-204e530f-db27-400d-aef9-6dbdea07b887 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.167472 Aug 29 04:57:22.064366 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 885/1816] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:21 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:22.195225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:22.196630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:22.206943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:22.211937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:22.215339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:22.216245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:22.216733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:22.217175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:22.650943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:22.665911 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c6315908-1973-46d6-adf7-1a5dfdece4eb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1472 microversion: 2.1 time: 0.475361 Aug 29 04:57:22.682100 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 932/1817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:22 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:22.750827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c41a5771-baff-4564-b3fb-1a7ab23f08d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd7d1c10>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:22.822762 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c41a5771-baff-4564-b3fb-1a7ab23f08d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.075968 Aug 29 04:57:22.823019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:22.823815 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 886/1818] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:22 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:22.823962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:22.843523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:22.844067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:22.846279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:22.847032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:22.852549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:22.853091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:22.890643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-88a909b7-4eaa-4ec1-a60e-b4a64c0a5244 req-9db403c4-cae0-4b34-a189-c108719aa885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154", "name": "network-vif-deleted", "tag": "39ed18ba-56f8-4c3d-a711-deebbf9109d3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:22.902551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-88a909b7-4eaa-4ec1-a60e-b4a64c0a5244 req-9db403c4-cae0-4b34-a189-c108719aa885 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:22.903118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-88a909b7-4eaa-4ec1-a60e-b4a64c0a5244 req-9db403c4-cae0-4b34-a189-c108719aa885 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:22.903647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-88a909b7-4eaa-4ec1-a60e-b4a64c0a5244 req-9db403c4-cae0-4b34-a189-c108719aa885 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:22.939473 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-88a909b7-4eaa-4ec1-a60e-b4a64c0a5244 req-9db403c4-cae0-4b34-a189-c108719aa885 service nova] Creating event network-vif-deleted:39ed18ba-56f8-4c3d-a711-deebbf9109d3 for instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 on n-h1-854119-9 Aug 29 04:57:22.960298 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-88a909b7-4eaa-4ec1-a60e-b4a64c0a5244 req-9db403c4-cae0-4b34-a189-c108719aa885 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068127 Aug 29 04:57:22.960997 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 887/1819] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:57:23.090621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:23.091326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:23.108236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:23.110012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:23.110127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:23.112981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:23.117065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:23.120593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:23.293535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:23.306744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:23.310822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:23.313257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:23.317165 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2dbb0049-9080-4426-ae75-1b9a8a456f16 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.232422 Aug 29 04:57:23.318300 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 888/1820] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:23 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:57:23.331982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:23.334828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:23.336004 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39a072eb-ec82-49c1-bdcd-0bae6be7cdad tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.517785 Aug 29 04:57:23.359096 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 933/1821] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:22 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:57:23.687564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:23.690276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:23.705309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:23.705976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:23.706666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:23.708565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:23.709015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:23.710320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:23.754386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:23.755781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:23.756401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:23.757290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lazy-loading 'fault' on Instance uuid 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:23.818985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236a9aeeb6f6493797a3c8fe6d6581d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6baeb53030d84c5e8999a9653663ab34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:23.845044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06c84151-7223-44e9-b50f-0cf8dc86b494 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd7dae50>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:23.850120 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6c9d7d40-6729-4b26-adc0-096089f38696 tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 200 len: 1306 microversion: 2.1 time: 0.165792 Aug 29 04:57:23.852976 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 889/1822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:23 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 1306 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:24.152650 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06c84151-7223-44e9-b50f-0cf8dc86b494 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.316161 Aug 29 04:57:24.163071 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 934/1823] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:23 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:24.345738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-65aa687f-65e4-4989-8a52-500d1f01c574 req-1634a3e9-0b55-4bfc-ab56-96685185e2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901a2798-d6c4-4d96-8a72-a0828794e98c", "name": "network-vif-plugged", "status": "completed", "tag": "7336574f-6a84-480f-9e96-5a47d4706f1b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:24.372690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:24.373324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:24.376791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:24.387824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:24.389393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-65aa687f-65e4-4989-8a52-500d1f01c574 req-1634a3e9-0b55-4bfc-ab56-96685185e2dd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:24.390199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:24.390640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:24.391271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-65aa687f-65e4-4989-8a52-500d1f01c574 req-1634a3e9-0b55-4bfc-ab56-96685185e2dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:24.391408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:24.391728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-65aa687f-65e4-4989-8a52-500d1f01c574 req-1634a3e9-0b55-4bfc-ab56-96685185e2dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:24.391864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:24.393054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:24.437323 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-65aa687f-65e4-4989-8a52-500d1f01c574 req-1634a3e9-0b55-4bfc-ab56-96685185e2dd service nova] Creating event network-vif-plugged:7336574f-6a84-480f-9e96-5a47d4706f1b for instance 901a2798-d6c4-4d96-8a72-a0828794e98c on n-h1-854119-9 Aug 29 04:57:24.455703 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-65aa687f-65e4-4989-8a52-500d1f01c574 req-1634a3e9-0b55-4bfc-ab56-96685185e2dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121127 Aug 29 04:57:24.457792 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 890/1824] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:24.470580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:24.471885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:24.482618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:24.483652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:24.484402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:24.487397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:24.488362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:24.489321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:24.602622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:24.626314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:24.627785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:24.643325 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5c3f51f-7ad7-439d-ad31-0fb1f173b689 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.297108 Aug 29 04:57:24.643932 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 935/1825] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:24 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:24.873254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:24.873924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] [instance: 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:24.885415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:24.887128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:24.887750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:24.891590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:24.896548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:24.897179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:24.935511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:24.942012 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] HTTP exception thrown: Instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 could not be found. Aug 29 04:57:24.949693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:24.951439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Request method failure captured: Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 HTTP/1.1 Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEbYl90PzS4I2eyVqT-PhVKT6cXiPfxIPpvMd-MSfOpHC_ZG7dB5-iwYkqkHRVlEpDxh_ebDJXW-ytbRobJ5-NqI1xjsXllC3D2X4sqAxQwD1Up5zXdDnl3DYkOg55xVBJAfur1LWiA2r0IbJFJYoMajOo49P3a2pWyklCQOUwEFH60 Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6baeb53030d84c5e8999a9653663ab34 Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerTestJSON-884282419 Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:57:24.952523 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6baeb53030d84c5e8999a9653663ab34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6baeb53030d84c5e8999a9653663ab34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6baeb53030d84c5e8999a9653663ab34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6baeb53030d84c5e8999a9653663ab34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerTestJSON-884282419 Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6baeb53030d84c5e8999a9653663ab34 Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-884282419 Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerTestJSON-884282419-project Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 236a9aeeb6f6493797a3c8fe6d6581d8 Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerTestJSON-884282419-project Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 could not be found. Aug 29 04:57:24.954081 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154'} Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 could not be found. Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:24.954969 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 could not be found. Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 could not be found. Aug 29 04:57:24.957630 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:24.963286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] Returning 404 to user: Instance 4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:24.965784 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3ac34b8c-c81b-41c3-99a1-b605369395fb tempest-ImagesOneServerTestJSON-884282419 tempest-ImagesOneServerTestJSON-884282419-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154" status: 404 len: 111 microversion: 2.1 time: 0.096462 Aug 29 04:57:24.966531 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-48bea50b-512a-4d38-8076-ce371161d0f7 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.503846 Aug 29 04:57:24.967522 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 891/1826] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:24 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:24.968812 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 936/1827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:24 2022] GET /compute/v2.1/servers/4f3de9ed-b1c3-4e89-9484-a7e6ff2f7154 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:57:25.171182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28c0567b-bae3-4a27-92b9-e7c06e0a0324 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd81d4c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:25.675237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:25.677672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:25.694461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:25.695279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:25.695945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:25.697252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:25.698193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:25.698961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:25.841910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:25.858169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:25.859941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:25.866926 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aed828c3-e72f-4cd2-bc74-e3d3564cad22 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.199174 Aug 29 04:57:25.882377 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 937/1828] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:25 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:25.997727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:25.998822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:26.017899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:26.018828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:26.019345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:26.020909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:26.021974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:26.022482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:26.214182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:26.227785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:26.230716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:26.232802 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9a2613c-a600-41cc-9a8d-f632b6315329 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1280 microversion: 2.25 time: 0.240808 Aug 29 04:57:26.248279 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 938/1829] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:25 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:26.690285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1208910062", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "57e28866-1c32-4826-b8f3-b2fdc024be39"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:27.379915 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28c0567b-bae3-4a27-92b9-e7c06e0a0324 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 2.212387 Aug 29 04:57:27.382558 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 892/1830] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:25 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:27.407400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:27.408506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:27.412526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] validate_networks() for [('57e28866-1c32-4826-b8f3-b2fdc024be39', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:57:27.418959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:27.419943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:27.421770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:27.422932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:27.423550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:27.424438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:27.558545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:27.568822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:27.573149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:27.579423 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7f3ee010-3bf3-4e3c-8240-b9d26364921d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.185754 Aug 29 04:57:27.596722 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 893/1831] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:27 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:27.602418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:27.603341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:27.609848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:27.610667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:27.611207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:27.612167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:27.612838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:27.613481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:27.941347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:27.951437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:27.952822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:27.953995 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f315d4d7-f680-496e-99fc-cf1666aa65a2 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1476 microversion: 2.25 time: 0.355830 Aug 29 04:57:27.976343 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 894/1832] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:27 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:28.234508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a385f10-9428-49a3-a6ba-ab293fcd85d2 tempest-ListImagesTestJSON-1409134155 tempest-ListImagesTestJSON-1409134155-project] Calling method '.version_select at 0x7f1ab951faf0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:28.292878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:57:28.293427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:57:28.293976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:57:28.294455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:57:28.294931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:57:28.299325 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a385f10-9428-49a3-a6ba-ab293fcd85d2 tempest-ListImagesTestJSON-1409134155 tempest-ListImagesTestJSON-1409134155-project] 10.222.0.20 "GET /compute/v2.1/images/6e3fd38c-90a0-4677-991e-152affedd0a1" status: 200 len: 784 microversion: 2.1 time: 0.321817 Aug 29 04:57:28.299909 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 895/1833] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:27 2022] GET /compute/v2.1/images/6e3fd38c-90a0-4677-991e-152affedd0a1 => generated 784 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:28.318756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:28.320300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:28.320978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:28.321913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:28.322576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:28.323210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:28.345024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:28.356464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for user 4d3aaab47eb243c6bf9a0b2e512e7c4a and project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:28.372144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:57:28.374858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:57:28.462988 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a165e60d-e25c-4e98-887e-69af34918753 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.222471 Aug 29 04:57:28.466877 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 939/1834] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:57:28.479342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fe43c9e1-fc2c-4dd1-abc1-8398924a9fbe tempest-ListImagesTestJSON-1409134155 tempest-ListImagesTestJSON-1409134155-project] Calling method '.version_select at 0x7f1ab8b473a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:28.561515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:28.562833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:28.574015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:28.575604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:28.576269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:28.577175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:28.579784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:28.580483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:28.628970 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fe43c9e1-fc2c-4dd1-abc1-8398924a9fbe tempest-ListImagesTestJSON-1409134155 tempest-ListImagesTestJSON-1409134155-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.160689 Aug 29 04:57:28.640462 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 940/1835] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 04:57:28 2022] GET /compute/v2.1/images => generated 871 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:28.653090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df1c7727-e69e-497d-a9c0-019970d24a7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8b49ee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:28.755807 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df1c7727-e69e-497d-a9c0-019970d24a7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.114155 Aug 29 04:57:28.763763 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 941/1836] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:28 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:28.776106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-700b938d-bde1-4a26-be7a-c8e91df3c006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:28.779828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-700b938d-bde1-4a26-be7a-c8e91df3c006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:28.882989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 901a2798-d6c4-4d96-8a72-a0828794e98c {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:28.925792 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c5bfcd23-99d6-463b-bca8-82a160efa8c2 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1968 microversion: 2.25 time: 0.624376 Aug 29 04:57:28.931351 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 896/1837] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:28 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1968 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:28.941475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:28.944592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:28.958854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:28.959444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:28.959775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:28.967354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-700b938d-bde1-4a26-be7a-c8e91df3c006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:28.968915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:28.969416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:28.969866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:28.981232 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-700b938d-bde1-4a26-be7a-c8e91df3c006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1215 microversion: 2.1 time: 0.210495 Aug 29 04:57:28.988352 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 942/1838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:28 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:29.002756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e434fc5b-6fdb-4f54-8991-509ccc1d425a tempest-ListImagesTestJSON-1409134155 tempest-ListImagesTestJSON-1409134155-project] Calling method '.version_select at 0x7f1ab8b75ee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:29.085655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:29.113307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:29.115419 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e434fc5b-6fdb-4f54-8991-509ccc1d425a tempest-ListImagesTestJSON-1409134155 tempest-ListImagesTestJSON-1409134155-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.124251 Aug 29 04:57:29.124495 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 943/1839] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:57:28 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:29.130646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:29.147253 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e9c175e3-e2bc-4d00-8f14-361a7ef3c820 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.214268 Aug 29 04:57:29.149779 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 897/1840] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:28 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:29.157899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:29.158564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:29.181243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:29.181794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:29.184770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:29.185523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:29.186151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:29.187395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:29.419945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:29.427418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 901a2798-d6c4-4d96-8a72-a0828794e98c {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:29.489468 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8b246b20-a16e-42c8-814a-446f533a0be0 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1968 microversion: 2.25 time: 0.367642 Aug 29 04:57:29.504380 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 944/1841] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:29 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1968 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:29.514136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-954b64ff-b9af-4582-aeb8-4198feb9bc91 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:29.518367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-954b64ff-b9af-4582-aeb8-4198feb9bc91 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:29.521538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-954b64ff-b9af-4582-aeb8-4198feb9bc91 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:29.522320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-954b64ff-b9af-4582-aeb8-4198feb9bc91 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:29.528840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-954b64ff-b9af-4582-aeb8-4198feb9bc91 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:29.529444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-954b64ff-b9af-4582-aeb8-4198feb9bc91 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:29.535922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-954b64ff-b9af-4582-aeb8-4198feb9bc91 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:29.588029 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-954b64ff-b9af-4582-aeb8-4198feb9bc91 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077986 Aug 29 04:57:29.589451 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 898/1842] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Aug 29 04:57:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:57:29.601799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-9", "block_migration": "auto"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:29.606129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:29.620068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:29.621534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:29.622202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:29.623127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:29.623794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:29.624478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:29.664640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'flavor' on Instance uuid 901a2798-d6c4-4d96-8a72-a0828794e98c {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:29.681907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Going to try to live migrate instance to n-h2-854119-9 {{(pid=128872) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 04:57:29.771068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-948e012e-d93a-43fc-a719-13e5e35d3e06 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab95d4b80>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:29.842187 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-948e012e-d93a-43fc-a719-13e5e35d3e06 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.075260 Aug 29 04:57:29.844254 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 899/1843] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:29 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:29.999619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:30.000482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:30.025529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:30.032103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:30.032788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:30.034142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:30.034984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:30.040486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:30.209294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:30.263087 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c01be489-5c43-4f39-8867-d8551a69001e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1267 microversion: 2.1 time: 0.254671 Aug 29 04:57:30.282431 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 900/1844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:29 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:30.306038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:30.306656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:30.341747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:30.342782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:30.344405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:30.352830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:30.355505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:30.357732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:30.499796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:30.655885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:30.675367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:30.678012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:30.686250 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e4bb52f5-e046-44cf-b4a5-8c75695f5256 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.398154 Aug 29 04:57:30.687506 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 901/1845] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:30 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:30.859122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b04286f5-61be-4647-b4dd-77879e59cd9f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd81d0d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:30.983074 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b04286f5-61be-4647-b4dd-77879e59cd9f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.128772 Aug 29 04:57:30.983728 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 902/1846] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:30 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:31.286217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:31.287000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:31.306256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:31.306647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:31.314999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:31.320833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:31.321428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:31.321976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:31.581115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:31.592271 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64858efb-a3f5-491d-aad2-8ae50453d8be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1275 microversion: 2.1 time: 0.308931 Aug 29 04:57:31.609268 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 903/1847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:31 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1275 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:31.719434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:31.721927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:31.734424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:31.737860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:31.739052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:31.741397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:31.742928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:31.746768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:31.996420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:32.006559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:32.020570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:32.037405 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a21c1a6b-92cb-448c-bc6a-851395272516 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1446 microversion: 2.75 time: 0.326560 Aug 29 04:57:32.042610 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 904/1848] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:31 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1446 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:32.065155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64f5a31b-f936-4d83-9b2a-6e5250e72134 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd7d1790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:32.137978 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64f5a31b-f936-4d83-9b2a-6e5250e72134 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.093938 Aug 29 04:57:32.139252 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 905/1849] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:32 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:32.641989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b43ca845-2b05-4d2b-89b3-a3f27e0dff75 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Action: 'create', calling method: .version_select at 0x7f1abd847940>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqNYV9mT4T9I4T0fIBq9BxeQ1FnqhhwdSSdVH2XdIOvAIKceP5m5BQtU7SXPB923LxGP1pYPMpdXm2AI2jeVmbkm71R5KzMb09qRZEIXIyC1zSCaEDKXJ7bIF3/gpyn3g=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b43ca845-2b05-4d2b-89b3-a3f27e0dff75 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Request method failure captured: Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 257 Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc8GXYDVEotXnmKwWx-gL0T46PRyriOWKFyUtp2_GlCiGm1wigbx1mTz9mXu2Iqr1bpn4d4_XWNDNyQYWbO-XbxXBsNDCWGfKib0Elr09y0ezql6UKyixjz75cTVnxEE2ftc37kgF7jidatRPeKGLWivKZhhiR_VP6XnWyJ18ImfLk Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:32.647098 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9628585eb224f61bdbe53b8fe490d88", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:57:32.648816 n-d-854119-9 devstack@n-api.service[128871]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqNYV9mT4T9I4T0fIBq9BxeQ1FnqhhwdSSdVH2XdIOvAIKceP5m5BQtU7SXPB923LxGP1pYPMpdXm2AI2jeVmbkm71R5KzMb09qRZEIXIyC1zSCaEDKXJ7bIF3/gpyn3g=="}} Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqNYV9mT4T9I4T0fIBq9BxeQ1FnqhhwdSSdVH2XdIOvAIKceP5m5BQtU7SXPB923LxGP1pYPMpdXm2AI2jeVmbkm71R5KzMb09qRZEIXIyC1zSCaEDKXJ7bIF3/gpyn3g=='}}} Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:32.649636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:32.650920 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:57:32.656415 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:57:32.659272 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 04:57:32.659272 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:32.659272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b43ca845-2b05-4d2b-89b3-a3f27e0dff75 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:32.659272 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b43ca845-2b05-4d2b-89b3-a3f27e0dff75 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.241291 Aug 29 04:57:32.659272 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 906/1850] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:57:32 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:57:32.659272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:32.660019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:32.669356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:32.673220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:32.673756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:32.674517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:32.675058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:32.675490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:33.142159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:33.152808 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6a749453-8916-427b-9e93-ae7acd6397a9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1315 microversion: 2.1 time: 0.502115 Aug 29 04:57:33.154683 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 907/1851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:32 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:33.165283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72324b4f-3373-44e2-98d9-c663b69b785f tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Action: 'create', calling method: .version_select at 0x7f1abd84b5e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-465580108", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:33.204715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-72324b4f-3373-44e2-98d9-c663b69b785f tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:33.222166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-72324b4f-3373-44e2-98d9-c663b69b785f tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for user 40a4264a25624b808b6beda72e1bbb6e and project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:33.257430 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-72324b4f-3373-44e2-98d9-c663b69b785f tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72324b4f-3373-44e2-98d9-c663b69b785f tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Request method failure captured: Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 2166 Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc8GXYDVEotXnmKwWx-gL0T46PRyriOWKFyUtp2_GlCiGm1wigbx1mTz9mXu2Iqr1bpn4d4_XWNDNyQYWbO-XbxXBsNDCWGfKib0Elr09y0ezql6UKyixjz75cTVnxEE2ftc37kgF7jidatRPeKGLWivKZhhiR_VP6XnWyJ18ImfLk Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9628585eb224f61bdbe53b8fe490d88", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-465580108", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:57:33.279610 n-d-854119-9 devstack@n-api.service[128871]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-465580108', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:33.282416 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:33.286642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.289761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72324b4f-3373-44e2-98d9-c663b69b785f tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:33.290831 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72324b4f-3373-44e2-98d9-c663b69b785f tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.129932 Aug 29 04:57:33.292638 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 908/1852] 10.222.0.20 () {60 vars in 1160 bytes} [Mon Aug 29 04:57:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:57:33.299758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:33.300682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:33.312994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:33.320595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:33.321364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:33.322339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:33.323006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:33.323711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:33.465987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:33.488009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:33.489991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:33.496868 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b3974553-d96e-46ac-a575-ac3cb952635d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1464 microversion: 2.75 time: 0.202824 Aug 29 04:57:33.498281 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 909/1853] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:33 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1464 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:33.517178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d62c3cd3-d177-48f5-a958-bbd526a2aae4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd7ccca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:33.590190 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d62c3cd3-d177-48f5-a958-bbd526a2aae4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.090538 Aug 29 04:57:33.591475 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 910/1854] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:33 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:33.597381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab51fb47-0439-4f8c-93f4-9cb7cefdb1d7 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Action: 'create', calling method: .version_select at 0x7f1abd7d1310>, body: {"keypair": {"name": "tempest-keypair-341913919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP9KN53I3dF9kgbMrm9vlB/NKKT0FgMdHGHqX6uX6P0GCqq0olbtu54Xr0nxNbOyDafiuIL+E+NghXl6U7JPigcfOMQlXG9WiQSyvQ3Ry9e0bBfeqRvge76sgp/jdFihA=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:33.624909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:33.633774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ab51fb47-0439-4f8c-93f4-9cb7cefdb1d7 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:33.642108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ab51fb47-0439-4f8c-93f4-9cb7cefdb1d7 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for user 40a4264a25624b808b6beda72e1bbb6e and project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:33.709241 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab51fb47-0439-4f8c-93f4-9cb7cefdb1d7 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116402 Aug 29 04:57:33.720873 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 911/1855] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:57:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:33.729310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-58c35013-b6d3-4c42-adef-40a425f587ce tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Action: 'create', calling method: .version_select at 0x7f1abd81d0d0>, body: {"keypair": {"name": "tempest-keypair-341913919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLkQJQFeYrZvNfxXsAzsi2+IZHgJtkh/hdykk3XMBAMsU68E94v9Hre9KO2SM3PeIECL6hI8CsmdkDy8E2GY/OI0BIxMn4xFdCB6X7tSjdsVFpVgcACQ8CwjfQoHUt19w=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:33.781748 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7dbdc55b-e1ce-4362-a520-457f272f4c0d tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c/action" status: 202 len: 0 microversion: 2.25 time: 4.183156 Aug 29 04:57:33.784793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-58c35013-b6d3-4c42-adef-40a425f587ce tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:33.786073 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 945/1856] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 04:57:29 2022] POST /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c/action => generated 0 bytes in 4189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:57:33.792613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-58c35013-b6d3-4c42-adef-40a425f587ce tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for user 40a4264a25624b808b6beda72e1bbb6e and project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:33.801945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:33.802927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:33.815080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:33.820462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:33.821505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:33.822869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:33.824427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:33.825494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:33.827715 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-58c35013-b6d3-4c42-adef-40a425f587ce tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] HTTP exception thrown: Key pair 'tempest-keypair-341913919' already exists. Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-58c35013-b6d3-4c42-adef-40a425f587ce tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Request method failure captured: Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 272 Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc8GXYDVEotXnmKwWx-gL0T46PRyriOWKFyUtp2_GlCiGm1wigbx1mTz9mXu2Iqr1bpn4d4_XWNDNyQYWbO-XbxXBsNDCWGfKib0Elr09y0ezql6UKyixjz75cTVnxEE2ftc37kgF7jidatRPeKGLWivKZhhiR_VP6XnWyJ18ImfLk Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9628585eb224f61bdbe53b8fe490d88", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: {"keypair": {"name": "tempest-keypair-341913919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLkQJQFeYrZvNfxXsAzsi2+IZHgJtkh/hdykk3XMBAMsU68E94v9Hre9KO2SM3PeIECL6hI8CsmdkDy8E2GY/OI0BIxMn4xFdCB6X7tSjdsVFpVgcACQ8CwjfQoHUt19w=="}} Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: exception: Key pair 'tempest-keypair-341913919' already exists. Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-341913919', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLkQJQFeYrZvNfxXsAzsi2+IZHgJtkh/hdykk3XMBAMsU68E94v9Hre9KO2SM3PeIECL6hI8CsmdkDy8E2GY/OI0BIxMn4xFdCB6X7tSjdsVFpVgcACQ8CwjfQoHUt19w=='}}} Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result.read() Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '40a4264a25624b808b6beda72e1bbb6e-tempest-keypair-341913919' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 04:57:33.851246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result.read() Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 04:57:33.856717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '40a4264a25624b808b6beda72e1bbb6e-tempest-keypair-341913919' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 4, 57, 33, 814972), 'updated_at': None, 'name': 'tempest-keypair-341913919', 'user_id': '40a4264a25624b808b6beda72e1bbb6e', 'fingerprint': 'cc:cc:7b:12:5c:54:f2:39:e5:8b:b7:04:fe:56:0f:cc', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLkQJQFeYrZvNfxXsAzsi2+IZHgJtkh/hdykk3XMBAMsU68E94v9Hre9KO2SM3PeIECL6hI8CsmdkDy8E2GY/OI0BIxMn4xFdCB6X7tSjdsVFpVgcACQ8CwjfQoHUt19w==', 'type': 'ssh'}] Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi keypair.create() Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._create() Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-341913919' already exists. Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 29 04:57:33.863086 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-341913919' already exists. Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-341913919' already exists. Aug 29 04:57:33.872734 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.875136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-58c35013-b6d3-4c42-adef-40a425f587ce tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Returning 409 to user: Key pair 'tempest-keypair-341913919' already exists. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:33.878210 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-58c35013-b6d3-4c42-adef-40a425f587ce tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.152603 Aug 29 04:57:33.882378 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 912/1857] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:57:33 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:57:33.903476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06c12a1e-c260-4195-b726-75600ee5ccac tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Calling method '.version_select at 0x7f1ab9c4baf0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:33.955229 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06c12a1e-c260-4195-b726-75600ee5ccac tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-341913919" status: 202 len: 0 microversion: 2.1 time: 0.071139 Aug 29 04:57:33.956034 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 913/1858] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 04:57:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-341913919 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:57:33.969866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ac75ea2c-e37c-4ae1-9084-e46560290e25 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Action: 'create', calling method: .version_select at 0x7f1abd8474c0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuPPcc3FSeoxGOAfVw4COKlotpODD5OSqmPH4qOrSoyc9Ce5R+QURSi2+a6NQu/gUbmr7Es+QKtFnImJPaG4jdh2EUv6pCWweavfMsqjhE50B6+75OcdUON9riP6CbgGg=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ac75ea2c-e37c-4ae1-9084-e46560290e25 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Request method failure captured: Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 247 Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc8GXYDVEotXnmKwWx-gL0T46PRyriOWKFyUtp2_GlCiGm1wigbx1mTz9mXu2Iqr1bpn4d4_XWNDNyQYWbO-XbxXBsNDCWGfKib0Elr09y0ezql6UKyixjz75cTVnxEE2ftc37kgF7jidatRPeKGLWivKZhhiR_VP6XnWyJ18ImfLk Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9628585eb224f61bdbe53b8fe490d88", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuPPcc3FSeoxGOAfVw4COKlotpODD5OSqmPH4qOrSoyc9Ce5R+QURSi2+a6NQu/gUbmr7Es+QKtFnImJPaG4jdh2EUv6pCWweavfMsqjhE50B6+75OcdUON9riP6CbgGg=="}} Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuPPcc3FSeoxGOAfVw4COKlotpODD5OSqmPH4qOrSoyc9Ce5R+QURSi2+a6NQu/gUbmr7Es+QKtFnImJPaG4jdh2EUv6pCWweavfMsqjhE50B6+75OcdUON9riP6CbgGg=='}}} Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi '' Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:57:33.981388 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ac75ea2c-e37c-4ae1-9084-e46560290e25 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ac75ea2c-e37c-4ae1-9084-e46560290e25 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.017913 Aug 29 04:57:33.991180 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 914/1859] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:57:33 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:57:34.005858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64db7ab6-cb1c-486f-9ec3-be3cf7f1ea50 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Action: 'create', calling method: .version_select at 0x7f1ab8e121f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1412226473", "public_key": " "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:34.034475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-64db7ab6-cb1c-486f-9ec3-be3cf7f1ea50 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:34.039918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-64db7ab6-cb1c-486f-9ec3-be3cf7f1ea50 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for user 40a4264a25624b808b6beda72e1bbb6e and project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:34.057803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-64db7ab6-cb1c-486f-9ec3-be3cf7f1ea50 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64db7ab6-cb1c-486f-9ec3-be3cf7f1ea50 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Request method failure captured: Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 95 Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc8GXYDVEotXnmKwWx-gL0T46PRyriOWKFyUtp2_GlCiGm1wigbx1mTz9mXu2Iqr1bpn4d4_XWNDNyQYWbO-XbxXBsNDCWGfKib0Elr09y0ezql6UKyixjz75cTVnxEE2ftc37kgF7jidatRPeKGLWivKZhhiR_VP6XnWyJ18ImfLk Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9628585eb224f61bdbe53b8fe490d88", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1412226473", "public_key": " "}} Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1412226473', 'public_key': ' '}}} Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.059748 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64db7ab6-cb1c-486f-9ec3-be3cf7f1ea50 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64db7ab6-cb1c-486f-9ec3-be3cf7f1ea50 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071497 Aug 29 04:57:34.074502 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 915/1860] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Aug 29 04:57:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:57:34.079394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9786a20c-eb4b-4ffa-8206-8d85a5b6b71e tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Action: 'create', calling method: .version_select at 0x7f1ab8e12430>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8ZNjMc8qfYc4WrngeYXMc5H1oopt+9lqs8cKtwMl/fpVxT7Ir5MzLzXx0+32//ZiSFHsWieJ7Sh6KbHAqYJB57MWMM67spWv09nSB9KdtlHwDX0QBVtxBG3Avrg/wbZg=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9786a20c-eb4b-4ffa-8206-8d85a5b6b71e tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Request method failure captured: Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 507 Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc8GXYDVEotXnmKwWx-gL0T46PRyriOWKFyUtp2_GlCiGm1wigbx1mTz9mXu2Iqr1bpn4d4_XWNDNyQYWbO-XbxXBsNDCWGfKib0Elr09y0ezql6UKyixjz75cTVnxEE2ftc37kgF7jidatRPeKGLWivKZhhiR_VP6XnWyJ18ImfLk Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9628585eb224f61bdbe53b8fe490d88", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8ZNjMc8qfYc4WrngeYXMc5H1oopt+9lqs8cKtwMl/fpVxT7Ir5MzLzXx0+32//ZiSFHsWieJ7Sh6KbHAqYJB57MWMM67spWv09nSB9KdtlHwDX0QBVtxBG3Avrg/wbZg=="}} Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8ZNjMc8qfYc4WrngeYXMc5H1oopt+9lqs8cKtwMl/fpVxT7Ir5MzLzXx0+32//ZiSFHsWieJ7Sh6KbHAqYJB57MWMM67spWv09nSB9KdtlHwDX0QBVtxBG3Avrg/wbZg=='}}} Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 04:57:34.084236 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9786a20c-eb4b-4ffa-8206-8d85a5b6b71e tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9786a20c-eb4b-4ffa-8206-8d85a5b6b71e tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.015126 Aug 29 04:57:34.092633 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 916/1861] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:57:34 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 04:57:34.103454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-357608d7-04de-4a5c-82d0-38ba4d5dfed4 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Action: 'create', calling method: .version_select at 0x7f1abd847dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1879204983", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:34.140943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-357608d7-04de-4a5c-82d0-38ba4d5dfed4 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:34.147718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-357608d7-04de-4a5c-82d0-38ba4d5dfed4 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Getting quotas for user 40a4264a25624b808b6beda72e1bbb6e and project f9628585eb224f61bdbe53b8fe490d88. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:34.173649 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-357608d7-04de-4a5c-82d0-38ba4d5dfed4 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-357608d7-04de-4a5c-82d0-38ba4d5dfed4 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Request method failure captured: Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 118 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc8GXYDVEotXnmKwWx-gL0T46PRyriOWKFyUtp2_GlCiGm1wigbx1mTz9mXu2Iqr1bpn4d4_XWNDNyQYWbO-XbxXBsNDCWGfKib0Elr09y0ezql6UKyixjz75cTVnxEE2ftc37kgF7jidatRPeKGLWivKZhhiR_VP6XnWyJ18ImfLk Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9628585eb224f61bdbe53b8fe490d88", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1879204983", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1879204983', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 04:57:34.174840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-357608d7-04de-4a5c-82d0-38ba4d5dfed4 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:34.180294 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-357608d7-04de-4a5c-82d0-38ba4d5dfed4 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.082828 Aug 29 04:57:34.183078 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 917/1862] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 04:57:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:57:34.189557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:34.190303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:34.199005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:34.199527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:34.200091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:34.201221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:34.202002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:34.202280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:34.237357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:34.246667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:34.250951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:34.252390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ec9a9e79-a37c-499d-b202-2760f949a22c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.465086 Aug 29 04:57:34.252984 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 946/1863] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:33 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:34.268782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa376913-34d1-49a5-9bab-e2e7430a8196 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Calling method '.version_select at 0x7f1ab8afaee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:34.286855 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-fa376913-34d1-49a5-9bab-e2e7430a8196 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-214190996 not found for user 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa376913-34d1-49a5-9bab-e2e7430a8196 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Request method failure captured: Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-214190996 HTTP/1.1 Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc8GXYDVEotXnmKwWx-gL0T46PRyriOWKFyUtp2_GlCiGm1wigbx1mTz9mXu2Iqr1bpn4d4_XWNDNyQYWbO-XbxXBsNDCWGfKib0Elr09y0ezql6UKyixjz75cTVnxEE2ftc37kgF7jidatRPeKGLWivKZhhiR_VP6XnWyJ18ImfLk Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9628585eb224f61bdbe53b8fe490d88", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9628585eb224f61bdbe53b8fe490d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f9628585eb224f61bdbe53b8fe490d88 Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-197252271 Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-KeyPairsNegativeTestJSON-197252271-project Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: exception: Keypair tempest-keypair-non-existent-214190996 not found for user 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'tempest-keypair-non-existent-214190996'} Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-214190996 not found for user 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.289412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-214190996 not found for user 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-214190996 not found for user 40a4264a25624b808b6beda72e1bbb6e Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:34.294808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa376913-34d1-49a5-9bab-e2e7430a8196 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] Returning 404 to user: Keypair tempest-keypair-non-existent-214190996 not found for user 40a4264a25624b808b6beda72e1bbb6e {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:34.297399 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa376913-34d1-49a5-9bab-e2e7430a8196 tempest-KeyPairsNegativeTestJSON-197252271 tempest-KeyPairsNegativeTestJSON-197252271-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-214190996" status: 404 len: 144 microversion: 2.1 time: 0.039822 Aug 29 04:57:34.298669 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 947/1864] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Aug 29 04:57:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-214190996 => generated 144 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:57:34.493929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e7df9496-8df5-4866-9668-49b2f682ee6a req-46625d0d-6f7d-4f03-ae1c-f536acccac8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a03db1b0-6fca-4eb2-9579-8903be60ba92", "tag": "411672e7-0217-48fc-a423-e5e891878193"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:34.529381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e7df9496-8df5-4866-9668-49b2f682ee6a req-46625d0d-6f7d-4f03-ae1c-f536acccac8e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:34.533518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e7df9496-8df5-4866-9668-49b2f682ee6a req-46625d0d-6f7d-4f03-ae1c-f536acccac8e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:34.537587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e7df9496-8df5-4866-9668-49b2f682ee6a req-46625d0d-6f7d-4f03-ae1c-f536acccac8e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:34.570824 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e7df9496-8df5-4866-9668-49b2f682ee6a req-46625d0d-6f7d-4f03-ae1c-f536acccac8e service nova] Creating event network-changed:411672e7-0217-48fc-a423-e5e891878193 for instance a03db1b0-6fca-4eb2-9579-8903be60ba92 on n-h2-854119-9 Aug 29 04:57:34.578475 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e7df9496-8df5-4866-9668-49b2f682ee6a req-46625d0d-6f7d-4f03-ae1c-f536acccac8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091973 Aug 29 04:57:34.581209 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 948/1865] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:57:34.593893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:34.594900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:34.611084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:34.613907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:34.614551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:34.615936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:34.616930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:34.619631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:34.620469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:34.628857 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d4f820c-e5c6-439c-a275-b898cf3f9a15 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1315 microversion: 2.1 time: 0.445040 Aug 29 04:57:34.646555 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 918/1866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:34 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:34.648149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d197f608-2419-4c07-8306-7c9779a77e5a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8e0ee50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:34.732405 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d197f608-2419-4c07-8306-7c9779a77e5a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.093642 Aug 29 04:57:34.733570 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 919/1867] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:34 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:34.794310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:34.806972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:34.809202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:34.818629 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7d9c48e1-7c14-43c8-b38a-230b599f96d1 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1452 microversion: 2.75 time: 0.234451 Aug 29 04:57:34.820319 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 949/1868] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:34 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1452 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:35.277490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:35.278268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:35.299851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:35.300676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:35.301124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:35.303177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:35.309482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:35.310006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:35.553741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:35.567041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:35.573009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:35.576644 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a3bd0f8-d0bd-479f-8488-a0037ad9ffe9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.301308 Aug 29 04:57:35.598615 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 920/1869] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:35 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:35.656626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:35.658211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:35.668779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:35.671605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:35.672058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:35.672854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:35.673308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:35.673729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:35.747411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f173b3d4-0513-4556-af0a-92be155dd81a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8e0ed30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:35.840388 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f173b3d4-0513-4556-af0a-92be155dd81a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.089601 Aug 29 04:57:35.857428 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 921/1870] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:35 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:35.866044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:35.867577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:35.883256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:35.888095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:35.890248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:35.891392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:35.897315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:35.898025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:35.965646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:36.001078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-482bcc11-04fb-4aff-9acd-debbb7c11916 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1315 microversion: 2.1 time: 0.342591 Aug 29 04:57:36.027689 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 950/1871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:35 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:36.117171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:36.131192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:36.133672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:36.140020 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d765221a-516e-4fde-be9f-222a34a701b8 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1452 microversion: 2.75 time: 0.281043 Aug 29 04:57:36.141075 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 922/1872] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:35 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1452 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:36.614659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:36.615295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:36.642289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:36.642782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:36.643253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:36.643994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:36.644482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:36.644972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:36.857471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a743b292-e62b-40c3-8791-2f544c1c79a1 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd81d790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:36.937488 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a743b292-e62b-40c3-8791-2f544c1c79a1 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.084930 Aug 29 04:57:36.938194 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 923/1873] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:36 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:37.071140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:37.082540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:37.089785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:37.097681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:37.099301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:37.100543 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3212503-cbc0-4357-845b-e4b9b54b59f8 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.498743 Aug 29 04:57:37.135723 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 951/1874] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:36 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:37.135898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:37.135898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:37.135898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:37.135898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:37.135898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:37.135898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:37.328461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:37.338954 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a228b06-a18d-4f2a-a82a-8a9a7f1577ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1315 microversion: 2.1 time: 0.268353 Aug 29 04:57:37.340655 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 924/1875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:37 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:37.345627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:37.346484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:37.355603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:37.356092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:37.356558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:37.357263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:37.357712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:37.358133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:37.385761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a74265c-4ee8-41f8-b191-67c45764e42a tempest-AbsoluteLimitsTestJSON-744967954 tempest-AbsoluteLimitsTestJSON-744967954-project] Calling method '.version_select at 0x7f1abd87a0d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:37.401983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a74265c-4ee8-41f8-b191-67c45764e42a tempest-AbsoluteLimitsTestJSON-744967954 tempest-AbsoluteLimitsTestJSON-744967954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:37.402760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a74265c-4ee8-41f8-b191-67c45764e42a tempest-AbsoluteLimitsTestJSON-744967954 tempest-AbsoluteLimitsTestJSON-744967954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:37.403649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a74265c-4ee8-41f8-b191-67c45764e42a tempest-AbsoluteLimitsTestJSON-744967954 tempest-AbsoluteLimitsTestJSON-744967954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:37.404579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a74265c-4ee8-41f8-b191-67c45764e42a tempest-AbsoluteLimitsTestJSON-744967954 tempest-AbsoluteLimitsTestJSON-744967954-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:37.405206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a74265c-4ee8-41f8-b191-67c45764e42a tempest-AbsoluteLimitsTestJSON-744967954 tempest-AbsoluteLimitsTestJSON-744967954-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:37.405803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a74265c-4ee8-41f8-b191-67c45764e42a tempest-AbsoluteLimitsTestJSON-744967954 tempest-AbsoluteLimitsTestJSON-744967954-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:37.441382 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a74265c-4ee8-41f8-b191-67c45764e42a tempest-AbsoluteLimitsTestJSON-744967954 tempest-AbsoluteLimitsTestJSON-744967954-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.301090 Aug 29 04:57:37.444977 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 952/1876] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 04:57:37 2022] GET /compute/v2.1/limits => generated 511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:57:37.480661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:37.506160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:37.508811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:37.517870 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-da5c8196-a6c2-495f-bdf2-f113f3e18844 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1452 microversion: 2.75 time: 0.175792 Aug 29 04:57:37.519661 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 925/1877] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:37 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:37.960856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e2fff1ec-417a-43d6-8622-88fc1a9ef69b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8b47ee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:38.114050 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e2fff1ec-417a-43d6-8622-88fc1a9ef69b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.161917 Aug 29 04:57:38.124264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:38.125422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:38.125691 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 953/1878] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:37 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:38.143347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:38.154403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:38.155055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:38.158912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:38.159443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:38.159886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:38.364968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:38.366361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:38.384737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:38.389503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:38.392310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:38.393362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:38.395096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:38.397264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:38.806650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:38.829460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:38.834677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:38.839301 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aa5ccdcb-999d-40b0-8c44-b477446ad8b6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.718301 Aug 29 04:57:38.840161 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 926/1879] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:38 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:57:38.850913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:38.851860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:38.871469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:38.872350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:38.872982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:38.873877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:38.876571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:38.878005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:39.057048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:39.069700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1ed6044-4152-4485-82f8-967cdf4f6e3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1315 microversion: 2.1 time: 0.709402 Aug 29 04:57:39.071584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 954/1880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:38 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:39.081016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:39.098362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:39.099926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1598755181", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "9035ba9b-de41-4199-ad6d-44b4cdc08bb4"}], "block_device_mapping_v2": [{"uuid": "f30431e6-2a1a-42b7-86c5-cc145ff76bd0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:39.111707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:39.129533 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c298b007-ff5e-47d3-8d81-644d8f35e688 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1437 microversion: 2.75 time: 0.284896 Aug 29 04:57:39.133069 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 927/1881] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:38 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1437 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:39.141974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-044dcda0-4173-49db-a948-dd22087f1474 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd8848b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:39.238959 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-044dcda0-4173-49db-a948-dd22087f1474 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.102667 Aug 29 04:57:39.240288 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 928/1882] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:39 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:39.256111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] validate_networks() for [('9035ba9b-de41-4199-ad6d-44b4cdc08bb4', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:57:39.563628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:39.739036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:39.742576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:39.771813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:39.773381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:39.775926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:39.781543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:39.785237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:39.785806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:39.991087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:57:39.991995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:57:39.992791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:57:39.993583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:57:39.994257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:57:40.101125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:40.113787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:40.114419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:40.114968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:40.115908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:40.116477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:40.123220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:40.498951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:40.580082 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-df828f24-1d86-4f07-82c4-1e85178941b0 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28/action" status: 202 len: 1940 microversion: 2.75 time: 1.315717 Aug 29 04:57:40.580775 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 929/1883] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 04:57:39 2022] POST /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28/action => generated 1940 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 04:57:40.592850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a4e29397-0979-4f32-bc81-26f74ec0eab7 req-9c60901e-f5fc-4351-ad23-7e286a89be6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a03db1b0-6fca-4eb2-9579-8903be60ba92", "name": "network-vif-plugged", "status": "completed", "tag": "411672e7-0217-48fc-a423-e5e891878193"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:40.614995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a4e29397-0979-4f32-bc81-26f74ec0eab7 req-9c60901e-f5fc-4351-ad23-7e286a89be6a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:40.616324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a4e29397-0979-4f32-bc81-26f74ec0eab7 req-9c60901e-f5fc-4351-ad23-7e286a89be6a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:40.616921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a4e29397-0979-4f32-bc81-26f74ec0eab7 req-9c60901e-f5fc-4351-ad23-7e286a89be6a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:40.635881 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a4e29397-0979-4f32-bc81-26f74ec0eab7 req-9c60901e-f5fc-4351-ad23-7e286a89be6a service nova] Creating event network-vif-plugged:411672e7-0217-48fc-a423-e5e891878193 for instance a03db1b0-6fca-4eb2-9579-8903be60ba92 on n-h2-854119-9 Aug 29 04:57:40.651531 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a4e29397-0979-4f32-bc81-26f74ec0eab7 req-9c60901e-f5fc-4351-ad23-7e286a89be6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066082 Aug 29 04:57:40.652987 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 930/1884] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:40.660000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:40.663666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:40.676797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:40.678024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:40.678789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:40.680198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:40.681928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:40.682957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:40.788503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:57:40.788503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:57:40.788503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:57:40.788503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:57:40.788503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:57:40.819790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:40.820336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:40.820786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:40.821543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:40.822000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:40.822425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:40.866472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:40.881670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Getting quotas for user f5a5756b12204e9f9fbd7a2f3c5e1749 and project bb84e6fe60b3405382ebd2c54aa67908. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:41.055522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:57:41.058651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f30431e6-2a1a-42b7-86c5-cc145ff76bd0',volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:57:41.164051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:41.180760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:41.182940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:41.184409 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4127ca61-2dc9-4e7e-8e2d-b2698f18a3f9 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.529908 Aug 29 04:57:41.185238 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 931/1885] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:40 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:41.191912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:41.192983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:41.204005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:41.205339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:41.206022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:41.206999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:41.207749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:41.208476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:41.215040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:41.326698 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23467d7f-c25d-4856-b84e-6be04898e756 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252303 Aug 29 04:57:41.338691 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 955/1886] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:57:41.344307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf959295-7b03-46e5-ac1a-4aa5f3c1d2ba tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd800700>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:41.398492 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf959295-7b03-46e5-ac1a-4aa5f3c1d2ba tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.058304 Aug 29 04:57:41.399339 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 956/1887] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:41 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:41.406196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:41.407022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:41.415752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:41.417219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:41.417819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:41.418952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:41.419569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:41.420162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:41.425360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:41.434414 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dfdc4e2e-9596-4933-a285-7d4b70d44bee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1315 microversion: 2.1 time: 0.247925 Aug 29 04:57:41.435220 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 932/1888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:41 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:41.626352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:41.648946 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-082ec905-7505-4d80-8027-584f781a0c0a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.247514 Aug 29 04:57:41.649821 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 957/1889] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:41 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:41.654929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf5a7868-34f0-4dc9-bd42-f9d689489ae0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:41.655911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf5a7868-34f0-4dc9-bd42-f9d689489ae0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:41.722212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1947027879", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": "none"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:41.745109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf5a7868-34f0-4dc9-bd42-f9d689489ae0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:41.764034 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf5a7868-34f0-4dc9-bd42-f9d689489ae0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1053 microversion: 2.1 time: 0.112959 Aug 29 04:57:41.770699 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 958/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:41 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1053 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:41.837253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:57:41.837800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:57:41.838380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:57:41.838972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:57:41.839452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:57:41.850591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:41.851082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:41.851508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:41.852304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:41.852746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:41.853382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:41.886923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Getting quotas for project 9ceb20ff94e945e2a0b5eebcf1ca1e6d. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:41.895761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Getting quotas for user f9e06ae097cb458cb112bd1dd823d24c and project 9ceb20ff94e945e2a0b5eebcf1ca1e6d. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:41.913167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:57:41.915492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:57:42.008210 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0834f5a4-8f65-49ba-9655-ad4492d65d31 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.571744 Aug 29 04:57:42.011230 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 933/1891] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 04:57:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 04:57:42.024194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0bc4e4d2-e0a3-45cb-bd90-4dfe5b7b2ee7 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:42.025493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0bc4e4d2-e0a3-45cb-bd90-4dfe5b7b2ee7 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:42.174780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0bc4e4d2-e0a3-45cb-bd90-4dfe5b7b2ee7 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:42.186524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0bc4e4d2-e0a3-45cb-bd90-4dfe5b7b2ee7 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:42.195873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0bc4e4d2-e0a3-45cb-bd90-4dfe5b7b2ee7 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:42.199419 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0bc4e4d2-e0a3-45cb-bd90-4dfe5b7b2ee7 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1281 microversion: 2.47 time: 0.178750 Aug 29 04:57:42.201075 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 959/1892] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:42 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1281 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:42.216777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:42.217767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:42.227095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:42.229429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:42.229878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:42.233693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:42.234170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:42.234779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:42.415824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5f2dfca1-ea75-4a4e-9fd3-1730b1ea26b3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8afaa60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:42.508997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:42.518852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:42.521087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:42.523188 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8d5d907d-6758-4ed1-8cf4-af3d81e0c7b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.319805 Aug 29 04:57:42.524427 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 934/1893] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:42 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:42.527887 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5f2dfca1-ea75-4a4e-9fd3-1730b1ea26b3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.106065 Aug 29 04:57:42.528641 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 960/1894] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:42 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:42.530222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:42.531137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:42.538312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:42.539077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:42.540043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:42.541056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:42.541783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:42.543432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:42.682092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:42.684469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:42.717805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:42.721497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:42.722168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:42.727186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:42.727948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:42.729701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:42.888774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:42.896048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:42.909986 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e1fda947-ec3c-4e59-8430-35fa2bb420ad tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1315 microversion: 2.1 time: 0.384134 Aug 29 04:57:42.917059 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 935/1895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:42 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:42.933866 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-03be6ae7-589b-4848-8830-1e299dff9331 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.259764 Aug 29 04:57:42.935164 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 961/1896] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:42 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:42.939860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:42.954133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:42.968341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:42.970372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:42.971065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:42.972239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:42.973227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:42.973886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:42.974494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:43.123929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:43.132583 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7cf98e5-970e-44f6-8d4a-ef866a7aea25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1151 microversion: 2.1 time: 0.197516 Aug 29 04:57:43.137941 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 936/1897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:42 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1151 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:43.233923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:43.235174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:43.258503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:43.259759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:43.261717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:43.263130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:43.264067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:43.264954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:43.351950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:43.364069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:43.366033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:43.367435 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f36d98a4-7a5d-44a2-920c-62bd17de08fa tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1333 microversion: 2.47 time: 0.137789 Aug 29 04:57:43.368535 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 962/1898] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:43 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1333 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:43.547185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-01a7a99b-15c8-498c-addc-4ccb55d5f00b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8e0e5e0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:43.557545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:43.558951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:43.578018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:43.578617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:43.579771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:43.582037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:43.582755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:43.584454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:43.644725 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-01a7a99b-15c8-498c-addc-4ccb55d5f00b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1412 microversion: 2.1 time: 0.105468 Aug 29 04:57:43.647418 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 937/1899] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:43 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:43.938777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:43.939459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:43.953231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:43.953949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:43.954552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:43.955623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:43.957214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:43.957824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.032471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:44.042884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:44.054097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:44.055475 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab83959e-689b-4043-b998-c371df59ce8a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.512132 Aug 29 04:57:44.068639 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 963/1900] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:43 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:44.077488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:44.089247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:44.096082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.096801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.097401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.098272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.100651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.101313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.227273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:44.253862 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ede6d2e-0a6d-4673-abbc-5b3556626e36 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.179608 Aug 29 04:57:44.254613 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 964/1901] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:44 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:44.259379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:44.260089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:44.263453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:44.268734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.269331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.269877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.270674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.271219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.271866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.278804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:44.287952 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b68c45d-be16-44de-b14f-3d7a0988375e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1503 microversion: 2.1 time: 0.353501 Aug 29 04:57:44.300142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 938/1902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:43 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:44.322255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:44.322648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:44.346653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.347193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.347644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.348414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.348871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.349291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.428433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:44.441428 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7f4b6f0b-f85c-41eb-aa4e-c787d097d080 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1169 microversion: 2.1 time: 0.184601 Aug 29 04:57:44.452167 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 965/1903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:44 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1169 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:44.459232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:44.459232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:44.467603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:57:44.483900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.484443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.486290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.487295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.487750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.490669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.495625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:44.603148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:44.618927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:44.624031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:44.628694 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-494f5964-4a1b-451b-abb4-45281c876e98 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1341 microversion: 2.47 time: 0.180959 Aug 29 04:57:44.630639 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 966/1904] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:44 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:44.663753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-158ea700-5030-4092-a43b-8c05efbcb178 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8b498b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:44.740343 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-158ea700-5030-4092-a43b-8c05efbcb178 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1421 microversion: 2.1 time: 0.081240 Aug 29 04:57:44.741156 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 967/1905] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:44 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:44.754651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6357f23-d023-40f5-8c64-15105af518c9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8afaa60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:44.812915 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6357f23-d023-40f5-8c64-15105af518c9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 200 len: 1421 microversion: 2.1 time: 0.062579 Aug 29 04:57:44.814023 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 968/1906] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:57:44 2022] GET /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 1421 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:44.831955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-015a5038-13c2-4f8b-a0b0-2b4e72fca100 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd87aaf0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:44.878040 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-67c6196d-99bc-47b2-a203-c8973d5e1cd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 204 len: 0 microversion: 2.1 time: 0.559771 Aug 29 04:57:44.882035 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 939/1907] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:57:44 2022] DELETE /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:57:44.898592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:44.899330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:44.917495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.918002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.918445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:44.919172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:44.919630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:44.920062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.335960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:45.347264 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7a349f1-47df-43b6-9e0e-2bbea848a605 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1509 microversion: 2.1 time: 0.463700 Aug 29 04:57:45.348834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 940/1908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:44 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1509 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:45.355653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:45.356427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:45.366275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.367243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.368582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.370127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.370857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.371425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.631160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:45.648292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:45.650061 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-015a5038-13c2-4f8b-a0b0-2b4e72fca100 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 204 len: 0 microversion: 2.1 time: 0.825436 Aug 29 04:57:45.650663 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 969/1909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:44 2022] DELETE /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:57:45.650813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:45.651998 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aad171ed-7fe3-4f28-a3d4-94b40ba8f63c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.302017 Aug 29 04:57:45.652861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 941/1910] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:45 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:45.657245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:45.657856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:45.664085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.664603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.665407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.665842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:45.666120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.666604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.667025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.667509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:45.675688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.678253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.678800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.679591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.680141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.680630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.763765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:45.782297 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-44394ca9-5407-46bd-be79-b101c52eda2a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.130511 Aug 29 04:57:45.782996 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 970/1911] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:45 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:45.788186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:45.788972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:45.796254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.797015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.797610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.798480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.799118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.800028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.853445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:45.861828 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-734b0e41-c126-429b-80f5-5bd31d8e59f2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1211 microversion: 2.1 time: 0.207961 Aug 29 04:57:45.863020 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 942/1912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:45 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1211 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:45.869815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:45.870249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:45.870508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:45.880281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.880885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.881416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.882223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:45.882770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:45.883273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:45.884154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:45.885689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:45.886816 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0dbfa77-a229-4b58-a380-383f6db358db tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1339 microversion: 2.47 time: 0.102691 Aug 29 04:57:45.887741 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 971/1913] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:45 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:45.912652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:57:45.997113 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c71d1491-d23c-4925-9911-33ed81a81983 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 204 len: 0 microversion: 2.1 time: 0.132227 Aug 29 04:57:45.998192 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 943/1914] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:57:45 2022] DELETE /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:57:46.109584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1176759750", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "c1c2b0fe-774a-41d7-804b-9b252b4c0fcb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:46.170210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] validate_networks() for [('c1c2b0fe-774a-41d7-804b-9b252b4c0fcb', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:57:46.372647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:46.373445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:46.380758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:46.381559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:46.381984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:46.382773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:46.383253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:46.383630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:46.728720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:46.754908 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1c5a13b-4bc7-4441-b8cb-6246c8c1b795 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1509 microversion: 2.1 time: 0.386683 Aug 29 04:57:46.776658 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 944/1915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:46 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:46.784831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:46.785570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:46.793651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:46.794526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:46.795223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:46.797032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:46.798025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:46.799190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:46.925891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:57:46.926398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:57:46.926771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:57:46.927179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:57:46.927856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:57:46.954806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:46.955323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:46.955745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:46.956501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:46.957187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:46.957619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:46.976023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Getting quotas for project e88260cc20924f92a617cc231ad24f77. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:46.982884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Getting quotas for user da246be637924c248fa3746468546f00 and project e88260cc20924f92a617cc231ad24f77. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:46.998664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:57:47.001235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:57:47.080684 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-33092f77-6704-4bdc-83ca-72eb24655850 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974736 Aug 29 04:57:47.081729 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 972/1916] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:57:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:57:47.093402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:47.094559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:47.104157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:47.105124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:47.105944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:47.106927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:47.107713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:47.108521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:47.247842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:47.258480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:47.261765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:47.272449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:47.278685 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a491a2d-1133-43ec-be22-5aba25129cf3 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.496114 Aug 29 04:57:47.278685 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 945/1917] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:46 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:47.280564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:47.281284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:47.288930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:47.289650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:47.290515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:47.291482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:47.293664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:47.293664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:47.322021 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ac81079-f93f-4fad-a347-55d70df6728e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.238880 Aug 29 04:57:47.323244 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 973/1918] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:47 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:47.329518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:47.335817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:47.350342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:47.351110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:47.352274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:47.354317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:47.355303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:47.355939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:47.514135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:47.534041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:47.535957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:47.537585 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39a9fef7-bc06-4273-bac1-96c1f5963305 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1339 microversion: 2.47 time: 0.212986 Aug 29 04:57:47.544194 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 974/1919] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:47 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:47.544422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-74b41bfd-d2b1-444e-ae01-cd602028ff19 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:47.545289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-74b41bfd-d2b1-444e-ae01-cd602028ff19 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:47.653123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-74b41bfd-d2b1-444e-ae01-cd602028ff19 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:47.665971 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-74b41bfd-d2b1-444e-ae01-cd602028ff19 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1208 microversion: 2.1 time: 0.123797 Aug 29 04:57:47.669587 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 975/1920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:47 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1208 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:47.704528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6324a564-4839-4604-908b-1546a093004c req-c9e8f3c6-ea4b-429d-a9e6-8e5bacf76e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c5f9e23-6688-4b92-ba5e-844e4ba6d72d", "tag": "5148f8dc-bb11-451d-b354-b31019213845"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:47.714360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:47.722016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6324a564-4839-4604-908b-1546a093004c req-c9e8f3c6-ea4b-429d-a9e6-8e5bacf76e37 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:47.722499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6324a564-4839-4604-908b-1546a093004c req-c9e8f3c6-ea4b-429d-a9e6-8e5bacf76e37 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:47.722931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6324a564-4839-4604-908b-1546a093004c req-c9e8f3c6-ea4b-429d-a9e6-8e5bacf76e37 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:47.727751 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c6d0e3a0-1966-4f6f-8df8-17ac43eb74d5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1211 microversion: 2.1 time: 0.451294 Aug 29 04:57:47.743662 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 946/1921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:47 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1211 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:47.747829 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6324a564-4839-4604-908b-1546a093004c req-c9e8f3c6-ea4b-429d-a9e6-8e5bacf76e37 service nova] Creating event network-changed:5148f8dc-bb11-451d-b354-b31019213845 for instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d on n-h2-854119-9 Aug 29 04:57:47.757972 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6324a564-4839-4604-908b-1546a093004c req-c9e8f3c6-ea4b-429d-a9e6-8e5bacf76e37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069553 Aug 29 04:57:47.762659 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 976/1922] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:47.786082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:47.787663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:47.802382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:47.805148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:47.806062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:47.808571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:47.810417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:47.811041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:47.862338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:47.999526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-52281c75-ce46-4666-ae1c-f010629af074 req-901c6f81-040b-440b-a472-83727676cb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edb1989-4869-4968-ba61-d2fd91304761", "name": "network-vif-unplugged", "status": "completed", "tag": "807392e6-35c9-4185-be60-e876c6285ebe"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:48.021863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-52281c75-ce46-4666-ae1c-f010629af074 req-901c6f81-040b-440b-a472-83727676cb7d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.022426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-52281c75-ce46-4666-ae1c-f010629af074 req-901c6f81-040b-440b-a472-83727676cb7d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.023109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-52281c75-ce46-4666-ae1c-f010629af074 req-901c6f81-040b-440b-a472-83727676cb7d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.049570 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-52281c75-ce46-4666-ae1c-f010629af074 req-901c6f81-040b-440b-a472-83727676cb7d service nova] Creating event network-vif-unplugged:807392e6-35c9-4185-be60-e876c6285ebe for instance 0edb1989-4869-4968-ba61-d2fd91304761 on n-h1-854119-9 Aug 29 04:57:48.059414 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-52281c75-ce46-4666-ae1c-f010629af074 req-901c6f81-040b-440b-a472-83727676cb7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065908 Aug 29 04:57:48.062474 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 977/1923] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:48.302405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:48.304158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:48.313628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.314183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.314762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.315484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.319655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:48.322059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.322792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.331331 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4ff7179f-ab54-47db-97ab-9d53d1193c0c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1509 microversion: 2.1 time: 0.549741 Aug 29 04:57:48.332909 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 947/1924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:47 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1509 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:48.364062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:48.364708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:48.375558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.376013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.377988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.381077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.381077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.382326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.499701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:48.544457 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7111d58e-0a73-4a63-9935-53861305c092 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.192680 Aug 29 04:57:48.567266 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 948/1925] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:48 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:48.582362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:48.583005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:48.593366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.593861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.594288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.596003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.596487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.596908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.775649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:48.791023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:48.794058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:48.796088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a3b52157-9213-4b79-a644-c5e4960de9e0 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1339 microversion: 2.47 time: 0.227131 Aug 29 04:57:48.796926 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 949/1926] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:48 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1339 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:48.804237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:48.805102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:48.830212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.831545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.834103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.838754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.842702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.843470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.850711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:48.874947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:48.879669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:48.881367 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-889b95ea-2c09-4424-8c96-1f7386ef5d9b tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.586068 Aug 29 04:57:48.886404 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 978/1927] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:48 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:57:48.905862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:48.907772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:48.925313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.925809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.928799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:48.929908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:48.930554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:48.931468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:49.008080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:49.020323 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-088b4fa5-e35c-4a60-8294-dda24ad4c39e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1260 microversion: 2.1 time: 0.221562 Aug 29 04:57:49.021061 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 950/1928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:48 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:49.229816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e11a90d3-48ec-4495-8029-6bfe619141aa tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6d6341f-80cc-468a-ab07-01067e30ac1a"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:49.232960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e11a90d3-48ec-4495-8029-6bfe619141aa tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:49.245658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e11a90d3-48ec-4495-8029-6bfe619141aa tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:49.252625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e11a90d3-48ec-4495-8029-6bfe619141aa tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:49.253197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e11a90d3-48ec-4495-8029-6bfe619141aa tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:49.254339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e11a90d3-48ec-4495-8029-6bfe619141aa tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:49.254824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e11a90d3-48ec-4495-8029-6bfe619141aa tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:49.255318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e11a90d3-48ec-4495-8029-6bfe619141aa tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:49.499293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:49.517924 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4065a3a3-8307-45c5-8ae5-a30ca66258f8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1211 microversion: 2.1 time: 0.628073 Aug 29 04:57:49.518913 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 979/1929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:48 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1211 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:49.523693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a8960428-2302-4a9a-bf4e-d5b5f94f101e req-df41205c-82ff-43a8-b430-7d3e49818d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a03db1b0-6fca-4eb2-9579-8903be60ba92", "name": "network-vif-deleted", "tag": "411672e7-0217-48fc-a423-e5e891878193"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:49.534292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a8960428-2302-4a9a-bf4e-d5b5f94f101e req-df41205c-82ff-43a8-b430-7d3e49818d5f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:49.534765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a8960428-2302-4a9a-bf4e-d5b5f94f101e req-df41205c-82ff-43a8-b430-7d3e49818d5f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:49.535189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a8960428-2302-4a9a-bf4e-d5b5f94f101e req-df41205c-82ff-43a8-b430-7d3e49818d5f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:49.573894 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a8960428-2302-4a9a-bf4e-d5b5f94f101e req-df41205c-82ff-43a8-b430-7d3e49818d5f service nova] Creating event network-vif-deleted:411672e7-0217-48fc-a423-e5e891878193 for instance a03db1b0-6fca-4eb2-9579-8903be60ba92 on n-h2-854119-9 Aug 29 04:57:49.593148 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a8960428-2302-4a9a-bf4e-d5b5f94f101e req-df41205c-82ff-43a8-b430-7d3e49818d5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072699 Aug 29 04:57:49.594825 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 980/1930] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:49.603104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:49.603976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:49.610961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:49.611389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:49.611911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:49.613606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:49.613606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:49.613863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:49.731896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:49.742023 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f8cf752-8bfb-4224-9525-cabb8559a97c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1467 microversion: 2.1 time: 0.145420 Aug 29 04:57:49.742984 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 981/1931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:49 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1467 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:49.748076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:49.748906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:49.755667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:49.756411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:49.757026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:49.757912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:49.758535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:49.759241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:49.915623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:49.948694 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-250362d7-b98e-4563-a35d-fd50b8a39e61 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.203692 Aug 29 04:57:49.950545 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 982/1932] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:49 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:49.976963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-38a67979-85ba-4443-8723-9d9da0fe7723 req-c387d8a6-099e-4fa9-b7bb-ff30524109ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edb1989-4869-4968-ba61-d2fd91304761", "name": "network-vif-deleted", "tag": "807392e6-35c9-4185-be60-e876c6285ebe"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:49.994547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-38a67979-85ba-4443-8723-9d9da0fe7723 req-c387d8a6-099e-4fa9-b7bb-ff30524109ae service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:49.995150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-38a67979-85ba-4443-8723-9d9da0fe7723 req-c387d8a6-099e-4fa9-b7bb-ff30524109ae service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:49.995801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-38a67979-85ba-4443-8723-9d9da0fe7723 req-c387d8a6-099e-4fa9-b7bb-ff30524109ae service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.011874 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-38a67979-85ba-4443-8723-9d9da0fe7723 req-c387d8a6-099e-4fa9-b7bb-ff30524109ae service nova] Creating event network-vif-deleted:807392e6-35c9-4185-be60-e876c6285ebe for instance 0edb1989-4869-4968-ba61-d2fd91304761 on n-h1-854119-9 Aug 29 04:57:50.022586 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-38a67979-85ba-4443-8723-9d9da0fe7723 req-c387d8a6-099e-4fa9-b7bb-ff30524109ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068278 Aug 29 04:57:50.024772 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 983/1933] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:50.034522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:50.035628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:50.036940 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e11a90d3-48ec-4495-8029-6bfe619141aa tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "POST /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811291 Aug 29 04:57:50.037910 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 951/1934] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 04:57:49 2022] POST /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:57:50.045617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.047727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.048481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.050036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.051351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.053205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.055789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:50.056602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:50.094502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.102274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.105710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.107068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.108670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.109301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.242694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:50.271341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:50.276458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:50.279794 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18f31b1b-7d3c-4eda-905f-bafe36bf62a6 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1339 microversion: 2.47 time: 0.253925 Aug 29 04:57:50.281770 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 984/1935] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:50 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:50.287452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:50.288634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:50.297511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.298184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.298897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.300691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.301379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.302079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.457144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:50.486260 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4e8bd005-0e42-48f3-b00f-135ef33dabf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1266 microversion: 2.1 time: 0.202818 Aug 29 04:57:50.487415 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 985/1936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:50 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:50.539461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:50.540888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:50.550588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.551487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.552206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.553719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.554502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.555127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.614096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:50.626879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:50.628992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:50.630380 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a03a592c-4288-4fdf-a264-50fb02ddf7bb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.591079 Aug 29 04:57:50.631212 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 952/1937] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:50 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:50.770729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:50.771660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:50.780128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.783729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.784557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.785496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.787058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.788237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.836074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:50.836873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:50.837758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:50.839329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lazy-loading 'fault' on Instance uuid a03db1b0-6fca-4eb2-9579-8903be60ba92 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:51.096582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:51.105073 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23fa5789-f1db-44b7-8bf4-839d9c4626a7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 200 len: 1305 microversion: 2.1 time: 0.339652 Aug 29 04:57:51.108077 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 953/1938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:50 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 1305 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:51.114202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:51.115046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:51.126475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.128375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.128864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.129732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.130194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.130625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.309253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:51.332736 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cc88929b-b5c0-4bb7-94b8-f97827fde539 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.223055 Aug 29 04:57:51.334175 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 954/1939] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:51 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:51.340113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:51.342245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:51.350893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.351910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.352856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.353957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.354806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.355391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.378964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:51.389574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e4dba62-8aeb-44ac-8ac2-0f39137e1a1c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1211 microversion: 2.1 time: 0.853974 Aug 29 04:57:51.391253 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 986/1940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:50 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1211 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:51.462154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:51.471176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:51.473140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:51.474330 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5797986d-3b08-4328-a60c-7f0abdaab5b8 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1360 microversion: 2.47 time: 0.138867 Aug 29 04:57:51.475075 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 955/1941] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:51 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1360 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:51.507813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45e80dc9-6c26-49fe-a096-f4d5afd59e18 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1905535159"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:51.510866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45e80dc9-6c26-49fe-a096-f4d5afd59e18 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:51.524247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:51.524880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:51.527245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e80dc9-6c26-49fe-a096-f4d5afd59e18 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.527800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e80dc9-6c26-49fe-a096-f4d5afd59e18 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.528377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e80dc9-6c26-49fe-a096-f4d5afd59e18 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.529099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e80dc9-6c26-49fe-a096-f4d5afd59e18 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.529643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e80dc9-6c26-49fe-a096-f4d5afd59e18 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.530169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e80dc9-6c26-49fe-a096-f4d5afd59e18 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.538088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.539971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.541868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.542647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.543106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.544473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.754685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:51.772214 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45e80dc9-6c26-49fe-a096-f4d5afd59e18 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "POST /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767/action" status: 202 len: 52 microversion: 2.47 time: 0.273366 Aug 29 04:57:51.773228 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 987/1942] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 04:57:51 2022] POST /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767/action => generated 52 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Aug 29 04:57:51.779000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:51.780034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:51.790039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.790707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.791132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.792148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.792793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.793301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.826600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:51.836338 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2db327a-3969-4b32-a767-541a2f65e2d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.322075 Aug 29 04:57:51.855981 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 956/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:51 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:51.861148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:51.861660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:51.882933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:51.894765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.895533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.896253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.898541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:51.899131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:51.901559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:51.909226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=26 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:51.949194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:57:52.055925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f96ac7b5-33e0-4acc-b8be-66ced811883c tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 204 len: 0 microversion: 2.47 time: 0.198371 Aug 29 04:57:52.060023 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 957/1944] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 04:57:51 2022] DELETE /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:57:52.067850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:52.070891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:52.074895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:52.085700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:52.087425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:52.088374 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-56a474e2-fb9f-4fe4-a2d4-a6146f7fc3da tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.313799 Aug 29 04:57:52.104556 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 988/1945] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:51 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:52.114914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:52.116636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:52.117506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:52.120226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:52.121930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:52.122956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:52.130909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:52.131519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:52.140950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:52.141381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:52.144650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:52.146108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:52.146808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:52.147437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:52.168256 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 HTTP/1.1 Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a03db1b0-6fca-4eb2-9579-8903be60ba92'} Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:52.172666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:52.178539 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:52.178539 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:52.178539 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:52.178539 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:52.178539 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:52.178539 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 04:57:52.178539 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:57:52.180679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:52.181924 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5ac38e0f-54e8-4b26-acc5-52c4920d9246 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 404 len: 111 microversion: 2.1 time: 0.054906 Aug 29 04:57:52.183628 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 989/1946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:52 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:57:52.277561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:52.289293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:52.291833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:52.302838 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-08146a4b-277e-45de-bb45-c1617fde2415 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1366 microversion: 2.47 time: 0.239845 Aug 29 04:57:52.305258 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 958/1947] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:52 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:52.322956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-81736421", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "57e28866-1c32-4826-b8f3-b2fdc024be39"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:52.363442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:52.364508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:52.374046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:52.377955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:52.378542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:52.380916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:52.382321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:52.384749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:52.399266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] validate_networks() for [('57e28866-1c32-4826-b8f3-b2fdc024be39', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:57:52.523999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:52.527613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:52.550913 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a62051d1-7526-4b58-9832-30233d5db6f5 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.192041 Aug 29 04:57:52.551515 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 959/1948] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:52 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:57:52.556944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:52.557550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:52.565607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:52.566098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:52.566731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:52.567262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:52.567761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:52.568866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:52.991372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:53.001668 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-02593a37-b063-43fb-b077-aa6dea44a34e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.449076 Aug 29 04:57:53.002761 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 960/1949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:52 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:53.008206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1e6c5a34-7a76-4846-a9f2-096b6aa903d1 req-12b412d5-a0db-4a80-8ff8-8ddbab774116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de63423e-f87b-485b-b071-9f20dcdf4eaf", "tag": "c7d98676-d55c-41a4-b6a4-487708a826ff"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:53.018792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1e6c5a34-7a76-4846-a9f2-096b6aa903d1 req-12b412d5-a0db-4a80-8ff8-8ddbab774116 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.019327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1e6c5a34-7a76-4846-a9f2-096b6aa903d1 req-12b412d5-a0db-4a80-8ff8-8ddbab774116 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.019764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1e6c5a34-7a76-4846-a9f2-096b6aa903d1 req-12b412d5-a0db-4a80-8ff8-8ddbab774116 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.032256 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1e6c5a34-7a76-4846-a9f2-096b6aa903d1 req-12b412d5-a0db-4a80-8ff8-8ddbab774116 service nova] Creating event network-changed:c7d98676-d55c-41a4-b6a4-487708a826ff for instance de63423e-f87b-485b-b071-9f20dcdf4eaf on n-h1-854119-9 Aug 29 04:57:53.037874 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1e6c5a34-7a76-4846-a9f2-096b6aa903d1 req-12b412d5-a0db-4a80-8ff8-8ddbab774116 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033340 Aug 29 04:57:53.038481 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 961/1950] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:53.043803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:53.044531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:53.050618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.051108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.051546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.052281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.052740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.053159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.341022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:53.349562 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-969b3239-dbbc-4453-8031-23170f33c027 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.309623 Aug 29 04:57:53.363774 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 962/1951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:53 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:53.368646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:53.369395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:53.376264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.376896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.377530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.378367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.378932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.379470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.425560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:57:53.426071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:57:53.426640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:57:53.427307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:57:53.427812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:57:53.437610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.438174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.438672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.439636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.440092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.441383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.459992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:57:53.465484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for user 4d3aaab47eb243c6bf9a0b2e512e7c4a and project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:57:53.479546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:57:53.482306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:57:53.539235 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d71699fb-7b2f-47c5-a153-fe5efaecd027 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220223 Aug 29 04:57:53.541363 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 990/1952] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:57:53.547299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:53.548316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:53.558161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.558805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.559306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.560077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.560816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.561816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.651379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:53.654972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:53.664074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:53.665123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:53.665791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:53.666929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:53.667352 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07a9be0c-3653-43b3-8564-a7ae0e790488 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1366 microversion: 2.47 time: 0.124689 Aug 29 04:57:53.668164 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 991/1953] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:53 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:53.668288 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-78cfebb8-e991-4839-96f5-bc0e3006aeb0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.303418 Aug 29 04:57:53.681455 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 963/1954] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:53 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:53.684545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c644d53a-cc42-4848-88c4-1720de8c9564 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:53.685156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c644d53a-cc42-4848-88c4-1720de8c9564 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:53.689995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:53.691125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:53.700704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.701697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.702719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.703967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:53.704733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:53.705679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:53.769384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c644d53a-cc42-4848-88c4-1720de8c9564 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:53.778496 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c644d53a-cc42-4848-88c4-1720de8c9564 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1213 microversion: 2.1 time: 0.108591 Aug 29 04:57:53.792308 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 992/1955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:53 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1213 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:53.810642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:53.833381 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d90e9004-aa9a-4032-a6c2-20d8d17ed63e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.149811 Aug 29 04:57:53.836466 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 964/1956] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:53 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:54.024916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:54.025550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:54.031548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.031985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.032631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.033513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.033991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.034380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.169602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:54.181692 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d1fea28b-c613-40c0-b404-0b33ae308ebd tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.160893 Aug 29 04:57:54.192700 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 993/1957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:54 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:54.371392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:54.371980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:54.379030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.379518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.379952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.380752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.381254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.381622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.527851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:54.535866 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d94627f-0d70-441d-b957-db8dd5522186 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.168554 Aug 29 04:57:54.536666 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 965/1958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:54 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:54.713942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:54.714676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:54.716925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:54.717502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:54.722173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.723092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.723621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.723786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.724305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.724643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.724766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.725191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.725425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.725712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.725939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.726480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.848429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:54.859279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:54.860905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:54.862412 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e5167d24-1c05-4cdd-8019-01c441918302 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1366 microversion: 2.47 time: 0.150028 Aug 29 04:57:54.863088 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 966/1959] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:54 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:54.868382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:54.869250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:54.875788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.877138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.877580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.878296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.878877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.879358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.954035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:54.956140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:54.962834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:54.964362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:54.965506 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-90bc2b63-1bbc-4ed5-be9e-69695f5ff967 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1217 microversion: 2.1 time: 0.100961 Aug 29 04:57:54.965654 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a6322da-393f-4c1e-ae6b-4e232aa67d2a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.256101 Aug 29 04:57:54.966071 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 967/1961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:54 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:54.966227 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 994/1961] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:54 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:54.970918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:54.971409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:54.977969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.978378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.979280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:54.979981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:54.980468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:54.980891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:55.062428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:55.081053 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1dbbb7e1-5fb2-4ca7-acc9-927b5bf31e6b tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.113713 Aug 29 04:57:55.081614 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 995/1962] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:54 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:55.203476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:55.204218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:55.210538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:55.211012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:55.211448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:55.212198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:55.212669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:55.213192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:55.360916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:55.368954 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68cd3cf3-dc8a-4400-a88a-3fdc72239cc9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.169870 Aug 29 04:57:55.369619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 968/1963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:55 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:55.556484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:55.557098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:55.564368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:55.564856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:55.565290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:55.566048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:55.566521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:55.566993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:55.703854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:55.712048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9be00bb-a97f-4e5a-97c5-c6f0e4606996 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.159557 Aug 29 04:57:55.712658 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 996/1964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:55 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:55.888014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:55.889266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:55.919994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:55.920548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:55.920992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:55.921765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:55.922880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:55.923554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:55.987456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:55.989247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:55.998391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.000062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.001066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:56.002088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.002706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.003325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:56.018841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:56.027806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:56.029287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:56.031456 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23594896-6b6f-4d16-a4d6-5250795486b1 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1366 microversion: 2.47 time: 0.149413 Aug 29 04:57:56.032022 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 969/1965] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:55 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:56.036759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:56.037364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:56.047784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.049362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.051199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:56.052007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.055811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.056373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:56.158304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:56.167433 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4759cb25-e38f-43c5-adfb-64a401699bb0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1265 microversion: 2.1 time: 0.184416 Aug 29 04:57:56.168700 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 997/1966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:55 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:56.175141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:56.176003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:56.180868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:56.190734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.192363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.193108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:56.194080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.194541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.195812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:56.287592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:56.294733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:56.303225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:56.304542 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09113bc6-f4d4-42aa-997c-e01ee9197088 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.134256 Aug 29 04:57:56.304771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:56.305495 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 998/1967] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:56 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:56.306357 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d2445d96-f5b5-4032-8f04-4202b3578634 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.273231 Aug 29 04:57:56.306956 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 970/1968] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:56 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:56.390344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:56.391125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:56.397435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.397919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.398343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:56.399041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.399485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.399898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:56.698041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:56.708726 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f6eb6d51-8d44-4105-9720-c229033daacf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.322031 Aug 29 04:57:56.709313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 999/1969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:56 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:56.733023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:56.733619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:56.739513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.739979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.740463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:56.741168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:56.741607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:56.742018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.055379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:57.055951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:57.065026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.065533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.065972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.066681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.067130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.067542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.331142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:57.339598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:57.341074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e06ae097cb458cb112bd1dd823d24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceb20ff94e945e2a0b5eebcf1ca1e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:57.342262 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f6fe7e2e-394f-4e64-9770-572116986a00 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 200 len: 1366 microversion: 2.47 time: 0.291089 Aug 29 04:57:57.343038 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1000/1970] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:57 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:57.347643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:57.348282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:57.354438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.355286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.355729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.356451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.357144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.357770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.373496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:57.389322 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc1b02e3-3e76-481b-b242-7cadd59838e3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.659208 Aug 29 04:57:57.394371 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 971/1971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:56 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:57.400678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:57.401335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:57.410462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.410723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.411290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.412784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.413408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.413996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.505480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:57.514568 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-119c2d70-21f8-41ad-9147-fc5c1b20322e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1271 microversion: 2.1 time: 0.170230 Aug 29 04:57:57.515502 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1001/1972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:57 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:57.519793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:57.520415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:57.527705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.528571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.529415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.530358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.530796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.531453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.548863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:57.565252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:57.568350 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f74d7372-141b-4b02-9c93-47559b3a4f08 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.172820 Aug 29 04:57:57.572166 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 972/1973] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:57 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:57.730690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:57.731306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:57.739118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.739716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.740198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.740888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:57.741337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:57.741925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:57.888723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:57.898310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:57.899990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:57.901555 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47c3fa48-d0b1-4513-8d35-456986091a47 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.385053 Aug 29 04:57:57.917335 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1002/1974] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:57 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:58.086177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:58.097006 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0536a510-7b36-486d-a0d1-a606c7ab43cf tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.370907 Aug 29 04:57:58.097757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 973/1975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:57 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:57:58.308223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7e2bc0b1-78fe-4f3e-a4f2-234282d7316f req-858b55a9-9fcf-4257-a91a-533186894ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901a2798-d6c4-4d96-8a72-a0828794e98c", "name": "network-vif-unplugged", "status": "completed", "tag": "7336574f-6a84-480f-9e96-5a47d4706f1b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:57:58.334463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7e2bc0b1-78fe-4f3e-a4f2-234282d7316f req-858b55a9-9fcf-4257-a91a-533186894ca7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:58.335584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7e2bc0b1-78fe-4f3e-a4f2-234282d7316f req-858b55a9-9fcf-4257-a91a-533186894ca7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:58.336743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7e2bc0b1-78fe-4f3e-a4f2-234282d7316f req-858b55a9-9fcf-4257-a91a-533186894ca7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:58.369901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:58.370889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] [instance: 32cfbba4-bf87-468c-89f5-b41381c40767] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:58.371747 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7e2bc0b1-78fe-4f3e-a4f2-234282d7316f req-858b55a9-9fcf-4257-a91a-533186894ca7 service nova] Creating event network-vif-unplugged:7336574f-6a84-480f-9e96-5a47d4706f1b for instance 901a2798-d6c4-4d96-8a72-a0828794e98c on n-h1-854119-9 Aug 29 04:57:58.378728 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7e2bc0b1-78fe-4f3e-a4f2-234282d7316f req-858b55a9-9fcf-4257-a91a-533186894ca7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078956 Aug 29 04:57:58.379918 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1003/1976] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:57:58.385946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:58.386545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:58.386964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:58.387828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:58.391528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:58.391968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:58.410275 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] HTTP exception thrown: Instance 32cfbba4-bf87-468c-89f5-b41381c40767 could not be found. Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Request method failure captured: Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 HTTP/1.1 Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEdE-M7Xe_RpV5Pw_bgUFZa6ZiNqscBsoEtImiwOvQqnCo3Q91PmIOI2lVuWHOkdiude4T8LtVuAKnKrFzSKdXKeZhB5w3jVGxRlzuQ-hZzEchA2-ooZ8joyiSqn7SUPgSsN67_A4OQOuf0opTLVbT9kEiQlLVFfdy_uCuPX5fL9frk Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 9ceb20ff94e945e2a0b5eebcf1ca1e6d Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAaction247Test-535846035 Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceb20ff94e945e2a0b5eebcf1ca1e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ceb20ff94e945e2a0b5eebcf1ca1e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ceb20ff94e945e2a0b5eebcf1ca1e6d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ceb20ff94e945e2a0b5eebcf1ca1e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAaction247Test-535846035 Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 9ceb20ff94e945e2a0b5eebcf1ca1e6d Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAaction247Test-535846035 Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAaction247Test-535846035-project Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: f9e06ae097cb458cb112bd1dd823d24c Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAaction247Test-535846035-project Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 32cfbba4-bf87-468c-89f5-b41381c40767 could not be found. Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '32cfbba4-bf87-468c-89f5-b41381c40767'} Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32cfbba4-bf87-468c-89f5-b41381c40767 could not be found. Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32cfbba4-bf87-468c-89f5-b41381c40767 could not be found. Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:57:58.412084 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:58.418299 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:57:58.418299 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:57:58.418299 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:57:58.418299 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:57:58.418299 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:57:58.418299 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32cfbba4-bf87-468c-89f5-b41381c40767 could not be found. Aug 29 04:57:58.418299 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:57:58.418299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] Returning 404 to user: Instance 32cfbba4-bf87-468c-89f5-b41381c40767 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:57:58.418299 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fcb2aec7-e0aa-45c4-a91e-75d038248b33 tempest-ServersAaction247Test-535846035 tempest-ServersAaction247Test-535846035-project] 10.222.0.20 "GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767" status: 404 len: 111 microversion: 2.47 time: 0.051523 Aug 29 04:57:58.426127 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 974/1977] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:58 2022] GET /compute/v2.1/servers/32cfbba4-bf87-468c-89f5-b41381c40767 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:57:58.436104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:58.437563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:58.444884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:58.446265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:58.446805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:58.447708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:58.448423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:58.448944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:58.538344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:58.539905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:58.548414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:58.549331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:58.550106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:58.550995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:58.551612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:58.553252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:58.914434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:58.926582 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-63b62e0b-89b4-4d59-bc2b-6fdddf0536c0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.497469 Aug 29 04:57:58.927182 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1004/1978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:58 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:58.935703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:58.936652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:58.943728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:58.944482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:58.944950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:58.945743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:58.946431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:58.946852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:58.996998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:59.005889 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e415fa5-67de-49d1-aba0-3fac27247253 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1313 microversion: 2.1 time: 0.474697 Aug 29 04:57:59.006766 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 975/1979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:58 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:59.022382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:59.023326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:59.030850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:59.031359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:59.032149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:59.032895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:59.033943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:59.033943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:59.062769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:57:59.106524 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-02fef894-6d98-44e2-b7f0-91eb8a1b341c tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.174351 Aug 29 04:57:59.107772 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1005/1980] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:58 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:59.124937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:59.126809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:59.136283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:59.137089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:59.137641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:59.139124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:59.140156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:59.140782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:59.163265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:59.459792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:59.463365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:57:59.473159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:59.475285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:59.476518 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf3fd838-f25c-48e5-b70a-ea9bcab011b0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.466907 Aug 29 04:57:59.490103 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 976/1981] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:57:59 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:57:59.499782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:57:59.510713 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0904d1ff-fa1f-46d6-be1f-efbc1b8ef11e tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.391054 Aug 29 04:57:59.525048 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1006/1982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:59 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:57:59.948929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:57:59.950140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:57:59.959810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:59.960347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:59.960893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:57:59.961626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:57:59.962157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:57:59.962588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.031167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:00.032015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:00.045592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.047700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.051253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.062432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.063831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.064471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.302500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:00.312244 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dfae90d0-c70b-4b1b-a587-ca10b83eaaad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.367245 Aug 29 04:58:00.323247 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 977/1983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:57:59 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:00.331195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:00.332508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:00.339346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.339962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.340525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.341738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.344497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.344497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.375851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:00.386659 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9ae2bb67-d4de-40e3-a5a8-feec452e0d87 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1313 microversion: 2.1 time: 0.361381 Aug 29 04:58:00.396762 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1007/1984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:00 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:00.407208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-815f89de-3981-4f81-ba64-3d71a4804e44 req-dd4b0659-51f5-455f-bb03-a562d2f58988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de63423e-f87b-485b-b071-9f20dcdf4eaf", "name": "network-vif-plugged", "status": "completed", "tag": "c7d98676-d55c-41a4-b6a4-487708a826ff"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:00.418319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-815f89de-3981-4f81-ba64-3d71a4804e44 req-dd4b0659-51f5-455f-bb03-a562d2f58988 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.419505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-815f89de-3981-4f81-ba64-3d71a4804e44 req-dd4b0659-51f5-455f-bb03-a562d2f58988 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.420200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-815f89de-3981-4f81-ba64-3d71a4804e44 req-dd4b0659-51f5-455f-bb03-a562d2f58988 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.434240 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-815f89de-3981-4f81-ba64-3d71a4804e44 req-dd4b0659-51f5-455f-bb03-a562d2f58988 service nova] Creating event network-vif-plugged:c7d98676-d55c-41a4-b6a4-487708a826ff for instance de63423e-f87b-485b-b071-9f20dcdf4eaf on n-h1-854119-9 Aug 29 04:58:00.440480 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-815f89de-3981-4f81-ba64-3d71a4804e44 req-dd4b0659-51f5-455f-bb03-a562d2f58988 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038720 Aug 29 04:58:00.441743 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1008/1985] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:00.445832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:00.467223 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9e9318b1-515c-4cf6-963f-07f943432f1e tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.142353 Aug 29 04:58:00.468523 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 978/1986] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:00 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:00.474293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1a0f1078-88eb-4ac9-a909-d74414fac509 req-295f4642-49f0-445b-9c29-3bd1a48d60db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901a2798-d6c4-4d96-8a72-a0828794e98c", "tag": "7336574f-6a84-480f-9e96-5a47d4706f1b"}, {"name": "network-changed", "server_uuid": "96a08139-975a-4c7d-9bf2-05a417d9fbde", "tag": "8bfc5d07-7eb5-47d2-a100-33c56a9a0439"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:00.485792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1a0f1078-88eb-4ac9-a909-d74414fac509 req-295f4642-49f0-445b-9c29-3bd1a48d60db service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.486570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1a0f1078-88eb-4ac9-a909-d74414fac509 req-295f4642-49f0-445b-9c29-3bd1a48d60db service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.487207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1a0f1078-88eb-4ac9-a909-d74414fac509 req-295f4642-49f0-445b-9c29-3bd1a48d60db service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.505722 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1a0f1078-88eb-4ac9-a909-d74414fac509 req-295f4642-49f0-445b-9c29-3bd1a48d60db service nova] Creating event network-changed:7336574f-6a84-480f-9e96-5a47d4706f1b for instance 901a2798-d6c4-4d96-8a72-a0828794e98c on n-h1-854119-9 Aug 29 04:58:00.506669 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1a0f1078-88eb-4ac9-a909-d74414fac509 req-295f4642-49f0-445b-9c29-3bd1a48d60db service nova] Creating event network-changed:8bfc5d07-7eb5-47d2-a100-33c56a9a0439 for instance 96a08139-975a-4c7d-9bf2-05a417d9fbde on n-h1-854119-9 Aug 29 04:58:00.516351 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1a0f1078-88eb-4ac9-a909-d74414fac509 req-295f4642-49f0-445b-9c29-3bd1a48d60db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046144 Aug 29 04:58:00.517324 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 979/1987] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:00.523526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:00.524387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:00.542093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.542624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.543069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.543784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.544276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.544828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.660473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ffc6251a-0c51-4b31-8b6c-436b0f7dd138 tempest-ExtensionsTest-1787565221 tempest-ExtensionsTest-1787565221-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:00.663882 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ffc6251a-0c51-4b31-8b6c-436b0f7dd138 tempest-ExtensionsTest-1787565221 tempest-ExtensionsTest-1787565221-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.218787 Aug 29 04:58:00.668576 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1009/1988] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 29 04:58:00 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:00.682086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:00.683432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:00.698156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.699039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.700800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.701732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:00.702422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:00.704352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:00.866094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:00.874905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:00.876469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:00.877618 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-db004e79-9f9e-4bdf-9e09-9f534e0eb973 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.359167 Aug 29 04:58:00.878180 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 980/1989] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:00 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:00.882612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ffcbfcff-f02b-49a4-8329-52be4313acf6 tempest-ExtensionsTest-1787565221 tempest-ExtensionsTest-1787565221-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:00.884779 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ffcbfcff-f02b-49a4-8329-52be4313acf6 tempest-ExtensionsTest-1787565221 tempest-ExtensionsTest-1787565221-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005585 Aug 29 04:58:00.885314 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 981/1990] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 29 04:58:00 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:58:00.907023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:00.916533 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0617f264-3a8a-41c9-ad94-7d0a93d9767f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.250722 Aug 29 04:58:00.917253 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1010/1991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:00 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:01.334241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:01.334817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:01.341635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.342412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.343008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:01.343834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.344311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.344955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:01.418645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:01.420408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:01.429344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.430113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.430721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:01.432798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.433453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.435847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:01.551778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:01.561380 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e21d0ce-0e1a-4ac8-a3b9-65f44c8f8254 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.230894 Aug 29 04:58:01.568228 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 982/1992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:01 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:01.568489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:01.569173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:01.577158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.577745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.578180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:01.578994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.579591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.579986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:01.607495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:01.615734 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-31abf5e5-18be-4d53-b91e-12c7ad5fd750 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1313 microversion: 2.1 time: 0.209665 Aug 29 04:58:01.616712 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1011/1993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:01 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:01.656840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:01.673672 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-05580b3b-992a-4dd7-a7ed-e122df9176f3 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.110178 Aug 29 04:58:01.674266 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 983/1994] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:01 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:01.901773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:01.902380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:01.908451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.909122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.909749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:01.910430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.910915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.911314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:01.938938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:01.939570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:01.945935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.946461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.946869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:01.947578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:01.948210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:01.948634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:02.097577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:02.107068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:02.109003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:02.110355 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7782b601-51c3-45d8-a5e9-53047ca08e08 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.212850 Aug 29 04:58:02.110988 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1012/1995] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:01 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:02.126958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:02.135213 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c4a20e0c-871a-49ff-9c03-5dc49cc451fe tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.200649 Aug 29 04:58:02.135808 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 984/1996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:01 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:02.582761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:02.583569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:02.591329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:02.591807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:02.592455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:02.592910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:02.593353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:02.593766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:02.636871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:02.639127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:02.646218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:02.646984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:02.647584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:02.649020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:02.649641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:02.650516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:02.805161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:02.813716 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8893ef57-3fe2-4746-bfa1-34cd0a13ddf7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.234731 Aug 29 04:58:02.814307 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1013/1997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:02 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:02.834814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:02.836526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:02.844778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:02.845504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:02.846267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:02.847342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:02.847957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:02.848558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:02.888471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:02.900000 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-13bed541-06ca-4b35-b7eb-587326adf36f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1313 microversion: 2.1 time: 0.266726 Aug 29 04:58:02.900734 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 985/1998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:02 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:02.905517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7abbdbbb-b0de-4109-95b4-a3c914f7bad9 req-988d823e-c6ec-4518-92ad-fceb614ef62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5f9e23-6688-4b92-ba5e-844e4ba6d72d", "name": "network-vif-plugged", "status": "completed", "tag": "5148f8dc-bb11-451d-b354-b31019213845"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:02.915571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7abbdbbb-b0de-4109-95b4-a3c914f7bad9 req-988d823e-c6ec-4518-92ad-fceb614ef62a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:02.916197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7abbdbbb-b0de-4109-95b4-a3c914f7bad9 req-988d823e-c6ec-4518-92ad-fceb614ef62a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:02.916845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7abbdbbb-b0de-4109-95b4-a3c914f7bad9 req-988d823e-c6ec-4518-92ad-fceb614ef62a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:02.929797 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7abbdbbb-b0de-4109-95b4-a3c914f7bad9 req-988d823e-c6ec-4518-92ad-fceb614ef62a service nova] Creating event network-vif-plugged:5148f8dc-bb11-451d-b354-b31019213845 for instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d on n-h2-854119-9 Aug 29 04:58:02.935637 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7abbdbbb-b0de-4109-95b4-a3c914f7bad9 req-988d823e-c6ec-4518-92ad-fceb614ef62a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033315 Aug 29 04:58:02.935903 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 986/1999] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:02.966259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:02.983182 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6c2e898d-34c9-4f27-9bef-fa963b38e8c9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.153158 Aug 29 04:58:02.983758 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1014/2000] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:02 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:03.135295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:03.136611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:03.145852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:03.146609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:03.147221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:03.148297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:03.149060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:03.149731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:03.160637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:03.161554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:03.172611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:03.173357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:03.173993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:03.179093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:03.179979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:03.180836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:03.449702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:03.454454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:03.460145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:03.463436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9845b759-8523-4dae-9e7c-8d04a20adf25 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.310378 Aug 29 04:58:03.475486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:03.477144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:03.479019 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9ff817d1-e768-4f52-9cca-8b4f12cfde27 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.349255 Aug 29 04:58:03.479663 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 987/2001] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:03 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:03.480204 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1015/2002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:03 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:03.835965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:03.836687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:03.844037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:03.844580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:03.845183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:03.846283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:03.846814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:03.847310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:03.922666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:03.923292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:03.926344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=36 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:03.938755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:03.941169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:03.941791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:03.944525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:03.945194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:03.947343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.106418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:04.117648 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ff97a89-bcc9-4544-86ed-6ea09ffbd062 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1308 microversion: 2.1 time: 0.285553 Aug 29 04:58:04.118835 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 988/2003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:03 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:04.136642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:04.137534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:04.144603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.145361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.146003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.146910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.147539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.148295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.157094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:04.167025 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f6f229c-ddd5-432b-82aa-82ef06d530e2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1313 microversion: 2.1 time: 0.248740 Aug 29 04:58:04.167629 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1016/2004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:03 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:04.183732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2696ad38-c430-45c6-89f9-d541120d98da tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:04.206996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2696ad38-c430-45c6-89f9-d541120d98da tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:04.220830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2696ad38-c430-45c6-89f9-d541120d98da tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.222009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2696ad38-c430-45c6-89f9-d541120d98da tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.222852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2696ad38-c430-45c6-89f9-d541120d98da tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.226767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2696ad38-c430-45c6-89f9-d541120d98da tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.227958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2696ad38-c430-45c6-89f9-d541120d98da tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.228971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2696ad38-c430-45c6-89f9-d541120d98da tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.256408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:04.277138 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fd217c76-a8f5-4b4c-a533-6f10663e65af tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.147735 Aug 29 04:58:04.278025 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 989/2005] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:04 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:04.322222 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2696ad38-c430-45c6-89f9-d541120d98da tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148643 Aug 29 04:58:04.322820 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1017/2006] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:58:04 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:04.334349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:04.334879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:04.344075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.344075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.344075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.344075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.344075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.344075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.459405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lazy-loading 'services' on Instance uuid f1e3b162-b20c-46a9-9839-dca9a18ce982 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:04.505155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:04.506588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:04.523747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.524283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.524718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.525506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.525957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.532732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.585002 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f615587-6da7-4269-a878-7652379843ab tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments/c6d6341f-80cc-468a-ab07-01067e30ac1a" status: 202 len: 0 microversion: 2.1 time: 0.254499 Aug 29 04:58:04.585952 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 990/2007] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 04:58:04 2022] DELETE /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments/c6d6341f-80cc-468a-ab07-01067e30ac1a => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:58:04.593027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:04.593667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:04.604883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.605398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.605837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.607479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:04.609177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:04.609802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:04.898397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:04.915849 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4dbb12fa-cc1f-4b5e-86e2-a19c6714ee70 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1199 microversion: 2.1 time: 0.433585 Aug 29 04:58:04.920641 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1018/2008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:04 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1199 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:04.978729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:04.991646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:04.994530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:04.996285 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a68ffaf4-3d57-47c0-91f7-95441a35e438 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.408924 Aug 29 04:58:05.014474 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 991/2009] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:04 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:05.142617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:05.143352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:05.154375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.159381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.160017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.162738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.163358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.163789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.192232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:05.193243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:05.200233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.201046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.201703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.202638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.203323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.204257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.432706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:05.433936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:05.442646 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5aabf7ce-f063-4d55-8fff-3fe5e28a47a3 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1313 microversion: 2.1 time: 0.254237 Aug 29 04:58:05.443705 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 992/2010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:05 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:05.445465 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8972d9ca-b06b-4488-9b2e-a3d82bb16753 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1488 microversion: 2.1 time: 0.307602 Aug 29 04:58:05.446071 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1019/2011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:05 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1488 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:05.466132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:05.466752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:05.469917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-10f9bac1-a9fe-44fa-8c65-d0e76df8ef4c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:05.473365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.474041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.474486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.475423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.475670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.476092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.478930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10f9bac1-a9fe-44fa-8c65-d0e76df8ef4c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.479423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10f9bac1-a9fe-44fa-8c65-d0e76df8ef4c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.479864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10f9bac1-a9fe-44fa-8c65-d0e76df8ef4c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.545093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-10f9bac1-a9fe-44fa-8c65-d0e76df8ef4c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Going to try to stop instance {{(pid=128872) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 04:58:05.559264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:05.563889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:05.583164 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f522e4ad-2a6c-4ea6-87cd-38d46b2f11c6 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.138264 Aug 29 04:58:05.599338 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 993/2012] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:05 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:05.618233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-10f9bac1-a9fe-44fa-8c65-d0e76df8ef4c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf/action" status: 202 len: 0 microversion: 2.1 time: 0.152218 Aug 29 04:58:05.619689 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1020/2013] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:58:05 2022] POST /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:58:05.630449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:05.631571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:05.642366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.643201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.643935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.644937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.645710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.646493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.802017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:05.811292 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3d8db828-1e1f-4d41-b954-cf1fe34afe3e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.187507 Aug 29 04:58:05.826084 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 994/2014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:05 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:05.938150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:05.939286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:05.946663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.947407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.948140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:05.949160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:05.949833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:05.950742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:06.024506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:06.025277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:06.035180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:06.036322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:06.037311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:06.038356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:06.039536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:06.040214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:06.144232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:06.156891 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-67e3c5c3-fde0-4cec-b076-a342ff5d7104 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1382 microversion: 2.1 time: 0.223383 Aug 29 04:58:06.157697 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1021/2015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:05 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1382 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:06.164799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-11bac349-197f-423b-a324-f68e3d3a3c3c req-a76fa9fa-7aed-4fab-be19-f78c3fa4af6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a08139-975a-4c7d-9bf2-05a417d9fbde", "name": "network-vif-plugged", "status": "completed", "tag": "8bfc5d07-7eb5-47d2-a100-33c56a9a0439"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:06.186561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-11bac349-197f-423b-a324-f68e3d3a3c3c req-a76fa9fa-7aed-4fab-be19-f78c3fa4af6a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:06.187527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-11bac349-197f-423b-a324-f68e3d3a3c3c req-a76fa9fa-7aed-4fab-be19-f78c3fa4af6a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:06.188222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-11bac349-197f-423b-a324-f68e3d3a3c3c req-a76fa9fa-7aed-4fab-be19-f78c3fa4af6a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:06.232755 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-11bac349-197f-423b-a324-f68e3d3a3c3c req-a76fa9fa-7aed-4fab-be19-f78c3fa4af6a service nova] Creating event network-vif-plugged:8bfc5d07-7eb5-47d2-a100-33c56a9a0439 for instance 96a08139-975a-4c7d-9bf2-05a417d9fbde on n-h1-854119-9 Aug 29 04:58:06.244244 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-11bac349-197f-423b-a324-f68e3d3a3c3c req-a76fa9fa-7aed-4fab-be19-f78c3fa4af6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082669 Aug 29 04:58:06.248551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1022/2016] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:06.282842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:06.296716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:06.298488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:06.299880 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dca3728a-a2d2-4132-8788-f8e61e76574e tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.282218 Aug 29 04:58:06.301050 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 995/2017] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:06 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:06.463087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:06.463986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:06.472315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:06.473059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:06.473724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:06.474977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:06.475684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:06.476370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:06.603515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98f7d290-5c11-408f-9788-45c54bbd00fa tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:06.604880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98f7d290-5c11-408f-9788-45c54bbd00fa tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:06.632781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98f7d290-5c11-408f-9788-45c54bbd00fa tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:06.632781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98f7d290-5c11-408f-9788-45c54bbd00fa tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:06.632781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98f7d290-5c11-408f-9788-45c54bbd00fa tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:06.632781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98f7d290-5c11-408f-9788-45c54bbd00fa tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:06.632781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98f7d290-5c11-408f-9788-45c54bbd00fa tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:06.632781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98f7d290-5c11-408f-9788-45c54bbd00fa tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.106666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:07.119351 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30a87dac-2d34-4367-87e0-4483a5c47e99 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1313 microversion: 2.1 time: 0.660153 Aug 29 04:58:07.124836 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 996/2018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:06 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:07.135335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:07.136349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:07.144463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.145095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.145611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.146425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.147157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.147809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.156872 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98f7d290-5c11-408f-9788-45c54bbd00fa tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1533 microversion: 2.1 time: 0.906775 Aug 29 04:58:07.157545 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1023/2019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:06 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1533 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:07.168548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:07.168548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:07.192521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.193015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.193456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.194213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.194672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.195113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.202016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:07.369033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:07.374398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:07.384354 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fea135e1-024a-4d86-859a-e00ce29940d2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.225715 Aug 29 04:58:07.389509 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1024/2020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:07 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:07.401837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae8babbd-3446-4590-af21-f6eaf4c06134 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:07.402746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae8babbd-3446-4590-af21-f6eaf4c06134 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:07.407350 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d59ede13-6f14-4b56-92ca-0bb7750ac0ca tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.281034 Aug 29 04:58:07.407980 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 997/2021] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:07 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:07.412992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:07.413818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:07.414216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae8babbd-3446-4590-af21-f6eaf4c06134 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.414848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae8babbd-3446-4590-af21-f6eaf4c06134 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.415386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae8babbd-3446-4590-af21-f6eaf4c06134 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.416362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae8babbd-3446-4590-af21-f6eaf4c06134 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.416906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae8babbd-3446-4590-af21-f6eaf4c06134 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.417480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae8babbd-3446-4590-af21-f6eaf4c06134 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.428883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.429379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.430032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.430756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.431386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.431730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.764811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:07.779922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:07.784662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:07.787453 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae8babbd-3446-4590-af21-f6eaf4c06134 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1533 microversion: 2.1 time: 0.396608 Aug 29 04:58:07.788048 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1025/2022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:07 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1533 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:07.801766 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b1fb7c5f-cd68-4891-8eaa-f5cbe9597f15 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1486 microversion: 2.25 time: 0.379811 Aug 29 04:58:07.823843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39f74466-f0ca-4c4f-9811-2037c44647ca tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:07.824484 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 998/2023] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:07 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1486 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:07.835621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39f74466-f0ca-4c4f-9811-2037c44647ca tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.842117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39f74466-f0ca-4c4f-9811-2037c44647ca tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.842579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39f74466-f0ca-4c4f-9811-2037c44647ca tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.845837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39f74466-f0ca-4c4f-9811-2037c44647ca tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.846323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39f74466-f0ca-4c4f-9811-2037c44647ca tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.846755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39f74466-f0ca-4c4f-9811-2037c44647ca tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.935407 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39f74466-f0ca-4c4f-9811-2037c44647ca tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.130188 Aug 29 04:58:07.936976 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1026/2024] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Aug 29 04:58:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:58:07.950668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854119-9", "block_migration": false, "disk_over_commit": false}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:07.954941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:07.963497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.964383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.965076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:07.966036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:07.966712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:07.967425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:08.020370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lazy-loading 'flavor' on Instance uuid 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:08.059647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Going to try to live migrate instance to n-h1-854119-9 {{(pid=128871) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 04:58:08.156842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:08.157454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:08.198119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:08.198840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:08.198840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:08.199413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:08.199864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:08.217052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:08.577719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:08.590955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9e1b8c2c-b59d-4efd-be7f-9f218fdf30d4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1500 microversion: 2.1 time: 0.443868 Aug 29 04:58:08.612148 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1027/2025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:08 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1500 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:08.612148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:08.612148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:08.618143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:08.618775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:08.619790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:08.620658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:08.621313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:08.621801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:08.848916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:08.868144 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-54664a02-a04e-49ac-9d7f-8d2d351a3d08 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.262782 Aug 29 04:58:08.874596 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1028/2026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:08 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:08.887137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:08.888634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:08.925524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:08.926443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:08.927234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:08.928858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:08.940878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:08.941427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:09.070520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:09.093564 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55d23b1d-4f10-44a5-ab22-9b6c6b618929 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.216774 Aug 29 04:58:09.112618 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1029/2027] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:08 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:09.119116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:09.120579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:09.144137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:09.144982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:09.145842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:09.146741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:09.147359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:09.148342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:09.650604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:09.661968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:09.665147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:09.666903 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb020eb2-e343-4d15-a11a-4de9349e54e5 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1476 microversion: 2.25 time: 0.553047 Aug 29 04:58:09.667663 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1030/2028] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:09 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1476 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:09.690957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70ed48ee-deaa-4819-9454-48b38ed73a72 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '.version_select at 0x7f1ab8a13c10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:09.696571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70ed48ee-deaa-4819-9454-48b38ed73a72 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:09.697590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70ed48ee-deaa-4819-9454-48b38ed73a72 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:09.698374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70ed48ee-deaa-4819-9454-48b38ed73a72 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:09.719045 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70ed48ee-deaa-4819-9454-48b38ed73a72 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3578 microversion: 2.25 time: 0.032985 Aug 29 04:58:09.720345 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1031/2029] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Aug 29 04:58:09 2022] GET /compute/v2.1/os-migrations => generated 3578 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:09.742049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:09.743276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:09.750384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:09.752054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:09.752718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:09.754049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:09.754665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:09.755286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:09.987136 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6bb7513e-93e3-475f-bbd7-c98fbc3fd114 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d/action" status: 202 len: 0 microversion: 2.1 time: 2.042355 Aug 29 04:58:09.988577 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 999/2030] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:58:07 2022] POST /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d/action => generated 0 bytes in 2044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:58:09.993368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:09.994399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:10.016278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.017025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.017643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.018545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.026053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.028042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.058367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] Lazy-loading 'services' on Instance uuid 901a2798-d6c4-4d96-8a72-a0828794e98c {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:10.111752 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6fc31e80-40c5-4d4a-a1c0-52f35dc88217 tempest-LiveAutoBlockMigrationV225Test-1494573085 tempest-LiveAutoBlockMigrationV225Test-1494573085-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1968 microversion: 2.25 time: 0.378587 Aug 29 04:58:10.114245 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1032/2031] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:09 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1968 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:10.126757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:10.129833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:10.143512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.147113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.148143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.151458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.152791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.153861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.495197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:10.506423 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-904cfa51-90fd-4523-8b5a-7d371431eee8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.516659 Aug 29 04:58:10.508614 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1000/2032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:09 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:10.514558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:10.515812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:10.522177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:10.525271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.526508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.527195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.528518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.529459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.530130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.536846 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69854279-8402-43ed-a255-1a65f0b9d23f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.420255 Aug 29 04:58:10.545587 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1033/2033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:10 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:10.550551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:10.551054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:10.567699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.568348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.569023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.569967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.570620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.571262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.628325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:10.697554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:10.723924 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f54fce20-a9c2-4ba8-ac9d-47c99f543a93 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.213927 Aug 29 04:58:10.739157 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1001/2034] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:10 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:10.792391 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6b26aa7b-0a17-4a9f-b6c4-1d0853b91b4a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "DELETE /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 204 len: 0 microversion: 2.25 time: 0.245282 Aug 29 04:58:10.794519 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1034/2035] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 04:58:10 2022] DELETE /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:58:10.803152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:10.804171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:10.810219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.810776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.811277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.812044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:10.812748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:10.813417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:10.970750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:10.979050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:10.980534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:10.981913 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8add3244-16e9-4c0d-91c9-faa883c2aa4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1482 microversion: 2.25 time: 0.183285 Aug 29 04:58:10.982467 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1002/2036] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:10 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1482 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:11.502675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ae02c64-0d9d-4c08-8bcd-15b9d28c7b05 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb8265a6-8c2a-4443-86bf-96645ebf8909"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:11.505272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ae02c64-0d9d-4c08-8bcd-15b9d28c7b05 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:11.512323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ae02c64-0d9d-4c08-8bcd-15b9d28c7b05 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:11.512806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ae02c64-0d9d-4c08-8bcd-15b9d28c7b05 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:11.513347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ae02c64-0d9d-4c08-8bcd-15b9d28c7b05 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:11.514041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ae02c64-0d9d-4c08-8bcd-15b9d28c7b05 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:11.514486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ae02c64-0d9d-4c08-8bcd-15b9d28c7b05 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:11.514901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ae02c64-0d9d-4c08-8bcd-15b9d28c7b05 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:11.529775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:11.530378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:11.539304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:11.540152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:11.540853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:11.541876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:11.542940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:11.543442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:11.732615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:11.744285 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6b84cc87-351d-45e3-9311-1b90ce606dea tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.218243 Aug 29 04:58:11.757203 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1003/2037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:11 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:11.763795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:11.769863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:11.779031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:11.779520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:11.780821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:11.783226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:11.783689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:11.784144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:12.082625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:12.096598 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f0d0c387-cc41-4d97-9546-884be0feaed7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.336582 Aug 29 04:58:12.110555 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1004/2038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:11 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:12.117920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:12.119102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:12.134560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:12.136251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:12.137328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:12.138466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:12.139493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:12.143705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:12.254300 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2ae02c64-0d9d-4c08-8bcd-15b9d28c7b05 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.757805 Aug 29 04:58:12.258214 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1035/2039] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 04:58:11 2022] POST /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:58:12.300014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:12.304006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:12.307261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:12.330969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:12.331975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:12.335517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:12.336870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:12.338719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:12.339368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:12.339900 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ad27f680-aba6-4a06-9716-20daea13d443 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1927 microversion: 2.75 time: 0.227844 Aug 29 04:58:12.359756 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1005/2040] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:12 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1927 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:12.745225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-db0f44f6-657e-4e8e-a387-e6de1e8bf189 req-d5eb4be7-a7be-4bca-87e0-e8e375941794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901a2798-d6c4-4d96-8a72-a0828794e98c", "name": "network-vif-deleted", "tag": "7336574f-6a84-480f-9e96-5a47d4706f1b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:12.769976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:12.779122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:12.780796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:12.781515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-db0f44f6-657e-4e8e-a387-e6de1e8bf189 req-d5eb4be7-a7be-4bca-87e0-e8e375941794 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:12.782217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-db0f44f6-657e-4e8e-a387-e6de1e8bf189 req-d5eb4be7-a7be-4bca-87e0-e8e375941794 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:12.782927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-db0f44f6-657e-4e8e-a387-e6de1e8bf189 req-d5eb4be7-a7be-4bca-87e0-e8e375941794 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:12.789106 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5da18a8c-3af3-448b-9a2a-85f05921a767 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1482 microversion: 2.25 time: 0.510522 Aug 29 04:58:12.789723 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1036/2041] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:12 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1482 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:12.813036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:12.818505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:12.821942 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-db0f44f6-657e-4e8e-a387-e6de1e8bf189 req-d5eb4be7-a7be-4bca-87e0-e8e375941794 service nova] Creating event network-vif-deleted:7336574f-6a84-480f-9e96-5a47d4706f1b for instance 901a2798-d6c4-4d96-8a72-a0828794e98c on n-h2-854119-9 Aug 29 04:58:12.830203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:12.830760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:12.831132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:12.831831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:12.832693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:12.834559 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-db0f44f6-657e-4e8e-a387-e6de1e8bf189 req-d5eb4be7-a7be-4bca-87e0-e8e375941794 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093839 Aug 29 04:58:12.835380 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1006/2042] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:58:12.836225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:13.049075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:13.060857 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b742ed9b-a330-497a-8fad-40d99a53cc80 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.249550 Aug 29 04:58:13.061909 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1037/2043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:12 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:13.122030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:13.123369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:13.136878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:13.138461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:13.139094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:13.141018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:13.145405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:13.145926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:13.327125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:13.335563 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e64e91da-c44b-4ce3-a792-9caa937ee253 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.221248 Aug 29 04:58:13.336921 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1007/2044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:13 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:13.366732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:13.367463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:13.375150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:13.375755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:13.376325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:13.377127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:13.377684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:13.378205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:13.403959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:13.468582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:13.487599 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4602e3e5-b135-4f0e-b9d6-25f3e788f8d9 tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1933 microversion: 2.75 time: 0.125489 Aug 29 04:58:13.488514 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1038/2045] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:13 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1933 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:13.810960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:13.811563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:13.818695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:13.819182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:13.819618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:13.820393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:13.820857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:13.821275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:13.826865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:13.901969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:13.916770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:13.919278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:13.921253 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-393d17ab-465f-40ea-8f4f-e36797ef9a59 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.114126 Aug 29 04:58:13.922151 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1008/2046] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:13 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:14.082688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:14.083293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:14.090018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:14.090528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:14.090952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:14.091643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:14.092081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:14.092549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:14.252442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:14.261012 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9c70cd6-9c8a-4762-94c0-9679e49394ed tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.182067 Aug 29 04:58:14.261801 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1039/2047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:14 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:14.356661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:14.357557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:14.363957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:14.364563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:14.365170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:14.366142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:14.367137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:14.367692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:14.513203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:14.514485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:14.521535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:14.522286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:14.523061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:14.524278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:14.525214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:14.525753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:14.526503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:14.536509 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1f1e25da-9c59-4f37-b668-7dee2afde8be tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.183657 Aug 29 04:58:14.537351 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1009/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:14 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:14.610321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:14.627710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:14.631098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55519133-1536-4a26-b445-5086afbb2d1a tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1933 microversion: 2.75 time: 0.122071 Aug 29 04:58:14.631687 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1040/2049] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:14 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1933 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:14.945683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:14.946515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:14.956319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:14.957181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:14.957895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:14.959041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:14.959603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:14.960297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:15.033376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:15.042809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:15.044308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:15.045546 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e694fd5d-4afc-42a2-85a4-7e5ed58d54b4 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.105456 Aug 29 04:58:15.046445 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1010/2050] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:14 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:15.285581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:15.286641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:15.298423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:15.299246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:15.300173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:15.301132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:15.301744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:15.302587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:15.493040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:15.500865 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43326b25-ac26-4260-83e3-d0dc404f0fce tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.220994 Aug 29 04:58:15.514670 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1041/2051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:15 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:15.559122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:15.559860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:15.567634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:15.570633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:15.579194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:15.579964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:15.580472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:15.580989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:15.657500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:15.658130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:15.664611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:15.665089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:15.665516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:15.666237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:15.666678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:15.669934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:15.768279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:15.775513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:15.779162 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9aea65a3-d0a0-44c6-8e81-e8d9aac4552c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.224529 Aug 29 04:58:15.780289 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1011/2052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:15 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:15.806377 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a697f688-a7ae-42f9-a561-e226a7ede9fb tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1933 microversion: 2.75 time: 0.152694 Aug 29 04:58:15.807087 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1042/2053] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:15 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1933 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:16.070088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:16.071494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:16.080087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:16.080674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:16.081109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:16.082135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:16.082587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:16.083006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:16.154449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:16.163000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:16.165031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:16.166241 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b33b156f-f20e-440c-a5fa-1528fdc2b515 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.100630 Aug 29 04:58:16.166807 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1012/2054] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:16 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:16.526606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:16.528292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:16.537355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:16.539364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:16.540642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:16.541756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:16.542815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:16.543505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:16.795596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:16.803817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:16.807210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:16.813846 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51e09bbd-b833-4148-98f2-b322466af46e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.294459 Aug 29 04:58:16.817974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:16.818478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:16.818915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:16.819639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:16.829229 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1043/2055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:16 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:16.829458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:16.830127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:16.836915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:16.838332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:16.848581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:16.850096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:16.850765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:16.851673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:16.852358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:16.852940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:16.988542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] Lazy-loading 'services' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:17.010902 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-79ed3086-3bdd-45e7-9178-cf612d881dfc tempest-ServersAdmin275Test-1424996341 tempest-ServersAdmin275Test-1424996341-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1918 microversion: 2.75 time: 0.179296 Aug 29 04:58:17.011778 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1044/2056] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:16 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1918 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:17.051503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:17.052256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:17.059441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:17.060143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:17.060946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:17.061889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:17.062508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:17.063098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:17.094165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:17.165899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:17.185304 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06d75faa-ed84-4d75-b9dd-6c4dc20693f9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.386197 Aug 29 04:58:17.186538 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1013/2057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:16 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:17.191599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:17.192466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:17.205448 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a54da329-0c6f-4f9e-b20f-7f0170ec5e0d tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 204 len: 0 microversion: 2.75 time: 0.158303 Aug 29 04:58:17.206608 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1045/2058] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 04:58:17 2022] DELETE /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:58:17.209817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:17.210000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:17.210369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:17.211133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:17.211636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:17.212063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:17.219079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:17.221707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:17.231685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:17.232208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:17.232683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:17.233453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:17.233895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:17.234498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:17.312560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:17.325867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:17.327719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:17.329879 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-234d5137-6aad-4ff3-a4f0-e795152569ab tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.141840 Aug 29 04:58:17.331217 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1014/2059] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:17 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:17.342709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:17.351545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:17.353043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:17.358612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-63af9557-30ae-4a0b-9053-0142df31c2d6 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1443 microversion: 2.75 time: 0.145752 Aug 29 04:58:17.359833 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1046/2060] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:17 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:17.840586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:17.841489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:17.845204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:17.848571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:17.849352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:17.849562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:17.850570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:17.851267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:17.851812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:18.015189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:18.024370 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b8cac75a-ed22-4809-9261-d2a4d41c6104 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.187895 Aug 29 04:58:18.025529 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1015/2061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:17 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:18.211528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:18.213377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:18.223424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:18.225845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:18.226620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:18.227369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:18.229170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:18.229906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:18.230610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:18.355509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:18.356198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:18.363959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:18.364536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:18.365026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:18.365668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:18.366129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:18.366553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:18.434504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:18.443586 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3acf98a0-75aa-4cd1-a606-a70b9f9bdb4f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.236379 Aug 29 04:58:18.458357 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1047/2062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:18 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:18.458477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:18.458615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:18.458615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:18.462521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:18.463044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:18.463592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:18.464473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:18.464996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:18.465472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:18.469568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:18.473240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:18.474817 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e648eb0-14bd-471b-92fa-3ee7b817b2a0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.124533 Aug 29 04:58:18.475491 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1016/2063] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:18 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:18.537707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:18.546230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:18.547705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:18.552875 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5d79bac0-1ab6-4881-beaa-e312fb39b277 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1443 microversion: 2.75 time: 0.103228 Aug 29 04:58:18.553887 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1048/2064] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:18 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:19.050339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:19.051658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:19.062031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:19.062605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:19.063199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:19.065200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:19.066075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:19.067141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:19.255946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:19.265681 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd70148b-5360-4173-8ff8-7533eb07b24f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.220629 Aug 29 04:58:19.279197 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1017/2065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:19 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:19.466277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:19.467456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:19.476607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:19.477092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:19.477520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:19.478410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:19.479032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:19.479594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:19.499551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:19.500085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:19.507936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:19.508456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:19.508886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:19.511977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:19.512472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:19.512905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:19.639869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:19.651547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:19.653224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:19.654672 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e2966790-1cca-493f-ba31-8aa7e04f7ad1 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.159036 Aug 29 04:58:19.655606 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1018/2066] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:19 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:19.673091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:19.674032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:19.680516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:19.681012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:19.682829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:19.683918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:19.684609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:19.685230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:19.734468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:19.743379 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f0fec582-f7cb-4c28-88a4-6f0074719c08 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.281268 Aug 29 04:58:19.744721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1049/2067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:19 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:19.748957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:19.749463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:19.749979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:19.750637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lazy-loading 'fault' on Instance uuid 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:19.808881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:19.820986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:19.822793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a312c39cfc84c45bb78f68ce39c237a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5ed0bbe92a48909999b101bb4a77dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:19.829139 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-deb40616-d167-486f-bcdd-a4cadd3ef0f9 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 200 len: 1448 microversion: 2.75 time: 0.172474 Aug 29 04:58:19.841684 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1019/2068] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:19 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 1448 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:20.287914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:20.288821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:20.295418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:20.296240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:20.296863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:20.297839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:20.298478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:20.304185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:20.679133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:20.679753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:20.688056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:20.688592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:20.689003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:20.694574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:20.703732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:20.705352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:20.705805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:20.718670 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e15c5650-18dd-4b19-8270-bbcaad8639e9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.434908 Aug 29 04:58:20.719794 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1050/2069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:20 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:20.765942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:20.769442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:20.789859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:20.790375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:20.790862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:20.791580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:20.792032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:20.792484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:20.800272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:20.814301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:20.818103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:20.819326 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3c15e7a8-639d-4cd8-a526-2e3a2de20b53 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.144708 Aug 29 04:58:20.824254 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1020/2070] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:20 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:20.854828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:20.856468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] [instance: 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:20.873511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:20.875857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:20.876509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:20.878457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:20.880613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:20.881236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:20.899778 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] HTTP exception thrown: Instance 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 could not be found. Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Request method failure captured: Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 HTTP/1.1 Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcURlnJHk_Wx7iaC8Z-6_4o-bIgAMqsXWKFB7IDREvQ1mj4CQNSrjuBERg1B7JUhG_SVZJQLQAyOLvb2U-joFpBCRYRliOLITAnEJA7uf2MTtZPLKJDUZL0QpHmLH46LsXiFCzxgomG9oe1jHaSWW8nRcyJj6QgFgXogEJrQGs743Y Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.75 Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: bc5ed0bbe92a48909999b101bb4a77dd Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdmin275Test-1688809744 Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc5ed0bbe92a48909999b101bb4a77dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc5ed0bbe92a48909999b101bb4a77dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc5ed0bbe92a48909999b101bb4a77dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc5ed0bbe92a48909999b101bb4a77dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdmin275Test-1688809744 Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: bc5ed0bbe92a48909999b101bb4a77dd Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdmin275Test-1688809744 Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdmin275Test-1688809744-project Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 2a312c39cfc84c45bb78f68ce39c237a Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdmin275Test-1688809744-project Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 could not be found. Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '3e20278f-ffd7-4bd9-95bb-7e387d8dfd28'} Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 could not be found. Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 could not be found. Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:20.910984 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:20.916532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:20.916532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:20.916532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:20.916532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:20.916532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:20.916532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 could not be found. Aug 29 04:58:20.916532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:20.918097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] Returning 404 to user: Instance 3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:20.919128 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4bb8ffa7-dc3a-46e7-b8d6-9e8d0c635c55 tempest-ServersAdmin275Test-1688809744 tempest-ServersAdmin275Test-1688809744-project] 10.222.0.20 "GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28" status: 404 len: 111 microversion: 2.75 time: 0.068268 Aug 29 04:58:20.920231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1021/2071] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:20 2022] GET /compute/v2.1/servers/3e20278f-ffd7-4bd9-95bb-7e387d8dfd28 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 04:58:21.012588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:21.022681 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-407fe51b-dd8a-4032-865d-be4fd20ed646 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.261100 Aug 29 04:58:21.036924 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1051/2072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:20 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:21.743012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:21.744644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:21.780176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:21.780911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:21.781363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:21.783136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:21.783758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:21.784079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:21.842665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:21.843862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:21.853360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:21.856951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:21.857978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:21.862067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:21.862782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:21.864229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:21.872112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:21.957582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:21.967398 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3e533d57-91f9-482c-a348-a96b377f4f7c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.232400 Aug 29 04:58:21.968297 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1022/2073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:21 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:21.994727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:22.004394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:22.006305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:22.007859 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c6cd5713-1db9-4327-988c-490cbbebd917 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.168923 Aug 29 04:58:22.009071 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1052/2074] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:21 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:22.048853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:22.049467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:22.062893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:22.063724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:22.064748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:22.065861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:22.067387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:22.068045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:22.237177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:22.246140 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab58f477-cefa-4f15-9a6d-bbcf5600275f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.205194 Aug 29 04:58:22.262104 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1023/2075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:22 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:22.993529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:22.994239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:23.006432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.006928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.007363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.021169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.021938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.022541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.033719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:23.034551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:23.049477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.052105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.052765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.053632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.054177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.054624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.224538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:23.241737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:23.243578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:23.247594 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6391f06c-370b-4e92-8e00-fd869858d206 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.220484 Aug 29 04:58:23.249515 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1024/2076] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:23 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:23.254776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d1b96361-1d2b-40d4-992b-532170e0ad37 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:23.262073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1b96361-1d2b-40d4-992b-532170e0ad37 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:23.281030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b96361-1d2b-40d4-992b-532170e0ad37 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.284495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b96361-1d2b-40d4-992b-532170e0ad37 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.285063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b96361-1d2b-40d4-992b-532170e0ad37 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.285917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b96361-1d2b-40d4-992b-532170e0ad37 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.287377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b96361-1d2b-40d4-992b-532170e0ad37 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.287913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b96361-1d2b-40d4-992b-532170e0ad37 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.292506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:23.358573 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d1b96361-1d2b-40d4-992b-532170e0ad37 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107668 Aug 29 04:58:23.362501 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1025/2077] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:58:23 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 04:58:23.367480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:23.368511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:23.376031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.377244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.377874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.378833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.379516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.380212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.382858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:23.393384 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f91c4f8a-a521-45ba-bbcd-8dbadf265bc7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.403738 Aug 29 04:58:23.393964 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1053/2078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:22 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:23.458129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d5121ece-1611-44eb-a351-34e3aab3e83d tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:23.460972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d5121ece-1611-44eb-a351-34e3aab3e83d tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:23.469189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5121ece-1611-44eb-a351-34e3aab3e83d tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.469937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5121ece-1611-44eb-a351-34e3aab3e83d tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.470597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5121ece-1611-44eb-a351-34e3aab3e83d tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.471623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5121ece-1611-44eb-a351-34e3aab3e83d tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.472598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5121ece-1611-44eb-a351-34e3aab3e83d tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.473225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5121ece-1611-44eb-a351-34e3aab3e83d tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.511833 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d5121ece-1611-44eb-a351-34e3aab3e83d tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058674 Aug 29 04:58:23.519333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1054/2079] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:58:23 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 04:58:23.610915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:23.611819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:23.618683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.619503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.620192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.621128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.621804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.622447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.633919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:23.648789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6b83cdda-bc46-48b5-8f3e-a0dc249ffa8c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.285043 Aug 29 04:58:23.649694 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1026/2080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:23 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:23.662677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:23.764050 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-05521ea7-ff11-40de-b9a1-a8c000eb673a tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 204 len: 0 microversion: 2.1 time: 0.154999 Aug 29 04:58:23.765204 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1055/2081] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:58:23 2022] DELETE /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:58:23.776744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:23.777822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:23.786418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.786927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.787366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.788080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:23.788565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:23.788986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:23.954026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:23.964052 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4636b43-e65e-4ca6-bb78-1f73a85e9214 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1683 microversion: 2.1 time: 0.193318 Aug 29 04:58:23.977144 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1027/2082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:23 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1683 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:24.277257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:24.278075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:24.286398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:24.287037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:24.287473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:24.288257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:24.288692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:24.289107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:24.358991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:24.385494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:24.387556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:24.388777 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6bc6ea08-5306-43b8-8ede-ee3041d2060f tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.116935 Aug 29 04:58:24.400268 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1056/2083] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:24 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:24.417664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:24.421089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:24.434134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:24.436173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:24.436628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:24.437357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:24.437976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:24.438655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:24.624634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:24.633190 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8a573904-c325-4035-80ba-1f6ad534c2aa tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.220318 Aug 29 04:58:24.644413 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1028/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:24 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:24.676267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:24.677146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:24.688738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:24.690075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:24.691042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:24.692108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:24.693005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:24.693679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:24.858230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:24.873605 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7ed786ce-e2b1-4303-8292-495e1048e8b7 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.203190 Aug 29 04:58:24.874503 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1029/2085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:24 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:24.928003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1125117370", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:24.983870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:58:24.987069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:24.987691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:24.994834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:24.995614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:24.996294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:24.997231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:24.997889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:24.998523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:25.238587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:25.250221 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3458279e-58cf-494c-9ad8-d42e5084393c tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1683 microversion: 2.1 time: 0.264719 Aug 29 04:58:25.251335 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1030/2086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:24 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1683 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:25.270191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:58:25.270616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:58:25.271090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:58:25.273288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:58:25.273903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:58:25.300245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:25.301911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:25.302893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:25.303929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:25.304578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:25.305169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:25.337498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Getting quotas for project bba34657d53f486e998548eeb8808579. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:58:25.343501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Getting quotas for user dd9d19d7439040d88387d4d5be2e3e20 and project bba34657d53f486e998548eeb8808579. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:58:25.365125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:58:25.368735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:58:25.413002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:25.414317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:25.421297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:25.422480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:25.423332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:25.424011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:25.424206 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-618d53fd-c8ca-4a06-aade-0125f18c4f7e tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844143 Aug 29 04:58:25.425043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:25.425494 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1057/2087] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:58:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:58:25.425967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:25.439341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f34547c7-467c-4cc2-83c1-cf519afbe524 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:25.440077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f34547c7-467c-4cc2-83c1-cf519afbe524 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:25.530185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:25.542198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:25.547433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f34547c7-467c-4cc2-83c1-cf519afbe524 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:25.550471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:25.552367 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e3b8d2a-daf0-44b5-b372-ca568ec03bc0 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.145008 Aug 29 04:58:25.553475 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1031/2088] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:25 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:25.560171 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f34547c7-467c-4cc2-83c1-cf519afbe524 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1214 microversion: 2.1 time: 0.126776 Aug 29 04:58:25.561463 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1058/2089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:25 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:25.654626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:25.655164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:25.663614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:25.664083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:25.665374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:25.666758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:25.667139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:25.667556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:25.901237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:25.901923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:25.919697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:25.921432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:25.921973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:25.923004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:25.925437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:25.927637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:25.959280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:25.967575 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-883bedd0-933d-4933-993d-89cb207ddce4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.316745 Aug 29 04:58:25.968391 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1032/2090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:25 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:26.247760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:26.260411 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d7ac44a8-7620-4a7f-a704-00b41ca99656 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.367086 Aug 29 04:58:26.261611 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1059/2091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:25 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:26.280794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:26.282229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:26.293531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:26.294323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:26.295212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:26.296596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:26.297558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:26.298236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:26.581716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:26.584509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:26.595972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:26.597440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:26.598780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:26.600529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:26.601460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:26.602215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:26.891510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:26.907628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:26.922816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:26.925416 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c2dd3c46-1a1c-45fc-9071-c6cc1a3370fb tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.353206 Aug 29 04:58:26.930950 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1060/2092] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:26 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:26.939496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:26.941104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:26.952235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:26.953065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:26.953722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:26.954849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:26.955554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:26.956310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:26.984026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:26.993874 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab36c6a3-59f2-4bf1-9a36-3db840e8bc25 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1683 microversion: 2.1 time: 0.717350 Aug 29 04:58:26.996701 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1033/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:26 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1683 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:27.001580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:27.002661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:27.019608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.020539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.021139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:27.022644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.023351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.023997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:27.069131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:27.081061 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-81b1c85a-f1d3-449a-a576-246403594e0f tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1266 microversion: 2.1 time: 0.148685 Aug 29 04:58:27.092339 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1061/2094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:26 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:27.283065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:27.283597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:27.290392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.291158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.291772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:27.292745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.293381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.293969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:27.297703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:27.338353 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d2066caa-b673-468c-8b8b-17df41a2da35 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.340251 Aug 29 04:58:27.339228 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1034/2095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:26 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:27.571206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:27.571718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:27.585506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.585995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.586434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:27.587177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.587710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.588406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:27.636966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:27.655471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:27.664256 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17e8a1e2-20b9-40b8-9539-ce207dbefce1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.384975 Aug 29 04:58:27.665138 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1062/2096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:27 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:27.788184 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5b845dc8-59b6-4c53-8671-fba54ad54e68 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 204 len: 0 microversion: 2.1 time: 0.220949 Aug 29 04:58:27.789996 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1035/2097] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:58:27 2022] DELETE /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 04:58:27.801764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:27.802688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:27.811627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.812716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.814479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:27.815878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.818265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.819541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:27.957764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:27.958532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:27.971086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.971654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.974668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:27.975519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:27.976050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:27.976740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.111665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:28.125512 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ce034a4-0153-46e2-b62b-ee2663d86415 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1552 microversion: 2.1 time: 0.330895 Aug 29 04:58:28.128886 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1063/2098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:27 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1552 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:28.133998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-259d07cd-6f15-43ab-ae14-a6974403ce61 req-9a691c10-d410-46bb-a482-edd6097ef010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e3b162-b20c-46a9-9839-dca9a18ce982", "name": "network-vif-deleted", "tag": "a062dfc6-5a22-4087-960a-ef508765cdb8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:28.144494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-259d07cd-6f15-43ab-ae14-a6974403ce61 req-9a691c10-d410-46bb-a482-edd6097ef010 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.144985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-259d07cd-6f15-43ab-ae14-a6974403ce61 req-9a691c10-d410-46bb-a482-edd6097ef010 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.145408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-259d07cd-6f15-43ab-ae14-a6974403ce61 req-9a691c10-d410-46bb-a482-edd6097ef010 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.177068 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-259d07cd-6f15-43ab-ae14-a6974403ce61 req-9a691c10-d410-46bb-a482-edd6097ef010 service nova] Creating event network-vif-deleted:a062dfc6-5a22-4087-960a-ef508765cdb8 for instance f1e3b162-b20c-46a9-9839-dca9a18ce982 on n-h2-854119-9 Aug 29 04:58:28.186186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:28.199922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:28.202299 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-259d07cd-6f15-43ab-ae14-a6974403ce61 req-9a691c10-d410-46bb-a482-edd6097ef010 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069449 Aug 29 04:58:28.204842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1064/2099] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:28.208216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:28.211602 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-90f3b8f9-3ece-4773-99c3-199fa3b22573 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1265 microversion: 2.25 time: 0.261583 Aug 29 04:58:28.213553 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1036/2100] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:27 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:28.218859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:28.219993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:28.222469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:28.227000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:28.241414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.244317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.244979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.247060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.249087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.249567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.250261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.250901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.255917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.256959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.257910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.258301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.319045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.319469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.319907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.320401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lazy-loading 'fault' on Instance uuid f1e3b162-b20c-46a9-9839-dca9a18ce982 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:28.421874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:28.430662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4beeed05-900d-4635-8e00-613389c56cb0 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1284 microversion: 2.1 time: 0.215794 Aug 29 04:58:28.431341 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1037/2101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:28 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1284 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:28.444288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:28.454599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:28.456965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:28.464008 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8e842939-20cc-41f6-acb7-fa73d36db210 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1331 microversion: 2.1 time: 0.256388 Aug 29 04:58:28.464654 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1065/2102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:28 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1331 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:28.476897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.478076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.478904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.479873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.480718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.481567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.693622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:28.694391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:28.712211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.712820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.713254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.713962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:28.714423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:28.714843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:28.752751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:28.761616 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bdabb15c-c997-41c0-b58c-925478ede993 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.328963 Aug 29 04:58:28.762727 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1038/2103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:28 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:29.032393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:29.041096 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-236a241c-be29-4a47-8b08-f5d1b264875c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.351253 Aug 29 04:58:29.041949 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1066/2104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:28 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:29.153203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:29.153916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:29.164012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.165532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.167963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.169094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.170672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.173927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.242234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:29.243200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:29.261737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.263171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.263826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.264812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.265484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.266310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.318577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.319433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.320281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.320997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lazy-loading 'fault' on Instance uuid 901a2798-d6c4-4d96-8a72-a0828794e98c {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:29.427141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:29.443011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:29.445107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:29.447491 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c58c967d-f02f-4239-8a54-9c482c16590a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 200 len: 1270 microversion: 2.25 time: 0.210353 Aug 29 04:58:29.450761 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1067/2105] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:29 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:29.456536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:29.457418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:29.464714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.465660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.466370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.467309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.468238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.469240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.484094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:29.513414 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f73b6537-a744-4d43-a4a1-89291fb33291 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1552 microversion: 2.1 time: 0.364705 Aug 29 04:58:29.514660 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1039/2106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:29 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1552 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:29.530786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:29.531739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:29.546130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.546859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.547490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.548417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.549312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.549970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.576833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:29.602891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.603922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.604087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:29.604877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.605524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lazy-loading 'fault' on Instance uuid f1e3b162-b20c-46a9-9839-dca9a18ce982 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:29.616600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:29.635612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a043d635-e15e-43f5-a5d5-8b5836e941ce tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1272 microversion: 2.1 time: 0.180956 Aug 29 04:58:29.637879 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1068/2107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:29 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:29.694577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25804068a64f5fb3407c0351be09c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dc7feeb2544557b122e2423a9ce97f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:29.705973 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be3710c7-b26f-4438-b713-01c326e494fb tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 200 len: 1331 microversion: 2.1 time: 0.189844 Aug 29 04:58:29.706948 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1040/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:29 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 1331 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:29.786903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:29.790073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:29.804038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.804804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.805602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:29.806777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:29.807401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:29.807984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:30.062016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:30.062969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:30.073774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:30.074558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:30.075521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:30.076652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:30.077352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:30.078668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:30.113452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:30.126048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c94b687f-9b7b-46df-821c-67e4a9bfe5bb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.346384 Aug 29 04:58:30.141519 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1069/2109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:29 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:30.278536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:30.287781 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1d81ace-0ded-4125-8b81-5198b738f0d3 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.230380 Aug 29 04:58:30.289111 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1041/2110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:30 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:30.477055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:30.477572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 901a2798-d6c4-4d96-8a72-a0828794e98c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:30.481778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:30.490029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:30.490889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:30.491710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:30.492770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:30.493543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:30.494295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:30.526718 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] HTTP exception thrown: Instance 901a2798-d6c4-4d96-8a72-a0828794e98c could not be found. Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Request method failure captured: Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c HTTP/1.1 Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWmiRulnmh0OC1Rld63FrUg8885ukFAOv7V2-Wshr5SrmJVoBF7xPo71IeJIhxylsCgQrQ4jUACYVdSEHvR9UQeDt5OoDgqkzLEO-gCUd8y60V4RcCRHgslnckwqGDNcK69B9w1Y8OY8KXJsMSvWxmLu_-bGfHvwW7X__660b4vk9M Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2864fc0a731f4945a27e68889572000f Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2864fc0a731f4945a27e68889572000f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2864fc0a731f4945a27e68889572000f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2864fc0a731f4945a27e68889572000f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2864fc0a731f4945a27e68889572000f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2864fc0a731f4945a27e68889572000f Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-LiveAutoBlockMigrationV225Test-98150719-project Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 62ea00a8210b4ede95e54c53e7445794 Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-98150719-project Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 901a2798-d6c4-4d96-8a72-a0828794e98c could not be found. Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '901a2798-d6c4-4d96-8a72-a0828794e98c'} Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901a2798-d6c4-4d96-8a72-a0828794e98c could not be found. Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901a2798-d6c4-4d96-8a72-a0828794e98c could not be found. Aug 29 04:58:30.529763 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:30.535715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:30.535715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:30.535715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:30.535715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:30.535715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:30.535715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:30.535715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:30.535715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901a2798-d6c4-4d96-8a72-a0828794e98c could not be found. Aug 29 04:58:30.535715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:30.537566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:30.538203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:30.547955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Returning 404 to user: Instance 901a2798-d6c4-4d96-8a72-a0828794e98c could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:30.549667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:30.550384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:30.550669 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-02e874b2-f120-4d86-addd-5ba4966d8f4c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c" status: 404 len: 111 microversion: 2.25 time: 0.076986 Aug 29 04:58:30.551170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:30.554597 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1070/2111] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:30 2022] GET /compute/v2.1/servers/901a2798-d6c4-4d96-8a72-a0828794e98c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:58:30.555889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:30.556858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:30.558904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:30.660862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:30.661757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:30.672215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:30.678901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:30.679464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:30.680483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:30.681104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:30.681883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:31.064018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:31.074748 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-63bb3950-390a-464f-8259-5eb79ba43518 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1552 microversion: 2.1 time: 0.541265 Aug 29 04:58:31.080277 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1042/2112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:30 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1552 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:31.095470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:31.096464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:31.111038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:31.111893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:31.112544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:31.113435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:31.114098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:31.114722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:31.135842 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] HTTP exception thrown: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Request method failure captured: Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 HTTP/1.1 Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEausR8teH4Vtxh9guGwnDac5m6z0vTs_PBeQwVKIBMjZrGuNPS0jtm6YgBKUwtHfPKudqjkzwM7gmMVlN4JUgqK_ZDpWiB45c45cYOwa4Tk8rG98-at7orOlRrNIhYuCgEOzKy031R3uJTiZQ7l_NlCNLtlUydX4K-dbIUrOCqKszw Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 22dc7feeb2544557b122e2423a9ce97f Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1238070868 Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22dc7feeb2544557b122e2423a9ce97f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22dc7feeb2544557b122e2423a9ce97f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22dc7feeb2544557b122e2423a9ce97f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22dc7feeb2544557b122e2423a9ce97f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1238070868 Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 22dc7feeb2544557b122e2423a9ce97f Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1238070868 Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachSCSIVolumeTestJSON-1238070868-project Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: cd25804068a64f5fb3407c0351be09c1 Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1238070868-project Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'f1e3b162-b20c-46a9-9839-dca9a18ce982'} Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:31.158091 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Returning 404 to user: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a5bc9e21-cf52-4141-a6bd-190f27215d05 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 404 len: 111 microversion: 2.1 time: 0.078642 Aug 29 04:58:31.164328 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1043/2113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:31 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:58:31.177179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:31.177823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:31.184615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:31.185139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:31.185578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:31.186337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:31.186782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:31.187379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:31.330132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:31.344332 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-181c5380-9171-44ba-9a5c-3815ca9d8ff4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1314 microversion: 2.1 time: 0.687828 Aug 29 04:58:31.345175 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1071/2114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:30 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:31.361355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-efd26d3c-d823-4c79-979c-a64e3fc09fe0 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '.version_select at 0x7f1ab89c0550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:31.398410 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-efd26d3c-d823-4c79-979c-a64e3fc09fe0 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-908197294" status: 202 len: 0 microversion: 2.1 time: 0.051922 Aug 29 04:58:31.399490 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1072/2115] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 04:58:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-908197294 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:58:31.405184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:31.408002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:31.424379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:31.424820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:31.425466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:31.426358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:31.427039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:31.427676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:31.834553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:31.856399 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a7bd3acd-02de-457e-8dca-5aae271dd90e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.694507 Aug 29 04:58:31.866175 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1044/2116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:31 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:31.872233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-adf550b2-310a-4a90-a3e7-7e4d4d826c99 req-6d0003a1-1ce5-4fd8-a0c6-a12b4690cc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a08139-975a-4c7d-9bf2-05a417d9fbde", "name": "network-vif-deleted", "tag": "8bfc5d07-7eb5-47d2-a100-33c56a9a0439"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:31.903097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-adf550b2-310a-4a90-a3e7-7e4d4d826c99 req-6d0003a1-1ce5-4fd8-a0c6-a12b4690cc96 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:31.903591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-adf550b2-310a-4a90-a3e7-7e4d4d826c99 req-6d0003a1-1ce5-4fd8-a0c6-a12b4690cc96 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:31.904022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-adf550b2-310a-4a90-a3e7-7e4d4d826c99 req-6d0003a1-1ce5-4fd8-a0c6-a12b4690cc96 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:31.923677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:31.938815 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-adf550b2-310a-4a90-a3e7-7e4d4d826c99 req-6d0003a1-1ce5-4fd8-a0c6-a12b4690cc96 service nova] Creating event network-vif-deleted:8bfc5d07-7eb5-47d2-a100-33c56a9a0439 for instance 96a08139-975a-4c7d-9bf2-05a417d9fbde on n-h1-854119-9 Aug 29 04:58:31.948382 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4d48707-da0b-41c9-88d2-95d44e759e44 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.547413 Aug 29 04:58:31.951818 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1073/2117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:31 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:31.968141 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-adf550b2-310a-4a90-a3e7-7e4d4d826c99 req-6d0003a1-1ce5-4fd8-a0c6-a12b4690cc96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093764 Aug 29 04:58:31.968826 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1045/2118] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:32.104375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:32.105529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:32.117348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:32.119165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:32.120919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:32.124224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:32.125048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:32.126045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:32.365942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:32.366646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:32.378577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:32.379073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:32.381216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:32.381982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:32.382446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:32.382880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:32.418398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:32.440146 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5dc7a96-510b-4c89-9b7c-e97658bd60cc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1344 microversion: 2.1 time: 0.340597 Aug 29 04:58:32.442282 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1074/2119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:32 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1344 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:32.635725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:32.644420 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b8ef061c-7b07-4947-a7b2-5b65df93edfa tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1314 microversion: 2.1 time: 0.282696 Aug 29 04:58:32.646740 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1046/2120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:32 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:32.888284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:32.889165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:32.908305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:32.909085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:32.910661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:32.912292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:32.914171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:32.915420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:32.987269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:32.988693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:33.007919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:33.008453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:33.008892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:33.009713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:33.015154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:33.015822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:33.406325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:33.418148 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1199316d-5979-426f-ae62-37f83d3bbdc5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.441603 Aug 29 04:58:33.425142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1047/2121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:32 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:33.426658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:33.436497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c36a3f31-2456-487a-9311-ad1145f2f4cf req-f89e4e3d-09e0-4153-b5b1-987ca88aa445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf611f75-4724-49dd-8de7-7c7ac0c1784c", "tag": "39a3f592-7bb2-47e2-a2fb-0014a7345377"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:33.438543 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13e046e4-c608-46bc-b2bd-f387cbda3a68 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.555295 Aug 29 04:58:33.441954 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1075/2122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:32 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:33.474869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:33.475752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:33.478032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c36a3f31-2456-487a-9311-ad1145f2f4cf req-f89e4e3d-09e0-4153-b5b1-987ca88aa445 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:33.482714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c36a3f31-2456-487a-9311-ad1145f2f4cf req-f89e4e3d-09e0-4153-b5b1-987ca88aa445 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:33.483482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c36a3f31-2456-487a-9311-ad1145f2f4cf req-f89e4e3d-09e0-4153-b5b1-987ca88aa445 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:33.489892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:33.490976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:33.493153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:33.496297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:33.497192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:33.499897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:33.521871 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c36a3f31-2456-487a-9311-ad1145f2f4cf req-f89e4e3d-09e0-4153-b5b1-987ca88aa445 service nova] Creating event network-changed:39a3f592-7bb2-47e2-a2fb-0014a7345377 for instance cf611f75-4724-49dd-8de7-7c7ac0c1784c on n-h1-854119-9 Aug 29 04:58:33.529424 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c36a3f31-2456-487a-9311-ad1145f2f4cf req-f89e4e3d-09e0-4153-b5b1-987ca88aa445 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102721 Aug 29 04:58:33.542035 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1048/2123] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:33.616833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:33.628827 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b43280bb-5b97-4667-bd98-693cdf4fbc78 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1344 microversion: 2.1 time: 0.165079 Aug 29 04:58:33.629575 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1076/2124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:33 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1344 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:33.667539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:33.668265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:33.680248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:33.682197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:33.684262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:33.684982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:33.686596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:33.687233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:33.929154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:33.940531 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c5ca6f73-2411-4b7f-91ab-aabe4629d3b8 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1314 microversion: 2.1 time: 0.277308 Aug 29 04:58:33.944040 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1049/2125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:33 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:33.993625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f4cd6589-7968-48f1-805c-4c2fa201034c req-a14c6aa1-ec95-415d-b46d-ed83f83f3eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5f9e23-6688-4b92-ba5e-844e4ba6d72d", "name": "network-vif-unplugged", "status": "completed", "tag": "5148f8dc-bb11-451d-b354-b31019213845"}, {"name": "network-changed", "server_uuid": "4c5f9e23-6688-4b92-ba5e-844e4ba6d72d", "tag": "5148f8dc-bb11-451d-b354-b31019213845"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:34.024887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f4cd6589-7968-48f1-805c-4c2fa201034c req-a14c6aa1-ec95-415d-b46d-ed83f83f3eac service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:34.026787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f4cd6589-7968-48f1-805c-4c2fa201034c req-a14c6aa1-ec95-415d-b46d-ed83f83f3eac service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:34.027551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f4cd6589-7968-48f1-805c-4c2fa201034c req-a14c6aa1-ec95-415d-b46d-ed83f83f3eac service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:34.047493 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f4cd6589-7968-48f1-805c-4c2fa201034c req-a14c6aa1-ec95-415d-b46d-ed83f83f3eac service nova] Creating event network-vif-unplugged:5148f8dc-bb11-451d-b354-b31019213845 for instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d on n-h2-854119-9 Aug 29 04:58:34.048509 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f4cd6589-7968-48f1-805c-4c2fa201034c req-a14c6aa1-ec95-415d-b46d-ed83f83f3eac service nova] Creating event network-changed:5148f8dc-bb11-451d-b354-b31019213845 for instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d on n-h2-854119-9 Aug 29 04:58:34.055003 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f4cd6589-7968-48f1-805c-4c2fa201034c req-a14c6aa1-ec95-415d-b46d-ed83f83f3eac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.065581 Aug 29 04:58:34.056197 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1077/2126] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:34.449856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:34.451620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:34.463385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:34.464160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:34.469500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:34.471056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:34.471804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:34.486696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:34.488859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:34.491229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:34.492322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:34.493158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:34.493855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:34.494761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:34.499334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:34.501470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:35.004109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:35.017135 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9aa0adc3-6af3-415d-8468-e073bf611b4a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.571785 Aug 29 04:58:35.021297 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1050/2127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:34 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:35.038403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:35.039301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:35.057147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:35.061448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:35.062083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:35.063092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:35.064256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:35.068227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:35.218897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:35.229238 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9c33a88b-3df8-4aa3-aced-0cc500e105ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.771114 Aug 29 04:58:35.233642 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1078/2128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:34 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:35.244470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:35.248423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:35.259716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:35.260261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:35.260696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:35.261418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:35.261872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:35.262296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:35.281299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:35.299928 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e1b34b0-3362-4344-82f3-4341c73e1542 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1344 microversion: 2.1 time: 0.274717 Aug 29 04:58:35.300557 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1051/2129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:35 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1344 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:35.329270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:35.552832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:35.574895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:35.588258 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6662bf86-672d-4c25-ba6a-abba30edd8b4 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1314 microversion: 2.1 time: 0.353186 Aug 29 04:58:35.590527 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1079/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:35 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:36.040832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:36.042203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:36.052379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.053129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.053815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.054762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.055496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.056257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.255624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:36.256285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:36.263791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.264313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.264747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.265673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.266124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.266531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.641273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:36.644368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:36.654582 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-696c3428-9dde-48fb-b3c5-eeb9c23ef1a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1498 microversion: 2.1 time: 0.403475 Aug 29 04:58:36.654831 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f34a1ab-8ff1-41ad-91e3-30e5dfbc324a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.619117 Aug 29 04:58:36.655326 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1052/2131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:36 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:36.676274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:36.677191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:36.683140 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1080/2132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:36 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1498 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:36.684524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.685308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.685960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.686837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.687456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.688044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.693898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:36.696813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:36.715490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.717552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.718260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.720154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.720936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.722729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.782997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:36.787277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:36.795607 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5c95bf64-5951-46e0-a293-59e88b778898 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1344 microversion: 2.1 time: 0.123239 Aug 29 04:58:36.814667 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1053/2133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:36 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1344 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:36.821241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:36.822200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:36.831528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.832350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.833158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.834049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.834771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.835354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.958563 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8bc1fed9-5a85-49f0-8781-e1e80241a373 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 204 len: 0 microversion: 2.25 time: 0.272708 Aug 29 04:58:36.959364 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1081/2134] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 04:58:36 2022] DELETE /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:58:36.970459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:36.971230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:36.979670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.979785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.980393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:36.981218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:36.981733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:36.982220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:37.096075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:37.106046 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b6e54f9d-05e7-48d5-a550-d43370b4286c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1314 microversion: 2.1 time: 0.289898 Aug 29 04:58:37.112666 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1054/2135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:36 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:37.237415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:37.266601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:37.271659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:37.275237 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73f9092a-c68a-45cb-a3ef-fd0084330304 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1732 microversion: 2.25 time: 0.309801 Aug 29 04:58:37.290600 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1082/2136] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:36 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1732 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:37.675811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:37.676463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:37.677391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:37.678850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:37.684495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:37.685000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:37.685449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:37.686434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:37.686897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:37.687325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:37.688067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:37.688826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:37.689499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:37.690730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:37.691406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:37.693616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.097835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:38.110018 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8963e62a-35ab-4ed2-91d1-3cfe01f4149b tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.438411 Aug 29 04:58:38.120158 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1055/2137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:37 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:38.138310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:38.148862 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d4aa852-c94d-4d8a-a39e-daafbe529e4e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 200 len: 1475 microversion: 2.1 time: 0.473085 Aug 29 04:58:38.163819 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1083/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:37 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 1475 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:38.170705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:38.171778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:38.179939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.180809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.181528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.183424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.184210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.185065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.490485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:38.505136 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a8051603-34f2-4c19-b201-97cbd384f15d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1344 microversion: 2.1 time: 0.338908 Aug 29 04:58:38.508067 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1084/2139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:38 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1344 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:38.516090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:38.517121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:38.528623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:38.529530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:38.543710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.545281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.545897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.546784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.546933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.547884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.548679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.549639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.550773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.551523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.552641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.553103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.604583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:38.683015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:38.742336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:38.747394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f2c499b8-fe70-4f38-aa08-ceb360a41df6 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 204 len: 0 microversion: 2.32 time: 0.625488 Aug 29 04:58:38.749010 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1056/2140] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 04:58:38 2022] DELETE /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:58:38.759171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dbe24f60-4321-4e70-9a8b-bd06b464ea57 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-817705217"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:38.761793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dbe24f60-4321-4e70-9a8b-bd06b464ea57 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:38.770225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbe24f60-4321-4e70-9a8b-bd06b464ea57 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.770765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbe24f60-4321-4e70-9a8b-bd06b464ea57 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.771201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbe24f60-4321-4e70-9a8b-bd06b464ea57 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.771919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbe24f60-4321-4e70-9a8b-bd06b464ea57 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.772584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbe24f60-4321-4e70-9a8b-bd06b464ea57 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.773319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbe24f60-4321-4e70-9a8b-bd06b464ea57 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.864469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:38.876040 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-03ac9117-0b81-4941-acbf-a00b16efeb31 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1314 microversion: 2.1 time: 0.366279 Aug 29 04:58:38.888525 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1085/2141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:38 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:38.905335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:38.907215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:38.919837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.921837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.922594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.924245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:38.925125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:38.925509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:38.942503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:39.069808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:39.083945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:39.086030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:39.087851 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73f5fa2e-3b1a-4404-869f-6e623be20239 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1664 microversion: 2.25 time: 0.193933 Aug 29 04:58:39.097598 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1086/2142] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:38 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1664 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:39.104347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:39.104966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:39.118215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:39.119698 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dbe24f60-4321-4e70-9a8b-bd06b464ea57 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf/action" status: 202 len: 0 microversion: 2.1 time: 0.368245 Aug 29 04:58:39.120456 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1057/2143] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:58:38 2022] POST /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 04:58:39.132679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:39.133291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:39.134484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:39.139453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:39.139911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:39.146795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:39.148942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:39.163808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:39.166233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:39.166867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:39.168308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:39.168955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:39.170382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:39.515835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:39.526497 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1cf900a2-2020-4bc6-8840-d2243d638f0c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.389513 Aug 29 04:58:39.527677 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1058/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:39 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:39.533501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-34e36950-ad14-4bc8-ab2c-f46bfca00099 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9d7cf70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:39.589730 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-34e36950-ad14-4bc8-ab2c-f46bfca00099 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.060723 Aug 29 04:58:39.590729 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1059/2145] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:39 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:39.596301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:39.597251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:39.599180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:39.606869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:39.607747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:39.609167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:39.609167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:39.609946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:39.610598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:39.612746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:39.614208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:39.615507 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f4af2878-9925-4059-8480-a4195d1f08f8 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 2945 microversion: 2.32 time: 0.515949 Aug 29 04:58:39.631111 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1087/2146] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:39 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 2945 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:39.712317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:39.724373 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-20e48e77-28d1-441a-b3b3-9d459c27b1bc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1344 microversion: 2.1 time: 0.130542 Aug 29 04:58:39.727498 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1060/2147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:39 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1344 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:39.831566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8479d100-bb7d-4637-8e6c-75039e1e8233 req-c400418b-17db-4852-aa30-79db6e94c816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b14f0ef-853d-4876-888d-045a86ffd64a", "name": "network-vif-deleted", "tag": "cb07cff6-85cd-45cb-b12a-e416d047ddfb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:39.880292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8479d100-bb7d-4637-8e6c-75039e1e8233 req-c400418b-17db-4852-aa30-79db6e94c816 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:39.881558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8479d100-bb7d-4637-8e6c-75039e1e8233 req-c400418b-17db-4852-aa30-79db6e94c816 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:39.882277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8479d100-bb7d-4637-8e6c-75039e1e8233 req-c400418b-17db-4852-aa30-79db6e94c816 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:39.901410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:39.902116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:39.911548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:39.912054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:39.912523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:39.913246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:39.913707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:39.914131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:39.924623 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8479d100-bb7d-4637-8e6c-75039e1e8233 req-c400418b-17db-4852-aa30-79db6e94c816 service nova] Creating event network-vif-deleted:cb07cff6-85cd-45cb-b12a-e416d047ddfb for instance 1b14f0ef-853d-4876-888d-045a86ffd64a on n-h2-854119-9 Aug 29 04:58:39.931339 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8479d100-bb7d-4637-8e6c-75039e1e8233 req-c400418b-17db-4852-aa30-79db6e94c816 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106258 Aug 29 04:58:39.932670 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1088/2148] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:40.133439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:40.134187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:40.134813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:40.145447 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4aadb0ac-3473-4885-b042-66e640e97fb7 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1314 microversion: 2.1 time: 0.249650 Aug 29 04:58:40.146525 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1061/2149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:39 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:40.157347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:40.157868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:40.158396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:40.159523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:40.160833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:40.161545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:40.220816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:40.221235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:40.221770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:40.222459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lazy-loading 'fault' on Instance uuid 1b14f0ef-853d-4876-888d-045a86ffd64a {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:40.324387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:40.340628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:40.342088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:40.343284 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c29984ba-a3e9-4aa1-a442-5a23cb6ceff6 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 200 len: 1374 microversion: 2.25 time: 0.224475 Aug 29 04:58:40.350632 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1089/2150] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:40 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 1374 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:40.551435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:40.552464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:40.560713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:40.561207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:40.561635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:40.568704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:40.569453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:40.569885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:40.606223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57c02d2f-eb5c-4255-a427-08d40ce6a943 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8968550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:40.684864 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57c02d2f-eb5c-4255-a427-08d40ce6a943 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.083620 Aug 29 04:58:40.693971 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1090/2151] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:40 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:40.701948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:40.702568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:40.718959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:40.719463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:40.719904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:40.723664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:40.724231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:40.724691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:41.282215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:41.287861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:41.298461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:41.299936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:41.301502 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6865889c-a0e7-4230-bb86-a426cd02ede6 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.753887 Aug 29 04:58:41.302197 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1062/2152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:40 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:41.307329 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-36a7c324-a2af-45e2-ac1f-718c895e8125 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 2945 microversion: 2.32 time: 0.608316 Aug 29 04:58:41.316871 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1091/2153] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:40 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 2945 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:41.318094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-71999411-1455-4971-90bb-bc8a2989d352 req-8b0d9fed-66c1-454c-bb3c-2d4ab75b9554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf611f75-4724-49dd-8de7-7c7ac0c1784c", "name": "network-vif-plugged", "status": "completed", "tag": "39a3f592-7bb2-47e2-a2fb-0014a7345377"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:41.330780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:41.331616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:41.335245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-71999411-1455-4971-90bb-bc8a2989d352 req-8b0d9fed-66c1-454c-bb3c-2d4ab75b9554 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:41.335828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-71999411-1455-4971-90bb-bc8a2989d352 req-8b0d9fed-66c1-454c-bb3c-2d4ab75b9554 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:41.336620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-71999411-1455-4971-90bb-bc8a2989d352 req-8b0d9fed-66c1-454c-bb3c-2d4ab75b9554 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:41.349967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:41.351101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:41.351560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:41.352384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:41.352848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:41.357624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:41.377827 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-71999411-1455-4971-90bb-bc8a2989d352 req-8b0d9fed-66c1-454c-bb3c-2d4ab75b9554 service nova] Creating event network-vif-plugged:39a3f592-7bb2-47e2-a2fb-0014a7345377 for instance cf611f75-4724-49dd-8de7-7c7ac0c1784c on n-h1-854119-9 Aug 29 04:58:41.384952 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-71999411-1455-4971-90bb-bc8a2989d352 req-8b0d9fed-66c1-454c-bb3c-2d4ab75b9554 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078237 Aug 29 04:58:41.386456 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1063/2154] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:41.412493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:41.417364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:41.439283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:41.444452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:41.446448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:41.447618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:41.448542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:41.449439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:41.459304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:41.460460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:41.462224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:41.464752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lazy-loading 'fault' on Instance uuid 96a08139-975a-4c7d-9bf2-05a417d9fbde {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:41.593237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:41.607162 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae1ee30e-0a75-4806-ad1c-a973f16ed016 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 200 len: 1349 microversion: 2.1 time: 0.289073 Aug 29 04:58:41.608834 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1092/2155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:41 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 1349 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:41.616571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:41.617751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 1b14f0ef-853d-4876-888d-045a86ffd64a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:41.628773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:41.628773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:41.629243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:41.631023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:41.631525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:41.631939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:41.649524 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] HTTP exception thrown: Instance 1b14f0ef-853d-4876-888d-045a86ffd64a could not be found. Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Request method failure captured: Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a HTTP/1.1 Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEWmiRulnmh0OC1Rld63FrUg8885ukFAOv7V2-Wshr5SrmJVoBF7xPo71IeJIhxylsCgQrQ4jUACYVdSEHvR9UQeDt5OoDgqkzLEO-gCUd8y60V4RcCRHgslnckwqGDNcK69B9w1Y8OY8KXJsMSvWxmLu_-bGfHvwW7X__660b4vk9M Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2864fc0a731f4945a27e68889572000f Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2864fc0a731f4945a27e68889572000f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2864fc0a731f4945a27e68889572000f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2864fc0a731f4945a27e68889572000f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2864fc0a731f4945a27e68889572000f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2864fc0a731f4945a27e68889572000f Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-LiveAutoBlockMigrationV225Test-98150719-project Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 62ea00a8210b4ede95e54c53e7445794 Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-98150719-project Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 1b14f0ef-853d-4876-888d-045a86ffd64a could not be found. Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '1b14f0ef-853d-4876-888d-045a86ffd64a'} Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b14f0ef-853d-4876-888d-045a86ffd64a could not be found. Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b14f0ef-853d-4876-888d-045a86ffd64a could not be found. Aug 29 04:58:41.652576 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b14f0ef-853d-4876-888d-045a86ffd64a could not be found. Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Returning 404 to user: Instance 1b14f0ef-853d-4876-888d-045a86ffd64a could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aabffbb2-a817-4864-ba75-f43aee87d729 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a" status: 404 len: 111 microversion: 2.25 time: 0.042998 Aug 29 04:58:41.659809 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1093/2156] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:41 2022] GET /compute/v2.1/servers/1b14f0ef-853d-4876-888d-045a86ffd64a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:58:41.663556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-503b79c5-240a-4ee7-a000-7aee4906a22a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '.version_select at 0x7f1ab8968550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:41.713801 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-503b79c5-240a-4ee7-a000-7aee4906a22a tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890935324" status: 204 len: 0 microversion: 2.25 time: 0.054590 Aug 29 04:58:41.718148 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1094/2157] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Aug 29 04:58:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890935324 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:58:41.724529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-364d61eb-ad81-4a0e-94f0-9f7fdf267a8f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8b2daf0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:41.793513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:41.803496 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7af03391-f7d6-497c-8c52-4cffc9b0b10c tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1314 microversion: 2.1 time: 0.415518 Aug 29 04:58:41.805973 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1064/2158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:41 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:41.811425 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-364d61eb-ad81-4a0e-94f0-9f7fdf267a8f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.083729 Aug 29 04:58:41.812847 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1095/2159] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:41 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:42.323289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:42.323829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:42.337674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:42.338741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:42.339350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:42.340475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:42.340839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:42.341689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:42.342103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:42.342710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:42.354444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:42.356691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:42.357549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:42.358692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:42.359405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:42.360879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:42.999307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:43.017511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:43.021483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:43.031521 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9d927f33-74ce-42aa-a57b-e5620c862733 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 2945 microversion: 2.32 time: 0.694310 Aug 29 04:58:43.033773 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1096/2160] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:42 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 2945 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:43.042705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:43.050911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:43.074495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.075001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.075765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.083898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:43.084595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.085335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.085939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.096931 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7621c930-ce45-440f-a0e1-3b7f01f63ee8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.777617 Aug 29 04:58:43.113114 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1065/2161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:42 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:43.125550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:43.126358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:43.139739 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.140532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde HTTP/1.1 Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '96a08139-975a-4c7d-9bf2-05a417d9fbde'} Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:43.144844 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.150382 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:43.150382 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:43.150382 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:43.150382 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:43.150382 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:43.150382 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.150382 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.150973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.150973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.153437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.153574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:43.153682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.153682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.154337 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa665b2f-dc26-4fd9-8b39-a332ce0ac7d9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 404 len: 111 microversion: 2.1 time: 0.118625 Aug 29 04:58:43.158591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1097/2162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:43 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:58:43.175670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-845bd69b-1058-4a51-a71d-fb7d4f02c44a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8b3c1f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:43.271249 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-845bd69b-1058-4a51-a71d-fb7d4f02c44a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.107390 Aug 29 04:58:43.272312 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1098/2163] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:43 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:43.367421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:43.370593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:43.377938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.378709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.391106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.392292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.392936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.396843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.425828 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde/os-volume_attachments HTTP/1.1 Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'server_id': '96a08139-975a-4c7d-9bf2-05a417d9fbde'} Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:43.432227 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 04:58:43.438357 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:43.442020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:43.443326 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-afb85cf3-0065-4ca1-94fb-375ce37f5102 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.080653 Aug 29 04:58:43.445191 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1099/2164] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 04:58:43 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde/os-volume_attachments => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:58:43.464954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:43.466941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:43.485849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.487761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.489569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.493428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.494263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.495437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.562623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:43.571819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:43.575718 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-24abd4f6-702a-4aeb-a3f5-695c211bb048 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1314 microversion: 2.1 time: 0.460424 Aug 29 04:58:43.581288 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1066/2165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:43 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:43.767058 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-90ca1a3a-60c8-4ac0-b31b-9bc969497424 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 204 len: 0 microversion: 2.25 time: 0.317270 Aug 29 04:58:43.768034 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1100/2166] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 04:58:43 2022] DELETE /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:58:43.771662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1473226219", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "57e28866-1c32-4826-b8f3-b2fdc024be39"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:43.778842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:43.780405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:43.788911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.789860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.790743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.793005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:43.793728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:43.794551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:43.879613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] validate_networks() for [('57e28866-1c32-4826-b8f3-b2fdc024be39', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:58:44.188464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:44.199235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:44.204734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:44.205956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17ed22d0-c255-45f1-8376-67ce9b78e695 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1549 microversion: 2.25 time: 0.432538 Aug 29 04:58:44.206523 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1101/2167] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:43 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1549 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:44.223430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:44.223922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:44.235576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:44.237151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:44.237766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:44.238657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:44.242856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:44.243532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:44.274998 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] HTTP exception thrown: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Request method failure captured: Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 HTTP/1.1 Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEausR8teH4Vtxh9guGwnDac5m6z0vTs_PBeQwVKIBMjZrGuNPS0jtm6YgBKUwtHfPKudqjkzwM7gmMVlN4JUgqK_ZDpWiB45c45cYOwa4Tk8rG98-at7orOlRrNIhYuCgEOzKy031R3uJTiZQ7l_NlCNLtlUydX4K-dbIUrOCqKszw Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 22dc7feeb2544557b122e2423a9ce97f Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1238070868 Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22dc7feeb2544557b122e2423a9ce97f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22dc7feeb2544557b122e2423a9ce97f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22dc7feeb2544557b122e2423a9ce97f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22dc7feeb2544557b122e2423a9ce97f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1238070868 Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 22dc7feeb2544557b122e2423a9ce97f Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1238070868 Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachSCSIVolumeTestJSON-1238070868-project Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: cd25804068a64f5fb3407c0351be09c1 Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1238070868-project Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'f1e3b162-b20c-46a9-9839-dca9a18ce982'} Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:44.282338 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:44.286879 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:58:44.290940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Returning 404 to user: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:44.292167 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-36270ada-44fd-4350-9987-931a209fe31f tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 404 len: 111 microversion: 2.1 time: 0.081419 Aug 29 04:58:44.296018 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1102/2168] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:58:44 2022] DELETE /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:58:44.302843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:44.303790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:44.311977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:44.312817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:44.313477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:44.314721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:44.315783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:44.316250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:44.975357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:44.987871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:44.997349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:45.000764 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-34f64a7d-9080-454a-9b06-e26683c7b5bf tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 2924 microversion: 2.32 time: 0.703147 Aug 29 04:58:45.006258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1103/2169] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:44 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 2924 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:45.027104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:45.027777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:45.042995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.050223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.050934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.051856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.052500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.053153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.429488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:58:45.429982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:58:45.430432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:58:45.430832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:58:45.431547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:58:45.450273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.451501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.452159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.453245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.454495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.455794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.544377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:58:45.558024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for user 4d3aaab47eb243c6bf9a0b2e512e7c4a and project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:58:45.596232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:58:45.597560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:45.599443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:58:45.607223 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff220aa3-b85d-4508-979a-004bc2a5e0b8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.599567 Aug 29 04:58:45.632366 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1104/2170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:45 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:45.644307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cacd3039-cdd1-4f64-8331-62caca825b42 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8a1f310>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:45.679680 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7961af51-1ff3-48ff-9d55-60ac021ec12d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.914340 Aug 29 04:58:45.681603 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1067/2171] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:58:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:58:45.686975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:45.687955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] [instance: f1e3b162-b20c-46a9-9839-dca9a18ce982] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:45.695836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.696373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.696985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.697779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.698245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.698674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.720546 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cacd3039-cdd1-4f64-8331-62caca825b42 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.086752 Aug 29 04:58:45.721337 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1105/2172] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:45 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:45.734198 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] HTTP exception thrown: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Request method failure captured: Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 HTTP/1.1 Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEausR8teH4Vtxh9guGwnDac5m6z0vTs_PBeQwVKIBMjZrGuNPS0jtm6YgBKUwtHfPKudqjkzwM7gmMVlN4JUgqK_ZDpWiB45c45cYOwa4Tk8rG98-at7orOlRrNIhYuCgEOzKy031R3uJTiZQ7l_NlCNLtlUydX4K-dbIUrOCqKszw Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 22dc7feeb2544557b122e2423a9ce97f Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1238070868 Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22dc7feeb2544557b122e2423a9ce97f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22dc7feeb2544557b122e2423a9ce97f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22dc7feeb2544557b122e2423a9ce97f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22dc7feeb2544557b122e2423a9ce97f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1238070868 Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 22dc7feeb2544557b122e2423a9ce97f Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1238070868 Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachSCSIVolumeTestJSON-1238070868-project Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: cd25804068a64f5fb3407c0351be09c1 Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1238070868-project Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'f1e3b162-b20c-46a9-9839-dca9a18ce982'} Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:45.736455 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:45.741978 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:45.741978 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:45.741978 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:45.741978 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:45.741978 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:45.741978 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. Aug 29 04:58:45.741978 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:45.744051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] Returning 404 to user: Instance f1e3b162-b20c-46a9-9839-dca9a18ce982 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:45.745182 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8ec47fd4-7778-400d-9677-c7e351f12c27 tempest-AttachSCSIVolumeTestJSON-1238070868 tempest-AttachSCSIVolumeTestJSON-1238070868-project] 10.222.0.20 "GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982" status: 404 len: 111 microversion: 2.1 time: 0.062461 Aug 29 04:58:45.746263 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1068/2173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:45 2022] GET /compute/v2.1/servers/f1e3b162-b20c-46a9-9839-dca9a18ce982 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:58:45.753734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:45.754361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:45.763104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a8a2a799-cde9-4b7f-84de-9cf9ef4c0f19 req-417cf40e-fea5-4a24-a5fc-0015423fc6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-unplugged", "status": "completed", "tag": "e51c89e9-9080-422f-9836-19aa7e66d035"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:45.778054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.778543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.778969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.779678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.793635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.794578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.803729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a8a2a799-cde9-4b7f-84de-9cf9ef4c0f19 req-417cf40e-fea5-4a24-a5fc-0015423fc6b8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.804587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a8a2a799-cde9-4b7f-84de-9cf9ef4c0f19 req-417cf40e-fea5-4a24-a5fc-0015423fc6b8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.806511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a8a2a799-cde9-4b7f-84de-9cf9ef4c0f19 req-417cf40e-fea5-4a24-a5fc-0015423fc6b8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.833312 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a8a2a799-cde9-4b7f-84de-9cf9ef4c0f19 req-417cf40e-fea5-4a24-a5fc-0015423fc6b8 service nova] Creating event network-vif-unplugged:e51c89e9-9080-422f-9836-19aa7e66d035 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:45.849351 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a8a2a799-cde9-4b7f-84de-9cf9ef4c0f19 req-417cf40e-fea5-4a24-a5fc-0015423fc6b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101663 Aug 29 04:58:45.850440 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1069/2174] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:45.864707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0a37b447-3a1b-4314-9c41-94714ecbe278 req-9475b134-3fc8-4a21-a7ed-f602e84d8e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b96b18-802e-42f5-9751-0f1aac336e11", "name": "network-vif-deleted", "tag": "130be427-70c6-4954-bb69-4cbabeacd226"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:45.901452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0a37b447-3a1b-4314-9c41-94714ecbe278 req-9475b134-3fc8-4a21-a7ed-f602e84d8e83 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.904052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0a37b447-3a1b-4314-9c41-94714ecbe278 req-9475b134-3fc8-4a21-a7ed-f602e84d8e83 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.904939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0a37b447-3a1b-4314-9c41-94714ecbe278 req-9475b134-3fc8-4a21-a7ed-f602e84d8e83 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.935761 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0a37b447-3a1b-4314-9c41-94714ecbe278 req-9475b134-3fc8-4a21-a7ed-f602e84d8e83 service nova] Creating event network-vif-deleted:130be427-70c6-4954-bb69-4cbabeacd226 for instance 91b96b18-802e-42f5-9751-0f1aac336e11 on n-h2-854119-9 Aug 29 04:58:45.941371 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0a37b447-3a1b-4314-9c41-94714ecbe278 req-9475b134-3fc8-4a21-a7ed-f602e84d8e83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086280 Aug 29 04:58:45.942589 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1070/2175] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:45.965246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:45.965958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:45.981302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.982052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.982685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:45.983396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:45.983843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:45.984287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:46.039442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:46.040578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:46.041359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:46.041974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lazy-loading 'fault' on Instance uuid 91b96b18-802e-42f5-9751-0f1aac336e11 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:46.631436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:46.643611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:46.649675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:46.654354 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee05aad3-2eb1-4b56-b1b7-07ec29d5f98c tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 200 len: 1352 microversion: 2.25 time: 0.708241 Aug 29 04:58:46.654959 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1071/2176] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:45 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 1352 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:46.671730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:46.672626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:46.678626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:46.679124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:46.680783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:46.681911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:46.682379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:46.682806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:46.932039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:46.944413 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7b09ca8-8d85-446c-a440-ca3aa35f2ac6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1211 microversion: 2.1 time: 0.287373 Aug 29 04:58:46.945653 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1072/2177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:46 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1211 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:46.962966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:46.963608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:46.974804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:46.975809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:46.976682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:46.977570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:46.978226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:46.979135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:47.129921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:47.146349 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e777f5ff-6432-4e15-a9e7-e13250714353 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1464 microversion: 2.1 time: 1.421796 Aug 29 04:58:47.159161 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1106/2178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:45 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1464 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:47.159562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:47.161406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:47.179117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:47.179641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:47.180547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:47.181684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:47.182672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:47.183268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:47.592757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:47.603193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:47.604870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:47.606537 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-508a6339-e74e-4a85-86cd-2c0a2b63b609 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 2858 microversion: 2.32 time: 0.659442 Aug 29 04:58:47.607792 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1073/2179] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:46 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 2858 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:47.612687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b39e9ad5-87de-4407-8491-fb05bfef8673 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9cf9dc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:47.667406 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b39e9ad5-87de-4407-8491-fb05bfef8673 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.058243 Aug 29 04:58:47.668305 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1074/2180] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:47 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:47.695895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:47.708490 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6776f7f3-99a4-4bb9-b047-9ded94f450d0 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1392 microversion: 2.1 time: 0.555394 Aug 29 04:58:47.709733 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1107/2181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:47 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1392 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:47.715319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:47.716049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:47.725145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:47.725989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:47.726605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:47.727505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:47.728068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:47.728625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:47.759778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:47.766988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:47.922057 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-202833eb-1dc9-4d40-9e3a-959fe011ba22 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 204 len: 0 microversion: 2.1 time: 0.210477 Aug 29 04:58:47.932070 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1108/2182] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:58:47 2022] DELETE /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:58:47.963579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Calling method '.version_select at 0x7f1ab9a21a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:47.965916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:47.966631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:47.967243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.015098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.015412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.016051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.029295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.030015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.030627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.037243 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a99ecde2-0a31-4554-8091-693873c52beb tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413 tempest-PortsAdminExtendedAttrsIpV6TestJSON-104248413-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.367660 Aug 29 04:58:48.038445 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1075/2183] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 04:58:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:48.044092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:48.044992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 91b96b18-802e-42f5-9751-0f1aac336e11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:48.052637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.053381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.054072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.054967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.055603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.056278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.074060 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] HTTP exception thrown: Instance 91b96b18-802e-42f5-9751-0f1aac336e11 could not be found. Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Request method failure captured: Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 HTTP/1.1 Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWmiRulnmh0OC1Rld63FrUg8885ukFAOv7V2-Wshr5SrmJVoBF7xPo71IeJIhxylsCgQrQ4jUACYVdSEHvR9UQeDt5OoDgqkzLEO-gCUd8y60V4RcCRHgslnckwqGDNcK69B9w1Y8OY8KXJsMSvWxmLu_-bGfHvwW7X__660b4vk9M Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2864fc0a731f4945a27e68889572000f Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2864fc0a731f4945a27e68889572000f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2864fc0a731f4945a27e68889572000f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2864fc0a731f4945a27e68889572000f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2864fc0a731f4945a27e68889572000f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2864fc0a731f4945a27e68889572000f Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-LiveAutoBlockMigrationV225Test-98150719-project Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 62ea00a8210b4ede95e54c53e7445794 Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-98150719-project Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 91b96b18-802e-42f5-9751-0f1aac336e11 could not be found. Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '91b96b18-802e-42f5-9751-0f1aac336e11'} Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b96b18-802e-42f5-9751-0f1aac336e11 could not be found. Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b96b18-802e-42f5-9751-0f1aac336e11 could not be found. Aug 29 04:58:48.076956 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:48.082595 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:48.082595 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:48.082595 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:48.082595 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:48.082595 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:48.082595 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:48.082595 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:48.082595 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b96b18-802e-42f5-9751-0f1aac336e11 could not be found. Aug 29 04:58:48.082595 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:48.090964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Returning 404 to user: Instance 91b96b18-802e-42f5-9751-0f1aac336e11 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:48.092654 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be55bad7-1cc2-40cb-980e-a0d942c1e943 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11" status: 404 len: 111 microversion: 2.25 time: 0.053051 Aug 29 04:58:48.093434 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1076/2184] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:48 2022] GET /compute/v2.1/servers/91b96b18-802e-42f5-9751-0f1aac336e11 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:58:48.098850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-unplugged", "status": "completed", "tag": "e6173923-7d90-4415-821f-4e432a713b3e"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-unplugged", "status": "completed", "tag": "9da0fa16-4ab8-435c-abe2-442d313636cf"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-unplugged", "status": "completed", "tag": "56f6927d-5229-47b9-8f1f-2f0466f24ad6"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-unplugged", "status": "completed", "tag": "398b88bc-ab6b-4fae-9575-780d3764d159"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-unplugged", "status": "completed", "tag": "1e83970a-7e64-4b23-bf48-2452589a5692"}, {"server_uuid": "de63423e-f87b-485b-b071-9f20dcdf4eaf", "name": "network-vif-plugged", "status": "completed", "tag": "c7d98676-d55c-41a4-b6a4-487708a826ff"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:48.134061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70704158-21ab-47d7-ad70-0cca273ae18a tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Calling method '.version_select at 0x7f1abd7fbb80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:48.135493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.136282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.136883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.147374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70704158-21ab-47d7-ad70-0cca273ae18a tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.147950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70704158-21ab-47d7-ad70-0cca273ae18a tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.148547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70704158-21ab-47d7-ad70-0cca273ae18a tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.154701 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Creating event network-vif-unplugged:e6173923-7d90-4415-821f-4e432a713b3e for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:48.155456 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Creating event network-vif-unplugged:9da0fa16-4ab8-435c-abe2-442d313636cf for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:48.156161 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Creating event network-vif-unplugged:56f6927d-5229-47b9-8f1f-2f0466f24ad6 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:48.156832 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Creating event network-vif-unplugged:398b88bc-ab6b-4fae-9575-780d3764d159 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:48.157494 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Creating event network-vif-unplugged:1e83970a-7e64-4b23-bf48-2452589a5692 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:48.158219 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] Creating event network-vif-plugged:c7d98676-d55c-41a4-b6a4-487708a826ff for instance de63423e-f87b-485b-b071-9f20dcdf4eaf on n-h1-854119-9 Aug 29 04:58:48.165862 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e905ea98-11c8-44ab-ae0f-df6a6b1a34b1 req-b6647ed2-5e18-49ac-9315-6171b02aced9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1048 microversion: 2.1 time: 0.071003 Aug 29 04:58:48.170429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70704158-21ab-47d7-ad70-0cca273ae18a tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.171159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70704158-21ab-47d7-ad70-0cca273ae18a tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.172377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70704158-21ab-47d7-ad70-0cca273ae18a tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.174008 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1077/2185] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 1048 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:48.180330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:48.181340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:48.190323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.191024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.191631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.192564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.193209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.193805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.196438 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70704158-21ab-47d7-ad70-0cca273ae18a tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/bba34657d53f486e998548eeb8808579?start=2022-08-28T04%3A58%3A47.163736&end=2022-08-30T04%3A58%3A47.163736" status: 200 len: 694 microversion: 2.1 time: 0.266812 Aug 29 04:58:48.200810 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1109/2186] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Aug 29 04:58:47 2022] GET /compute/v2.1/os-simple-tenant-usage/bba34657d53f486e998548eeb8808579?start=2022-08-28T04%3A58%3A47.163736&end=2022-08-30T04%3A58%3A47.163736 => generated 694 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:48.214758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ff77c07e-b9a9-4d83-9f77-e45c065dcfbb req-515574c8-5913-4472-96f3-7da9b237cb6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-deleted", "tag": "56f6927d-5229-47b9-8f1f-2f0466f24ad6"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-deleted", "tag": "1e83970a-7e64-4b23-bf48-2452589a5692"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:48.216522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:48.225139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ff77c07e-b9a9-4d83-9f77-e45c065dcfbb req-515574c8-5913-4472-96f3-7da9b237cb6a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.225895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ff77c07e-b9a9-4d83-9f77-e45c065dcfbb req-515574c8-5913-4472-96f3-7da9b237cb6a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.226497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ff77c07e-b9a9-4d83-9f77-e45c065dcfbb req-515574c8-5913-4472-96f3-7da9b237cb6a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.238836 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ff77c07e-b9a9-4d83-9f77-e45c065dcfbb req-515574c8-5913-4472-96f3-7da9b237cb6a service nova] Creating event network-vif-deleted:56f6927d-5229-47b9-8f1f-2f0466f24ad6 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:48.239631 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ff77c07e-b9a9-4d83-9f77-e45c065dcfbb req-515574c8-5913-4472-96f3-7da9b237cb6a service nova] Creating event network-vif-deleted:1e83970a-7e64-4b23-bf48-2452589a5692 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:48.245354 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ff77c07e-b9a9-4d83-9f77-e45c065dcfbb req-515574c8-5913-4472-96f3-7da9b237cb6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041209 Aug 29 04:58:48.246351 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1110/2187] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:48.252335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:48.253130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:48.259012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:48.260928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.261580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.262185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.263057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.263984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.264636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.297497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:48.359248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:48.368803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1dd12852-a282-429b-9c05-95ef88af8310 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1273 microversion: 2.1 time: 0.193186 Aug 29 04:58:48.374987 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1078/2188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:48 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:48.386920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ece363a1-28d3-46fb-9d64-c479c09ff2de tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '.version_select at 0x7f1ab9a21af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:48.401294 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ddb73b2d-1d2a-4142-ba97-fb28cb2299fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 204 len: 0 microversion: 2.25 time: 0.152752 Aug 29 04:58:48.402567 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1111/2189] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 04:58:48 2022] DELETE /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:58:48.405133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece363a1-28d3-46fb-9d64-c479c09ff2de tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.409777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece363a1-28d3-46fb-9d64-c479c09ff2de tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.411343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece363a1-28d3-46fb-9d64-c479c09ff2de tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.413281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:48.414261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:48.420963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.421818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.422506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.423454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.424165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.424819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.445858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece363a1-28d3-46fb-9d64-c479c09ff2de tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.446845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece363a1-28d3-46fb-9d64-c479c09ff2de tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.447532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece363a1-28d3-46fb-9d64-c479c09ff2de tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.468682 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ece363a1-28d3-46fb-9d64-c479c09ff2de tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/bba34657d53f486e998548eeb8808579?start=2022-08-28T04%3A58%3A47.163736&end=2022-08-30T04%3A58%3A47.163736" status: 200 len: 695 microversion: 2.1 time: 0.092560 Aug 29 04:58:48.470122 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1079/2190] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Aug 29 04:58:48 2022] GET /compute/v2.1/os-simple-tenant-usage/bba34657d53f486e998548eeb8808579?start=2022-08-28T04%3A58%3A47.163736&end=2022-08-30T04%3A58%3A47.163736 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:48.487112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30336778-c7e9-4675-b204-efdb9929966c tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Calling method '.version_select at 0x7f1ab9b95e50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:48.496889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30336778-c7e9-4675-b204-efdb9929966c tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.497656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30336778-c7e9-4675-b204-efdb9929966c tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.498292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30336778-c7e9-4675-b204-efdb9929966c tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.515443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30336778-c7e9-4675-b204-efdb9929966c tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.516294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30336778-c7e9-4675-b204-efdb9929966c tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.517359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30336778-c7e9-4675-b204-efdb9929966c tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.630484 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30336778-c7e9-4675-b204-efdb9929966c tempest-TenantUsagesTestJSON-1883295039 tempest-TenantUsagesTestJSON-1883295039-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T04%3A58%3A47.163736&end=2022-08-30T04%3A58%3A47.163736&detailed=1" status: 200 len: 22557 microversion: 2.1 time: 0.147771 Aug 29 04:58:48.642116 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1080/2191] 10.222.0.20 () {58 vars in 1335 bytes} [Mon Aug 29 04:58:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T04%3A58%3A47.163736&end=2022-08-30T04%3A58%3A47.163736&detailed=1 => generated 22557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 04:58:48.642116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:48.642116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:48.644094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.644613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.645427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:48.646308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:48.647137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:48.647725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:49.323836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:49.352343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:49.356473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:49.361856 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d05ea5ae-f7dd-4a18-b9c0-0c41f1aa1fb2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 2540 microversion: 2.32 time: 0.727908 Aug 29 04:58:49.425472 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1081/2192] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:48 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 2540 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:49.425472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:49.425472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:49.425472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:49.425472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:49.425472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:49.425472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:49.431573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:49.431573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:49.480992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:49.610883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:49.630766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:49.637666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:49.641232 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f9562bb1-1e1e-41c5-821b-b6d932d512fa tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1565 microversion: 2.25 time: 1.234146 Aug 29 04:58:49.642029 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1112/2193] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:48 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1565 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:49.653739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b3fea78-ba7d-4a0d-880e-4598c68ef9a0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8a40670>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:49.689986 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-37f23aeb-8bd8-40a2-8608-23c894345990 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 204 len: 0 microversion: 2.1 time: 0.320556 Aug 29 04:58:49.691220 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1082/2194] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:58:49 2022] DELETE /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:58:49.711162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:49.711929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:49.732716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:49.749314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:49.749888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:49.750674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:49.751147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:49.753798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:49.779651 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b3fea78-ba7d-4a0d-880e-4598c68ef9a0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.130356 Aug 29 04:58:49.780859 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1113/2195] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:49 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:49.787188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:49.788086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:49.799415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:49.800396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:49.801256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:49.802411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:49.803097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:49.803742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:50.479267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:50.494203 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f85d2e65-6e9c-47b3-b230-fd640894fe8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1315 microversion: 2.1 time: 0.712041 Aug 29 04:58:50.496424 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1114/2196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:49 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:50.501272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:50.513072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:50.526587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:50.527852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:50.529309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:50.530704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:50.531309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:50.531922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:50.871773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:50.889237 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-432ffdc9-97e1-48eb-bfcb-3e9e09a406d1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1382 microversion: 2.1 time: 1.193861 Aug 29 04:58:50.889870 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1083/2197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:49 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1382 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:50.902781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a785205c-27f2-4865-b2b1-1d5e892f7daf req-322199f7-0816-43b5-9be0-2e1cc5ceac76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-deleted", "tag": "e6173923-7d90-4415-821f-4e432a713b3e"}, {"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-deleted", "tag": "398b88bc-ab6b-4fae-9575-780d3764d159"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:50.936819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a785205c-27f2-4865-b2b1-1d5e892f7daf req-322199f7-0816-43b5-9be0-2e1cc5ceac76 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:50.939058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a785205c-27f2-4865-b2b1-1d5e892f7daf req-322199f7-0816-43b5-9be0-2e1cc5ceac76 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:50.940265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a785205c-27f2-4865-b2b1-1d5e892f7daf req-322199f7-0816-43b5-9be0-2e1cc5ceac76 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:50.966410 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a785205c-27f2-4865-b2b1-1d5e892f7daf req-322199f7-0816-43b5-9be0-2e1cc5ceac76 service nova] Creating event network-vif-deleted:e6173923-7d90-4415-821f-4e432a713b3e for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:50.967715 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a785205c-27f2-4865-b2b1-1d5e892f7daf req-322199f7-0816-43b5-9be0-2e1cc5ceac76 service nova] Creating event network-vif-deleted:398b88bc-ab6b-4fae-9575-780d3764d159 for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:50.981459 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a785205c-27f2-4865-b2b1-1d5e892f7daf req-322199f7-0816-43b5-9be0-2e1cc5ceac76 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087908 Aug 29 04:58:50.986938 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1084/2198] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:51.010211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:51.012245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:51.034762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:51.035544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:51.036307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:51.037531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:51.038444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:51.039751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:51.139533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:51.148265 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-878d8615-a125-4195-8d66-9fedd66475b1 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1470 microversion: 2.1 time: 0.650533 Aug 29 04:58:51.149438 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1115/2199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:50 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1470 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:51.160030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:51.160948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:51.175751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:51.176629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:51.177222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:51.178088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:51.178691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:51.179259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:51.757946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:51.772149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:51.777429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:51.784461 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1d208bec-6a86-4b54-8c4d-2d6c8a1a8323 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1565 microversion: 2.25 time: 0.633598 Aug 29 04:58:51.787438 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1116/2200] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:51 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1565 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:51.798280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fdfe74f2-8b69-44f2-8fb4-e2df2abc4f24 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8b2d700>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:51.889824 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fdfe74f2-8b69-44f2-8fb4-e2df2abc4f24 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.100192 Aug 29 04:58:51.890653 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1117/2201] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:51 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:51.895899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee722254-9744-4eeb-afc1-c1f87b393668 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '.version_select at 0x7f1ab8b475e0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:51.899608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee722254-9744-4eeb-afc1-c1f87b393668 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:51.901202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee722254-9744-4eeb-afc1-c1f87b393668 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:51.901872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee722254-9744-4eeb-afc1-c1f87b393668 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:51.913170 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee722254-9744-4eeb-afc1-c1f87b393668 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1938 microversion: 2.1 time: 0.021058 Aug 29 04:58:51.918296 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1118/2202] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 04:58:51 2022] GET /compute/v2.1/os-migrations => generated 1938 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:51.929625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:51.930721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:51.937529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:51.938346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:51.938996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:51.939929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:51.940637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:51.941271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:52.235347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:52.249409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:52.251051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:52.263654 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bdd4ff83-d5cf-4dfd-9d7d-96c0d2c9f8aa tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 2381 microversion: 2.32 time: 1.263686 Aug 29 04:58:52.280554 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1085/2203] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:50 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 2381 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:52.288731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c3a7bea-6acd-4952-92eb-c654f50802a4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:52.289358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c3a7bea-6acd-4952-92eb-c654f50802a4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:52.304664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c3a7bea-6acd-4952-92eb-c654f50802a4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:52.305201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c3a7bea-6acd-4952-92eb-c654f50802a4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:52.305637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c3a7bea-6acd-4952-92eb-c654f50802a4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:52.306485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c3a7bea-6acd-4952-92eb-c654f50802a4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:52.306950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c3a7bea-6acd-4952-92eb-c654f50802a4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:52.307376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c3a7bea-6acd-4952-92eb-c654f50802a4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.022051 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c3a7bea-6acd-4952-92eb-c654f50802a4 tempest-LiveMigrationTest-168225161 tempest-LiveMigrationTest-168225161-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1533 microversion: 2.1 time: 0.736848 Aug 29 04:58:53.026457 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1086/2204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:52 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1533 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:53.033506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:53.047542 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c3471fdf-f09b-42ea-8b19-db8dfe33ca3a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1315 microversion: 2.1 time: 1.127274 Aug 29 04:58:53.053486 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1119/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:51 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1315 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:53.067941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c784603b-14c5-4ce0-8dd5-bcee907259a4 req-d4816892-a4ae-4f7e-b7e5-afe77c288759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62702580-59ac-4125-ba70-96e4f239dbc3", "name": "network-vif-deleted", "tag": "2a21104d-abfb-4eaa-ba7f-9469f2215d82"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:53.074587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:53.077070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:53.096071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c784603b-14c5-4ce0-8dd5-bcee907259a4 req-d4816892-a4ae-4f7e-b7e5-afe77c288759 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.100036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c784603b-14c5-4ce0-8dd5-bcee907259a4 req-d4816892-a4ae-4f7e-b7e5-afe77c288759 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.103126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.103681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.104160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.104514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c784603b-14c5-4ce0-8dd5-bcee907259a4 req-d4816892-a4ae-4f7e-b7e5-afe77c288759 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.110245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.110720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.111204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.154814 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c784603b-14c5-4ce0-8dd5-bcee907259a4 req-d4816892-a4ae-4f7e-b7e5-afe77c288759 service nova] Creating event network-vif-deleted:2a21104d-abfb-4eaa-ba7f-9469f2215d82 for instance 62702580-59ac-4125-ba70-96e4f239dbc3 on n-h2-854119-9 Aug 29 04:58:53.181389 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c784603b-14c5-4ce0-8dd5-bcee907259a4 req-d4816892-a4ae-4f7e-b7e5-afe77c288759 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122394 Aug 29 04:58:53.182531 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1120/2206] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:53.195492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:53.198915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:53.222853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.223373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.223821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.226842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.227384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.227962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.390749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:53.408309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:53.414037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62ea00a8210b4ede95e54c53e7445794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2864fc0a731f4945a27e68889572000f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:53.415636 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f8220abc-befa-4ff2-9d39-ca2a3c47c6ca tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 200 len: 1523 microversion: 2.25 time: 0.231894 Aug 29 04:58:53.419578 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1121/2207] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:53 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:53.427679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c6e5b0da-47a6-401a-a600-608fa770e59a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8b47550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:53.509343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:53.528231 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60f17eb4-6ea7-45e7-b05d-6b615b75718a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1470 microversion: 2.1 time: 0.493796 Aug 29 04:58:53.529161 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c6e5b0da-47a6-401a-a600-608fa770e59a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.108247 Aug 29 04:58:53.530571 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1087/2208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:53 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1470 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:53.536634 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1122/2209] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:53 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:53.543750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8504f3aa-0190-4c1b-ba0c-392a0de122d9 req-2698fcca-9bb6-4d39-8cd4-ef40ad64fff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7984b96-f6da-4a31-a6ff-548b39c2348d", "tag": "da164b9c-945d-45f8-9d3e-f35187ab9bae"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:53.543917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:53.545062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:53.562472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.562970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.563414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.566465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.567170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.568903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8504f3aa-0190-4c1b-ba0c-392a0de122d9 req-2698fcca-9bb6-4d39-8cd4-ef40ad64fff9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.569661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.570401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8504f3aa-0190-4c1b-ba0c-392a0de122d9 req-2698fcca-9bb6-4d39-8cd4-ef40ad64fff9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.573519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8504f3aa-0190-4c1b-ba0c-392a0de122d9 req-2698fcca-9bb6-4d39-8cd4-ef40ad64fff9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.598545 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8504f3aa-0190-4c1b-ba0c-392a0de122d9 req-2698fcca-9bb6-4d39-8cd4-ef40ad64fff9 service nova] Creating event network-changed:da164b9c-945d-45f8-9d3e-f35187ab9bae for instance f7984b96-f6da-4a31-a6ff-548b39c2348d on n-h2-854119-9 Aug 29 04:58:53.636207 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8504f3aa-0190-4c1b-ba0c-392a0de122d9 req-2698fcca-9bb6-4d39-8cd4-ef40ad64fff9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094222 Aug 29 04:58:53.638820 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1123/2210] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:53.646955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:53.672958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:58:53.679895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:53.695826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.699205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.699739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.702446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.703009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.707012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.864333 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9917c81-aa0b-4c42-baf1-26c81adf8e97 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 204 len: 0 microversion: 2.1 time: 0.332115 Aug 29 04:58:53.864946 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1088/2211] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:58:53 2022] DELETE /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:58:53.882549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:53.904097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:53.905890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:53.907964 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc4e2feb-1891-45a7-b644-c1fcf9f00dc9 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.264715 Aug 29 04:58:53.909042 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1124/2212] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:53 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:53.930203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:53.933276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:53.958114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.960646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.961113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:53.961870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:53.962401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:53.971316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:54.077321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:54.077975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:54.084667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:54.085321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:54.085869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:54.086660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:54.087269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:54.087771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:54.785223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:54.801299 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af9fcf14-dca6-467f-b4a6-e355ade8612d tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1388 microversion: 2.1 time: 0.919180 Aug 29 04:58:54.817077 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1089/2213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:53 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1388 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:54.823597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:54.830190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] [instance: 62702580-59ac-4125-ba70-96e4f239dbc3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:54.848041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:54.848815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:54.849398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:54.850749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:54.851344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:54.852053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:54.882965 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] HTTP exception thrown: Instance 62702580-59ac-4125-ba70-96e4f239dbc3 could not be found. Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Request method failure captured: Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 HTTP/1.1 Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEWmiRulnmh0OC1Rld63FrUg8885ukFAOv7V2-Wshr5SrmJVoBF7xPo71IeJIhxylsCgQrQ4jUACYVdSEHvR9UQeDt5OoDgqkzLEO-gCUd8y60V4RcCRHgslnckwqGDNcK69B9w1Y8OY8KXJsMSvWxmLu_-bGfHvwW7X__660b4vk9M Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2864fc0a731f4945a27e68889572000f Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2864fc0a731f4945a27e68889572000f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2864fc0a731f4945a27e68889572000f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2864fc0a731f4945a27e68889572000f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2864fc0a731f4945a27e68889572000f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2864fc0a731f4945a27e68889572000f Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-98150719 Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-LiveAutoBlockMigrationV225Test-98150719-project Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 62ea00a8210b4ede95e54c53e7445794 Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-98150719-project Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 62702580-59ac-4125-ba70-96e4f239dbc3 could not be found. Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '62702580-59ac-4125-ba70-96e4f239dbc3'} Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62702580-59ac-4125-ba70-96e4f239dbc3 could not be found. Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62702580-59ac-4125-ba70-96e4f239dbc3 could not be found. Aug 29 04:58:54.889639 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:54.892641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:54.892641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:54.892641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:54.892641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:54.892641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:54.892641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:54.892641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:54.892641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62702580-59ac-4125-ba70-96e4f239dbc3 could not be found. Aug 29 04:58:54.892641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:54.897647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] Returning 404 to user: Instance 62702580-59ac-4125-ba70-96e4f239dbc3 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:54.898813 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ebf1a97d-42a6-4892-952e-b01c8d88a012 tempest-LiveAutoBlockMigrationV225Test-98150719 tempest-LiveAutoBlockMigrationV225Test-98150719-project] 10.222.0.20 "GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3" status: 404 len: 111 microversion: 2.25 time: 0.080168 Aug 29 04:58:54.905668 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1090/2214] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:54 2022] GET /compute/v2.1/servers/62702580-59ac-4125-ba70-96e4f239dbc3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:58:54.911814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-726f0700-752d-4b85-8b84-b725a700ecef tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9d7ce50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:54.992359 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-726f0700-752d-4b85-8b84-b725a700ecef tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.085278 Aug 29 04:58:54.993576 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1091/2215] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:54 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:55.000748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:55.004374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:55.014438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:55.015263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:55.015919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:55.017096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:55.017748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:55.018380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:55.089660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:55.090889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:55.091856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:55.095994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lazy-loading 'fault' on Instance uuid cf611f75-4724-49dd-8de7-7c7ac0c1784c {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:58:55.341526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:55.364562 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b3002f5-f05b-453e-8fd1-0f80c98e4e39 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1315 microversion: 2.1 time: 1.288545 Aug 29 04:58:55.369824 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1125/2216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:54 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1315 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:55.393808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:55.394464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:55.436707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:55.437198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:55.452617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:55.458831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:55.459449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:55.459900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:55.572262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:55.611222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9d19d7439040d88387d4d5be2e3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba34657d53f486e998548eeb8808579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:55.625048 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1f3958b1-3206-4028-b2d3-626a9ceffd70 tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 200 len: 1304 microversion: 2.1 time: 0.625173 Aug 29 04:58:55.625815 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1092/2217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:54 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 1304 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:55.656703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7dca07ce-207f-4548-a582-64e1886619f0 req-99d6b8fd-ad9f-439d-960c-4c091b8d5916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf611f75-4724-49dd-8de7-7c7ac0c1784c", "name": "network-vif-deleted", "tag": "39a3f592-7bb2-47e2-a2fb-0014a7345377"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:55.703672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:55.709313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7dca07ce-207f-4548-a582-64e1886619f0 req-99d6b8fd-ad9f-439d-960c-4c091b8d5916 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:55.709802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7dca07ce-207f-4548-a582-64e1886619f0 req-99d6b8fd-ad9f-439d-960c-4c091b8d5916 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:55.718194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7dca07ce-207f-4548-a582-64e1886619f0 req-99d6b8fd-ad9f-439d-960c-4c091b8d5916 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:55.765860 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7dca07ce-207f-4548-a582-64e1886619f0 req-99d6b8fd-ad9f-439d-960c-4c091b8d5916 service nova] Creating event network-vif-deleted:39a3f592-7bb2-47e2-a2fb-0014a7345377 for instance cf611f75-4724-49dd-8de7-7c7ac0c1784c on n-h1-854119-9 Aug 29 04:58:55.776272 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7dca07ce-207f-4548-a582-64e1886619f0 req-99d6b8fd-ad9f-439d-960c-4c091b8d5916 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144475 Aug 29 04:58:55.798233 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1093/2218] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:55.805197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-09bccac6-3c64-4ca8-baf3-624fd42e0197 req-1b1d819f-cb33-4518-97bb-64a51b66a10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f35fea-40dd-43e9-9bf5-58c622aaefcf", "name": "network-vif-deleted", "tag": "9da0fa16-4ab8-435c-abe2-442d313636cf"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:55.821580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-09bccac6-3c64-4ca8-baf3-624fd42e0197 req-1b1d819f-cb33-4518-97bb-64a51b66a10a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:55.824453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-09bccac6-3c64-4ca8-baf3-624fd42e0197 req-1b1d819f-cb33-4518-97bb-64a51b66a10a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:55.825138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-09bccac6-3c64-4ca8-baf3-624fd42e0197 req-1b1d819f-cb33-4518-97bb-64a51b66a10a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:55.861922 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-09bccac6-3c64-4ca8-baf3-624fd42e0197 req-1b1d819f-cb33-4518-97bb-64a51b66a10a service nova] Creating event network-vif-deleted:9da0fa16-4ab8-435c-abe2-442d313636cf for instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf on n-h1-854119-9 Aug 29 04:58:55.903544 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-09bccac6-3c64-4ca8-baf3-624fd42e0197 req-1b1d819f-cb33-4518-97bb-64a51b66a10a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102833 Aug 29 04:58:55.905200 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1094/2219] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:55.912567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:55.913656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:55.922634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:55.923245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:55.923901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:55.924711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:55.926030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:55.926030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:56.010863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:56.024482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:56.026022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:56.037640 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da326af5-5cdb-4231-a817-36f3c2c7ae8a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.654573 Aug 29 04:58:56.038699 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1126/2220] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:55 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:56.046302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9fbd2862-3893-41e3-a69a-5130b843e289 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8aec670>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:56.157296 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9fbd2862-3893-41e3-a69a-5130b843e289 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.117250 Aug 29 04:58:56.159131 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1127/2221] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:56 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:56.394374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:56.395830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:56.412264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:56.414267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:56.415938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:56.417345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:56.419476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:56.422428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:56.777469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:56.787617 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d729a929-ea01-4ca3-8e84-ef997bc9efb1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1388 microversion: 2.1 time: 0.880509 Aug 29 04:58:56.793479 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1095/2222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:55 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1388 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:56.808031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:56.809319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] [instance: cf611f75-4724-49dd-8de7-7c7ac0c1784c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:56.820142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:56.820870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:56.822056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:56.822920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:56.826557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:56.827191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:56.857520 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] HTTP exception thrown: Instance cf611f75-4724-49dd-8de7-7c7ac0c1784c could not be found. Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Request method failure captured: Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c HTTP/1.1 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEdvTBxPz3EH7zTheKQnUA-4orQpf2Q_2cobyDHW7rCpoF2q_pml09jkSC1xWiqaZWGJf6V5MkSr8dTmtZsA1KIpQEFMnLWSCwI9P6Qf8HHeOvQtDwZwvjxMJp6AILQ5zmmDtNf46tyy_fkbOvkeUjXmowL7Fdld1RBAE9QNVtcPyWE Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: bba34657d53f486e998548eeb8808579 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TenantUsagesTestJSON-2043003662 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bba34657d53f486e998548eeb8808579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bba34657d53f486e998548eeb8808579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bba34657d53f486e998548eeb8808579", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bba34657d53f486e998548eeb8808579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TenantUsagesTestJSON-2043003662 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: bba34657d53f486e998548eeb8808579 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2043003662 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TenantUsagesTestJSON-2043003662-project Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: dd9d19d7439040d88387d4d5be2e3e20 Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TenantUsagesTestJSON-2043003662-project Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance cf611f75-4724-49dd-8de7-7c7ac0c1784c could not be found. Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'cf611f75-4724-49dd-8de7-7c7ac0c1784c'} Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf611f75-4724-49dd-8de7-7c7ac0c1784c could not be found. Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf611f75-4724-49dd-8de7-7c7ac0c1784c could not be found. Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:58:56.861767 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:56.865741 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:58:56.865741 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:58:56.865741 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:58:56.865741 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:58:56.865741 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:58:56.865741 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf611f75-4724-49dd-8de7-7c7ac0c1784c could not be found. Aug 29 04:58:56.865741 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:58:56.869306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] Returning 404 to user: Instance cf611f75-4724-49dd-8de7-7c7ac0c1784c could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:58:56.874792 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71bcb3d1-a41d-4347-80ae-febe461dff6a tempest-TenantUsagesTestJSON-2043003662 tempest-TenantUsagesTestJSON-2043003662-project] 10.222.0.20 "GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c" status: 404 len: 111 microversion: 2.1 time: 0.080063 Aug 29 04:58:56.875569 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1096/2223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:56 2022] GET /compute/v2.1/servers/cf611f75-4724-49dd-8de7-7c7ac0c1784c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:58:57.066252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:57.067371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:57.080994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:57.087155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:57.088756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:57.089881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:57.095142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:57.103422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:57.118236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:57.691976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:57.716063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:57.720775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:57.727631 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b652f46e-2784-4e18-bc5d-634eadc7065d tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.666069 Aug 29 04:58:57.731476 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1097/2224] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:57 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:58:57.753134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-db6eccc5-1b66-49b1-a7b9-d11e8488d25d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9bfc8b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:57.879215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-db6eccc5-1b66-49b1-a7b9-d11e8488d25d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.145622 Aug 29 04:58:57.879880 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1098/2225] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:57 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:57.887894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:57.903591 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1d58522-9a23-424d-9d3e-b213be0f5bc9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1315 microversion: 2.1 time: 1.516247 Aug 29 04:58:57.907005 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1128/2226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:56 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1315 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:57.927628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:57.930787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:57.956329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:57.956835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:57.961802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:57.962697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:57.963182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:57.963622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:58.042728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-52ee9dbd-58e9-45a1-9ecc-231e22e3cd87 req-b5c29c7e-0841-409d-94c0-0d6c0286b38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7984b96-f6da-4a31-a6ff-548b39c2348d", "name": "network-vif-plugged", "status": "completed", "tag": "da164b9c-945d-45f8-9d3e-f35187ab9bae"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:58.088953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-52ee9dbd-58e9-45a1-9ecc-231e22e3cd87 req-b5c29c7e-0841-409d-94c0-0d6c0286b38b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:58.094226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-52ee9dbd-58e9-45a1-9ecc-231e22e3cd87 req-b5c29c7e-0841-409d-94c0-0d6c0286b38b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:58.094772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-52ee9dbd-58e9-45a1-9ecc-231e22e3cd87 req-b5c29c7e-0841-409d-94c0-0d6c0286b38b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:58.141797 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-52ee9dbd-58e9-45a1-9ecc-231e22e3cd87 req-b5c29c7e-0841-409d-94c0-0d6c0286b38b service nova] Creating event network-vif-plugged:da164b9c-945d-45f8-9d3e-f35187ab9bae for instance f7984b96-f6da-4a31-a6ff-548b39c2348d on n-h2-854119-9 Aug 29 04:58:58.160895 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-52ee9dbd-58e9-45a1-9ecc-231e22e3cd87 req-b5c29c7e-0841-409d-94c0-0d6c0286b38b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126724 Aug 29 04:58:58.174364 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1129/2227] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:58.194317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9a4b6a97-0d7f-4a21-9796-463c8593d40c req-e7a1e179-17df-442a-a995-4c17231a50d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5f9e23-6688-4b92-ba5e-844e4ba6d72d", "name": "network-vif-deleted", "tag": "5148f8dc-bb11-451d-b354-b31019213845"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:58:58.202771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:58.213231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9a4b6a97-0d7f-4a21-9796-463c8593d40c req-e7a1e179-17df-442a-a995-4c17231a50d0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:58.214298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9a4b6a97-0d7f-4a21-9796-463c8593d40c req-e7a1e179-17df-442a-a995-4c17231a50d0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:58.214867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9a4b6a97-0d7f-4a21-9796-463c8593d40c req-e7a1e179-17df-442a-a995-4c17231a50d0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:58.227202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:58.229652 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9a4b6a97-0d7f-4a21-9796-463c8593d40c req-e7a1e179-17df-442a-a995-4c17231a50d0 service nova] Creating event network-vif-deleted:5148f8dc-bb11-451d-b354-b31019213845 for instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d on n-h1-854119-9 Aug 29 04:58:58.235056 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9a4b6a97-0d7f-4a21-9796-463c8593d40c req-e7a1e179-17df-442a-a995-4c17231a50d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057781 Aug 29 04:58:58.236249 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1130/2228] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:58:58.285858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:58.308714 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4bc35a73-bfb6-4d15-86fd-208e9f15501c tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1346 microversion: 2.1 time: 0.418171 Aug 29 04:58:58.321840 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1099/2229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:57 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1346 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:58.759915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:58.761061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:58.779735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:58.780739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:58.781383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:58.782306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:58.782987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:58.783607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:58.905987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe50c2dd-0316-49c8-b832-8e309e5543ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd8473a0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:58.918992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:58:58.981856 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fe50c2dd-0316-49c8-b832-8e309e5543ae tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.092095 Aug 29 04:58:58.984697 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1100/2230] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:58 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:58:58.995095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:58.995709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:59.016567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:59.017060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:59.017493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:59.018202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:59.018653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:59.019072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:59.071104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:59.093278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:59.095143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:59.096493 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a83a8f96-7695-45ec-bb76-077b82762269 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.343020 Aug 29 04:58:59.097558 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1131/2231] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:58:58 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:58:59.331862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:58:59.332615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:58:59.358174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:59.358785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:59.359623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:59.360463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:58:59.361026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:58:59.361689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:58:59.448353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:59.467292 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-276c4b2f-90d2-47e3-9649-966636efe87e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1315 microversion: 2.1 time: 0.479952 Aug 29 04:58:59.472952 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1101/2232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:58 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:58:59.564501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:58:59.573484 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4463487b-e8ce-4695-ad54-ae617f316df8 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.247737 Aug 29 04:58:59.576851 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1132/2233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:58:59 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:00.001053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9d90c28f-132a-42d3-ab5d-326328e8103e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9d98ca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:00.084499 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9d90c28f-132a-42d3-ab5d-326328e8103e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.089328 Aug 29 04:59:00.094434 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1102/2234] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:58:59 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:00.208715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:00.209976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:00.228415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:00.229107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:00.229860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:00.230833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:00.231796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:00.232463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:00.493251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:00.494198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:00.511588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:00.518807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:00.529271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:00.538384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:00.539196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:00.539861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:00.607445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:00.622586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:00.626900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:00.629561 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-20fd3b71-e653-40ae-9c95-5e8c75c77cbb tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.429425 Aug 29 04:59:00.636059 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1133/2235] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:00 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:59:00.646171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:00.647126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:00.658185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:00.661882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:00.662632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:00.663608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:00.666486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:00.667167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:00.850544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:00.861115 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0f457ff9-6a00-459f-9236-b51efbb6f91f tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.223382 Aug 29 04:59:00.862324 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1134/2236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:00 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:01.032087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:01.041944 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-91fd5766-a2f8-41c6-95ce-3c30ddc88173 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1315 microversion: 2.1 time: 0.553158 Aug 29 04:59:01.046762 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1103/2237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:00 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:01.101103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9845aee6-b035-4a04-98fc-c8f1a346f662 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8ba1790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:01.173529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9845aee6-b035-4a04-98fc-c8f1a346f662 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.077065 Aug 29 04:59:01.174646 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1135/2238] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:01 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:01.666129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:01.667837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:01.686006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:01.687349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:01.689315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:01.690202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:01.693465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:01.694061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:01.887383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:01.888680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:01.908893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:01.909620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:01.912962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:01.920358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:01.921881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:01.924917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:01.993128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:02.018496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:02.020717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:02.025830 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb5d39fe-0e58-40f3-913b-5b6ba9a08c9e tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.365161 Aug 29 04:59:02.026956 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1104/2239] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:01 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:02.072623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:02.073956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:02.090014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:02.098534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:02.099385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:02.101053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:02.105662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:02.108610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:02.178938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:02.197996 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-50418119-923d-4703-9388-dad38e077233 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.318601 Aug 29 04:59:02.201566 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1136/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:01 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:02.216704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-576e0569-5ee1-4538-9bef-a11281d2b82b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8b47040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:02.347439 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-576e0569-5ee1-4538-9bef-a11281d2b82b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.143638 Aug 29 04:59:02.357008 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1137/2241] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:02 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:02.383124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6bfe76b7-3165-410e-8696-532da5c4021d req-fa6160fc-d717-4b6c-a144-2c26de46fd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7984b96-f6da-4a31-a6ff-548b39c2348d", "name": "network-vif-deleted", "tag": "da164b9c-945d-45f8-9d3e-f35187ab9bae"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:02.438082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6bfe76b7-3165-410e-8696-532da5c4021d req-fa6160fc-d717-4b6c-a144-2c26de46fd6d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:02.441294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6bfe76b7-3165-410e-8696-532da5c4021d req-fa6160fc-d717-4b6c-a144-2c26de46fd6d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:02.447300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6bfe76b7-3165-410e-8696-532da5c4021d req-fa6160fc-d717-4b6c-a144-2c26de46fd6d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:02.502366 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6bfe76b7-3165-410e-8696-532da5c4021d req-fa6160fc-d717-4b6c-a144-2c26de46fd6d service nova] Creating event network-vif-deleted:da164b9c-945d-45f8-9d3e-f35187ab9bae for instance f7984b96-f6da-4a31-a6ff-548b39c2348d on n-h2-854119-9 Aug 29 04:59:02.516402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:02.535207 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7272a15b-2d50-4998-9d2e-8e52cc1de665 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1273 microversion: 2.1 time: 0.468582 Aug 29 04:59:02.540798 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6bfe76b7-3165-410e-8696-532da5c4021d req-fa6160fc-d717-4b6c-a144-2c26de46fd6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178525 Aug 29 04:59:02.541493 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1138/2242] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:02.563189 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1105/2243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:02 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1273 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:03.058263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:03.058973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:03.083618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:03.085153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:03.086191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:03.087336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:03.095590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:03.096606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:03.222304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:03.222927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:03.243782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:03.244300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:03.246544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:03.247282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:03.247808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:03.248259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:03.493381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:03.506917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:03.516783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:03.521584 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4af69e58-179e-4e4f-866a-ca2de1b21f32 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.468822 Aug 29 04:59:03.528483 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1139/2244] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:03 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:03.649344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:03.659294 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a155b707-84d4-4157-96a2-48d764621910 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.441684 Aug 29 04:59:03.674811 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1106/2245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:03 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:03.688560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-071b6bda-2df4-4648-b566-ec97f95dcef4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9cf9e50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:03.801457 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-071b6bda-2df4-4648-b566-ec97f95dcef4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.125233 Aug 29 04:59:03.802266 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1107/2246] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:03 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:03.813037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:03.814517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:03.844395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:03.848585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:03.863861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5e88744-29da-4685-8b14-e8aae09b8104 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Calling method '.version_select at 0x7f1abd89b8b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:03.877029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:03.881494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e88744-29da-4685-8b14-e8aae09b8104 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:03.882737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e88744-29da-4685-8b14-e8aae09b8104 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:03.883409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e88744-29da-4685-8b14-e8aae09b8104 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:03.884685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e88744-29da-4685-8b14-e8aae09b8104 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:03.885411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e88744-29da-4685-8b14-e8aae09b8104 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:03.886097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e88744-29da-4685-8b14-e8aae09b8104 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:03.886814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:03.887322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:03.887763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:03.935197 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5e88744-29da-4685-8b14-e8aae09b8104 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.405333 Aug 29 04:59:03.937438 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1140/2247] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 04:59:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:04.027994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7ed74bd-1069-402d-bfcf-53e84564c5d8 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-549710946", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:04.121368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-e7ed74bd-1069-402d-bfcf-53e84564c5d8 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:59:04.620310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:04.643788 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c4ab3d4-2b53-4756-8e54-48c77e917197 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1294 microversion: 2.1 time: 0.840293 Aug 29 04:59:04.644976 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1108/2248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:03 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1294 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:04.662243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:04.663069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:04.679591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:04.683774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:04.684586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:04.686957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:04.688506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:04.690794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:05.112288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:05.146530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:05.152095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:05.155159 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1a6676c-b3cd-485f-82a1-d36b7ff1210c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.506429 Aug 29 04:59:05.155951 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1109/2249] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:04 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:05.164033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:05.171465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:05.178905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:05.179820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:05.195307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:05.196838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:05.197334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:05.197777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:05.257023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e7ed74bd-1069-402d-bfcf-53e84564c5d8 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Getting quotas for project 710980594bbf4c01a0e6398a19211b6f. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:59:05.285720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e7ed74bd-1069-402d-bfcf-53e84564c5d8 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Getting quotas for user 4c630553798d4898b41a1438a9745302 and project 710980594bbf4c01a0e6398a19211b6f. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:59:05.348694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:05.358884 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1a89eee1-da44-4c0b-94a1-a4f843f6f704 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.201468 Aug 29 04:59:05.359578 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-e7ed74bd-1069-402d-bfcf-53e84564c5d8 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 29 04:59:05.360424 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1110/2250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:05 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7ed74bd-1069-402d-bfcf-53e84564c5d8 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Request method failure captured: Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 1751 Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEeXMspa_w4FS3KiPTIUznUxpVO9bOiTHzUrrF4cWILpkWZx3vVxyaVk_sj1ss9QgC981RaFAKzg3zqf5avvBXZAVh0bXgI0lFrMNWI5iyPBHw3objbfVe43Ksld4bBIcNtnZBf1E9FrxAnMqC5xmLcxTG8amfX-DvRoks7PTEpnyLc Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 710980594bbf4c01a0e6398a19211b6f Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-663247638 Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/710980594bbf4c01a0e6398a19211b6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/710980594bbf4c01a0e6398a19211b6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_710980594bbf4c01a0e6398a19211b6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/710980594bbf4c01a0e6398a19211b6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-663247638 Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 710980594bbf4c01a0e6398a19211b6f Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-663247638 Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-663247638-project Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4c630553798d4898b41a1438a9745302 Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-663247638-project Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-549710946", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:59:05.366587 n-d-854119-9 devstack@n-api.service[128872]: exception: Maximum number of metadata items exceeds 128 Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-549710946', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:59:05.368599 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7ed74bd-1069-402d-bfcf-53e84564c5d8 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:05.371103 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7ed74bd-1069-402d-bfcf-53e84564c5d8 tempest-AbsoluteLimitsNegativeTestJSON-663247638 tempest-AbsoluteLimitsNegativeTestJSON-663247638-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.348686 Aug 29 04:59:05.384597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd3c8559-8d01-4491-aff9-04d32b58c034 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9796ca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:05.415713 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1141/2251] 10.222.0.20 () {60 vars in 1148 bytes} [Mon Aug 29 04:59:04 2022] POST /compute/v2.1/servers => generated 87 bytes in 1396 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 29 04:59:05.474748 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd3c8559-8d01-4491-aff9-04d32b58c034 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.098065 Aug 29 04:59:05.477937 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1111/2252] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:05 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:05.667709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:05.668402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:05.689662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:05.690415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:05.690987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:05.693657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:05.694291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:05.695680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:05.923810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:05.936599 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6f628927-d5bd-476c-8cfe-bdc8f9f21d4c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1294 microversion: 2.1 time: 0.274101 Aug 29 04:59:05.938175 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1142/2253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:05 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1294 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:06.182300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:06.183483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:06.201532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:06.204686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:06.205527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:06.208969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:06.210799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:06.211443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:06.385064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:06.385810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:06.404873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:06.405593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:06.407128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:06.409247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:06.410808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:06.412513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:06.531816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:06.557560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:06.567752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:06.571346 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc7b6eed-3ff0-4210-aa2d-2fbe3e74d794 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.393148 Aug 29 04:59:06.575010 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1112/2254] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:06 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:06.582567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff08b446-db74-4557-bbcd-a51206fed3b0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9dd6dc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:06.693771 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff08b446-db74-4557-bbcd-a51206fed3b0 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.114909 Aug 29 04:59:06.697072 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1113/2255] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:06 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:06.716065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:06.727501 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0fca88c5-9c62-474c-8701-96ca124c86b2 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.350686 Aug 29 04:59:06.734393 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1143/2256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:06 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:06.968555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:06.969537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:06.983296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:06.985525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:06.986201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:06.987664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:06.988997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:06.991856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:07.045462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:07.046452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:07.047243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:07.047912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lazy-loading 'fault' on Instance uuid f7984b96-f6da-4a31-a6ff-548b39c2348d {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:59:07.148068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:07.165489 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-78ab6591-3cc4-4897-b13c-8cc69628b4a0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 200 len: 1305 microversion: 2.1 time: 0.208148 Aug 29 04:59:07.181048 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1114/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:06 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 1305 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:07.604837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:07.606473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:07.625635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:07.626873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:07.627532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:07.633843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:07.635120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:07.639229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:07.711677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-53b19a56-12be-4be9-8d05-580e51c6ea0b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9796ca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:07.773210 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-53b19a56-12be-4be9-8d05-580e51c6ea0b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.065788 Aug 29 04:59:07.783913 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1115/2258] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:07 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:07.843287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:07.843949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:07.866425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:07.882302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:07.882904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:07.883338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:07.888327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:07.889154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:07.894603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:07.895387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:07.898997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:07.901651 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb1e0b86-0967-4e6b-bf26-e2c497a29033 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.302184 Aug 29 04:59:07.930177 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1144/2259] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:07 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:08.093696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:08.102925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a6b097f4-d904-47ce-a5be-4dc36311cd0a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.295316 Aug 29 04:59:08.119831 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1116/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:07 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:08.193486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:08.201785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:08.221637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:08.222143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:08.226569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:08.228091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:08.232792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:08.233265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:08.251447 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d HTTP/1.1 Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'f7984b96-f6da-4a31-a6ff-548b39c2348d'} Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:08.253100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-306a25e2-ce3b-4a2a-b43a-80d6fade3a9c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 404 len: 111 microversion: 2.1 time: 0.071307 Aug 29 04:59:08.256235 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1145/2261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:08 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:59:08.549944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1599685665", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "57e28866-1c32-4826-b8f3-b2fdc024be39"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:08.753935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] validate_networks() for [('57e28866-1c32-4826-b8f3-b2fdc024be39', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:59:08.802593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-03b09ddc-f3a1-4e06-8399-aad5c3563694 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd87aca0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:08.928672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-03b09ddc-f3a1-4e06-8399-aad5c3563694 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.134809 Aug 29 04:59:08.944464 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1146/2262] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:08 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:08.950322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:08.951346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:08.971837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:08.973073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:08.977555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:08.984797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:08.987452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:08.988145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:09.272375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:09.297036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:09.298852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:09.300095 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1bd8f398-fdfe-4f6c-a3fa-803e1b5d5d8f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.354265 Aug 29 04:59:09.300920 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1147/2263] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:08 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:09.324436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:09.331244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:09.355216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:09.355713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:09.356180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:09.367139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:09.367729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:09.368910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:09.621615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:09.637660 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf369227-9ed2-4278-be7d-2e8131dbafa4 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.335409 Aug 29 04:59:09.639906 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1148/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:09 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:09.953924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2cf37f6d-3ed7-45aa-b30b-b949dd849aa1 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd7f0790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:10.062049 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2cf37f6d-3ed7-45aa-b30b-b949dd849aa1 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.114154 Aug 29 04:59:10.062946 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1149/2265] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:09 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:10.347542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:10.348194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:10.358506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:10.360696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:10.365667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:10.366795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:10.367443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:10.368008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:10.678023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:10.692914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:59:10.693421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:59:10.694139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:59:10.694266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:10.694844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:59:10.695443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:59:10.698606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:10.700155 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-92926a73-e6c6-481e-9bb1-38791675a13c tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.358098 Aug 29 04:59:10.705627 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1150/2266] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:10 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:59:10.711075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:10.716599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:10.720961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:10.725074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:10.727112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:10.728770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:10.729263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:10.729700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:10.731818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:10.735243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:10.737859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:10.738794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:10.739429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:10.751585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:10.822451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:59:10.837438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for user 4d3aaab47eb243c6bf9a0b2e512e7c4a and project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:59:10.873183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:59:10.882856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:59:10.887671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:10.902512 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71cf086d-893c-4965-86e8-ce7ff84e8160 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.195220 Aug 29 04:59:10.912676 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1151/2267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:10 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:11.113215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9018b132-0b92-4666-ad01-e078df3f6942 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.567656 Aug 29 04:59:11.116043 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1117/2268] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:59:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:59:11.140609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ca8d2821-fd67-4030-bb55-464db3ed5236 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9de80d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:11.270996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5d70e362-7c59-4ed1-ba4c-981116b1a894 tempest-FlavorsV2NegativeTest-368788028 tempest-FlavorsV2NegativeTest-368788028-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:11.296045 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5d70e362-7c59-4ed1-ba4c-981116b1a894 tempest-FlavorsV2NegativeTest-368788028 tempest-FlavorsV2NegativeTest-368788028-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.369511 Aug 29 04:59:11.296251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ca8d2821-fd67-4030-bb55-464db3ed5236 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.178342 Aug 29 04:59:11.296849 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1118/2269] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:11 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:11.303923 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1152/2270] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 04:59:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:11.317128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a2db37e-18d6-4612-929d-712d95fe07e4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:11.335417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a2db37e-18d6-4612-929d-712d95fe07e4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:11.730864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:11.731966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:11.755296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:11.755828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:11.761292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:11.763278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:11.767245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:11.768758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:11.769324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5a2db37e-18d6-4612-929d-712d95fe07e4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:11.777844 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a2db37e-18d6-4612-929d-712d95fe07e4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1215 microversion: 2.1 time: 0.473159 Aug 29 04:59:11.801335 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1153/2271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:11 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1215 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:11.925547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:11.926166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:11.949969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:11.950480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:11.951243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:11.951968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:11.952452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:11.952879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:12.246893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:12.256904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:12.258326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:12.259569 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c78b0c8f-1768-4d5a-a024-f6613b6fd008 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.533695 Aug 29 04:59:12.273864 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1119/2272] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:11 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 04:59:12.312762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3386719a-5c08-45d6-a91d-74b06c358e34 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9e5fc10>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:12.330835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:12.353894 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a70fbcda-af38-4d76-84f4-f2e64a5e5703 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 200 len: 1184 microversion: 2.1 time: 0.432132 Aug 29 04:59:12.354490 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1154/2273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:11 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 1184 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:12.805294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:12.806495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:12.867877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:12.868729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:12.869893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:12.870928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:12.871768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:12.872385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:12.984722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:12.999999 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-62cf9e5c-21c8-4b9d-b07c-8ff3ce4319f9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1267 microversion: 2.1 time: 0.200022 Aug 29 04:59:13.001317 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1155/2274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:12 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:13.186784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f38de3d-8d88-40cf-97a4-91eb6b904304 tempest-FlavorsV2NegativeTest-368788028 tempest-FlavorsV2NegativeTest-368788028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-419559650", "imageRef": "96044cb9-c2b5-459d-a5a6-54daf5f7fdff", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:13.222940 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3386719a-5c08-45d6-a91d-74b06c358e34 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1411 microversion: 2.1 time: 0.914562 Aug 29 04:59:13.223548 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1120/2275] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:12 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1411 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:13.302757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:13.304423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:13.333717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:13.349670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:13.351627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:13.354121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:13.357452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:13.360214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:13.372272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-9f38de3d-8d88-40cf-97a4-91eb6b904304 tempest-FlavorsV2NegativeTest-368788028 tempest-FlavorsV2NegativeTest-368788028-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:59:13.786836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:13.807535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:13.809816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:13.813450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-882cd207-5227-4190-aa4e-cd14e4175890 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.515215 Aug 29 04:59:13.814554 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1121/2276] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:13 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:13.826674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:13.827592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:13.841402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:13.842268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:13.843357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:13.844385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:13.845531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:13.846148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:13.869492 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] HTTP exception thrown: Instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d could not be found. Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Request method failure captured: Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d HTTP/1.1 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXYR5twN_s37bXZ0eeliQvNreduYAJW88vypFFx7lC2pDMiC_8rXaOrKOyUxl0nAXZAb1z0fnUCrZYtKkyMz-vqBN8ulL9W7bwSX6rzTF2601pYMRoEYTw8ZOYno4RfPMOp3gzjuhszaFKe4fKwpKtoTJYm7vzwQ8iMNT_RgIz2zJw Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: bb84e6fe60b3405382ebd2c54aa67908 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-LiveMigrationTest-349516559 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb84e6fe60b3405382ebd2c54aa67908", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-LiveMigrationTest-349516559 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: bb84e6fe60b3405382ebd2c54aa67908 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-LiveMigrationTest-349516559 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-LiveMigrationTest-349516559-project Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: f5a5756b12204e9f9fbd7a2f3c5e1749 Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-LiveMigrationTest-349516559-project Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d could not be found. Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '4c5f9e23-6688-4b92-ba5e-844e4ba6d72d'} Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d could not be found. Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d could not be found. Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:13.871695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:13.874869 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:13.874869 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:13.874869 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:13.874869 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:13.874869 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:13.874869 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d could not be found. Aug 29 04:59:13.874869 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:13.877321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Returning 404 to user: Instance 4c5f9e23-6688-4b92-ba5e-844e4ba6d72d could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:13.878899 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-91fb2575-c33b-4729-9c19-a2345f67d286 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d" status: 404 len: 111 microversion: 2.1 time: 0.063195 Aug 29 04:59:13.880509 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1122/2277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:13 2022] GET /compute/v2.1/servers/4c5f9e23-6688-4b92-ba5e-844e4ba6d72d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:59:13.924056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:14.022457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:14.023097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:14.032443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:14.032949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:14.033400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:14.034120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:14.034581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:14.035012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:14.257665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:14.261242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:14.274056 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4a3efcf5-dafc-43c1-b419-663eaa50815d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1273 microversion: 2.1 time: 0.252491 Aug 29 04:59:14.276921 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1123/2278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:14 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:14.284916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9c552c55-58e2-43e7-93e0-ec0727ea5b5d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab97eac10>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:14.383380 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9c552c55-58e2-43e7-93e0-ec0727ea5b5d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1420 microversion: 2.1 time: 0.105323 Aug 29 04:59:14.384510 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1124/2279] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:14 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:14.401997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24298483-8fb8-4b6f-99cf-83ef0d967a27 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9bfc0d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:14.466393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-24298483-8fb8-4b6f-99cf-83ef0d967a27 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 200 len: 1420 microversion: 2.1 time: 0.072632 Aug 29 04:59:14.467408 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1125/2280] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:14 2022] GET /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:14.484251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d6c979c-0b10-4990-8014-999aeccd68e7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9718310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:15.078755 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-9f38de3d-8d88-40cf-97a4-91eb6b904304 tempest-FlavorsV2NegativeTest-368788028 tempest-FlavorsV2NegativeTest-368788028-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f38de3d-8d88-40cf-97a4-91eb6b904304 tempest-FlavorsV2NegativeTest-368788028 tempest-FlavorsV2NegativeTest-368788028-project] Request method failure captured: Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 142 Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEeebTMU2K4uCIYPONYnHBd3Cj-J-8MjsTbsmtw2jHonbVwaez9NCCxl16LjA2LegLpa4jAxVLNeY1zeRvmrll2TN-2RSnJX9IGuJM5kXzvx5LZLbLyJ2FWf4g8TJyRIh1yq4K396ymo_PFnKGanTAQuigA_ZOLsZ9iu75V7h3IF-JQ Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3052c089025f4e10bcc38d9f49830b69 Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FlavorsV2NegativeTest-368788028 Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3052c089025f4e10bcc38d9f49830b69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3052c089025f4e10bcc38d9f49830b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3052c089025f4e10bcc38d9f49830b69", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3052c089025f4e10bcc38d9f49830b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FlavorsV2NegativeTest-368788028 Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3052c089025f4e10bcc38d9f49830b69 Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-368788028 Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FlavorsV2NegativeTest-368788028-project Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 15295c8c947d4430b87e7d90f17cdbac Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FlavorsV2NegativeTest-368788028-project Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-419559650", "imageRef": "96044cb9-c2b5-459d-a5a6-54daf5f7fdff", "flavorRef": "452"}} Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: exception: Flavor's memory is too small for requested image. Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-419559650', 'imageRef': '96044cb9-c2b5-459d-a5a6-54daf5f7fdff', 'flavorRef': '452'}}} Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:59:15.099635 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f38de3d-8d88-40cf-97a4-91eb6b904304 tempest-FlavorsV2NegativeTest-368788028 tempest-FlavorsV2NegativeTest-368788028-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:15.104000 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f38de3d-8d88-40cf-97a4-91eb6b904304 tempest-FlavorsV2NegativeTest-368788028 tempest-FlavorsV2NegativeTest-368788028-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.921676 Aug 29 04:59:15.106211 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1156/2281] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:59:13 2022] POST /compute/v2.1/servers => generated 93 bytes in 1925 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:59:15.119572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:15.125259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:15.135586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:15.136193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:15.136760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:15.138725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:15.140395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:15.140986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:15.245473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:15.288604 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d6c979c-0b10-4990-8014-999aeccd68e7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 204 len: 0 microversion: 2.1 time: 0.809613 Aug 29 04:59:15.289883 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1126/2282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:14 2022] DELETE /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 0 bytes in 814 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:59:15.296703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:15.297476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:15.311131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:15.311983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:15.312632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:15.313535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:15.314171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:15.317137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:16.241473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:16.257354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:16.258879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:16.260137 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69580ddb-d4c4-4b51-9eb5-fe239ea4c0be tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 1.153015 Aug 29 04:59:16.262892 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1157/2283] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:15 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:16.294131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:16.302109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:16.302617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:16.308102 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0046a88c-eeb9-46f3-b999-7cae002b52c2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1273 microversion: 2.1 time: 1.015114 Aug 29 04:59:16.308725 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1127/2284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:15 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1273 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:16.353008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:16.353514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:16.353956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:16.354687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:16.355438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:16.355539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:16.395280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:59:16.569788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:16.582899 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8d10f9ab-27a6-4d1d-9e67-beaa490f08d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 204 len: 0 microversion: 2.1 time: 0.303661 Aug 29 04:59:16.583628 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1158/2285] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:59:16 2022] DELETE /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:59:16.812317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-514498590", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "c1c2b0fe-774a-41d7-804b-9b252b4c0fcb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:16.916250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] validate_networks() for [('c1c2b0fe-774a-41d7-804b-9b252b4c0fcb', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:59:17.293658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:17.294486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:17.312711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:17.313243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:17.313707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:17.318064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:17.318724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:17.320069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:17.667279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:17.685636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:17.687288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:17.690206 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8c462d7c-789e-4a31-9c63-ca29bc78a236 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.401680 Aug 29 04:59:17.692142 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1159/2286] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:17 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:17.703070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:17.703696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:17.720172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:17.720690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:17.721296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:17.723944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:17.726943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:17.727481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:18.612777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:18.625466 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-867eda14-24f7-4d5c-ae78-9411f876a62c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1315 microversion: 2.1 time: 0.929181 Aug 29 04:59:18.626358 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1160/2287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:17 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:18.724183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:18.725280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:18.755520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:18.759073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:18.764021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:18.767924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:18.768721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:18.770362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:19.395001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:19.423541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:19.432979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:19.457477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:59:19.457972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:59:19.459073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:59:19.459716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:59:19.460401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:59:19.460955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dd184d57-6705-469c-98f7-9f1c56fac5b2 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.718157 Aug 29 04:59:19.469250 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1161/2288] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:18 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:19.475994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fecdd94a-d092-439b-a551-546b7e9d02d2 req-fa1498c8-7ca3-4e77-b6cf-f8cc5bbaa854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de63423e-f87b-485b-b071-9f20dcdf4eaf", "name": "network-vif-deleted", "tag": "c7d98676-d55c-41a4-b6a4-487708a826ff"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:19.494028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fecdd94a-d092-439b-a551-546b7e9d02d2 req-fa1498c8-7ca3-4e77-b6cf-f8cc5bbaa854 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:19.495067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:19.495611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fecdd94a-d092-439b-a551-546b7e9d02d2 req-fa1498c8-7ca3-4e77-b6cf-f8cc5bbaa854 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:19.496379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fecdd94a-d092-439b-a551-546b7e9d02d2 req-fa1498c8-7ca3-4e77-b6cf-f8cc5bbaa854 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:19.498253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:19.499358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:19.501904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:19.504838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:19.506546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:19.527394 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fecdd94a-d092-439b-a551-546b7e9d02d2 req-fa1498c8-7ca3-4e77-b6cf-f8cc5bbaa854 service nova] Creating event network-vif-deleted:c7d98676-d55c-41a4-b6a4-487708a826ff for instance de63423e-f87b-485b-b071-9f20dcdf4eaf on n-h1-854119-9 Aug 29 04:59:19.536670 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fecdd94a-d092-439b-a551-546b7e9d02d2 req-fa1498c8-7ca3-4e77-b6cf-f8cc5bbaa854 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065989 Aug 29 04:59:19.537659 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1162/2289] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:19.571630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Getting quotas for project e88260cc20924f92a617cc231ad24f77. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:59:19.589200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Getting quotas for user da246be637924c248fa3746468546f00 and project e88260cc20924f92a617cc231ad24f77. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:59:19.608941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:59:19.611555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:59:19.663462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:19.665361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:19.689691 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd0011b5-1df3-4d54-b506-4c8dd83fd0be tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.881568 Aug 29 04:59:19.690718 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1128/2290] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:59:19.693838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:19.697308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:19.703816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:19.706212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:19.708505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:19.713393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b14a65e-77fa-4d84-8ee8-1b090e5bffec tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:19.714691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:19.732757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2b14a65e-77fa-4d84-8ee8-1b090e5bffec tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:20.162870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b14a65e-77fa-4d84-8ee8-1b090e5bffec tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:20.171103 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b14a65e-77fa-4d84-8ee8-1b090e5bffec tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1207 microversion: 2.1 time: 0.468231 Aug 29 04:59:20.172703 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1129/2291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:19 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1207 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:20.292702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:20.304539 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-607c3a11-44ce-43e1-aedc-9ad6f3f1fcb2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1315 microversion: 2.1 time: 0.646317 Aug 29 04:59:20.319453 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1163/2292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:19 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:20.495687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:20.496694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:20.510721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:20.514207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:20.514806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:20.517949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:20.518599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:20.520335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:20.812491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:20.828754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:20.831663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:20.834457 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09e9088d-3928-4c58-9b6a-0695c5d960cd tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.343989 Aug 29 04:59:20.835176 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1130/2293] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:20 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:21.191362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:21.191987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:21.204036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:21.205845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:21.208814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:21.209763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:21.211785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:21.212455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:21.284506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-99d21a53-9e8e-47f4-befc-8207127b9c31 req-2adb0e5e-6072-4f3b-814e-b51a26e6b69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce6a237-7b7a-47ca-8206-662169d4e217", "tag": "c317c09b-ba1c-4cc2-b754-4cfef303586b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:21.305749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-99d21a53-9e8e-47f4-befc-8207127b9c31 req-2adb0e5e-6072-4f3b-814e-b51a26e6b69c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:21.309228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-99d21a53-9e8e-47f4-befc-8207127b9c31 req-2adb0e5e-6072-4f3b-814e-b51a26e6b69c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:21.310701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-99d21a53-9e8e-47f4-befc-8207127b9c31 req-2adb0e5e-6072-4f3b-814e-b51a26e6b69c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:21.339851 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-99d21a53-9e8e-47f4-befc-8207127b9c31 req-2adb0e5e-6072-4f3b-814e-b51a26e6b69c service nova] Creating event network-changed:c317c09b-ba1c-4cc2-b754-4cfef303586b for instance 8ce6a237-7b7a-47ca-8206-662169d4e217 on n-h1-854119-9 Aug 29 04:59:21.352908 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-99d21a53-9e8e-47f4-befc-8207127b9c31 req-2adb0e5e-6072-4f3b-814e-b51a26e6b69c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067064 Aug 29 04:59:21.353999 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1131/2294] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:21.363320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:21.365471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:21.389936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:21.390458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:21.390903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:21.391627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:21.392083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:21.392543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:21.532197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:21.544154 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b0497cc7-a142-4121-a160-74307d6140d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1259 microversion: 2.1 time: 0.354596 Aug 29 04:59:21.548372 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1164/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:21 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1259 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:21.861874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:21.863153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:21.877373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:21.881479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:21.881997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:21.882436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:21.883182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:21.890211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:21.892488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:22.487479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:22.505333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:22.507466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:22.515289 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c2e269d8-3659-4f75-9bb7-d7b8ed9cfc33 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.656785 Aug 29 04:59:22.518608 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1165/2296] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:21 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:22.579059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:22.581228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:22.602166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:22.607580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:22.607777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:22.608582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:22.609171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:22.609932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:22.651346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:22.662511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7101347a-bd6d-4e2a-b52c-fdbf3a470f64 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1315 microversion: 2.1 time: 1.306029 Aug 29 04:59:22.684593 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1132/2297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:21 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1315 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:22.994436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:23.002276 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e22f86e3-1670-49de-a666-a73309645ce9 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1265 microversion: 2.1 time: 0.437089 Aug 29 04:59:23.005832 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1166/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:22 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1265 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:23.547143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:23.547768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:23.558432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:23.558862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:23.561231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:23.565991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:23.567171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:23.569281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:23.696221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:23.698317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:23.713779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:23.716056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:23.717816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:23.721025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:23.722419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:23.724874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:23.892847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:23.922459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:23.931898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:23.937802 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d8e46f08-5e69-4ed8-aa62-9f178c748c0a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.394943 Aug 29 04:59:23.942075 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1133/2299] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:23 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:24.024954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:24.025739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:24.037633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:24.042699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:24.043216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:24.043988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:24.044499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:24.051601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:24.401804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:24.415340 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b28d5cca-483e-41d7-96f9-857c77d64bbc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1265 microversion: 2.1 time: 0.391549 Aug 29 04:59:24.419381 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1134/2300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:24 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1265 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:24.755728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:24.768523 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4870a63-dddc-484f-bdb6-73f3227f3181 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1315 microversion: 2.1 time: 1.077437 Aug 29 04:59:24.769122 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1167/2301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:23 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1315 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:24.963605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:24.964786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:24.992471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:24.993260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:24.995561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:24.997953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:24.999292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:25.001365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:25.335913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:25.366779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:25.371534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:25.372880 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52441105-705e-4c37-b346-d47be61c9321 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.413983 Aug 29 04:59:25.373440 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1135/2302] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:24 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:25.439377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:25.440399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:25.455569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:25.460814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:25.462304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:25.467080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:25.468946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:25.470119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:25.523658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11eccb06-cc89-4a9a-a67e-3aa7315ebda7 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Calling method '.version_select at 0x7f1ab8b47a60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:25.678267 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11eccb06-cc89-4a9a-a67e-3aa7315ebda7 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/adc338d450cd4fc8949e6fc9a7b4be7a" status: 200 len: 371 microversion: 2.1 time: 0.470906 Aug 29 04:59:25.685583 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1168/2303] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 04:59:25 2022] GET /compute/v2.1/os-quota-sets/adc338d450cd4fc8949e6fc9a7b4be7a => generated 371 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:25.716137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d03715a5-2870-4a83-b0fe-fbddd4f9e640 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Action: 'update', calling method: .version_select at 0x7f1abd89b820>, body: {"quota_set": {"ram": "5120"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:25.875279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d03715a5-2870-4a83-b0fe-fbddd4f9e640 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:25.875935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d03715a5-2870-4a83-b0fe-fbddd4f9e640 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:25.876317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d03715a5-2870-4a83-b0fe-fbddd4f9e640 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:25.877165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d03715a5-2870-4a83-b0fe-fbddd4f9e640 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:25.877607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d03715a5-2870-4a83-b0fe-fbddd4f9e640 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:25.878033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d03715a5-2870-4a83-b0fe-fbddd4f9e640 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:26.083595 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d03715a5-2870-4a83-b0fe-fbddd4f9e640 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/adc338d450cd4fc8949e6fc9a7b4be7a" status: 200 len: 328 microversion: 2.1 time: 0.393006 Aug 29 04:59:26.085933 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1169/2304] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:59:25 2022] PUT /compute/v2.1/os-quota-sets/adc338d450cd4fc8949e6fc9a7b4be7a => generated 328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:26.101321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:26.102296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:26.124965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:26.128147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:26.131939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:26.135018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:26.137985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:26.138659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:27.407069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:27.415253 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e2a5be12-f3a8-4e20-b288-95317e4135d5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1307 microversion: 2.1 time: 1.979589 Aug 29 04:59:27.434250 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1136/2305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:25 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1307 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:27.445769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10e6eb46-047c-4255-8d0e-67189683481f tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:27.467441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:27.480295 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-10e6eb46-047c-4255-8d0e-67189683481f tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/adc338d450cd4fc8949e6fc9a7b4be7a" status: 202 len: 0 microversion: 2.1 time: 0.044425 Aug 29 04:59:27.481789 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1137/2306] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 04:59:27 2022] DELETE /compute/v2.1/os-quota-sets/adc338d450cd4fc8949e6fc9a7b4be7a => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:59:27.490936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:27.493178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:27.513278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:27.515161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:27.517047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:27.518065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:27.519939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:27.520976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:28.079193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:28.108850 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-084d3775-c1fc-4108-aece-dac082777be6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1315 microversion: 2.1 time: 2.017773 Aug 29 04:59:28.110778 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1170/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:26 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1315 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:28.132772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:28.153220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:28.157396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:28.158788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-634ae802-c557-4118-afbf-46c776f07db4 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Calling method '.version_select at 0x7f1ab8b47b80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:28.167421 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b7cc023d-d5b7-46a7-be0b-5449d5f85e4f tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.676427 Aug 29 04:59:28.168354 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1138/2308] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:27 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:28.189920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:28.191883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:28.212547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:28.222942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:28.224523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:28.226290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:28.234067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:28.234520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:28.309011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:59:28.341961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-634ae802-c557-4118-afbf-46c776f07db4 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/adc338d450cd4fc8949e6fc9a7b4be7a" status: 200 len: 371 microversion: 2.1 time: 0.190217 Aug 29 04:59:28.350022 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1171/2309] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 04:59:28 2022] GET /compute/v2.1/os-quota-sets/adc338d450cd4fc8949e6fc9a7b4be7a => generated 371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:28.441231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:28.442622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:28.482222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:28.484720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:28.485368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:28.494771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:28.495461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:28.497475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:28.605432 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-329c1367-1656-4859-985b-d617a0c65cc1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 204 len: 0 microversion: 2.1 time: 0.435651 Aug 29 04:59:28.606032 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1139/2310] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:59:28 2022] DELETE /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:59:28.615628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:28.638850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:28.658244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:28.658741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:28.659173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:28.659888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:28.660368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:28.660788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:29.536717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:30.166820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=14 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:30.882381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:30.892226 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4400a2c7-60c7-41d5-9116-24d66e878607 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1669 microversion: 2.1 time: 2.280946 Aug 29 04:59:30.909437 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1140/2311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:28 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1669 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:30.920977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6a8813c7-4669-40f9-a41c-a66c1819ee83 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Calling method '.version_select at 0x7f1ab9796a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:30.922633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:30.934451 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43506248-9392-4d02-8618-4e6314514ded tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1307 microversion: 2.1 time: 2.501187 Aug 29 04:59:30.940063 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1172/2312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:28 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1307 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:30.950419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c45ca477-fa28-4681-ad6d-5053a5412450 req-8a100cf1-67ea-4acc-b5c1-23d5552b45e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec43b062-7f3a-4331-8a9b-af76fe09a90d", "tag": "3facff58-cf97-4f91-bc63-24d3df54d9eb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:30.994420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c45ca477-fa28-4681-ad6d-5053a5412450 req-8a100cf1-67ea-4acc-b5c1-23d5552b45e4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:30.998158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c45ca477-fa28-4681-ad6d-5053a5412450 req-8a100cf1-67ea-4acc-b5c1-23d5552b45e4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:30.998827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c45ca477-fa28-4681-ad6d-5053a5412450 req-8a100cf1-67ea-4acc-b5c1-23d5552b45e4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:31.038472 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c45ca477-fa28-4681-ad6d-5053a5412450 req-8a100cf1-67ea-4acc-b5c1-23d5552b45e4 service nova] Creating event network-changed:3facff58-cf97-4f91-bc63-24d3df54d9eb for instance ec43b062-7f3a-4331-8a9b-af76fe09a90d on n-h1-854119-9 Aug 29 04:59:31.054294 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c45ca477-fa28-4681-ad6d-5053a5412450 req-8a100cf1-67ea-4acc-b5c1-23d5552b45e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112775 Aug 29 04:59:31.061408 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1173/2313] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:31.075216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:31.077044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:31.092467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:31.093754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:31.096475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:31.097465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:31.099047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:31.101427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:31.420245 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6a8813c7-4669-40f9-a41c-a66c1819ee83 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/d9dac0733b2540db9ee0b9190791e739/defaults" status: 200 len: 371 microversion: 2.1 time: 0.509211 Aug 29 04:59:31.420857 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1141/2314] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 04:59:30 2022] GET /compute/v2.1/os-quota-sets/d9dac0733b2540db9ee0b9190791e739/defaults => generated 371 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:31.435438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:31.436361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:31.448621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:31.449175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:31.449612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:31.450329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:31.450780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:31.451513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:31.760685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:31.776921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:31.783347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:31.784733 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-824c5a5e-5aee-4f1b-b0c7-491d1850e725 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.361820 Aug 29 04:59:31.785320 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1142/2315] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:31 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:31.794933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-2bf232dc-6efe-4a06-a0a3-23ab7ce336a9 req-4d037130-3ffc-4ac8-a165-ce823e715c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce6a237-7b7a-47ca-8206-662169d4e217", "name": "network-vif-plugged", "status": "completed", "tag": "c317c09b-ba1c-4cc2-b754-4cfef303586b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:31.820832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2bf232dc-6efe-4a06-a0a3-23ab7ce336a9 req-4d037130-3ffc-4ac8-a165-ce823e715c71 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:31.823083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2bf232dc-6efe-4a06-a0a3-23ab7ce336a9 req-4d037130-3ffc-4ac8-a165-ce823e715c71 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:31.823933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2bf232dc-6efe-4a06-a0a3-23ab7ce336a9 req-4d037130-3ffc-4ac8-a165-ce823e715c71 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:31.856411 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2bf232dc-6efe-4a06-a0a3-23ab7ce336a9 req-4d037130-3ffc-4ac8-a165-ce823e715c71 service nova] Creating event network-vif-plugged:c317c09b-ba1c-4cc2-b754-4cfef303586b for instance 8ce6a237-7b7a-47ca-8206-662169d4e217 on n-h1-854119-9 Aug 29 04:59:31.864925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-2bf232dc-6efe-4a06-a0a3-23ab7ce336a9 req-4d037130-3ffc-4ac8-a165-ce823e715c71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076187 Aug 29 04:59:31.868757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1143/2316] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:31.875391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-befc5ca8-1291-4f3d-9abe-f060587550c8 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9efeaf0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:31.900076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:31.931806 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8ca4a884-063c-4edc-ad08-cae35973b4e7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1315 microversion: 2.1 time: 0.868778 Aug 29 04:59:31.933807 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1174/2317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:31 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1315 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:31.957632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:31.958375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:31.980041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:31.981654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:31.982102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:31.982974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:31.983442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:31.985019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:32.180393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befc5ca8-1291-4f3d-9abe-f060587550c8 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:32.180975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befc5ca8-1291-4f3d-9abe-f060587550c8 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:32.181439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befc5ca8-1291-4f3d-9abe-f060587550c8 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:32.183870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befc5ca8-1291-4f3d-9abe-f060587550c8 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:32.186552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befc5ca8-1291-4f3d-9abe-f060587550c8 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:32.187048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befc5ca8-1291-4f3d-9abe-f060587550c8 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:32.320453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-befc5ca8-1291-4f3d-9abe-f060587550c8 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/c678c3e85cf7455bbb0abd607d01a606" status: 200 len: 328 microversion: 2.1 time: 0.450008 Aug 29 04:59:32.321641 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1144/2318] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 04:59:31 2022] PUT /compute/v2.1/os-quota-sets/c678c3e85cf7455bbb0abd607d01a606 => generated 328 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:32.339900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:32.342814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:32.373588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:32.379384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:32.385257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:32.387064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:32.388967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:32.393483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:32.885231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:32.894965 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-60fca182-a516-47f9-9205-ce61966a32e9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 200 len: 1669 microversion: 2.1 time: 0.942565 Aug 29 04:59:32.902236 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1175/2319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:31 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 1669 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:32.918409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd88f075-39b7-4d7b-bdd5-e5a464f24c70 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Calling method '.version_select at 0x7f1abd89b3a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:33.019400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd88f075-39b7-4d7b-bdd5-e5a464f24c70 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:33.021100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd88f075-39b7-4d7b-bdd5-e5a464f24c70 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:33.021781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd88f075-39b7-4d7b-bdd5-e5a464f24c70 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:33.022874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd88f075-39b7-4d7b-bdd5-e5a464f24c70 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:33.023677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd88f075-39b7-4d7b-bdd5-e5a464f24c70 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:33.024437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd88f075-39b7-4d7b-bdd5-e5a464f24c70 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:33.044444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:33.075899 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cd88f075-39b7-4d7b-bdd5-e5a464f24c70 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/c678c3e85cf7455bbb0abd607d01a606/detail" status: 200 len: 916 microversion: 2.1 time: 0.164648 Aug 29 04:59:33.077231 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cdf0affb-933e-4223-956b-492e1ff32aca tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1307 microversion: 2.1 time: 0.754350 Aug 29 04:59:33.091896 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1176/2321] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 04:59:32 2022] GET /compute/v2.1/os-quota-sets/c678c3e85cf7455bbb0abd607d01a606/detail => generated 916 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:33.112524 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1145/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:32 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1307 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:33.134733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:33.136713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:33.160338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:33.160916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:33.161360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:33.162084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:33.167034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:33.169832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:33.190838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bd8de809-06e7-4b0c-8b64-ca94f41a8d55 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1abd91ad30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1775526780", "description": "tempest-description-1417791220"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:33.312878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:33.339352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:33.340890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca81c4e0350646e58b67cc11892cd035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4757ab0515fe4b6db413ebefc1251588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:33.342126 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4bbeb0d-172e-40a7-8c6d-18ae201dd22a tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 200 len: 1604 microversion: 2.32 time: 0.227242 Aug 29 04:59:33.342690 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1146/2322] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:33 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 1604 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 04:59:33.445137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1139275597", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "264885bf-4295-4c69-814f-ea096817a42d"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:33.575894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] validate_networks() for [('264885bf-4295-4c69-814f-ea096817a42d', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:59:34.413078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bd8de809-06e7-4b0c-8b64-ca94f41a8d55 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.307516 Aug 29 04:59:34.422210 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1177/2323] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:59:33 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:34.429082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:34.430086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:34.448653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:34.449471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:34.450163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:34.451797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:34.452503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:34.453131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:34.514008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:34.882295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:34.890629 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-339c40a2-ac38-41d7-aa08-b72a4fb46e57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1315 microversion: 2.1 time: 0.465940 Aug 29 04:59:34.891277 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1178/2324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:34 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:34.922643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Action: 'update', calling method: .version_select at 0x7f1abd91a700>, body: {"quota_set": {"ram": "2048"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:35.074057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.074721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.075312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.076524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.078750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.079340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.187099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.187584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.188210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.188763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.189221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.189642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.282129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:59:35.282508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:59:35.282922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:59:35.283329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:59:35.283742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:59:35.302011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.308963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.311073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.314601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.315294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.319945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.382033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Getting quotas for project d0be48f9bd0347e7b2765f09ba0d50b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:59:35.398716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Getting quotas for user 5f9b5a46468f4cb79a0ec52a86f4482d and project d0be48f9bd0347e7b2765f09ba0d50b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:59:35.441588 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c37c315-6eed-4a33-96e8-5ad66403b140 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/c678c3e85cf7455bbb0abd607d01a606?user_id=7d5734dd8ff84c57820a3a5459e22de3" status: 200 len: 328 microversion: 2.1 time: 0.549203 Aug 29 04:59:35.448424 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1179/2325] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 04:59:34 2022] PUT /compute/v2.1/os-quota-sets/c678c3e85cf7455bbb0abd607d01a606?user_id=7d5734dd8ff84c57820a3a5459e22de3 => generated 328 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:35.450352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:59:35.453101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:59:35.461649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:35.462308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: d7c9b159-0dc2-4520-95ea-01bea5848a83] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:35.473497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.473996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.480441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.481541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.491115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.496761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.525832 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] HTTP exception thrown: Instance d7c9b159-0dc2-4520-95ea-01bea5848a83 could not be found. Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Request method failure captured: Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 HTTP/1.1 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXYR5twN_s37bXZ0eeliQvNreduYAJW88vypFFx7lC2pDMiC_8rXaOrKOyUxl0nAXZAb1z0fnUCrZYtKkyMz-vqBN8ulL9W7bwSX6rzTF2601pYMRoEYTw8ZOYno4RfPMOp3gzjuhszaFKe4fKwpKtoTJYm7vzwQ8iMNT_RgIz2zJw Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: bb84e6fe60b3405382ebd2c54aa67908 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-LiveMigrationTest-349516559 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb84e6fe60b3405382ebd2c54aa67908", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-LiveMigrationTest-349516559 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: bb84e6fe60b3405382ebd2c54aa67908 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-LiveMigrationTest-349516559 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-LiveMigrationTest-349516559-project Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f5a5756b12204e9f9fbd7a2f3c5e1749 Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-LiveMigrationTest-349516559-project Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance d7c9b159-0dc2-4520-95ea-01bea5848a83 could not be found. Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'd7c9b159-0dc2-4520-95ea-01bea5848a83'} Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c9b159-0dc2-4520-95ea-01bea5848a83 could not be found. Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c9b159-0dc2-4520-95ea-01bea5848a83 could not be found. Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:35.527543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.530904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:35.530904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:35.530904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:35.530904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:35.530904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:35.530904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c9b159-0dc2-4520-95ea-01bea5848a83 could not be found. Aug 29 04:59:35.530904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.530904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Returning 404 to user: Instance d7c9b159-0dc2-4520-95ea-01bea5848a83 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:35.533476 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5401e531-a51f-4093-8523-7d0ce3e4061a tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83" status: 404 len: 111 microversion: 2.1 time: 0.089217 Aug 29 04:59:35.534070 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1180/2326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:35 2022] GET /compute/v2.1/servers/d7c9b159-0dc2-4520-95ea-01bea5848a83 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:59:35.539654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:35.547436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:35.558944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.559432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.559913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.560689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.561714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.562480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.594228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf0ae074-dafd-4ce6-8586-06a275ec6069 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.250460 Aug 29 04:59:35.594950 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1147/2327] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:59:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:59:35.606051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:35.611264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:35.623534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.625138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.626576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.627484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.631045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.631646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.637764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:35.660246 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] HTTP exception thrown: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Request method failure captured: Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf HTTP/1.1 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEZAJGdeOiucYGzlDwuGoQBdDxYTWsbgeaVXQF_AjGU7H_mp0Z5atQTnN3XgcCvcasq-CKQ85eNry_evn6K4j9AXZ4CHqxGSp00LTOGzF2sE1-eXhU0XgY4U67S8rB1ZMAo0ozEkK5UXVUdZ0DVI8dHacPeRRI42BQ4Gdj2VTorxDoo Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 4757ab0515fe4b6db413ebefc1251588 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TaggedBootDevicesTest-1738619472 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4757ab0515fe4b6db413ebefc1251588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4757ab0515fe4b6db413ebefc1251588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4757ab0515fe4b6db413ebefc1251588", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4757ab0515fe4b6db413ebefc1251588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TaggedBootDevicesTest-1738619472 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 4757ab0515fe4b6db413ebefc1251588 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1738619472 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TaggedBootDevicesTest-1738619472-project Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca81c4e0350646e58b67cc11892cd035 Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TaggedBootDevicesTest-1738619472-project Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'e3f35fea-40dd-43e9-9bf5-58c622aaefcf'} Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.662402 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:35.666496 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.666496 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:35.666496 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:35.666496 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:35.666496 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:35.666496 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:35.666496 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:35.666496 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:35.668474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Returning 404 to user: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:35.671644 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42306504-6c31-4676-b923-75ae020aa2a7 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 404 len: 111 microversion: 2.32 time: 0.069478 Aug 29 04:59:35.672452 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1148/2328] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:35 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:59:35.682175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1dabdcf9-4bea-4243-9943-4423501b6ca8 req-5d173027-2fc1-495d-85f7-6f78d285ee8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c9b159-0dc2-4520-95ea-01bea5848a83", "name": "network-vif-deleted", "tag": "ab2261dd-06cc-4525-b84d-5964ae7d42b7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:35.702385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1dabdcf9-4bea-4243-9943-4423501b6ca8 req-5d173027-2fc1-495d-85f7-6f78d285ee8a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:35.703169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1dabdcf9-4bea-4243-9943-4423501b6ca8 req-5d173027-2fc1-495d-85f7-6f78d285ee8a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:35.704206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1dabdcf9-4bea-4243-9943-4423501b6ca8 req-5d173027-2fc1-495d-85f7-6f78d285ee8a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:35.722510 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1dabdcf9-4bea-4243-9943-4423501b6ca8 req-5d173027-2fc1-495d-85f7-6f78d285ee8a service nova] Creating event network-vif-deleted:ab2261dd-06cc-4525-b84d-5964ae7d42b7 for instance d7c9b159-0dc2-4520-95ea-01bea5848a83 on n-h2-854119-9 Aug 29 04:59:35.736803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1dabdcf9-4bea-4243-9943-4423501b6ca8 req-5d173027-2fc1-495d-85f7-6f78d285ee8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062793 Aug 29 04:59:35.737845 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1149/2329] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:35.745966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ab30ae6-f28d-4d33-978d-79060cce5f0f tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab97e48b0>, body: {"security_group_rule": {"parent_group_id": "76406787-1db1-4486-bb34-2d7ba3ea9d55", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:36.342403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:36.356227 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7d46280-05ff-44c2-b875-2a62d5aec9b2 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1307 microversion: 2.1 time: 0.820443 Aug 29 04:59:36.357531 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1181/2330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:35 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1307 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:36.363568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8e031f5f-37e7-4060-9a94-c9f23985595f tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Calling method '.version_select at 0x7f1abd8af700>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:36.503945 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8e031f5f-37e7-4060-9a94-c9f23985595f tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/c678c3e85cf7455bbb0abd607d01a606?user_id=7d5734dd8ff84c57820a3a5459e22de3" status: 200 len: 370 microversion: 2.1 time: 0.141673 Aug 29 04:59:36.511707 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1182/2331] 10.222.0.20 () {58 vars in 1323 bytes} [Mon Aug 29 04:59:36 2022] GET /compute/v2.1/os-quota-sets/c678c3e85cf7455bbb0abd607d01a606?user_id=7d5734dd8ff84c57820a3a5459e22de3 => generated 370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:36.537270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4e1f8c7e-2fa7-43d3-af1a-3465c1bb4e11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '.version_select at 0x7f1abd913c10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:36.548584 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8ab30ae6-f28d-4d33-978d-79060cce5f0f tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.809369 Aug 29 04:59:36.549744 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1150/2332] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:59:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:36.556793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:36.557748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:36.565919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:36.566995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:36.567579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:36.569463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:36.570267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:36.571894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:36.625872 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4e1f8c7e-2fa7-43d3-af1a-3465c1bb4e11 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124226703" status: 202 len: 0 microversion: 2.1 time: 0.117260 Aug 29 04:59:36.646730 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1183/2333] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 04:59:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124226703 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:59:36.657387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0cd708f1-4cae-4991-b239-61a4ea812784 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '.version_select at 0x7f1abd7fde50>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:36.679348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:36.694237 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0cd708f1-4cae-4991-b239-61a4ea812784 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814986845" status: 204 len: 0 microversion: 2.32 time: 0.046220 Aug 29 04:59:36.695847 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1184/2334] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Aug 29 04:59:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814986845 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 04:59:36.703211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:36.704080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:36.713931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:36.714720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:36.715529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:36.716832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:36.717550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:36.718618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:36.902525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:36.915587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc90f340-65ab-4815-b885-5c2773d4e26b tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1220 microversion: 2.1 time: 0.363938 Aug 29 04:59:36.916824 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1151/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:36 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1220 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:36.923553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15666777-d3ba-4e12-b56d-c7379c11c634 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab97e4ca0>, body: {"security_group_rule": {"parent_group_id": "76406787-1db1-4486-bb34-2d7ba3ea9d55", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:37.120859 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-15666777-d3ba-4e12-b56d-c7379c11c634 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] HTTP exception thrown: This rule already exists in group 76406787-1db1-4486-bb34-2d7ba3ea9d55 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15666777-d3ba-4e12-b56d-c7379c11c634 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Request method failure captured: Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 138 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEe0dpzFq_EJ0yFU5BC65zVnKQ_yHaKa06itUK5em_iIznsrrHXpmkwBwVdmbFxHSkVVyPFS0HwJq3Wk735Db2qNHVPEQcewybKjAjiKzz_iM96OXZLnFN1UvkowLxp7JgVzwLBGkejvXCpMdcFswvPzET0jHaI9tntjyni6-OmNj84 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f52c02992f9240ee879fcb724897cfac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 2c61fb05d72f4f3a81b2ee723c6ce069 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: {"security_group_rule": {"parent_group_id": "76406787-1db1-4486-bb34-2d7ba3ea9d55", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: exception: This rule already exists in group 76406787-1db1-4486-bb34-2d7ba3ea9d55 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'security_group_rule': {'parent_group_id': '76406787-1db1-4486-bb34-2d7ba3ea9d55', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 76406787-1db1-4486-bb34-2d7ba3ea9d55 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 76406787-1db1-4486-bb34-2d7ba3ea9d55 Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:37.122726 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:37.127908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:37.127908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:37.127908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 76406787-1db1-4486-bb34-2d7ba3ea9d55 Aug 29 04:59:37.127908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:37.127908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15666777-d3ba-4e12-b56d-c7379c11c634 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Returning 400 to user: This rule already exists in group 76406787-1db1-4486-bb34-2d7ba3ea9d55 {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:37.127908 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15666777-d3ba-4e12-b56d-c7379c11c634 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.206448 Aug 29 04:59:37.127908 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1152/2336] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:59:36 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:59:37.136860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b72b573a-03c5-4054-9588-8d02892d6ddd tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Calling method '.version_select at 0x7f1ab97578b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:37.206860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:37.223131 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab6e0c09-b309-477b-99fd-ba191723ecd1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1503 microversion: 2.1 time: 0.524036 Aug 29 04:59:37.223960 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1185/2337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:36 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1503 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:37.245536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1909244a-a867-4a5c-8fc1-7115d03f71f4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:37.246571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1909244a-a867-4a5c-8fc1-7115d03f71f4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:37.257081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1909244a-a867-4a5c-8fc1-7115d03f71f4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:37.258797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1909244a-a867-4a5c-8fc1-7115d03f71f4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:37.259812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1909244a-a867-4a5c-8fc1-7115d03f71f4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:37.260844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1909244a-a867-4a5c-8fc1-7115d03f71f4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:37.261873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1909244a-a867-4a5c-8fc1-7115d03f71f4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:37.262720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1909244a-a867-4a5c-8fc1-7115d03f71f4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:37.470702 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1909244a-a867-4a5c-8fc1-7115d03f71f4 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217/action" status: 202 len: 0 microversion: 2.1 time: 0.228042 Aug 29 04:59:37.474924 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1186/2338] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:59:37 2022] POST /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:59:37.484357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4f4a129e-bd83-4152-88ce-8ad1cbe5fead tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Calling method '.version_select at 0x7f1ab8b47b80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:37.976882 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4f4a129e-bd83-4152-88ce-8ad1cbe5fead tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/d9dac0733b2540db9ee0b9190791e739/defaults" status: 200 len: 371 microversion: 2.1 time: 0.500088 Aug 29 04:59:37.979169 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b72b573a-03c5-4054-9588-8d02892d6ddd tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/08ae755f-5e0a-40fc-bafa-87fd656eb873" status: 202 len: 0 microversion: 2.1 time: 0.846965 Aug 29 04:59:37.979992 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1153/2340] 10.222.0.20 () {58 vars in 1287 bytes} [Mon Aug 29 04:59:37 2022] DELETE /compute/v2.1/os-security-group-rules/08ae755f-5e0a-40fc-bafa-87fd656eb873 => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 04:59:37.984611 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1187/2340] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 04:59:37 2022] GET /compute/v2.1/os-quota-sets/d9dac0733b2540db9ee0b9190791e739/defaults => generated 371 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:37.984783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:37.985329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:37.997262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:37.999764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:38.000338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:38.000842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:38.001397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:38.002081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:38.002533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:38.003299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:38.018036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:38.022650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:38.023442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:38.027970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:38.029112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:38.030259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:38.874123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:38.887706 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-931bfb90-5c4c-40a8-830d-8261d97d865d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1307 microversion: 2.1 time: 0.906251 Aug 29 04:59:38.888540 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1154/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:37 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1307 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:38.902503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:38.902728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:38.915286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:38.922603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:38.923787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:38.924279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:38.924997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:38.925457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:38.925881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:38.927169 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a2ded63-72b6-444d-bf3c-6e9c963d6591 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1488 microversion: 2.1 time: 0.940804 Aug 29 04:59:38.951943 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1188/2342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:37 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1488 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:38.957171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b119cc10-74a0-4f1e-a9ad-ff3c2379022c tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab9ba35e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1262140491", "description": "tempest-description-852439914"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:39.098985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:39.107206 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be9bb98d-aef3-4418-80a4-9df254e223db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1282 microversion: 2.1 time: 0.217198 Aug 29 04:59:39.108147 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1155/2343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:38 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:39.112950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7064f51d-15d0-4971-b916-d8891648c4df tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9db19d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:39.225323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7064f51d-15d0-4971-b916-d8891648c4df tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:39.229258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7064f51d-15d0-4971-b916-d8891648c4df tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:39.229925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7064f51d-15d0-4971-b916-d8891648c4df tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:39.237223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7064f51d-15d0-4971-b916-d8891648c4df tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:39.238144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7064f51d-15d0-4971-b916-d8891648c4df tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:39.238769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7064f51d-15d0-4971-b916-d8891648c4df tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:39.626443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=18 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:39.679304 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7064f51d-15d0-4971-b916-d8891648c4df tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/d9dac0733b2540db9ee0b9190791e739" status: 200 len: 329 microversion: 2.1 time: 0.569793 Aug 29 04:59:39.680732 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1156/2344] 10.222.0.20 () {60 vars in 1263 bytes} [Mon Aug 29 04:59:39 2022] PUT /compute/v2.1/os-quota-sets/d9dac0733b2540db9ee0b9190791e739 => generated 329 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:39.688500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-9c180286-684b-4162-9d3c-e5919a7355c7 req-952dec45-e113-4e34-95dd-3e5e7597a5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec43b062-7f3a-4331-8a9b-af76fe09a90d", "name": "network-vif-plugged", "status": "completed", "tag": "3facff58-cf97-4f91-bc63-24d3df54d9eb"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:39.700426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9c180286-684b-4162-9d3c-e5919a7355c7 req-952dec45-e113-4e34-95dd-3e5e7597a5ad service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:39.701372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9c180286-684b-4162-9d3c-e5919a7355c7 req-952dec45-e113-4e34-95dd-3e5e7597a5ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:39.707158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9c180286-684b-4162-9d3c-e5919a7355c7 req-952dec45-e113-4e34-95dd-3e5e7597a5ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:39.724182 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-9c180286-684b-4162-9d3c-e5919a7355c7 req-952dec45-e113-4e34-95dd-3e5e7597a5ad service nova] Creating event network-vif-plugged:3facff58-cf97-4f91-bc63-24d3df54d9eb for instance ec43b062-7f3a-4331-8a9b-af76fe09a90d on n-h1-854119-9 Aug 29 04:59:39.733640 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-9c180286-684b-4162-9d3c-e5919a7355c7 req-952dec45-e113-4e34-95dd-3e5e7597a5ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048726 Aug 29 04:59:39.735486 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1157/2345] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:39.742668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:39.743723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:39.753528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:39.754018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:39.754578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:39.755290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:39.756233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:39.756660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:39.815278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:59:39.843405 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b119cc10-74a0-4f1e-a9ad-ff3c2379022c tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.889692 Aug 29 04:59:39.846060 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1189/2346] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:59:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:39.851329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d60a562a-9bf6-4361-808c-1f48140771f2 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab8b47b80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:39.955606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d60a562a-9bf6-4361-808c-1f48140771f2 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:39.956192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d60a562a-9bf6-4361-808c-1f48140771f2 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:39.956624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d60a562a-9bf6-4361-808c-1f48140771f2 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:39.958870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d60a562a-9bf6-4361-808c-1f48140771f2 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:39.959594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d60a562a-9bf6-4361-808c-1f48140771f2 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:39.960304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d60a562a-9bf6-4361-808c-1f48140771f2 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:39.972089 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b604ff0-7f50-45ed-9b45-36c16b7ffabc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 204 len: 0 microversion: 2.1 time: 0.233494 Aug 29 04:59:39.975536 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1158/2347] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:59:39 2022] DELETE /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:59:39.983017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-67082600-9785-40ac-88e0-9a617174496b tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab9a21160>, body: {"security_group_rule": {"parent_group_id": "82384bcc-b3c8-42ec-bbc7-55e3055e3aa1", "ip_protocol": "tcp", "from_port": 2004143872, "to_port": 22}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:40.216194 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-67082600-9785-40ac-88e0-9a617174496b tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] HTTP exception thrown: Invalid port range 2004143872:22. Former value cannot be greater than the later Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-67082600-9785-40ac-88e0-9a617174496b tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Request method failure captured: Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 146 Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEe0dpzFq_EJ0yFU5BC65zVnKQ_yHaKa06itUK5em_iIznsrrHXpmkwBwVdmbFxHSkVVyPFS0HwJq3Wk735Db2qNHVPEQcewybKjAjiKzz_iM96OXZLnFN1UvkowLxp7JgVzwLBGkejvXCpMdcFswvPzET0jHaI9tntjyni6-OmNj84 Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f52c02992f9240ee879fcb724897cfac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 2c61fb05d72f4f3a81b2ee723c6ce069 Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: {"security_group_rule": {"parent_group_id": "82384bcc-b3c8-42ec-bbc7-55e3055e3aa1", "ip_protocol": "tcp", "from_port": 2004143872, "to_port": 22}} Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid port range 2004143872:22. Former value cannot be greater than the later Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'security_group_rule': {'parent_group_id': '82384bcc-b3c8-42ec-bbc7-55e3055e3aa1', 'ip_protocol': 'tcp', 'from_port': 2004143872, 'to_port': 22}}} Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2004143872:22. Former value cannot be greater than the later Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2004143872:22. Former value cannot be greater than the later Aug 29 04:59:40.219412 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.223371 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:40.223371 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.223371 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:40.223371 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:40.223371 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:40.223371 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:40.223371 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:40.223371 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2004143872:22. Former value cannot be greater than the later Aug 29 04:59:40.223371 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.225241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-67082600-9785-40ac-88e0-9a617174496b tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Returning 400 to user: Invalid port range 2004143872:22. Former value cannot be greater than the later {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:40.227100 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-67082600-9785-40ac-88e0-9a617174496b tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.251986 Aug 29 04:59:40.228142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1159/2348] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:59:39 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:59:40.243677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:40.249150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:40.262033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:40.262516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:40.262947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:40.263649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:40.264094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:40.264560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:40.438679 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d60a562a-9bf6-4361-808c-1f48140771f2 tempest-QuotasAdminTestJSON-217530586 tempest-QuotasAdminTestJSON-217530586-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/d9dac0733b2540db9ee0b9190791e739" status: 200 len: 329 microversion: 2.1 time: 0.591332 Aug 29 04:59:40.439273 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1190/2349] 10.222.0.20 () {60 vars in 1263 bytes} [Mon Aug 29 04:59:39 2022] PUT /compute/v2.1/os-quota-sets/d9dac0733b2540db9ee0b9190791e739 => generated 329 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:40.444181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:40.445042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:40.454419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:40.455094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:40.455674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:40.456996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:40.457601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:40.458185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:40.663355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:40.672685 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef7de898-86ed-4a08-b919-aef13b5be214 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1307 microversion: 2.1 time: 0.438004 Aug 29 04:59:40.673275 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1160/2350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:40 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1307 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:40.689096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:40.689849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:40.707767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:40.708310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:40.708750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:40.709474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:40.709932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:40.710364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:40.770182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:59:40.901187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:40.917621 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bffa0e17-e1f7-4683-91ce-3bb135d05ded tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1494 microversion: 2.1 time: 0.476944 Aug 29 04:59:40.919019 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1191/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:40 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1494 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:40.928388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:40.929240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:40.936187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:40.942211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:40.942951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:40.943868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:40.946286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:40.946908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:40.972682 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c0ffff1b-a867-43d9-b572-d1d4c26c7c64 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 204 len: 0 microversion: 2.1 time: 0.287188 Aug 29 04:59:40.977717 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1161/2352] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:59:40 2022] DELETE /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:59:40.982518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-781f24b8-8a83-4f9e-adca-b38ac0fc88c4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab97eac10>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2028437407", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:40.989790 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-781f24b8-8a83-4f9e-adca-b38ac0fc88c4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] HTTP exception thrown: Security group id should be uuid Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-781f24b8-8a83-4f9e-adca-b38ac0fc88c4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Request method failure captured: Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 131 Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEe0dpzFq_EJ0yFU5BC65zVnKQ_yHaKa06itUK5em_iIznsrrHXpmkwBwVdmbFxHSkVVyPFS0HwJq3Wk735Db2qNHVPEQcewybKjAjiKzz_iM96OXZLnFN1UvkowLxp7JgVzwLBGkejvXCpMdcFswvPzET0jHaI9tntjyni6-OmNj84 Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f52c02992f9240ee879fcb724897cfac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 2c61fb05d72f4f3a81b2ee723c6ce069 Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2028437407", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: exception: Security group id should be uuid Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2028437407', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:40.991923 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:40.996145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 29 04:59:40.996145 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:40.996145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-781f24b8-8a83-4f9e-adca-b38ac0fc88c4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Returning 400 to user: Security group id should be uuid {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:40.996145 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-781f24b8-8a83-4f9e-adca-b38ac0fc88c4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016253 Aug 29 04:59:40.996145 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1162/2353] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:59:40 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:59:41.006469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:41.012410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:41.025497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:41.025994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:41.026427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:41.027134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:41.027587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:41.028007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:41.406310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:41.417619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:41.419944 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c58b40f7-6314-4655-9073-af6f27bb95c5 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1485 microversion: 2.1 time: 0.423627 Aug 29 04:59:41.434682 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-571fdedd-b384-4bfb-9b1f-e2497c8c9360 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1324 microversion: 2.1 time: 0.514407 Aug 29 04:59:41.435573 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1192/2354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:40 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1324 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:41.441462 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1163/2355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:40 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1485 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:41.444550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d973c93-925f-4990-9132-84a38daccb36 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1abd8528b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-605625289", "description": "tempest-description-1502449340"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:41.697463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:41.699606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:41.712079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:41.713505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:41.714719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:41.716022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:41.717986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:41.719059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:42.392400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:42.398665 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d973c93-925f-4990-9132-84a38daccb36 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.961769 Aug 29 04:59:42.400276 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1193/2356] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:59:41 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:42.408418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:42.409623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:42.417668 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a46c6f81-c86e-4e67-b6d3-417e1b6eb60e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1307 microversion: 2.1 time: 0.723653 Aug 29 04:59:42.425592 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1164/2357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:41 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1307 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:42.427085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:42.427830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:42.428527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:42.430641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:42.434472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:42.435226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:42.437672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b8f12d3-7ede-4a74-a3d6-9a29298ab299 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab979e820>, body: {"security_group_rule": {"parent_group_id": "cbd35ee7-ed3c-4438-a7c5-f6b38375affb", "ip_protocol": "tempest-999-690152647", "from_port": 22, "to_port": 22}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:42.987549 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-4b8f12d3-7ede-4a74-a3d6-9a29298ab299 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] HTTP exception thrown: Invalid IP protocol tempest-999-690152647. Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b8f12d3-7ede-4a74-a3d6-9a29298ab299 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Request method failure captured: Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 156 Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEe0dpzFq_EJ0yFU5BC65zVnKQ_yHaKa06itUK5em_iIznsrrHXpmkwBwVdmbFxHSkVVyPFS0HwJq3Wk735Db2qNHVPEQcewybKjAjiKzz_iM96OXZLnFN1UvkowLxp7JgVzwLBGkejvXCpMdcFswvPzET0jHaI9tntjyni6-OmNj84 Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f52c02992f9240ee879fcb724897cfac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 2c61fb05d72f4f3a81b2ee723c6ce069 Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: {"security_group_rule": {"parent_group_id": "cbd35ee7-ed3c-4438-a7c5-f6b38375affb", "ip_protocol": "tempest-999-690152647", "from_port": 22, "to_port": 22}} Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid IP protocol tempest-999-690152647. Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cbd35ee7-ed3c-4438-a7c5-f6b38375affb', 'ip_protocol': 'tempest-999-690152647', 'from_port': 22, 'to_port': 22}}} Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-690152647. Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-690152647. Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:42.991846 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:42.995332 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:42.995332 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:42.995332 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:42.995332 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:42.995332 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:42.995332 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:42.995332 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-690152647. Aug 29 04:59:42.995332 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:42.997807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b8f12d3-7ede-4a74-a3d6-9a29298ab299 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Returning 400 to user: Invalid IP protocol tempest-999-690152647. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:43.000671 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b8f12d3-7ede-4a74-a3d6-9a29298ab299 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.572490 Aug 29 04:59:43.006338 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1165/2358] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:59:42 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 580 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 04:59:43.013946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:43.016241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:43.035526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:43.036312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:43.036983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:43.038399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:43.039384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:43.040625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:43.138964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:43.163472 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-95051cce-7107-429c-8b40-6435efaec08d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 200 len: 1494 microversion: 2.1 time: 0.761112 Aug 29 04:59:43.179781 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1194/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:42 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 1494 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:43.185034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:43.185694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:43.192523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:43.193309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:43.193904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:43.194983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:43.195630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:43.196284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:43.940095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:43.952903 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7512e0d3-4589-40da-9956-313b060fbe42 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 200 len: 1485 microversion: 2.1 time: 0.945195 Aug 29 04:59:43.956714 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1166/2360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:43 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 1485 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:43.961445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93ef66ca-430b-4347-bfed-4324c840f8db tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab97dff70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1969181312", "description": "tempest-description-1083998264"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:44.113812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:44.126470 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76f073e8-1959-4644-9f45-9bf56fdb01d1 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1324 microversion: 2.1 time: 0.944949 Aug 29 04:59:44.127679 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1195/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:43 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1324 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:44.134475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:44.135388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:44.144172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:44.145141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:44.146367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:44.147763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:44.148424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:44.149071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:44.591502 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-93ef66ca-430b-4347-bfed-4324c840f8db tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.633652 Aug 29 04:59:44.592929 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1167/2362] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:59:43 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:44.599603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c577dfb6-2867-4ea4-b61a-61f89f1a10c3 req-965774d2-282c-4e86-a3dc-997dfe1e986c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce6a237-7b7a-47ca-8206-662169d4e217", "name": "network-vif-deleted", "tag": "c317c09b-ba1c-4cc2-b754-4cfef303586b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:44.625263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c577dfb6-2867-4ea4-b61a-61f89f1a10c3 req-965774d2-282c-4e86-a3dc-997dfe1e986c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:44.625840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c577dfb6-2867-4ea4-b61a-61f89f1a10c3 req-965774d2-282c-4e86-a3dc-997dfe1e986c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:44.626334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c577dfb6-2867-4ea4-b61a-61f89f1a10c3 req-965774d2-282c-4e86-a3dc-997dfe1e986c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:44.641109 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c577dfb6-2867-4ea4-b61a-61f89f1a10c3 req-965774d2-282c-4e86-a3dc-997dfe1e986c service nova] Creating event network-vif-deleted:c317c09b-ba1c-4cc2-b754-4cfef303586b for instance 8ce6a237-7b7a-47ca-8206-662169d4e217 on n-h1-854119-9 Aug 29 04:59:44.648630 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c577dfb6-2867-4ea4-b61a-61f89f1a10c3 req-965774d2-282c-4e86-a3dc-997dfe1e986c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053632 Aug 29 04:59:44.649999 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1168/2363] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:44.658276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1fee9285-e472-40f2-a2d9-a3bab6df6f9a req-bef72d67-feb6-44f8-8847-507cea913b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cfe2c4-11f6-4b11-a3f6-3531a60966a2", "tag": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:44.672756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1fee9285-e472-40f2-a2d9-a3bab6df6f9a req-bef72d67-feb6-44f8-8847-507cea913b21 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:44.673433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1fee9285-e472-40f2-a2d9-a3bab6df6f9a req-bef72d67-feb6-44f8-8847-507cea913b21 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:44.674405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1fee9285-e472-40f2-a2d9-a3bab6df6f9a req-bef72d67-feb6-44f8-8847-507cea913b21 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:44.691285 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1fee9285-e472-40f2-a2d9-a3bab6df6f9a req-bef72d67-feb6-44f8-8847-507cea913b21 service nova] Creating event network-changed:77d571e0-5b8d-40da-8344-3e0ce0a6a8d9 for instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 on n-h1-854119-9 Aug 29 04:59:44.699495 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1fee9285-e472-40f2-a2d9-a3bab6df6f9a req-bef72d67-feb6-44f8-8847-507cea913b21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046038 Aug 29 04:59:44.700786 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1169/2364] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:44.708196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:44.709243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:44.720483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:44.721918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:44.722551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:44.723449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:44.724623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:44.725340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:44.743128 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 HTTP/1.1 Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8ce6a237-7b7a-47ca-8206-662169d4e217'} Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:44.745848 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:44.749214 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:44.749214 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:44.749214 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:44.749214 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:44.749214 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:44.749214 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 04:59:44.749214 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:44.751205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:44.752528 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7d70f8ca-bf02-441b-a653-4172b1a2f2f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 404 len: 111 microversion: 2.1 time: 0.049868 Aug 29 04:59:44.753633 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1170/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:44 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:59:44.759964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa803186-1362-45ed-8c46-ac2d39d52ce4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab9c15160>, body: {"security_group_rule": {"parent_group_id": "7888d7c2-be6b-4a58-afcb-8cfe8e7be66b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:44.901365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:44.919045 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-79c72a41-cd1a-455c-95e2-2192cd0fc89f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1487 microversion: 2.1 time: 0.789794 Aug 29 04:59:44.919691 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1196/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:44 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1487 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:44.946139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1544213638", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "57e28866-1c32-4826-b8f3-b2fdc024be39"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:45.014457 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-fa803186-1362-45ed-8c46-ac2d39d52ce4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 04:59:45.017605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] validate_networks() for [('57e28866-1c32-4826-b8f3-b2fdc024be39', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa803186-1362-45ed-8c46-ac2d39d52ce4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Request method failure captured: Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 138 Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEe0dpzFq_EJ0yFU5BC65zVnKQ_yHaKa06itUK5em_iIznsrrHXpmkwBwVdmbFxHSkVVyPFS0HwJq3Wk735Db2qNHVPEQcewybKjAjiKzz_iM96OXZLnFN1UvkowLxp7JgVzwLBGkejvXCpMdcFswvPzET0jHaI9tntjyni6-OmNj84 Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f52c02992f9240ee879fcb724897cfac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 2c61fb05d72f4f3a81b2ee723c6ce069 Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: {"security_group_rule": {"parent_group_id": "7888d7c2-be6b-4a58-afcb-8cfe8e7be66b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7888d7c2-be6b-4a58-afcb-8cfe8e7be66b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 04:59:45.018644 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.022071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa803186-1362-45ed-8c46-ac2d39d52ce4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:45.023274 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa803186-1362-45ed-8c46-ac2d39d52ce4 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.267797 Aug 29 04:59:45.023736 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1171/2367] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:59:44 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:59:45.028520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:45.029146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:45.038033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.038855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.039490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.040486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.041144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.041789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.073129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lazy-loading 'flavor' on Instance uuid ec43b062-7f3a-4331-8a9b-af76fe09a90d {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 04:59:45.173793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:45.198818 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e5ede947-4888-4b3c-82a9-cf0239fbf64c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d/action" status: 202 len: 0 microversion: 2.1 time: 0.173385 Aug 29 04:59:45.199863 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1172/2368] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:59:45 2022] POST /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:59:45.206517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:45.207275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: ca257379-780a-4815-8792-3b7356fff43f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:45.214007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.214393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.217544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.217544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.217544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.217544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.234387 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] HTTP exception thrown: Instance ca257379-780a-4815-8792-3b7356fff43f could not be found. Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Request method failure captured: Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f HTTP/1.1 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEXYR5twN_s37bXZ0eeliQvNreduYAJW88vypFFx7lC2pDMiC_8rXaOrKOyUxl0nAXZAb1z0fnUCrZYtKkyMz-vqBN8ulL9W7bwSX6rzTF2601pYMRoEYTw8ZOYno4RfPMOp3gzjuhszaFKe4fKwpKtoTJYm7vzwQ8iMNT_RgIz2zJw Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: bb84e6fe60b3405382ebd2c54aa67908 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-LiveMigrationTest-349516559 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb84e6fe60b3405382ebd2c54aa67908", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-LiveMigrationTest-349516559 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: bb84e6fe60b3405382ebd2c54aa67908 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-LiveMigrationTest-349516559 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-LiveMigrationTest-349516559-project Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: f5a5756b12204e9f9fbd7a2f3c5e1749 Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-LiveMigrationTest-349516559-project Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ca257379-780a-4815-8792-3b7356fff43f could not be found. Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ca257379-780a-4815-8792-3b7356fff43f'} Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca257379-780a-4815-8792-3b7356fff43f could not be found. Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca257379-780a-4815-8792-3b7356fff43f could not be found. Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:45.236382 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.239760 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:45.239760 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:45.239760 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:45.239760 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:45.239760 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:45.239760 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca257379-780a-4815-8792-3b7356fff43f could not be found. Aug 29 04:59:45.239760 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:45.241895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Returning 404 to user: Instance ca257379-780a-4815-8792-3b7356fff43f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:45.243286 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-638d76ae-c67d-48e0-9da5-c5522a6d77b1 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f" status: 404 len: 111 microversion: 2.1 time: 0.041962 Aug 29 04:59:45.246019 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1173/2369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:45 2022] GET /compute/v2.1/servers/ca257379-780a-4815-8792-3b7356fff43f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:59:45.254401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d203de09-a3b7-4793-97ac-c31fb322da5e tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab97eac10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-497428831", "description": "tempest-description-978374913"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:45.592346 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d203de09-a3b7-4793-97ac-c31fb322da5e tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.343154 Aug 29 04:59:45.593234 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1174/2370] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 04:59:45 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:45.598001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:45.598610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:45.613256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.615136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.615759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.617693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.618553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.619143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.725698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 04:59:45.726316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 04:59:45.726776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 04:59:45.727270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 04:59:45.728205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 04:59:45.745655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.746833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.747473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.748413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.749247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.750417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.775382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 04:59:45.789159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for user 4d3aaab47eb243c6bf9a0b2e512e7c4a and project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 04:59:45.800928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:45.806858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 04:59:45.810255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 04:59:45.814385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:45.824290 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e00a3de5-6228-452f-b1bf-a527996a5e7c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1324 microversion: 2.1 time: 0.229838 Aug 29 04:59:45.825771 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1175/2371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:45 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:45.832334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:45.833306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:45.840617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.841311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.842041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.842933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.843526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.844091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.882899 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7beb947a-51a3-45f6-ae45-56cb4fbfe758 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944001 Aug 29 04:59:45.884343 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1197/2372] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:59:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 04:59:45.898044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:45.900510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:45.917620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.918194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.918682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.919401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:45.919847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:45.920296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:45.956549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 04:59:46.031520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:46.043258 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5b268403-d15b-40b5-b991-4de331183d48 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1495 microversion: 2.1 time: 0.215567 Aug 29 04:59:46.068488 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1176/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:45 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1495 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:46.090826 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2ebeb7a7-4949-44f4-9ed0-c73f06e6b434 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 204 len: 0 microversion: 2.1 time: 0.204751 Aug 29 04:59:46.095131 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1198/2374] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 04:59:45 2022] DELETE /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 04:59:46.102479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e48462f-3f29-4918-a280-ddf79ff65cf8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:46.102479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e48462f-3f29-4918-a280-ddf79ff65cf8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:46.122397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ea9999c-76f1-4cfb-84a2-d8164c224c53 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab97e4ca0>, body: {"security_group_rule": {"parent_group_id": "556ebe01-bf94-41ed-a9a6-a6adee615cfe", "ip_protocol": "tcp", "from_port": 22, "to_port": 2016377210}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:46.165396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e48462f-3f29-4918-a280-ddf79ff65cf8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:46.188482 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e48462f-3f29-4918-a280-ddf79ff65cf8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1215 microversion: 2.1 time: 0.080519 Aug 29 04:59:46.189152 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1199/2375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:46 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:46.194191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:46.194805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:46.209020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:46.209744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:46.210520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:46.211479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:46.212680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:46.213494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:46.246028 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-1ea9999c-76f1-4cfb-84a2-d8164c224c53 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] HTTP exception thrown: Invalid port range 22:2016377210. Valid TCP ports should be between 1-65535 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ea9999c-76f1-4cfb-84a2-d8164c224c53 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Request method failure captured: Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 146 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEe0dpzFq_EJ0yFU5BC65zVnKQ_yHaKa06itUK5em_iIznsrrHXpmkwBwVdmbFxHSkVVyPFS0HwJq3Wk735Db2qNHVPEQcewybKjAjiKzz_iM96OXZLnFN1UvkowLxp7JgVzwLBGkejvXCpMdcFswvPzET0jHaI9tntjyni6-OmNj84 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f52c02992f9240ee879fcb724897cfac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 2c61fb05d72f4f3a81b2ee723c6ce069 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: {"security_group_rule": {"parent_group_id": "556ebe01-bf94-41ed-a9a6-a6adee615cfe", "ip_protocol": "tcp", "from_port": 22, "to_port": 2016377210}} Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid port range 22:2016377210. Valid TCP ports should be between 1-65535 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'security_group_rule': {'parent_group_id': '556ebe01-bf94-41ed-a9a6-a6adee615cfe', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2016377210}}} Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2016377210. Valid TCP ports should be between 1-65535 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2016377210. Valid TCP ports should be between 1-65535 Aug 29 04:59:46.248579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.251866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.251866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.251866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.251866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.251866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.251866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:46.251866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:46.251866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2016377210. Valid TCP ports should be between 1-65535 Aug 29 04:59:46.251866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.255396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ea9999c-76f1-4cfb-84a2-d8164c224c53 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Returning 400 to user: Invalid port range 22:2016377210. Valid TCP ports should be between 1-65535 {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:46.256595 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ea9999c-76f1-4cfb-84a2-d8164c224c53 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.186737 Aug 29 04:59:46.257726 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1177/2376] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:59:46 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:59:46.270065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce00ede3-ee72-4b6b-b64b-fa7edf8cb829 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Action: 'create', calling method: .version_select at 0x7f1ab9f03a60>, body: {"security_group_rule": {"parent_group_id": "67c363f9-962f-4b87-a677-266e3c6821cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:46.306678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-ce00ede3-ee72-4b6b-b64b-fa7edf8cb829 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 67c363f9-962f-4b87-a677-266e3c6821cd does not exist", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 04:59:46.307878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.security_group_api [None req-ce00ede3-ee72-4b6b-b64b-fa7edf8cb829 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Neutron security group 67c363f9-962f-4b87-a677-266e3c6821cd not found {{(pid=128871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 04:59:46.308852 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ce00ede3-ee72-4b6b-b64b-fa7edf8cb829 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] HTTP exception thrown: Security group 67c363f9-962f-4b87-a677-266e3c6821cd does not exist Aug 29 04:59:46.308852 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-4dd2e31e-af30-47c9-ba2c-279d94ccdbda'] Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce00ede3-ee72-4b6b-b64b-fa7edf8cb829 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Request method failure captured: Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 138 Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEe0dpzFq_EJ0yFU5BC65zVnKQ_yHaKa06itUK5em_iIznsrrHXpmkwBwVdmbFxHSkVVyPFS0HwJq3Wk735Db2qNHVPEQcewybKjAjiKzz_iM96OXZLnFN1UvkowLxp7JgVzwLBGkejvXCpMdcFswvPzET0jHaI9tntjyni6-OmNj84 Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f52c02992f9240ee879fcb724897cfac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 2c61fb05d72f4f3a81b2ee723c6ce069 Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: {"security_group_rule": {"parent_group_id": "67c363f9-962f-4b87-a677-266e3c6821cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: exception: Security group 67c363f9-962f-4b87-a677-266e3c6821cd does not exist Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-4dd2e31e-af30-47c9-ba2c-279d94ccdbda'] Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'security_group_rule': {'parent_group_id': '67c363f9-962f-4b87-a677-266e3c6821cd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 04:59:46.313712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 67c363f9-962f-4b87-a677-266e3c6821cd does not exist Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dd2e31e-af30-47c9-ba2c-279d94ccdbda'] Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 67c363f9-962f-4b87-a677-266e3c6821cd does not exist Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dd2e31e-af30-47c9-ba2c-279d94ccdbda'] Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 67c363f9-962f-4b87-a677-266e3c6821cd does not exist Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dd2e31e-af30-47c9-ba2c-279d94ccdbda'] Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 67c363f9-962f-4b87-a677-266e3c6821cd does not exist Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dd2e31e-af30-47c9-ba2c-279d94ccdbda'] Aug 29 04:59:46.317117 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.323301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce00ede3-ee72-4b6b-b64b-fa7edf8cb829 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Returning 404 to user: Security group 67c363f9-962f-4b87-a677-266e3c6821cd does not exist Aug 29 04:59:46.323301 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-4dd2e31e-af30-47c9-ba2c-279d94ccdbda'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:46.324297 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ce00ede3-ee72-4b6b-b64b-fa7edf8cb829 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.059725 Aug 29 04:59:46.324904 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1178/2377] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Aug 29 04:59:46 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:59:46.354622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d45b616c-c8c2-4eec-b9f8-1ba4df75fd36 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Calling method '.version_select at 0x7f1ab97a2ca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:46.403070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-d45b616c-c8c2-4eec-b9f8-1ba4df75fd36 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 882cae19-607f-4eec-8901-4162e86090dd does not exist", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 04:59:46.404022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.security_group_api [None req-d45b616c-c8c2-4eec-b9f8-1ba4df75fd36 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Neutron security group rule 882cae19-607f-4eec-8901-4162e86090dd not found {{(pid=128871) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 29 04:59:46.404713 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-d45b616c-c8c2-4eec-b9f8-1ba4df75fd36 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] HTTP exception thrown: Security group rule 882cae19-607f-4eec-8901-4162e86090dd does not exist Aug 29 04:59:46.404713 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-60a32950-4665-481a-8080-e30637a60449'] Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d45b616c-c8c2-4eec-b9f8-1ba4df75fd36 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Request method failure captured: Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/os-security-group-rules/882cae19-607f-4eec-8901-4162e86090dd HTTP/1.1 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEe0dpzFq_EJ0yFU5BC65zVnKQ_yHaKa06itUK5em_iIznsrrHXpmkwBwVdmbFxHSkVVyPFS0HwJq3Wk735Db2qNHVPEQcewybKjAjiKzz_iM96OXZLnFN1UvkowLxp7JgVzwLBGkejvXCpMdcFswvPzET0jHaI9tntjyni6-OmNj84 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f52c02992f9240ee879fcb724897cfac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f52c02992f9240ee879fcb724897cfac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f52c02992f9240ee879fcb724897cfac Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 2c61fb05d72f4f3a81b2ee723c6ce069 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-152974482-project Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: exception: Security group rule 882cae19-607f-4eec-8901-4162e86090dd does not exist Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-60a32950-4665-481a-8080-e30637a60449'] Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '882cae19-607f-4eec-8901-4162e86090dd'} Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 04:59:46.408203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 882cae19-607f-4eec-8901-4162e86090dd does not exist Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60a32950-4665-481a-8080-e30637a60449'] Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 882cae19-607f-4eec-8901-4162e86090dd does not exist Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60a32950-4665-481a-8080-e30637a60449'] Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 882cae19-607f-4eec-8901-4162e86090dd does not exist Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60a32950-4665-481a-8080-e30637a60449'] Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 882cae19-607f-4eec-8901-4162e86090dd does not exist Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60a32950-4665-481a-8080-e30637a60449'] Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d45b616c-c8c2-4eec-b9f8-1ba4df75fd36 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Returning 404 to user: Security group rule 882cae19-607f-4eec-8901-4162e86090dd does not exist Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-60a32950-4665-481a-8080-e30637a60449'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d45b616c-c8c2-4eec-b9f8-1ba4df75fd36 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/882cae19-607f-4eec-8901-4162e86090dd" status: 404 len: 199 microversion: 2.1 time: 0.076505 Aug 29 04:59:46.411929 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1179/2378] 10.222.0.20 () {58 vars in 1287 bytes} [Mon Aug 29 04:59:46 2022] DELETE /compute/v2.1/os-security-group-rules/882cae19-607f-4eec-8901-4162e86090dd => generated 199 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 04:59:46.419813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7d921ef8-f26f-4e2a-81db-158829668d3a tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Calling method '.version_select at 0x7f1ab97ead30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:46.537401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:46.546488 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5d85ff3-e95f-458e-a9ce-cc5853b6c9d9 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1501 microversion: 2.1 time: 0.355944 Aug 29 04:59:46.549037 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1200/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:46 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1501 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:46.555634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:46.556266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:46.563218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:46.563941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:46.564591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:46.565518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:46.566210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:46.566840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:46.583155 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] HTTP exception thrown: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Request method failure captured: Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf HTTP/1.1 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEZAJGdeOiucYGzlDwuGoQBdDxYTWsbgeaVXQF_AjGU7H_mp0Z5atQTnN3XgcCvcasq-CKQ85eNry_evn6K4j9AXZ4CHqxGSp00LTOGzF2sE1-eXhU0XgY4U67S8rB1ZMAo0ozEkK5UXVUdZ0DVI8dHacPeRRI42BQ4Gdj2VTorxDoo Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 4757ab0515fe4b6db413ebefc1251588 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TaggedBootDevicesTest-1738619472 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4757ab0515fe4b6db413ebefc1251588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4757ab0515fe4b6db413ebefc1251588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4757ab0515fe4b6db413ebefc1251588", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4757ab0515fe4b6db413ebefc1251588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TaggedBootDevicesTest-1738619472 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 4757ab0515fe4b6db413ebefc1251588 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1738619472 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TaggedBootDevicesTest-1738619472-project Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: ca81c4e0350646e58b67cc11892cd035 Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TaggedBootDevicesTest-1738619472-project Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'e3f35fea-40dd-43e9-9bf5-58c622aaefcf'} Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:59:46.585272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.588719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.590995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Returning 404 to user: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:46.592200 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f6aadc5a-fcfb-4e37-b07c-6935056a1494 tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 404 len: 111 microversion: 2.32 time: 0.040451 Aug 29 04:59:46.593275 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1201/2380] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 04:59:46 2022] DELETE /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:59:46.603815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:46.604833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] [instance: e3f35fea-40dd-43e9-9bf5-58c622aaefcf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:46.613381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:46.614324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:46.615039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:46.615969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:46.616709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:46.617404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:46.622844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:46.635093 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] HTTP exception thrown: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Request method failure captured: Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf HTTP/1.1 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEZAJGdeOiucYGzlDwuGoQBdDxYTWsbgeaVXQF_AjGU7H_mp0Z5atQTnN3XgcCvcasq-CKQ85eNry_evn6K4j9AXZ4CHqxGSp00LTOGzF2sE1-eXhU0XgY4U67S8rB1ZMAo0ozEkK5UXVUdZ0DVI8dHacPeRRI42BQ4Gdj2VTorxDoo Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 4757ab0515fe4b6db413ebefc1251588 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TaggedBootDevicesTest-1738619472 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4757ab0515fe4b6db413ebefc1251588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4757ab0515fe4b6db413ebefc1251588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4757ab0515fe4b6db413ebefc1251588", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4757ab0515fe4b6db413ebefc1251588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TaggedBootDevicesTest-1738619472 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 4757ab0515fe4b6db413ebefc1251588 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1738619472 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TaggedBootDevicesTest-1738619472-project Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: ca81c4e0350646e58b67cc11892cd035 Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TaggedBootDevicesTest-1738619472-project Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'e3f35fea-40dd-43e9-9bf5-58c622aaefcf'} Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.637266 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:46.641233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.641233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:46.641233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:46.641233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:46.641233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:46.641233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:46.641233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. Aug 29 04:59:46.641233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:46.641937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] Returning 404 to user: Instance e3f35fea-40dd-43e9-9bf5-58c622aaefcf could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:46.642277 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-252b58f8-bb31-4de8-b43a-ee45b6a57aab tempest-TaggedBootDevicesTest-1738619472 tempest-TaggedBootDevicesTest-1738619472-project] 10.222.0.20 "GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf" status: 404 len: 111 microversion: 2.32 time: 0.043834 Aug 29 04:59:46.645975 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1202/2381] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 04:59:46 2022] GET /compute/v2.1/servers/e3f35fea-40dd-43e9-9bf5-58c622aaefcf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 04:59:46.767213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-27bf8203-3c41-4b2c-a4de-5a631ba7c00f req-63cf0f81-be6c-4c0a-a25b-abea34bf7465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca257379-780a-4815-8792-3b7356fff43f", "name": "network-vif-deleted", "tag": "475dea98-d637-462b-a3e0-d1da0dcada7f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:46.797683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-27bf8203-3c41-4b2c-a4de-5a631ba7c00f req-63cf0f81-be6c-4c0a-a25b-abea34bf7465 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:46.798172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-27bf8203-3c41-4b2c-a4de-5a631ba7c00f req-63cf0f81-be6c-4c0a-a25b-abea34bf7465 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:46.798605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-27bf8203-3c41-4b2c-a4de-5a631ba7c00f req-63cf0f81-be6c-4c0a-a25b-abea34bf7465 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:46.830287 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-27bf8203-3c41-4b2c-a4de-5a631ba7c00f req-63cf0f81-be6c-4c0a-a25b-abea34bf7465 service nova] Creating event network-vif-deleted:475dea98-d637-462b-a3e0-d1da0dcada7f for instance ca257379-780a-4815-8792-3b7356fff43f on n-h2-854119-9 Aug 29 04:59:46.842227 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7d921ef8-f26f-4e2a-81db-158829668d3a tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/556ebe01-bf94-41ed-a9a6-a6adee615cfe" status: 202 len: 0 microversion: 2.1 time: 0.426170 Aug 29 04:59:46.842880 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1180/2382] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:59:46 2022] DELETE /compute/v2.1/os-security-groups/556ebe01-bf94-41ed-a9a6-a6adee615cfe => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:59:46.847253 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-27bf8203-3c41-4b2c-a4de-5a631ba7c00f req-63cf0f81-be6c-4c0a-a25b-abea34bf7465 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083915 Aug 29 04:59:46.851417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:46.852245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:46.852576 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1203/2383] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:59:46.861707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1086e2f0-a5a3-4276-9773-389c827fd992 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Calling method '.version_select at 0x7f1aba2a91f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:46.881316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:46.882038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:46.886732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:46.887494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:46.887978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:46.888500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:47.795371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:47.803222 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ae5cad6-2400-4219-8cef-950b9e2bf2d9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1324 microversion: 2.1 time: 0.955932 Aug 29 04:59:47.813954 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1181/2384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:46 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1324 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:47.818867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:47.819672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:47.831620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:47.832108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:47.832717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:47.833592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:47.835830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:47.836479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:48.188947 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1086e2f0-a5a3-4276-9773-389c827fd992 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/7888d7c2-be6b-4a58-afcb-8cfe8e7be66b" status: 202 len: 0 microversion: 2.1 time: 1.333960 Aug 29 04:59:48.189521 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1204/2385] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:59:46 2022] DELETE /compute/v2.1/os-security-groups/7888d7c2-be6b-4a58-afcb-8cfe8e7be66b => generated 0 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:59:48.194967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:48.196134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:48.211514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:48.212477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:48.216214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:48.217073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:48.218300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:48.218924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:48.387778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:48.404290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b66e79f-9d59-4b60-9fec-0cda1deb35ba tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1285 microversion: 2.1 time: 0.213465 Aug 29 04:59:48.406040 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1205/2386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:48 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1285 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:48.412328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:48.413469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:48.426811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:48.427586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:48.428332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:48.429405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:48.429986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:48.430691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:48.546440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:48.548201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a5756b12204e9f9fbd7a2f3c5e1749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb84e6fe60b3405382ebd2c54aa67908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:48.556945 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3dbf69db-e528-4a8b-a63b-c79bac8f5610 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 200 len: 1459 microversion: 2.1 time: 0.148964 Aug 29 04:59:48.558396 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0f3d7c2-4a6e-489e-91b7-36cc7d669ca4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1495 microversion: 2.1 time: 0.742770 Aug 29 04:59:48.559536 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1182/2387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:47 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1495 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:48.573080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1206/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:48 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 1459 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:48.577328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97e5d58b-54f2-40f4-bd04-dab91bf0d644 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Calling method '.version_select at 0x7f1abd90d9d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:48.940595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d91e39f-cf54-459e-8314-5ac83ca4bc14 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab97a24c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:49.005134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-97e5d58b-54f2-40f4-bd04-dab91bf0d644 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cbd35ee7-ed3c-4438-a7c5-f6b38375affb" status: 202 len: 0 microversion: 2.1 time: 0.443399 Aug 29 04:59:49.005857 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1207/2389] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:59:48 2022] DELETE /compute/v2.1/os-security-groups/cbd35ee7-ed3c-4438-a7c5-f6b38375affb => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:59:49.011691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:49.014087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:49.052211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.054406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.055108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.056600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.066686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.067739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.145292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d91e39f-cf54-459e-8314-5ac83ca4bc14 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.146205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d91e39f-cf54-459e-8314-5ac83ca4bc14 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.146970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d91e39f-cf54-459e-8314-5ac83ca4bc14 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.148035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d91e39f-cf54-459e-8314-5ac83ca4bc14 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.148835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d91e39f-cf54-459e-8314-5ac83ca4bc14 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.149582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d91e39f-cf54-459e-8314-5ac83ca4bc14 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.231154 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d91e39f-cf54-459e-8314-5ac83ca4bc14 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/1169f58d73f04cbfa5f210f79ff1e2c8" status: 200 len: 240 microversion: 2.36 time: 0.656688 Aug 29 04:59:49.232496 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1183/2390] 10.222.0.20 () {62 vars in 1303 bytes} [Mon Aug 29 04:59:48 2022] PUT /compute/v2.1/os-quota-sets/1169f58d73f04cbfa5f210f79ff1e2c8 => generated 240 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:59:49.238841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b5faa130-24d7-43fd-a71f-1474ecc10080 req-4ffe197c-a803-4d90-8c4e-cfde25f7258a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b208f5-b156-40d9-abb8-1cc1a0f0f348", "name": "network-vif-deleted", "tag": "f5871f66-d98c-45e7-82d7-a580d66552bd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:49.250817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b5faa130-24d7-43fd-a71f-1474ecc10080 req-4ffe197c-a803-4d90-8c4e-cfde25f7258a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.251575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b5faa130-24d7-43fd-a71f-1474ecc10080 req-4ffe197c-a803-4d90-8c4e-cfde25f7258a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.265329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b5faa130-24d7-43fd-a71f-1474ecc10080 req-4ffe197c-a803-4d90-8c4e-cfde25f7258a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.301387 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b5faa130-24d7-43fd-a71f-1474ecc10080 req-4ffe197c-a803-4d90-8c4e-cfde25f7258a service nova] Creating event network-vif-deleted:f5871f66-d98c-45e7-82d7-a580d66552bd for instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 on n-h2-854119-9 Aug 29 04:59:49.307336 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b5faa130-24d7-43fd-a71f-1474ecc10080 req-4ffe197c-a803-4d90-8c4e-cfde25f7258a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073030 Aug 29 04:59:49.308620 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1184/2391] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:49.327843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-347a4c7c-9cbd-4024-8af9-9e3bc93797bc tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Calling method '.version_select at 0x7f1ab97c5430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:49.362038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:49.374746 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dff4ecbf-2421-40d5-ac42-6eb9c112bb77 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1324 microversion: 2.1 time: 0.366540 Aug 29 04:59:49.379232 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1208/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:49 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1324 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:49.395330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb8365d1-7459-40f4-8bbf-3a716f2a26ac tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Calling method '.version_select at 0x7f1abd90d790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:49.561469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb8365d1-7459-40f4-8bbf-3a716f2a26ac tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.563067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb8365d1-7459-40f4-8bbf-3a716f2a26ac tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.563763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb8365d1-7459-40f4-8bbf-3a716f2a26ac tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.565715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb8365d1-7459-40f4-8bbf-3a716f2a26ac tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.566689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb8365d1-7459-40f4-8bbf-3a716f2a26ac tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.567900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb8365d1-7459-40f4-8bbf-3a716f2a26ac tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.602529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb8365d1-7459-40f4-8bbf-3a716f2a26ac tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/1169f58d73f04cbfa5f210f79ff1e2c8/detail" status: 200 len: 672 microversion: 2.36 time: 0.221841 Aug 29 04:59:49.603679 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1209/2393] 10.222.0.20 () {60 vars in 1304 bytes} [Mon Aug 29 04:59:49 2022] GET /compute/v2.1/os-quota-sets/1169f58d73f04cbfa5f210f79ff1e2c8/detail => generated 672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:59:49.610597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:49.611385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:49.620353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.620834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.621262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.622552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.623100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.623521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.719649 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-347a4c7c-9cbd-4024-8af9-9e3bc93797bc tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/82384bcc-b3c8-42ec-bbc7-55e3055e3aa1" status: 202 len: 0 microversion: 2.1 time: 0.409482 Aug 29 04:59:49.720440 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1185/2394] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:59:49 2022] DELETE /compute/v2.1/os-security-groups/82384bcc-b3c8-42ec-bbc7-55e3055e3aa1 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:59:49.725568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:49.726593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:49.741534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.742292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.743803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.759759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.760406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.762311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.925516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:49.935782 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4fc7bdf9-376d-40df-9406-01c06b2a594b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.330886 Aug 29 04:59:49.949692 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1210/2395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:49 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:49.954889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:49.956217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] [instance: 74b208f5-b156-40d9-abb8-1cc1a0f0f348] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:49.967651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.968606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.969403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.970246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:49.970890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:49.971331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:49.991883 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] HTTP exception thrown: Instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 could not be found. Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Request method failure captured: Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 HTTP/1.1 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEXYR5twN_s37bXZ0eeliQvNreduYAJW88vypFFx7lC2pDMiC_8rXaOrKOyUxl0nAXZAb1z0fnUCrZYtKkyMz-vqBN8ulL9W7bwSX6rzTF2601pYMRoEYTw8ZOYno4RfPMOp3gzjuhszaFKe4fKwpKtoTJYm7vzwQ8iMNT_RgIz2zJw Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: bb84e6fe60b3405382ebd2c54aa67908 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-LiveMigrationTest-349516559 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb84e6fe60b3405382ebd2c54aa67908", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb84e6fe60b3405382ebd2c54aa67908"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-LiveMigrationTest-349516559 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: bb84e6fe60b3405382ebd2c54aa67908 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-LiveMigrationTest-349516559 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-LiveMigrationTest-349516559-project Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f5a5756b12204e9f9fbd7a2f3c5e1749 Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-LiveMigrationTest-349516559-project Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 could not be found. Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '74b208f5-b156-40d9-abb8-1cc1a0f0f348'} Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 could not be found. Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 could not be found. Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 04:59:49.994009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 could not be found. Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] Returning 404 to user: Instance 74b208f5-b156-40d9-abb8-1cc1a0f0f348 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59849a5a-620f-4809-9457-8dc2d6b6f494 tempest-LiveMigrationTest-349516559 tempest-LiveMigrationTest-349516559-project] 10.222.0.20 "GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348" status: 404 len: 111 microversion: 2.1 time: 0.057763 Aug 29 04:59:49.997790 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1211/2396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:49 2022] GET /compute/v2.1/servers/74b208f5-b156-40d9-abb8-1cc1a0f0f348 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 04:59:50.009694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18aae747-89c3-41f2-96ee-bfa28c3d8313 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] Calling method '.version_select at 0x7f1abd90d040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:50.031074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:50.042910 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-62913728-cd18-407d-ade0-760ae1a3802c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 200 len: 1478 microversion: 2.1 time: 0.318036 Aug 29 04:59:50.043586 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1186/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:49 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 1478 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:50.056764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9d98550>, body: {"quota_set": {"ram": "2048"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:50.191535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.192035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:50.192496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:50.193233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.193685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:50.194106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:50.284648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.289990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:50.290457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:50.291487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.291951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:50.292396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:50.369687 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5f162df7-81a1-408d-83dc-e42f4b758d96 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/1169f58d73f04cbfa5f210f79ff1e2c8?user_id=bd28f1422dd54e8b9e5e00e39e40de12" status: 200 len: 240 microversion: 2.36 time: 0.324946 Aug 29 04:59:50.370996 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1187/2398] 10.222.0.20 () {62 vars in 1384 bytes} [Mon Aug 29 04:59:50 2022] PUT /compute/v2.1/os-quota-sets/1169f58d73f04cbfa5f210f79ff1e2c8?user_id=bd28f1422dd54e8b9e5e00e39e40de12 => generated 240 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:59:50.376350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-67fbf426-0380-42d6-8cb4-67c04f17634b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-573453393"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:50.378883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-67fbf426-0380-42d6-8cb4-67c04f17634b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:50.385674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fbf426-0380-42d6-8cb4-67c04f17634b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.386376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fbf426-0380-42d6-8cb4-67c04f17634b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:50.386976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fbf426-0380-42d6-8cb4-67c04f17634b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:50.388449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fbf426-0380-42d6-8cb4-67c04f17634b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.389125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fbf426-0380-42d6-8cb4-67c04f17634b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:50.389717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67fbf426-0380-42d6-8cb4-67c04f17634b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:50.562982 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18aae747-89c3-41f2-96ee-bfa28c3d8313 tempest-SecurityGroupRulesNegativeTestJSON-152974482 tempest-SecurityGroupRulesNegativeTestJSON-152974482-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/76406787-1db1-4486-bb34-2d7ba3ea9d55" status: 202 len: 0 microversion: 2.1 time: 0.565485 Aug 29 04:59:50.563563 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1212/2399] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 04:59:49 2022] DELETE /compute/v2.1/os-security-groups/76406787-1db1-4486-bb34-2d7ba3ea9d55 => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 04:59:50.572884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-67008901-c39f-4a74-a058-f4378f5da9d9 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] Calling method '.version_select at 0x7f1abd9154c0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:50.677717 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-67fbf426-0380-42d6-8cb4-67c04f17634b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d/action" status: 202 len: 0 microversion: 2.1 time: 0.299661 Aug 29 04:59:50.683842 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1188/2400] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 04:59:50 2022] POST /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 04:59:50.692220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:50.693202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:50.718663 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-67008901-c39f-4a74-a058-f4378f5da9d9 tempest-QuotasAdminTestV236-479603219 tempest-QuotasAdminTestV236-479603219-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/1169f58d73f04cbfa5f210f79ff1e2c8?user_id=bd28f1422dd54e8b9e5e00e39e40de12" status: 200 len: 282 microversion: 2.36 time: 0.149499 Aug 29 04:59:50.727894 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1213/2401] 10.222.0.20 () {60 vars in 1364 bytes} [Mon Aug 29 04:59:50 2022] GET /compute/v2.1/os-quota-sets/1169f58d73f04cbfa5f210f79ff1e2c8?user_id=bd28f1422dd54e8b9e5e00e39e40de12 => generated 282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 04:59:50.735621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d623199-f56c-4114-bd07-cf1204f0e610 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd90df70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:50.742700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.745737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:50.746699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:50.749304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.749782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:50.763608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:50.835259 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d623199-f56c-4114-bd07-cf1204f0e610 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.105598 Aug 29 04:59:50.837315 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1214/2402] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:50 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:50.961020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:50.962487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:50.983728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.984279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:50.996513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:50.997536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:50.999580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:51.000039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:51.143065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:51.157387 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f5edd84-a6e9-416e-8ba8-ee5ddc4e0ea8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1324 microversion: 2.1 time: 0.476496 Aug 29 04:59:51.158069 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1189/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:50 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:51.196772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-9691a15b-1f33-4525-975e-c982d642350b req-7d6b4f0d-3aea-41fc-a963-4a60fa929a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cfe2c4-11f6-4b11-a3f6-3531a60966a2", "name": "network-vif-plugged", "status": "completed", "tag": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:51.209113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9691a15b-1f33-4525-975e-c982d642350b req-7d6b4f0d-3aea-41fc-a963-4a60fa929a85 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:51.209881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9691a15b-1f33-4525-975e-c982d642350b req-7d6b4f0d-3aea-41fc-a963-4a60fa929a85 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:51.210757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9691a15b-1f33-4525-975e-c982d642350b req-7d6b4f0d-3aea-41fc-a963-4a60fa929a85 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:51.246182 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-9691a15b-1f33-4525-975e-c982d642350b req-7d6b4f0d-3aea-41fc-a963-4a60fa929a85 service nova] Creating event network-vif-plugged:77d571e0-5b8d-40da-8344-3e0ce0a6a8d9 for instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 on n-h1-854119-9 Aug 29 04:59:51.257083 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-9691a15b-1f33-4525-975e-c982d642350b req-7d6b4f0d-3aea-41fc-a963-4a60fa929a85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072249 Aug 29 04:59:51.258783 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1190/2404] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:59:51.557290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:51.570692 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa1efd18-cdcf-4e7e-bdfc-01250e124540 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.614919 Aug 29 04:59:51.575164 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1215/2405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:50 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:51.853477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ba6179e-96e0-48bc-af44-e6ef4f4331a3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab96188b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:51.917608 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ba6179e-96e0-48bc-af44-e6ef4f4331a3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.069886 Aug 29 04:59:51.918375 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1191/2406] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:51 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:52.180843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:52.181472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:52.197413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:52.199978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:52.200645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:52.202881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:52.203664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:52.211198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:52.559151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:52.569505 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b033137e-7622-48ea-adb6-b11fb6dce2b9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1324 microversion: 2.1 time: 0.393106 Aug 29 04:59:52.570102 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1216/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:52 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1324 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:52.595096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:52.596470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:52.610470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:52.611156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:52.612066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:52.613334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:52.614156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:52.614745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:52.841561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-27faee20-4edd-4465-9b42-eeb66e567edd req-55ea8f83-4b01-49d4-abd4-c53a8a44e369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65e5f2d-e369-4e32-a10f-d3c261c15e87", "tag": "1754cce9-2a4f-42a1-8b8a-f6943372486b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:52.860804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-27faee20-4edd-4465-9b42-eeb66e567edd req-55ea8f83-4b01-49d4-abd4-c53a8a44e369 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:52.861820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-27faee20-4edd-4465-9b42-eeb66e567edd req-55ea8f83-4b01-49d4-abd4-c53a8a44e369 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:52.863765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-27faee20-4edd-4465-9b42-eeb66e567edd req-55ea8f83-4b01-49d4-abd4-c53a8a44e369 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:52.888421 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-27faee20-4edd-4465-9b42-eeb66e567edd req-55ea8f83-4b01-49d4-abd4-c53a8a44e369 service nova] Creating event network-changed:1754cce9-2a4f-42a1-8b8a-f6943372486b for instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 on n-h1-854119-9 Aug 29 04:59:52.904099 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-27faee20-4edd-4465-9b42-eeb66e567edd req-55ea8f83-4b01-49d4-abd4-c53a8a44e369 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065936 Aug 29 04:59:52.905015 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1217/2408] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:59:52.933932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-360ff3c7-8101-40b3-ab07-a5e127ebfc1c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd91a430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:53.005210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-360ff3c7-8101-40b3-ab07-a5e127ebfc1c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.075402 Aug 29 04:59:53.015789 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1218/2409] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:52 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:53.298435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:53.307946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6dce0b9b-03da-492c-94f1-fc113fa603a1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.716867 Aug 29 04:59:53.316168 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1192/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:52 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:53.596685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:53.597614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:53.621025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:53.622926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:53.623569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:53.624530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:53.625300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:53.625908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:54.046012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4de4e81-982d-43ea-b412-9d3017df3d29 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9677040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:54.080704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:54.098425 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7f0936aa-adf9-44cc-993e-8c0f72f4603c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1520 microversion: 2.1 time: 0.507308 Aug 29 04:59:54.100893 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1219/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:53 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1520 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:54.123312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ca2eae93-7054-4d0c-a05d-04b976a71125 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Action: 'create', calling method: .version_select at 0x7f1abd87b3a0>, body: {"pool": null} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:54.161608 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4de4e81-982d-43ea-b412-9d3017df3d29 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.143420 Aug 29 04:59:54.174412 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1193/2412] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:54 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:54.339881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:54.340943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:54.352748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:54.359168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:54.359983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:54.361009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:54.361695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:54.362341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:55.254580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:55.266255 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-075b172d-3dda-42aa-921f-7b1633fbcc28 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.933327 Aug 29 04:59:55.274514 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1194/2413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:54 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:55.279531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-34675457-2bdf-4f2b-a776-0a40ba2fdcf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9e52940>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:55.369342 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-34675457-2bdf-4f2b-a776-0a40ba2fdcf8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.093587 Aug 29 04:59:55.370076 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1195/2414] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:55 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:55.505956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-93c1a5fc-5ef3-481e-a363-b3870c2dffe5 req-cc0600fb-7e54-44f3-af81-0758d1468671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec43b062-7f3a-4331-8a9b-af76fe09a90d", "name": "network-vif-plugged", "status": "completed", "tag": "3facff58-cf97-4f91-bc63-24d3df54d9eb"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:55.514748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 04:59:55.531486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-93c1a5fc-5ef3-481e-a363-b3870c2dffe5 req-cc0600fb-7e54-44f3-af81-0758d1468671 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:55.534141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-93c1a5fc-5ef3-481e-a363-b3870c2dffe5 req-cc0600fb-7e54-44f3-af81-0758d1468671 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:55.535014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-93c1a5fc-5ef3-481e-a363-b3870c2dffe5 req-cc0600fb-7e54-44f3-af81-0758d1468671 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:55.567306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-93c1a5fc-5ef3-481e-a363-b3870c2dffe5 req-cc0600fb-7e54-44f3-af81-0758d1468671 service nova] Creating event network-vif-plugged:3facff58-cf97-4f91-bc63-24d3df54d9eb for instance ec43b062-7f3a-4331-8a9b-af76fe09a90d on n-h1-854119-9 Aug 29 04:59:55.578144 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-93c1a5fc-5ef3-481e-a363-b3870c2dffe5 req-cc0600fb-7e54-44f3-af81-0758d1468671 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076507 Aug 29 04:59:55.581390 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1196/2415] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 04:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 04:59:56.295973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:56.297751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:56.326550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:56.331421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:56.332900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:56.334311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:56.335747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:56.337140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:56.747578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:56.759984 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f31366e3-2cd1-484e-a258-8d0944049ecc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.470316 Aug 29 04:59:56.760602 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1197/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:56 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:56.786426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2c6aade5-d242-4196-82a5-05950958ea31 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab95c7820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:56.884434 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2c6aade5-d242-4196-82a5-05950958ea31 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.109521 Aug 29 04:59:56.889219 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1198/2417] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:56 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:57.783974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:57.784655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:57.797726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:57.798222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:57.803819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:57.804758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:57.808071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:57.810279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:58.137803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 04:59:58.151121 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-04f0086d-e116-4c85-967e-25220317c1bb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.372037 Aug 29 04:59:58.157402 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1199/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:57 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 04:59:58.165893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-32729764-9714-4d43-a6be-d109a226532a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab95c7af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:58.191249 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ca2eae93-7054-4d0c-a05d-04b976a71125 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.075443 Aug 29 04:59:58.200270 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1220/2419] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 04:59:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 04:59:58.281527 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-32729764-9714-4d43-a6be-d109a226532a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.122725 Aug 29 04:59:58.286341 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1200/2420] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 04:59:58 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 04:59:58.489461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1218297729", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "264885bf-4295-4c69-814f-ea096817a42d"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 04:59:58.601647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] validate_networks() for [('264885bf-4295-4c69-814f-ea096817a42d', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 04:59:59.192841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 04:59:59.196263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 04:59:59.220836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:59.222042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:59.223019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:59.223930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 04:59:59.224632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 04:59:59.225352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 04:59:59.587037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=15 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:00.312972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=13 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:00.364208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=68 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:00.429054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:00.450809 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-27d19f20-4c07-401e-b6ac-34e5ccb158ea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 1.279857 Aug 29 05:00:00.468525 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1201/2421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 04:59:59 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:00.478580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa3b568d-345d-4c3f-bd02-6fc4edc752ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9555f70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:00.573973 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa3b568d-345d-4c3f-bd02-6fc4edc752ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.103045 Aug 29 05:00:00.574836 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1202/2422] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:00 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:00.706437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=78 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:00.909637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5790333a-c262-4b1a-bfd9-6bf8c0e4c01e tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Action: 'update', calling method: .version_select at 0x7f1ab9555280>, body: {"quota_set": {"ram": "5120"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:01.058929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5790333a-c262-4b1a-bfd9-6bf8c0e4c01e tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:01.059831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5790333a-c262-4b1a-bfd9-6bf8c0e4c01e tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:01.062517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5790333a-c262-4b1a-bfd9-6bf8c0e4c01e tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:01.063567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5790333a-c262-4b1a-bfd9-6bf8c0e4c01e tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:01.064795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5790333a-c262-4b1a-bfd9-6bf8c0e4c01e tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:01.065505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5790333a-c262-4b1a-bfd9-6bf8c0e4c01e tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:01.140501 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5790333a-c262-4b1a-bfd9-6bf8c0e4c01e tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/82caf8fd8b33474e826dea6f62919eee" status: 200 len: 148 microversion: 2.57 time: 0.564014 Aug 29 05:00:01.142194 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1203/2423] 10.222.0.20 () {62 vars in 1303 bytes} [Mon Aug 29 05:00:00 2022] PUT /compute/v2.1/os-quota-sets/82caf8fd8b33474e826dea6f62919eee => generated 148 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:00:01.154675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83bc58f6-ebd8-411b-a74f-79ca1d79afbd tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Calling method '.version_select at 0x7f1ab9548700>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:01.276238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83bc58f6-ebd8-411b-a74f-79ca1d79afbd tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:01.278257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83bc58f6-ebd8-411b-a74f-79ca1d79afbd tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:01.278925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83bc58f6-ebd8-411b-a74f-79ca1d79afbd tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:01.281052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83bc58f6-ebd8-411b-a74f-79ca1d79afbd tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:01.281797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83bc58f6-ebd8-411b-a74f-79ca1d79afbd tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:01.282439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83bc58f6-ebd8-411b-a74f-79ca1d79afbd tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:01.301500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:01.320836 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83bc58f6-ebd8-411b-a74f-79ca1d79afbd tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/82caf8fd8b33474e826dea6f62919eee/detail" status: 200 len: 463 microversion: 2.57 time: 0.171765 Aug 29 05:00:01.322945 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1204/2424] 10.222.0.20 () {60 vars in 1304 bytes} [Mon Aug 29 05:00:01 2022] GET /compute/v2.1/os-quota-sets/82caf8fd8b33474e826dea6f62919eee/detail => generated 463 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:00:01.483705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:01.485510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:01.521694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:01.539102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:01.540907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:01.541806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:01.545316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:01.546560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:01.649373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:00:01.650085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:00:01.650674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:00:01.651189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:00:01.651740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:00:01.669219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:01.670849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:01.671374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:01.673626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:01.674110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:01.676380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:01.723498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Getting quotas for project d0be48f9bd0347e7b2765f09ba0d50b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:01.735723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Getting quotas for user 5f9b5a46468f4cb79a0ec52a86f4482d and project d0be48f9bd0347e7b2765f09ba0d50b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:01.772846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:00:01.777365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:00:01.886255 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07732528-5595-4797-88a5-774a3c5a7b86 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.400896 Aug 29 05:00:01.893169 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1221/2425] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 04:59:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:00:01.907076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-705f5bb3-c2c1-4a86-afe3-289d285db446 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd968ee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:02.021160 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-705f5bb3-c2c1-4a86-afe3-289d285db446 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.126574 Aug 29 05:00:02.021981 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1222/2426] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:01 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:02.034455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Action: 'update', calling method: .version_select at 0x7f1abd946670>, body: {"quota_set": {"ram": "2048"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:02.173239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:02.185797 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-05f09348-ab87-445c-b8a3-862e387a7133 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.714040 Aug 29 05:00:02.189927 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1205/2427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:01 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:00:02.200303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8eb3ad8e-1abf-4827-b0a5-b52a2789b5f0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:02.202285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8eb3ad8e-1abf-4827-b0a5-b52a2789b5f0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:02.227982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:02.228945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:02.242112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:02.252659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:02.253318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:02.254013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:02.337938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:02.338602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:02.339182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:02.340076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:02.340694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:02.341936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:02.373625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8eb3ad8e-1abf-4827-b0a5-b52a2789b5f0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:02.390064 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8eb3ad8e-1abf-4827-b0a5-b52a2789b5f0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1224 microversion: 2.1 time: 0.197623 Aug 29 05:00:02.392832 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1206/2428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:02 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1224 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:02.591404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef079ef0-8622-43a5-b8a2-98b4c8be7c0d tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/82caf8fd8b33474e826dea6f62919eee?user_id=a84d9ea641e54fd99102df796df0d9c9" status: 200 len: 148 microversion: 2.57 time: 0.566803 Aug 29 05:00:02.595439 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1223/2429] 10.222.0.20 () {62 vars in 1384 bytes} [Mon Aug 29 05:00:02 2022] PUT /compute/v2.1/os-quota-sets/82caf8fd8b33474e826dea6f62919eee?user_id=a84d9ea641e54fd99102df796df0d9c9 => generated 148 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:00:02.603190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9d7de591-c5b2-4575-b7f1-78c8221d4654 tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] Calling method '.version_select at 0x7f1ab97df0d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:02.884199 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9d7de591-c5b2-4575-b7f1-78c8221d4654 tempest-QuotasAdminTestV257-746823001 tempest-QuotasAdminTestV257-746823001-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/82caf8fd8b33474e826dea6f62919eee?user_id=a84d9ea641e54fd99102df796df0d9c9" status: 200 len: 190 microversion: 2.57 time: 0.285090 Aug 29 05:00:02.895585 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1207/2430] 10.222.0.20 () {60 vars in 1364 bytes} [Mon Aug 29 05:00:02 2022] GET /compute/v2.1/os-quota-sets/82caf8fd8b33474e826dea6f62919eee?user_id=a84d9ea641e54fd99102df796df0d9c9 => generated 190 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:00:03.037392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b4259831-5026-44aa-af7c-ff1cdc93fcef tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd91adc0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:03.133730 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b4259831-5026-44aa-af7c-ff1cdc93fcef tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.101667 Aug 29 05:00:03.134564 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1224/2431] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:03 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:03.210688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:03.211444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:03.224435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:03.232712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:03.235696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:03.236967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:03.243063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:03.254873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:03.412253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:03.413003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:03.426658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:03.435496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:03.443093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:03.443891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:03.444406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:03.444841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:03.725979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:03.738611 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9708924d-c1f2-43df-a8ff-46036b83506d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1276 microversion: 2.1 time: 0.330314 Aug 29 05:00:03.744158 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1225/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:03 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1276 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:03.753005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1b2a01cc-ace2-4457-a59d-a203be73acd7 req-a8783268-72d7-40a0-9035-758d46a383d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65e5f2d-e369-4e32-a10f-d3c261c15e87", "name": "network-vif-plugged", "status": "completed", "tag": "1754cce9-2a4f-42a1-8b8a-f6943372486b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:03.777056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b2a01cc-ace2-4457-a59d-a203be73acd7 req-a8783268-72d7-40a0-9035-758d46a383d8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:03.780683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b2a01cc-ace2-4457-a59d-a203be73acd7 req-a8783268-72d7-40a0-9035-758d46a383d8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:03.781692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b2a01cc-ace2-4457-a59d-a203be73acd7 req-a8783268-72d7-40a0-9035-758d46a383d8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:03.843810 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1b2a01cc-ace2-4457-a59d-a203be73acd7 req-a8783268-72d7-40a0-9035-758d46a383d8 service nova] Creating event network-vif-plugged:1754cce9-2a4f-42a1-8b8a-f6943372486b for instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 on n-h1-854119-9 Aug 29 05:00:03.863972 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-1b2a01cc-ace2-4457-a59d-a203be73acd7 req-a8783268-72d7-40a0-9035-758d46a383d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117668 Aug 29 05:00:03.870364 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1226/2433] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:04.015638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:04.025899 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39952281-ac35-488c-8257-1a460a5cf408 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.819488 Aug 29 05:00:04.032457 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1208/2434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:03 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:00:04.151365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb082c0e-dcc4-4405-9de2-7982a10cb2eb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd907af0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:04.227328 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb082c0e-dcc4-4405-9de2-7982a10cb2eb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.081830 Aug 29 05:00:04.230410 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1227/2435] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:04 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:04.760492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:04.761769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:04.776508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:04.777229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:04.777830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:04.778573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:04.779118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:04.779443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:04.927952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:04.940171 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7a4e0c37-a168-4c2b-84d1-7057bcf2e21f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1282 microversion: 2.1 time: 0.183888 Aug 29 05:00:04.952918 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1209/2436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:04 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:05.057625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:05.058999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:05.081661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:05.082443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:05.084308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:05.088970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:05.089697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:05.090318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:05.245315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-59a2aa70-4325-4d07-9da7-efc5af5fbf59 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9555550>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:05.346245 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-59a2aa70-4325-4d07-9da7-efc5af5fbf59 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.105293 Aug 29 05:00:05.347489 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1210/2437] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:05 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:05.769241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:05.783060 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b02f3e30-cc21-477b-8e86-aec5b44999b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.730389 Aug 29 05:00:05.784658 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1228/2438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:05 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:05.965546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:05.966160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:05.984226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:05.984765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:05.985176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:05.985907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:05.986360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:05.986785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:06.134355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:06.144851 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ecb30e4e-ca7f-4e0d-8893-06622dcf6713 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1282 microversion: 2.1 time: 0.183238 Aug 29 05:00:06.159839 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1211/2439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:05 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1282 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:06.361519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f444d294-467e-461a-a87d-41ad6b2b8f73 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd89bd30>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:06.451022 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f444d294-467e-461a-a87d-41ad6b2b8f73 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.093262 Aug 29 05:00:06.452180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1229/2440] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:06 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:06.806143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:06.807537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:06.819382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:06.820150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:06.823284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:06.825216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:06.825847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:06.827064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:07.168146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:07.168834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:07.184466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:07.189534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:07.192533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:07.193649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:07.195466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:07.196380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:07.199256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:07.695117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:07.707857 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a57a78fc-1014-468c-a36b-82d2668d742c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1324 microversion: 2.1 time: 0.544902 Aug 29 05:00:07.709891 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1230/2441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:07 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1324 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:00:07.726444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb8d3aa9-83d1-4038-90ac-677d6a671f0a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd87a3a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:07.762255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:07.770715 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f55cfe70-02fe-400c-aced-68ffa3c54b09 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1315 microversion: 2.1 time: 0.968572 Aug 29 05:00:07.773718 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1212/2442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:06 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:07.840927 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb8d3aa9-83d1-4038-90ac-677d6a671f0a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.121378 Aug 29 05:00:07.841543 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1231/2443] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:07 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:08.732702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:08.733312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:08.744465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:08.747051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:08.747697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:08.748629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:08.749224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:08.754186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:08.799115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:08.804012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:08.816704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:08.817567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:08.818187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:08.819219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:08.820376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:08.820995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:09.516303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:09.532574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f0c71ecb-48c1-4d49-805c-2f32402b4264 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1502 microversion: 2.1 time: 0.741401 Aug 29 05:00:09.536914 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1232/2444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:08 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1502 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:00:09.547667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4deb4c51-d0cb-4548-85ed-871e2788941a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd87a3a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:09.638783 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4deb4c51-d0cb-4548-85ed-871e2788941a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.100477 Aug 29 05:00:09.639501 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1233/2445] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:09 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:09.651034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:09.657786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:09.670662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:09.672650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:09.673346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:09.678489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:09.680495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:09.681102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:09.687232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:09.720809 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc163da0-d1d8-47bd-83a8-5fbc9fbbe69d tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1324 microversion: 2.1 time: 0.992036 Aug 29 05:00:09.728832 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1213/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:08 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1324 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:09.749778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lazy-loading 'flavor' on Instance uuid b65e5f2d-e369-4e32-a10f-d3c261c15e87 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:00:09.799237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-2d15d8fd-4d18-4f28-8376-8fc6f9eef6d4 req-37a88a19-d179-4d7c-92b6-e8d86113bcbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7894a837-4098-4a9b-9fcf-dd5f7d1a5d31", "tag": "4f42455f-dfe0-430a-9e5a-e6570d1bdc4d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:09.839861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2d15d8fd-4d18-4f28-8376-8fc6f9eef6d4 req-37a88a19-d179-4d7c-92b6-e8d86113bcbe service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:09.840384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2d15d8fd-4d18-4f28-8376-8fc6f9eef6d4 req-37a88a19-d179-4d7c-92b6-e8d86113bcbe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:09.846559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2d15d8fd-4d18-4f28-8376-8fc6f9eef6d4 req-37a88a19-d179-4d7c-92b6-e8d86113bcbe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:09.887333 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2d15d8fd-4d18-4f28-8376-8fc6f9eef6d4 req-37a88a19-d179-4d7c-92b6-e8d86113bcbe service nova] Creating event network-changed:4f42455f-dfe0-430a-9e5a-e6570d1bdc4d for instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 on n-h1-854119-9 Aug 29 05:00:09.904061 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-2d15d8fd-4d18-4f28-8376-8fc6f9eef6d4 req-37a88a19-d179-4d7c-92b6-e8d86113bcbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109942 Aug 29 05:00:09.907490 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1214/2447] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:10.014926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:10.258404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0e84d51f-b03c-403c-a546-3132cde82b47 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87/action" status: 202 len: 0 microversion: 2.1 time: 0.615216 Aug 29 05:00:10.259491 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1234/2448] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:00:09 2022] POST /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:00:10.268099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:10.268852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:10.279922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:10.280460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:10.281074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:10.281794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:10.282266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:10.282696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:10.656617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0f098bfb-a7d8-4ebc-8f3a-e50c6eaa48a7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab98ae3a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:10.749169 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0f098bfb-a7d8-4ebc-8f3a-e50c6eaa48a7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.098497 Aug 29 05:00:10.757207 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1235/2449] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:10 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:10.773659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:10.774446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:10.796226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:10.796738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:10.797178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:10.797896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:10.798356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:10.798782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:11.220956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:11.234171 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8343abc9-3e42-43a1-97c2-3a18fb0e556c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.970142 Aug 29 05:00:11.248567 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1215/2450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:10 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:11.548096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:11.560029 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16c5b09a-b0a3-4518-a159-1ac8145b2af0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1324 microversion: 2.1 time: 0.793382 Aug 29 05:00:11.566009 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1236/2451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:10 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1324 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:11.771021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8620b46-aed9-4e05-b437-72aa6bf0fa8e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9677dc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:11.781446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:12.254796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:12.255663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:12.274821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:12.275726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:12.278932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:12.281526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:12.284452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:12.285078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:12.420449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=7 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:12.465151 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8620b46-aed9-4e05-b437-72aa6bf0fa8e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.698158 Aug 29 05:00:12.466311 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1216/2452] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:11 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:12.472389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0db4bf43-9bdb-42fa-a19a-c80912f403f6 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Calling method '.version_select at 0x7f1ab97a2820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:12.530676 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0db4bf43-9bdb-42fa-a19a-c80912f403f6 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff" status: 200 len: 636 microversion: 2.1 time: 0.063083 Aug 29 05:00:12.531457 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1217/2453] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:12 2022] GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff => generated 636 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:12.541033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=18 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:12.552713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9f5e3459-41d2-43c0-8392-afa0e44d0f80 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Action: 'update_all', calling method: .version_select at 0x7f1ab97eac10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:12.665976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9f5e3459-41d2-43c0-8392-afa0e44d0f80 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:12.676469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9f5e3459-41d2-43c0-8392-afa0e44d0f80 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for user f020d9579b6b4f6e8a515f02ddfa7ab2 and project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:13.168451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:13.177909 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80a5e879-50fb-4b1b-8e72-4c4fe861b96d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.926894 Aug 29 05:00:13.188736 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1237/2454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:12 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:13.188736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:13.188736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:13.204293 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9f5e3459-41d2-43c0-8392-afa0e44d0f80 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.659008 Aug 29 05:00:13.209131 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1218/2455] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:00:12 2022] PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 61 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:13.211731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:13.212832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:13.213508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:13.214507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:13.215217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:13.215868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:13.220809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf569fd4-d8fd-4888-9288-558da24b83e4 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Calling method '.version_select at 0x7f1ab97a2670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:13.721484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:13.733155 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf569fd4-d8fd-4888-9288-558da24b83e4 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "DELETE /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.522291 Aug 29 05:00:13.735057 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1219/2456] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Aug 29 05:00:13 2022] DELETE /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata/os_version => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:13.740505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5244896a-6c88-41c5-8812-d9f3ba7c769d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9e529d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:13.744504 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c1cc1795-bf9a-464c-ae83-0119ea1336f9 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1324 microversion: 2.1 time: 0.563112 Aug 29 05:00:13.757399 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1238/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:13 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1324 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:13.762988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c90486f3-587f-4735-a566-ccd10c4ed95f tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Calling method '.version_select at 0x7f1abd98a670>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:13.860945 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5244896a-6c88-41c5-8812-d9f3ba7c769d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.124544 Aug 29 05:00:13.862122 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1220/2458] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:13 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:13.897145 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c90486f3-587f-4735-a566-ccd10c4ed95f tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 37 microversion: 2.1 time: 0.138079 Aug 29 05:00:13.904786 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1239/2459] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 05:00:13 2022] GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 37 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:13.913726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-abbc522d-9eb9-4a07-96ea-53d14875af25 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Action: 'update_all', calling method: .version_select at 0x7f1ab967dc10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:14.006577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-abbc522d-9eb9-4a07-96ea-53d14875af25 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:14.024434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-abbc522d-9eb9-4a07-96ea-53d14875af25 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for user f020d9579b6b4f6e8a515f02ddfa7ab2 and project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:14.205158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:14.206539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:14.239158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:14.239681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:14.241121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:14.247461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:14.248394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:14.248855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:14.498200 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:00:14.498608 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:00:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata (ip 10.222.0.20) !!! Aug 29 05:00:14.523620 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-abbc522d-9eb9-4a07-96ea-53d14875af25 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.618557 Aug 29 05:00:14.531371 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1221/2460] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:00:13 2022] PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 61 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:00:14.537915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-07050353-c3d4-47ad-984b-324e71ba7baf tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Calling method '.version_select at 0x7f1ab967dca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:14.614912 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-07050353-c3d4-47ad-984b-324e71ba7baf tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.081789 Aug 29 05:00:14.615643 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1222/2461] 10.222.0.20 () {58 vars in 1290 bytes} [Mon Aug 29 05:00:14 2022] GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata/os_distro => generated 33 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:14.628690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0cc47352-3769-411a-98e0-bb29643122ae tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Action: 'update_all', calling method: .version_select at 0x7f1ab96e5790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:14.724925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0cc47352-3769-411a-98e0-bb29643122ae tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:14.755304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0cc47352-3769-411a-98e0-bb29643122ae tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for user f020d9579b6b4f6e8a515f02ddfa7ab2 and project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:14.809676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:14.825871 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-72055bbc-d832-4a02-972c-d3e806b1bcbe tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.627068 Aug 29 05:00:14.840488 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1240/2462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:14 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:14.846819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:14.848223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:14.855673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:14.856446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:14.857230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:14.858745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:14.859387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:14.860000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:15.057460 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0cc47352-3769-411a-98e0-bb29643122ae tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.433556 Aug 29 05:00:15.062096 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1223/2463] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:00:14 2022] PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 61 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:15.064938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e435393-38fc-4274-8b7d-8b994bf4f505 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9555a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:15.161903 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e435393-38fc-4274-8b7d-8b994bf4f505 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.101741 Aug 29 05:00:15.162490 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1224/2464] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:15 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:15.178898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54411534-f2c7-489a-8340-bae05c6e6867 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Calling method '.version_select at 0x7f1ab9e85ca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:15.292249 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54411534-f2c7-489a-8340-bae05c6e6867 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.119035 Aug 29 05:00:15.293116 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1225/2465] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 05:00:15 2022] GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 61 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:15.305226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7d8666c1-eae6-46f1-bebd-7230d412f54f tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Action: 'update_all', calling method: .version_select at 0x7f1ab95553a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:15.391582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7d8666c1-eae6-46f1-bebd-7230d412f54f tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:15.404281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7d8666c1-eae6-46f1-bebd-7230d412f54f tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for user f020d9579b6b4f6e8a515f02ddfa7ab2 and project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:15.715674 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7d8666c1-eae6-46f1-bebd-7230d412f54f tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.414615 Aug 29 05:00:15.716706 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1226/2466] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:00:15 2022] PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 61 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:00:15.734560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9f8e4c8-9ce1-4dba-a615-b07c97ac9494 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Action: 'update_all', calling method: .version_select at 0x7f1ab967d4c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:15.820264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b9f8e4c8-9ce1-4dba-a615-b07c97ac9494 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:15.843532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b9f8e4c8-9ce1-4dba-a615-b07c97ac9494 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for user f020d9579b6b4f6e8a515f02ddfa7ab2 and project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:16.263184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:16.273058 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba3a020d-1b10-4974-b86a-03680c09c355 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1324 microversion: 2.1 time: 1.430451 Aug 29 05:00:16.280170 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1241/2467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:14 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1324 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:16.299725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:16.311374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:16.340532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:16.341381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:16.342053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:16.342937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:16.344368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:16.345041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:16.431309 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b9f8e4c8-9ce1-4dba-a615-b07c97ac9494 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 64 microversion: 2.1 time: 0.705174 Aug 29 05:00:16.431919 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1227/2468] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:00:15 2022] PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 64 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:00:16.437646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3893a6dc-4d3d-4310-8b14-02949b8fd65c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab951f4c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:16.503626 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3893a6dc-4d3d-4310-8b14-02949b8fd65c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.070594 Aug 29 05:00:16.504235 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1228/2469] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:16 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:16.508797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8b92dbe-48ee-4e55-b806-6c753460dec6 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Calling method '.version_select at 0x7f1ab951fca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:16.572727 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8b92dbe-48ee-4e55-b806-6c753460dec6 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 64 microversion: 2.1 time: 0.067147 Aug 29 05:00:16.573757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1229/2470] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 05:00:16 2022] GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 64 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:16.585062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c6ddaad5-2ae5-4078-b7b4-6d3ebfcaafb6 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Action: 'update_all', calling method: .version_select at 0x7f1ab951f1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:16.669147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c6ddaad5-2ae5-4078-b7b4-6d3ebfcaafb6 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:16.698446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c6ddaad5-2ae5-4078-b7b4-6d3ebfcaafb6 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for user f020d9579b6b4f6e8a515f02ddfa7ab2 and project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:16.729078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:17.364985 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c6ddaad5-2ae5-4078-b7b4-6d3ebfcaafb6 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.783465 Aug 29 05:00:17.366888 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1230/2471] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:00:16 2022] PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 61 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:00:17.372424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:17.373966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:17.382004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:17.382602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:17.383211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:17.383888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:17.384659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:17.385681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:18.497585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:18.509439 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bae0d942-834a-4ce3-ba00-a7a890f6f473 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1324 microversion: 2.1 time: 1.141292 Aug 29 05:00:18.515724 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1231/2472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:17 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1324 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:18.533884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-49b722bc-81a3-4942-8b5c-6dd8364fdb07 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Action: 'update', calling method: .version_select at 0x7f1abd884af0>, body: {"meta": {"os_version": "alt"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:18.638422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:18.646436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c1a4c6c9-10ca-43b4-a234-634a4f5a6a07 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 2.365054 Aug 29 05:00:18.647021 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1242/2473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:16 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:18.657669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6919911-a11f-4d5d-a348-fff0ecc32710 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd968670>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:19.182003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-49b722bc-81a3-4942-8b5c-6dd8364fdb07 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:19.187269 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f6919911-a11f-4d5d-a348-fff0ecc32710 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.533318 Aug 29 05:00:19.188178 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1243/2474] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:18 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:19.198387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-49b722bc-81a3-4942-8b5c-6dd8364fdb07 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for user f020d9579b6b4f6e8a515f02ddfa7ab2 and project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:19.539983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:19.540911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:19.556692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:19.557529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:19.558161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:19.559062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:19.559700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:19.560354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:19.682128 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-49b722bc-81a3-4942-8b5c-6dd8364fdb07 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.164207 Aug 29 05:00:19.688885 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1232/2475] 10.222.0.20 () {60 vars in 1313 bytes} [Mon Aug 29 05:00:18 2022] PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata/os_version => generated 31 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:19.695229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-58afe1b4-b422-4600-a122-41ffde29b064 req-4297a3b4-b3a1-4fed-b526-cb183e9ae291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7894a837-4098-4a9b-9fcf-dd5f7d1a5d31", "name": "network-vif-plugged", "status": "completed", "tag": "4f42455f-dfe0-430a-9e5a-e6570d1bdc4d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:19.714658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-58afe1b4-b422-4600-a122-41ffde29b064 req-4297a3b4-b3a1-4fed-b526-cb183e9ae291 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:19.715429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-58afe1b4-b422-4600-a122-41ffde29b064 req-4297a3b4-b3a1-4fed-b526-cb183e9ae291 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:19.715999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-58afe1b4-b422-4600-a122-41ffde29b064 req-4297a3b4-b3a1-4fed-b526-cb183e9ae291 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:19.731928 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-58afe1b4-b422-4600-a122-41ffde29b064 req-4297a3b4-b3a1-4fed-b526-cb183e9ae291 service nova] Creating event network-vif-plugged:4f42455f-dfe0-430a-9e5a-e6570d1bdc4d for instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 on n-h1-854119-9 Aug 29 05:00:19.744316 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-58afe1b4-b422-4600-a122-41ffde29b064 req-4297a3b4-b3a1-4fed-b526-cb183e9ae291 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053019 Aug 29 05:00:19.745470 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1233/2476] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:19.751578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:19.752614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:19.760730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:19.762204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:19.762827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:19.765175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:19.765902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:19.766528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:20.588660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:20.598463 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-15754d9f-a55c-4faa-912b-ddba8cbdc58e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1324 microversion: 2.1 time: 1.063244 Aug 29 05:00:20.611684 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1244/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:19 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1324 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:20.622088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e81397f9-5b32-4e54-95fb-4224ec720b88 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Calling method '.version_select at 0x7f1ab95b8550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:20.677136 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e81397f9-5b32-4e54-95fb-4224ec720b88 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 58 microversion: 2.1 time: 0.075835 Aug 29 05:00:20.678460 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1245/2478] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 05:00:20 2022] GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 58 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:20.684285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7304ed10-a6dc-44e0-8674-afcca790b145 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1abd90a4c0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:20.714991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:20.724291 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16de9171-a361-435e-8045-c0bfe214ac0d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.977238 Aug 29 05:00:20.726993 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1234/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:19 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:20.736741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83133a7f-7d87-4348-bcab-4d94a35460db tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Action: 'update_all', calling method: .version_select at 0x7f1ab951f5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:20.822593 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7304ed10-a6dc-44e0-8674-afcca790b145 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1437 microversion: 2.1 time: 0.142575 Aug 29 05:00:20.825189 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1246/2480] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:20 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1437 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:20.854871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-83133a7f-7d87-4348-bcab-4d94a35460db tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:20.865565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-83133a7f-7d87-4348-bcab-4d94a35460db tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for user f020d9579b6b4f6e8a515f02ddfa7ab2 and project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:21.301134 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83133a7f-7d87-4348-bcab-4d94a35460db tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.571824 Aug 29 05:00:21.301720 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1235/2481] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:00:20 2022] PUT /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 61 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:21.311529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3bcd85b0-91ed-4860-805f-d5752011b779 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Action: 'create', calling method: .version_select at 0x7f1abd968700>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:21.440823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-3bcd85b0-91ed-4860-805f-d5752011b779 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:21.457823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-3bcd85b0-91ed-4860-805f-d5752011b779 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Getting quotas for user f020d9579b6b4f6e8a515f02ddfa7ab2 and project 904080847e9849ae9c758da752b9a2da. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:21.619086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:21.619705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:21.642824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:21.643397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:21.643837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:21.644631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:21.645085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:21.646665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:22.152383 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3bcd85b0-91ed-4860-805f-d5752011b779 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "POST /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 85 microversion: 2.1 time: 0.844863 Aug 29 05:00:22.157672 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1247/2482] 10.222.0.20 () {60 vars in 1281 bytes} [Mon Aug 29 05:00:21 2022] POST /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 85 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:22.289634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:22.304398 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2c12ae55-2c46-4075-9463-96b5a05f9567 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1324 microversion: 2.1 time: 0.689233 Aug 29 05:00:22.308552 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1236/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:21 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1324 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:00:22.324103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:22.325269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:22.326793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1839003608", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:22.333411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:22.333907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:22.334342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:22.335052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:22.335507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:22.335930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:22.398838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:00:22.626335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:22.639826 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5448b367-3ff3-467e-b44f-a073d4442937 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.328880 Aug 29 05:00:22.641516 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1237/2484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:22 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:22.656503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c8b51383-8c0c-42cb-a9f9-36255a27ba1c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9677a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:22.733654 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c8b51383-8c0c-42cb-a9f9-36255a27ba1c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1446 microversion: 2.1 time: 0.090257 Aug 29 05:00:22.748269 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1238/2485] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:22 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:22.753697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de1a504b-935e-47f5-a18a-da9212ab17f1 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] Calling method '.version_select at 0x7f1abd7d1040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:22.801264 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de1a504b-935e-47f5-a18a-da9212ab17f1 tempest-ImagesMetadataTestJSON-972506842 tempest-ImagesMetadataTestJSON-972506842-project] 10.222.0.20 "GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata" status: 200 len: 85 microversion: 2.1 time: 0.051500 Aug 29 05:00:22.802129 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1239/2486] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 05:00:22 2022] GET /compute/v2.1/images/85f324c9-86ea-4874-b673-36c1da1b45ff/metadata => generated 85 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:00:22.822770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9ef318e-6673-4148-b4e6-07fcbe3210ac tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab97e4940>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:22.893245 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b9ef318e-6673-4148-b4e6-07fcbe3210ac tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 200 len: 1446 microversion: 2.1 time: 0.089389 Aug 29 05:00:22.894364 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1240/2487] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:00:22 2022] GET /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:22.907707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-36286be0-de6e-4d34-a218-d6691333676a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab95c7040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:23.710168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:00:23.710618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:00:23.711060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:00:23.711545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:00:23.711961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:00:23.730235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:23.734313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:23.734313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:23.736980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:23.737532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:23.740383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:23.791899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Getting quotas for project 3cd6136711c248539c04a2b2dd8fae78. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:23.802769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Getting quotas for user 7368462223bb4007b69efb0c864eb010 and project 3cd6136711c248539c04a2b2dd8fae78. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:23.841502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:00:23.854518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:00:23.971793 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-36286be0-de6e-4d34-a218-d6691333676a tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 204 len: 0 microversion: 2.1 time: 1.067905 Aug 29 05:00:23.976514 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1241/2488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:22 2022] DELETE /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 0 bytes in 1073 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:23.982807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:23.984675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:23.992753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:23.993679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:23.994493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:23.996601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:23.997259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:23.998207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:24.013655 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2879b273-5ecd-435f-9ae7-7a92d3c34e3a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859049 Aug 29 05:00:24.014477 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1248/2489] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:00:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:00:24.048928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:24.053438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:24.064797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:24.065298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:24.066066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:24.067008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:24.067480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:24.068807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:24.687617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:24.698475 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7ada6c77-35db-4ba7-8aa7-e465c9e4a6b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1521 microversion: 2.1 time: 0.720109 Aug 29 05:00:24.699899 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1242/2490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:23 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1521 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:24.708381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:24.711183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:24.725859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:24.729650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:24.730594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:24.731534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:24.732209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:24.732835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:24.786297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:00:24.822507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:24.853236 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-54eaefff-bb5c-4334-9e4f-70376e9d104a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.828672 Aug 29 05:00:24.854706 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1249/2491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:24 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:24.860538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38522ebd-da58-4f15-a6ab-7b29e3c62be8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:24.861354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-38522ebd-da58-4f15-a6ab-7b29e3c62be8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:24.957309 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1dd5eae9-6e3d-472b-bc1b-ab9d065172cd tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 204 len: 0 microversion: 2.1 time: 0.255834 Aug 29 05:00:24.958148 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1243/2492] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:00:24 2022] DELETE /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:24.975391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.141"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:24.975391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:24.988054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:24.988928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:24.990062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:24.991383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:24.992762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:24.993691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:25.058192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "refresh_cache-11cfe2c4-11f6-4b11-a3f6-3531a60966a2" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 05:00:25.064806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquired lock "refresh_cache-11cfe2c4-11f6-4b11-a3f6-3531a60966a2" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 05:00:25.342190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-38522ebd-da58-4f15-a6ab-7b29e3c62be8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:25.360304 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-38522ebd-da58-4f15-a6ab-7b29e3c62be8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1219 microversion: 2.1 time: 0.504266 Aug 29 05:00:25.360895 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1250/2493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:24 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1219 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:25.366206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2076119127", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "c1c2b0fe-774a-41d7-804b-9b252b4c0fcb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:25.442285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] validate_networks() for [('c1c2b0fe-774a-41d7-804b-9b252b4c0fcb', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:00:27.525702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:00:27.526374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:00:27.526579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:00:27.527159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:00:27.527716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:00:27.545451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:27.546342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:27.548143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:27.548939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:27.549406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:27.549836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:27.603929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Getting quotas for project e88260cc20924f92a617cc231ad24f77. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:27.609596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Getting quotas for user da246be637924c248fa3746468546f00 and project e88260cc20924f92a617cc231ad24f77. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:27.636007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:00:27.638232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:00:27.737247 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ceb3825-614b-41db-b454-b036326a0e33 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.375119 Aug 29 05:00:27.738067 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1251/2494] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:00:27.743025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1b12f321-adf0-492c-846c-37877b01fbab req-717364cb-b043-4f47-9501-3c5f9c5372c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec43b062-7f3a-4331-8a9b-af76fe09a90d", "name": "network-vif-unplugged", "status": "completed", "tag": "3facff58-cf97-4f91-bc63-24d3df54d9eb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:27.763818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b12f321-adf0-492c-846c-37877b01fbab req-717364cb-b043-4f47-9501-3c5f9c5372c8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:27.766600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b12f321-adf0-492c-846c-37877b01fbab req-717364cb-b043-4f47-9501-3c5f9c5372c8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:27.767098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1b12f321-adf0-492c-846c-37877b01fbab req-717364cb-b043-4f47-9501-3c5f9c5372c8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:27.794826 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1b12f321-adf0-492c-846c-37877b01fbab req-717364cb-b043-4f47-9501-3c5f9c5372c8 service nova] Creating event network-vif-unplugged:3facff58-cf97-4f91-bc63-24d3df54d9eb for instance ec43b062-7f3a-4331-8a9b-af76fe09a90d on n-h1-854119-9 Aug 29 05:00:27.810281 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-1b12f321-adf0-492c-846c-37877b01fbab req-717364cb-b043-4f47-9501-3c5f9c5372c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070728 Aug 29 05:00:27.813066 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1252/2495] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:27.823447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:27.827156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:27.838435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:27.842476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:27.843205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:27.844766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:27.846478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:27.847009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:28.530946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:28.542801 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ad37035-a48c-49bb-be8d-ad69c5cb1e8a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.725481 Aug 29 05:00:28.557158 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1253/2496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:27 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:28.564553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:28.565482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:28.573165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:28.573927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:28.574586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:28.575507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:28.576108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:28.577014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:28.708857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:28.730706 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d1c578cc-314f-4b3f-9f80-5151a66e970d tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1277 microversion: 2.1 time: 0.171975 Aug 29 05:00:28.734850 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1254/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:28 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:29.174943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-19d2d5c0-db70-40d8-83b9-872d236f4ec8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Action: 'create', calling method: .version_select at 0x7f1ab913e1f0>, body: {"keypair": {"name": "tempest-keypair-2007206608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQI7nxSqtEU5c9on11mYL5Q6X9/BM72knjBtgk+s9ElcU9yPTBcWI8r+O49wQsSpGYLDXdn9ZTRsu5iOYyleHH9o52qtI9Dbb8j37RxMrOYIiuXgFFUwlKPDE+3ojyVoA=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:29.203595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-19d2d5c0-db70-40d8-83b9-872d236f4ec8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Getting quotas for project d09f5bf987364fd9931c1662d1f26e8e. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:29.210877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-19d2d5c0-db70-40d8-83b9-872d236f4ec8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Getting quotas for user 1bfae618b26a421f926b82d7947167c2 and project d09f5bf987364fd9931c1662d1f26e8e. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:29.247262 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-19d2d5c0-db70-40d8-83b9-872d236f4ec8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.502488 Aug 29 05:00:29.248744 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1255/2498] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:00:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:29.412905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb98c0b6-2bc0-4d57-8f14-0a5b3abad50a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Action: 'create', calling method: .version_select at 0x7f1ab96fbaf0>, body: {"keypair": {"name": "tempest-keypair-1723778004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbTq7lop0ojodvWkQc9BOfXyjmGnACaNxbn9SPYILOeFxZ57I3qbRdZ/BIJmHtRWMgXGt/BjfMadc4fhUwcBZ5ydyPHtgGbhTaE3cwkUQ31M7odtl50jfOMwVCNBC4fEg=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:29.447432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-eb98c0b6-2bc0-4d57-8f14-0a5b3abad50a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:29.454316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-eb98c0b6-2bc0-4d57-8f14-0a5b3abad50a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for user fbcfd905825c40bf9e6bff7c35c43ee2 and project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:29.528259 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb98c0b6-2bc0-4d57-8f14-0a5b3abad50a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.277845 Aug 29 05:00:29.534837 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1256/2499] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Aug 29 05:00:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 285 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 05:00:29.540177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:29.540873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:29.547921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:29.548551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:29.549155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:29.550082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:29.550749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:29.551388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:29.886947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:29.897603 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-60b1ac03-1411-41e0-94d8-136db29f430d tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1260 microversion: 2.1 time: 0.361563 Aug 29 05:00:29.901512 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1257/2500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:29 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1260 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:29.920466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d06574d3-8e72-4faf-b4c0-db900b266fa2 req-d579ba47-1742-47cc-a6f9-a61aec8b3948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec43b062-7f3a-4331-8a9b-af76fe09a90d", "name": "network-vif-deleted", "tag": "3facff58-cf97-4f91-bc63-24d3df54d9eb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:29.960813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d06574d3-8e72-4faf-b4c0-db900b266fa2 req-d579ba47-1742-47cc-a6f9-a61aec8b3948 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:29.980609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d06574d3-8e72-4faf-b4c0-db900b266fa2 req-d579ba47-1742-47cc-a6f9-a61aec8b3948 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:29.981537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d06574d3-8e72-4faf-b4c0-db900b266fa2 req-d579ba47-1742-47cc-a6f9-a61aec8b3948 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:30.006966 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d06574d3-8e72-4faf-b4c0-db900b266fa2 req-d579ba47-1742-47cc-a6f9-a61aec8b3948 service nova] Creating event network-vif-deleted:3facff58-cf97-4f91-bc63-24d3df54d9eb for instance ec43b062-7f3a-4331-8a9b-af76fe09a90d on n-h1-854119-9 Aug 29 05:00:30.035824 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d06574d3-8e72-4faf-b4c0-db900b266fa2 req-d579ba47-1742-47cc-a6f9-a61aec8b3948 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132660 Aug 29 05:00:30.052523 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1258/2501] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:30.058261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7293c83-0817-4729-bb91-cb801ae382e3 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1ab913eee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:30.063430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:30.074757 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d7293c83-0817-4729-bb91-cb801ae382e3 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1723778004" status: 200 len: 513 microversion: 2.2 time: 0.020683 Aug 29 05:00:30.088012 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1259/2502] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Aug 29 05:00:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1723778004 => generated 513 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:30.101556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:30.108862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:30.135975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:30.139040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:30.139584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:30.140450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:30.152800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:30.153577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:30.266512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Building network info cache for instance {{(pid=128871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 05:00:30.641946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:30.652945 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d664eb3-5f07-4a09-9e0d-60feacf6d006 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.562598 Aug 29 05:00:30.653530 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1260/2503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:30 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:30.669204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:30.670098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:30.676804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:30.677488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:30.678073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:30.679028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:30.679616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:30.680256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:30.891650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=48 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:31.003218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:31.012845 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f7045e42-c3aa-492e-903c-d899b86b5ccb tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1319 microversion: 2.1 time: 0.347392 Aug 29 05:00:31.019399 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1261/2504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:30 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:31.024456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37120dc9-eba8-45ee-8faa-f86e81de3a7c tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1abd90a550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:31.079005 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37120dc9-eba8-45ee-8faa-f86e81de3a7c tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723778004" status: 204 len: 0 microversion: 2.2 time: 0.058387 Aug 29 05:00:31.080245 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1262/2505] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Aug 29 05:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723778004 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:31.091725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:31.093659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:31.111240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:31.120211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:31.120816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:31.122870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:31.126664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:31.127673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:31.273658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:31.281767 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d316dbb6-e85a-45f9-9e30-dbce00f0570e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1266 microversion: 2.1 time: 0.200070 Aug 29 05:00:31.282642 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1263/2506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:31 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:31.287500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13d30305-d20b-444e-a095-62a437001547 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Action: 'create', calling method: .version_select at 0x7f1abd7fdaf0>, body: {"keypair": {"name": "tempest-keypair-703337567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXC3GW8tNx/bsuvMWMNdYIgPRP7m8tmChiQiRb1xuyf0V7BLOJFplxmt8gHDXBAsKaWRxmEUXBn8nowaJZrd4vKYLm91slA6EtRutJJvH1tjq3aC8q3QGYQ6QRJJDy9Nw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:31.314651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-13d30305-d20b-444e-a095-62a437001547 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:31.320757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-13d30305-d20b-444e-a095-62a437001547 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for user fbcfd905825c40bf9e6bff7c35c43ee2 and project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:31.375307 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13d30305-d20b-444e-a095-62a437001547 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.091386 Aug 29 05:00:31.376249 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1264/2507] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Aug 29 05:00:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 05:00:31.390565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84a084ff-d302-48ad-9453-cd6bc64863bc tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1abd915550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:31.435329 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84a084ff-d302-48ad-9453-cd6bc64863bc tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-703337567" status: 204 len: 0 microversion: 2.2 time: 0.052600 Aug 29 05:00:31.436501 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1265/2508] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Aug 29 05:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-703337567 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:00:31.447216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e588096-e328-4ca0-9186-af02961d0baa tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Action: 'create', calling method: .version_select at 0x7f1abd9e50d0>, body: {"keypair": {"name": "tempest-keypair-1695630967", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:31.470309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-6e588096-e328-4ca0-9186-af02961d0baa tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:31.478496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-6e588096-e328-4ca0-9186-af02961d0baa tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for user fbcfd905825c40bf9e6bff7c35c43ee2 and project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:31.515315 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e588096-e328-4ca0-9186-af02961d0baa tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.073680 Aug 29 05:00:31.516566 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1266/2509] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Aug 29 05:00:31 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 29 05:00:31.540347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69b691af-7827-4b27-bc44-c7e0448af32b tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1abd9e5ca0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:31.606942 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69b691af-7827-4b27-bc44-c7e0448af32b tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695630967" status: 204 len: 0 microversion: 2.2 time: 0.082485 Aug 29 05:00:31.608084 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1267/2510] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Aug 29 05:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695630967 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:31.620422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a454f22-a8cd-4512-8a21-7ae4d43baba0 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Action: 'create', calling method: .version_select at 0x7f1abd98a8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-728332312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMujrBSmoiBxLWLG+2bFzxjf+THhFnH+psNDU9dvxMTHHZBv8baXmP3yRPdN+20CpDPpZFPUBk88xYS1U8ZY80z7L70T9YR368tmngICdmW+6TY/lAV+cG330bS2qxAcjQ=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:31.650164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2a454f22-a8cd-4512-8a21-7ae4d43baba0 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:31.657924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2a454f22-a8cd-4512-8a21-7ae4d43baba0 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for user fbcfd905825c40bf9e6bff7c35c43ee2 and project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:31.690104 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2a454f22-a8cd-4512-8a21-7ae4d43baba0 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.073862 Aug 29 05:00:31.691247 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1268/2511] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Aug 29 05:00:31 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 29 05:00:31.705288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:31.706645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:31.715556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:31.719055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:31.719720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:31.721854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:31.722534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:31.723394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:32.294534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:32.298582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:32.306927 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-460bff22-7888-4cae-b10d-6e0bed6ab7e1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.613658 Aug 29 05:00:32.322896 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1269/2512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:31 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:32.329808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17e8805f-19e1-4bb8-b818-2ace80c11678 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Action: 'create', calling method: .version_select at 0x7f1abd9134c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1461411457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKCBWHcV6O/xLyP3ANBcdd2ywSmkmkO7+v3Zm0esMfWjilfJfA8/HscP8EZEcjNkJstIMhVQkdHFTdD8ELjIZAo9Oz/RYkNj26pYyqFY2JqvZpQxDdB43dHwj32SDJ05A=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:32.347410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Updating instance_info_cache with network_info: [{"id": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9", "address": "fa:16:3e:6a:74:35", "network": {"id": "264885bf-4295-4c69-814f-ea096817a42d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1585730778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0be48f9bd0347e7b2765f09ba0d50b9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap77d571e0-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:00:32.350676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-17e8805f-19e1-4bb8-b818-2ace80c11678 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:32.359979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:32.361053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-17e8805f-19e1-4bb8-b818-2ace80c11678 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for user fbcfd905825c40bf9e6bff7c35c43ee2 and project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:32.369910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Releasing lock "refresh_cache-11cfe2c4-11f6-4b11-a3f6-3531a60966a2" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 05:00:32.372068 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09fad227-a010-4dba-a797-d64fe69c91d5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "POST /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2/action" status: 202 len: 0 microversion: 2.1 time: 7.412456 Aug 29 05:00:32.377080 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1244/2513] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:00:24 2022] POST /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2/action => generated 0 bytes in 7418 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 05:00:32.384343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:32.385378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:32.395301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:32.396235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:32.397164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:32.398166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:32.399688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:32.400384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:32.400823 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17e8805f-19e1-4bb8-b818-2ace80c11678 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.075908 Aug 29 05:00:32.426679 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1270/2514] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Aug 29 05:00:32 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 05:00:32.441621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-dc8a1a30-f54a-4092-bc3c-5b0d8e60e9e6 req-d5c897cc-ab0a-4e2b-86f7-b610dfaf2a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cfe2c4-11f6-4b11-a3f6-3531a60966a2", "tag": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:32.466791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dc8a1a30-f54a-4092-bc3c-5b0d8e60e9e6 req-d5c897cc-ab0a-4e2b-86f7-b610dfaf2a17 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:32.467505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dc8a1a30-f54a-4092-bc3c-5b0d8e60e9e6 req-d5c897cc-ab0a-4e2b-86f7-b610dfaf2a17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:32.468381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dc8a1a30-f54a-4092-bc3c-5b0d8e60e9e6 req-d5c897cc-ab0a-4e2b-86f7-b610dfaf2a17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:32.488825 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-dc8a1a30-f54a-4092-bc3c-5b0d8e60e9e6 req-d5c897cc-ab0a-4e2b-86f7-b610dfaf2a17 service nova] Creating event network-changed:77d571e0-5b8d-40da-8344-3e0ce0a6a8d9 for instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 on n-h1-854119-9 Aug 29 05:00:32.495293 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-dc8a1a30-f54a-4092-bc3c-5b0d8e60e9e6 req-d5c897cc-ab0a-4e2b-86f7-b610dfaf2a17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066627 Aug 29 05:00:32.497535 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1271/2515] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:32.512992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:32.516755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:32.526862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:32.527976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:32.528672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:32.529651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:32.530309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:32.530969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:33.072054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:33.081231 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f8e50cfa-362a-4fd4-a76e-1ed1e7c6557e tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1319 microversion: 2.1 time: 0.702732 Aug 29 05:00:33.082385 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1245/2516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:32 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:33.087235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.141"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:33.090110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:33.096656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:33.097375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:33.098102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:33.098975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:33.099576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:33.100317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:33.139276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:33.148569 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ccd4014d-3753-4045-a1b5-d9bc719b2316 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1308 microversion: 2.1 time: 0.648458 Aug 29 05:00:33.150132 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1272/2517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:32 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1308 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:33.155192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-183ac919-24c5-471d-8ffc-13e68aab176e tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Action: 'create', calling method: .version_select at 0x7f1ab9a42e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-316406059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPB8Sk3g5aT/XM+QR32jCrbQfSgQVhx1tL6IWogM0Io+BUY0ILY8bLoWGzfhsKuzGhIO7qkKWAOPWwocuWy6V7Xo5TqE7jthxDNZBFGmNsTT7S4eCkY2OaDMfpvYfELVg=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:33.170316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "refresh_cache-7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 05:00:33.170726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquired lock "refresh_cache-7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 05:00:33.176643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-183ac919-24c5-471d-8ffc-13e68aab176e tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:33.182863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-183ac919-24c5-471d-8ffc-13e68aab176e tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for user fbcfd905825c40bf9e6bff7c35c43ee2 and project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:33.217470 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-183ac919-24c5-471d-8ffc-13e68aab176e tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.065427 Aug 29 05:00:33.218965 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1273/2518] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Aug 29 05:00:33 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 05:00:33.229708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9260f452-7ec0-4867-ad8a-25d49186762c tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1abd9e5280>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:33.235036 n-d-854119-9 devstack@n-api.service[128872]: WARNING oslo_db.sqlalchemy.utils [None req-9260f452-7ec0-4867-ad8a-25d49186762c tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 05:00:33.246275 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9260f452-7ec0-4867-ad8a-25d49186762c tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.020602 Aug 29 05:00:33.255422 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1274/2519] 10.222.0.20 () {60 vars in 1177 bytes} [Mon Aug 29 05:00:33 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:33.261915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-746150e4-17cf-493b-86f5-e39dabb6a32b tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1abd968d30>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:33.288429 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-746150e4-17cf-493b-86f5-e39dabb6a32b tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-316406059" status: 204 len: 0 microversion: 2.2 time: 0.031360 Aug 29 05:00:33.289461 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1275/2520] 10.222.0.20 () {60 vars in 1318 bytes} [Mon Aug 29 05:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-316406059 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:33.298331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f88d867c-038b-4e4b-b1da-d2d6764f1d7c tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1ab96df280>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:33.322921 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f88d867c-038b-4e4b-b1da-d2d6764f1d7c tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1461411457" status: 204 len: 0 microversion: 2.2 time: 0.029063 Aug 29 05:00:33.329018 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1276/2521] 10.222.0.20 () {60 vars in 1321 bytes} [Mon Aug 29 05:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1461411457 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:33.334203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:33.335502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:33.343905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:33.344958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:33.345601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:33.346515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:33.347401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:33.348021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:33.939384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:33.951989 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b61e2dbf-3d65-47de-bd05-9c4273da3ade tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1508 microversion: 2.1 time: 0.621168 Aug 29 05:00:33.953700 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1277/2522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:33 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1508 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:33.963234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0098b72e-28b4-4264-a012-84e56f5595fd tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1ab97993a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:33.980754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:33.989682 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0098b72e-28b4-4264-a012-84e56f5595fd tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-728332312" status: 204 len: 0 microversion: 2.2 time: 0.034561 Aug 29 05:00:33.990424 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1278/2523] 10.222.0.20 () {60 vars in 1318 bytes} [Mon Aug 29 05:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-728332312 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:33.997933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2f1bab76-7195-4817-a835-0a0d74d3aa3f req-a3067516-ad0f-4a77-8336-50fe6d588836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a228325-cc63-438f-ba35-f09c9535d6b7", "tag": "4007050e-d1a7-4e14-ae3d-783a4d2f7878"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:34.015327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2f1bab76-7195-4817-a835-0a0d74d3aa3f req-a3067516-ad0f-4a77-8336-50fe6d588836 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:34.015970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2f1bab76-7195-4817-a835-0a0d74d3aa3f req-a3067516-ad0f-4a77-8336-50fe6d588836 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:34.016536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2f1bab76-7195-4817-a835-0a0d74d3aa3f req-a3067516-ad0f-4a77-8336-50fe6d588836 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:34.033049 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2f1bab76-7195-4817-a835-0a0d74d3aa3f req-a3067516-ad0f-4a77-8336-50fe6d588836 service nova] Creating event network-changed:4007050e-d1a7-4e14-ae3d-783a4d2f7878 for instance 8a228325-cc63-438f-ba35-f09c9535d6b7 on n-h1-854119-9 Aug 29 05:00:34.040702 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2f1bab76-7195-4817-a835-0a0d74d3aa3f req-a3067516-ad0f-4a77-8336-50fe6d588836 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047587 Aug 29 05:00:34.041738 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1279/2524] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:34.052287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c550d12-7fcb-4f57-9eac-dd427790137a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Action: 'create', calling method: .version_select at 0x7f1abda15f70>, body: {"keypair": {"name": "tempest-keypair-1698395555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6e7pgLENywfDJnuY9F2on6KSuYs9fNuJ4wlIqHhfU4lh0y584BjaqfD4dmWpFch7Jp9DJhBos1vThh16wuPaKr+WPqVcHc+Fh5+3H3GRs1K6iU7eIukUfBzIrPAjrcIw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:34.069789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4c550d12-7fcb-4f57-9eac-dd427790137a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:34.076871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4c550d12-7fcb-4f57-9eac-dd427790137a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for user fbcfd905825c40bf9e6bff7c35c43ee2 and project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:34.106646 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4c550d12-7fcb-4f57-9eac-dd427790137a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.063398 Aug 29 05:00:34.113376 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1280/2525] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Aug 29 05:00:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 05:00:34.117999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-694843929", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fac34b70-e919-440f-a8d7-9bb30b4adef0"}], "security_groups": [{"name": "tempest-securitygroup--1049942730"}], "key_name": "tempest-keypair-2007206608", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:34.756238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] validate_networks() for [('fac34b70-e919-440f-a8d7-9bb30b4adef0', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:00:36.095903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Getting quotas for project d09f5bf987364fd9931c1662d1f26e8e. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:36.101838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Getting quotas for user 1bfae618b26a421f926b82d7947167c2 and project d09f5bf987364fd9931c1662d1f26e8e. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:36.114781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:00:36.115199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:00:36.115667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:00:36.116095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:00:36.116526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:00:36.124905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:36.125396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:36.125848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:36.126576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:36.127295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:36.127739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:36.145853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Getting quotas for project d09f5bf987364fd9931c1662d1f26e8e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:36.152322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Getting quotas for user 1bfae618b26a421f926b82d7947167c2 and project d09f5bf987364fd9931c1662d1f26e8e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:36.166794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:00:36.169358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:00:36.221692 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7127fa5f-190b-437e-bec0-ec3d0211ed93 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.113117 Aug 29 05:00:36.222612 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1281/2526] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:00:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 2115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:00:36.232477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:36.233350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:36.241011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:36.241709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:36.242326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:36.243187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:36.243790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:36.244390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:37.364068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:37.384596 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dc933601-c049-481d-880f-1be7b689cac8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1319 microversion: 2.1 time: 1.148459 Aug 29 05:00:37.385275 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1282/2527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:36 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1319 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:37.392030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-293049e8-e66c-4fc5-a000-ad3ab9e6c97a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1abd915ca0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:37.410066 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-293049e8-e66c-4fc5-a000-ad3ab9e6c97a tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1698395555" status: 200 len: 513 microversion: 2.2 time: 0.023454 Aug 29 05:00:37.416466 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1283/2528] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Aug 29 05:00:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1698395555 => generated 513 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:37.423938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:37.430130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:37.443322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:37.444278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:37.445277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:37.446437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:37.447195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:37.447840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:38.007645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:38.018329 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-087cacf9-ce01-4ccc-87cd-4ac715405032 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1308 microversion: 2.1 time: 0.600342 Aug 29 05:00:38.019837 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1284/2529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:37 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1308 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:38.024933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:38.026407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:38.035239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:38.036032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:38.036708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:38.037695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:38.038355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:38.039065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:38.323347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:38.334806 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28c8ddcd-9f57-4e0f-8195-f1c33f290370 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1529 microversion: 2.1 time: 0.313496 Aug 29 05:00:38.337551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1285/2530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:38 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1529 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:38.475109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1021436628", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "b40b6114-4945-4eec-aec1-95568d0bc35a"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:38.506164 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.network.neutron [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] re-assign floating IP 172.25.9.141 from instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 Aug 29 05:00:38.537355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] validate_networks() for [('b40b6114-4945-4eec-aec1-95568d0bc35a', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:00:38.599775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Building network info cache for instance {{(pid=128871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 05:00:39.211921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:00:39.213053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:00:39.213538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:00:39.213951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:00:39.214562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:00:39.230667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:39.231550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:39.233245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:39.234194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:39.234967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:39.235555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:39.261612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Getting quotas for project 8f56323324964034a3de9c9dd25cf3ad. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:39.270662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Getting quotas for user 6e65a1add31144aaafd8b620ed3f89bb and project 8f56323324964034a3de9c9dd25cf3ad. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:39.291895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:00:39.295002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:00:39.355805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Updating instance_info_cache with network_info: [{"id": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9", "address": "fa:16:3e:6a:74:35", "network": {"id": "264885bf-4295-4c69-814f-ea096817a42d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1585730778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0be48f9bd0347e7b2765f09ba0d50b9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap77d571e0-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:00:39.370386 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-35c100c9-7f02-463b-82b2-71b5cb1e2c85 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031247 Aug 29 05:00:39.371923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Building network info cache for instance {{(pid=128871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 05:00:39.383754 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1286/2531] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:00:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:00:39.533809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f10f3e94-e03a-4530-9666-1a9226dc8648 req-19bc0918-09e7-4fbf-bea3-32a76bc3b13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f05ad94c-e821-4e1b-8a8d-82363cd3659c", "tag": "fb36119d-18a9-40d3-8ef7-07a524215b7c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:39.555878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f10f3e94-e03a-4530-9666-1a9226dc8648 req-19bc0918-09e7-4fbf-bea3-32a76bc3b13b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:39.556976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f10f3e94-e03a-4530-9666-1a9226dc8648 req-19bc0918-09e7-4fbf-bea3-32a76bc3b13b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:39.558171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f10f3e94-e03a-4530-9666-1a9226dc8648 req-19bc0918-09e7-4fbf-bea3-32a76bc3b13b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:39.578660 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f10f3e94-e03a-4530-9666-1a9226dc8648 req-19bc0918-09e7-4fbf-bea3-32a76bc3b13b service nova] Creating event network-changed:fb36119d-18a9-40d3-8ef7-07a524215b7c for instance f05ad94c-e821-4e1b-8a8d-82363cd3659c on n-h1-854119-9 Aug 29 05:00:39.592667 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f10f3e94-e03a-4530-9666-1a9226dc8648 req-19bc0918-09e7-4fbf-bea3-32a76bc3b13b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205434 Aug 29 05:00:39.594043 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1287/2532] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:39.609433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:39.610349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:39.633513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:39.634129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:39.634667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:39.635483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:39.636054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:39.636599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:40.144048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:40.160869 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dd1a9bac-128e-4c75-bb79-5737363b654d tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1329 microversion: 2.1 time: 0.565531 Aug 29 05:00:40.163902 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1288/2533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:39 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1329 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:40.186347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4153442-2c5e-46c1-bbc8-10ccf82c1f75 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1ab93cd4c0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:40.202026 n-d-854119-9 devstack@n-api.service[128872]: WARNING oslo_db.sqlalchemy.utils [None req-a4153442-2c5e-46c1-bbc8-10ccf82c1f75 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 05:00:40.215174 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a4153442-2c5e-46c1-bbc8-10ccf82c1f75 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.048334 Aug 29 05:00:40.221377 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1289/2534] 10.222.0.20 () {60 vars in 1177 bytes} [Mon Aug 29 05:00:40 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:40.230565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:40.231351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:40.244234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:40.245890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:40.246342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:40.249254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:40.249733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:40.250628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:40.817422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:40.825929 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae92ddc5-80d8-477a-a2ef-aaf70928fe27 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1319 microversion: 2.1 time: 0.603384 Aug 29 05:00:40.827773 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1290/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:40 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:40.834579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:40.835641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:40.843149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:40.844062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:40.844766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:40.845788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:40.846441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:40.847058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:41.106257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Updating instance_info_cache with network_info: [{"id": "4f42455f-dfe0-430a-9e5a-e6570d1bdc4d", "address": "fa:16:3e:80:13:a8", "network": {"id": "264885bf-4295-4c69-814f-ea096817a42d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1585730778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0be48f9bd0347e7b2765f09ba0d50b9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4f42455f-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:00:41.112811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:41.123836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Releasing lock "refresh_cache-7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 05:00:41.125575 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7635cf7d-0ef3-4862-a81f-40969bdceed5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "POST /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31/action" status: 202 len: 0 microversion: 2.1 time: 8.041921 Aug 29 05:00:41.126618 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-38608486-0277-4805-a9fc-d127c4b3c314 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1308 microversion: 2.1 time: 0.297263 Aug 29 05:00:41.127449 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1291/2536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:40 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:41.135876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:41.142283 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1246/2537] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:00:33 2022] POST /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31/action => generated 0 bytes in 8059 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 05:00:41.148552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1252639434", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "b40b6114-4945-4eec-aec1-95568d0bc35a"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:41.149650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:41.174121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:41.174854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:41.175549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:41.176509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:41.177220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:41.177846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:41.219306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] validate_networks() for [('b40b6114-4945-4eec-aec1-95568d0bc35a', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:00:41.599733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:41.609386 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fe5c2c69-0fd9-40b6-bff9-9edd257d9752 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1529 microversion: 2.1 time: 0.480046 Aug 29 05:00:41.628200 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1292/2538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:41 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1529 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:41.633587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2656a9f2-c652-4128-bd45-48ecb5aa5a7c req-efc6d50b-17e1-4aa4-979c-cb4d4290f22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a228325-cc63-438f-ba35-f09c9535d6b7", "name": "network-vif-plugged", "status": "completed", "tag": "4007050e-d1a7-4e14-ae3d-783a4d2f7878"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:41.648016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2656a9f2-c652-4128-bd45-48ecb5aa5a7c req-efc6d50b-17e1-4aa4-979c-cb4d4290f22c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:41.650210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2656a9f2-c652-4128-bd45-48ecb5aa5a7c req-efc6d50b-17e1-4aa4-979c-cb4d4290f22c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:41.650941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2656a9f2-c652-4128-bd45-48ecb5aa5a7c req-efc6d50b-17e1-4aa4-979c-cb4d4290f22c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:41.675134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2656a9f2-c652-4128-bd45-48ecb5aa5a7c req-efc6d50b-17e1-4aa4-979c-cb4d4290f22c service nova] Creating event network-vif-plugged:4007050e-d1a7-4e14-ae3d-783a4d2f7878 for instance 8a228325-cc63-438f-ba35-f09c9535d6b7 on n-h1-854119-9 Aug 29 05:00:41.682364 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2656a9f2-c652-4128-bd45-48ecb5aa5a7c req-efc6d50b-17e1-4aa4-979c-cb4d4290f22c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051971 Aug 29 05:00:41.683775 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1293/2539] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:41.692652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-48d31c39-8333-494b-8136-ac0875f90132 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1ab93cdd30>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:41.721422 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-48d31c39-8333-494b-8136-ac0875f90132 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698395555" status: 204 len: 0 microversion: 2.2 time: 0.035664 Aug 29 05:00:41.722707 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1294/2540] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Aug 29 05:00:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698395555 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:41.743675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.141"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:42.167435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:42.175807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:42.176393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:42.176935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:42.177731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:42.178273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:42.178800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:42.550774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:00:42.552303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:00:42.553030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:00:42.555001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:00:42.555763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:00:42.568892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:42.569627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:42.570303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:42.571282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:42.571882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:42.572624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:42.608560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Getting quotas for project 8f56323324964034a3de9c9dd25cf3ad. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:42.619362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Getting quotas for user 6e65a1add31144aaafd8b620ed3f89bb and project 8f56323324964034a3de9c9dd25cf3ad. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:42.658048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:00:42.662507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:00:42.720904 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-589182c5-1b5a-4c78-a93a-999a01fa3d93 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576267 Aug 29 05:00:42.721742 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1247/2541] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:00:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:00:42.729127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:42.731410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:42.741243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:42.742241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:42.742961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:42.743877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:42.744586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:42.745214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:42.807671 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] HTTP exception thrown: Floating IP 172.25.9.141 is not associated with instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2. Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Request method failure captured: Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2/action HTTP/1.1 Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 49 Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEe01ER4DEQhZISVT3OSXeeIr3Cu7raM1YMG2L7FaMS7NJWOMsw_aYKj8b37gYVfcCNc4ppCHH4ELkX_eeOfYD8hrdqYxzSCKweSaSdY_zarzv50svlAn2jQq92OQZfLrpETsEdqDmsw9RBpQQX6HGAwzrUHZd3q5z7aZ-8Aw89zwaI Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: d0be48f9bd0347e7b2765f09ba0d50b9 Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1177526769 Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0be48f9bd0347e7b2765f09ba0d50b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0be48f9bd0347e7b2765f09ba0d50b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0be48f9bd0347e7b2765f09ba0d50b9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0be48f9bd0347e7b2765f09ba0d50b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1177526769 Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: d0be48f9bd0347e7b2765f09ba0d50b9 Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1177526769 Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FloatingIPsAssociationTestJSON-1177526769-project Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 5f9b5a46468f4cb79a0ec52a86f4482d Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1177526769-project Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: {"removeFloatingIp": {"address": "172.25.9.141"}} Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: exception: Floating IP 172.25.9.141 is not associated with instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2. Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '11cfe2c4-11f6-4b11-a3f6-3531a60966a2', 'body': {'removeFloatingIp': {'address': '172.25.9.141'}}} Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.141 is not associated with instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2. Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.141 is not associated with instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2. Aug 29 05:00:42.809547 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:00:42.816047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Returning 409 to user: Floating IP 172.25.9.141 is not associated with instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:00:42.817320 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1cf5e5c7-56a2-4f39-b01b-dee55c528c1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "POST /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2/action" status: 409 len: 146 microversion: 2.1 time: 1.085703 Aug 29 05:00:42.821755 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1295/2542] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:00:41 2022] POST /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2/action => generated 146 bytes in 1092 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:00:42.830210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5e4cf6d1-0217-4ef7-be09-5990ac2a54f3 req-0702ce36-81bb-4e18-bc2f-d29a7691aa61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cfe2c4-11f6-4b11-a3f6-3531a60966a2", "tag": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9"}, {"name": "network-changed", "server_uuid": "7894a837-4098-4a9b-9fcf-dd5f7d1a5d31", "tag": "4f42455f-dfe0-430a-9e5a-e6570d1bdc4d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:42.869809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5e4cf6d1-0217-4ef7-be09-5990ac2a54f3 req-0702ce36-81bb-4e18-bc2f-d29a7691aa61 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:42.870664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5e4cf6d1-0217-4ef7-be09-5990ac2a54f3 req-0702ce36-81bb-4e18-bc2f-d29a7691aa61 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:42.871157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5e4cf6d1-0217-4ef7-be09-5990ac2a54f3 req-0702ce36-81bb-4e18-bc2f-d29a7691aa61 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:42.886998 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5e4cf6d1-0217-4ef7-be09-5990ac2a54f3 req-0702ce36-81bb-4e18-bc2f-d29a7691aa61 service nova] Creating event network-changed:77d571e0-5b8d-40da-8344-3e0ce0a6a8d9 for instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 on n-h1-854119-9 Aug 29 05:00:42.887549 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5e4cf6d1-0217-4ef7-be09-5990ac2a54f3 req-0702ce36-81bb-4e18-bc2f-d29a7691aa61 service nova] Creating event network-changed:4f42455f-dfe0-430a-9e5a-e6570d1bdc4d for instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 on n-h1-854119-9 Aug 29 05:00:42.909117 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5e4cf6d1-0217-4ef7-be09-5990ac2a54f3 req-0702ce36-81bb-4e18-bc2f-d29a7691aa61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072087 Aug 29 05:00:42.911451 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1296/2543] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:42.919964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Action: 'create', calling method: .version_select at 0x7f1ab92705e0>, body: {"keypair": {"name": "tempest-keypair-1996334780", "type": "x509"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:42.938921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=67 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:42.940632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:42.950318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for user fbcfd905825c40bf9e6bff7c35c43ee2 and project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:42.975610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.processutils [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpa3wtsv_g/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpa3wtsv_g/temp.key -subj /CN=fbcfd905825c40bf9e6bff7c35c43ee2 -extensions v3_req_client {{(pid=128872) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 05:00:43.263298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.processutils [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpa3wtsv_g/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpa3wtsv_g/temp.key -subj /CN=fbcfd905825c40bf9e6bff7c35c43ee2 -extensions v3_req_client" returned: 0 in 0.287s {{(pid=128872) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 05:00:43.266958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.processutils [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpa3wtsv_g/temp.key -password pass: {{(pid=128872) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 05:00:43.309281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.processutils [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpa3wtsv_g/temp.key -password pass:" returned: 0 in 0.042s {{(pid=128872) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 05:00:43.359382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=90,nova_api:INSERT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:43.371698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:43.381100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Getting quotas for user fbcfd905825c40bf9e6bff7c35c43ee2 and project 78b306a9f5394652aabf63d0a90abc4c. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:43.402392 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e84ba4ca-06ef-4595-98ae-5e454b4af5b9 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.488638 Aug 29 05:00:43.403628 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1297/2544] 10.222.0.20 () {62 vars in 1198 bytes} [Mon Aug 29 05:00:42 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 491 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:43.414078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:43.414952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:43.440582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:43.441359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:43.442094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:43.443039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:43.443585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:43.444010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:43.677233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:43.685066 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b1da58b-e3ea-4884-b021-9c4f51ac7122 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1403 microversion: 2.1 time: 0.962007 Aug 29 05:00:43.688960 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1248/2545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:42 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1403 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:43.694813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:43.696015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:43.709317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:43.720069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:43.720821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:43.721593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:43.722067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:43.722493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:43.866847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:43.876462 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2952f97c-ca04-4c3d-b6ff-384e9501bc72 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1319 microversion: 2.1 time: 0.471300 Aug 29 05:00:43.890397 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1298/2546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:43 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:43.903004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:43.903850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:43.917632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:43.918480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:43.919151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:43.920097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:43.921031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:43.921665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:44.181442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:44.190691 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d99526a-62ee-47d2-b406-a1cd49d880d3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1308 microversion: 2.1 time: 0.499724 Aug 29 05:00:44.191288 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1249/2547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:43 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1308 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:44.203872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-187985752", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "451", "networks": [{"uuid": "b40b6114-4945-4eec-aec1-95568d0bc35a"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:44.299378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] validate_networks() for [('b40b6114-4945-4eec-aec1-95568d0bc35a', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:00:44.455373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:44.465895 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8af2de06-c119-4b97-9274-d9fec62c1c3d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1529 microversion: 2.1 time: 0.565277 Aug 29 05:00:44.470139 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1299/2548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:43 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1529 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:44.480502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.141"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:44.898902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:44.914218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:44.915014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:44.915639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:44.916691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:44.917289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:44.917866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:45.702915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "refresh_cache-7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 05:00:45.703493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquired lock "refresh_cache-7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 05:00:45.878823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:00:45.879821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:00:45.880494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:00:45.881820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:00:45.882395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:00:45.896596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:45.897952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:45.898725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:45.899813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:45.901684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:45.903047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:45.943881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Getting quotas for project 8f56323324964034a3de9c9dd25cf3ad. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:45.953317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Getting quotas for user 6e65a1add31144aaafd8b620ed3f89bb and project 8f56323324964034a3de9c9dd25cf3ad. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:45.976576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:00:45.982186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:00:46.047921 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4e0320c-80b3-4d36-8c91-70a0b1d4bdd6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.855519 Aug 29 05:00:46.049897 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1250/2549] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:00:46.066926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5baa996a-efe9-4f9d-ba29-78cf3766bcde tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1ab9e85820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:46.078983 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5baa996a-efe9-4f9d-ba29-78cf3766bcde tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1996334780" status: 200 len: 1534 microversion: 2.2 time: 0.026542 Aug 29 05:00:46.080944 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1251/2550] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Aug 29 05:00:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1996334780 => generated 1534 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:46.092739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e6be0f67-244e-46a1-8477-0e4b42b0e710 req-fd327643-665e-4e85-b2c4-bae75bb3c1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65e5f2d-e369-4e32-a10f-d3c261c15e87", "name": "network-vif-plugged", "status": "completed", "tag": "1754cce9-2a4f-42a1-8b8a-f6943372486b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:46.123167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e6be0f67-244e-46a1-8477-0e4b42b0e710 req-fd327643-665e-4e85-b2c4-bae75bb3c1b9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:46.125803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e6be0f67-244e-46a1-8477-0e4b42b0e710 req-fd327643-665e-4e85-b2c4-bae75bb3c1b9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:46.127089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e6be0f67-244e-46a1-8477-0e4b42b0e710 req-fd327643-665e-4e85-b2c4-bae75bb3c1b9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:46.165610 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e6be0f67-244e-46a1-8477-0e4b42b0e710 req-fd327643-665e-4e85-b2c4-bae75bb3c1b9 service nova] Creating event network-vif-plugged:1754cce9-2a4f-42a1-8b8a-f6943372486b for instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 on n-h1-854119-9 Aug 29 05:00:46.177471 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e6be0f67-244e-46a1-8477-0e4b42b0e710 req-fd327643-665e-4e85-b2c4-bae75bb3c1b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087645 Aug 29 05:00:46.178696 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1252/2551] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:46.186596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:46.187612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:46.199061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:46.200259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:46.201982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:46.202892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:46.203569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:46.204166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:47.153693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:47.174496 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4c0438c1-5d92-498a-b546-bc4bec57f42c tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1403 microversion: 2.1 time: 0.993946 Aug 29 05:00:47.175497 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1253/2552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:46 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1403 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:47.209791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:47.214540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:47.230440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:47.236316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:47.237671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:47.238362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:47.240069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:47.241429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:47.242385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:47.802384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:47.832768 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f17b9967-0acd-4512-941a-cc0a9f9e685a tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1468 microversion: 2.1 time: 0.640908 Aug 29 05:00:47.834937 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1254/2553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:47 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1468 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:47.840840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:47.841633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:47.850435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:47.850965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:47.851467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:47.852324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:47.853033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:47.853611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:49.126232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:49.140866 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1e10a765-f42c-4074-945e-da27512402f7 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1308 microversion: 2.1 time: 1.304604 Aug 29 05:00:49.141743 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1255/2554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:47 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1308 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:49.146513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:49.157024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:49.163478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:49.164356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:49.164981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:49.165856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:49.166468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:49.176938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:49.248294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:49.306735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Building network info cache for instance {{(pid=128872) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 05:00:49.948247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:49.956650 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-70e90391-32fd-4eae-b20f-085293fcd603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1524 microversion: 2.1 time: 0.813673 Aug 29 05:00:49.960424 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1256/2555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:49 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1524 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:49.985541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:49.986160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:50.002809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:50.003321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:50.003760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:50.005102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:50.005625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:50.006053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:50.205505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:50.214620 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f33fff07-78f3-40b4-8fef-0f6ea96e848c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1278 microversion: 2.1 time: 0.237974 Aug 29 05:00:50.216865 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1257/2556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:49 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:50.225221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-187c9aea-dc9e-4fba-8bf4-1d59d6efc334 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1ab951fa60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:50.233396 n-d-854119-9 devstack@n-api.service[128871]: WARNING oslo_db.sqlalchemy.utils [None req-187c9aea-dc9e-4fba-8bf4-1d59d6efc334 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 05:00:50.266736 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-187c9aea-dc9e-4fba-8bf4-1d59d6efc334 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.045077 Aug 29 05:00:50.267332 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1258/2557] 10.222.0.20 () {60 vars in 1177 bytes} [Mon Aug 29 05:00:50 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:50.286946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f079b3a0-71a5-4a93-93e1-68b91670bc2e req-6855239e-e569-4d5c-aa33-0f4787efb138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16924c2-4d44-4b93-a184-10cde1934009", "tag": "6ea56d13-f7fa-4e9e-b1a1-33ddd0498066"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:50.317616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f079b3a0-71a5-4a93-93e1-68b91670bc2e req-6855239e-e569-4d5c-aa33-0f4787efb138 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:50.318510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f079b3a0-71a5-4a93-93e1-68b91670bc2e req-6855239e-e569-4d5c-aa33-0f4787efb138 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:50.319161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f079b3a0-71a5-4a93-93e1-68b91670bc2e req-6855239e-e569-4d5c-aa33-0f4787efb138 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:50.342386 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f079b3a0-71a5-4a93-93e1-68b91670bc2e req-6855239e-e569-4d5c-aa33-0f4787efb138 service nova] Creating event network-changed:6ea56d13-f7fa-4e9e-b1a1-33ddd0498066 for instance e16924c2-4d44-4b93-a184-10cde1934009 on n-h1-854119-9 Aug 29 05:00:50.351973 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f079b3a0-71a5-4a93-93e1-68b91670bc2e req-6855239e-e569-4d5c-aa33-0f4787efb138 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079653 Aug 29 05:00:50.357830 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1259/2558] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:50.529258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-476632352", "block_migration": true, "disk_over_commit": false}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:50.532326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:50.541783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:50.542614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:50.543300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:50.544389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:50.545059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:50.546478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:50.580401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lazy-loading 'flavor' on Instance uuid 8a228325-cc63-438f-ba35-f09c9535d6b7 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:00:50.596264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Going to try to live migrate instance to tempest-host-476632352 {{(pid=128871) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 05:00:50.608857 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] HTTP exception thrown: Compute host tempest-host-476632352 could not be found. Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Request method failure captured: Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7/action HTTP/1.1 Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 106 Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEfloePCtYqCMqVb23DkPZSt2nrj56tp1JBzK3nIju8VzudwsAm9GmZLGc4PQbCvmIkn8MVXMybaSq6v9MX2mmxepPpHEi0l2JhOGVyuXiscRVi6pCEyUAr9cPScpjD0ekDGW8MIu_V4oAsDjUtEC3ffq5W2nRS5DMnsCxwFHPcOdGI Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: c152a7fa03c1478084fbe162285100dc Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-LiveMigrationNegativeTest-1217376683 Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c152a7fa03c1478084fbe162285100dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c152a7fa03c1478084fbe162285100dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c152a7fa03c1478084fbe162285100dc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c152a7fa03c1478084fbe162285100dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-LiveMigrationNegativeTest-1217376683 Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: c152a7fa03c1478084fbe162285100dc Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1217376683 Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-LiveMigrationNegativeTest-1217376683-project-admin Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c5d2e68db3504a88b8066b6808cc0a8a Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-LiveMigrationNegativeTest-1217376683-project-admin Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: {"os-migrateLive": {"host": "tempest-host-476632352", "block_migration": true, "disk_over_commit": false}} Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: exception: Compute host tempest-host-476632352 could not be found. Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8a228325-cc63-438f-ba35-f09c9535d6b7', 'body': {'os-migrateLive': {'host': 'tempest-host-476632352', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 29 05:00:50.617335 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-476632352 could not be found. Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-476632352 could not be found. Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-476632352 could not be found. Aug 29 05:00:50.620871 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:00:50.625122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Returning 400 to user: Compute host tempest-host-476632352 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:00:50.626269 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-664e3662-87a3-4eea-bbf1-b7379b39d153 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7/action" status: 400 len: 99 microversion: 2.1 time: 0.267006 Aug 29 05:00:50.631426 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1260/2559] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Aug 29 05:00:50 2022] POST /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7/action => generated 99 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 05:00:50.638850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:50.640603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:50.649475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:50.650343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:50.650990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:50.651920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:50.653124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:50.653795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.005451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Updating instance_info_cache with network_info: [{"id": "4f42455f-dfe0-430a-9e5a-e6570d1bdc4d", "address": "fa:16:3e:80:13:a8", "network": {"id": "264885bf-4295-4c69-814f-ea096817a42d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1585730778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0be48f9bd0347e7b2765f09ba0d50b9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4f42455f-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128872) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:00:51.013359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:51.022474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Releasing lock "refresh_cache-7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 05:00:51.024014 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a8cef2d-6ec0-45fc-a2b0-ab99ad532d18 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "POST /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31/action" status: 202 len: 0 microversion: 2.1 time: 6.552693 Aug 29 05:00:51.028034 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3f13655-f9ee-43f1-abc3-d2277f1b253a tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1403 microversion: 2.1 time: 0.394394 Aug 29 05:00:51.028721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1300/2560] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:00:44 2022] POST /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31/action => generated 0 bytes in 6557 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 05:00:51.028856 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1261/2561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:50 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1403 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:51.033927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ead11e88-7199-46d3-8507-f4db869aeb0c req-1c4f68c6-8af0-4a61-9734-2a9ec03fa40d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c902e9b9-36b2-40c4-9060-98aa8806bd4c", "tag": "bcacbbc7-9283-4bfe-bdd0-a18d07b1643f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:51.048810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ead11e88-7199-46d3-8507-f4db869aeb0c req-1c4f68c6-8af0-4a61-9734-2a9ec03fa40d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.049316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ead11e88-7199-46d3-8507-f4db869aeb0c req-1c4f68c6-8af0-4a61-9734-2a9ec03fa40d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.049744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ead11e88-7199-46d3-8507-f4db869aeb0c req-1c4f68c6-8af0-4a61-9734-2a9ec03fa40d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.090635 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ead11e88-7199-46d3-8507-f4db869aeb0c req-1c4f68c6-8af0-4a61-9734-2a9ec03fa40d service nova] Creating event network-changed:bcacbbc7-9283-4bfe-bdd0-a18d07b1643f for instance c902e9b9-36b2-40c4-9060-98aa8806bd4c on n-h1-854119-9 Aug 29 05:00:51.105950 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ead11e88-7199-46d3-8507-f4db869aeb0c req-1c4f68c6-8af0-4a61-9734-2a9ec03fa40d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075394 Aug 29 05:00:51.106600 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1262/2562] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:51.111695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:51.112444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:51.130252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.130753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.131190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.131905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.132410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.132910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.173636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:51.226217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c6f10b2e-ecc5-445d-afbc-387c93637579 req-704e76f5-5622-4007-8d50-9e4d1c56c29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f05ad94c-e821-4e1b-8a8d-82363cd3659c", "name": "network-vif-plugged", "status": "completed", "tag": "fb36119d-18a9-40d3-8ef7-07a524215b7c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:51.244675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c6f10b2e-ecc5-445d-afbc-387c93637579 req-704e76f5-5622-4007-8d50-9e4d1c56c29b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.245168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c6f10b2e-ecc5-445d-afbc-387c93637579 req-704e76f5-5622-4007-8d50-9e4d1c56c29b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.250253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c6f10b2e-ecc5-445d-afbc-387c93637579 req-704e76f5-5622-4007-8d50-9e4d1c56c29b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.283507 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c6f10b2e-ecc5-445d-afbc-387c93637579 req-704e76f5-5622-4007-8d50-9e4d1c56c29b service nova] Creating event network-vif-plugged:fb36119d-18a9-40d3-8ef7-07a524215b7c for instance f05ad94c-e821-4e1b-8a8d-82363cd3659c on n-h1-854119-9 Aug 29 05:00:51.296837 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c6f10b2e-ecc5-445d-afbc-387c93637579 req-704e76f5-5622-4007-8d50-9e4d1c56c29b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254150 Aug 29 05:00:51.304527 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1301/2563] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:51.318886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5099055-9dae-4499-b754-41c192ae8449 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] Calling method '.version_select at 0x7f1abd9685e0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:51.373232 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5099055-9dae-4499-b754-41c192ae8449 tempest-KeyPairsV22TestJSON-289560167 tempest-KeyPairsV22TestJSON-289560167-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996334780" status: 204 len: 0 microversion: 2.2 time: 0.065009 Aug 29 05:00:51.374746 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1302/2564] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Aug 29 05:00:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996334780 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:51.383633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:51.385522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:51.395481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.396508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.397091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.397984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.398675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.399496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:51.399992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.407390 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fe559bda-e1bf-42f4-a386-065db043e1ad tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1308 microversion: 2.1 time: 0.299585 Aug 29 05:00:51.412420 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1263/2565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:51 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:51.417299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:51.417917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:51.422170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:51.428088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.428919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.429579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.430565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.431200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.431780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.762593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:51.779963 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c573d5b5-4501-4d84-88b1-b70d29af29fd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1468 microversion: 2.1 time: 0.403235 Aug 29 05:00:51.780813 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1303/2566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:51 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1468 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:51.785889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:51.786652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:51.794752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.795664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.796469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.797401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.798060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.798692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.842973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:00:51.843690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:51.900919 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9bfe32ce-0b08-4b75-b0a6-ad3d04642a70 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1524 microversion: 2.1 time: 0.487345 Aug 29 05:00:51.903177 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1264/2567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:51 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1524 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:51.912211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:51.917158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:51.923698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.924557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.925399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.926446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.927084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.927556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:51.961464 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f836ee5-82c5-4cbd-afba-309cfd8c8238 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 204 len: 0 microversion: 2.1 time: 0.179117 Aug 29 05:00:51.972704 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1304/2568] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:00:51 2022] DELETE /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:00:51.979707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.141"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:51.983317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:51.997653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:51.998353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:51.999139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:52.000215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:52.000818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:52.001495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:52.057990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "refresh_cache-11cfe2c4-11f6-4b11-a3f6-3531a60966a2" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 05:00:52.058656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquired lock "refresh_cache-11cfe2c4-11f6-4b11-a3f6-3531a60966a2" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 05:00:52.198222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:52.210791 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c0447067-3a2b-4971-94de-34d3caebaa9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.301749 Aug 29 05:00:52.212333 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1265/2569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:51 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:52.223692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-116190277", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:52.328683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:00:53.390920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=7 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:00:53.420048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:00:53.420557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:00:53.420975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:00:53.421386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:00:53.421862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:00:53.432343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:53.434116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:53.436106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:53.438920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:53.441217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:53.442613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:53.475437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Getting quotas for project 3cd6136711c248539c04a2b2dd8fae78. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:00:53.481548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Getting quotas for user 7368462223bb4007b69efb0c864eb010 and project 3cd6136711c248539c04a2b2dd8fae78. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:00:53.496189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:00:53.498698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:00:53.581475 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c92e3336-a1bd-48ae-9c9f-8818644869f7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363754 Aug 29 05:00:53.583167 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1266/2570] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:00:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:00:53.588470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:53.590398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:53.600686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:53.602769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:53.603688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:53.605349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:53.606336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:53.607094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:54.913767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:54.927874 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0bed7448-fd2d-420b-823d-18f8d257df2e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1403 microversion: 2.1 time: 1.339451 Aug 29 05:00:54.930856 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1267/2571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:53 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1403 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:54.942943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0026aabf-2476-4de4-8a30-9f461c895a6d req-16f16ee4-b622-4ef1-bcea-d207da7d22b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652fbf6a-e3b6-4ca0-9845-ad15d1348664", "tag": "b0857ece-512d-420c-ba5a-53b48cf6e29b"}, {"name": "network-changed", "server_uuid": "7894a837-4098-4a9b-9fcf-dd5f7d1a5d31", "tag": "4f42455f-dfe0-430a-9e5a-e6570d1bdc4d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:54.957333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0026aabf-2476-4de4-8a30-9f461c895a6d req-16f16ee4-b622-4ef1-bcea-d207da7d22b3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:54.958378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0026aabf-2476-4de4-8a30-9f461c895a6d req-16f16ee4-b622-4ef1-bcea-d207da7d22b3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:54.959423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0026aabf-2476-4de4-8a30-9f461c895a6d req-16f16ee4-b622-4ef1-bcea-d207da7d22b3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:54.977566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0026aabf-2476-4de4-8a30-9f461c895a6d req-16f16ee4-b622-4ef1-bcea-d207da7d22b3 service nova] Creating event network-changed:b0857ece-512d-420c-ba5a-53b48cf6e29b for instance 652fbf6a-e3b6-4ca0-9845-ad15d1348664 on n-h1-854119-9 Aug 29 05:00:54.978592 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0026aabf-2476-4de4-8a30-9f461c895a6d req-16f16ee4-b622-4ef1-bcea-d207da7d22b3 service nova] Creating event network-changed:4f42455f-dfe0-430a-9e5a-e6570d1bdc4d for instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 on n-h1-854119-9 Aug 29 05:00:54.987736 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0026aabf-2476-4de4-8a30-9f461c895a6d req-16f16ee4-b622-4ef1-bcea-d207da7d22b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054861 Aug 29 05:00:54.989319 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1268/2572] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:54.997147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:54.998496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:55.006064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:55.007972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:55.009010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:55.010174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:55.010977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:55.011629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:55.552900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:55.561720 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-151cf83d-6408-4221-aa53-eaa906005c50 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1308 microversion: 2.1 time: 0.570437 Aug 29 05:00:55.565136 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1269/2573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:54 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1308 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:55.584425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:55.586970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:55.604781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:55.605269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:55.605697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:55.606578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:55.607042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:55.607461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:55.741355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Building network info cache for instance {{(pid=128872) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 05:00:56.015937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:56.024897 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a87264eb-a86e-4b2b-a46f-74e5432ac01b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1524 microversion: 2.1 time: 0.446655 Aug 29 05:00:56.028813 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1270/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:55 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1524 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:56.037442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:56.040832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:56.052345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:56.056630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:56.057282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:56.058259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:56.058866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:56.061419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:56.317549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:56.331615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68f49c6d-389a-4a55-b540-b03899ebe3e9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.301467 Aug 29 05:00:56.348154 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1271/2575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:56 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:56.365782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:56.367593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:56.388794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:56.390646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:56.393707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:56.394587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:56.395166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:56.395904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:56.512474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:56.524343 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-67efb8fa-2c68-44fd-851d-d09d05ad8835 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1222 microversion: 2.1 time: 0.176432 Aug 29 05:00:56.525086 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1272/2576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:56 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:56.536770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:56.537542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:56.551114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:56.551782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:56.553860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:56.554947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:56.557042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:56.557926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:56.858864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:56.867656 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-306b26c0-0134-49a5-92eb-83bb2a87863e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1403 microversion: 2.1 time: 0.340634 Aug 29 05:00:56.871564 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1273/2577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:56 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1403 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:56.878577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:56.879673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:56.905114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:56.908141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:56.908849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:56.916433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:56.919594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:56.920333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:56.987825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Updating instance_info_cache with network_info: [{"id": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9", "address": "fa:16:3e:6a:74:35", "network": {"id": "264885bf-4295-4c69-814f-ea096817a42d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1585730778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0be48f9bd0347e7b2765f09ba0d50b9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap77d571e0-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128872) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:00:57.005704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Releasing lock "refresh_cache-11cfe2c4-11f6-4b11-a3f6-3531a60966a2" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 05:00:57.006605 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ffb8a59d-b7ed-48cc-a76b-4f779c0c0bb0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "POST /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2/action" status: 202 len: 0 microversion: 2.1 time: 5.032465 Aug 29 05:00:57.007717 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1305/2578] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:00:51 2022] POST /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2/action => generated 0 bytes in 5034 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 05:00:57.023670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2696a7ec-446c-44cb-924f-315df1a261b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '.version_select at 0x7f1abd98b5e0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:57.181868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:57.192715 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c99f9861-811b-4b7b-8d1d-84339f197ad5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1308 microversion: 2.1 time: 0.317628 Aug 29 05:00:57.194245 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1274/2579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:56 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:57.233429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:57.236953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:57.246611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:57.248074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:57.248711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:57.250249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:57.256309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:57.257071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:57.466670 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2696a7ec-446c-44cb-924f-315df1a261b0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/db980297-bb63-44f7-bae6-8dcb81dc5b4f" status: 200 len: 184 microversion: 2.1 time: 0.453771 Aug 29 05:00:57.467598 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1306/2580] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 05:00:57 2022] GET /compute/v2.1/os-floating-ips/db980297-bb63-44f7-bae6-8dcb81dc5b4f => generated 184 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:57.472925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-220b29cc-b38f-4b09-8454-8bc16de38bf5 req-9c6e1f3b-9919-4002-aeb3-4823a1874927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cfe2c4-11f6-4b11-a3f6-3531a60966a2", "tag": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9"}, {"name": "network-changed", "server_uuid": "2c15cb93-855b-403c-b905-dfd3e2ed68bb", "tag": "a581c00c-7ee3-415b-a9bd-6b161b24b0b8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:57.510809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-220b29cc-b38f-4b09-8454-8bc16de38bf5 req-9c6e1f3b-9919-4002-aeb3-4823a1874927 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:57.515530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-220b29cc-b38f-4b09-8454-8bc16de38bf5 req-9c6e1f3b-9919-4002-aeb3-4823a1874927 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:57.516690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-220b29cc-b38f-4b09-8454-8bc16de38bf5 req-9c6e1f3b-9919-4002-aeb3-4823a1874927 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:57.561737 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-220b29cc-b38f-4b09-8454-8bc16de38bf5 req-9c6e1f3b-9919-4002-aeb3-4823a1874927 service nova] Creating event network-changed:77d571e0-5b8d-40da-8344-3e0ce0a6a8d9 for instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 on n-h1-854119-9 Aug 29 05:00:57.563032 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-220b29cc-b38f-4b09-8454-8bc16de38bf5 req-9c6e1f3b-9919-4002-aeb3-4823a1874927 service nova] Creating event network-changed:a581c00c-7ee3-415b-a9bd-6b161b24b0b8 for instance 2c15cb93-855b-403c-b905-dfd3e2ed68bb on n-h1-854119-9 Aug 29 05:00:57.583889 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-220b29cc-b38f-4b09-8454-8bc16de38bf5 req-9c6e1f3b-9919-4002-aeb3-4823a1874927 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.114644 Aug 29 05:00:57.587362 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1307/2581] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:57.607906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:57.609317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:57.624710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:57.626218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:57.627354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:57.629332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:57.630575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:57.632110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:57.677705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:57.689994 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6b7ed537-3e62-4a3a-9715-4f8e6121af1a tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1524 microversion: 2.1 time: 0.493632 Aug 29 05:00:57.708168 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1275/2582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:57 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1524 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:57.722795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.141"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:58.032643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:58.039510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:58.040168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:58.040881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:58.041781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:58.044108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:58.044666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:58.069428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:58.084877 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-62498107-7551-4c7b-a5a9-9dd36e3cbcfd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.496279 Aug 29 05:00:58.088720 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1308/2583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:57 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:58.111838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:58.112494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:58.129002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:58.129724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:58.130471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:58.132205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:58.133242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:58.134686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:58.325636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:58.362193 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6b029d7a-dbc8-4dd2-bda9-85a67c42cfc1 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1222 microversion: 2.1 time: 0.268388 Aug 29 05:00:58.363490 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1309/2584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:58 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1222 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:58.369942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:58.371016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:58.380492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:58.381459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:58.382083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:58.384189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:58.384882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:58.385529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:58.629842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "refresh_cache-11cfe2c4-11f6-4b11-a3f6-3531a60966a2" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 05:00:58.630368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquired lock "refresh_cache-11cfe2c4-11f6-4b11-a3f6-3531a60966a2" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 05:00:58.789717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:58.798573 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-10ea1a3d-526e-4349-85d5-58ba27aedb80 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1403 microversion: 2.1 time: 0.433773 Aug 29 05:00:58.803602 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1310/2585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:58 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1403 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:58.820948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5a99ec96-63ae-49ce-bded-103955580140 req-4e02b41e-59e1-49b4-bfe4-fcc2e03baaac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c902e9b9-36b2-40c4-9060-98aa8806bd4c", "name": "network-vif-plugged", "status": "completed", "tag": "bcacbbc7-9283-4bfe-bdd0-a18d07b1643f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:00:58.855643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5a99ec96-63ae-49ce-bded-103955580140 req-4e02b41e-59e1-49b4-bfe4-fcc2e03baaac service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:58.856679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5a99ec96-63ae-49ce-bded-103955580140 req-4e02b41e-59e1-49b4-bfe4-fcc2e03baaac service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:58.857615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5a99ec96-63ae-49ce-bded-103955580140 req-4e02b41e-59e1-49b4-bfe4-fcc2e03baaac service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:58.895523 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5a99ec96-63ae-49ce-bded-103955580140 req-4e02b41e-59e1-49b4-bfe4-fcc2e03baaac service nova] Creating event network-vif-plugged:bcacbbc7-9283-4bfe-bdd0-a18d07b1643f for instance c902e9b9-36b2-40c4-9060-98aa8806bd4c on n-h1-854119-9 Aug 29 05:00:58.908828 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5a99ec96-63ae-49ce-bded-103955580140 req-4e02b41e-59e1-49b4-bfe4-fcc2e03baaac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103887 Aug 29 05:00:58.910033 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1311/2586] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:00:58.921336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:58.924738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:58.949423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:58.954319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:58.959395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:58.962616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:58.963113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:58.965427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:59.427077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:00:59.439040 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-db60b75e-c3fc-42df-9900-62cdffb829cc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1308 microversion: 2.1 time: 0.527522 Aug 29 05:00:59.441578 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1312/2587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:58 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:00:59.459648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:00:59.460495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:00:59.474099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:59.477484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:59.479472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:00:59.481924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:00:59.483558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:00:59.486091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:02.363867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:02.375786 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2c15de55-205b-4ad8-9fcb-c45f01849d75 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1524 microversion: 2.1 time: 2.932249 Aug 29 05:01:02.385797 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1313/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:00:59 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1524 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:02.407189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:02.408586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:02.429902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:02.433612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:02.434308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:02.435196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:02.435798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:02.436797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:03.463993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:03.489096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=18 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:03.717859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:03.734198 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa25d73f-c63e-4fba-87dc-bf0743cfb6c4 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 1.346805 Aug 29 05:01:03.743246 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1314/2589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:02 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:03.764058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:03.764706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:03.799754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:03.808305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:03.808896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:03.809665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:03.816220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:03.827516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:04.028772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Building network info cache for instance {{(pid=128871) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 05:01:04.205387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:04.213945 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8bc95aac-172c-432b-a27a-a6a9e3050ea3 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1276 microversion: 2.1 time: 0.468583 Aug 29 05:01:04.219099 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1315/2590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:03 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1276 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:04.232556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:04.236034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:04.250311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:04.252721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:04.253539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:04.255098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:04.258204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:04.261582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:04.929729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:04.944389 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-32a71ae0-d6f0-4177-a28b-b7e3e4717b39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1403 microversion: 2.1 time: 0.723272 Aug 29 05:01:04.950816 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1316/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:04 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1403 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:04.970594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:04.977010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:04.990074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:04.996964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:04.997662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:04.998728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:04.999518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:05.000479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:05.334884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:05.349479 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59349942-2dca-4f4c-bec4-f0eff4ab8176 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1488 microversion: 2.1 time: 0.392141 Aug 29 05:01:05.350596 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1317/2592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:04 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1488 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:05.364493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e71eb09a-d9e9-4a86-954c-0121c35fd345 req-376c4ea7-9fac-4747-9925-892a82c7780f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16924c2-4d44-4b93-a184-10cde1934009", "name": "network-vif-plugged", "status": "completed", "tag": "6ea56d13-f7fa-4e9e-b1a1-33ddd0498066"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:05.383400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e71eb09a-d9e9-4a86-954c-0121c35fd345 req-376c4ea7-9fac-4747-9925-892a82c7780f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:05.384673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e71eb09a-d9e9-4a86-954c-0121c35fd345 req-376c4ea7-9fac-4747-9925-892a82c7780f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:05.385334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e71eb09a-d9e9-4a86-954c-0121c35fd345 req-376c4ea7-9fac-4747-9925-892a82c7780f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:05.406403 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e71eb09a-d9e9-4a86-954c-0121c35fd345 req-376c4ea7-9fac-4747-9925-892a82c7780f service nova] Creating event network-vif-plugged:6ea56d13-f7fa-4e9e-b1a1-33ddd0498066 for instance e16924c2-4d44-4b93-a184-10cde1934009 on n-h1-854119-9 Aug 29 05:01:05.422168 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e71eb09a-d9e9-4a86-954c-0121c35fd345 req-376c4ea7-9fac-4747-9925-892a82c7780f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064798 Aug 29 05:01:05.423233 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1318/2593] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:05.431165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:05.432246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:05.446823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:05.447673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:05.448600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:05.449670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:05.450342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:05.450976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:05.615636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Updating instance_info_cache with network_info: [{"id": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9", "address": "fa:16:3e:6a:74:35", "network": {"id": "264885bf-4295-4c69-814f-ea096817a42d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1585730778-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0be48f9bd0347e7b2765f09ba0d50b9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap77d571e0-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:01:05.633526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Releasing lock "refresh_cache-11cfe2c4-11f6-4b11-a3f6-3531a60966a2" {{(pid=128871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 05:01:05.636854 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-11f27f96-1db5-4324-ab99-5de33b496141 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "POST /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2/action" status: 202 len: 0 microversion: 2.1 time: 7.925192 Aug 29 05:01:05.638299 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1276/2594] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:00:57 2022] POST /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2/action => generated 0 bytes in 7930 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 05:01:05.648736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e892c802-8181-4fcb-bd43-3b74c1e2b809 req-00308de8-a7a7-44a8-8a84-e7396ea5ebc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cfe2c4-11f6-4b11-a3f6-3531a60966a2", "tag": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:05.674481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e892c802-8181-4fcb-bd43-3b74c1e2b809 req-00308de8-a7a7-44a8-8a84-e7396ea5ebc9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:05.679556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e892c802-8181-4fcb-bd43-3b74c1e2b809 req-00308de8-a7a7-44a8-8a84-e7396ea5ebc9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:05.680724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e892c802-8181-4fcb-bd43-3b74c1e2b809 req-00308de8-a7a7-44a8-8a84-e7396ea5ebc9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:05.690060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:05.702803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e02708c-41fa-448e-9885-beb08a2d7e21 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1524 microversion: 2.1 time: 0.277915 Aug 29 05:01:05.704925 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1319/2595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:05 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1524 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:05.716288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:05.719884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:05.721649 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e892c802-8181-4fcb-bd43-3b74c1e2b809 req-00308de8-a7a7-44a8-8a84-e7396ea5ebc9 service nova] Creating event network-changed:77d571e0-5b8d-40da-8344-3e0ce0a6a8d9 for instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 on n-h1-854119-9 Aug 29 05:01:05.733130 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e892c802-8181-4fcb-bd43-3b74c1e2b809 req-00308de8-a7a7-44a8-8a84-e7396ea5ebc9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093178 Aug 29 05:01:05.733781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:05.734538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:05.736109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:05.736559 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1277/2596] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:05.740377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:05.741119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:05.745196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:05.751313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:05.753792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:05.765379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:05.771100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:05.772096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:05.775294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:05.776085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:05.776899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:05.792081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:05.971727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:06.006381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:06.019759 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb3453f8-a4fb-4d76-a564-58f2e40e5fae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.311019 Aug 29 05:01:06.020920 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1320/2597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:05 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:06.028233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-691aadba-49d5-45fa-a160-d1a9a96e3beb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-239272120"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:06.033047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-691aadba-49d5-45fa-a160-d1a9a96e3beb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:06.043443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-691aadba-49d5-45fa-a160-d1a9a96e3beb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:06.044441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-691aadba-49d5-45fa-a160-d1a9a96e3beb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:06.045127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-691aadba-49d5-45fa-a160-d1a9a96e3beb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:06.046072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-691aadba-49d5-45fa-a160-d1a9a96e3beb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:06.046999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-691aadba-49d5-45fa-a160-d1a9a96e3beb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:06.047801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-691aadba-49d5-45fa-a160-d1a9a96e3beb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:06.065599 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f1172e3-aa22-44fa-8762-2172469daab7 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1276 microversion: 2.1 time: 0.325652 Aug 29 05:01:06.086987 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1278/2598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:05 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:06.099974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:06.104594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:06.141434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:06.147143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:06.147143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:06.147143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:06.161270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:06.162193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:06.242542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:01:06.365569 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Instance is already in deleting state, ignoring this request Aug 29 05:01:06.366963 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a81eebfc-9d6e-4aa5-b755-9bd829d9ef2c tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 204 len: 0 microversion: 2.1 time: 0.278624 Aug 29 05:01:06.368067 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1279/2599] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:06 2022] DELETE /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:01:06.378839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:06.380947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:06.391495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:06.397722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:06.398570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:06.399526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:06.400192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:06.401102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:06.423717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:06.449530 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-691aadba-49d5-45fa-a160-d1a9a96e3beb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "POST /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c/action" status: 202 len: 0 microversion: 2.1 time: 0.427152 Aug 29 05:01:06.450512 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1321/2600] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:01:06 2022] POST /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 05:01:06.881777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d000fedd-cb46-4d19-aa99-d5c9ba4645ec tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: .version_select at 0x7f1ab9270a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1572181236", "description": "tempest-description-1241123909"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:08.140405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:08.149101 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc9b5059-76e4-4c8d-9551-0b338ff008c7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1403 microversion: 2.1 time: 1.779525 Aug 29 05:01:08.160973 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1280/2601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:06 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1403 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:08.166461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:08.167429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:08.178580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.181145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.184485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.185440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.186004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.186589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.263652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.264571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.265260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.265962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lazy-loading 'fault' on Instance uuid 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:01:08.377307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:08.417858 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a2876c19-0d72-49af-b4c8-53e014ad08c6 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 200 len: 1314 microversion: 2.1 time: 0.255166 Aug 29 05:01:08.418461 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1281/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:08 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:08.428723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8deff1f8-9100-42c2-85ed-8917948538fb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab9645af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:08.441711 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d000fedd-cb46-4d19-aa99-d5c9ba4645ec tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.989907 Aug 29 05:01:08.445107 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1322/2603] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:01:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:08.462171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:08.465652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:08.486523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.487382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.488512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.490490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.492397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.493100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.511727 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8deff1f8-9100-42c2-85ed-8917948538fb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034" status: 200 len: 1411 microversion: 2.1 time: 0.086632 Aug 29 05:01:08.512342 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1282/2604] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:01:08 2022] GET /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:08.519907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:08.526802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:08.543664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.544195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.545252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.545975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.546655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.547216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.714781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:08.732418 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-855a3be6-85b4-4891-bfd7-9fcf5325dce2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1524 microversion: 2.1 time: 0.281282 Aug 29 05:01:08.733292 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1323/2605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:08 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1524 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:08.745429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:08.751461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:08.769314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.769813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.775635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.780747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.781493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.782455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.854068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:08.869282 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b7b6e90c-4407-435c-8d2c-df2a63b03d31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.355796 Aug 29 05:01:08.870242 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1283/2606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:08 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:08.875250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-262ac4de-fda0-4aee-aa2a-5d5051aec790 req-e8e3b248-32ac-4080-a07a-d935b4d28215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7894a837-4098-4a9b-9fcf-dd5f7d1a5d31", "name": "network-vif-unplugged", "status": "completed", "tag": "4f42455f-dfe0-430a-9e5a-e6570d1bdc4d"}, {"server_uuid": "652fbf6a-e3b6-4ca0-9845-ad15d1348664", "name": "network-vif-plugged", "status": "completed", "tag": "b0857ece-512d-420c-ba5a-53b48cf6e29b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:08.902622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-262ac4de-fda0-4aee-aa2a-5d5051aec790 req-e8e3b248-32ac-4080-a07a-d935b4d28215 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.903323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-262ac4de-fda0-4aee-aa2a-5d5051aec790 req-e8e3b248-32ac-4080-a07a-d935b4d28215 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.903762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-262ac4de-fda0-4aee-aa2a-5d5051aec790 req-e8e3b248-32ac-4080-a07a-d935b4d28215 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:08.931948 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-262ac4de-fda0-4aee-aa2a-5d5051aec790 req-e8e3b248-32ac-4080-a07a-d935b4d28215 service nova] Creating event network-vif-unplugged:4f42455f-dfe0-430a-9e5a-e6570d1bdc4d for instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 on n-h1-854119-9 Aug 29 05:01:08.932486 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-262ac4de-fda0-4aee-aa2a-5d5051aec790 req-e8e3b248-32ac-4080-a07a-d935b4d28215 service nova] Creating event network-vif-plugged:b0857ece-512d-420c-ba5a-53b48cf6e29b for instance 652fbf6a-e3b6-4ca0-9845-ad15d1348664 on n-h1-854119-9 Aug 29 05:01:08.951655 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-262ac4de-fda0-4aee-aa2a-5d5051aec790 req-e8e3b248-32ac-4080-a07a-d935b4d28215 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.079910 Aug 29 05:01:08.953016 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1284/2607] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:08.958017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-2fd1f698-57e7-493a-945e-776b23ebd8f2 req-ef68880e-51c5-42a4-823d-1da82230c72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7894a837-4098-4a9b-9fcf-dd5f7d1a5d31", "name": "network-vif-deleted", "tag": "4f42455f-dfe0-430a-9e5a-e6570d1bdc4d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:08.977969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2fd1f698-57e7-493a-945e-776b23ebd8f2 req-ef68880e-51c5-42a4-823d-1da82230c72b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:08.979896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2fd1f698-57e7-493a-945e-776b23ebd8f2 req-ef68880e-51c5-42a4-823d-1da82230c72b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:08.981921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2fd1f698-57e7-493a-945e-776b23ebd8f2 req-ef68880e-51c5-42a4-823d-1da82230c72b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:09.001889 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2fd1f698-57e7-493a-945e-776b23ebd8f2 req-ef68880e-51c5-42a4-823d-1da82230c72b service nova] Creating event network-vif-deleted:4f42455f-dfe0-430a-9e5a-e6570d1bdc4d for instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 on n-h1-854119-9 Aug 29 05:01:09.012429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-2fd1f698-57e7-493a-945e-776b23ebd8f2 req-ef68880e-51c5-42a4-823d-1da82230c72b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058010 Aug 29 05:01:09.013359 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1285/2608] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:09.056793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:09.065772 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6ef461ba-6b31-4608-8013-bd66e42f29fe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.330537 Aug 29 05:01:09.078591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1324/2609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:08 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:09.091459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d1f9747-ee59-4c21-9e3f-4c2db4624707 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: .version_select at 0x7f1abd968310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1796309295", "description": "tempest-description-282900840"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:09.127753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b04f906a-6a68-4e16-8e85-cf64de360568 req-86719f6a-9b5f-4d8f-b374-143029b3d328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5dc7d86-1634-4dc0-94aa-8deb57e7d232", "tag": "f5a191bd-ccac-4d87-a97f-82a77c3543b5"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:09.141034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b04f906a-6a68-4e16-8e85-cf64de360568 req-86719f6a-9b5f-4d8f-b374-143029b3d328 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:09.141791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b04f906a-6a68-4e16-8e85-cf64de360568 req-86719f6a-9b5f-4d8f-b374-143029b3d328 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:09.141944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b04f906a-6a68-4e16-8e85-cf64de360568 req-86719f6a-9b5f-4d8f-b374-143029b3d328 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:09.177022 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b04f906a-6a68-4e16-8e85-cf64de360568 req-86719f6a-9b5f-4d8f-b374-143029b3d328 service nova] Creating event network-changed:f5a191bd-ccac-4d87-a97f-82a77c3543b5 for instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 on n-h1-854119-9 Aug 29 05:01:09.183488 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b04f906a-6a68-4e16-8e85-cf64de360568 req-86719f6a-9b5f-4d8f-b374-143029b3d328 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168770 Aug 29 05:01:09.185435 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1286/2610] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:09.193279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c801130-eb47-4aa0-8c69-9cec91e992a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab95559d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:09.295069 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c801130-eb47-4aa0-8c69-9cec91e992a4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034" status: 200 len: 1411 microversion: 2.1 time: 0.107945 Aug 29 05:01:09.295777 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1287/2611] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:01:09 2022] GET /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:09.309620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:09.310358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:09.326521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:09.333480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:09.333938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:09.334689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:09.335157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:09.335643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:09.429865 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d1f9747-ee59-4c21-9e3f-4c2db4624707 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.348773 Aug 29 05:01:09.431118 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1325/2612] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:01:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:09.438635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4842369-41af-4e47-891f-8bef21386adc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab96fbc10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:09.556813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:09.572165 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d08b3955-88b1-4f41-91ea-ef4be7310775 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1403 microversion: 2.1 time: 0.274292 Aug 29 05:01:09.578314 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1288/2613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:09 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1403 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:09.595402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:09.597057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:09.604758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:09.605306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:09.605806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:09.606603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:09.607103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:09.607676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:09.625949 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] HTTP exception thrown: Instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 could not be found. Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Request method failure captured: Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 HTTP/1.1 Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEe01ER4DEQhZISVT3OSXeeIr3Cu7raM1YMG2L7FaMS7NJWOMsw_aYKj8b37gYVfcCNc4ppCHH4ELkX_eeOfYD8hrdqYxzSCKweSaSdY_zarzv50svlAn2jQq92OQZfLrpETsEdqDmsw9RBpQQX6HGAwzrUHZd3q5z7aZ-8Aw89zwaI Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: d0be48f9bd0347e7b2765f09ba0d50b9 Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1177526769 Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0be48f9bd0347e7b2765f09ba0d50b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0be48f9bd0347e7b2765f09ba0d50b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0be48f9bd0347e7b2765f09ba0d50b9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0be48f9bd0347e7b2765f09ba0d50b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1177526769 Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: d0be48f9bd0347e7b2765f09ba0d50b9 Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1177526769 Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-FloatingIPsAssociationTestJSON-1177526769-project Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5f9b5a46468f4cb79a0ec52a86f4482d Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1177526769-project Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 could not be found. Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7894a837-4098-4a9b-9fcf-dd5f7d1a5d31'} Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 could not be found. Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 could not be found. Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:09.627766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 could not be found. Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Returning 404 to user: Instance 7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cbcc3370-9f1c-481f-a3a6-4b7105a59e9a tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31" status: 404 len: 111 microversion: 2.1 time: 0.045802 Aug 29 05:01:09.635789 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1289/2614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:09 2022] GET /compute/v2.1/servers/7894a837-4098-4a9b-9fcf-dd5f7d1a5d31 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:09.639827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-859056318", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "830055cb-0272-4311-a24b-9881fd9d72ea"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:09.702910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] validate_networks() for [('830055cb-0272-4311-a24b-9881fd9d72ea', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:01:09.750613 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4842369-41af-4e47-891f-8bef21386adc tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034" status: 204 len: 0 microversion: 2.1 time: 0.318300 Aug 29 05:01:09.752831 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1326/2615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:09 2022] DELETE /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:01:09.765351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-72f9c19c-e750-4ac2-9bc3-25262f2377c3 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '.version_select at 0x7f1ab92709d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:11.634766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:01:11.635313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:01:11.635872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:01:11.636551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:01:11.637784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:01:11.649236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:11.649830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:11.650635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:11.651931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:11.652428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:11.652960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:11.671602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Getting quotas for project 9e7d2fe02ed74ebe917c21af1d280080. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:01:11.677105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Getting quotas for user 1833f2d2adf84acf98169a3ef701a492 and project 9e7d2fe02ed74ebe917c21af1d280080. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:01:11.692033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:01:11.694355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:01:11.744523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dbfbe44c-d781-4e47-b4e2-601bb08878b8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.109484 Aug 29 05:01:11.751027 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1290/2616] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:01:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:01:11.774103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:11.774723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:11.776826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:11.807606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:11.808133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:11.808572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:11.809296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:11.809747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:11.810175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.305277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:12.313820 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9cbe394d-bca7-4d9b-9315-96b30385b603 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1506 microversion: 2.1 time: 0.561620 Aug 29 05:01:12.319646 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1291/2617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:11 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:12.331042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bbfffbad-c5bd-42b4-abc2-76fa09e845e8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1aba2bc160>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:12.364669 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-bbfffbad-c5bd-42b4-abc2-76fa09e845e8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Image not found. Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bbfffbad-c5bd-42b4-abc2-76fa09e845e8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 HTTP/1.1 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'a46d1ad3-3427-4c7d-91c7-a8ed1bc95034'} Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 05:01:12.367364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 could not be found. Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bbfffbad-c5bd-42b4-abc2-76fa09e845e8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:12.372397 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bbfffbad-c5bd-42b4-abc2-76fa09e845e8 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034" status: 404 len: 62 microversion: 2.1 time: 0.047938 Aug 29 05:01:12.379350 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1292/2618] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:01:12 2022] GET /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:01:12.381353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:12.381969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:12.390805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-72f9c19c-e750-4ac2-9bc3-25262f2377c3 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/db980297-bb63-44f7-bae6-8dcb81dc5b4f" status: 202 len: 0 microversion: 2.1 time: 2.635656 Aug 29 05:01:12.391798 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1327/2619] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:01:09 2022] DELETE /compute/v2.1/os-floating-ips/db980297-bb63-44f7-bae6-8dcb81dc5b4f => generated 0 bytes in 2638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:01:12.393521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.394075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.394650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.395419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.395915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.396473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.398622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:12.399520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:12.413317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.416613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.417120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.419169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.419703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.428292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.618704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:12.624109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:12.628854 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed600fc8-a5fc-4568-bbeb-abfed783df4c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.251727 Aug 29 05:01:12.629584 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1293/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:12 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:12.633434 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08ad9578-75e7-4607-b3e1-ab383ec93c2f tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.240223 Aug 29 05:01:12.634262 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1328/2621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:12 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:12.634870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:12.636060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:12.643109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.643928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.644686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.645596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.646184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:12.646469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.646972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:12.647342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.655395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.655876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.659536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.660340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.660805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.661355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.869194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:12.887013 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6118918f-9d91-4eaa-8e7d-d806ee5eb520 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1219 microversion: 2.1 time: 0.251594 Aug 29 05:01:12.889758 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1329/2622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:12 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1219 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:12.922758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:12.923531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:12.930651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.931443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.932095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:12.933017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:12.933621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:12.934201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:13.233282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:13.242043 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30856766-9dc1-4d72-bacf-0f62e912d14e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1590 microversion: 2.1 time: 0.611119 Aug 29 05:01:13.242709 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1294/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:12 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1590 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:13.247604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:13.248239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:13.254700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:13.255442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:13.256109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:13.257047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:13.257706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:13.258340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:13.269349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:13.278427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0af689c6-b30a-4c0a-bba5-39d4b576adcb tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1506 microversion: 2.1 time: 0.378417 Aug 29 05:01:13.285323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:01:13.291887 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1330/2624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:12 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:13.297075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d66a42e2-1d49-4502-867d-27b99474bf8f req-c41d038f-94c7-46de-920a-cc8aac150daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c15cb93-855b-403c-b905-dfd3e2ed68bb", "name": "network-vif-plugged", "status": "completed", "tag": "a581c00c-7ee3-415b-a9bd-6b161b24b0b8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:13.307010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d66a42e2-1d49-4502-867d-27b99474bf8f req-c41d038f-94c7-46de-920a-cc8aac150daf service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:13.307634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d66a42e2-1d49-4502-867d-27b99474bf8f req-c41d038f-94c7-46de-920a-cc8aac150daf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:13.308067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d66a42e2-1d49-4502-867d-27b99474bf8f req-c41d038f-94c7-46de-920a-cc8aac150daf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:13.321053 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d66a42e2-1d49-4502-867d-27b99474bf8f req-c41d038f-94c7-46de-920a-cc8aac150daf service nova] Creating event network-vif-plugged:a581c00c-7ee3-415b-a9bd-6b161b24b0b8 for instance 2c15cb93-855b-403c-b905-dfd3e2ed68bb on n-h1-854119-9 Aug 29 05:01:13.327256 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d66a42e2-1d49-4502-867d-27b99474bf8f req-c41d038f-94c7-46de-920a-cc8aac150daf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033206 Aug 29 05:01:13.327960 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1331/2625] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:13.334859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd954384-b8e5-400f-ae6d-a2ea354203c8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:13.335494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fd954384-b8e5-400f-ae6d-a2ea354203c8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:13.343025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd954384-b8e5-400f-ae6d-a2ea354203c8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:13.343507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd954384-b8e5-400f-ae6d-a2ea354203c8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:13.343940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd954384-b8e5-400f-ae6d-a2ea354203c8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:13.344885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd954384-b8e5-400f-ae6d-a2ea354203c8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:13.345385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd954384-b8e5-400f-ae6d-a2ea354203c8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:13.345933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd954384-b8e5-400f-ae6d-a2ea354203c8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:13.374578 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-10dbcc55-4744-4ee8-807b-5643b694099e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 204 len: 0 microversion: 2.1 time: 0.128343 Aug 29 05:01:13.375186 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1295/2626] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:13 2022] DELETE /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:01:13.380532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:13.383059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:13.391509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:13.392246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:13.392684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:13.393526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:13.393992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:13.394398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:13.510626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd954384-b8e5-400f-ae6d-a2ea354203c8 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180731 Aug 29 05:01:13.511301 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1332/2627] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:01:13 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:13.516412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:13.517253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:13.525732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:13.528964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:13.529544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:13.530400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:13.532930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:13.533513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:13.533955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:14.077883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:14.092048 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-345922fd-633e-40ad-bb2e-f0b67e62db04 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1506 microversion: 2.1 time: 0.715450 Aug 29 05:01:14.094005 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1296/2628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:13 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1506 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:14.110419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:14.111310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:14.117946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:14.118731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:14.119380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:14.120354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:14.121030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:14.121653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:14.159901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:14.169062 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17ebf232-7f1c-4a12-8839-7ee6794e13c8 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1526 microversion: 2.1 time: 0.656286 Aug 29 05:01:14.170033 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1333/2629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:13 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1526 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:14.175324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:14.176176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:14.190350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:14.191793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:14.192256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:14.193476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:14.194814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:14.203752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:14.812725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:14.821245 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b21bea7-bfea-4b67-a62e-bb7afdb5948f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.725919 Aug 29 05:01:14.821909 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1297/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:14 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:14.828646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:14.830831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:14.838896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:14.839684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:14.840347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:14.841769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:14.842219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:14.842863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:14.862316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:14.871936 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-99146413-92fc-468e-bb35-fe0370677367 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.700422 Aug 29 05:01:14.873251 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1334/2631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:14 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:14.878258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:14.879111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:14.885884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:14.886684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:14.887323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:14.888257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:14.888914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:14.889543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:15.068547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:15.078857 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eafd11f9-d05f-4442-bb16-b06b1a962868 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1211 microversion: 2.1 time: 0.255619 Aug 29 05:01:15.079917 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1298/2632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:14 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1211 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:15.114281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:15.114998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:15.122159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:15.122923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:15.123426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:15.124220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:15.124748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:15.125253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:15.456634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:15.464785 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da0081cc-6215-459f-9b3c-756c8903412b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1506 microversion: 2.1 time: 0.590151 Aug 29 05:01:15.465460 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1335/2633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:14 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:15.470186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:15.470864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:15.476807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:15.477599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:15.478252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:15.479193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:15.479900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:15.480354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:15.534821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:15.543173 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9c5a9ba8-6a2f-41ae-8e44-b938feb6c660 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1506 microversion: 2.1 time: 0.432884 Aug 29 05:01:15.543834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1299/2634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:15 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:15.548814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d88218c0-62dc-43a7-ad9b-90381d3b6947 req-c20a7aa1-52de-49ad-b9e0-551f41c800b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f05ad94c-e821-4e1b-8a8d-82363cd3659c", "name": "network-vif-plugged", "status": "completed", "tag": "fb36119d-18a9-40d3-8ef7-07a524215b7c"}, {"server_uuid": "b65e5f2d-e369-4e32-a10f-d3c261c15e87", "name": "network-vif-unplugged", "status": "completed", "tag": "1754cce9-2a4f-42a1-8b8a-f6943372486b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:15.562239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d88218c0-62dc-43a7-ad9b-90381d3b6947 req-c20a7aa1-52de-49ad-b9e0-551f41c800b8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:15.562800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d88218c0-62dc-43a7-ad9b-90381d3b6947 req-c20a7aa1-52de-49ad-b9e0-551f41c800b8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:15.563301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d88218c0-62dc-43a7-ad9b-90381d3b6947 req-c20a7aa1-52de-49ad-b9e0-551f41c800b8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:15.577224 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d88218c0-62dc-43a7-ad9b-90381d3b6947 req-c20a7aa1-52de-49ad-b9e0-551f41c800b8 service nova] Creating event network-vif-plugged:fb36119d-18a9-40d3-8ef7-07a524215b7c for instance f05ad94c-e821-4e1b-8a8d-82363cd3659c on n-h1-854119-9 Aug 29 05:01:15.578089 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d88218c0-62dc-43a7-ad9b-90381d3b6947 req-c20a7aa1-52de-49ad-b9e0-551f41c800b8 service nova] Creating event network-vif-unplugged:1754cce9-2a4f-42a1-8b8a-f6943372486b for instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 on n-h1-854119-9 Aug 29 05:01:15.585057 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d88218c0-62dc-43a7-ad9b-90381d3b6947 req-c20a7aa1-52de-49ad-b9e0-551f41c800b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039157 Aug 29 05:01:15.585811 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1300/2635] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:15.701099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:15.711051 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f0493dfc-7101-4762-9806-f9c313b4a2db tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1526 microversion: 2.1 time: 0.244271 Aug 29 05:01:15.711973 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1336/2636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:15 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1526 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:15.845636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:15.846331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:15.853233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:15.853976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:15.854587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:15.855269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:15.855869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:15.856459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:15.894583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:15.895193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:15.910859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:15.913968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:15.916445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:15.917408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:15.918035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:15.918644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.104554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:16.108882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:16.109051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:16.117923 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df8dd339-c903-46c7-b0ce-8246ba80cf21 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.227798 Aug 29 05:01:16.122754 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e2e89527-95d3-4c18-bbb2-418db84d5cdb tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.281384 Aug 29 05:01:16.123844 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1301/2637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:15 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:16.130171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:16.130807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:16.132196 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1337/2638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:15 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:16.138743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-893687fd-6ba5-4f9c-9a0d-f2aa2c83d446 req-cbbc92ce-b0df-4c02-91b2-2f84b6400e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16924c2-4d44-4b93-a184-10cde1934009", "tag": "6ea56d13-f7fa-4e9e-b1a1-33ddd0498066"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:16.139617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.140138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.140568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.141264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.141710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.142128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.153175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-893687fd-6ba5-4f9c-9a0d-f2aa2c83d446 req-cbbc92ce-b0df-4c02-91b2-2f84b6400e78 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.154027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-893687fd-6ba5-4f9c-9a0d-f2aa2c83d446 req-cbbc92ce-b0df-4c02-91b2-2f84b6400e78 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.154686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-893687fd-6ba5-4f9c-9a0d-f2aa2c83d446 req-cbbc92ce-b0df-4c02-91b2-2f84b6400e78 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.167219 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-893687fd-6ba5-4f9c-9a0d-f2aa2c83d446 req-cbbc92ce-b0df-4c02-91b2-2f84b6400e78 service nova] Creating event network-changed:6ea56d13-f7fa-4e9e-b1a1-33ddd0498066 for instance e16924c2-4d44-4b93-a184-10cde1934009 on n-h1-854119-9 Aug 29 05:01:16.173457 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-893687fd-6ba5-4f9c-9a0d-f2aa2c83d446 req-cbbc92ce-b0df-4c02-91b2-2f84b6400e78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038240 Aug 29 05:01:16.174486 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1338/2639] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:16.182099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:16.183088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:16.189866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.190617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.191255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.192041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.192604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.193097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.281931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:16.290665 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-195c22f8-0491-424a-a553-bb152b0bd8a0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1267 microversion: 2.1 time: 0.114322 Aug 29 05:01:16.305322 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1339/2640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:16 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:16.320356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:16.328804 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23d2f0f2-7e12-4da1-ba2a-6d75c503523e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1590 microversion: 2.1 time: 0.203704 Aug 29 05:01:16.329552 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1302/2641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:16 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1590 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:16.489782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:16.490669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:16.498249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.499019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.499674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.500605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.501348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.502238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.566787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:16.567793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:16.578301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.578935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.584050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.584883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.587731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.588217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.704646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:16.717320 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-785f3e63-dee6-4e51-9798-21b4bb26c31c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1506 microversion: 2.1 time: 0.228587 Aug 29 05:01:16.719742 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1340/2642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:16 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:16.740219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:16.741028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:16.749047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.749869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.750779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.751730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:16.752700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:16.753332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:16.783737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:16.855635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:16.870439 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-334a39f3-3393-4b7d-b2c7-35db985214ae tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1506 microversion: 2.1 time: 0.306757 Aug 29 05:01:16.872004 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1303/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:16 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:16.939759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:16.950301 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17293f47-cf00-4298-872a-d26b12e6fc1f tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1526 microversion: 2.1 time: 0.214513 Aug 29 05:01:16.964204 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1341/2644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:16 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1526 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:17.138419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:17.139909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:17.146993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.147893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.148716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:17.148966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:17.149150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:17.150517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.151230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.151951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:17.156977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.157613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.158246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:17.158939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.160945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.161473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:17.391712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:17.403928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:17.414812 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5fa12537-e479-4954-ba00-4039be9732a5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.270149 Aug 29 05:01:17.416245 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1342/2645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:17 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:17.421810 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c7a09c03-5395-41e1-9dc9-fb425b1b4cfd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.278504 Aug 29 05:01:17.422451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:17.423486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:17.430104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.430806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.431238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:17.431929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.432406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.432828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:17.437096 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1304/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:17 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:17.508953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:17.517047 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-54fd7191-d79a-49f6-81a9-79ecc2a486c5 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1267 microversion: 2.1 time: 0.099268 Aug 29 05:01:17.517628 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1343/2647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:17 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:17.743815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:17.745172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:17.752316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.752900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.753457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:17.754825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.755375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.755886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:17.890554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:17.891178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:17.904698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.905034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.908460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:17.912268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:17.912268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:17.912268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:18.123876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:18.135388 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-92ea70a0-202d-4637-92db-328fea74882b tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1506 microversion: 2.1 time: 0.396883 Aug 29 05:01:18.137269 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1305/2648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:17 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:18.143821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:18.145147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:18.154685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:18.155537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:18.156266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:18.157640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:18.158396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:18.158989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:18.202744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:18.214281 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed3b6708-bb97-48d6-88cf-36c3bcddc659 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1506 microversion: 2.1 time: 0.327700 Aug 29 05:01:18.215615 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1344/2649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:17 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:18.339224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:18.347784 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a738a35b-06ea-4b11-884d-7c16aafe3659 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1526 microversion: 2.1 time: 0.209194 Aug 29 05:01:18.348708 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1306/2650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:18 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1526 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:18.441272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:18.442156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:18.443462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:18.444268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:18.450279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:18.451130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:18.451791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:18.452920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:18.453706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:18.454342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:18.458153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:18.459247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:18.459700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:18.460530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:18.462131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:18.462131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:18.681701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:18.690332 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-99f5a4a3-8246-4da4-9cfa-f1e8008277cd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.258012 Aug 29 05:01:18.705871 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1345/2651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:18 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:18.715912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:18.716582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:18.722966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:18.723427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:18.723558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:18.723892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:18.724652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:18.725109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:18.725696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:18.738174 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5df1bf54-6d65-4d5c-b598-d10f4a803887 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.298541 Aug 29 05:01:18.739144 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1307/2652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:18 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:18.815328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:18.823418 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11bc8703-2a6d-41e0-8dda-17284ad1efdc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1267 microversion: 2.1 time: 0.116326 Aug 29 05:01:18.828189 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1346/2653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:18 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:19.157917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:19.158841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:19.166930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.168305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.168948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.170190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.170818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.171242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.235163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:19.236912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:19.243531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.246861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.247439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.248297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.248869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.249527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.343322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:19.352203 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6b81245e-0ee2-4446-b921-10711d0a31ff tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1506 microversion: 2.1 time: 0.198459 Aug 29 05:01:19.352966 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1308/2654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:19 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:19.371476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:19.372210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:19.378411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.379096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.379867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.380600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.381050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.381468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.407122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:19.415619 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-564fd426-9b19-4791-9afe-ac6fd8a34a24 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1506 microversion: 2.1 time: 0.184645 Aug 29 05:01:19.416568 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1347/2655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:19 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:19.522118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:19.530505 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d945bb4b-4a1e-416a-ad0a-467405510fc5 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1526 microversion: 2.1 time: 0.163439 Aug 29 05:01:19.531584 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1309/2656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:19 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:19.717685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:19.718569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:19.730744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.731422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.731956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.732800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.733367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.734463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.767322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:19.768521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:19.779701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.780347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.780793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.781655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:19.782113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:19.782670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:19.988379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:19.989605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:20.003863 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9181ee95-a2fd-430c-970a-29c938de14f5 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.290228 Aug 29 05:01:20.004112 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-650f1e71-6998-4169-abca-224951dadfdd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.246196 Aug 29 05:01:20.017736 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1310/2657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:19 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:20.018143 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1348/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:19 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:20.023912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:20.024565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:20.030912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:20.031405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:20.031839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:20.032578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:20.033025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:20.033714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:20.108326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:20.119269 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9471dbc0-2a23-4634-94c8-f3467a8588c2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1267 microversion: 2.1 time: 0.102494 Aug 29 05:01:20.132143 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1311/2659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:20 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:20.313782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-737c4fcb-f5e1-4286-bbe1-08d9d58d4d61 req-07e2dd7f-9352-4a79-8fd6-cf0a0ee4d13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dc7d86-1634-4dc0-94aa-8deb57e7d232", "name": "network-vif-plugged", "status": "completed", "tag": "f5a191bd-ccac-4d87-a97f-82a77c3543b5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:20.327407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-737c4fcb-f5e1-4286-bbe1-08d9d58d4d61 req-07e2dd7f-9352-4a79-8fd6-cf0a0ee4d13f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:20.327900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-737c4fcb-f5e1-4286-bbe1-08d9d58d4d61 req-07e2dd7f-9352-4a79-8fd6-cf0a0ee4d13f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:20.328521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-737c4fcb-f5e1-4286-bbe1-08d9d58d4d61 req-07e2dd7f-9352-4a79-8fd6-cf0a0ee4d13f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:20.350589 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-737c4fcb-f5e1-4286-bbe1-08d9d58d4d61 req-07e2dd7f-9352-4a79-8fd6-cf0a0ee4d13f service nova] Creating event network-vif-plugged:f5a191bd-ccac-4d87-a97f-82a77c3543b5 for instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 on n-h1-854119-9 Aug 29 05:01:20.357394 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-737c4fcb-f5e1-4286-bbe1-08d9d58d4d61 req-07e2dd7f-9352-4a79-8fd6-cf0a0ee4d13f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049403 Aug 29 05:01:20.358250 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1349/2660] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:01:20.375348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:20.376138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:20.387214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:20.387711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:20.390097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:20.391287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:20.391909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:20.392548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:20.438315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:20.439164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:20.446371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:20.446869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:20.447301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:20.448874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:20.449347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:20.449773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:20.763953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:20.773454 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9571a906-65a8-4ea0-a6e5-e69c77539501 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1501 microversion: 2.1 time: 0.402681 Aug 29 05:01:20.774185 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1312/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:20 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1501 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:20.796433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:20.797073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:20.803274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:20.803774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:20.804410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:20.805152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:20.805606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:20.806028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:20.839502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:20.849772 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f36ceade-95c1-4d07-82d8-a0313a6f6a94 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1506 microversion: 2.1 time: 0.416231 Aug 29 05:01:20.850356 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1350/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:20 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:21.026225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:21.027489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:21.034383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:21.035378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:21.035968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:21.036832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:21.037584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:21.038097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:21.635490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:21.644429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8a1ab675-e215-438b-8f73-ea6aee2e432e tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1526 microversion: 2.1 time: 0.851989 Aug 29 05:01:21.645015 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1313/2663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:20 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1526 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:21.649751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:21.650316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:21.656397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:21.656879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:21.657363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:21.657980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:21.658447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:21.658862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:21.663125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:21.689573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:21.961337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:21.969320 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-208eea22-8d1e-425d-8f59-99574b4fff7c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1320 microversion: 2.1 time: 0.947685 Aug 29 05:01:21.970125 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1351/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:21 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1320 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:21.974558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:21.975166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:21.981024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:21.981474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:21.982112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:21.982810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:21.983266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:21.983688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.126955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:22.135059 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21341b5d-1ca0-4e8f-b59d-ac3ed66f375c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1267 microversion: 2.1 time: 0.163963 Aug 29 05:01:22.135842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1352/2665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:21 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:22.144159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:22.144971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:22.151838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.152416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.152843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.153542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.153984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.154400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.248604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:22.256749 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d0e3041a-375c-49f3-b789-7ba1a908ddcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.610661 Aug 29 05:01:22.257300 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1314/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:21 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:22.261907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:22.262828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:22.273696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.274477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.275132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.275931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.276473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.276964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.552345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:22.561113 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-79f57849-ee7a-4b45-aa68-9d45a5448c53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1488 microversion: 2.1 time: 0.424029 Aug 29 05:01:22.561940 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1353/2667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:22 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1488 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:22.584107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:22.584694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:22.591857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.592456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.592954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.593716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.594249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.594881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.624261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:01:22.702950 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0c713e71-e7e1-4715-b3ad-b6d3049efcf4 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 204 len: 0 microversion: 2.1 time: 0.122883 Aug 29 05:01:22.703544 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1354/2668] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:22 2022] DELETE /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:01:22.713339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:22.713339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:22.717010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.717486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.717952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.718642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.719087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.719504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.751062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:22.759547 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e6530504-a693-4430-851b-1c67ea499763 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 200 len: 1509 microversion: 2.1 time: 0.500703 Aug 29 05:01:22.760077 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1315/2669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:22 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 1509 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:22.764458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74b04097-3d04-41b5-af66-3520fa60936f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8d48e50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:22.786696 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-74b04097-3d04-41b5-af66-3520fa60936f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Image not found. Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74b04097-3d04-41b5-af66-3520fa60936f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 HTTP/1.1 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'a46d1ad3-3427-4c7d-91c7-a8ed1bc95034'} Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 to delete Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 could not be found. Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:22.788665 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74b04097-3d04-41b5-af66-3520fa60936f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-74b04097-3d04-41b5-af66-3520fa60936f tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034" status: 404 len: 62 microversion: 2.1 time: 0.029023 Aug 29 05:01:22.793822 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1316/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:22 2022] DELETE /compute/v2.1/images/a46d1ad3-3427-4c7d-91c7-a8ed1bc95034 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:01:22.798243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:22.798754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:22.805814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.806299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.806733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.807433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:22.808037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:22.808633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:22.834712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:01:22.841108 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Working on deleting snapshot 293c66d3-96f6-43c5-ab03-414eeb518869 from shelved instance... Aug 29 05:01:23.161508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:23.172647 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-54501ba1-21a2-4a48-9095-298c216ffaeb tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1526 microversion: 2.1 time: 0.467849 Aug 29 05:01:23.173580 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1355/2671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:22 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1526 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:23.179597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:23.180421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:23.187008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:23.187814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:23.188465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:23.189302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:23.189753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:23.190217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:23.221179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:01:23.237781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:23.279429 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.compute.api [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Instance is already in deleting state, ignoring this request Aug 29 05:01:23.280312 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7193db14-fea6-46a7-b593-51fe54d686e5 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 204 len: 0 microversion: 2.1 time: 0.104844 Aug 29 05:01:23.283852 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1356/2672] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:23 2022] DELETE /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:01:23.290387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:23.291164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:23.298950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:23.300516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:23.301124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:23.302204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:23.302644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:23.303037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:23.487883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Doing local delete in cell a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) {{(pid=128871) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 05:01:23.488562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:23.489044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:23.489475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:23.489891 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 05:01:23.497927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] deallocate_for_instance() {{(pid=128871) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 29 05:01:23.914177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:23.923099 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e5c7cb04-07a9-4562-b3b0-b984c8c2704f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1510 microversion: 2.1 time: 0.637203 Aug 29 05:01:23.923695 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1357/2673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:23 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1510 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:23.928201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:23.929022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:23.934961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:23.935811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:23.936282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:23.937153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:23.937784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:23.938238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:24.036472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:24.045205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cb4b06ef-d194-4da6-8d7b-b340c7d2575d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1275 microversion: 2.1 time: 0.120447 Aug 29 05:01:24.045807 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1358/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:23 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1275 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:24.050504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:24.051115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:24.061117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:24.061604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:24.062042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:24.062736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:24.063232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:24.063650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:24.406312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:24.414664 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef621a48-9f0a-420c-9455-36a8629d647c tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.367768 Aug 29 05:01:24.428280 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1359/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:24 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:24.433046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:24.433708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:24.439847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:24.440403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:24.440830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:24.441505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:24.442137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:24.442619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:24.717686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:24.727295 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-10e35902-6602-4f58-85e1-0e508fbd2a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1494 microversion: 2.1 time: 0.298040 Aug 29 05:01:24.738359 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1360/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:24 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1494 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:24.738359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-97b2eb13-045d-426b-9a01-c7cb38fc31f9 req-3037e7d1-d09f-4a62-b413-22c1f58af9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cfe2c4-11f6-4b11-a3f6-3531a60966a2", "name": "network-vif-deleted", "tag": "77d571e0-5b8d-40da-8344-3e0ce0a6a8d9"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:24.742779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-97b2eb13-045d-426b-9a01-c7cb38fc31f9 req-3037e7d1-d09f-4a62-b413-22c1f58af9e8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:24.743280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-97b2eb13-045d-426b-9a01-c7cb38fc31f9 req-3037e7d1-d09f-4a62-b413-22c1f58af9e8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:24.743829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-97b2eb13-045d-426b-9a01-c7cb38fc31f9 req-3037e7d1-d09f-4a62-b413-22c1f58af9e8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:24.757881 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-97b2eb13-045d-426b-9a01-c7cb38fc31f9 req-3037e7d1-d09f-4a62-b413-22c1f58af9e8 service nova] Creating event network-vif-deleted:77d571e0-5b8d-40da-8344-3e0ce0a6a8d9 for instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 on n-h1-854119-9 Aug 29 05:01:24.763591 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-97b2eb13-045d-426b-9a01-c7cb38fc31f9 req-3037e7d1-d09f-4a62-b413-22c1f58af9e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034522 Aug 29 05:01:24.764844 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1361/2677] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:24.769606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:24.770290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:24.780206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:24.780695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:24.781127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:24.781828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:24.782272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:24.782687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:24.878222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Updating instance_info_cache with network_info: [] {{(pid=128871) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:01:24.902657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:25.032546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:25.041178 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98c02c31-82c9-4d1d-a9da-ffd7562c8220 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1512 microversion: 2.1 time: 0.275346 Aug 29 05:01:25.056152 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1362/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:24 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:25.060490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:25.062145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:25.073390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.076550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.077519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.079254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.081106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.081723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.165572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9b5a46468f4cb79a0ec52a86f4482d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0be48f9bd0347e7b2765f09ba0d50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:25.175553 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ba4d7d2-c679-4ca0-b29b-50187c4188d4 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 200 len: 1484 microversion: 2.1 time: 0.129562 Aug 29 05:01:25.176506 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1363/2679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:25 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 1484 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:25.181568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6daf65f6-a1de-4ec8-b04b-b36299d38817 req-8eb7cc16-2192-436c-ba6e-aee1cfc8bd24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f05ad94c-e821-4e1b-8a8d-82363cd3659c", "name": "network-vif-unplugged", "status": "completed", "tag": "fb36119d-18a9-40d3-8ef7-07a524215b7c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:25.192186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6daf65f6-a1de-4ec8-b04b-b36299d38817 req-8eb7cc16-2192-436c-ba6e-aee1cfc8bd24 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.192942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6daf65f6-a1de-4ec8-b04b-b36299d38817 req-8eb7cc16-2192-436c-ba6e-aee1cfc8bd24 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.193545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6daf65f6-a1de-4ec8-b04b-b36299d38817 req-8eb7cc16-2192-436c-ba6e-aee1cfc8bd24 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.207010 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6daf65f6-a1de-4ec8-b04b-b36299d38817 req-8eb7cc16-2192-436c-ba6e-aee1cfc8bd24 service nova] Creating event network-vif-unplugged:fb36119d-18a9-40d3-8ef7-07a524215b7c for instance f05ad94c-e821-4e1b-8a8d-82363cd3659c on n-h1-854119-9 Aug 29 05:01:25.212272 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6daf65f6-a1de-4ec8-b04b-b36299d38817 req-8eb7cc16-2192-436c-ba6e-aee1cfc8bd24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034311 Aug 29 05:01:25.213081 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1364/2680] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:25.219447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:25.220183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:25.226707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.227217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.227737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.228828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.229470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.230046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.273202 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e22faab9-72a8-423c-97fd-371bdec8759b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 204 len: 0 microversion: 2.1 time: 2.478380 Aug 29 05:01:25.273770 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1317/2681] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:22 2022] DELETE /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 0 bytes in 2480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:01:25.278698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:25.279603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:25.285629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.286109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.286538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.287240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.287760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.288215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.303346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:25.318385 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-016b8f05-269f-4cc9-90d8-2b93548b7a97 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1275 microversion: 2.1 time: 0.103628 Aug 29 05:01:25.318991 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1365/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:25 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:25.328491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:25.329103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:25.336600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.337099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.337572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.338291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.338878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.339343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.353440 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 HTTP/1.1 Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'b65e5f2d-e369-4e32-a10f-d3c261c15e87'} Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:25.355086 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7582f2ad-eac1-485a-a6fb-7bd1db4c27f1 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 404 len: 111 microversion: 2.1 time: 0.036625 Aug 29 05:01:25.358811 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1366/2683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:25 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:25.438074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:25.439199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:25.446003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.446567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.447077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.447824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.448495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.449121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.837140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:25.844891 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d9dd7bd1-aca1-4f15-8aaf-042d2d750426 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c" status: 200 len: 1512 microversion: 2.1 time: 0.570088 Aug 29 05:01:25.845474 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1318/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:25 2022] GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c => generated 1512 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:25.856558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1550291499", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "57e28866-1c32-4826-b8f3-b2fdc024be39"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:25.877181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:25.890310 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bbc39f1c-5475-4eba-8f6d-066b544614ca tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1318 microversion: 2.1 time: 0.457384 Aug 29 05:01:25.892091 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1367/2685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:25 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:25.909720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:25.910339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:25.917247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.917735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.918167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.918864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:25.919986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:25.920447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:25.938275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] validate_networks() for [('57e28866-1c32-4826-b8f3-b2fdc024be39', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:01:27.064449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:27.073019 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0c0f281-85a6-4ee6-9efa-c955b445627e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1494 microversion: 2.1 time: 1.179631 Aug 29 05:01:27.073591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1368/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:25 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1494 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:27.078428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:27.083491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:27.084428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:27.097604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:27.098284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:27.098885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:27.099893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:27.100628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:27.101092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:27.193264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:27.263433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:27.269365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:27.269876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:27.270296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:27.775016 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-edb3232f-3b72-4fce-9d53-6b8e6a9e7171 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.700353 Aug 29 05:01:27.775620 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1369/2687] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 29 05:01:27 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:27.780513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:27.781122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] [instance: 11cfe2c4-11f6-4b11-a3f6-3531a60966a2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:27.797811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:27.798298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:27.798752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:27.799986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:27.799986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:27.800357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:27.814574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] HTTP exception thrown: Instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 could not be found. Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Request method failure captured: Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 HTTP/1.1 Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEe01ER4DEQhZISVT3OSXeeIr3Cu7raM1YMG2L7FaMS7NJWOMsw_aYKj8b37gYVfcCNc4ppCHH4ELkX_eeOfYD8hrdqYxzSCKweSaSdY_zarzv50svlAn2jQq92OQZfLrpETsEdqDmsw9RBpQQX6HGAwzrUHZd3q5z7aZ-8Aw89zwaI Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: d0be48f9bd0347e7b2765f09ba0d50b9 Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1177526769 Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0be48f9bd0347e7b2765f09ba0d50b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0be48f9bd0347e7b2765f09ba0d50b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0be48f9bd0347e7b2765f09ba0d50b9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0be48f9bd0347e7b2765f09ba0d50b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1177526769 Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: d0be48f9bd0347e7b2765f09ba0d50b9 Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1177526769 Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-FloatingIPsAssociationTestJSON-1177526769-project Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 5f9b5a46468f4cb79a0ec52a86f4482d Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1177526769-project Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 could not be found. Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '11cfe2c4-11f6-4b11-a3f6-3531a60966a2'} Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 could not be found. Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 could not be found. Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:27.816210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 could not be found. Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] Returning 404 to user: Instance 11cfe2c4-11f6-4b11-a3f6-3531a60966a2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1e40a56a-bf6c-45d4-aa32-e0a0c5a953a0 tempest-FloatingIPsAssociationTestJSON-1177526769 tempest-FloatingIPsAssociationTestJSON-1177526769-project] 10.222.0.20 "GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2" status: 404 len: 111 microversion: 2.1 time: 0.040850 Aug 29 05:01:27.822848 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1370/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:27 2022] GET /compute/v2.1/servers/11cfe2c4-11f6-4b11-a3f6-3531a60966a2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:27.823957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:27.824258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:27.831672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:27.831672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:27.832038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:27.832691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:27.833140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:27.833614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:27.953842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:27.963968 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2991575f-c923-44a0-97a2-5767407b84f8 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1273 microversion: 2.1 time: 0.144817 Aug 29 05:01:27.965199 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1371/2689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:27 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:27.970040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e123d6d0-6e32-4cf2-8a35-e4fc55d30328 req-51039107-da0e-49f8-b639-0678718b80a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65e5f2d-e369-4e32-a10f-d3c261c15e87", "name": "network-vif-deleted", "tag": "1754cce9-2a4f-42a1-8b8a-f6943372486b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:27.981208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e123d6d0-6e32-4cf2-8a35-e4fc55d30328 req-51039107-da0e-49f8-b639-0678718b80a7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:27.982012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e123d6d0-6e32-4cf2-8a35-e4fc55d30328 req-51039107-da0e-49f8-b639-0678718b80a7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:27.982653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e123d6d0-6e32-4cf2-8a35-e4fc55d30328 req-51039107-da0e-49f8-b639-0678718b80a7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:27.996686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.compute.server_external_events [req-e123d6d0-6e32-4cf2-8a35-e4fc55d30328 req-51039107-da0e-49f8-b639-0678718b80a7 service nova] Unable to find a host for instance b65e5f2d-e369-4e32-a10f-d3c261c15e87. Dropping event network-vif-deleted {{(pid=128872) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 05:01:27.997942 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e123d6d0-6e32-4cf2-8a35-e4fc55d30328 req-51039107-da0e-49f8-b639-0678718b80a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031599 Aug 29 05:01:27.999110 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1372/2690] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 05:01:28.004385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:28.004987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:28.011805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:28.012470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:28.012900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:28.013583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:28.014024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:28.014437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:28.055860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:01:28.056394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:01:28.056820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:01:28.057215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:01:28.057618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:01:28.067031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:28.067514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:28.067944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:28.068702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:28.069153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:28.069657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:28.087235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:01:28.093166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for user 4d3aaab47eb243c6bf9a0b2e512e7c4a and project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:01:28.106489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:01:28.108821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:01:28.157922 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ddba7c7d-f1c3-4173-b73e-5dee0e8ad4ce tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.311400 Aug 29 05:01:28.158594 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1319/2691] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:01:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:01:28.163328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:28.168853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:28.169970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1021436628', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:28.177081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:28.177819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:28.178252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:28.179155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:28.179603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:28.180025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:28.272466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:28.368791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:28.381770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:28.383081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:28.383781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:28.861842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:28.896806 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9ab10e6-31af-4b01-a58b-5943cfb27bcd tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1468 microversion: 2.1 time: 0.896319 Aug 29 05:01:28.900458 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1373/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:27 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1468 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:28.915610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:28.917960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:28.956967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:28.961373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:28.962241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:28.964054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:28.965890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:28.967867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.191170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:29.200595 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43a33f87-9b46-437c-9869-d3957770e21e tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1293 microversion: 2.1 time: 0.296971 Aug 29 05:01:29.207753 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1374/2693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:28 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1293 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:29.220947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:29.221860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:29.231947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.232478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.232919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.233723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.234119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.234485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.239232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:29.310817 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d6dd3a0e-03d2-4d62-9d2c-da3f1e11f3fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1021436628" status: 200 len: 1515 microversion: 2.1 time: 1.150821 Aug 29 05:01:29.316200 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1320/2694] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:01:28 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1021436628 => generated 1515 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:29.317450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:29.317973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:29.331824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.332577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.333219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.334262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.336063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.336740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.368805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:29.388614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lazy-loading 'flavor' on Instance uuid a5dc7d86-1634-4dc0-94aa-8deb57e7d232 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:01:29.398863 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43c8aa94-e430-49d4-b718-16ca09e2aa55 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1267 microversion: 2.1 time: 0.189763 Aug 29 05:01:29.403867 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1375/2695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:29 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:29.432062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:29.432657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:29.441825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.442324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.442856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.443638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.444238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.450326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.503775 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1011170e-2541-46ac-9ece-75984ee2ccac tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232/action" status: 202 len: 0 microversion: 2.1 time: 0.190702 Aug 29 05:01:29.508919 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1321/2696] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:01:29 2022] POST /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:01:29.517624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:29.526481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:29.527418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:29.535384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.536392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.537286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.538418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.539167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.540009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.657573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:29.739645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:29.751893 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-974807f9-3e19-4583-828d-a6c7c4f32809 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1315 microversion: 2.1 time: 0.327765 Aug 29 05:01:29.768952 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1376/2697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:29 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:29.774066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:29.774622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:29.798035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.799477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.800684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:29.801937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:29.802407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:29.802833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.059308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:30.067362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.067585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.067918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.204028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:30.213521 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9546121f-bf3a-4989-905f-795ea5a23321 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1476 microversion: 2.1 time: 0.443191 Aug 29 05:01:30.214848 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1377/2698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:29 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1476 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:30.220322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-cf9dbde0-64be-49a6-baf3-68f4990ecd15 req-5bdaba83-5c55-4321-8416-ccd37a0a2c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f05ad94c-e821-4e1b-8a8d-82363cd3659c", "name": "network-vif-deleted", "tag": "fb36119d-18a9-40d3-8ef7-07a524215b7c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:30.227606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:30.248344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cf9dbde0-64be-49a6-baf3-68f4990ecd15 req-5bdaba83-5c55-4321-8416-ccd37a0a2c8e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.249440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cf9dbde0-64be-49a6-baf3-68f4990ecd15 req-5bdaba83-5c55-4321-8416-ccd37a0a2c8e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.249878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cf9dbde0-64be-49a6-baf3-68f4990ecd15 req-5bdaba83-5c55-4321-8416-ccd37a0a2c8e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.267024 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-cf9dbde0-64be-49a6-baf3-68f4990ecd15 req-5bdaba83-5c55-4321-8416-ccd37a0a2c8e service nova] Creating event network-vif-deleted:fb36119d-18a9-40d3-8ef7-07a524215b7c for instance f05ad94c-e821-4e1b-8a8d-82363cd3659c on n-h1-854119-9 Aug 29 05:01:30.272818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-cf9dbde0-64be-49a6-baf3-68f4990ecd15 req-5bdaba83-5c55-4321-8416-ccd37a0a2c8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056043 Aug 29 05:01:30.273888 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1378/2699] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:30.279073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:30.279933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:30.288075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.288837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.289336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.290186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.290770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.291193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.332010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.332838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.332953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.333377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lazy-loading 'fault' on Instance uuid f05ad94c-e821-4e1b-8a8d-82363cd3659c {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:01:30.457749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da246be637924c248fa3746468546f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88260cc20924f92a617cc231ad24f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:30.474549 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2b4a4bc0-cfcc-4896-9030-fa82f68d3336 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 200 len: 1298 microversion: 2.1 time: 0.199413 Aug 29 05:01:30.475443 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1379/2700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:30 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 1298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:30.475694 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2ed0060-fe12-4e3f-849d-ff0815585b4b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.965066 Aug 29 05:01:30.477313 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1322/2701] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Aug 29 05:01:29 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:30.479985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:30.480626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:30.492517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.493010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.493444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.494214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.494969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.495095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.507807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:30.513151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:30.514895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.compute.servers [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Removing options 'limit' from query {{(pid=128871) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 05:01:30.519349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:30.526055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.531275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.533758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.536993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.537666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.538137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.575003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:30.581955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.582706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.583303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.609561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:30.619155 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-849336d5-1e17-4dff-8759-7798bfcb2fec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1275 microversion: 2.1 time: 0.142609 Aug 29 05:01:30.622759 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1380/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:30 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:30.774387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:30.775089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:30.792259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.792706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.793173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:30.793862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:30.794303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:30.794752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.130866 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1328a78-249a-42f6-b31d-e22d8a245bd0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.627286 Aug 29 05:01:31.133097 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1323/2703] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Aug 29 05:01:30 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:31.156257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:31.161359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:31.162908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:31.170311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.171138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.171772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.172697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.173217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.173648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.283751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:31.354711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:31.370066 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71335627-23e5-4320-89ea-7957ae532d19 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1315 microversion: 2.1 time: 0.599890 Aug 29 05:01:31.372013 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1381/2704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:30 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:31.376873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:31.382505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:31.385146 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-afa3dd4b-3058-421b-900f-106b5b1e89d8 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.219901 Aug 29 05:01:31.388172 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1324/2705] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 05:01:31 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:31.398619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.399458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:31.399760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.400511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.401487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.402146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.402772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.404617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:31.405065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.compute.servers [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Removing options 'limit' from query {{(pid=128871) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 05:01:31.405909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:31.411289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.411979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.412610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.413616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.414405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.414984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.459846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:31.513712 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6fc26d68-bd8c-4812-b594-662b1b981e77 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.117346 Aug 29 05:01:31.520025 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1325/2706] 10.222.0.20 () {58 vars in 1150 bytes} [Mon Aug 29 05:01:31 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:31.535898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:31.537217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: f05ad94c-e821-4e1b-8a8d-82363cd3659c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:31.544348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:31.546224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.546911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.547714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.549376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.550093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.550813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.580853 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Instance f05ad94c-e821-4e1b-8a8d-82363cd3659c could not be found. Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c HTTP/1.1 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance f05ad94c-e821-4e1b-8a8d-82363cd3659c could not be found. Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'f05ad94c-e821-4e1b-8a8d-82363cd3659c'} Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f05ad94c-e821-4e1b-8a8d-82363cd3659c could not be found. Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f05ad94c-e821-4e1b-8a8d-82363cd3659c could not be found. Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.582843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:31.587908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:31.587908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:31.587908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:31.587908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:31.587908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f05ad94c-e821-4e1b-8a8d-82363cd3659c could not be found. Aug 29 05:01:31.587908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.590598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Instance f05ad94c-e821-4e1b-8a8d-82363cd3659c could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:31.591682 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b621b7c8-f0dd-4612-9f75-8ebd6dab650c tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c" status: 404 len: 111 microversion: 2.1 time: 0.069907 Aug 29 05:01:31.597877 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1326/2707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:31 2022] GET /compute/v2.1/servers/f05ad94c-e821-4e1b-8a8d-82363cd3659c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:31.604577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:31.611288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:31.612244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:31.618555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.621213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.621900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.622922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.623393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.623826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.663810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:31.680211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=79,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=16,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:31.719184 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-364204d3-149a-4173-806b-bd98b05fce5e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.119350 Aug 29 05:01:31.720297 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1327/2708] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:01:31 2022] GET /compute/v2.1/servers => generated 1011 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:31.727810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bc31be3-76d2-4991-a6c9-36f0b4fd5cf3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8bc6af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:31.755306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5bc31be3-76d2-4991-a6c9-36f0b4fd5cf3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Image not found. Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bc31be3-76d2-4991-a6c9-36f0b4fd5cf3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 HTTP/1.1 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187'} Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 to delete Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 could not be found. Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.757289 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bc31be3-76d2-4991-a6c9-36f0b4fd5cf3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bc31be3-76d2-4991-a6c9-36f0b4fd5cf3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187" status: 404 len: 62 microversion: 2.1 time: 0.037233 Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1328/2709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:31 2022] DELETE /compute/v2.1/images/e5b63ecb-3aa1-4c2e-8b3b-e6ee4ad3e187 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:01:31.765409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:31.768449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:31.772856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.773357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.773957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.774672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.775129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.775558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.855766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:31.864065 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c79de1ff-0e6b-4c86-a242-2c01104f3ccc tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1459 microversion: 2.1 time: 0.490797 Aug 29 05:01:31.877352 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1382/2710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:31 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1459 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:31.882324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:31.888063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:31.888886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:31.926394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.927760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.928440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.929600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:31.931913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:31.932571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:31.986128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:31.992872 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5fcf270f-6501-40c8-ba21-36230a60d6bd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1273 microversion: 2.1 time: 0.231687 Aug 29 05:01:31.994002 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1329/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:31 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:32.006432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:32.006982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:32.014029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.014664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.015112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.016013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.016501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.017022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.033865 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d HTTP/1.1 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ec43b062-7f3a-4331-8a9b-af76fe09a90d'} Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:32.035749 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:32.039429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f553763d-a4ae-44c8-b8cb-3af87d8c7e01 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 404 len: 111 microversion: 2.1 time: 0.041902 Aug 29 05:01:32.040866 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1330/2712] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:31 2022] DELETE /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:32.049201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ca04cae1-758c-43d2-a360-d1f99b133ee2 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:32.049833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ca04cae1-758c-43d2-a360-d1f99b133ee2 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:32.056304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca04cae1-758c-43d2-a360-d1f99b133ee2 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.056803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca04cae1-758c-43d2-a360-d1f99b133ee2 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.057246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca04cae1-758c-43d2-a360-d1f99b133ee2 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.057961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca04cae1-758c-43d2-a360-d1f99b133ee2 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.058411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca04cae1-758c-43d2-a360-d1f99b133ee2 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.058839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca04cae1-758c-43d2-a360-d1f99b133ee2 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.060806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:32.131501 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bfc30294-86bc-4808-bc0f-2942559a86fd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.252808 Aug 29 05:01:32.134474 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1383/2713] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 05:01:31 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:32.140295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:32.140978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: ec43b062-7f3a-4331-8a9b-af76fe09a90d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:32.154558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.156020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.156020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.156395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.158178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.158730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.187822 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d HTTP/1.1 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'ec43b062-7f3a-4331-8a9b-af76fe09a90d'} Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.193398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.198172 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:32.198172 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:32.198172 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:32.198172 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:32.198172 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. Aug 29 05:01:32.198172 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.198172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Instance ec43b062-7f3a-4331-8a9b-af76fe09a90d could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:32.198172 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8c6a522c-d3f4-46bf-ac14-d5b35ebdd4c3 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d" status: 404 len: 111 microversion: 2.1 time: 0.063927 Aug 29 05:01:32.208408 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1384/2714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:32 2022] GET /compute/v2.1/servers/ec43b062-7f3a-4331-8a9b-af76fe09a90d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:32.214108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:32.221059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:32.221759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.compute.servers [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Removing options 'limit' from query {{(pid=128872) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 05:01:32.222634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:32.229566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.230904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.231547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.232493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.234385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.234385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.276612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-521f3e63-9949-4a1c-a9c2-36eba2fd3a3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.067322 Aug 29 05:01:32.277493 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1385/2715] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 29 05:01:32 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:32.282795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90dce63c-149a-4530-ae9e-46c805157683 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8817b80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:32.313187 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-90dce63c-149a-4530-ae9e-46c805157683 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Image not found. Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90dce63c-149a-4530-ae9e-46c805157683 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee HTTP/1.1 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '4290a972-24a1-4a42-bbea-af4055a6e3ee'} Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4290a972-24a1-4a42-bbea-af4055a6e3ee to delete Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4290a972-24a1-4a42-bbea-af4055a6e3ee could not be found. Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.314501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90dce63c-149a-4530-ae9e-46c805157683 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:32.318903 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-90dce63c-149a-4530-ae9e-46c805157683 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee" status: 404 len: 62 microversion: 2.1 time: 0.036970 Aug 29 05:01:32.323661 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1386/2716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:32 2022] DELETE /compute/v2.1/images/4290a972-24a1-4a42-bbea-af4055a6e3ee => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:01:32.325020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:32.330585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:32.331259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1021436628', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:32.338179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.338663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.339094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.339806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.340301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.340720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.451210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:32.510903 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b727573-2e74-4afb-823b-e4982c4109ac tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1021436628" status: 200 len: 346 microversion: 2.1 time: 0.189486 Aug 29 05:01:32.511496 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1387/2717] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 05:01:32 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1021436628 => generated 346 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:32.516219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:32.516902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:32.523087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.523574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.524004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.524744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.525200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.525679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.539754 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf HTTP/1.1 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'de63423e-f87b-485b-b071-9f20dcdf4eaf'} Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:32.541354 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:32.545849 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:32.547235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:32.548160 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-445b14f9-e7d7-498b-a801-a6c7c298d606 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 404 len: 111 microversion: 2.1 time: 0.035480 Aug 29 05:01:32.548997 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1388/2718] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:32 2022] DELETE /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:32.554031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c1f26fe3-2ebf-48a8-a6d7-009dfcfbe7af req-9634ce81-8988-4395-9918-03b14afede43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "787ae235-66d8-42b2-8e32-779d88d6af00", "tag": "61689bd4-c361-4f95-9b8d-62755812544e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:32.563745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c1f26fe3-2ebf-48a8-a6d7-009dfcfbe7af req-9634ce81-8988-4395-9918-03b14afede43 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.564549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c1f26fe3-2ebf-48a8-a6d7-009dfcfbe7af req-9634ce81-8988-4395-9918-03b14afede43 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.565182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c1f26fe3-2ebf-48a8-a6d7-009dfcfbe7af req-9634ce81-8988-4395-9918-03b14afede43 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.578276 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c1f26fe3-2ebf-48a8-a6d7-009dfcfbe7af req-9634ce81-8988-4395-9918-03b14afede43 service nova] Creating event network-changed:61689bd4-c361-4f95-9b8d-62755812544e for instance 787ae235-66d8-42b2-8e32-779d88d6af00 on n-h1-854119-9 Aug 29 05:01:32.583891 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c1f26fe3-2ebf-48a8-a6d7-009dfcfbe7af req-9634ce81-8988-4395-9918-03b14afede43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033070 Aug 29 05:01:32.585134 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1389/2719] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:32.591339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:32.592036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:32.598609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.599122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.599553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.600283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:32.600776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:32.601195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:32.996481 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ca04cae1-758c-43d2-a360-d1f99b133ee2 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1610 microversion: 2.1 time: 0.953752 Aug 29 05:01:33.013753 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1331/2720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:32 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1610 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:33.017589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7ba5ca97-411e-429e-8bf8-3df446441ac1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:33.023543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:33.032094 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-68d989ac-5faf-480c-bd30-b533adf6c320 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1315 microversion: 2.1 time: 0.445522 Aug 29 05:01:33.033222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ba5ca97-411e-429e-8bf8-3df446441ac1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.033760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ba5ca97-411e-429e-8bf8-3df446441ac1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.035196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ba5ca97-411e-429e-8bf8-3df446441ac1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.036647 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1390/2721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:32 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:33.047917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:33.048971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: de63423e-f87b-485b-b071-9f20dcdf4eaf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:33.056692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.057401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.058024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.058963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.059566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.060170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.076252 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf HTTP/1.1 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'de63423e-f87b-485b-b071-9f20dcdf4eaf'} Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.080009 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.083816 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:33.083816 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:33.083816 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:33.083816 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:33.083816 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. Aug 29 05:01:33.083816 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.086260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Instance de63423e-f87b-485b-b071-9f20dcdf4eaf could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:33.087366 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ebb57210-241c-4136-bf5f-5e95146b4a49 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf" status: 404 len: 111 microversion: 2.1 time: 0.049479 Aug 29 05:01:33.088445 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1391/2722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:33 2022] GET /compute/v2.1/servers/de63423e-f87b-485b-b071-9f20dcdf4eaf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:33.093194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:33.094097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:33.103523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.104437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.105239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.107454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.108306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.116792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.123662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7ba5ca97-411e-429e-8bf8-3df446441ac1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Going to try to stop instance {{(pid=128871) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 05:01:33.176369 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7ba5ca97-411e-429e-8bf8-3df446441ac1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "POST /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664/action" status: 202 len: 0 microversion: 2.1 time: 0.175142 Aug 29 05:01:33.177536 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1332/2723] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:01:32 2022] POST /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:01:33.196488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0db1b47-ce57-478a-9c1c-87de3c3448bb tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:33.201074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0db1b47-ce57-478a-9c1c-87de3c3448bb tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.201776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0db1b47-ce57-478a-9c1c-87de3c3448bb tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.202694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0db1b47-ce57-478a-9c1c-87de3c3448bb tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.207104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0db1b47-ce57-478a-9c1c-87de3c3448bb tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.208336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0db1b47-ce57-478a-9c1c-87de3c3448bb tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.220498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0db1b47-ce57-478a-9c1c-87de3c3448bb tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.262592 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c0db1b47-ce57-478a-9c1c-87de3c3448bb tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083325 Aug 29 05:01:33.263492 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1333/2724] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Aug 29 05:01:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:33.269104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60722887-cfde-418d-8aa8-dad68d856474 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '.version_select at 0x7f1ab8ba5790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:33.300480 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-60722887-cfde-418d-8aa8-dad68d856474 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Image not found. Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60722887-cfde-418d-8aa8-dad68d856474 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b HTTP/1.1 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '4b407c5e-a3cd-4803-9528-d06cae30916b'} Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4b407c5e-a3cd-4803-9528-d06cae30916b to delete Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b407c5e-a3cd-4803-9528-d06cae30916b could not be found. Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.303244 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:01:33.307699 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.310428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60722887-cfde-418d-8aa8-dad68d856474 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:33.311471 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60722887-cfde-418d-8aa8-dad68d856474 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b" status: 404 len: 62 microversion: 2.1 time: 0.046484 Aug 29 05:01:33.312222 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1334/2725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:33 2022] DELETE /compute/v2.1/images/4b407c5e-a3cd-4803-9528-d06cae30916b => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:01:33.317838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:33.318926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:33.327592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.328221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.328877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.330122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.330594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.331026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.826852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:33.836469 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a699c5d-4dd9-43e5-9371-78b50bc38221 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1315 microversion: 2.1 time: 0.746702 Aug 29 05:01:33.837360 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1392/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:33 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:33.854636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-9", "block_migration": true, "disk_over_commit": false}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:33.857641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:33.870484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.870990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:33.871588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.872016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.872753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.873356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.873930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.888520 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87111156-ceb6-41c9-9a8d-ddf3651691c1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1522 microversion: 2.1 time: 0.574341 Aug 29 05:01:33.889248 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1335/2727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:33 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:33.902469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:33.904777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:33.911918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.912794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.913729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.915661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.916443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.920417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.930804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Lazy-loading 'flavor' on Instance uuid a5dc7d86-1634-4dc0-94aa-8deb57e7d232 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:01:33.942778 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 HTTP/1.1 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '0edb1989-4869-4968-ba61-d2fd91304761'} Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:33.944718 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:33.949021 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.950248 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 while it is in vm_state suspended Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Request method failure captured: Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232/action HTTP/1.1 Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 97 Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEfloePCtYqCMqVb23DkPZSt2nrj56tp1JBzK3nIju8VzudwsAm9GmZLGc4PQbCvmIkn8MVXMybaSq6v9MX2mmxepPpHEi0l2JhOGVyuXiscRVi6pCEyUAr9cPScpjD0ekDGW8MIu_V4oAsDjUtEC3ffq5W2nRS5DMnsCxwFHPcOdGI Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: c152a7fa03c1478084fbe162285100dc Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-LiveMigrationNegativeTest-1217376683 Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c152a7fa03c1478084fbe162285100dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c152a7fa03c1478084fbe162285100dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c152a7fa03c1478084fbe162285100dc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c152a7fa03c1478084fbe162285100dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-LiveMigrationNegativeTest-1217376683 Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: c152a7fa03c1478084fbe162285100dc Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1217376683 Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-LiveMigrationNegativeTest-1217376683-project-admin Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: c5d2e68db3504a88b8066b6808cc0a8a Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-LiveMigrationNegativeTest-1217376683-project-admin Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: {"os-migrateLive": {"host": "n-h2-854119-9", "block_migration": true, "disk_over_commit": false}} Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot 'os-migrateLive' instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 while it is in vm_state suspended Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a5dc7d86-1634-4dc0-94aa-8deb57e7d232', 'body': {'os-migrateLive': {'host': 'n-h2-854119-9', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.950740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 while it is in vm_state suspended Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 while it is in vm_state suspended Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 while it is in vm_state suspended {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:33.955363 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d0b5e3b-7de7-4c9c-9900-66fd22a3a1c0 tempest-LiveMigrationNegativeTest-1217376683 tempest-LiveMigrationNegativeTest-1217376683-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232/action" status: 409 len: 155 microversion: 2.1 time: 0.114758 Aug 29 05:01:33.959648 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1393/2728] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:01:33 2022] POST /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232/action => generated 155 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:01:33.962853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:33.963943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44222e04-0690-443d-9b4b-430dcba18b53 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 404 len: 111 microversion: 2.1 time: 0.073336 Aug 29 05:01:33.964706 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1336/2729] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:33 2022] DELETE /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:33.970295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:33.971246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:33.974135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:33.975126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] [instance: 0edb1989-4869-4968-ba61-d2fd91304761] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:33.979468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.981967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.982737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.984357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.985123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.985725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.987994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.989224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.995019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:33.995813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:33.996329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:33.996771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:34.015591 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] HTTP exception thrown: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Request method failure captured: Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 HTTP/1.1 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEcUlcikjgMQKLTilaO5Da7QL0YA3f44HhUUuFAENAzwbke5MLCt6KHWv80amKHxEGPdDGwUbmYZCFQiONkjJ0pfFyNqJrs7EyHEIjPHJKX05KJllPcV2ckF0oVSksAFcsygyjEf2FLYHfLRT88lVimBG-vALt9xzoIk504j-Lh3IQk Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e88260cc20924f92a617cc231ad24f77", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e88260cc20924f92a617cc231ad24f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesTestJSON-646779937 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e88260cc20924f92a617cc231ad24f77 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesTestJSON-646779937 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da246be637924c248fa3746468546f00 Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesTestJSON-646779937-project Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '0edb1989-4869-4968-ba61-d2fd91304761'} Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:34.017221 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:34.023481 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:34.023481 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:34.023481 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:34.023481 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:34.023481 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. Aug 29 05:01:34.023481 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:01:34.023481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] Returning 404 to user: Instance 0edb1989-4869-4968-ba61-d2fd91304761 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:34.023481 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-793fe4f4-49c8-4449-ab89-26a2b4509ec6 tempest-ImagesTestJSON-646779937 tempest-ImagesTestJSON-646779937-project] 10.222.0.20 "GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761" status: 404 len: 111 microversion: 2.1 time: 0.049803 Aug 29 05:01:34.023947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:01:34.024028 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1337/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:33 2022] GET /compute/v2.1/servers/0edb1989-4869-4968-ba61-d2fd91304761 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:01:34.056779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:34.057684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:34.063914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:34.064654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:34.065311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:34.066233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:34.066920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:34.067631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:34.072577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:34.138173 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2dce7393-b334-4ce4-84ee-adf59bd85fbe tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 204 len: 0 microversion: 2.1 time: 0.176601 Aug 29 05:01:34.139833 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1394/2731] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:33 2022] DELETE /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:01:34.150312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:34.151260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:34.158484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:34.159237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:34.159672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:34.160695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:34.161151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:34.161577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:34.443532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:34.452650 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1054e519-18cd-4aca-829e-af58d642443a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1315 microversion: 2.1 time: 0.399496 Aug 29 05:01:34.453383 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1338/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:34 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:34.468221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:34.477733 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a304ea1f-b109-4a82-b078-518063d56e43 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1465 microversion: 2.1 time: 0.333480 Aug 29 05:01:34.478307 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1395/2733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:34 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1465 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:34.858390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:34.859304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:34.866524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:34.867293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:34.867912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:34.869216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:34.870057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:34.870591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:34.913783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:34.913783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:34.917289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:34.917784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:34.918220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:34.918922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:34.919375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:34.919799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:35.197424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:35.206393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de0c184d-2698-4349-a0b1-2594bfc5e3e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1315 microversion: 2.1 time: 0.351741 Aug 29 05:01:35.206861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1339/2734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:34 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:35.220893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:35.229627 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6ad00d4c-688c-468c-956a-8d19bc3c21ae tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1522 microversion: 2.1 time: 0.323847 Aug 29 05:01:35.231132 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1396/2735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:34 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:35.482484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:35.484037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:35.503133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:35.503749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:35.514011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:35.514514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:35.514952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:35.519323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:35.519847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:35.520678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:35.523029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:35.524081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:35.525438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:35.527379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:35.527751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:35.528411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:36.000172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:36.015585 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7060bff2-0535-4e02-ac7a-ab5cc4219214 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1465 microversion: 2.1 time: 0.514672 Aug 29 05:01:36.019487 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1397/2736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:35 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1465 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:36.073881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:36.085970 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4133cca5-c44d-4792-a1b4-3db4c380e44d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1315 microversion: 2.1 time: 0.614548 Aug 29 05:01:36.087295 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1340/2737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:35 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:36.229836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:36.230359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:36.252359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:36.256314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:36.261207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:36.261914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:36.263208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:36.264096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:36.270076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:36.270749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:36.275823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:36.277352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:36.277795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:36.278526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:36.286226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:36.286909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:37.213234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:37.244616 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ca3d7391-011d-43b1-a52f-bf0fe97c03e2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1522 microversion: 2.1 time: 0.994375 Aug 29 05:01:37.246625 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1341/2738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:36 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1522 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:37.260781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:37.264309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:37.266597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:37.281174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:37.290173 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f4a8509c-3da5-45cc-b57b-1923e2b0a075 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1315 microversion: 2.1 time: 1.064040 Aug 29 05:01:37.295855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:37.296658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:37.297805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:37.298600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:37.300674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:37.304979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:37.306350 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1398/2739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:36 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1315 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:37.313956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:37.317141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:37.327657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:37.328577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:37.329252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:37.330255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:37.330917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:37.331570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:38.623775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:38.635078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3cb30673-0ea8-4c34-bf9b-a7af578890e0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1315 microversion: 2.1 time: 1.327325 Aug 29 05:01:38.649311 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1399/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:37 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1315 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:38.656559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:38.657344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:38.665686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:38.676916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:38.677384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:38.678107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:38.678787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:38.679401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:38.833434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:38.844681 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-962faca1-270e-48c4-8e63-6e92a3e33f05 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1465 microversion: 2.1 time: 1.595729 Aug 29 05:01:38.847879 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1342/2741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:37 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1465 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:38.853925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:38.854942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:38.874154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:38.874643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:38.875509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:38.876479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:38.878724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:38.879145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:39.713298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:39.725903 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39a7aef6-baa9-472d-8961-787a15bd785f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1522 microversion: 2.1 time: 1.072000 Aug 29 05:01:39.727266 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1400/2742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:38 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1522 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:39.746578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0971e1f7-36cc-4aed-b6a3-41abb78da613 req-2262ef47-5e3d-4ee6-a060-7c6f3dd7dfca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787ae235-66d8-42b2-8e32-779d88d6af00", "name": "network-vif-plugged", "status": "completed", "tag": "61689bd4-c361-4f95-9b8d-62755812544e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:39.771919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0971e1f7-36cc-4aed-b6a3-41abb78da613 req-2262ef47-5e3d-4ee6-a060-7c6f3dd7dfca service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:39.772537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0971e1f7-36cc-4aed-b6a3-41abb78da613 req-2262ef47-5e3d-4ee6-a060-7c6f3dd7dfca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:39.773216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0971e1f7-36cc-4aed-b6a3-41abb78da613 req-2262ef47-5e3d-4ee6-a060-7c6f3dd7dfca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:39.796672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0971e1f7-36cc-4aed-b6a3-41abb78da613 req-2262ef47-5e3d-4ee6-a060-7c6f3dd7dfca service nova] Creating event network-vif-plugged:61689bd4-c361-4f95-9b8d-62755812544e for instance 787ae235-66d8-42b2-8e32-779d88d6af00 on n-h1-854119-9 Aug 29 05:01:39.808834 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0971e1f7-36cc-4aed-b6a3-41abb78da613 req-2262ef47-5e3d-4ee6-a060-7c6f3dd7dfca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079591 Aug 29 05:01:39.812560 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1401/2743] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:39.834634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:39.836171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:39.843428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:39.845029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:39.845831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:39.846833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:39.847540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:39.848229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:39.874564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:39.892957 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f5fa3ac0-6826-4471-a76b-c5207ea4a93c tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1315 microversion: 2.1 time: 1.041126 Aug 29 05:01:39.903945 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1343/2744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:38 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1315 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:39.917457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:39.924608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:39.948801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:39.949402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:39.951296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:39.954750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:39.955471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:39.955913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:40.573994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:40.721690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:40.727691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:40.756763 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d442cf5-972d-45b4-9d30-6c0c65ff0607 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1465 microversion: 2.1 time: 0.847482 Aug 29 05:01:40.757027 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa06bce7-9d39-4366-a9a5-b8a098cddb62 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1315 microversion: 2.1 time: 0.940184 Aug 29 05:01:40.759190 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1402/2745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:39 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:40.759518 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1344/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:39 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1465 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:40.786144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:40.788358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:40.806861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:40.809135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:40.817259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:40.824259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-83a3e77f-4917-477c-857b-261b3bff06fe req-610df8a2-9cba-4fe7-bab2-4a616a62e6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c25788-08f4-4d5a-8f8d-372ed53b2fcb", "tag": "8232d335-b93d-4b44-8231-9ab9b6adfb00"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:40.825840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:40.828867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:40.832706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:40.842474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-83a3e77f-4917-477c-857b-261b3bff06fe req-610df8a2-9cba-4fe7-bab2-4a616a62e6a9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:40.842977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-83a3e77f-4917-477c-857b-261b3bff06fe req-610df8a2-9cba-4fe7-bab2-4a616a62e6a9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:40.848022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-83a3e77f-4917-477c-857b-261b3bff06fe req-610df8a2-9cba-4fe7-bab2-4a616a62e6a9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:40.877805 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-83a3e77f-4917-477c-857b-261b3bff06fe req-610df8a2-9cba-4fe7-bab2-4a616a62e6a9 service nova] Creating event network-changed:8232d335-b93d-4b44-8231-9ab9b6adfb00 for instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb on n-h1-854119-9 Aug 29 05:01:40.890088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-83a3e77f-4917-477c-857b-261b3bff06fe req-610df8a2-9cba-4fe7-bab2-4a616a62e6a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069504 Aug 29 05:01:40.891048 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1345/2747] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:01:40.919416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:40.920178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:40.927441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:40.928272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:40.928999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:40.929731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:40.930182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:40.930772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:42.048438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:42.059796 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea579aab-d986-428e-b6e6-f26beb06a503 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1522 microversion: 2.1 time: 1.298616 Aug 29 05:01:42.060811 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1403/2748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:40 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1522 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:42.067741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:42.068622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:42.076375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:42.077619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:42.078240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:42.079475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:42.080148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:42.080796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:42.266901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:42.280602 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f7cac495-9ef5-4830-b04a-97c899fa56b8 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 200 len: 1423 microversion: 2.1 time: 0.218464 Aug 29 05:01:42.282322 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1404/2749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:42 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 1423 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:42.283808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:42.292182 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5682441c-4cae-4fbb-b893-ad1767c2d6ac tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1315 microversion: 2.1 time: 1.378485 Aug 29 05:01:42.294597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:42.295262 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1346/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:40 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1315 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:01:42.295628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:42.321795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:42.322298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:42.322912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:42.323492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:42.326750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:42.327777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:42.382592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:42.656899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9f893e8e-befd-4164-932b-a07424fb5309 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Action: 'create', calling method: .version_select at 0x7f1ab8ba5ca0>, body: {"pool": null} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:42.835219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:42.884415 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8fab7f01-7fbb-488c-bca9-88e919ae8788 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1504 microversion: 2.1 time: 0.597226 Aug 29 05:01:42.885823 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1405/2751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:42 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1504 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:42.916267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1572181236"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:42.917482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:42.936701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:42.940154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:42.942138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:42.944688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:42.945552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:42.946205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:43.247518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=16 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:43.407672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.network.security_group_api [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Adding security group d3fb9c4e-2c74-44bc-a53c-08b0794094c8 to port 61689bd4-c361-4f95-9b8d-62755812544e Aug 29 05:01:44.731921 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76fbe5ff-6615-4666-aab2-aac91186a100 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00/action" status: 202 len: 0 microversion: 2.1 time: 1.825984 Aug 29 05:01:44.733837 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1406/2752] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:01:42 2022] POST /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00/action => generated 0 bytes in 1829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:01:44.740590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0d0563b6-424f-407c-b65d-dcf419842f08 req-e807625d-4bb9-4ad6-ae69-951201588402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dc7d86-1634-4dc0-94aa-8deb57e7d232", "name": "network-vif-deleted", "tag": "f5a191bd-ccac-4d87-a97f-82a77c3543b5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:44.753374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0d0563b6-424f-407c-b65d-dcf419842f08 req-e807625d-4bb9-4ad6-ae69-951201588402 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:44.756517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0d0563b6-424f-407c-b65d-dcf419842f08 req-e807625d-4bb9-4ad6-ae69-951201588402 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:44.757167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0d0563b6-424f-407c-b65d-dcf419842f08 req-e807625d-4bb9-4ad6-ae69-951201588402 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:44.776274 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0d0563b6-424f-407c-b65d-dcf419842f08 req-e807625d-4bb9-4ad6-ae69-951201588402 service nova] Creating event network-vif-deleted:f5a191bd-ccac-4d87-a97f-82a77c3543b5 for instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 on n-h1-854119-9 Aug 29 05:01:44.788890 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0d0563b6-424f-407c-b65d-dcf419842f08 req-e807625d-4bb9-4ad6-ae69-951201588402 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052215 Aug 29 05:01:44.790150 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1407/2753] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:44.807441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:44.808171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:44.820815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:44.821318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:44.822291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:44.823025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:44.823648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:44.824136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.105622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:45.113774 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e41cc575-db23-4c38-96b8-3921b7c8af54 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1499 microversion: 2.1 time: 0.318408 Aug 29 05:01:45.114333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1408/2754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:44 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1499 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:45.119096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:45.119721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: a5dc7d86-1634-4dc0-94aa-8deb57e7d232] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:45.126144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.126882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.128109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.129123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.129754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.130346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.146086 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] HTTP exception thrown: Instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 could not be found. Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Request method failure captured: Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 HTTP/1.1 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEfkwvxGUtriTxvg0UhFxS8cv3ObADxo9MWgvwcLhKjF71XqCuQ_oZS1cL0WuXiDcY90jKwEyV6c2RsZLaa0sLG-MeqwywMRWFT0lDpyHk9ZRiipSY0Oup_e43S2dS0eyVvfoPrhpG3DPPFmnSaE_zQ_duLH7QbL-4VI3Dfurs_xtc8 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3cd6136711c248539c04a2b2dd8fae78 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-LiveMigrationNegativeTest-609130438 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3cd6136711c248539c04a2b2dd8fae78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3cd6136711c248539c04a2b2dd8fae78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3cd6136711c248539c04a2b2dd8fae78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3cd6136711c248539c04a2b2dd8fae78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-LiveMigrationNegativeTest-609130438 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3cd6136711c248539c04a2b2dd8fae78 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-609130438 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-LiveMigrationNegativeTest-609130438-project Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 7368462223bb4007b69efb0c864eb010 Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-LiveMigrationNegativeTest-609130438-project Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 could not be found. Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a5dc7d86-1634-4dc0-94aa-8deb57e7d232'} Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 could not be found. Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 could not be found. Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:45.147814 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.151754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:45.151754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:45.151754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:45.151754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:45.151754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:45.151754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 could not be found. Aug 29 05:01:45.151754 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.151754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Returning 404 to user: Instance a5dc7d86-1634-4dc0-94aa-8deb57e7d232 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:45.151754 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2a853eb6-da7a-4ee6-b6ea-4ceae71b0ced tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232" status: 404 len: 111 microversion: 2.1 time: 0.033756 Aug 29 05:01:45.152433 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1409/2755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:45 2022] GET /compute/v2.1/servers/a5dc7d86-1634-4dc0-94aa-8deb57e7d232 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:45.157720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:45.158876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:45.165658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.166426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.166851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.167635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.168038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.168683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.402884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:45.413030 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f4f3836-020d-4797-9f0b-908a8e7b54b2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1315 microversion: 2.1 time: 0.259035 Aug 29 05:01:45.414675 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1410/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:45 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:45.558108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e08f7ffd-dfac-4599-9f13-f8cc61a937d2 tempest-ListImageFiltersNegativeTestJSON-1533573783 tempest-ListImageFiltersNegativeTestJSON-1533573783-project] Calling method '.version_select at 0x7f1ab86c41f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:45.585290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-e08f7ffd-dfac-4599-9f13-f8cc61a937d2 tempest-ListImageFiltersNegativeTestJSON-1533573783 tempest-ListImageFiltersNegativeTestJSON-1533573783-project] HTTP exception thrown: Image not found. Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e08f7ffd-dfac-4599-9f13-f8cc61a937d2 tempest-ListImageFiltersNegativeTestJSON-1533573783 tempest-ListImageFiltersNegativeTestJSON-1533573783-project] Request method failure captured: Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/images/2c9bd04c-f575-43cb-a88b-5a345981f649 HTTP/1.1 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEg3PVV8ESzF84-Z5kqWtzfKe00yeK3LFph0OBEqMwARlJLIOS0o7FX4jEq7WUwklfF5qH_uyYzh01mPCtJ0s5PyeNt0Y40d6EspHrdIIly0qkAn3KdQRes89XJ10A7zZ35413TeDP3WE3WEJ0apuTkSlccL2K7-8C51CSKOD4rQbtY Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 03e8130d1aa349df88e62c80133bc330 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1533573783 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03e8130d1aa349df88e62c80133bc330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/03e8130d1aa349df88e62c80133bc330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_03e8130d1aa349df88e62c80133bc330", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03e8130d1aa349df88e62c80133bc330"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1533573783 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 03e8130d1aa349df88e62c80133bc330 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1533573783 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ListImageFiltersNegativeTestJSON-1533573783-project Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 6cf998718d8148c2a7a27a3815e8a332 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1533573783-project Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '2c9bd04c-f575-43cb-a88b-5a345981f649'} Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2c9bd04c-f575-43cb-a88b-5a345981f649 Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 05:01:45.587384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2c9bd04c-f575-43cb-a88b-5a345981f649 could not be found. Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e08f7ffd-dfac-4599-9f13-f8cc61a937d2 tempest-ListImageFiltersNegativeTestJSON-1533573783 tempest-ListImageFiltersNegativeTestJSON-1533573783-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e08f7ffd-dfac-4599-9f13-f8cc61a937d2 tempest-ListImageFiltersNegativeTestJSON-1533573783 tempest-ListImageFiltersNegativeTestJSON-1533573783-project] 10.222.0.20 "GET /compute/v2.1/images/2c9bd04c-f575-43cb-a88b-5a345981f649" status: 404 len: 62 microversion: 2.1 time: 0.172437 Aug 29 05:01:45.591166 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1411/2757] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:01:45 2022] GET /compute/v2.1/images/2c9bd04c-f575-43cb-a88b-5a345981f649 => generated 62 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:01:45.602609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1796309295"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:45.603156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:45.613417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.613839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.614644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.615370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.615822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.616334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.636277 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9f893e8e-befd-4164-932b-a07424fb5309 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.338977 Aug 29 05:01:45.637015 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1347/2758] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 05:01:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:45.648280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:45.653571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:45.654387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:45.663119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.663600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.664037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.664797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.665252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.665705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.690665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:45.718780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:45.721022 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6dfba896-4e18-410b-a1b8-62b31fc48556 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.082755 Aug 29 05:01:45.724414 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1348/2759] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Aug 29 05:01:45 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:45.728852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:45.732222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:45.743331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.743823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.744391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.745156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:45.745615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:45.746036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:45.774811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:01:45.821743 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.network.security_group_api [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Adding security group 9264cb56-54ce-43fd-a958-040b3c7aea25 to port 61689bd4-c361-4f95-9b8d-62755812544e Aug 29 05:01:45.890042 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-24432dca-b82e-4cc5-a13d-a2d3d3985136 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 204 len: 0 microversion: 2.1 time: 0.166929 Aug 29 05:01:45.894235 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1349/2760] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:01:45 2022] DELETE /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:01:45.901840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e12b86fc-6c71-447e-9dfe-01ee3e328103 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Action: 'create', calling method: .version_select at 0x7f1ab96603a0>, body: {"pool": null} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:46.495870 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5992868a-19d6-4bd8-8ddd-c106d0ea9fbc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00/action" status: 202 len: 0 microversion: 2.1 time: 0.905480 Aug 29 05:01:46.497200 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1412/2761] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:01:45 2022] POST /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00/action => generated 0 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:01:46.503604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3606ded4-295b-4e06-9cd6-9bf6999d9b97 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:46.514597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3606ded4-295b-4e06-9cd6-9bf6999d9b97 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:46.518074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3606ded4-295b-4e06-9cd6-9bf6999d9b97 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:46.518686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3606ded4-295b-4e06-9cd6-9bf6999d9b97 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:46.594927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3606ded4-295b-4e06-9cd6-9bf6999d9b97 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Going to try to start instance {{(pid=128872) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 05:01:46.635998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:46.668053 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3606ded4-295b-4e06-9cd6-9bf6999d9b97 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "POST /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664/action" status: 202 len: 0 microversion: 2.1 time: 0.169244 Aug 29 05:01:46.669151 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1413/2762] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:01:46 2022] POST /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:01:46.678293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:46.680376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:46.693118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:46.693663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:46.694152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:46.695594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:46.696097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:46.696545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:46.969224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:46.979322 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d91ffac-bfa6-441f-99b1-f8b908078eff tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1474 microversion: 2.1 time: 0.308023 Aug 29 05:01:46.983446 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1414/2763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:46 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1474 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:46.988817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:46.996958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:47.027183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:47.034707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:47.035441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:47.036549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:47.037090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:47.053878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:47.624802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:47.634089 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-751b945f-6901-4e65-88e7-b664c18682c6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1315 microversion: 2.1 time: 0.648956 Aug 29 05:01:47.635220 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1415/2764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:46 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:47.642814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21afbbdb-f562-4917-b745-0302fb66483d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:47.643326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-21afbbdb-f562-4917-b745-0302fb66483d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:47.650730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21afbbdb-f562-4917-b745-0302fb66483d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:47.651580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21afbbdb-f562-4917-b745-0302fb66483d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:47.652207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21afbbdb-f562-4917-b745-0302fb66483d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:47.653045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21afbbdb-f562-4917-b745-0302fb66483d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:47.653635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21afbbdb-f562-4917-b745-0302fb66483d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:47.654196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21afbbdb-f562-4917-b745-0302fb66483d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:48.632418 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21afbbdb-f562-4917-b745-0302fb66483d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.995565 Aug 29 05:01:48.633455 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1416/2765] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Aug 29 05:01:47 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00/os-security-groups => generated 1158 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:48.639205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:48.640036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:48.648056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:48.649242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:48.650702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:48.651506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:48.651945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:48.652458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:49.274811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:49.287085 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-60da814b-2e85-42d8-828f-55ffe826131c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1508 microversion: 2.1 time: 0.651328 Aug 29 05:01:49.288258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1417/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:48 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1508 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:49.296529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-dea5d7e8-0e9e-4c04-8d04-6afdf5f62e04 req-d16dbf29-ca5a-49ea-9cce-052f112a1852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "787ae235-66d8-42b2-8e32-779d88d6af00", "tag": "61689bd4-c361-4f95-9b8d-62755812544e"}, {"name": "network-changed", "server_uuid": "787ae235-66d8-42b2-8e32-779d88d6af00", "tag": "61689bd4-c361-4f95-9b8d-62755812544e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:49.314418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dea5d7e8-0e9e-4c04-8d04-6afdf5f62e04 req-d16dbf29-ca5a-49ea-9cce-052f112a1852 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:49.314974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dea5d7e8-0e9e-4c04-8d04-6afdf5f62e04 req-d16dbf29-ca5a-49ea-9cce-052f112a1852 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:49.315703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dea5d7e8-0e9e-4c04-8d04-6afdf5f62e04 req-d16dbf29-ca5a-49ea-9cce-052f112a1852 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:49.333460 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-dea5d7e8-0e9e-4c04-8d04-6afdf5f62e04 req-d16dbf29-ca5a-49ea-9cce-052f112a1852 service nova] Creating event network-changed:61689bd4-c361-4f95-9b8d-62755812544e for instance 787ae235-66d8-42b2-8e32-779d88d6af00 on n-h1-854119-9 Aug 29 05:01:49.334138 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-dea5d7e8-0e9e-4c04-8d04-6afdf5f62e04 req-d16dbf29-ca5a-49ea-9cce-052f112a1852 service nova] Creating event network-changed:61689bd4-c361-4f95-9b8d-62755812544e for instance 787ae235-66d8-42b2-8e32-779d88d6af00 on n-h1-854119-9 Aug 29 05:01:49.339550 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-dea5d7e8-0e9e-4c04-8d04-6afdf5f62e04 req-d16dbf29-ca5a-49ea-9cce-052f112a1852 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049856 Aug 29 05:01:49.340754 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1418/2767] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:49.346544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:49.347315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:49.354628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:49.355120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:49.355546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:49.356285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:49.356788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:49.357215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:49.969203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7368462223bb4007b69efb0c864eb010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd6136711c248539c04a2b2dd8fae78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:49.980196 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-344e8bca-65d7-4b0d-b60d-888c443544d5 tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 200 len: 1474 microversion: 2.1 time: 0.636269 Aug 29 05:01:49.981215 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1419/2768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:49 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 1474 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:49.986207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40887c15-632b-40ac-8737-ea7bc82c2334 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: .version_select at 0x7f1ab95b8160>, body: {"security_group": {"name": " tempest-securitygroup -1266096374 ", "description": "tempest-description-1047680315"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:50.111879 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e12b86fc-6c71-447e-9dfe-01ee3e328103 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.215702 Aug 29 05:01:50.112547 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1350/2769] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 05:01:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:50.119020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:50.120580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:50.127236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:50.127816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:50.128281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:50.128997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:50.129513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:50.129943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:50.538176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:50.546847 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8cf4da02-e5e3-4d34-855b-67f0c0555272 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1315 microversion: 2.1 time: 0.432210 Aug 29 05:01:50.547439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1351/2770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:50 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:50.558333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-83babc2b-19d0-4fe4-92f6-1134795693e0 req-7aa55a95-c600-4d1f-9fe9-28bb9ca83479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c25788-08f4-4d5a-8f8d-372ed53b2fcb", "name": "network-vif-plugged", "status": "completed", "tag": "8232d335-b93d-4b44-8231-9ab9b6adfb00"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:50.580890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-83babc2b-19d0-4fe4-92f6-1134795693e0 req-7aa55a95-c600-4d1f-9fe9-28bb9ca83479 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:50.581433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-83babc2b-19d0-4fe4-92f6-1134795693e0 req-7aa55a95-c600-4d1f-9fe9-28bb9ca83479 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:50.581892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-83babc2b-19d0-4fe4-92f6-1134795693e0 req-7aa55a95-c600-4d1f-9fe9-28bb9ca83479 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:50.612655 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-83babc2b-19d0-4fe4-92f6-1134795693e0 req-7aa55a95-c600-4d1f-9fe9-28bb9ca83479 service nova] Creating event network-vif-plugged:8232d335-b93d-4b44-8231-9ab9b6adfb00 for instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb on n-h1-854119-9 Aug 29 05:01:50.619228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-83babc2b-19d0-4fe4-92f6-1134795693e0 req-7aa55a95-c600-4d1f-9fe9-28bb9ca83479 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064258 Aug 29 05:01:50.620895 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1352/2771] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:50.629532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d28b9346-d189-452d-bed9-c004244b4273 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Action: 'create', calling method: .version_select at 0x7f1ab8ba5280>, body: {"pool": null} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:50.829768 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40887c15-632b-40ac-8737-ea7bc82c2334 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.847259 Aug 29 05:01:50.830990 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1420/2772] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:01:49 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:50.844543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:50.846176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:50.853822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:50.854609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:50.855498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:50.856586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:50.857218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:50.857834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:51.548998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:51.557239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-afff7129-df63-4cdf-a317-32f277eaf548 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1512 microversion: 2.1 time: 0.723511 Aug 29 05:01:51.557826 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1421/2773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:50 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1512 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:51.563602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-805a37d7-05f7-41aa-b862-eced78b3960c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab86aeee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:51.739803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-805a37d7-05f7-41aa-b862-eced78b3960c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d" status: 200 len: 224 microversion: 2.1 time: 0.180350 Aug 29 05:01:51.741795 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1422/2774] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:01:51 2022] GET /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d => generated 224 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:51.748354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:51.749227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] [instance: 8a228325-cc63-438f-ba35-f09c9535d6b7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:51.758499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:51.759277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:51.760389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:51.764316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:51.766506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:51.768409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:51.813460 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] HTTP exception thrown: Instance 8a228325-cc63-438f-ba35-f09c9535d6b7 could not be found. Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Request method failure captured: Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 HTTP/1.1 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEfkwvxGUtriTxvg0UhFxS8cv3ObADxo9MWgvwcLhKjF71XqCuQ_oZS1cL0WuXiDcY90jKwEyV6c2RsZLaa0sLG-MeqwywMRWFT0lDpyHk9ZRiipSY0Oup_e43S2dS0eyVvfoPrhpG3DPPFmnSaE_zQ_duLH7QbL-4VI3Dfurs_xtc8 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3cd6136711c248539c04a2b2dd8fae78 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-LiveMigrationNegativeTest-609130438 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3cd6136711c248539c04a2b2dd8fae78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3cd6136711c248539c04a2b2dd8fae78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3cd6136711c248539c04a2b2dd8fae78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3cd6136711c248539c04a2b2dd8fae78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-LiveMigrationNegativeTest-609130438 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3cd6136711c248539c04a2b2dd8fae78 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-609130438 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-LiveMigrationNegativeTest-609130438-project Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 7368462223bb4007b69efb0c864eb010 Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-LiveMigrationNegativeTest-609130438-project Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 8a228325-cc63-438f-ba35-f09c9535d6b7 could not be found. Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8a228325-cc63-438f-ba35-f09c9535d6b7'} Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a228325-cc63-438f-ba35-f09c9535d6b7 could not be found. Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a228325-cc63-438f-ba35-f09c9535d6b7 could not be found. Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:51.816988 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a228325-cc63-438f-ba35-f09c9535d6b7 could not be found. Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] Returning 404 to user: Instance 8a228325-cc63-438f-ba35-f09c9535d6b7 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f361c5fc-be74-4b30-8830-4eed98d5875b tempest-LiveMigrationNegativeTest-609130438 tempest-LiveMigrationNegativeTest-609130438-project] 10.222.0.20 "GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7" status: 404 len: 111 microversion: 2.1 time: 0.075898 Aug 29 05:01:51.822608 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1423/2775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:51 2022] GET /compute/v2.1/servers/8a228325-cc63-438f-ba35-f09c9535d6b7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:51.826947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fe13d0bb-7155-492e-b924-d93efcc179af req-34d06ea8-bac7-4408-b77b-6f12cc533daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a228325-cc63-438f-ba35-f09c9535d6b7", "name": "network-vif-deleted", "tag": "4007050e-d1a7-4e14-ae3d-783a4d2f7878"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:51.838994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fe13d0bb-7155-492e-b924-d93efcc179af req-34d06ea8-bac7-4408-b77b-6f12cc533daa service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:51.839476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fe13d0bb-7155-492e-b924-d93efcc179af req-34d06ea8-bac7-4408-b77b-6f12cc533daa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:51.839900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fe13d0bb-7155-492e-b924-d93efcc179af req-34d06ea8-bac7-4408-b77b-6f12cc533daa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:51.851775 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fe13d0bb-7155-492e-b924-d93efcc179af req-34d06ea8-bac7-4408-b77b-6f12cc533daa service nova] Creating event network-vif-deleted:4007050e-d1a7-4e14-ae3d-783a4d2f7878 for instance 8a228325-cc63-438f-ba35-f09c9535d6b7 on n-h1-854119-9 Aug 29 05:01:51.857268 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fe13d0bb-7155-492e-b924-d93efcc179af req-34d06ea8-bac7-4408-b77b-6f12cc533daa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036726 Aug 29 05:01:51.858254 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1424/2776] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:51.863597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:51.864237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:51.870660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:51.871150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:51.871594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:51.872319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:51.872764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:51.873183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:52.416720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:52.430550 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7c31cdf5-ed1b-480e-b560-64ef480498eb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1315 microversion: 2.1 time: 0.570877 Aug 29 05:01:52.443796 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1425/2777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:51 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:52.443796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:52.443796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:52.443796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.compute.servers [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Removing options 'limit' from query {{(pid=128872) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 05:01:52.444612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:52.452960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:52.453746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:52.454335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:52.456025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:52.456726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:52.457845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:52.462505 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ded93405-50b2-4263-a2cb-8273c08e5b3c tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.029516 Aug 29 05:01:52.465075 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1426/2778] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 29 05:01:52 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:01:52.471160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a957d2b-8a16-488a-b7e3-9c65fe5a3d94 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab865e160>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:53.969518 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a957d2b-8a16-488a-b7e3-9c65fe5a3d94 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d" status: 202 len: 0 microversion: 2.1 time: 1.502728 Aug 29 05:01:53.970631 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1427/2779] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:01:52 2022] DELETE /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d => generated 0 bytes in 1505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:01:53.979440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:53.980354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:54.000546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:54.001990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:54.002772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:54.005262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:54.005912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:54.007330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:54.537430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:54.545931 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-46b33597-f908-4828-b43d-fa840bdcae4f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1512 microversion: 2.1 time: 0.572932 Aug 29 05:01:54.560730 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1428/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:53 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1512 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:54.566249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:54.566862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:54.569398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:54.574404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:54.574956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:54.575548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:54.576430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:54.577351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:54.579676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:55.061619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:55.070444 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-32faa0ce-cd1f-4a82-9227-2698d1848a82 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1502 microversion: 2.1 time: 0.508553 Aug 29 05:01:55.071032 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1429/2781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:54 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1502 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:55.075444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90b835cb-2621-4547-9c93-901cb6661c94 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab86b7a60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:55.198563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-90b835cb-2621-4547-9c93-901cb6661c94 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:01:55.199221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-90b835cb-2621-4547-9c93-901cb6661c94 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group 4374748f-a9f7-48fd-a328-ed051136fc3d not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:01:55.199758 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-90b835cb-2621-4547-9c93-901cb6661c94 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:01:55.199758 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-2bebde08-1cdd-418f-8216-b496448b56ab'] Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90b835cb-2621-4547-9c93-901cb6661c94 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d HTTP/1.1 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-2bebde08-1cdd-418f-8216-b496448b56ab'] Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '4374748f-a9f7-48fd-a328-ed051136fc3d'} Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:01:55.202841 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bebde08-1cdd-418f-8216-b496448b56ab'] Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bebde08-1cdd-418f-8216-b496448b56ab'] Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bebde08-1cdd-418f-8216-b496448b56ab'] Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bebde08-1cdd-418f-8216-b496448b56ab'] Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90b835cb-2621-4547-9c93-901cb6661c94 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-2bebde08-1cdd-418f-8216-b496448b56ab'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-90b835cb-2621-4547-9c93-901cb6661c94 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d" status: 404 len: 194 microversion: 2.1 time: 0.132291 Aug 29 05:01:55.206517 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1430/2782] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:01:55 2022] GET /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:01:55.211686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:55.211686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:55.217738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:55.218320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:55.218753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:55.219487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:55.219943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:55.220404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:55.616476 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d28b9346-d189-452d-bed9-c004244b4273 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.994074 Aug 29 05:01:55.617130 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1353/2783] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 05:01:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:55.628371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:55.638612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-020b32a6-81ed-4cad-86f6-f336e75ce80f tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c" status: 200 len: 1512 microversion: 2.1 time: 0.432813 Aug 29 05:01:55.650725 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1431/2784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:55 2022] GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c => generated 1512 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:55.650725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce6d57a8-5d1b-4f6c-8496-7b6e7385d0e6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:55.650725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce6d57a8-5d1b-4f6c-8496-7b6e7385d0e6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:55.651344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce6d57a8-5d1b-4f6c-8496-7b6e7385d0e6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:55.651961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce6d57a8-5d1b-4f6c-8496-7b6e7385d0e6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:55.671112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:01:55.677736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ce6d57a8-5d1b-4f6c-8496-7b6e7385d0e6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Going to try to stop instance {{(pid=128872) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 05:01:55.728139 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ce6d57a8-5d1b-4f6c-8496-7b6e7385d0e6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb/action" status: 202 len: 0 microversion: 2.1 time: 0.086675 Aug 29 05:01:55.729821 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1432/2785] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:01:55 2022] POST /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:01:55.742908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-697df28c-85e0-442f-a24f-fea9ac12547d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: .version_select at 0x7f1ab88820d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-298090114", "description": "tempest-description-1599902709"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:55.761183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-171744240", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:55.816607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:01:56.479771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:01:56.480345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:01:56.480887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:01:56.481652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:01:56.482139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:01:56.492615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:56.493358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:56.493998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:56.495211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:56.495704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:56.496154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:56.518019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Getting quotas for project 67e5947cf46d4fa19bda40742bdd5958. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:01:56.522792 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-697df28c-85e0-442f-a24f-fea9ac12547d tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.791162 Aug 29 05:01:56.523907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Getting quotas for user 388e910c6ed646d08b62526b2bcfb0d2 and project 67e5947cf46d4fa19bda40742bdd5958. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:01:56.536741 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1433/2786] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:01:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:56.539670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:01:56.542721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:01:56.558559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5ca314e-8c7c-4a0b-bd15-0611d4f3996f tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Action: 'create', calling method: .version_select at 0x7f1ab86b7e50>, body: {"pool": null} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:56.600642 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f17844f7-ded9-47e0-b7f6-6d2e1d507946 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982372 Aug 29 05:01:56.601594 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1354/2787] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:01:56.607128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:56.607927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:56.614985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:56.615700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:56.616397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:56.617248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:56.618293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:56.618993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:56.884153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:56.891228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cae02e08-a28d-4dbd-b50b-636d317adc26 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1510 microversion: 2.1 time: 0.288333 Aug 29 05:01:56.901957 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1355/2788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:56 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:56.918745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:56.920042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:56.930193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:56.930721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:56.931155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:56.931893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:56.932379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:56.933056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:57.298258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:57.311066 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22462311-0396-4436-b2c6-5f03ec02b4e8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.407749 Aug 29 05:01:57.313427 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1356/2789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:56 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:57.323794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b3392e68-1861-4237-92fc-90b85c699842 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: .version_select at 0x7f1ab97a25e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-843689168", "description": "tempest-description-992533770"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:57.641512 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b3392e68-1861-4237-92fc-90b85c699842 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.326603 Aug 29 05:01:57.650905 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1357/2790] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:01:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:57.657255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:57.660278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:57.678806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:57.679445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:57.679889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:57.682636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:57.684593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:57.685205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:57.843399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:57.851650 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6366b39-48a6-4f25-99ea-014b5f3b3f99 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1274 microversion: 2.1 time: 0.199162 Aug 29 05:01:57.852871 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1358/2791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:57 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:57.897189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:57.904960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:57.906042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:01:58.068657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:58.069920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:58.070539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:58.071547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:58.072335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:58.072909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:58.290016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:01:58.400019 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15bbe344-eb77-4f41-a643-69577b0204c2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.545605 Aug 29 05:01:58.402044 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1359/2792] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Aug 29 05:01:57 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:58.406964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4cf5775c-5dbc-4766-8a09-78cf47bdbf4e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: .version_select at 0x7f1ab8ba51f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1500677486", "description": "tempest-description-378725868"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:01:58.788323 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5ca314e-8c7c-4a0b-bd15-0611d4f3996f tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.248820 Aug 29 05:01:58.789141 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1434/2793] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 05:01:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:58.796426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:58.797417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:58.818607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:58.820702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:58.821499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:58.822447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:58.823189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:58.823792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:58.934393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4cf5775c-5dbc-4766-8a09-78cf47bdbf4e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.531080 Aug 29 05:01:58.935308 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1360/2794] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:01:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:58.940235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:58.941077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:58.954268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:58.959848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:58.960503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:58.961643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:58.962251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:58.962842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:59.226552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:59.236214 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ed5e41a-f101-4b0b-a3bc-b79d4bf9eb90 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.445550 Aug 29 05:01:59.236817 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1435/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:58 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:59.253251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71e23d32-5bec-487c-a76e-1b9c9330d76e tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Calling method '.version_select at 0x7f1aba3908b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:59.405778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:59.415806 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c194a7c6-21f5-4ecb-a348-721180d41fe6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1512 microversion: 2.1 time: 0.479278 Aug 29 05:01:59.416695 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1361/2796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:58 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:59.432698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:59.433801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:59.453376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:59.454571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:59.464681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:59.465607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:59.466116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:59.466606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:59.607182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:01:59.631197 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-227cae4b-5af9-4426-8ed9-73e549284268 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1280 microversion: 2.1 time: 0.209912 Aug 29 05:01:59.632889 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1362/2797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:59 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:01:59.638016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15bbfa0a-6dd2-4a85-bbaf-b0906a52ecd7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab9625670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:59.767356 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71e23d32-5bec-487c-a76e-1b9c9330d76e tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/5103c77f-3a48-40bd-8171-fcd0d9119f50" status: 200 len: 141 microversion: 2.1 time: 0.525624 Aug 29 05:01:59.768213 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1436/2798] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 05:01:59 2022] GET /compute/v2.1/os-floating-ips/5103c77f-3a48-40bd-8171-fcd0d9119f50 => generated 141 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:01:59.775452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:01:59.776810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:01:59.789789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:59.790346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:59.792570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:01:59.793304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:01:59.796069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:01:59.800427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:00.378412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:00.392645 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-90367b2b-235c-406f-b2ff-e6762ec3e209 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c" status: 200 len: 1512 microversion: 2.1 time: 0.623179 Aug 29 05:02:00.393849 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1437/2799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:01:59 2022] GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c => generated 1512 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:00.398780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e4fdd131-052c-40f9-9cfd-40e586f5c0d3 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Calling method '.version_select at 0x7f1ab86c45e0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:00.939720 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15bbfa0a-6dd2-4a85-bbaf-b0906a52ecd7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.305402 Aug 29 05:02:00.940354 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1363/2800] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 05:01:59 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:00.954773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:00.955429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:00.964285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:00.964704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:00.965148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:00.965845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:00.966466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:00.967280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:01.332367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:01.344694 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ac2c1dc-4404-48cf-bf96-f26a1aead43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.394261 Aug 29 05:02:01.345318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1364/2801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:00 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:01.351017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:01.351775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:01.365949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:01.366451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:01.366888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:01.368907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:01.370238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:01.371855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:01.813626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:01.827840 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cca5c4ab-1261-4d10-8ef4-10f7451b8ed6 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1510 microversion: 2.1 time: 0.480213 Aug 29 05:02:01.840359 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1365/2802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:01 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1510 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:02.107431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2fd0f551-6129-4c75-b5e1-fe107911234b tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Calling method '.version_select at 0x7f1ab979e790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:02.197732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-2fd0f551-6129-4c75-b5e1-fe107911234b tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4bc84b34-8ee8-453c-bef4-d02446756f14 does not exist", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:02:02.198430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.security_group_api [None req-2fd0f551-6129-4c75-b5e1-fe107911234b tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Neutron security group 4bc84b34-8ee8-453c-bef4-d02446756f14 not found {{(pid=128871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:02:02.199153 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-2fd0f551-6129-4c75-b5e1-fe107911234b tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] HTTP exception thrown: Security group 4bc84b34-8ee8-453c-bef4-d02446756f14 does not exist Aug 29 05:02:02.199153 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-02579afc-8610-4dd7-98be-7998b22c8185'] Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2fd0f551-6129-4c75-b5e1-fe107911234b tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Request method failure captured: Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/os-security-groups/4bc84b34-8ee8-453c-bef4-d02446756f14 HTTP/1.1 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEhIIMHTvMoCoWzu7AvQiMP162VFuhgbKbr6OFPeMsuWm9Ag5HytA4P19paLkRfJmwAZnrkZTDsMeaE3uzsUp9ojt69nOrcscWa_PC8SToTOcedA1P4W7xnecAhkDGx15QyCj3k9_jfBUTxGABzSZhkF09mxx7ZgHpxwczg_ImNgrOI Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: b9b01316282f4638a09da82c99971450 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9b01316282f4638a09da82c99971450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b9b01316282f4638a09da82c99971450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b9b01316282f4638a09da82c99971450", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9b01316282f4638a09da82c99971450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: b9b01316282f4638a09da82c99971450 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupsNegativeTestJSON-1471029102-project Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 1c822ccebe1d437d8b4318e02973731c Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102-project Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: exception: Security group 4bc84b34-8ee8-453c-bef4-d02446756f14 does not exist Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-02579afc-8610-4dd7-98be-7998b22c8185'] Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '4bc84b34-8ee8-453c-bef4-d02446756f14'} Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:02:02.201441 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4bc84b34-8ee8-453c-bef4-d02446756f14 does not exist Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02579afc-8610-4dd7-98be-7998b22c8185'] Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4bc84b34-8ee8-453c-bef4-d02446756f14 does not exist Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02579afc-8610-4dd7-98be-7998b22c8185'] Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4bc84b34-8ee8-453c-bef4-d02446756f14 does not exist Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02579afc-8610-4dd7-98be-7998b22c8185'] Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4bc84b34-8ee8-453c-bef4-d02446756f14 does not exist Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02579afc-8610-4dd7-98be-7998b22c8185'] Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2fd0f551-6129-4c75-b5e1-fe107911234b tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Returning 404 to user: Security group 4bc84b34-8ee8-453c-bef4-d02446756f14 does not exist Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-02579afc-8610-4dd7-98be-7998b22c8185'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2fd0f551-6129-4c75-b5e1-fe107911234b tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4bc84b34-8ee8-453c-bef4-d02446756f14" status: 404 len: 194 microversion: 2.1 time: 0.361249 Aug 29 05:02:02.205451 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1366/2803] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:02:01 2022] DELETE /compute/v2.1/os-security-groups/4bc84b34-8ee8-453c-bef4-d02446756f14 => generated 194 bytes in 363 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:02:02.213049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:02.213671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:02.215604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:02.224002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:02.224002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:02.224490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:02.225616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:02.226240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:02.226837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:02.513214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:02.517043 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e4fdd131-052c-40f9-9cfd-40e586f5c0d3 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/5103c77f-3a48-40bd-8171-fcd0d9119f50" status: 202 len: 0 microversion: 2.1 time: 2.121980 Aug 29 05:02:02.517862 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1438/2804] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:02:00 2022] DELETE /compute/v2.1/os-floating-ips/5103c77f-3a48-40bd-8171-fcd0d9119f50 => generated 0 bytes in 2123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:02:02.522778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-903c810b-e0ed-4be3-8f95-69108b2a988a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab86595e0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:02.528181 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0c58039a-2a21-4cb4-8319-c03525220e96 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1322 microversion: 2.1 time: 0.322976 Aug 29 05:02:02.541573 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1367/2805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:02 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:02.541573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:02.541573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:02.541573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:02.548236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:02.548850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:02.549390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:02.550271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:02.559428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:02.561423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:02.604469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:02.697272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:02.707124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:02.707511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:02.707947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:03.062348 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-04308a45-85f9-4746-819f-604da7258b37 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.531979 Aug 29 05:02:03.063008 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1368/2806] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 05:02:02 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:03.090253 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af4719e2-212b-41d5-b21b-02d6b1e2a536 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011149 Aug 29 05:02:03.090790 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1369/2807] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Aug 29 05:02:03 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 05:02:03.097429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:03.103068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:03.125081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:03.125624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:03.126106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:03.126825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:03.127275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:03.127690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:03.213969 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-903c810b-e0ed-4be3-8f95-69108b2a988a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c13a8363-315e-43c1-8515-f0e1d8e71968" status: 202 len: 0 microversion: 2.1 time: 0.695031 Aug 29 05:02:03.214794 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1439/2808] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:02:02 2022] DELETE /compute/v2.1/os-security-groups/c13a8363-315e-43c1-8515-f0e1d8e71968 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:02:03.219355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6ba823df-876a-4ef4-a12e-c5d47922ff32 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Calling method '.version_select at 0x7f1ab8695a60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:03.590858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:03.598242 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6ba823df-876a-4ef4-a12e-c5d47922ff32 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.381231 Aug 29 05:02:03.600525 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1440/2809] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Aug 29 05:02:03 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:02:03.612093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-10688d22-f0bf-4170-92f6-e44b101206f7 req-6e74bd75-092f-4995-929d-45a965ae8360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6c6b26-39fd-42ca-9194-7d610a4ed595", "tag": "d739b9be-708a-4a75-9b82-e4b51cb10770"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:03.623456 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0808cbff-b04e-4d8f-b97c-16cd176643f0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.531152 Aug 29 05:02:03.625988 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1370/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:03 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:03.635042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:03.637709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-10688d22-f0bf-4170-92f6-e44b101206f7 req-6e74bd75-092f-4995-929d-45a965ae8360 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:03.641678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-10688d22-f0bf-4170-92f6-e44b101206f7 req-6e74bd75-092f-4995-929d-45a965ae8360 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:03.642220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-10688d22-f0bf-4170-92f6-e44b101206f7 req-6e74bd75-092f-4995-929d-45a965ae8360 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:03.650161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:03.651530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:03.664767 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-10688d22-f0bf-4170-92f6-e44b101206f7 req-6e74bd75-092f-4995-929d-45a965ae8360 service nova] Creating event network-changed:d739b9be-708a-4a75-9b82-e4b51cb10770 for instance 5d6c6b26-39fd-42ca-9194-7d610a4ed595 on n-h1-854119-9 Aug 29 05:02:03.674683 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-10688d22-f0bf-4170-92f6-e44b101206f7 req-6e74bd75-092f-4995-929d-45a965ae8360 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072625 Aug 29 05:02:03.675775 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1441/2811] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:03.681624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b3d95977-900c-4548-a224-3fa00ab87a85 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Calling method '.version_select at 0x7f1ab88821f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:03.750785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:03.751306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:03.751917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:03.753040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:03.753660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:03.754291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:03.835957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:03.840804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:03.932358 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-61a0c228-f6da-4c2a-9f8f-6b5883efa1e0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.304938 Aug 29 05:02:03.932968 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1371/2812] 10.222.0.20 () {58 vars in 1150 bytes} [Mon Aug 29 05:02:03 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:03.938137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e1d6e02-3b09-4da3-b0e2-6ebfadd2f7b4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab9782af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:04.006239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-7e1d6e02-3b09-4da3-b0e2-6ebfadd2f7b4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:02:04.007388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.security_group_api [None req-7e1d6e02-3b09-4da3-b0e2-6ebfadd2f7b4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group c13a8363-315e-43c1-8515-f0e1d8e71968 not found {{(pid=128871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:02:04.009671 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-7e1d6e02-3b09-4da3-b0e2-6ebfadd2f7b4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:02:04.009671 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-18322647-4db4-4af8-ba87-4212b96c26cd'] Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e1d6e02-3b09-4da3-b0e2-6ebfadd2f7b4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-security-groups/c13a8363-315e-43c1-8515-f0e1d8e71968 HTTP/1.1 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: exception: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-18322647-4db4-4af8-ba87-4212b96c26cd'] Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'c13a8363-315e-43c1-8515-f0e1d8e71968'} Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:02:04.012704 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18322647-4db4-4af8-ba87-4212b96c26cd'] Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18322647-4db4-4af8-ba87-4212b96c26cd'] Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18322647-4db4-4af8-ba87-4212b96c26cd'] Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18322647-4db4-4af8-ba87-4212b96c26cd'] Aug 29 05:02:04.016448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.021605 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b3d95977-900c-4548-a224-3fa00ab87a85 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.341111 Aug 29 05:02:04.021690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e1d6e02-3b09-4da3-b0e2-6ebfadd2f7b4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:02:04.021690 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-18322647-4db4-4af8-ba87-4212b96c26cd'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:04.021823 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1442/2813] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 05:02:03 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:04.021896 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e1d6e02-3b09-4da3-b0e2-6ebfadd2f7b4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/c13a8363-315e-43c1-8515-f0e1d8e71968" status: 404 len: 194 microversion: 2.1 time: 0.086008 Aug 29 05:02:04.024842 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1372/2814] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:02:03 2022] GET /compute/v2.1/os-security-groups/c13a8363-315e-43c1-8515-f0e1d8e71968 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:02:04.031318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4547890c-dbff-46cd-8b6a-23e3883fa19f tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Calling method '.version_select at 0x7f1ab95489d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:04.032598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:04.033331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:04.041290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:04.041792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:04.042226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:04.042937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:04.043393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:04.043817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:04.326092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:04.334685 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-657f6a97-8673-498f-b198-f9218379c25d tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1322 microversion: 2.1 time: 0.305738 Aug 29 05:02:04.342810 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1443/2815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:04 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:04.348499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:04.354237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:04.355121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:04.361380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:04.361959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:04.362603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:04.363427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:04.363983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:04.364510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:04.366095 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4547890c-dbff-46cd-8b6a-23e3883fa19f tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.340018 Aug 29 05:02:04.366684 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1373/2816] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 29 05:02:04 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:04.383258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b68d885-4b07-428f-a903-d7d16c769a6e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab9548a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:04.433907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:04.457756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:04.526707 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e59d4ca-5fd1-4606-a2ec-6289a849ba8e tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.181861 Aug 29 05:02:04.527911 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1444/2817] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Aug 29 05:02:04 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:04.536595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d43a9bb0-6a60-47d2-86d1-394287f9c611 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Calling method '.version_select at 0x7f1ab8817af0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:04.670920 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b68d885-4b07-428f-a903-d7d16c769a6e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a0e41b78-a51b-43a2-b2a5-3b4e43041651" status: 202 len: 0 microversion: 2.1 time: 0.302976 Aug 29 05:02:04.671795 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1374/2818] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:02:04 2022] DELETE /compute/v2.1/os-security-groups/a0e41b78-a51b-43a2-b2a5-3b4e43041651 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:02:04.676495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef948fa1-148f-460a-8294-bf484712e393 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Calling method '.version_select at 0x7f1ab97e4160>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:04.851541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-d43a9bb0-6a60-47d2-86d1-394287f9c611 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:02:04.853852 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d43a9bb0-6a60-47d2-86d1-394287f9c611 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 29 05:02:04.853852 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-a4e2942c-9e81-4573-895f-54c2fd097b9c'] Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d43a9bb0-6a60-47d2-86d1-394287f9c611 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Request method failure captured: Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-security-groups/ac911d83-5f99-4c7e-a8d4-14b600128ee7 HTTP/1.1 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEhIIMHTvMoCoWzu7AvQiMP162VFuhgbKbr6OFPeMsuWm9Ag5HytA4P19paLkRfJmwAZnrkZTDsMeaE3uzsUp9ojt69nOrcscWa_PC8SToTOcedA1P4W7xnecAhkDGx15QyCj3k9_jfBUTxGABzSZhkF09mxx7ZgHpxwczg_ImNgrOI Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: b9b01316282f4638a09da82c99971450 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9b01316282f4638a09da82c99971450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b9b01316282f4638a09da82c99971450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b9b01316282f4638a09da82c99971450", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9b01316282f4638a09da82c99971450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: b9b01316282f4638a09da82c99971450 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsNegativeTestJSON-1471029102-project Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1c822ccebe1d437d8b4318e02973731c Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102-project Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: exception: Insufficient rights for removing default security group. Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-a4e2942c-9e81-4573-895f-54c2fd097b9c'] Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'ac911d83-5f99-4c7e-a8d4-14b600128ee7'} Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:02:04.858505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4e2942c-9e81-4573-895f-54c2fd097b9c'] Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4e2942c-9e81-4573-895f-54c2fd097b9c'] Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4e2942c-9e81-4573-895f-54c2fd097b9c'] Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4e2942c-9e81-4573-895f-54c2fd097b9c'] Aug 29 05:02:04.863445 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:04.868895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d43a9bb0-6a60-47d2-86d1-394287f9c611 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 29 05:02:04.868895 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-a4e2942c-9e81-4573-895f-54c2fd097b9c'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:04.870814 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d43a9bb0-6a60-47d2-86d1-394287f9c611 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ac911d83-5f99-4c7e-a8d4-14b600128ee7" status: 400 len: 182 microversion: 2.1 time: 0.341002 Aug 29 05:02:04.871857 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1445/2819] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:02:04 2022] DELETE /compute/v2.1/os-security-groups/ac911d83-5f99-4c7e-a8d4-14b600128ee7 => generated 182 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:02:04.884235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:04.900337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:04.901668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:04.926482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:04.927101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:04.927450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:04.928281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:04.928758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:04.929207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:05.039544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:05.108939 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e4a3a0d7-26a7-4a25-b42f-ab66ab2bf635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.235266 Aug 29 05:02:05.110180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1446/2820] 10.222.0.20 () {58 vars in 1196 bytes} [Mon Aug 29 05:02:04 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:05.116397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:05.117895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:05.125152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:05.125857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:05.126437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:05.127508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:05.128640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:05.129218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:05.697539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:05.718451 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3017d7f9-80ac-4bcb-a132-328ac1e0bbec tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.605820 Aug 29 05:02:05.719752 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1447/2821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:05 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:05.735680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7767f009-6d68-495c-b5ad-114918a46c48 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab8817dc0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:05.787896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-7767f009-6d68-495c-b5ad-114918a46c48 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:02:05.790863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-7767f009-6d68-495c-b5ad-114918a46c48 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:02:05.792301 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-7767f009-6d68-495c-b5ad-114918a46c48 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:02:05.792301 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-412cb819-1b23-4d28-b839-6c0290581a2a'] Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7767f009-6d68-495c-b5ad-114918a46c48 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-security-groups/a0e41b78-a51b-43a2-b2a5-3b4e43041651 HTTP/1.1 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-412cb819-1b23-4d28-b839-6c0290581a2a'] Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a0e41b78-a51b-43a2-b2a5-3b4e43041651'} Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:02:05.795840 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-412cb819-1b23-4d28-b839-6c0290581a2a'] Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-412cb819-1b23-4d28-b839-6c0290581a2a'] Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-412cb819-1b23-4d28-b839-6c0290581a2a'] Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-412cb819-1b23-4d28-b839-6c0290581a2a'] Aug 29 05:02:05.800857 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.806643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7767f009-6d68-495c-b5ad-114918a46c48 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:02:05.806643 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-412cb819-1b23-4d28-b839-6c0290581a2a'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:05.808284 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7767f009-6d68-495c-b5ad-114918a46c48 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/a0e41b78-a51b-43a2-b2a5-3b4e43041651" status: 404 len: 194 microversion: 2.1 time: 0.087247 Aug 29 05:02:05.809646 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1448/2822] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:02:05 2022] GET /compute/v2.1/os-security-groups/a0e41b78-a51b-43a2-b2a5-3b4e43041651 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:02:05.836109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4bafcbb5-1139-48e7-8d61-53ff663b4dd1 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Calling method '.version_select at 0x7f1ab86c7af0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:05.885575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-4bafcbb5-1139-48e7-8d61-53ff663b4dd1 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e51bed33-234d-4d2d-ad56-95ca121bd671 does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:02:05.886194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-4bafcbb5-1139-48e7-8d61-53ff663b4dd1 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Neutron security group e51bed33-234d-4d2d-ad56-95ca121bd671 not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:02:05.887081 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4bafcbb5-1139-48e7-8d61-53ff663b4dd1 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] HTTP exception thrown: Security group e51bed33-234d-4d2d-ad56-95ca121bd671 does not exist Aug 29 05:02:05.887081 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-9a140eca-cfcf-4144-ae14-2acdf3e8cf85'] Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4bafcbb5-1139-48e7-8d61-53ff663b4dd1 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Request method failure captured: Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-security-groups/e51bed33-234d-4d2d-ad56-95ca121bd671 HTTP/1.1 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEhIIMHTvMoCoWzu7AvQiMP162VFuhgbKbr6OFPeMsuWm9Ag5HytA4P19paLkRfJmwAZnrkZTDsMeaE3uzsUp9ojt69nOrcscWa_PC8SToTOcedA1P4W7xnecAhkDGx15QyCj3k9_jfBUTxGABzSZhkF09mxx7ZgHpxwczg_ImNgrOI Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: b9b01316282f4638a09da82c99971450 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9b01316282f4638a09da82c99971450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b9b01316282f4638a09da82c99971450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b9b01316282f4638a09da82c99971450", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9b01316282f4638a09da82c99971450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: b9b01316282f4638a09da82c99971450 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsNegativeTestJSON-1471029102-project Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1c822ccebe1d437d8b4318e02973731c Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102-project Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group e51bed33-234d-4d2d-ad56-95ca121bd671 does not exist Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-9a140eca-cfcf-4144-ae14-2acdf3e8cf85'] Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'e51bed33-234d-4d2d-ad56-95ca121bd671'} Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:02:05.903070 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e51bed33-234d-4d2d-ad56-95ca121bd671 does not exist Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a140eca-cfcf-4144-ae14-2acdf3e8cf85'] Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e51bed33-234d-4d2d-ad56-95ca121bd671 does not exist Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a140eca-cfcf-4144-ae14-2acdf3e8cf85'] Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e51bed33-234d-4d2d-ad56-95ca121bd671 does not exist Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a140eca-cfcf-4144-ae14-2acdf3e8cf85'] Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e51bed33-234d-4d2d-ad56-95ca121bd671 does not exist Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a140eca-cfcf-4144-ae14-2acdf3e8cf85'] Aug 29 05:02:05.907146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:05.912626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4bafcbb5-1139-48e7-8d61-53ff663b4dd1 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Returning 404 to user: Security group e51bed33-234d-4d2d-ad56-95ca121bd671 does not exist Aug 29 05:02:05.912626 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-9a140eca-cfcf-4144-ae14-2acdf3e8cf85'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:05.915606 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4bafcbb5-1139-48e7-8d61-53ff663b4dd1 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/e51bed33-234d-4d2d-ad56-95ca121bd671" status: 404 len: 194 microversion: 2.1 time: 0.102545 Aug 29 05:02:05.927356 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1449/2823] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:02:05 2022] GET /compute/v2.1/os-security-groups/e51bed33-234d-4d2d-ad56-95ca121bd671 => generated 194 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:02:05.945347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:05.954872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:05.956037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'name': '1021436628', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:05.969714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:05.970488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:05.972030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:05.973404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:05.974168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:05.974712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:06.253365 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef948fa1-148f-460a-8294-bf484712e393 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/85310787-b442-488f-bf7f-bf9d9f883a74" status: 202 len: 0 microversion: 2.1 time: 1.580543 Aug 29 05:02:06.261458 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1375/2824] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:02:04 2022] DELETE /compute/v2.1/os-floating-ips/85310787-b442-488f-bf7f-bf9d9f883a74 => generated 0 bytes in 1589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:02:06.272971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:06.276467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:06.291814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:06.292367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:06.292868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:06.293592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:06.294053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:06.294499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:06.445858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:06.506675 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c2744f12-a147-49a3-9529-56f2c9a9924a tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?name=1021436628" status: 200 len: 346 microversion: 2.1 time: 0.576700 Aug 29 05:02:06.507271 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1450/2825] 10.222.0.20 () {58 vars in 1156 bytes} [Mon Aug 29 05:02:05 2022] GET /compute/v2.1/servers?name=1021436628 => generated 346 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:06.518723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b24dd6c-329c-4969-8212-c0839964c78e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab86df790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:06.586787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:06.596861 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e2736f95-b94c-42fb-986b-3de0e2cb80a1 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1322 microversion: 2.1 time: 0.333313 Aug 29 05:02:06.597904 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1376/2826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:06 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:06.603102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d1cbf13-9565-4877-a682-05c703eef9c7 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Action: 'update', calling method: .version_select at 0x7f1ab9677280>, body: {"security_group": {"name": "tempest-sg-1769342396", "description": "tempest-description-2112644018"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:06.705471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-5d1cbf13-9565-4877-a682-05c703eef9c7 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f82aad7-6565-4cbb-b261-a892d96f2cf4 does not exist", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:02:06.706171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.security_group_api [None req-5d1cbf13-9565-4877-a682-05c703eef9c7 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Neutron security group 7f82aad7-6565-4cbb-b261-a892d96f2cf4 not found {{(pid=128871) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:02:06.706874 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5d1cbf13-9565-4877-a682-05c703eef9c7 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] HTTP exception thrown: Security group 7f82aad7-6565-4cbb-b261-a892d96f2cf4 does not exist Aug 29 05:02:06.706874 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-5f834ed2-4fa0-4a30-ba73-1e8b3ebc478e'] Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d1cbf13-9565-4877-a682-05c703eef9c7 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Request method failure captured: Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/os-security-groups/7f82aad7-6565-4cbb-b261-a892d96f2cf4 HTTP/1.1 Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 102 Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEhIIMHTvMoCoWzu7AvQiMP162VFuhgbKbr6OFPeMsuWm9Ag5HytA4P19paLkRfJmwAZnrkZTDsMeaE3uzsUp9ojt69nOrcscWa_PC8SToTOcedA1P4W7xnecAhkDGx15QyCj3k9_jfBUTxGABzSZhkF09mxx7ZgHpxwczg_ImNgrOI Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: b9b01316282f4638a09da82c99971450 Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9b01316282f4638a09da82c99971450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b9b01316282f4638a09da82c99971450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b9b01316282f4638a09da82c99971450", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b9b01316282f4638a09da82c99971450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: b9b01316282f4638a09da82c99971450 Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102 Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupsNegativeTestJSON-1471029102-project Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 1c822ccebe1d437d8b4318e02973731c Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1471029102-project Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: {"security_group": {"name": "tempest-sg-1769342396", "description": "tempest-description-2112644018"}} Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: exception: Security group 7f82aad7-6565-4cbb-b261-a892d96f2cf4 does not exist Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-5f834ed2-4fa0-4a30-ba73-1e8b3ebc478e'] Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7f82aad7-6565-4cbb-b261-a892d96f2cf4', 'body': {'security_group': {'name': 'tempest-sg-1769342396', 'description': 'tempest-description-2112644018'}}} Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:02:06.708952 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f82aad7-6565-4cbb-b261-a892d96f2cf4 does not exist Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f834ed2-4fa0-4a30-ba73-1e8b3ebc478e'] Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f82aad7-6565-4cbb-b261-a892d96f2cf4 does not exist Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f834ed2-4fa0-4a30-ba73-1e8b3ebc478e'] Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f82aad7-6565-4cbb-b261-a892d96f2cf4 does not exist Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f834ed2-4fa0-4a30-ba73-1e8b3ebc478e'] Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f82aad7-6565-4cbb-b261-a892d96f2cf4 does not exist Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f834ed2-4fa0-4a30-ba73-1e8b3ebc478e'] Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d1cbf13-9565-4877-a682-05c703eef9c7 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] Returning 404 to user: Security group 7f82aad7-6565-4cbb-b261-a892d96f2cf4 does not exist Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-5f834ed2-4fa0-4a30-ba73-1e8b3ebc478e'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d1cbf13-9565-4877-a682-05c703eef9c7 tempest-SecurityGroupsNegativeTestJSON-1471029102 tempest-SecurityGroupsNegativeTestJSON-1471029102-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/7f82aad7-6565-4cbb-b261-a892d96f2cf4" status: 404 len: 194 microversion: 2.1 time: 0.112476 Aug 29 05:02:06.713290 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1377/2827] 10.222.0.20 () {60 vars in 1290 bytes} [Mon Aug 29 05:02:06 2022] PUT /compute/v2.1/os-security-groups/7f82aad7-6565-4cbb-b261-a892d96f2cf4 => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:02:06.717751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5c3ad1c8-a635-4f0e-a4b6-295793c8ca5a tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Calling method '.version_select at 0x7f1ab8bce0d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:07.442658 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b24dd6c-329c-4969-8212-c0839964c78e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f7713a38-b55b-4a92-b169-18a118887fd7" status: 202 len: 0 microversion: 2.1 time: 0.934066 Aug 29 05:02:07.445528 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1451/2828] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:02:06 2022] DELETE /compute/v2.1/os-security-groups/f7713a38-b55b-4a92-b169-18a118887fd7 => generated 0 bytes in 938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:02:07.455911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:07.463428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:07.465328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:07.473347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:07.474118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:07.474929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:07.475955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:07.476622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:07.477503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:07.620425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:07.719278 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5de98b25-b720-4e92-affa-5f0c3203a635 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.272395 Aug 29 05:02:07.720313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1452/2829] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Aug 29 05:02:07 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:07.737019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:07.738601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:07.746914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:07.748208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:07.748904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:07.750696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:07.751862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:07.752708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:08.022422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:08.030542 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37e82251-271f-44d0-8638-fb491ed2be57 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.305125 Aug 29 05:02:08.044704 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1453/2830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:07 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:08.049812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80a995f7-aca9-43e8-9b16-d785772ab104 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab86259d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:08.100769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-80a995f7-aca9-43e8-9b16-d785772ab104 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:02:08.101838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-80a995f7-aca9-43e8-9b16-d785772ab104 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group f7713a38-b55b-4a92-b169-18a118887fd7 not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:02:08.103277 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-80a995f7-aca9-43e8-9b16-d785772ab104 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:02:08.103277 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-f3c5ba8d-ae5c-47aa-ba83-b8921959d822'] Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80a995f7-aca9-43e8-9b16-d785772ab104 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-security-groups/f7713a38-b55b-4a92-b169-18a118887fd7 HTTP/1.1 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-f3c5ba8d-ae5c-47aa-ba83-b8921959d822'] Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'f7713a38-b55b-4a92-b169-18a118887fd7'} Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:02:08.106302 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3c5ba8d-ae5c-47aa-ba83-b8921959d822'] Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3c5ba8d-ae5c-47aa-ba83-b8921959d822'] Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3c5ba8d-ae5c-47aa-ba83-b8921959d822'] Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3c5ba8d-ae5c-47aa-ba83-b8921959d822'] Aug 29 05:02:08.111709 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:08.114907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80a995f7-aca9-43e8-9b16-d785772ab104 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:02:08.114907 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-f3c5ba8d-ae5c-47aa-ba83-b8921959d822'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:08.115909 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80a995f7-aca9-43e8-9b16-d785772ab104 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/f7713a38-b55b-4a92-b169-18a118887fd7" status: 404 len: 194 microversion: 2.1 time: 0.069932 Aug 29 05:02:08.119074 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1454/2831] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:02:08 2022] GET /compute/v2.1/os-security-groups/f7713a38-b55b-4a92-b169-18a118887fd7 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:02:08.127697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:08.128785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:08.137927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:08.138753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:08.139741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:08.140882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:08.142245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:08.143270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:08.371699 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5c3ad1c8-a635-4f0e-a4b6-295793c8ca5a tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/01fd48ca-466a-47a1-b4b1-49b13b8f914a" status: 202 len: 0 microversion: 2.1 time: 1.657969 Aug 29 05:02:08.373515 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1378/2832] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:02:06 2022] DELETE /compute/v2.1/os-floating-ips/01fd48ca-466a-47a1-b4b1-49b13b8f914a => generated 0 bytes in 1660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:02:08.380052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:08.391545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:08.392373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-102143662', 'deleted': False, 'project_id': '8f56323324964034a3de9c9dd25cf3ad'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:08.406132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:08.406908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:08.407364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:08.410948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:08.411572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:08.412474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:08.413349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:08.423963 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5da302ba-7730-4805-8ccb-b1d170b16abd tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1322 microversion: 2.1 time: 0.301962 Aug 29 05:02:08.425038 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1455/2833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:08 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:08.444935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-516be37f-7e3e-4e38-8bcf-35140745291e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab88820d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:08.558548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:08.629662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-636cf168-7f81-403d-a8d8-16939b1c02c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-102143662" status: 200 len: 346 microversion: 2.1 time: 0.254305 Aug 29 05:02:08.637351 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1379/2834] 10.222.0.20 () {58 vars in 1228 bytes} [Mon Aug 29 05:02:08 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-102143662 => generated 346 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:08.637351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-686b89e3-6fee-48ee-8a0c-c8208fa08174 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] Calling method '.version_select at 0x7f1ab9660820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:08.726653 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-516be37f-7e3e-4e38-8bcf-35140745291e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.286839 Aug 29 05:02:08.727248 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1456/2835] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 05:02:08 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:08.733248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:08.734038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:08.746334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:08.747490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:08.748529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:08.750561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:08.751380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:08.752072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:08.796642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:02:08.931885 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-efef302a-7f01-4eeb-8e08-0cd7ca9b52c7 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 204 len: 0 microversion: 2.1 time: 0.202713 Aug 29 05:02:08.932580 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1457/2836] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:02:08 2022] DELETE /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:02:08.949890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d828270-e72f-48df-aeb9-c37099409dcd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: .version_select at 0x7f1ab91c5f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1518165630", "description": "tempest-description-1160023137"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:09.331091 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7d828270-e72f-48df-aeb9-c37099409dcd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.393199 Aug 29 05:02:09.340313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1458/2837] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:02:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:09.340313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:09.340313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:09.344200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:09.344698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:09.345130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:09.346014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:09.346634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:09.347056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:09.611294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:09.622566 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e32c5d21-511e-401f-94c0-74c13eff6c7b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1516 microversion: 2.1 time: 0.289337 Aug 29 05:02:09.626374 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1459/2838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:09 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1516 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:09.636284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:09.637086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:09.648899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:09.651232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:09.653276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:09.655703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:09.656393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:09.659689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:09.961510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:09.976368 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ec56552d-17ef-44ee-bb83-b0f5fc7ade61 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.347789 Aug 29 05:02:09.977463 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1460/2839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:09 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:09.979394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-686b89e3-6fee-48ee-8a0c-c8208fa08174 tempest-FloatingIPDetailsTestJSON-1158206620 tempest-FloatingIPDetailsTestJSON-1158206620-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/a90a3585-e607-4b3d-8010-157024017cf3" status: 202 len: 0 microversion: 2.1 time: 1.347626 Aug 29 05:02:09.980091 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1380/2840] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:02:08 2022] DELETE /compute/v2.1/os-floating-ips/a90a3585-e607-4b3d-8010-157024017cf3 => generated 0 bytes in 1349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:02:09.986913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:09.987803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:09.988068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4bce9420-85ae-483b-bbbb-30f7a1a2a71c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: .version_select at 0x7f1ab8882790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-546558787", "description": "tempest-description-1128160291"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:10.000992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:10.004253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:10.004814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:10.005654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:10.006281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:10.006816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:10.402955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:10.412376 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83465920-6ff1-4601-9623-c7810fbcd573 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1322 microversion: 2.1 time: 0.430947 Aug 29 05:02:10.413695 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1381/2841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:09 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:10.423946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c2e68165-bfe5-4001-9b46-09ca7bbcbd17 req-e247198a-c369-4da3-bdfa-e420f2b50cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6c6b26-39fd-42ca-9194-7d610a4ed595", "name": "network-vif-plugged", "status": "completed", "tag": "d739b9be-708a-4a75-9b82-e4b51cb10770"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:10.436876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c2e68165-bfe5-4001-9b46-09ca7bbcbd17 req-e247198a-c369-4da3-bdfa-e420f2b50cd0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:10.437708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c2e68165-bfe5-4001-9b46-09ca7bbcbd17 req-e247198a-c369-4da3-bdfa-e420f2b50cd0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:10.438503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c2e68165-bfe5-4001-9b46-09ca7bbcbd17 req-e247198a-c369-4da3-bdfa-e420f2b50cd0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:10.450938 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c2e68165-bfe5-4001-9b46-09ca7bbcbd17 req-e247198a-c369-4da3-bdfa-e420f2b50cd0 service nova] Creating event network-vif-plugged:d739b9be-708a-4a75-9b82-e4b51cb10770 for instance 5d6c6b26-39fd-42ca-9194-7d610a4ed595 on n-h1-854119-9 Aug 29 05:02:10.457235 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c2e68165-bfe5-4001-9b46-09ca7bbcbd17 req-e247198a-c369-4da3-bdfa-e420f2b50cd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042112 Aug 29 05:02:10.462825 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1382/2842] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:10.559927 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4bce9420-85ae-483b-bbbb-30f7a1a2a71c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.580141 Aug 29 05:02:10.561347 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1461/2843] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:02:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:10.648243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:10.648723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:10.664222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:10.665387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:10.666374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:10.667404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:10.670424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:10.670979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:10.882570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1672759895", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "830055cb-0272-4311-a24b-9881fd9d72ea"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:10.972749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] validate_networks() for [('830055cb-0272-4311-a24b-9881fd9d72ea', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:02:11.709446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:11.717389 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf9c89ec-be04-4ce1-8990-7a4a7ac987b1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1516 microversion: 2.1 time: 1.074807 Aug 29 05:02:11.731374 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1383/2844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:10 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1516 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:11.738160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:11.738947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:11.746571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:11.747473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:11.748066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:11.749107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:11.749902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:11.750621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:12.308582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:12.317350 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c355216b-6a0b-4508-9341-4269a7f1ace9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.584578 Aug 29 05:02:12.318094 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1384/2845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:11 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:12.323442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:12.324237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:12.337855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:12.338502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:12.339162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:12.340095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:12.340806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:12.341427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:12.693949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:12.779408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:12.791142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:02:12.791689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:02:12.792142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:02:12.792637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:02:12.793266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:02:12.807263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:12.808326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:12.809238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:12.810180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:12.810808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:12.811392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:12.815842 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ff4e5d0-8c15-4a91-b12d-132ee84275de tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1322 microversion: 2.1 time: 0.494157 Aug 29 05:02:12.819691 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1385/2846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:12 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:12.839125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:12.843013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:12.860722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Getting quotas for project 9e7d2fe02ed74ebe917c21af1d280080. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:02:12.862694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:12.864762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:12.866246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:12.869728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:12.870632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Getting quotas for user 1833f2d2adf84acf98169a3ef701a492 and project 9e7d2fe02ed74ebe917c21af1d280080. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:02:12.870785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:12.872877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:12.919799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:02:12.927215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:02:13.008861 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0cc496e6-2395-4daa-9733-ec8fa7c4de7f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.130729 Aug 29 05:02:13.009844 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1462/2847] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:02:13.027030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4e861625-ba70-43f3-885c-bfb017cdf09e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:13.028163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4e861625-ba70-43f3-885c-bfb017cdf09e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:13.080393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:13.096929 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6877a160-72d7-45a1-8c35-207afe50da61 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1474 microversion: 2.1 time: 0.275110 Aug 29 05:02:13.097438 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1386/2848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:12 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1474 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:13.101936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7337e77c-b355-4d0f-a329-e93d7b4d04a8 req-a8c367b9-33b6-4dd1-9ec6-247edd0b3d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c15cb93-855b-403c-b905-dfd3e2ed68bb", "name": "network-vif-deleted", "tag": "a581c00c-7ee3-415b-a9bd-6b161b24b0b8"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:13.126685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4e861625-ba70-43f3-885c-bfb017cdf09e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:13.136112 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4e861625-ba70-43f3-885c-bfb017cdf09e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1216 microversion: 2.1 time: 0.113017 Aug 29 05:02:13.137513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7337e77c-b355-4d0f-a329-e93d7b4d04a8 req-a8c367b9-33b6-4dd1-9ec6-247edd0b3d94 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:13.138190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7337e77c-b355-4d0f-a329-e93d7b4d04a8 req-a8c367b9-33b6-4dd1-9ec6-247edd0b3d94 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:13.138797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7337e77c-b355-4d0f-a329-e93d7b4d04a8 req-a8c367b9-33b6-4dd1-9ec6-247edd0b3d94 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:13.145088 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1463/2849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:13 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:13.162071 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7337e77c-b355-4d0f-a329-e93d7b4d04a8 req-a8c367b9-33b6-4dd1-9ec6-247edd0b3d94 service nova] Creating event network-vif-deleted:a581c00c-7ee3-415b-a9bd-6b161b24b0b8 for instance 2c15cb93-855b-403c-b905-dfd3e2ed68bb on n-h1-854119-9 Aug 29 05:02:13.176753 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7337e77c-b355-4d0f-a329-e93d7b4d04a8 req-a8c367b9-33b6-4dd1-9ec6-247edd0b3d94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078022 Aug 29 05:02:13.183090 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1387/2850] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:13.340018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:13.340677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:13.351530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:13.351953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:13.360886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:13.362079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:13.363086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:13.363532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:13.839321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:13.840568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:13.853024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:13.853518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:13.856969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:13.869056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:13.869998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:13.870606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.063842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:14.072326 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b67faf2e-605e-4281-bf05-258cfbbbadfb tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.736514 Aug 29 05:02:14.084845 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1464/2851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:13 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:14.118280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:14.119171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:14.125937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.126495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.126937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.127680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.128163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.128750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.164605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.165091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.165521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.165971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lazy-loading 'fault' on Instance uuid 2c15cb93-855b-403c-b905-dfd3e2ed68bb {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:02:14.288899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:14.301019 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb42ef16-1a15-4d9d-b542-1a4ffb82f768 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 200 len: 1310 microversion: 2.1 time: 0.183212 Aug 29 05:02:14.305108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:14.320060 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1465/2852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:14 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 1310 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:14.323168 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54a3e904-c273-432c-ba46-fcf91690e0d4 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1472 microversion: 2.1 time: 0.488718 Aug 29 05:02:14.323789 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1388/2853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:13 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:14.330632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:14.331265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:14.337901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.338406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.346545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:14.347126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:14.355037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.356457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.358283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.358938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.359916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.364805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.365503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.367009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.370060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.370414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.449230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Request method failure captured: Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595/diagnostics HTTP/1.1 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEhBNeEXtFO1q1z821cNpP522pYTNif4fo4deMfPQ-gawAH1zTqivgCzhD5Hwrjgk7ql4j8jVtjSG2_Thud8_DxHnYg_P0BA4kgL5ZDzD3R_ke1WpNSoJJrt4pgr5ek0EpmFjAZ-rWR2UnvEHBPbBt2Pi92s6OU_HRcIlXYEDfc-UnQ Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 67e5947cf46d4fa19bda40742bdd5958 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1129169597 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67e5947cf46d4fa19bda40742bdd5958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/67e5947cf46d4fa19bda40742bdd5958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_67e5947cf46d4fa19bda40742bdd5958", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67e5947cf46d4fa19bda40742bdd5958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1129169597 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 67e5947cf46d4fa19bda40742bdd5958 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1129169597 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerDiagnosticsNegativeTest-1129169597-project Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 388e910c6ed646d08b62526b2bcfb0d2 Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1129169597-project Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': '5d6c6b26-39fd-42ca-9194-7d610a4ed595'} Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:14.458264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:14.462562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:14.462562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:14.462562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 05:02:14.462562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 05:02:14.462562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 05:02:14.462562 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:14.464909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:14.466142 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d38a678-2539-4cbd-821f-953c6e8d2081 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.125777 Aug 29 05:02:14.467908 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1389/2854] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:02:14 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595/diagnostics => generated 117 bytes in 128 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:02:14.485418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:14.485903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:14.500010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.502969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.503694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.505526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.507325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.507761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.561065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:02:14.706088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0fa42ab6-c750-4880-815b-ac38313a08ba tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 204 len: 0 microversion: 2.1 time: 0.227828 Aug 29 05:02:14.706750 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1390/2855] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:02:14 2022] DELETE /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:02:14.722429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:14.723710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:14.732063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.732901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.733679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.734584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:14.736370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:14.737053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:14.945392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:14.959457 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7801451f-9013-4b7d-bbd1-6fb066884771 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1212 microversion: 2.1 time: 0.638103 Aug 29 05:02:14.960057 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1466/2856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:14 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1212 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:15.094688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:15.095464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:15.102667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.103616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.104205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:15.105101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.105849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.106562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:15.140010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:15.144386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:15.155015 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be0b9439-b08a-408f-8a09-a6e39046c3ec tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1478 microversion: 2.1 time: 0.440124 Aug 29 05:02:15.155672 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1391/2857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:14 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1478 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:15.323790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:15.342759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:15.343926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 2c15cb93-855b-403c-b905-dfd3e2ed68bb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:15.350091 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-97b667b0-bf56-430b-929c-8573139503de tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.259141 Aug 29 05:02:15.351737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.352509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.353176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:15.354165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.354865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.355513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:15.356292 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1467/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:15 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:15.373349 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] HTTP exception thrown: Instance 2c15cb93-855b-403c-b905-dfd3e2ed68bb could not be found. Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Request method failure captured: Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb HTTP/1.1 Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEfzRVUbG31XAU3vu6r7Iaeg2GxJFTB1srFtKifZJQcXDmupAyvfqVf_e4hDXxPfp5yiFUlcVp0hEvweM9HF5PfEo0Vu2W9kUF8dPHR2atO25AUzj6t91XfSbF5ktYHggQwvQsHYJgebEwtNjOfCmOFcAMVUmEilXr3Dh5F4KYsfNY8 Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 8f56323324964034a3de9c9dd25cf3ad Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ListServerFiltersTestJSON-1737106202 Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f56323324964034a3de9c9dd25cf3ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f56323324964034a3de9c9dd25cf3ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f56323324964034a3de9c9dd25cf3ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f56323324964034a3de9c9dd25cf3ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ListServerFiltersTestJSON-1737106202 Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 8f56323324964034a3de9c9dd25cf3ad Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1737106202 Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ListServerFiltersTestJSON-1737106202-project Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6e65a1add31144aaafd8b620ed3f89bb Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ListServerFiltersTestJSON-1737106202-project Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 2c15cb93-855b-403c-b905-dfd3e2ed68bb could not be found. Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '2c15cb93-855b-403c-b905-dfd3e2ed68bb'} Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c15cb93-855b-403c-b905-dfd3e2ed68bb could not be found. Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c15cb93-855b-403c-b905-dfd3e2ed68bb could not be found. Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:15.377535 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:15.382087 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:15.382087 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:15.382087 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:15.382087 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:15.382087 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:15.382087 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c15cb93-855b-403c-b905-dfd3e2ed68bb could not be found. Aug 29 05:02:15.382087 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:15.382087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Returning 404 to user: Instance 2c15cb93-855b-403c-b905-dfd3e2ed68bb could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:15.382087 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e010b392-4945-4990-bd5d-ee9b92b44bdd tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb" status: 404 len: 111 microversion: 2.1 time: 0.045021 Aug 29 05:02:15.382815 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1392/2859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:15 2022] GET /compute/v2.1/servers/2c15cb93-855b-403c-b905-dfd3e2ed68bb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:02:15.391847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:15.392699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:15.402252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.402733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.403163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:15.404730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.405349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.405939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:15.459106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:02:15.564152 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e026c6b0-462d-478e-a562-6ad49e4f16f0 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c" status: 204 len: 0 microversion: 2.1 time: 0.176924 Aug 29 05:02:15.567860 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1468/2860] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:02:15 2022] DELETE /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:02:15.575747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:15.576887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:15.583552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.584041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.584770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:15.585635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.586528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.587116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:15.768467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:15.779614 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-612c7e3f-cdb6-4268-aaf0-0c283859c4f9 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c" status: 200 len: 1518 microversion: 2.1 time: 0.207654 Aug 29 05:02:15.781356 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1393/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:15 2022] GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c => generated 1518 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:15.982396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:15.983993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:15.993438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.994251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.994848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:15.995703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:15.996428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:15.996992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:16.095352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:16.104826 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e4510e19-f078-4470-9b96-0adf13563d58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1268 microversion: 2.1 time: 0.127824 Aug 29 05:02:16.106089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1469/2862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:15 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1268 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:16.178123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:16.179433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:16.205533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:16.206404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:16.207052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:16.210023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:16.210718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:16.211609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:16.378483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:16.379109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:16.393325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:16.393876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:16.394481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:16.395636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:16.396104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:16.396590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:16.482121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:16.485752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:16.504601 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6554921-6ac0-4f50-9181-da2a291643af tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1478 microversion: 2.1 time: 0.332642 Aug 29 05:02:16.519486 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1394/2863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:16 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1478 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:16.686903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:16.695438 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f3353e9-7ed0-465a-bbcf-181d247cd43b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.324273 Aug 29 05:02:16.708554 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1470/2864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:16 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:16.809777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:16.824458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:16.844102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:16.844869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:16.847453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:16.848322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:16.848776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:16.849261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:17.130107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:17.134805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:17.149367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:17.150025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:17.150811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:17.151684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:17.152329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:17.153006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:17.273262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:17.286566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-488a00eb-dee6-45a3-bbde-3cedf85bcee1 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c" status: 200 len: 1518 microversion: 2.1 time: 0.486734 Aug 29 05:02:17.286566 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1395/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:16 2022] GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c => generated 1518 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:17.295205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:17.308347 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8fb51b0e-3dcd-442e-bdf8-0f1352fa9fe7 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1268 microversion: 2.1 time: 0.181973 Aug 29 05:02:17.309271 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1471/2866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:17 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:17.526544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:17.527427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:17.534614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:17.535447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:17.536600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:17.537771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:17.538442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:17.539271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:17.719670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:17.720617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:17.729858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:17.730724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:17.731407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:17.732654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:17.733333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:17.733977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:18.379754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:18.396306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5a7ee911-1ad6-494a-8b31-f90d2f39c9d6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1478 microversion: 2.1 time: 0.869862 Aug 29 05:02:18.398539 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1396/2867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:17 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1478 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:18.409424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:18.410866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:18.420756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:18.421966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:18.422612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:18.424265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:18.425366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:18.426873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:18.505999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=10 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:18.688469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:18.701176 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7f795f5a-acb2-4b09-b302-277a5a6294b8 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.985977 Aug 29 05:02:18.701763 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1472/2868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:17 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:18.722873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:18.724877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:18.748252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:18.750478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:18.753345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:18.754278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:18.756500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:18.757087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:19.035396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:19.048044 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eae01a07-b5f1-4e0d-af46-08d6b073b079 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1274 microversion: 2.1 time: 0.329663 Aug 29 05:02:19.049447 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1473/2869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:18 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1274 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:19.250716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:19.263225 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d913322f-57bd-4157-9516-b3a600cd0949 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c" status: 200 len: 1518 microversion: 2.1 time: 0.862757 Aug 29 05:02:19.276624 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1397/2870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:18 2022] GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c => generated 1518 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:19.424994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:19.426125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:19.447882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:19.457891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:19.459609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:19.465183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:19.466246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:19.466953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:19.722311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:19.722922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:19.741048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:19.744893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:19.746596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:19.749801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:19.751599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:19.752330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:21.115471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:21.124037 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa84bd27-2d48-4d97-94eb-70d68dc37545 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1478 microversion: 2.1 time: 1.705093 Aug 29 05:02:21.130063 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1474/2871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:19 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1478 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:21.153574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:21.156374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:21.164868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:21.186716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:21.188590 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-58c0f20c-e1bc-48a5-bc52-f08d65bc0610 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 1.467417 Aug 29 05:02:21.205428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:21.205930 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1398/2872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:19 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:21.207711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:21.209652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:21.210213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:21.211794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:21.218133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:21.219009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:21.238559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:21.239846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:21.242192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:21.243160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:21.244848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:21.246652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:21.353273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:21.357303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:21.359916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:21.361560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lazy-loading 'fault' on Instance uuid c902e9b9-36b2-40c4-9060-98aa8806bd4c {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:02:21.711195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:21.720514 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b25b10fe-c78d-40be-9f24-21e0f9194278 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c" status: 200 len: 1311 microversion: 2.1 time: 0.512994 Aug 29 05:02:21.721695 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1399/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:21 2022] GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c => generated 1311 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:21.727921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-45ea5bd5-78c3-4c10-9746-d8389d26047b req-e16f1c1b-d6df-4050-9070-224355cac26f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c902e9b9-36b2-40c4-9060-98aa8806bd4c", "name": "network-vif-deleted", "tag": "bcacbbc7-9283-4bfe-bdd0-a18d07b1643f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:21.742442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-45ea5bd5-78c3-4c10-9746-d8389d26047b req-e16f1c1b-d6df-4050-9070-224355cac26f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:21.744219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-45ea5bd5-78c3-4c10-9746-d8389d26047b req-e16f1c1b-d6df-4050-9070-224355cac26f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:21.745226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-45ea5bd5-78c3-4c10-9746-d8389d26047b req-e16f1c1b-d6df-4050-9070-224355cac26f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:21.762956 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-45ea5bd5-78c3-4c10-9746-d8389d26047b req-e16f1c1b-d6df-4050-9070-224355cac26f service nova] Creating event network-vif-deleted:bcacbbc7-9283-4bfe-bdd0-a18d07b1643f for instance c902e9b9-36b2-40c4-9060-98aa8806bd4c on n-h1-854119-9 Aug 29 05:02:21.769717 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-45ea5bd5-78c3-4c10-9746-d8389d26047b req-e16f1c1b-d6df-4050-9070-224355cac26f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046388 Aug 29 05:02:21.771877 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1400/2874] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:21.918228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:21.933063 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-570dbb60-1f48-4bef-aa01-077d5ba01b07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.798811 Aug 29 05:02:21.946127 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1475/2875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:21 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:22.145577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:22.146270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:22.160166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.160692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.164299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.164770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.165486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.165971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.209796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:22.211151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:22.219397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.228944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.229701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.230650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.231330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.231945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.266307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.268063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.269035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.269510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lazy-loading 'fault' on Instance uuid 5d6c6b26-39fd-42ca-9194-7d610a4ed595 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:02:22.523559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388e910c6ed646d08b62526b2bcfb0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5947cf46d4fa19bda40742bdd5958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:22.535124 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-77e998f5-1909-4609-8a73-58416437baf6 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 200 len: 1312 microversion: 2.1 time: 0.393631 Aug 29 05:02:22.539142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1401/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:22 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:22.750681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:22.751344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: c902e9b9-36b2-40c4-9060-98aa8806bd4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:22.778936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.779593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.780181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.789316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.790068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.790532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.806331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:22.815695 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-faf1568a-3bc1-48a8-bc64-370dd1ee47be tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.610016 Aug 29 05:02:22.821251 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1476/2877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:22 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:22.844681 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] HTTP exception thrown: Instance c902e9b9-36b2-40c4-9060-98aa8806bd4c could not be found. Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Request method failure captured: Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c HTTP/1.1 Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEfzRVUbG31XAU3vu6r7Iaeg2GxJFTB1srFtKifZJQcXDmupAyvfqVf_e4hDXxPfp5yiFUlcVp0hEvweM9HF5PfEo0Vu2W9kUF8dPHR2atO25AUzj6t91XfSbF5ktYHggQwvQsHYJgebEwtNjOfCmOFcAMVUmEilXr3Dh5F4KYsfNY8 Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 8f56323324964034a3de9c9dd25cf3ad Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ListServerFiltersTestJSON-1737106202 Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f56323324964034a3de9c9dd25cf3ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f56323324964034a3de9c9dd25cf3ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f56323324964034a3de9c9dd25cf3ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f56323324964034a3de9c9dd25cf3ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ListServerFiltersTestJSON-1737106202 Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 8f56323324964034a3de9c9dd25cf3ad Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1737106202 Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ListServerFiltersTestJSON-1737106202-project Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6e65a1add31144aaafd8b620ed3f89bb Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ListServerFiltersTestJSON-1737106202-project Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance c902e9b9-36b2-40c4-9060-98aa8806bd4c could not be found. Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'c902e9b9-36b2-40c4-9060-98aa8806bd4c'} Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c902e9b9-36b2-40c4-9060-98aa8806bd4c could not be found. Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c902e9b9-36b2-40c4-9060-98aa8806bd4c could not be found. Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:22.850615 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:22.854489 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:22.854489 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:22.854489 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:22.854489 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:22.854489 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:22.854489 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c902e9b9-36b2-40c4-9060-98aa8806bd4c could not be found. Aug 29 05:02:22.854489 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:22.854489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Returning 404 to user: Instance c902e9b9-36b2-40c4-9060-98aa8806bd4c could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:22.854489 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7fe46a2b-fc26-43d1-a93b-f78796e79f11 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c" status: 404 len: 111 microversion: 2.1 time: 0.114957 Aug 29 05:02:22.855075 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1402/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:22 2022] GET /compute/v2.1/servers/c902e9b9-36b2-40c4-9060-98aa8806bd4c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:02:22.863699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:22.864354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:22.866553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:22.880528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.881432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.882120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.883063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.883726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.884402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.937564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:02:22.955275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:22.956340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:22.964040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.968702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.972630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:22.973615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:22.974286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:22.974949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:23.101882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:23.106452 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc12f179-1659-4c66-b44e-081e2f699f31 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 204 len: 0 microversion: 2.1 time: 0.246720 Aug 29 05:02:23.112252 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1477/2879] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:02:22 2022] DELETE /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:02:23.120566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:23.125493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:23.139183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:23.143995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:23.144974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:23.145673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:23.148620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:23.149332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:23.149970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:23.370226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:23.380454 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5333057d-3c5f-48cd-855c-a09b52e9a94c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.429144 Aug 29 05:02:23.385261 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1403/2880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:22 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:23.529020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:23.544517 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cceb0120-22f1-4899-bf0c-9a7e15d7221b tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1518 microversion: 2.1 time: 0.428080 Aug 29 05:02:23.545679 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1478/2881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:23 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1518 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:23.567848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:23.568817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] [instance: 5d6c6b26-39fd-42ca-9194-7d610a4ed595] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:23.593205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:23.593205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:23.593205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:23.593676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:23.594123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:23.594651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:23.618581 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] HTTP exception thrown: Instance 5d6c6b26-39fd-42ca-9194-7d610a4ed595 could not be found. Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Request method failure captured: Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 HTTP/1.1 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEhBNeEXtFO1q1z821cNpP522pYTNif4fo4deMfPQ-gawAH1zTqivgCzhD5Hwrjgk7ql4j8jVtjSG2_Thud8_DxHnYg_P0BA4kgL5ZDzD3R_ke1WpNSoJJrt4pgr5ek0EpmFjAZ-rWR2UnvEHBPbBt2Pi92s6OU_HRcIlXYEDfc-UnQ Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 67e5947cf46d4fa19bda40742bdd5958 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1129169597 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67e5947cf46d4fa19bda40742bdd5958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/67e5947cf46d4fa19bda40742bdd5958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_67e5947cf46d4fa19bda40742bdd5958", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67e5947cf46d4fa19bda40742bdd5958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1129169597 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 67e5947cf46d4fa19bda40742bdd5958 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1129169597 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerDiagnosticsNegativeTest-1129169597-project Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 388e910c6ed646d08b62526b2bcfb0d2 Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1129169597-project Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 5d6c6b26-39fd-42ca-9194-7d610a4ed595 could not be found. Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '5d6c6b26-39fd-42ca-9194-7d610a4ed595'} Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6c6b26-39fd-42ca-9194-7d610a4ed595 could not be found. Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6c6b26-39fd-42ca-9194-7d610a4ed595 could not be found. Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:23.624360 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6c6b26-39fd-42ca-9194-7d610a4ed595 could not be found. Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] Returning 404 to user: Instance 5d6c6b26-39fd-42ca-9194-7d610a4ed595 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-93ae27af-f3a0-4152-95b5-eaa006470fb3 tempest-ServerDiagnosticsNegativeTest-1129169597 tempest-ServerDiagnosticsNegativeTest-1129169597-project] 10.222.0.20 "GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595" status: 404 len: 111 microversion: 2.1 time: 0.072072 Aug 29 05:02:23.628199 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1404/2882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:23 2022] GET /compute/v2.1/servers/5d6c6b26-39fd-42ca-9194-7d610a4ed595 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:02:23.843379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:23.844056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:23.852492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b27c90a8-0c90-4a36-a543-4c437b14cbfb req-d4dfa8e3-e1e5-462e-8429-4878da322e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6c6b26-39fd-42ca-9194-7d610a4ed595", "name": "network-vif-deleted", "tag": "d739b9be-708a-4a75-9b82-e4b51cb10770"}, {"name": "network-changed", "server_uuid": "fa97c4a3-6876-4660-abff-28eeabe14c31", "tag": "c113b73e-1d01-4a2a-9d45-437549ac17fe"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:23.868082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:23.869273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:23.869273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:23.869735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:23.870396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:23.870833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:23.889505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b27c90a8-0c90-4a36-a543-4c437b14cbfb req-d4dfa8e3-e1e5-462e-8429-4878da322e33 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:23.890567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b27c90a8-0c90-4a36-a543-4c437b14cbfb req-d4dfa8e3-e1e5-462e-8429-4878da322e33 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:23.892387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b27c90a8-0c90-4a36-a543-4c437b14cbfb req-d4dfa8e3-e1e5-462e-8429-4878da322e33 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:23.944398 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b27c90a8-0c90-4a36-a543-4c437b14cbfb req-d4dfa8e3-e1e5-462e-8429-4878da322e33 service nova] Creating event network-vif-deleted:d739b9be-708a-4a75-9b82-e4b51cb10770 for instance 5d6c6b26-39fd-42ca-9194-7d610a4ed595 on n-h1-854119-9 Aug 29 05:02:23.951321 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b27c90a8-0c90-4a36-a543-4c437b14cbfb req-d4dfa8e3-e1e5-462e-8429-4878da322e33 service nova] Creating event network-changed:c113b73e-1d01-4a2a-9d45-437549ac17fe for instance fa97c4a3-6876-4660-abff-28eeabe14c31 on n-h1-854119-9 Aug 29 05:02:23.965915 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b27c90a8-0c90-4a36-a543-4c437b14cbfb req-d4dfa8e3-e1e5-462e-8429-4878da322e33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.118236 Aug 29 05:02:23.971517 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1405/2883] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:24.285078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:24.297936 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07abcea0-c328-490e-b15d-7b811ef36381 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 0.459378 Aug 29 05:02:24.312983 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1479/2884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:23 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:24.402480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:24.404176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:24.417485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:24.418007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:24.418489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:24.419279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:24.419727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:24.420233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:24.567326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:24.568109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:24.580143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:24.583127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:24.585243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:24.587096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:24.587759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:24.589499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:24.613545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:25.218697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:25.254886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:25.258786 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-92674b90-5da2-4082-b34b-930886aaaad3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.845301 Aug 29 05:02:25.275986 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1406/2885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:24 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:25.277656 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d1285934-9396-4b18-8d47-f13c9ee75fe2 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1518 microversion: 2.1 time: 0.714813 Aug 29 05:02:25.278579 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1480/2886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:24 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1518 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:25.324474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:25.325358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:25.351396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:25.351913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:25.357195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:25.358176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:25.358844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:25.359439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:25.895373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da4f777f-84b6-4886-a4ff-b367ebac64d0 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Action: 'create', calling method: .version_select at 0x7f1abd907f70>, body: {"keypair": {"name": "tempest-keypair-1288158769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd2kRltD9pa8fQKtsFOPtR3YsRHqDBCX8BRI6TtdkYkEYy4QS4J7fQmk4Do7V1RCVX4VtxjC+TMS9vGp6SGmHn2H+V8JYFvn7QLQLGuf8pXxMwVL5SVbrdqTvouzm+sDg=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:25.922537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-da4f777f-84b6-4886-a4ff-b367ebac64d0 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Getting quotas for project 24c64d14f0db4bc5a815cca2be384f2d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:02:25.929645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-da4f777f-84b6-4886-a4ff-b367ebac64d0 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Getting quotas for user 97ffb030cb5e4cb2a13cd7267f51b2cb and project 24c64d14f0db4bc5a815cca2be384f2d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:02:25.976359 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da4f777f-84b6-4886-a4ff-b367ebac64d0 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.453031 Aug 29 05:02:25.977452 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1481/2887] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:02:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:02:26.282571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:26.283247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:26.297283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:26.297792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:26.298231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:26.298952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:26.299405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:26.302420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:26.670916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:26.688823 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8f93e9c7-be9e-402f-9c54-33dcb8030067 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1512 microversion: 2.1 time: 1.373439 Aug 29 05:02:26.691124 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1407/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:25 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1512 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:26.706476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:26.707460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:26.719137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:26.720000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:26.721986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:26.723311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:26.724291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:26.725048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:26.981677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:27.001660 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d78d69b0-f9ce-4657-8b07-1e739ea1ae3d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1476 microversion: 2.1 time: 0.309201 Aug 29 05:02:27.002435 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1408/2889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:26 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1476 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:27.451519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:27.453752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-30a6b5e1-bdca-4979-82cd-74def8c69d47 req-156e5ca1-959d-4565-ba00-82d4d09cb657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652fbf6a-e3b6-4ca0-9845-ad15d1348664", "name": "network-vif-deleted", "tag": "b0857ece-512d-420c-ba5a-53b48cf6e29b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:27.469737 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-63372135-5fe5-4cdf-863b-1c5290ae86f1 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 1.192675 Aug 29 05:02:27.470816 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1482/2890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:26 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:27.511083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-30a6b5e1-bdca-4979-82cd-74def8c69d47 req-156e5ca1-959d-4565-ba00-82d4d09cb657 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:27.515800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-30a6b5e1-bdca-4979-82cd-74def8c69d47 req-156e5ca1-959d-4565-ba00-82d4d09cb657 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:27.516439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-30a6b5e1-bdca-4979-82cd-74def8c69d47 req-156e5ca1-959d-4565-ba00-82d4d09cb657 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:27.568266 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-30a6b5e1-bdca-4979-82cd-74def8c69d47 req-156e5ca1-959d-4565-ba00-82d4d09cb657 service nova] Creating event network-vif-deleted:b0857ece-512d-420c-ba5a-53b48cf6e29b for instance 652fbf6a-e3b6-4ca0-9845-ad15d1348664 on n-h1-854119-9 Aug 29 05:02:27.583610 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-30a6b5e1-bdca-4979-82cd-74def8c69d47 req-156e5ca1-959d-4565-ba00-82d4d09cb657 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134110 Aug 29 05:02:27.585979 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1409/2891] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:28.024538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:28.025247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:28.050541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:28.053958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:28.054632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:28.058369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:28.059080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:28.059738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:28.124080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:28.124933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:28.126087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:28.127078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lazy-loading 'fault' on Instance uuid 652fbf6a-e3b6-4ca0-9845-ad15d1348664 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:02:28.231855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:28.232577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:28.244381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:28.245100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:28.246464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:28.248621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:28.249460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:28.250508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:28.270095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e65a1add31144aaafd8b620ed3f89bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56323324964034a3de9c9dd25cf3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:28.286142 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9e2b2195-2881-4c84-8fef-bcd796bb8e9d tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 200 len: 1311 microversion: 2.1 time: 0.266661 Aug 29 05:02:28.287190 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1410/2892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:28 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 1311 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:28.490902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:28.491615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:28.501034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:28.501871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:28.503057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:28.504368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:28.505481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:28.506421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:28.885596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:28.916144 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-489120e8-f48e-4d0b-ba73-8b193fbabdaa tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1489 microversion: 2.1 time: 1.208946 Aug 29 05:02:28.925134 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1483/2893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:27 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1489 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:28.944616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:28.945415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:28.953451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:28.954335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:28.955192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:28.955319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:28.956343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:28.957338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:28.958030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:28.964207 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2af390dc-163e-4623-8c74-bf13910c885b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.477175 Aug 29 05:02:28.968082 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1411/2894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:28 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:29.003642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:02:29.135728 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-809f5c47-d5b3-4b3d-a221-6eb8530e0b73 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 204 len: 0 microversion: 2.1 time: 0.194835 Aug 29 05:02:29.141665 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1484/2895] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:02:28 2022] DELETE /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:02:29.146998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:29.147619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:29.154182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:29.154886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:29.155482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:29.156378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:29.156991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:29.157409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:29.321429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:29.322336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] [instance: 652fbf6a-e3b6-4ca0-9845-ad15d1348664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:29.345838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:29.346490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:29.347185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:29.348749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:29.351889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:29.352840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:29.378545 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] HTTP exception thrown: Instance 652fbf6a-e3b6-4ca0-9845-ad15d1348664 could not be found. Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Request method failure captured: Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 HTTP/1.1 Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEfzRVUbG31XAU3vu6r7Iaeg2GxJFTB1srFtKifZJQcXDmupAyvfqVf_e4hDXxPfp5yiFUlcVp0hEvweM9HF5PfEo0Vu2W9kUF8dPHR2atO25AUzj6t91XfSbF5ktYHggQwvQsHYJgebEwtNjOfCmOFcAMVUmEilXr3Dh5F4KYsfNY8 Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 8f56323324964034a3de9c9dd25cf3ad Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ListServerFiltersTestJSON-1737106202 Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f56323324964034a3de9c9dd25cf3ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f56323324964034a3de9c9dd25cf3ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f56323324964034a3de9c9dd25cf3ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f56323324964034a3de9c9dd25cf3ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ListServerFiltersTestJSON-1737106202 Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 8f56323324964034a3de9c9dd25cf3ad Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1737106202 Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ListServerFiltersTestJSON-1737106202-project Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 6e65a1add31144aaafd8b620ed3f89bb Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ListServerFiltersTestJSON-1737106202-project Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 652fbf6a-e3b6-4ca0-9845-ad15d1348664 could not be found. Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '652fbf6a-e3b6-4ca0-9845-ad15d1348664'} Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652fbf6a-e3b6-4ca0-9845-ad15d1348664 could not be found. Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652fbf6a-e3b6-4ca0-9845-ad15d1348664 could not be found. Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:29.380602 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:29.385113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:29.385113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:29.385113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:29.385113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:29.385113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:29.385113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652fbf6a-e3b6-4ca0-9845-ad15d1348664 could not be found. Aug 29 05:02:29.385113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:29.385113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] Returning 404 to user: Instance 652fbf6a-e3b6-4ca0-9845-ad15d1348664 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:29.385113 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b547baea-c8dc-4341-a641-13841028da62 tempest-ListServerFiltersTestJSON-1737106202 tempest-ListServerFiltersTestJSON-1737106202-project] 10.222.0.20 "GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664" status: 404 len: 111 microversion: 2.1 time: 0.076862 Aug 29 05:02:29.385802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:29.387014 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1485/2896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:29 2022] GET /compute/v2.1/servers/652fbf6a-e3b6-4ca0-9845-ad15d1348664 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:02:29.395012 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3593ab53-f96e-4c8b-aef0-7862580ab028 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1495 microversion: 2.1 time: 0.251999 Aug 29 05:02:29.395914 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1412/2897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:29 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1495 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:29.566978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-93583631", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b4a4719b-bd7b-44d7-bdad-cce979c26f61"}], "security_groups": [{"name": "tempest-securitygroup--1929680985"}], "key_name": "tempest-keypair-1288158769", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:29.993139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:29.993868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:30.017494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:30.018067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:30.018473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:30.019145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:30.019599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:30.029943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:30.452993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] validate_networks() for [('b4a4719b-bd7b-44d7-bdad-cce979c26f61', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:02:30.499264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:30.504352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:30.514971 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4cca7ba4-c144-42fe-90e0-311ef2cb0d07 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.528264 Aug 29 05:02:30.516056 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1413/2898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:29 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:30.522418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:30.523037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:30.543997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:30.544538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:30.544979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:30.545705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:30.546164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:30.546589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:31.850664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:31.866492 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f73d8d8c-4d84-4983-910d-f1f0ef38b8b7 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1495 microversion: 2.1 time: 1.349165 Aug 29 05:02:31.867087 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1414/2899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:30 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1495 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:31.880804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:31.880804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:31.903986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:31.915982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:31.916717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:31.917809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:31.922486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:31.928303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:32.861695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Getting quotas for project 24c64d14f0db4bc5a815cca2be384f2d. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:02:32.869332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Getting quotas for user 97ffb030cb5e4cb2a13cd7267f51b2cb and project 24c64d14f0db4bc5a815cca2be384f2d. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:02:32.898045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:02:32.898753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:02:32.899396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:02:32.901532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:02:32.902697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:02:32.923821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:32.924629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:32.925213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:32.926115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:32.926769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:32.927354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:32.948112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Getting quotas for project 24c64d14f0db4bc5a815cca2be384f2d. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:02:32.954783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Getting quotas for user 97ffb030cb5e4cb2a13cd7267f51b2cb and project 24c64d14f0db4bc5a815cca2be384f2d. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:02:32.979664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:02:32.982606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:02:33.080176 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-934b1105-9be8-4600-99d3-282f11fa22bb tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.519888 Aug 29 05:02:33.101984 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1486/2900] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:02:29 2022] POST /compute/v2.1/servers => generated 407 bytes in 3542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:02:33.107266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:33.125171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:33.142349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:33.142845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:33.143285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:33.143995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:33.144469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:33.144905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:33.312363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:33.324362 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fe1295e9-fc71-4de3-832f-6430ac6b8b45 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 1.453449 Aug 29 05:02:33.325847 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1415/2901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:31 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:33.331476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-662bf701-ac03-4b00-ac0e-eda5a0663b86 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:33.334914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-662bf701-ac03-4b00-ac0e-eda5a0663b86 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:33.343781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:33.715164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-662bf701-ac03-4b00-ac0e-eda5a0663b86 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:33.733645 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-662bf701-ac03-4b00-ac0e-eda5a0663b86 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1268 microversion: 2.1 time: 0.406461 Aug 29 05:02:33.752261 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1416/2902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:33 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1268 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:34.221505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:34.236504 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b60e522c-d61c-4672-867d-b12e7ed9184d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1495 microversion: 2.1 time: 1.131135 Aug 29 05:02:34.239396 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1487/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:33 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1495 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:34.347226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:34.348646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:34.358929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:34.359771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:34.360496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:34.371214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:34.371968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:34.372626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:34.749705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:34.758432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:34.759471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:34.770721 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-737acdff-fb9b-4b11-ba07-a8d125a72048 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.427625 Aug 29 05:02:34.779188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:34.779961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:34.780473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:34.781226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:34.781676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:34.782098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:34.784841 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1417/2904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:34 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:34.986169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:34.997589 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af214c4b-a922-48ad-a230-a5411f82c2c3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1320 microversion: 2.1 time: 0.243289 Aug 29 05:02:34.998215 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1488/2905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:34 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:35.228988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a5c5b4cc-edc5-4d6d-b573-32c0a9ff1627 req-c8259fed-a69d-490d-ae5e-06c2dd5483df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c25788-08f4-4d5a-8f8d-372ed53b2fcb", "name": "network-vif-deleted", "tag": "8232d335-b93d-4b44-8231-9ab9b6adfb00"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:35.252534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a5c5b4cc-edc5-4d6d-b573-32c0a9ff1627 req-c8259fed-a69d-490d-ae5e-06c2dd5483df service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:35.259770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:35.261030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a5c5b4cc-edc5-4d6d-b573-32c0a9ff1627 req-c8259fed-a69d-490d-ae5e-06c2dd5483df service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:35.261358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:35.261649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a5c5b4cc-edc5-4d6d-b573-32c0a9ff1627 req-c8259fed-a69d-490d-ae5e-06c2dd5483df service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:35.272819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:35.273638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:35.275553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:35.276619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:35.278454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:35.285919 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a5c5b4cc-edc5-4d6d-b573-32c0a9ff1627 req-c8259fed-a69d-490d-ae5e-06c2dd5483df service nova] Creating event network-vif-deleted:8232d335-b93d-4b44-8231-9ab9b6adfb00 for instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb on n-h1-854119-9 Aug 29 05:02:35.287280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:35.299386 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a5c5b4cc-edc5-4d6d-b573-32c0a9ff1627 req-c8259fed-a69d-490d-ae5e-06c2dd5483df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074718 Aug 29 05:02:35.299386 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1418/2906] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:02:35.484579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:35.501449 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba0fc35a-f0c3-44b1-a6eb-64ebe9d7ec16 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 200 len: 1287 microversion: 2.1 time: 0.246454 Aug 29 05:02:35.503595 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1489/2907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:35 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 1287 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:35.795980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:35.796714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:35.815717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:35.816246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:35.816675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:35.817559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:35.818382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:35.819177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:36.025271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:36.026390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:36.057680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:36.058855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:36.061256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:36.071609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:36.096885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:36.100994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:36.244691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:36.256375 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-245391b6-9741-48e2-97e4-5c1af78d3ee3 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.465433 Aug 29 05:02:36.261201 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1419/2908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:35 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:36.524459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:36.525450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:36.535322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:36.537662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:36.538911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:36.543938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:36.548686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:36.549413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:36.587116 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb HTTP/1.1 Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '23c25788-08f4-4d5a-8f8d-372ed53b2fcb'} Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:36.589093 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:36.592913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:36.592913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:36.592913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:36.592913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:36.592913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:36.592913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:02:36.592913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:36.595428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:36.596773 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e44cfaa8-d2f0-4b8a-8619-cf7342890d25 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 404 len: 111 microversion: 2.1 time: 0.076315 Aug 29 05:02:36.597857 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1420/2909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:36 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:02:36.769107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-153590661", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "57e28866-1c32-4826-b8f3-b2fdc024be39"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:36.844496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] validate_networks() for [('57e28866-1c32-4826-b8f3-b2fdc024be39', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:02:37.429680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:37.441205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b12292b7-299e-4acb-8d2d-335eb052a4f5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1394 microversion: 2.1 time: 1.423832 Aug 29 05:02:37.461453 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1490/2910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:36 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1394 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:37.475160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:37.484259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:37.486198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Searching by: {'deleted': False, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:37.494773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:37.495416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:37.496081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:37.497794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:37.498516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:37.499141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:37.546454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:37.626831 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-95fe632f-0bbb-4265-8a79-78aa93d6966b tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.162952 Aug 29 05:02:37.629297 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1491/2911] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:02:37 2022] GET /compute/v2.1/servers => generated 339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:37.651914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:37.654094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:37.679119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:37.679622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:37.680055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:37.687558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:37.688250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:37.688711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:38.437620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:38.456148 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3defedfa-3bc7-4939-a620-246ecad25570 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.824529 Aug 29 05:02:38.459183 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1492/2912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:37 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:38.466539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:38.479699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:38.485396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Searching by: {'deleted': False, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:38.497069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:38.497807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:38.498420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:38.511636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:38.517035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:38.517862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:38.587094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:38.698928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:38.715319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:38.717177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:38.717731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:39.439961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84c938bb-3632-42e0-acd8-3efa41548efe tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.977508 Aug 29 05:02:39.440857 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1493/2913] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 05:02:38 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:39.618667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:02:39.619638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:02:39.620515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:02:39.621086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:02:39.621811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:02:39.637931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:39.642329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:39.643112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:39.644220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:39.644835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:39.650173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:39.705151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:02:39.716871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Getting quotas for user 4d3aaab47eb243c6bf9a0b2e512e7c4a and project 2c8dbc7ce397480d8d31b963dac9688f. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:02:39.718431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-808200806", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "911ffd94-abc2-45d8-b80e-e85f99f6857a"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:39.745245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:02:39.753334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:02:39.856638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] validate_networks() for [('911ffd94-abc2-45d8-b80e-e85f99f6857a', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:02:39.884000 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e034ac5-4e61-4329-9d51-88b40c1bd052 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.121060 Aug 29 05:02:39.899155 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1421/2914] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:02:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:02:39.919850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:39.920731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:39.928678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:39.929476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:39.930254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:39.932172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:39.932851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:39.933483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:40.481163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:40.492836 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-708501f7-4ba8-44bb-962d-520df1e71269 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1394 microversion: 2.1 time: 0.592186 Aug 29 05:02:40.493669 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1422/2915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:39 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1394 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:40.611997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6cbeb2e-8ec4-4e5e-9781-fba66184af3a tempest-FloatingIPDetailsNegativeTestJSON-2043647835 tempest-FloatingIPDetailsNegativeTestJSON-2043647835-project] Calling method '.version_select at 0x7f1ab9796820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:40.687292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-f6cbeb2e-8ec4-4e5e-9781-fba66184af3a tempest-FloatingIPDetailsNegativeTestJSON-2043647835 tempest-FloatingIPDetailsNegativeTestJSON-2043647835-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 22b46179-1369-4c8e-a624-cb3cd430b6cb could not be found", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:02:40.688467 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f6cbeb2e-8ec4-4e5e-9781-fba66184af3a tempest-FloatingIPDetailsNegativeTestJSON-2043647835 tempest-FloatingIPDetailsNegativeTestJSON-2043647835-project] HTTP exception thrown: Floating IP not found for ID 22b46179-1369-4c8e-a624-cb3cd430b6cb Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6cbeb2e-8ec4-4e5e-9781-fba66184af3a tempest-FloatingIPDetailsNegativeTestJSON-2043647835 tempest-FloatingIPDetailsNegativeTestJSON-2043647835-project] Request method failure captured: Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-floating-ips/22b46179-1369-4c8e-a624-cb3cd430b6cb HTTP/1.1 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEhuA5PyVT_XIe5mzg7lulJ5F5hheAvrDxocwKHrv0OJelZvXtne-3E4Yu4lHo7UKi6SkKi1Ub6kHlNgKDWgKk0QcsRJugN4VVS-QYD5jil6uA5QrcmGHVdzwb7IbUouGJNykSXtPdAo39YvL9jl0K2om_vdvKnPAPMOy-EnQ9BZUX8 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 00e1f0b0a29f4601a40a525fe2386de1 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2043647835 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00e1f0b0a29f4601a40a525fe2386de1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00e1f0b0a29f4601a40a525fe2386de1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00e1f0b0a29f4601a40a525fe2386de1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00e1f0b0a29f4601a40a525fe2386de1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2043647835 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 00e1f0b0a29f4601a40a525fe2386de1 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2043647835 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2043647835-project Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 21f5d9abf25e421ea16769a17249a5d8 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2043647835-project Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: exception: Floating IP not found for ID 22b46179-1369-4c8e-a624-cb3cd430b6cb Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '22b46179-1369-4c8e-a624-cb3cd430b6cb'} Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:02:40.690635 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 22b46179-1369-4c8e-a624-cb3cd430b6cb could not be found Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a71b6eb-3fd6-45eb-a9b4-f83c0276968a'] Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 22b46179-1369-4c8e-a624-cb3cd430b6cb. Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 22b46179-1369-4c8e-a624-cb3cd430b6cb Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 22b46179-1369-4c8e-a624-cb3cd430b6cb Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6cbeb2e-8ec4-4e5e-9781-fba66184af3a tempest-FloatingIPDetailsNegativeTestJSON-2043647835 tempest-FloatingIPDetailsNegativeTestJSON-2043647835-project] Returning 404 to user: Floating IP not found for ID 22b46179-1369-4c8e-a624-cb3cd430b6cb {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6cbeb2e-8ec4-4e5e-9781-fba66184af3a tempest-FloatingIPDetailsNegativeTestJSON-2043647835 tempest-FloatingIPDetailsNegativeTestJSON-2043647835-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/22b46179-1369-4c8e-a624-cb3cd430b6cb" status: 404 len: 111 microversion: 2.1 time: 0.197186 Aug 29 05:02:40.694819 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1423/2916] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 29 05:02:40 2022] GET /compute/v2.1/os-floating-ips/22b46179-1369-4c8e-a624-cb3cd430b6cb => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:02:40.701029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-677ff5c4-d1c2-4d4d-be3a-3c0436b6a512 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:40.723312 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-677ff5c4-d1c2-4d4d-be3a-3c0436b6a512 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028769 Aug 29 05:02:40.727342 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1424/2917] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 05:02:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:40.740487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:40.741382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:40.750939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:40.751773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:40.752462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:40.753390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:40.756771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:40.758183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:41.653939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:41.688076 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-33c0929c-0d96-43c7-af59-655fee374ca4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.950924 Aug 29 05:02:41.689556 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1425/2918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:40 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:41.710093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ba252546-8ede-40e6-bbec-7891043bd8fe req-ea58b292-3f2b-4710-9bbf-1b7cdfc6b411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa97c4a3-6876-4660-abff-28eeabe14c31", "name": "network-vif-plugged", "status": "completed", "tag": "c113b73e-1d01-4a2a-9d45-437549ac17fe"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:41.722493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:02:41.722983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:02:41.723979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:02:41.724672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:02:41.725497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:02:41.754675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ba252546-8ede-40e6-bbec-7891043bd8fe req-ea58b292-3f2b-4710-9bbf-1b7cdfc6b411 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:41.755179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ba252546-8ede-40e6-bbec-7891043bd8fe req-ea58b292-3f2b-4710-9bbf-1b7cdfc6b411 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:41.755602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ba252546-8ede-40e6-bbec-7891043bd8fe req-ea58b292-3f2b-4710-9bbf-1b7cdfc6b411 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:41.758266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:41.758769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:41.762550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:41.767098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:41.768987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:41.769638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:41.771227 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ba252546-8ede-40e6-bbec-7891043bd8fe req-ea58b292-3f2b-4710-9bbf-1b7cdfc6b411 service nova] Creating event network-vif-plugged:c113b73e-1d01-4a2a-9d45-437549ac17fe for instance fa97c4a3-6876-4660-abff-28eeabe14c31 on n-h1-854119-9 Aug 29 05:02:41.788449 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ba252546-8ede-40e6-bbec-7891043bd8fe req-ea58b292-3f2b-4710-9bbf-1b7cdfc6b411 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087126 Aug 29 05:02:41.789471 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1426/2919] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:41.803221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:41.804632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:41.817841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:41.818767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:41.819434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:41.820478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:41.821307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:41.821942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:41.862652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Getting quotas for project 472505d0d1284ec7aab1199f2d9b9b0b. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:02:41.883801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Getting quotas for user f815ab4ebda14e749e67e67ca38f627f and project 472505d0d1284ec7aab1199f2d9b9b0b. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:02:41.920912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:02:41.930794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:02:41.991074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:42.019387 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eff0dba4-256f-4c67-b8e8-2cf796249692 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1266 microversion: 2.1 time: 0.224588 Aug 29 05:02:42.041202 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1427/2920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:41 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:42.064302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3b51cf01-036f-40a2-a642-0fcd64b10a24 req-0f4cf6d0-3ceb-4a9c-87aa-6d5311c16bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed82919b-2f3a-428a-b8bc-020f08560164", "tag": "72eb5b7a-13b2-4f9f-ae09-5427c7542daa"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:42.092279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3b51cf01-036f-40a2-a642-0fcd64b10a24 req-0f4cf6d0-3ceb-4a9c-87aa-6d5311c16bb4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:42.093139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3b51cf01-036f-40a2-a642-0fcd64b10a24 req-0f4cf6d0-3ceb-4a9c-87aa-6d5311c16bb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:42.094136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3b51cf01-036f-40a2-a642-0fcd64b10a24 req-0f4cf6d0-3ceb-4a9c-87aa-6d5311c16bb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:42.115751 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eab150bb-074e-4d75-b963-e38bee544c90 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.668846 Aug 29 05:02:42.127969 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1494/2921] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:02:42.127969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:42.127969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:42.146457 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3b51cf01-036f-40a2-a642-0fcd64b10a24 req-0f4cf6d0-3ceb-4a9c-87aa-6d5311c16bb4 service nova] Creating event network-changed:72eb5b7a-13b2-4f9f-ae09-5427c7542daa for instance ed82919b-2f3a-428a-b8bc-020f08560164 on n-h1-854119-9 Aug 29 05:02:42.150386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:42.150893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:42.151392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:42.152042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:42.153340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:42.153986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:42.175541 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3b51cf01-036f-40a2-a642-0fcd64b10a24 req-0f4cf6d0-3ceb-4a9c-87aa-6d5311c16bb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129582 Aug 29 05:02:42.176525 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1428/2922] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:42.199276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:42.206043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:42.231910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:42.236216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:42.237826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:42.240524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:42.241228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:42.241851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:42.250497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:02:42.382782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:42.462186 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cfc1495c-c069-42aa-bc10-3a5e54fe1d77 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 204 len: 0 microversion: 2.1 time: 0.337474 Aug 29 05:02:42.467083 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1495/2923] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:02:42 2022] DELETE /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:02:42.479130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22364519-d2d2-4f09-b795-4a4d00508dc4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:42.480021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22364519-d2d2-4f09-b795-4a4d00508dc4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:42.483491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:42.823329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-22364519-d2d2-4f09-b795-4a4d00508dc4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:42.838742 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22364519-d2d2-4f09-b795-4a4d00508dc4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1215 microversion: 2.1 time: 0.369704 Aug 29 05:02:42.848943 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1496/2924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:42 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1215 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:42.871673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:42.872228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:42.891601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:42.892326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:42.895406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:42.896448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:42.897065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:42.897639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:43.983831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:43.994103 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2c97df7a-d80d-4ddf-8264-bf7e1a0d49c5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1394 microversion: 2.1 time: 1.813848 Aug 29 05:02:44.012764 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1429/2925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:42 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1394 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:44.017938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:44.026540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:44.034521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:44.035021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:44.038914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:44.039747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:44.040251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:44.040711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:44.155763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:44.167361 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8535f2c0-4de3-4f72-9146-f4941bdb726e tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1715 microversion: 2.1 time: 1.317087 Aug 29 05:02:44.172033 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1497/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:42 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1715 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:44.184081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:44.186245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:44.210189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:44.210967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:44.211624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:44.212576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:44.215052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:44.216997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:44.356663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:44.368188 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3cee58d5-4077-4a69-a79e-377289dd27e5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1272 microversion: 2.1 time: 0.194626 Aug 29 05:02:44.371427 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1498/2927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:44 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:44.381817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:44.383936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:44.396519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:44.400139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:44.400605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:44.401473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:44.401929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:44.402945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:44.544608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:44.555767 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98a39a46-c3f8-4a56-b8f5-9aaeb59ae472 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1267 microversion: 2.1 time: 0.180976 Aug 29 05:02:44.558529 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1499/2928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:44 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:44.575286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:44.586133 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7bba121-6c0c-4f68-9f99-2710f87d81bd tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.572073 Aug 29 05:02:44.586727 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1430/2929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:44 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:45.015014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:45.015890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:45.022241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.023151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.024068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.025019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.025670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.026290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.194881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:45.195500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:45.210032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.211987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.213363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.217357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.220713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.222239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.342574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:45.357040 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5497f5b-0d4f-42ba-b953-4780e8ecd837 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1394 microversion: 2.1 time: 0.345597 Aug 29 05:02:45.362417 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1500/2930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:45 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1394 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:45.393985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:45.394877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:45.417329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.420295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.420980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.425465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.425950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.426386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.618509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:45.629587 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee1a36fd-49da-4c69-bac8-46ad4e738301 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1272 microversion: 2.1 time: 0.242326 Aug 29 05:02:45.632949 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1501/2931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:45 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:45.644206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:45.645076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:45.666321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.667326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.668080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.669074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.670512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.671144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.867324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:45.882570 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a14f85b-541f-4226-9414-54d263d69f46 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1715 microversion: 2.1 time: 0.691752 Aug 29 05:02:45.883162 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1431/2932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:45 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1715 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:45.901701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:45.909620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:45.925882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.928014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.928920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.929845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:45.930569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:45.931181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:45.941937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:45.959679 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cecb8f1f-0b4b-419e-9f2b-2c1b58ffca88 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1267 microversion: 2.1 time: 0.325338 Aug 29 05:02:45.965358 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1502/2933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:45 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1267 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:46.391600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:46.395806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:46.405499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:46.407061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:46.409640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:46.410573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:46.412789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:46.413434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:46.717944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:46.728960 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6a3c1d72-50e1-4074-840a-5cd10bd069d6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1316 microversion: 2.1 time: 0.844739 Aug 29 05:02:46.738908 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1432/2934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:45 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1316 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:46.743755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:46.758344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:46.783055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:46.787316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:46.789647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:46.790418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:46.790884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:46.791304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:47.532461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:47.543611 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a1ec1b0-f7e2-4d49-8b30-8a9dbf5a9fec tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1394 microversion: 2.1 time: 1.159066 Aug 29 05:02:47.557000 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1503/2935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:46 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1394 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:47.618889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-520994073", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "3608634f-c657-4632-a57c-89ec30d24b5a"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:47.675736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] validate_networks() for [('3608634f-c657-4632-a57c-89ec30d24b5a', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:02:48.013328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:48.021537 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-11c7d495-d941-4450-b1ad-cf82a5ab15ca tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1314 microversion: 2.1 time: 1.281533 Aug 29 05:02:48.022165 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1433/2936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:46 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1314 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:48.026774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:48.027382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:48.033237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:48.033926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:48.034598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:48.035271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:48.035691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:48.036136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:48.878829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:48.890903 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4be14ba3-9b25-4bf9-b477-2725ac2e24ac tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1715 microversion: 2.1 time: 0.867184 Aug 29 05:02:48.905711 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1434/2937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:48 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1715 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:48.919280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:48.920081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:48.926722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:48.927307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:48.927874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:48.928671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:48.929193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:48.929678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:49.148088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:49.163582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52abfcaf-b0e8-4e42-b998-852795b4d387 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1273 microversion: 2.1 time: 0.254707 Aug 29 05:02:49.166279 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1435/2938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:48 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:49.174168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:49.182269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:49.192324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:49.196494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:49.199144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:49.199882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:49.200369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:49.201009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:49.667520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:49.736968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:50.386087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:50.393559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:50.399125 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-21f328fd-e18f-4b0a-90a2-5f00ab028ee4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1504 microversion: 2.1 time: 1.231500 Aug 29 05:02:50.401649 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1436/2939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:49 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1504 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:50.414512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-63896ae0-0367-497a-b9cb-e10d04bc555b req-31e64d77-7ce0-49c0-bd86-7ee822462e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16924c2-4d44-4b93-a184-10cde1934009", "name": "network-vif-unplugged", "status": "completed", "tag": "6ea56d13-f7fa-4e9e-b1a1-33ddd0498066"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:50.446222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-63896ae0-0367-497a-b9cb-e10d04bc555b req-31e64d77-7ce0-49c0-bd86-7ee822462e4f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:50.448461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-63896ae0-0367-497a-b9cb-e10d04bc555b req-31e64d77-7ce0-49c0-bd86-7ee822462e4f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:50.450323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-63896ae0-0367-497a-b9cb-e10d04bc555b req-31e64d77-7ce0-49c0-bd86-7ee822462e4f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:50.484165 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-63896ae0-0367-497a-b9cb-e10d04bc555b req-31e64d77-7ce0-49c0-bd86-7ee822462e4f service nova] Creating event network-vif-unplugged:6ea56d13-f7fa-4e9e-b1a1-33ddd0498066 for instance e16924c2-4d44-4b93-a184-10cde1934009 on n-h1-854119-9 Aug 29 05:02:50.497562 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-63896ae0-0367-497a-b9cb-e10d04bc555b req-31e64d77-7ce0-49c0-bd86-7ee822462e4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094301 Aug 29 05:02:50.499076 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1437/2940] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:50.507618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:50.508605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:50.540270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:50.540989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:50.541594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:50.542467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:50.543071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:50.543646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:51.297169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:02:51.298036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:02:51.298539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:02:51.299065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:02:51.299715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:02:51.314739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:51.315244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:51.315670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:51.316425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:51.317018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:51.317443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:51.372709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Getting quotas for project b233cdda0d464bbd9063556d05f94f32. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:02:51.378983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Getting quotas for user 1b5778008702451e9e25aec8bafb13f3 and project b233cdda0d464bbd9063556d05f94f32. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:02:51.416342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Going to run 2 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:02:51.418714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: d8f8d726-cea8-47a1-8b08-3c6ddae3f11f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:02:51.498353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=d8f8d726-cea8-47a1-8b08-3c6ddae3f11f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:02:51.590448 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85d69165-0970-417c-a7bc-bd80a11f390c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.031898 Aug 29 05:02:51.591221 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1504/2941] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:02:51.597806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:51.608243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:51.649213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:51.652055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:51.653337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:51.654320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:51.655020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:51.655882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:51.814956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:51.830742 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab3a41a7-7cae-4d59-8d62-f15ce9301322 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1394 microversion: 2.1 time: 1.329775 Aug 29 05:02:51.836357 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1438/2942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:50 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1394 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:51.842202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:51.843064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:51.856670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:51.857551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:51.862685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:51.863991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:51.865286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:51.866636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:52.428878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:52.440909 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ef58368-a642-455b-98a9-9719699276df tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1647 microversion: 2.1 time: 0.602921 Aug 29 05:02:52.444603 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1439/2943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:51 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1647 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:52.458924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:52.475272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:52.484055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:52.485609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:52.486085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:52.488384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:52.489166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:52.489760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:52.986062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:52.997611 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-860bdd4f-956b-4759-8ee6-93cb1f95365d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1314 microversion: 2.1 time: 1.403507 Aug 29 05:02:52.998920 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1505/2944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:51 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1314 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:53.004948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1518165630"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:53.005851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:53.018004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:53.020959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:53.021899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:53.024082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:53.033157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:53.038641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:53.642699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:53.652501 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b49abee-3e0c-42c0-9d65-ac4e2ea169d6 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 1.206477 Aug 29 05:02:53.653274 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1440/2945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:52 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:53.676683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:53.683232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:53.684358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Searching by: {'deleted': False, 'project_id': 'b233cdda0d464bbd9063556d05f94f32'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:02:53.703171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:53.704162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:53.707842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:53.710919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:53.711824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:53.715889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:53.775044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:02:53.811215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16758ddd-71c0-4431-ad3a-f9e07a411647 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.141542 Aug 29 05:02:53.817968 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1441/2946] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:02:53 2022] GET /compute/v2.1/servers => generated 675 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:53.817968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4d2d2da7-26eb-409d-9539-443462fdbe54 req-ab899e85-094b-48c3-bd57-8020df902d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73dfa6f9-babd-4bec-a4e9-95e5829e2fd5", "tag": "42615650-c176-47e5-b155-cd885ba7347b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:53.831963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4d2d2da7-26eb-409d-9539-443462fdbe54 req-ab899e85-094b-48c3-bd57-8020df902d48 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:53.832623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4d2d2da7-26eb-409d-9539-443462fdbe54 req-ab899e85-094b-48c3-bd57-8020df902d48 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:53.833059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4d2d2da7-26eb-409d-9539-443462fdbe54 req-ab899e85-094b-48c3-bd57-8020df902d48 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:53.849182 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4d2d2da7-26eb-409d-9539-443462fdbe54 req-ab899e85-094b-48c3-bd57-8020df902d48 service nova] Creating event network-changed:42615650-c176-47e5-b155-cd885ba7347b for instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 on n-h1-854119-9 Aug 29 05:02:53.854432 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4d2d2da7-26eb-409d-9539-443462fdbe54 req-ab899e85-094b-48c3-bd57-8020df902d48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040531 Aug 29 05:02:53.856068 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1442/2947] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:53.862055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-abed7286-0219-46f2-99c0-11c69899e790 req-8b382d71-d33f-436c-a52b-97570e9174c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed82919b-2f3a-428a-b8bc-020f08560164", "name": "network-vif-plugged", "status": "completed", "tag": "72eb5b7a-13b2-4f9f-ae09-5427c7542daa"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:53.874517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-abed7286-0219-46f2-99c0-11c69899e790 req-8b382d71-d33f-436c-a52b-97570e9174c2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:53.875289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-abed7286-0219-46f2-99c0-11c69899e790 req-8b382d71-d33f-436c-a52b-97570e9174c2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:53.875897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-abed7286-0219-46f2-99c0-11c69899e790 req-8b382d71-d33f-436c-a52b-97570e9174c2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:53.889031 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-abed7286-0219-46f2-99c0-11c69899e790 req-8b382d71-d33f-436c-a52b-97570e9174c2 service nova] Creating event network-vif-plugged:72eb5b7a-13b2-4f9f-ae09-5427c7542daa for instance ed82919b-2f3a-428a-b8bc-020f08560164 on n-h1-854119-9 Aug 29 05:02:53.894459 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-abed7286-0219-46f2-99c0-11c69899e790 req-8b382d71-d33f-436c-a52b-97570e9174c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036816 Aug 29 05:02:53.900346 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1443/2948] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:53.906457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:53.907476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:53.915014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:53.915793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:53.916523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:53.917801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:53.918507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:53.919145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:54.154402 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.network.security_group_api [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Adding security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 to port c113b73e-1d01-4a2a-9d45-437549ac17fe Aug 29 05:02:54.936696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:54.949220 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc4063c5-dba6-4d66-8b1f-22a024809548 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1394 microversion: 2.1 time: 1.046880 Aug 29 05:02:54.951603 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1444/2949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:53 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1394 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:54.963652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:54.965855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:54.980005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:54.981599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:54.983965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:54.984947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:54.986929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:54.987274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:55.256942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:55.268197 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-10a52269-9960-4cc5-b1d5-615c381f9de0 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1362 microversion: 2.1 time: 0.313525 Aug 29 05:02:55.272540 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1445/2950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:54 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:55.277518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:55.282091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:55.298159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:55.298654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:55.299095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:55.304458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:55.304917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:55.305367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:55.518142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:55.530811 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-607e4a5c-53ae-4ecc-ac1b-84e37769b607 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1277 microversion: 2.1 time: 0.256935 Aug 29 05:02:55.535616 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1446/2951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:55 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:55.551000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:55.551638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:55.567724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:55.568501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:55.569108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:55.570610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:55.571239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:55.571823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:56.309292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:56.328576 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-29b73e5b-56bf-4a8d-ac28-91c4c84c33ee tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1314 microversion: 2.1 time: 0.791441 Aug 29 05:02:56.329460 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1447/2952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:55 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:56.336471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:56.337713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:56.348015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:56.349025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:56.349675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:56.350546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:56.352621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:56.353378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:56.355088 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-866ab84e-b9b8-40b9-a5d1-2a5896630cfe tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31/action" status: 202 len: 0 microversion: 2.1 time: 3.354882 Aug 29 05:02:56.356011 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1506/2953] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:02:52 2022] POST /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31/action => generated 0 bytes in 3356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:02:56.640285 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9325a8f5-9e62-475b-9bab-46b73abe711b tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.279079 Aug 29 05:02:56.642057 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1507/2954] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Aug 29 05:02:56 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 05:02:56.656343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:56.658497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:56.663562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:56.678925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-84c6ec30-6665-4b27-8b86-c562eee8dfa1 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 0.344893 Aug 29 05:02:56.681202 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1448/2955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:56 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:56.690573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:56.693417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-309f8a70-b592-4750-9a37-ecdf670fa32f req-44b9a244-631b-4c06-9c3e-e92c43d16a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16924c2-4d44-4b93-a184-10cde1934009", "name": "network-vif-deleted", "tag": "6ea56d13-f7fa-4e9e-b1a1-33ddd0498066"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:56.693893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:56.694530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:56.696063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:56.698995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:56.699850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:56.722320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-309f8a70-b592-4750-9a37-ecdf670fa32f req-44b9a244-631b-4c06-9c3e-e92c43d16a30 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:56.725261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-309f8a70-b592-4750-9a37-ecdf670fa32f req-44b9a244-631b-4c06-9c3e-e92c43d16a30 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:56.725832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-309f8a70-b592-4750-9a37-ecdf670fa32f req-44b9a244-631b-4c06-9c3e-e92c43d16a30 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:56.760460 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-309f8a70-b592-4750-9a37-ecdf670fa32f req-44b9a244-631b-4c06-9c3e-e92c43d16a30 service nova] Creating event network-vif-deleted:6ea56d13-f7fa-4e9e-b1a1-33ddd0498066 for instance e16924c2-4d44-4b93-a184-10cde1934009 on n-h1-854119-9 Aug 29 05:02:56.767162 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-309f8a70-b592-4750-9a37-ecdf670fa32f req-44b9a244-631b-4c06-9c3e-e92c43d16a30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084386 Aug 29 05:02:56.768731 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1449/2956] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:56.780339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:56.782318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:56.790723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:56.792094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:56.792793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:56.795109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:56.795822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:56.796498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:56.843145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:56.844892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:56.845735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:56.846433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lazy-loading 'fault' on Instance uuid e16924c2-4d44-4b93-a184-10cde1934009 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:02:56.951306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:56.963066 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b75ffca2-c4ef-4fe6-8cc0-4b6c709b83a7 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1367 microversion: 2.1 time: 0.190973 Aug 29 05:02:56.979476 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1450/2957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:56 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:56.985434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6e7a6ac6-36e0-409c-a298-7d2184754464 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab9c6d040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:57.032436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:57.045546 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55c4bdce-58f6-4dad-b6cf-7df370088343 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1394 microversion: 2.1 time: 0.402201 Aug 29 05:02:57.058944 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1508/2958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:56 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1394 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:57.058944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:57.058944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:57.072380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.072883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.073321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:57.074164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.074485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.074907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:57.306106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-6e7a6ac6-36e0-409c-a298-7d2184754464 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 in use.", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:02:57.306808 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-6e7a6ac6-36e0-409c-a298-7d2184754464 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security Group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 in use. Aug 29 05:02:57.306808 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-566084a8-27a3-44e6-8ce4-05af7976625a'] Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6e7a6ac6-36e0-409c-a298-7d2184754464 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/os-security-groups/b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 HTTP/1.1 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: exception: Security Group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 in use. Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-566084a8-27a3-44e6-8ce4-05af7976625a'] Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'b7f3273b-1f8d-4ef8-a390-e123eb9c9b76'} Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:02:57.308816 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 in use. Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-566084a8-27a3-44e6-8ce4-05af7976625a'] Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 in use. Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-566084a8-27a3-44e6-8ce4-05af7976625a'] Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 in use. Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-566084a8-27a3-44e6-8ce4-05af7976625a'] Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 in use. Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-566084a8-27a3-44e6-8ce4-05af7976625a'] Aug 29 05:02:57.313780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.317358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6e7a6ac6-36e0-409c-a298-7d2184754464 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 400 to user: Security Group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 in use. Aug 29 05:02:57.317358 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-566084a8-27a3-44e6-8ce4-05af7976625a'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:57.318310 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6e7a6ac6-36e0-409c-a298-7d2184754464 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b7f3273b-1f8d-4ef8-a390-e123eb9c9b76" status: 400 len: 185 microversion: 2.1 time: 0.337409 Aug 29 05:02:57.319203 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1451/2959] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:02:56 2022] DELETE /compute/v2.1/os-security-groups/b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 => generated 185 bytes in 339 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:02:57.325982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09998bfe-3f69-4426-b441-c2388f3e37ff tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Calling method '.version_select at 0x7f1ab9c7d280>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:57.370468 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-09998bfe-3f69-4426-b441-c2388f3e37ff tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] HTTP exception thrown: Image not found. Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09998bfe-3f69-4426-b441-c2388f3e37ff tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Request method failure captured: Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEh_SebDCB9Z8n_2lWLk0cP5_4IQnebhKqtU4QRymFR9__0EGf_p75ikOfRZLoRsORAUiPCfDSgh31x30ZseSaza-uWgqGB0uAX4KNVhpdXYNUl3RA6vThZoG7wXQQsQC8EwejQMqA9rHKGKf68P0Q_cJ88UNdz6CR4yYQ7Vp8lGupE Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f46622b409ac454db1447992ad81eba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f46622b409ac454db1447992ad81eba1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 656c8ffe4a27481cb7b8d7fc2a617c95 Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '-1'} Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.372300 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09998bfe-3f69-4426-b441-c2388f3e37ff tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09998bfe-3f69-4426-b441-c2388f3e37ff tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.053535 Aug 29 05:02:57.379019 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1452/2960] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 29 05:02:57 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:02:57.383532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a771813d-a4b0-46cd-bf2f-764911bacaef tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:57.398280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a771813d-a4b0-46cd-bf2f-764911bacaef tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:57.407630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a771813d-a4b0-46cd-bf2f-764911bacaef tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.408181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a771813d-a4b0-46cd-bf2f-764911bacaef tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.408585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a771813d-a4b0-46cd-bf2f-764911bacaef tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:57.409308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a771813d-a4b0-46cd-bf2f-764911bacaef tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.409743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a771813d-a4b0-46cd-bf2f-764911bacaef tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.413982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a771813d-a4b0-46cd-bf2f-764911bacaef tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:57.475353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:57.486077 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2eb7c158-e15c-493a-9cf2-cb63a969a3a1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.437819 Aug 29 05:02:57.487968 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1509/2961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:57 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:57.493443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:57.494309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:57.502352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.503122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.503894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:57.504661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.505106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.505700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:57.565681 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a771813d-a4b0-46cd-bf2f-764911bacaef tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31/action" status: 202 len: 0 microversion: 2.1 time: 0.185851 Aug 29 05:02:57.569441 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1453/2962] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:02:57 2022] POST /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:02:57.575322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a79978d-40bf-4408-be6d-370ccbf3cb9f tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Calling method '.version_select at 0x7f1ab9d0e430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:57.607756 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-4a79978d-40bf-4408-be6d-370ccbf3cb9f tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] HTTP exception thrown: Image not found. Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a79978d-40bf-4408-be6d-370ccbf3cb9f tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Request method failure captured: Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/images/dc9d3c7d-9380-4bd2-b343-db416c28fd4j HTTP/1.1 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEh_SebDCB9Z8n_2lWLk0cP5_4IQnebhKqtU4QRymFR9__0EGf_p75ikOfRZLoRsORAUiPCfDSgh31x30ZseSaza-uWgqGB0uAX4KNVhpdXYNUl3RA6vThZoG7wXQQsQC8EwejQMqA9rHKGKf68P0Q_cJ88UNdz6CR4yYQ7Vp8lGupE Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f46622b409ac454db1447992ad81eba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f46622b409ac454db1447992ad81eba1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 656c8ffe4a27481cb7b8d7fc2a617c95 Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'dc9d3c7d-9380-4bd2-b343-db416c28fd4j'} Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dc9d3c7d-9380-4bd2-b343-db416c28fd4j to delete Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc9d3c7d-9380-4bd2-b343-db416c28fd4j could not be found. Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.610817 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a79978d-40bf-4408-be6d-370ccbf3cb9f tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:57.614805 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4a79978d-40bf-4408-be6d-370ccbf3cb9f tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] 10.222.0.20 "DELETE /compute/v2.1/images/dc9d3c7d-9380-4bd2-b343-db416c28fd4j" status: 404 len: 62 microversion: 2.1 time: 0.043562 Aug 29 05:02:57.617466 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1454/2963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:57 2022] DELETE /compute/v2.1/images/dc9d3c7d-9380-4bd2-b343-db416c28fd4j => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:02:57.622229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:57.622955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:57.631639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.632144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.632644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:57.633553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.634042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.634975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:57.677101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:57.686400 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed80cfd6-021a-4944-b51a-a01aae08a32e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1314 microversion: 2.1 time: 0.197128 Aug 29 05:02:57.700201 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1510/2964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:57 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:57.714599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6b019d1d-47e5-43ff-8e43-cfdf3acfb743 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Calling method '.version_select at 0x7f1abd90dca0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:57.734143 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-6b019d1d-47e5-43ff-8e43-cfdf3acfb743 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] HTTP exception thrown: Image not found. Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6b019d1d-47e5-43ff-8e43-cfdf3acfb743 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Request method failure captured: Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/images/881577f7-3258-4d7e-b096-beefdac142de1 HTTP/1.1 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEh_SebDCB9Z8n_2lWLk0cP5_4IQnebhKqtU4QRymFR9__0EGf_p75ikOfRZLoRsORAUiPCfDSgh31x30ZseSaza-uWgqGB0uAX4KNVhpdXYNUl3RA6vThZoG7wXQQsQC8EwejQMqA9rHKGKf68P0Q_cJ88UNdz6CR4yYQ7Vp8lGupE Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f46622b409ac454db1447992ad81eba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f46622b409ac454db1447992ad81eba1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 656c8ffe4a27481cb7b8d7fc2a617c95 Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '881577f7-3258-4d7e-b096-beefdac142de1'} Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 881577f7-3258-4d7e-b096-beefdac142de1 to delete Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 881577f7-3258-4d7e-b096-beefdac142de1 could not be found. Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.737658 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6b019d1d-47e5-43ff-8e43-cfdf3acfb743 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:57.742958 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6b019d1d-47e5-43ff-8e43-cfdf3acfb743 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] 10.222.0.20 "DELETE /compute/v2.1/images/881577f7-3258-4d7e-b096-beefdac142de1" status: 404 len: 62 microversion: 2.1 time: 0.037812 Aug 29 05:02:57.748333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1511/2965] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:02:57 2022] DELETE /compute/v2.1/images/881577f7-3258-4d7e-b096-beefdac142de1 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:02:57.756654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:57.764684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:57.785586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.786391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.787110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:57.787843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:57.788326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:57.788743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:58.162261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:58.170865 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5afe4c7e-7d2c-485a-8815-0a51d0ae4267 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1575 microversion: 2.1 time: 0.552321 Aug 29 05:02:58.171717 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1455/2966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:57 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1575 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:58.177835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dfaf5826-ea0f-4ed4-a242-a3e0b695816c tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Calling method '.version_select at 0x7f1ab9e52dc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:58.201981 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-dfaf5826-ea0f-4ed4-a242-a3e0b695816c tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] HTTP exception thrown: Image not found. Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dfaf5826-ea0f-4ed4-a242-a3e0b695816c tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Request method failure captured: Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/images/tempest-invalid-1432516209 HTTP/1.1 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEh_SebDCB9Z8n_2lWLk0cP5_4IQnebhKqtU4QRymFR9__0EGf_p75ikOfRZLoRsORAUiPCfDSgh31x30ZseSaza-uWgqGB0uAX4KNVhpdXYNUl3RA6vThZoG7wXQQsQC8EwejQMqA9rHKGKf68P0Q_cJ88UNdz6CR4yYQ7Vp8lGupE Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f46622b409ac454db1447992ad81eba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f46622b409ac454db1447992ad81eba1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 656c8ffe4a27481cb7b8d7fc2a617c95 Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'tempest-invalid-1432516209'} Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1432516209 to delete Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1432516209 could not be found. Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.204167 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dfaf5826-ea0f-4ed4-a242-a3e0b695816c tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:58.208144 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dfaf5826-ea0f-4ed4-a242-a3e0b695816c tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-1432516209" status: 404 len: 62 microversion: 2.1 time: 0.032595 Aug 29 05:02:58.210983 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1456/2967] 10.222.0.20 () {58 vars in 1206 bytes} [Mon Aug 29 05:02:58 2022] DELETE /compute/v2.1/images/tempest-invalid-1432516209 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:02:58.215864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:58.216591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:58.224288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:58.224788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:58.225271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:58.226150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:58.226612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:58.227042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:58.261346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:58.261759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:58.262185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:58.262982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lazy-loading 'fault' on Instance uuid e16924c2-4d44-4b93-a184-10cde1934009 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:02:58.274133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:58.283188 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78355033-e8ac-4c49-a06c-55c0aabad33c tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 0.533050 Aug 29 05:02:58.284094 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1512/2968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:57 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:58.289693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:58.290567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:58.296712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:58.297449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:58.297880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:58.298569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:58.299012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:58.299427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:58.398610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfae618b26a421f926b82d7947167c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09f5bf987364fd9931c1662d1f26e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:58.407113 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17632c1e-2114-4d8a-b94f-d6c7efe25d39 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 200 len: 1367 microversion: 2.1 time: 0.194840 Aug 29 05:02:58.408029 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1457/2969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:58 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:58.413139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c82e1497-5a55-40c3-a7b5-c8d243f033a3 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Calling method '.version_select at 0x7f1ab9e780d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:58.443364 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-c82e1497-5a55-40c3-a7b5-c8d243f033a3 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] HTTP exception thrown: Image not found. Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c82e1497-5a55-40c3-a7b5-c8d243f033a3 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Request method failure captured: Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/images/27ead2c7-b3e0-4c85-a1f8-439cc9e14ad3 HTTP/1.1 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEh_SebDCB9Z8n_2lWLk0cP5_4IQnebhKqtU4QRymFR9__0EGf_p75ikOfRZLoRsORAUiPCfDSgh31x30ZseSaza-uWgqGB0uAX4KNVhpdXYNUl3RA6vThZoG7wXQQsQC8EwejQMqA9rHKGKf68P0Q_cJ88UNdz6CR4yYQ7Vp8lGupE Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f46622b409ac454db1447992ad81eba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f46622b409ac454db1447992ad81eba1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f46622b409ac454db1447992ad81eba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f46622b409ac454db1447992ad81eba1 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 656c8ffe4a27481cb7b8d7fc2a617c95 Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1521779194-project Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '27ead2c7-b3e0-4c85-a1f8-439cc9e14ad3'} Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 27ead2c7-b3e0-4c85-a1f8-439cc9e14ad3 to delete Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 27ead2c7-b3e0-4c85-a1f8-439cc9e14ad3 could not be found. Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:58.446591 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c82e1497-5a55-40c3-a7b5-c8d243f033a3 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:02:58.453231 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c82e1497-5a55-40c3-a7b5-c8d243f033a3 tempest-ImagesDeleteNegativeTestJSON-1521779194 tempest-ImagesDeleteNegativeTestJSON-1521779194-project] 10.222.0.20 "DELETE /compute/v2.1/images/27ead2c7-b3e0-4c85-a1f8-439cc9e14ad3" status: 404 len: 62 microversion: 2.1 time: 0.042733 Aug 29 05:02:58.457096 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1458/2970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:58 2022] DELETE /compute/v2.1/images/27ead2c7-b3e0-4c85-a1f8-439cc9e14ad3 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:02:58.510845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:58.511604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:58.533483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:58.534041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:58.536852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:58.537703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:58.538458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:58.539085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:58.579470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:02:58.946721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:58.959979 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-391016e7-e8e0-4756-bd81-06d5847a484f tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1394 microversion: 2.1 time: 0.674422 Aug 29 05:02:58.970823 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1513/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:58 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1394 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:58.978363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:58.979016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:58.997419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:59.001013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:59.002023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:59.003102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:59.004727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:59.008256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:59.018420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:59.021566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed28764c-08fe-4060-9421-f88d58de1d7d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.514435 Aug 29 05:02:59.026403 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1459/2972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:58 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:02:59.039866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4f56bb9d-ee51-480a-aaa0-1c2a8f2a755d req-7c8d5da8-fd31-475b-b640-34b32cb46078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa97c4a3-6876-4660-abff-28eeabe14c31", "tag": "c113b73e-1d01-4a2a-9d45-437549ac17fe"}, {"name": "network-changed", "server_uuid": "d9017bb8-cc8e-46d0-86ba-763c9fe82cd2", "tag": "4aeae9f9-1065-4f31-ac20-db276ec6f411"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:02:59.066324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4f56bb9d-ee51-480a-aaa0-1c2a8f2a755d req-7c8d5da8-fd31-475b-b640-34b32cb46078 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:59.068666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4f56bb9d-ee51-480a-aaa0-1c2a8f2a755d req-7c8d5da8-fd31-475b-b640-34b32cb46078 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:59.069120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4f56bb9d-ee51-480a-aaa0-1c2a8f2a755d req-7c8d5da8-fd31-475b-b640-34b32cb46078 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:59.093258 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4f56bb9d-ee51-480a-aaa0-1c2a8f2a755d req-7c8d5da8-fd31-475b-b640-34b32cb46078 service nova] Creating event network-changed:c113b73e-1d01-4a2a-9d45-437549ac17fe for instance fa97c4a3-6876-4660-abff-28eeabe14c31 on n-h1-854119-9 Aug 29 05:02:59.094189 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4f56bb9d-ee51-480a-aaa0-1c2a8f2a755d req-7c8d5da8-fd31-475b-b640-34b32cb46078 service nova] Creating event network-changed:4aeae9f9-1065-4f31-ac20-db276ec6f411 for instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 on n-h1-854119-9 Aug 29 05:02:59.101175 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4f56bb9d-ee51-480a-aaa0-1c2a8f2a755d req-7c8d5da8-fd31-475b-b640-34b32cb46078 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073335 Aug 29 05:02:59.101786 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1460/2973] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:02:59.199715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:59.200868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:59.212724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:59.214346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:59.215049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:59.216370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:59.219275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:59.220083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:59.582722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:02:59.591509 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-171e2898-2185-4bc7-937e-a26c7d992509 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1314 microversion: 2.1 time: 0.620162 Aug 29 05:02:59.604873 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1514/2974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:58 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:02:59.622520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:02:59.624685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:02:59.637865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:59.639119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:59.640535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:02:59.642101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:02:59.646224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:02:59.650005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:00.375363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:00.385476 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f24a0e7-5dc5-4174-86b4-e1322951068a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1575 microversion: 2.1 time: 1.191391 Aug 29 05:03:00.390663 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1461/2975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:59 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1575 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:00.395786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:00.400096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] [instance: e16924c2-4d44-4b93-a184-10cde1934009] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:00.411782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:00.421785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:00.425308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:00.426798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:00.428003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:00.429920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:00.434693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:00.474570 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] HTTP exception thrown: Instance e16924c2-4d44-4b93-a184-10cde1934009 could not be found. Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Request method failure captured: Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 HTTP/1.1 Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEfqtEjZJXAOsJDj5KHVUVPkxW4Pix6mMRUZ207HyQYnXOXvdX0FScgC7L71dbabaqAwVbZw6AbxSgCULaWBEpHb7VH-p68v-qVUGaa9K_DR-GyDeDwN9MlMJHywGmz5IZklQDADwCD98eGX2_udi7gr9P6oBqkGdKOQNeZh6CgwXNg Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: d09f5bf987364fd9931c1662d1f26e8e Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestManualDisk-1361059858 Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d09f5bf987364fd9931c1662d1f26e8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d09f5bf987364fd9931c1662d1f26e8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d09f5bf987364fd9931c1662d1f26e8e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d09f5bf987364fd9931c1662d1f26e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestManualDisk-1361059858 Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: d09f5bf987364fd9931c1662d1f26e8e Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestManualDisk-1361059858 Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestManualDisk-1361059858-project Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 1bfae618b26a421f926b82d7947167c2 Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestManualDisk-1361059858-project Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance e16924c2-4d44-4b93-a184-10cde1934009 could not be found. Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'e16924c2-4d44-4b93-a184-10cde1934009'} Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e16924c2-4d44-4b93-a184-10cde1934009 could not be found. Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16924c2-4d44-4b93-a184-10cde1934009 could not be found. Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:00.476380 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:00.481264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:00.481264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:00.481264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:00.481264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:00.481264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:00.481264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16924c2-4d44-4b93-a184-10cde1934009 could not be found. Aug 29 05:03:00.481264 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:00.482117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Returning 404 to user: Instance e16924c2-4d44-4b93-a184-10cde1934009 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:00.483170 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e59d8e1-d578-41ff-b559-40d2af6e1e59 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009" status: 404 len: 111 microversion: 2.1 time: 0.091422 Aug 29 05:03:00.484656 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1462/2976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:00 2022] GET /compute/v2.1/servers/e16924c2-4d44-4b93-a184-10cde1934009 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:00.505357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:00.505357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:00.530923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:00.532727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:00.533205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:00.534157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:00.540254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:00.541006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:00.543741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:00.545376 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c855f980-9731-4129-bc3f-b83fc2a50366 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 0.938220 Aug 29 05:03:00.558886 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1515/2977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:02:59 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:00.558886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:00.558886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:00.568490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:00.569134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:00.569583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:00.570303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:00.570902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:00.571337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:00.598329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:01.158821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:01.169481 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42fbae9c-11ed-4c4b-a112-70fe76c08d6e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1574 microversion: 2.1 time: 0.683409 Aug 29 05:03:01.170824 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1463/2978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:00 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1574 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:01.176018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e92465a-da1c-4d4c-9afd-7cd58b2a2f18 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] Calling method '.version_select at 0x7f1ab9d0e0d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:01.189338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:01.200995 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-095b0509-f982-4d0a-953c-5f104e882046 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.651405 Aug 29 05:03:01.201920 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1516/2979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:00 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:01.233787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:01.234094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:01.242418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:01.243412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:01.244177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:01.248385 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e92465a-da1c-4d4c-9afd-7cd58b2a2f18 tempest-ServersTestManualDisk-1361059858 tempest-ServersTestManualDisk-1361059858-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007206608" status: 202 len: 0 microversion: 2.1 time: 0.075795 Aug 29 05:03:01.252649 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1464/2980] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 05:03:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007206608 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:01.257828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:01.258844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:01.259547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:01.339826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:01.401231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=30 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:01.477484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e30ff93-c48e-4be4-8af4-9e4c2d5cf869 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Action: 'create', calling method: .version_select at 0x7f1ab9a29dc0>, body: {"keypair": {"name": "tempest-keypair-545303368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFnWIJ+XccIoYC3wxagCeK6is41H/ZXxtBaPgJMB/TKYej9q3zLGdA10Y1zoO+7DQ1uz4+CEqGiqC/+SKd+DaJbU1uefmnvxup86zifK2AwbHSWqsSp0duwncQBZ7CCng=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:01.509132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0e30ff93-c48e-4be4-8af4-9e4c2d5cf869 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:01.512467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:01.519289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0e30ff93-c48e-4be4-8af4-9e4c2d5cf869 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for user b85872a99181455f83841b2f06daf62b and project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:01.521316 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f7ea1b3d-454c-4e0f-a131-839aa3f18cea tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1314 microversion: 2.1 time: 0.306192 Aug 29 05:03:01.530861 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1517/2981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:01 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:01.550402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38c53574-0d62-45b9-ab42-9a629dd3c5b5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:01.551096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-38c53574-0d62-45b9-ab42-9a629dd3c5b5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:01.562595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53574-0d62-45b9-ab42-9a629dd3c5b5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:01.564332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53574-0d62-45b9-ab42-9a629dd3c5b5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:01.565055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53574-0d62-45b9-ab42-9a629dd3c5b5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:01.566077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53574-0d62-45b9-ab42-9a629dd3c5b5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:01.566457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53574-0d62-45b9-ab42-9a629dd3c5b5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:01.567162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53574-0d62-45b9-ab42-9a629dd3c5b5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:01.578286 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e30ff93-c48e-4be4-8af4-9e4c2d5cf869 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.322940 Aug 29 05:03:01.579537 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1465/2982] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:03:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:01.587342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:01.588495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:01.595741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:01.596565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:01.598821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:01.599943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:01.601493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:01.602094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:01.775130 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-38c53574-0d62-45b9-ab42-9a629dd3c5b5 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.242758 Aug 29 05:03:01.775863 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1518/2983] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:03:01 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:01.781305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:01.782065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:01.793377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:01.794621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:01.795098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:01.795767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:01.796418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:01.796869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:01.978495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:01.988269 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f1920bca-693f-484e-9f6d-6ef0bd58ab3f tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1575 microversion: 2.1 time: 0.407347 Aug 29 05:03:01.989316 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1466/2984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:01 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1575 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:01.994280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-89e274a3-43bb-452c-8278-25a3d518b3f3 req-10eb4a5f-ef00-4d82-8ed1-3cbec8d2472c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18f1144e-5344-49b5-8b05-244d389b3060", "tag": "f122ba75-45f2-4c3c-9e52-9b4525ed4a3a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:02.005028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-89e274a3-43bb-452c-8278-25a3d518b3f3 req-10eb4a5f-ef00-4d82-8ed1-3cbec8d2472c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:02.005785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-89e274a3-43bb-452c-8278-25a3d518b3f3 req-10eb4a5f-ef00-4d82-8ed1-3cbec8d2472c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:02.006221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-89e274a3-43bb-452c-8278-25a3d518b3f3 req-10eb4a5f-ef00-4d82-8ed1-3cbec8d2472c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:02.017819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-89e274a3-43bb-452c-8278-25a3d518b3f3 req-10eb4a5f-ef00-4d82-8ed1-3cbec8d2472c service nova] Creating event network-changed:f122ba75-45f2-4c3c-9e52-9b4525ed4a3a for instance 18f1144e-5344-49b5-8b05-244d389b3060 on n-h1-854119-9 Aug 29 05:03:02.022856 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-89e274a3-43bb-452c-8278-25a3d518b3f3 req-10eb4a5f-ef00-4d82-8ed1-3cbec8d2472c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032171 Aug 29 05:03:02.023641 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1467/2985] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:02.028912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4af09007-d23f-4461-8344-b2ad2c463871 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Calling method '.version_select at 0x7f1ab9db1dc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.037550 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4af09007-d23f-4461-8344-b2ad2c463871 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-545303368" status: 200 len: 497 microversion: 2.1 time: 0.012538 Aug 29 05:03:02.038413 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1468/2986] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Aug 29 05:03:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-545303368 => generated 497 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:02.049444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dfcfd822-c064-4cda-b7ad-c6ca9b6a7e56 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Calling method '.version_select at 0x7f1ab9d7cd30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.070610 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dfcfd822-c064-4cda-b7ad-c6ca9b6a7e56 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545303368" status: 202 len: 0 microversion: 2.1 time: 0.024823 Aug 29 05:03:02.071291 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1469/2987] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545303368 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:02.083269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17ef9eb9-8bb1-4583-b875-399147cfc921 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Action: 'create', calling method: .version_select at 0x7f1ab956e550>, body: {"keypair": {"name": "tempest-keypair-409619985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ0ppY+yOYElWa3uqz+wMbwD8kKEzMJHxHI69Ps2QJ0vvVPC6GLs+nHwqdomi0qrH6OduO6yJZcmaUPlp4fo/6SxNBpVafGtMwnSkiDlDfKtImTivJhrCnexrU13IP0Tg=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:02.103422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-17ef9eb9-8bb1-4583-b875-399147cfc921 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:02.109883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-17ef9eb9-8bb1-4583-b875-399147cfc921 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for user b85872a99181455f83841b2f06daf62b and project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:02.140223 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17ef9eb9-8bb1-4583-b875-399147cfc921 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060751 Aug 29 05:03:02.141041 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1470/2988] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:03:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:03:02.151515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-feafadab-58d6-4bd3-934c-cf32aedcf9e5 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Calling method '.version_select at 0x7f1ab9787040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.171344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:02.181010 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6de0966d-3ed5-45d4-bfb0-55eecbb9e1a2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 0.403703 Aug 29 05:03:02.182216 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1519/2989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:01 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:02.184793 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-feafadab-58d6-4bd3-934c-cf32aedcf9e5 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409619985" status: 202 len: 0 microversion: 2.1 time: 0.037182 Aug 29 05:03:02.186471 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1471/2990] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409619985 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:02.205653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80e7d3a4-cb8a-4b77-b046-d83f3b754725 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Action: 'create', calling method: .version_select at 0x7f1ab96070d0>, body: {"keypair": {"name": "tempest-keypair-486818445", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:02.230500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-80e7d3a4-cb8a-4b77-b046-d83f3b754725 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:02.230853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.232231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:02.243137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-80e7d3a4-cb8a-4b77-b046-d83f3b754725 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for user b85872a99181455f83841b2f06daf62b and project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:02.245096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:02.245622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:02.246280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:02.247342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:02.248015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:02.248777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:02.279504 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80e7d3a4-cb8a-4b77-b046-d83f3b754725 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.079493 Aug 29 05:03:02.281112 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1520/2991] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:03:02 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:03:02.291603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-94d21341-b98c-4699-b207-842a3e0a0cc8 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Calling method '.version_select at 0x7f1abd91a940>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.312848 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-94d21341-b98c-4699-b207-842a3e0a0cc8 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486818445" status: 202 len: 0 microversion: 2.1 time: 0.025506 Aug 29 05:03:02.313487 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1521/2992] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486818445 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:02.327118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-99f7cdfc-bc60-4f1a-a61b-194bd5b0f1e1 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Action: 'create', calling method: .version_select at 0x7f1ab9270550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-933925845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJDebPNipWTpfxHKZTHM1zjDE2EyZ57v+76mtv7i9fSlgyE+jikB4opdAQ1hxBioqqTLkIJrs+22z8orR8x6RMertK9/KIpXGA8KwvvzL5woOwrCCBGsu78f72WYdENuA=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:02.348708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-99f7cdfc-bc60-4f1a-a61b-194bd5b0f1e1 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:02.354553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-99f7cdfc-bc60-4f1a-a61b-194bd5b0f1e1 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for user b85872a99181455f83841b2f06daf62b and project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:02.380206 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-99f7cdfc-bc60-4f1a-a61b-194bd5b0f1e1 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.057769 Aug 29 05:03:02.380891 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1522/2993] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:03:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:02.394795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea9d637a-d8ca-4597-b114-278f571307b5 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Action: 'create', calling method: .version_select at 0x7f1abd9135e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-857575955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMISEx/tnfOptzEC8pmLtQTEYTEZ4ZG1aLSisR53ahAwusCmcgJT1fjpV9taGvtL+Ga58WvDqtX9DxxzRd8OGClXC5OfdgHyaDDNscsXRZ5wkdFavOxhG+jGZcCCmgr+Aw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:02.411221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ea9d637a-d8ca-4597-b114-278f571307b5 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:02.416567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ea9d637a-d8ca-4597-b114-278f571307b5 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for user b85872a99181455f83841b2f06daf62b and project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:02.426429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:02.445127 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea9d637a-d8ca-4597-b114-278f571307b5 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054822 Aug 29 05:03:02.445839 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1523/2994] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:03:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:02.459668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-333a73e2-3d29-4f77-99b9-9085a1e81947 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Action: 'create', calling method: .version_select at 0x7f1abd90dd30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-164602563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWPcChkZ3BTxuQfAXArgOjBHOkUjggF4b9IhDhbrUZt7eycHJlSidnB+5XhnlvxqdQ1Tde/kLw7vfsG3aBD6/RWlq9erPhvu9UGnFc9nAZaw0ATKzZGiu92jMO3yCNnow=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:02.477033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-333a73e2-3d29-4f77-99b9-9085a1e81947 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:02.483822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-333a73e2-3d29-4f77-99b9-9085a1e81947 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Getting quotas for user b85872a99181455f83841b2f06daf62b and project a34e5f353d7d487286e967df7fc73165. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:02.510178 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-333a73e2-3d29-4f77-99b9-9085a1e81947 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054512 Aug 29 05:03:02.516596 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1524/2995] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:03:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:03:02.521928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e541ae4-a263-4761-8fec-59fa60597c25 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Calling method '.version_select at 0x7f1ab98cd670>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.525865 n-d-854119-9 devstack@n-api.service[128872]: WARNING oslo_db.sqlalchemy.utils [None req-5e541ae4-a263-4761-8fec-59fa60597c25 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 05:03:02.532010 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e541ae4-a263-4761-8fec-59fa60597c25 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.014403 Aug 29 05:03:02.540005 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1525/2996] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 05:03:02 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:02.545282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-837bbe67-2b2e-405f-9013-517ab2c754e9 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Calling method '.version_select at 0x7f1abd90de50>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.558859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:02.571090 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ad57335c-76bf-4672-a5f5-f903427c702d tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.345595 Aug 29 05:03:02.572180 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1472/2997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:02 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:02.579895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.582340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:02.593400 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-837bbe67-2b2e-405f-9013-517ab2c754e9 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-164602563" status: 202 len: 0 microversion: 2.1 time: 0.051860 Aug 29 05:03:02.593997 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1526/2998] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-164602563 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:02.596249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:02.596976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:02.600774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:02.603425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ba79fca-e0d2-4614-b30a-14308f7777d7 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Calling method '.version_select at 0x7f1abd913700>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.609291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:02.610455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:02.611137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:02.645989 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5ba79fca-e0d2-4614-b30a-14308f7777d7 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-857575955" status: 202 len: 0 microversion: 2.1 time: 0.047351 Aug 29 05:03:02.646998 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1527/2999] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-857575955 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:03:02.655656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f37d4b91-f67f-407d-ad2c-93a12fe45ff2 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] Calling method '.version_select at 0x7f1abd91a820>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:02.684617 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f37d4b91-f67f-407d-ad2c-93a12fe45ff2 tempest-KeyPairsV2TestJSON-1623725379 tempest-KeyPairsV2TestJSON-1623725379-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-933925845" status: 202 len: 0 microversion: 2.1 time: 0.032434 Aug 29 05:03:02.689390 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1528/3000] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-933925845 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:03:02.785101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-51f35cad-09cc-478e-91b1-b22ff1ad1fd4 req-8367de66-64a2-41ad-a0e1-1054953a5e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dfa6f9-babd-4bec-a4e9-95e5829e2fd5", "name": "network-vif-plugged", "status": "completed", "tag": "42615650-c176-47e5-b155-cd885ba7347b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:02.808754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-51f35cad-09cc-478e-91b1-b22ff1ad1fd4 req-8367de66-64a2-41ad-a0e1-1054953a5e52 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:02.809249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-51f35cad-09cc-478e-91b1-b22ff1ad1fd4 req-8367de66-64a2-41ad-a0e1-1054953a5e52 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:02.809677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-51f35cad-09cc-478e-91b1-b22ff1ad1fd4 req-8367de66-64a2-41ad-a0e1-1054953a5e52 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:02.837246 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-51f35cad-09cc-478e-91b1-b22ff1ad1fd4 req-8367de66-64a2-41ad-a0e1-1054953a5e52 service nova] Creating event network-vif-plugged:42615650-c176-47e5-b155-cd885ba7347b for instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 on n-h1-854119-9 Aug 29 05:03:02.862195 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-51f35cad-09cc-478e-91b1-b22ff1ad1fd4 req-8367de66-64a2-41ad-a0e1-1054953a5e52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080594 Aug 29 05:03:02.872432 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1529/3001] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:02.949486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:02.960632 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52d96959-4104-4b6f-99ec-bce2ae7e1b98 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1314 microversion: 2.1 time: 0.387381 Aug 29 05:03:02.961789 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1473/3002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:02 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:03.009581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:03.010304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:03.016741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:03.017431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:03.018044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:03.018902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:03.019527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:03.020109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:03.208100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:03.209170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:03.215751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:03.216807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:03.217393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:03.218263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:03.218891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:03.219889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:03.724839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:04.121008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:04.139456 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-190bc203-61fb-4e4a-b3b0-31f23a6881d4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1575 microversion: 2.1 time: 1.134078 Aug 29 05:03:04.142481 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1530/3003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:03 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1575 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:04.149673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:04.150503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:04.159334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:04.159904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:04.160556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:04.162152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:04.162778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:04.163371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:04.387069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:04.406911 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-607380c3-9d99-421e-bcaf-7640ea83431e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 1.201732 Aug 29 05:03:04.409058 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1474/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:03 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:04.424619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:04.425524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:04.433406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:04.434223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:04.434889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:04.435827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:04.436715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:04.437597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:04.968946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:04.978774 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bcaa6007-99d9-4a8a-b1a2-74a9bd126b1b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.833854 Aug 29 05:03:04.979365 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1531/3005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:04 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:05.004011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:05.005075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:05.012432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:05.013356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:05.013986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:05.015034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:05.015671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:05.016335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:05.217615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:05.232859 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-66055e36-4d46-4be5-99a5-fedc70d7e635 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1314 microversion: 2.1 time: 0.821576 Aug 29 05:03:05.233467 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1475/3006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:04 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:05.257289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3bb7cd0d-eac3-4628-b134-e9101a6c06fb req-0a1a5b5a-6e64-4909-8708-726828b2d6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed82919b-2f3a-428a-b8bc-020f08560164", "tag": "72eb5b7a-13b2-4f9f-ae09-5427c7542daa"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:05.279707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3bb7cd0d-eac3-4628-b134-e9101a6c06fb req-0a1a5b5a-6e64-4909-8708-726828b2d6de service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:05.280224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3bb7cd0d-eac3-4628-b134-e9101a6c06fb req-0a1a5b5a-6e64-4909-8708-726828b2d6de service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:05.281041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3bb7cd0d-eac3-4628-b134-e9101a6c06fb req-0a1a5b5a-6e64-4909-8708-726828b2d6de service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:05.304554 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3bb7cd0d-eac3-4628-b134-e9101a6c06fb req-0a1a5b5a-6e64-4909-8708-726828b2d6de service nova] Creating event network-changed:72eb5b7a-13b2-4f9f-ae09-5427c7542daa for instance ed82919b-2f3a-428a-b8bc-020f08560164 on n-h1-854119-9 Aug 29 05:03:05.313262 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3bb7cd0d-eac3-4628-b134-e9101a6c06fb req-0a1a5b5a-6e64-4909-8708-726828b2d6de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062503 Aug 29 05:03:05.317282 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1476/3007] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:05.329065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:05.330504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:05.339673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:05.340997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:05.341692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:05.343140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:05.343823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:05.344518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:05.673835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:05.688851 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7bce653f-bdae-474c-99d3-5aaa8fe86fdc tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1574 microversion: 2.1 time: 0.691788 Aug 29 05:03:05.689459 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1532/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:04 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1574 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:05.701020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:05.701626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:05.723822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:05.724393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:05.724834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:05.725553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:05.726003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:05.732562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:06.547834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:06.559998 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30c57837-4d4c-4d1f-82d9-853bbbcd1cda tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1573 microversion: 2.1 time: 1.235942 Aug 29 05:03:06.567402 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1477/3009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:05 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1573 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:06.576369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:06.576369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:06.589715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:06.592311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:06.592935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:06.595947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:06.597945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:06.601555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:06.922554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:06.972873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a70571b-8565-469a-8540-43e4c512e35e tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 1.279932 Aug 29 05:03:06.984826 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1533/3010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:05 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:06.995166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:06.995993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:07.003950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:07.004761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:07.005524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:07.006424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:07.007032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:07.007610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:07.388296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:07.400717 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c1e5df7e-07c5-4cfa-98d7-aad74e251347 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.831666 Aug 29 05:03:07.413624 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1478/3011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:06 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:07.424354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-546558787"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:07.439865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:07.459198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:07.460390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:07.462237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:07.463393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:07.465703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:07.466503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:07.630801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:07.644164 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18f04e03-3659-4104-b008-103809ecf65e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1502 microversion: 2.1 time: 0.658059 Aug 29 05:03:07.645645 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1534/3012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:06 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1502 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:07.666877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-023332d9-8d6b-4781-b3a8-ee7a8263f540 req-ce55ce8f-23b2-492d-b584-ccec4145b104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9017bb8-cc8e-46d0-86ba-763c9fe82cd2", "name": "network-vif-plugged", "status": "completed", "tag": "4aeae9f9-1065-4f31-ac20-db276ec6f411"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:07.698551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-023332d9-8d6b-4781-b3a8-ee7a8263f540 req-ce55ce8f-23b2-492d-b584-ccec4145b104 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:07.699033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-023332d9-8d6b-4781-b3a8-ee7a8263f540 req-ce55ce8f-23b2-492d-b584-ccec4145b104 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:07.699458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-023332d9-8d6b-4781-b3a8-ee7a8263f540 req-ce55ce8f-23b2-492d-b584-ccec4145b104 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:07.734607 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-023332d9-8d6b-4781-b3a8-ee7a8263f540 req-ce55ce8f-23b2-492d-b584-ccec4145b104 service nova] Creating event network-vif-plugged:4aeae9f9-1065-4f31-ac20-db276ec6f411 for instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 on n-h1-854119-9 Aug 29 05:03:07.742164 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-023332d9-8d6b-4781-b3a8-ee7a8263f540 req-ce55ce8f-23b2-492d-b584-ccec4145b104 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095158 Aug 29 05:03:07.743428 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1535/3013] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:07.764228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e90abdf7-8a04-43e6-8eaa-165509539a71 req-ff57b08f-8d5a-47fd-ad37-c8749c9dc588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f8d726-cea8-47a1-8b08-3c6ddae3f11f", "tag": "26abd5ae-c796-4dee-bda3-b0b09b900eed"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:07.780879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e90abdf7-8a04-43e6-8eaa-165509539a71 req-ff57b08f-8d5a-47fd-ad37-c8749c9dc588 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:07.785588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e90abdf7-8a04-43e6-8eaa-165509539a71 req-ff57b08f-8d5a-47fd-ad37-c8749c9dc588 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:07.786222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e90abdf7-8a04-43e6-8eaa-165509539a71 req-ff57b08f-8d5a-47fd-ad37-c8749c9dc588 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:07.801265 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e90abdf7-8a04-43e6-8eaa-165509539a71 req-ff57b08f-8d5a-47fd-ad37-c8749c9dc588 service nova] Creating event network-changed:26abd5ae-c796-4dee-bda3-b0b09b900eed for instance d8f8d726-cea8-47a1-8b08-3c6ddae3f11f on n-h1-854119-9 Aug 29 05:03:07.810626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e90abdf7-8a04-43e6-8eaa-165509539a71 req-ff57b08f-8d5a-47fd-ad37-c8749c9dc588 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065354 Aug 29 05:03:07.811883 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1536/3014] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:07.817476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:07.818369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:07.826561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:07.827043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:07.827798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:07.828517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:07.828965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:07.829560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:07.857312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lazy-loading 'flavor' on Instance uuid 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:03:08.017625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2ffa1a4-2970-4646-8f29-1e97601d2306 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "POST /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.203966 Aug 29 05:03:08.019534 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1537/3015] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:03:07 2022] POST /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:08.039335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:08.049190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:08.060769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:08.062477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:08.064185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:08.066313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:08.067255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:08.069306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:08.399809 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.network.security_group_api [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Adding security group 26e803ce-0093-445e-ab96-56a85f0a963b to port c113b73e-1d01-4a2a-9d45-437549ac17fe Aug 29 05:03:08.684419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:08.692341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47a23006-b533-48a2-a680-c429aeeb80f2 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 0.671294 Aug 29 05:03:08.700286 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1538/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:08 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:08.709736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:08.710376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:08.723249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:08.723735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:08.724409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:08.725288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:08.725887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:08.726459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:09.455368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:09.469483 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-48e01ed2-177d-4f1b-9547-d5584692a228 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1510 microversion: 2.1 time: 0.774388 Aug 29 05:03:09.471095 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1539/3017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:08 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1510 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:09.478151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:09.479335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:09.488078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:09.488807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:09.489388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:09.490289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:09.490998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:09.491563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:09.692355 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-19528a6b-ccdd-4544-8479-ea9a603f0e9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31/action" status: 202 len: 0 microversion: 2.1 time: 2.277502 Aug 29 05:03:09.693186 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1479/3018] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:03:07 2022] POST /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31/action => generated 0 bytes in 2279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:09.701820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ee63faa-8381-4ff5-a587-40c1c424697b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab9d0e4c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:10.011522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:10.025609 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5c91450-dc2a-429b-8984-277e1d41a913 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.552986 Aug 29 05:03:10.027005 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1540/3019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:09 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:10.033647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:10.034717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:10.048586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:10.049548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:10.050355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:10.052025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:10.054231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:10.054958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:10.382805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG neutronclient.v2_0.client [None req-1ee63faa-8381-4ff5-a587-40c1c424697b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 26e803ce-0093-445e-ab96-56a85f0a963b in use.", "detail": ""}} {{(pid=128871) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:03:10.384280 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-1ee63faa-8381-4ff5-a587-40c1c424697b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security Group 26e803ce-0093-445e-ab96-56a85f0a963b in use. Aug 29 05:03:10.384280 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-ddac5244-1a58-4739-8ed0-a86b2902845d'] Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ee63faa-8381-4ff5-a587-40c1c424697b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/os-security-groups/26e803ce-0093-445e-ab96-56a85f0a963b HTTP/1.1 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: exception: Security Group 26e803ce-0093-445e-ab96-56a85f0a963b in use. Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-ddac5244-1a58-4739-8ed0-a86b2902845d'] Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '26e803ce-0093-445e-ab96-56a85f0a963b'} Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:03:10.386631 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 26e803ce-0093-445e-ab96-56a85f0a963b in use. Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ddac5244-1a58-4739-8ed0-a86b2902845d'] Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 26e803ce-0093-445e-ab96-56a85f0a963b in use. Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ddac5244-1a58-4739-8ed0-a86b2902845d'] Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 26e803ce-0093-445e-ab96-56a85f0a963b in use. Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ddac5244-1a58-4739-8ed0-a86b2902845d'] Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 26e803ce-0093-445e-ab96-56a85f0a963b in use. Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ddac5244-1a58-4739-8ed0-a86b2902845d'] Aug 29 05:03:10.390531 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:10.398836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ee63faa-8381-4ff5-a587-40c1c424697b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 400 to user: Security Group 26e803ce-0093-445e-ab96-56a85f0a963b in use. Aug 29 05:03:10.398836 n-d-854119-9 devstack@n-api.service[128871]: Neutron server returns request_ids: ['req-ddac5244-1a58-4739-8ed0-a86b2902845d'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:10.400044 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ee63faa-8381-4ff5-a587-40c1c424697b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/26e803ce-0093-445e-ab96-56a85f0a963b" status: 400 len: 185 microversion: 2.1 time: 0.702699 Aug 29 05:03:10.400909 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1480/3020] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:09 2022] DELETE /compute/v2.1/os-security-groups/26e803ce-0093-445e-ab96-56a85f0a963b => generated 185 bytes in 704 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 05:03:10.421152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:10.437375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e112bfe7-1e42-4ad9-a72f-25cc0806119a req-b674f537-320e-4ed3-8f47-0a89958b5ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa97c4a3-6876-4660-abff-28eeabe14c31", "tag": "c113b73e-1d01-4a2a-9d45-437549ac17fe"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:10.441927 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21a5d288-2d4c-414c-b80f-342582295817 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 0.407518 Aug 29 05:03:10.446666 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1541/3021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:10 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:10.468890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:10.474389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:10.487494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e112bfe7-1e42-4ad9-a72f-25cc0806119a req-b674f537-320e-4ed3-8f47-0a89958b5ec9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:10.487994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e112bfe7-1e42-4ad9-a72f-25cc0806119a req-b674f537-320e-4ed3-8f47-0a89958b5ec9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:10.492915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e112bfe7-1e42-4ad9-a72f-25cc0806119a req-b674f537-320e-4ed3-8f47-0a89958b5ec9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:10.495451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:10.495951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:10.496408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:10.497371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:10.497974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:10.498548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:10.511867 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e112bfe7-1e42-4ad9-a72f-25cc0806119a req-b674f537-320e-4ed3-8f47-0a89958b5ec9 service nova] Creating event network-changed:c113b73e-1d01-4a2a-9d45-437549ac17fe for instance fa97c4a3-6876-4660-abff-28eeabe14c31 on n-h1-854119-9 Aug 29 05:03:10.529417 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e112bfe7-1e42-4ad9-a72f-25cc0806119a req-b674f537-320e-4ed3-8f47-0a89958b5ec9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126845 Aug 29 05:03:10.532366 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1481/3022] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:10.540516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:03:10.546244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:10.549072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:10.549449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:10.568491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:10.569530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:10.570135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:10.571040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:10.571654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:10.572286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:10.710485 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7131e80d-f487-4c8e-b935-6ab020d17f5a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 204 len: 0 microversion: 2.1 time: 0.259767 Aug 29 05:03:10.711729 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1542/3023] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:10 2022] DELETE /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:03:10.721681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:10.722793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:10.729837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:10.730536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:10.731122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:10.732008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:10.732650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:10.733226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:11.169988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:11.182500 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69f3959f-b567-4a71-86d1-c7a5edd85986 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1510 microversion: 2.1 time: 0.648574 Aug 29 05:03:11.184891 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1482/3024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:10 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1510 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:11.212673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:11.215283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:11.228913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:11.231329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:11.231813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:11.232582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:11.233051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:11.233486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:11.409042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:11.419909 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-783d983b-4655-4649-8ae3-170bafa6f6ca tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1647 microversion: 2.1 time: 0.702450 Aug 29 05:03:11.421172 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1543/3025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:10 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1647 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:03:11.471555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:11.472955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:11.483117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:11.484214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:11.486298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:11.487421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:11.488029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:11.488641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:11.687564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:11.701446 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5a0b7fd4-cd90-4af8-9774-aaa86492a94c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.495645 Aug 29 05:03:11.702679 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1483/3026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:11 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:11.783709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:11.812155 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de25a3e0-fa3c-43cb-8064-035d81e7666f tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 0.346605 Aug 29 05:03:11.824650 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1544/3027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:11 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:12.205894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:12.206501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:12.208764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:12.223794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:12.224387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:12.225033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:12.225740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:12.232049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:12.232049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:12.446287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:12.447254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:12.466003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:12.467857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:12.469062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:12.473783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:12.474506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:12.475216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:12.509896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=16 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:12.780420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:12.794999 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e2786cf0-ecef-4be3-8851-cc4cf5b2361b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1510 microversion: 2.1 time: 0.592774 Aug 29 05:03:12.811714 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1484/3028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:12 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1510 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:12.813603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:12.814458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:12.837178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:12.841029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:12.843454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:12.844598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:12.846601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:12.848954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:13.478435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:13.505440 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4503f5a6-768b-41d8-957a-172e09817920 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1647 microversion: 2.1 time: 1.054565 Aug 29 05:03:13.507264 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1545/3029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:12 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1647 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:13.516686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:13.522169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:13.543185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:13.551192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:13.552557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:13.557050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:13.559367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:13.560042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:13.668565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:13.682228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f9a93005-0114-4bca-b8dc-86c85243aa0a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.880255 Aug 29 05:03:13.682817 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1485/3030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:12 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:13.822175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:13.823002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:13.839079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:13.839829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:13.840477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:13.842003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:13.846739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:13.847729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:13.888724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:15.171180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:15.194756 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c8a7b296-f046-4f1b-ac72-817f171802f3 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1315 microversion: 2.1 time: 1.678106 Aug 29 05:03:15.200234 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1546/3031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:13 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1315 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:15.229744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:15.231531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:15.265798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:15.266421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:15.266880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:15.267632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:15.268194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:15.270156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:15.390086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:15.408857 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3ac79623-a308-45ab-a180-edee85daab63 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1493 microversion: 2.1 time: 1.590198 Aug 29 05:03:15.422910 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1486/3032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:13 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1493 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:15.435059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:15.436003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:15.458089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:15.461323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:15.463114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:15.464861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:15.465672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:15.466219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:15.786396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:15.795963 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78b08d7c-5457-48e8-9bc6-4317ecfc040a tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1647 microversion: 2.1 time: 0.593483 Aug 29 05:03:15.796596 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1547/3033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:15 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1647 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:15.887759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:15.901462 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-70e7222c-c644-4248-8189-f1c49e650641 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.476394 Aug 29 05:03:15.902282 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1487/3034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:15 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:15.913075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-76db855a-577d-400e-9934-0dece662f06d req-bcbe44d1-61a8-4f56-925e-e8d7b4da8a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa97c4a3-6876-4660-abff-28eeabe14c31", "name": "network-vif-unplugged", "status": "completed", "tag": "c113b73e-1d01-4a2a-9d45-437549ac17fe"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:15.924152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-76db855a-577d-400e-9934-0dece662f06d req-bcbe44d1-61a8-4f56-925e-e8d7b4da8a08 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:15.924864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-76db855a-577d-400e-9934-0dece662f06d req-bcbe44d1-61a8-4f56-925e-e8d7b4da8a08 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:15.925238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-76db855a-577d-400e-9934-0dece662f06d req-bcbe44d1-61a8-4f56-925e-e8d7b4da8a08 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:15.942639 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-76db855a-577d-400e-9934-0dece662f06d req-bcbe44d1-61a8-4f56-925e-e8d7b4da8a08 service nova] Creating event network-vif-unplugged:c113b73e-1d01-4a2a-9d45-437549ac17fe for instance fa97c4a3-6876-4660-abff-28eeabe14c31 on n-h1-854119-9 Aug 29 05:03:15.950710 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-76db855a-577d-400e-9934-0dece662f06d req-bcbe44d1-61a8-4f56-925e-e8d7b4da8a08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045074 Aug 29 05:03:15.951962 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1488/3035] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:15.960987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:15.961970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:15.976984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:15.977551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:15.978208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:15.979001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:15.979681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:15.980291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:16.029291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:03:16.173848 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9bb3f9da-2293-4658-bbd7-e2ff57894c95 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 204 len: 0 microversion: 2.1 time: 0.219745 Aug 29 05:03:16.174693 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1489/3036] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:15 2022] DELETE /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:03:16.190419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:16.191897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:16.207431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:16.207947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:16.208480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:16.209206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:16.216699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:16.217174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:16.306703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b15549f4-3dcd-4750-aab8-1e2c93e6eb7d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Action: 'create', calling method: .version_select at 0x7f1ab9799670>, body: {"keypair": {"name": "tempest-keypair-769570994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/mwo411QQXbqk6/ZanOOLbNPgHX8ns0uXJ4lPGoc4Ym1LESWb3Hi5ppZ9aKDPcjEuWH/L6Dk4k90vP6RW7C/03p7LdyR0dOwr536QRWqnrDdmyJeYBBx+QX+cDksaPQA=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:16.333781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b15549f4-3dcd-4750-aab8-1e2c93e6eb7d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Getting quotas for project de791761bfd5463a82ecf6dc0b598a2e. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:16.340500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b15549f4-3dcd-4750-aab8-1e2c93e6eb7d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Getting quotas for user 95652f6c355c41e28e3e6f635a6f4868 and project de791761bfd5463a82ecf6dc0b598a2e. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:16.376382 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b15549f4-3dcd-4750-aab8-1e2c93e6eb7d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.575027 Aug 29 05:03:16.377566 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1548/3037] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:03:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:16.388508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:16.392624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:16.407366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:16.407936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:16.410462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:16.411298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:16.413103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:16.415313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:16.836827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:16.837040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:16.845773 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73476c69-fdca-4eb1-8d83-75386b09c806 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1503 microversion: 2.1 time: 0.467038 Aug 29 05:03:16.846361 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1549/3038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:16 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1503 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:16.855015 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d6b51b39-0282-4ce0-b8f9-01a356cc91fd tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1499 microversion: 2.1 time: 0.671285 Aug 29 05:03:16.865360 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1490/3039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:16 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1499 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:16.866141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a2cbd449-8de2-442c-a7a0-c1f4aa6f4bd7 req-ab3fd771-8bdb-4611-861b-fdc10fd20f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa97c4a3-6876-4660-abff-28eeabe14c31", "name": "network-vif-deleted", "tag": "c113b73e-1d01-4a2a-9d45-437549ac17fe"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:16.875589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:16.883835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:16.889804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a2cbd449-8de2-442c-a7a0-c1f4aa6f4bd7 req-ab3fd771-8bdb-4611-861b-fdc10fd20f24 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:16.903882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a2cbd449-8de2-442c-a7a0-c1f4aa6f4bd7 req-ab3fd771-8bdb-4611-861b-fdc10fd20f24 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:16.904394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a2cbd449-8de2-442c-a7a0-c1f4aa6f4bd7 req-ab3fd771-8bdb-4611-861b-fdc10fd20f24 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:16.914896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:16.917717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:16.921269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:16.921581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:16.922154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:16.922741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:16.942531 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a2cbd449-8de2-442c-a7a0-c1f4aa6f4bd7 req-ab3fd771-8bdb-4611-861b-fdc10fd20f24 service nova] Creating event network-vif-deleted:c113b73e-1d01-4a2a-9d45-437549ac17fe for instance fa97c4a3-6876-4660-abff-28eeabe14c31 on n-h1-854119-9 Aug 29 05:03:16.958952 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a2cbd449-8de2-442c-a7a0-c1f4aa6f4bd7 req-ab3fd771-8bdb-4611-861b-fdc10fd20f24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107657 Aug 29 05:03:16.960396 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1550/3040] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:16.968721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:16.969676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:16.977675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:16.978658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:16.979283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:16.980337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:16.981122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:16.982003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:17.017470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:03:17.073986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:17.099128 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54e663c5-9155-4c75-b5ff-6f5022a39923 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1468 microversion: 2.1 time: 0.232179 Aug 29 05:03:17.114925 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1491/3041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:16 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:17.145352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:17.146375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:17.165394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:17.167564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:17.168059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:17.169928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:17.171927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:17.172516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:17.227720 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee81e8f5-c40e-420d-981d-a4fca558c1de tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 204 len: 0 microversion: 2.1 time: 0.265487 Aug 29 05:03:17.228369 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1551/3042] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:16 2022] DELETE /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:03:17.245732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:17.247091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:17.256887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:17.257684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:17.258320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:17.259194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:17.259797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:17.260448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:17.557514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:17.569075 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e513d54-9072-40ba-9099-0cd7a040e199 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.446448 Aug 29 05:03:17.570057 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1492/3043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:17 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:17.661262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:17.672209 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0a127207-abc8-45f3-8409-8d7e11ac27f4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1509 microversion: 2.1 time: 0.439333 Aug 29 05:03:17.672823 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1552/3044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:17 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1509 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:17.877160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:17.878432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:17.884723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:17.885428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:17.886015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:17.886866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:17.887498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:17.888074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:17.994691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e2ac0d24-5826-40d6-bff2-3bceadb91eb3 req-fbdb1bf5-502e-4856-8af7-ef9dee0607b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18f1144e-5344-49b5-8b05-244d389b3060", "name": "network-vif-plugged", "status": "completed", "tag": "f122ba75-45f2-4c3c-9e52-9b4525ed4a3a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:18.017828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:18.029993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e2ac0d24-5826-40d6-bff2-3bceadb91eb3 req-fbdb1bf5-502e-4856-8af7-ef9dee0607b8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:18.031106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e2ac0d24-5826-40d6-bff2-3bceadb91eb3 req-fbdb1bf5-502e-4856-8af7-ef9dee0607b8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:18.032001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e2ac0d24-5826-40d6-bff2-3bceadb91eb3 req-fbdb1bf5-502e-4856-8af7-ef9dee0607b8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:18.062159 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e2ac0d24-5826-40d6-bff2-3bceadb91eb3 req-fbdb1bf5-502e-4856-8af7-ef9dee0607b8 service nova] Creating event network-vif-plugged:f122ba75-45f2-4c3c-9e52-9b4525ed4a3a for instance 18f1144e-5344-49b5-8b05-244d389b3060 on n-h1-854119-9 Aug 29 05:03:18.070171 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e2ac0d24-5826-40d6-bff2-3bceadb91eb3 req-fbdb1bf5-502e-4856-8af7-ef9dee0607b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079079 Aug 29 05:03:18.071429 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1553/3045] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:18.104318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:18.117869 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d6ec421a-dd2b-4aae-b4bb-84aeea81d22d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1499 microversion: 2.1 time: 0.243880 Aug 29 05:03:18.119490 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1493/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:17 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1499 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:18.144496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:18.145344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:18.167627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:18.168364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:18.169221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:18.170554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:18.171408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:18.172004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:18.228162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:18.228920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:18.229917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:18.230535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lazy-loading 'fault' on Instance uuid fa97c4a3-6876-4660-abff-28eeabe14c31 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:03:18.306684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:18.314985 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9681392f-6631-4929-b533-f78842f01915 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1306 microversion: 2.1 time: 0.180360 Aug 29 05:03:18.326348 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1554/3047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:18 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:18.591621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:18.592951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:18.606093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:18.607039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:18.607622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:18.609283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:18.610171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:18.610689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:18.693535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:18.694439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:18.706916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:18.708640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:18.709283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:18.710014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:18.712619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:18.713963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:18.948331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:18.959301 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b4b3ebc-878c-4cff-af66-a70c1d372e3f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.372803 Aug 29 05:03:18.964071 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1494/3048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:18 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:19.036359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:19.046945 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ddc49852-c400-4163-b276-49b92801d0d4 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1509 microversion: 2.1 time: 0.357208 Aug 29 05:03:19.060149 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1555/3049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:18 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:19.158472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:19.161093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:19.175900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:19.176435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:19.176918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:19.183035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:19.183638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:19.186419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:19.336801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "0c38c485-7059-40ae-b523-ebb5dc39ad0a"}], "security_groups": [{"name": "tempest-securitygroup--1532162832"}], "key_name": "tempest-keypair-769570994", "user_data": "}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:19.496841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:19.508703 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a90ac121-f0c7-43f5-a96b-73db2edcc69e tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1499 microversion: 2.1 time: 0.367049 Aug 29 05:03:19.509610 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1495/3050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:19 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1499 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:19.520680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:19.522196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:19.528012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] validate_networks() for [('0c38c485-7059-40ae-b523-ebb5dc39ad0a', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:03:19.529793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:19.530493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:19.531238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:19.532170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:19.532773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:19.533596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:19.605780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:19.609660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:19.610163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:19.610701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:19.611631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lazy-loading 'fault' on Instance uuid fa97c4a3-6876-4660-abff-28eeabe14c31 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:03:19.674833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:19.684849 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-483b8820-6da3-498a-8b3d-cc3587d3ef90 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 200 len: 1306 microversion: 2.1 time: 0.173194 Aug 29 05:03:19.701448 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1496/3051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:19 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 1306 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:19.987020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:19.988433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:19.998698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:20.005493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:20.007644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:20.010062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:20.014272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:20.015015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:20.798919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:20.810611 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e1b1fc7e-74e1-49be-be6a-ede7b8a172f0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1319 microversion: 2.1 time: 0.827845 Aug 29 05:03:20.813849 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1497/3052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:19 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1319 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:20.850882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:20.852780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:20.887642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:20.891936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:20.892655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:20.893621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:20.898525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:20.899825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:21.652717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:03:21.653887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:03:21.654531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:03:21.655101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:03:21.655670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:03:21.674101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:21.675404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:21.678396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:21.679599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:21.680662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:21.683501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:21.733185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Getting quotas for project de791761bfd5463a82ecf6dc0b598a2e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:21.752332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Getting quotas for user 95652f6c355c41e28e3e6f635a6f4868 and project de791761bfd5463a82ecf6dc0b598a2e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:21.782093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:03:21.787046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:03:21.898804 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d5ac8b3-dc5a-4d49-a3fc-a52926d9a398 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.569115 Aug 29 05:03:21.909269 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1556/3053] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:03:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 2580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:03:21.923377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:21.928500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:21.941678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:21.943855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:21.944923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:21.946359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:21.946969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:21.947538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:22.379821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:22.412788 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-952dde94-50a5-4894-aeb9-dd2893ab6825 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1509 microversion: 2.1 time: 1.578737 Aug 29 05:03:22.413829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1498/3054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:20 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1509 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:22.442159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:22.447788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:22.468165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:22.468778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:22.469378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:22.470406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:22.471117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:22.472602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:22.508236 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 HTTP/1.1 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'fa97c4a3-6876-4660-abff-28eeabe14c31'} Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:22.514146 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:22.518462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:22.518462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:22.518462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:22.518462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:22.518462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:22.518462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:22.518462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:22.520255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:22.521597 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8b28a58d-4932-431b-ac31-530f4ffda6e9 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 404 len: 111 microversion: 2.1 time: 0.102286 Aug 29 05:03:22.526679 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1499/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:22 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:22.532410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e69d6cd2-3018-4876-86e3-1bd782ff75b2 req-0504f0b5-627a-44e2-8653-0df8570fe1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f8d726-cea8-47a1-8b08-3c6ddae3f11f", "name": "network-vif-plugged", "status": "completed", "tag": "26abd5ae-c796-4dee-bda3-b0b09b900eed"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:22.545308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e69d6cd2-3018-4876-86e3-1bd782ff75b2 req-0504f0b5-627a-44e2-8653-0df8570fe1c8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:22.546076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e69d6cd2-3018-4876-86e3-1bd782ff75b2 req-0504f0b5-627a-44e2-8653-0df8570fe1c8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:22.548027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e69d6cd2-3018-4876-86e3-1bd782ff75b2 req-0504f0b5-627a-44e2-8653-0df8570fe1c8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:22.581619 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e69d6cd2-3018-4876-86e3-1bd782ff75b2 req-0504f0b5-627a-44e2-8653-0df8570fe1c8 service nova] Creating event network-vif-plugged:26abd5ae-c796-4dee-bda3-b0b09b900eed for instance d8f8d726-cea8-47a1-8b08-3c6ddae3f11f on n-h1-854119-9 Aug 29 05:03:22.592453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e69d6cd2-3018-4876-86e3-1bd782ff75b2 req-0504f0b5-627a-44e2-8653-0df8570fe1c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064190 Aug 29 05:03:22.593581 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1500/3056] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:22.598845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:22.600624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:22.608375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:22.609264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:22.610234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:22.611511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:22.612102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:22.612994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:22.942107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:22.967764 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9edae868-942a-4ac8-9b2d-c3999a4b68f6 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1499 microversion: 2.1 time: 1.057016 Aug 29 05:03:22.984358 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1557/3057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:21 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1499 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:23.001819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:23.008657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:23.024992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:23.025779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:23.026364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:23.027418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:23.027862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:23.028438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:23.553852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:23.556596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:23.575257 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a0cf836-9208-468f-96ce-40ae187531ab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1221 microversion: 2.1 time: 0.588261 Aug 29 05:03:23.577958 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1558/3058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:22 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1221 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:23.588781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dd236e99-2e94-4e34-bd51-e22cd041dacc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab9270550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:23.729661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:23.741971 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa00f1a6-b12a-4683-bc77-028c7e0a3f2a tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 200 len: 1507 microversion: 2.1 time: 1.147022 Aug 29 05:03:23.744827 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1501/3059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:22 2022] GET /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 1507 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:23.763157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:23.764341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:23.771095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:23.772051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:23.772720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:23.773668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:23.774524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:23.775100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:24.620147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f815ab4ebda14e749e67e67ca38f627f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472505d0d1284ec7aab1199f2d9b9b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:24.632078 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23f920dd-c6d7-448e-b4e9-6959df3db6d7 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 200 len: 1467 microversion: 2.1 time: 0.884701 Aug 29 05:03:24.645392 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1502/3060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:23 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 1467 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:24.654555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:24.655942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: d8f8d726-cea8-47a1-8b08-3c6ddae3f11f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:24.663036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:24.663973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:24.664722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:24.666302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:24.666922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:24.667509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:24.682480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:25.759164 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dd236e99-2e94-4e34-bd51-e22cd041dacc tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b7f3273b-1f8d-4ef8-a390-e123eb9c9b76" status: 202 len: 0 microversion: 2.1 time: 2.176931 Aug 29 05:03:25.760805 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1559/3061] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:23 2022] DELETE /compute/v2.1/os-security-groups/b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 => generated 0 bytes in 2182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:25.766982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0cf4cf3f-4408-45e2-b069-f0ddc84c9eb7 req-449bca8b-cb1b-4872-900d-07ce09b75374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9017bb8-cc8e-46d0-86ba-763c9fe82cd2", "name": "network-vif-deleted", "tag": "4aeae9f9-1065-4f31-ac20-db276ec6f411"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:25.780851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0cf4cf3f-4408-45e2-b069-f0ddc84c9eb7 req-449bca8b-cb1b-4872-900d-07ce09b75374 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:25.781720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0cf4cf3f-4408-45e2-b069-f0ddc84c9eb7 req-449bca8b-cb1b-4872-900d-07ce09b75374 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:25.782409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0cf4cf3f-4408-45e2-b069-f0ddc84c9eb7 req-449bca8b-cb1b-4872-900d-07ce09b75374 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:25.801460 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0cf4cf3f-4408-45e2-b069-f0ddc84c9eb7 req-449bca8b-cb1b-4872-900d-07ce09b75374 service nova] Creating event network-vif-deleted:4aeae9f9-1065-4f31-ac20-db276ec6f411 for instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 on n-h1-854119-9 Aug 29 05:03:25.809482 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0cf4cf3f-4408-45e2-b069-f0ddc84c9eb7 req-449bca8b-cb1b-4872-900d-07ce09b75374 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046611 Aug 29 05:03:25.810814 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1560/3062] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:25.819454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:25.820339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:25.829170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:25.830023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:25.831409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:25.833699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:25.834401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:25.835073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:25.884835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:25.900941 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de3e2152-e5d2-4b34-909f-8e622faef321 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f8d726-cea8-47a1-8b08-3c6ddae3f11f" status: 200 len: 1319 microversion: 2.1 time: 1.247964 Aug 29 05:03:25.901407 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1503/3063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:24 2022] GET /compute/v2.1/servers/d8f8d726-cea8-47a1-8b08-3c6ddae3f11f => generated 1319 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:25.906346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:25.908823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:25.916830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:25.917714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:25.918356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:25.919616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lazy-loading 'fault' on Instance uuid 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:03:25.922573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:25.922959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:25.923475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:25.924111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:25.934342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:25.934824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.079892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3aaab47eb243c6bf9a0b2e512e7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8dbc7ce397480d8d31b963dac9688f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:26.089424 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5cccf914-9788-4c7b-9ce3-d3a0c96b934b tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 200 len: 1304 microversion: 2.1 time: 0.277163 Aug 29 05:03:26.090013 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1561/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:25 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 1304 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:26.099840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:26.105173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:26.112434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.113180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.113859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.114845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.115624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.116318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.126996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:26.137640 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e78c197c-0851-471d-9d9f-671efb29c6d8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1283 microversion: 2.1 time: 0.234857 Aug 29 05:03:26.138593 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1504/3065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:25 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1283 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:26.145880 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] HTTP exception thrown: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Request method failure captured: Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 HTTP/1.1 Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEhtvm12ZKXnV93XAa1qRlwhKYhel3A65Sut9R1y3Yv-iw1iqLYQuGrPP11h_KJtY2tdx_y4GygcxN20o5pyBf6ASkFH7p182OTww_DlWGUbW9rtjLFiKaXw7pXt9Fjr7Bk1mKDh7Ww9tu5TIAaOOUrefBEvTW9YgbH-1zkxICmTNqI Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_472505d0d1284ec7aab1199f2d9b9b0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f815ab4ebda14e749e67e67ca38f627f Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'd9017bb8-cc8e-46d0-86ba-763c9fe82cd2'} Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.148403 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.152381 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.152381 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.152381 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.152381 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:26.152381 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:26.152381 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.152381 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.152381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Returning 404 to user: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:26.152381 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eef2b844-fa3d-47dd-aa47-8efee84d3f42 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 404 len: 111 microversion: 2.1 time: 0.054018 Aug 29 05:03:26.154651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3714f688-6f4f-4029-8e65-4fc957534f9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab9ba5a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:26.156301 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1562/3066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:26 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:26.163053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1210848357", "metadata": {"image_type": "test"}}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:26.174870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:26.182263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.183072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.183715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.184634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.185273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.185945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.212193 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] HTTP exception thrown: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Request method failure captured: Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2/action HTTP/1.1 Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 112 Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEhtvm12ZKXnV93XAa1qRlwhKYhel3A65Sut9R1y3Yv-iw1iqLYQuGrPP11h_KJtY2tdx_y4GygcxN20o5pyBf6ASkFH7p182OTww_DlWGUbW9rtjLFiKaXw7pXt9Fjr7Bk1mKDh7Ww9tu5TIAaOOUrefBEvTW9YgbH-1zkxICmTNqI Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_472505d0d1284ec7aab1199f2d9b9b0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f815ab4ebda14e749e67e67ca38f627f Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1210848357", "metadata": {"image_type": "test"}}} Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'd9017bb8-cc8e-46d0-86ba-763c9fe82cd2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1210848357', 'metadata': {'image_type': 'test'}}}} Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 05:03:26.214185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.218244 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.221099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Returning 404 to user: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:26.222366 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a3ed4a58-2ee1-473b-a504-611c53a25ab9 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "POST /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2/action" status: 404 len: 111 microversion: 2.1 time: 0.064764 Aug 29 05:03:26.223226 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1563/3067] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Aug 29 05:03:26 2022] POST /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:26.242604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5b3d81e-37dc-49aa-b6cf-57946596b705 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-440814822", "metadata": {"image_type": "test"}}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:26.245346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a5b3d81e-37dc-49aa-b6cf-57946596b705 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Failed to fetch instance by id tempest-invalid-2041167304 {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 05:03:26.246348 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a5b3d81e-37dc-49aa-b6cf-57946596b705 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] HTTP exception thrown: Instance tempest-invalid-2041167304 could not be found. Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5b3d81e-37dc-49aa-b6cf-57946596b705 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Request method failure captured: Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/tempest-invalid-2041167304/action HTTP/1.1 Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 111 Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEhtvm12ZKXnV93XAa1qRlwhKYhel3A65Sut9R1y3Yv-iw1iqLYQuGrPP11h_KJtY2tdx_y4GygcxN20o5pyBf6ASkFH7p182OTww_DlWGUbW9rtjLFiKaXw7pXt9Fjr7Bk1mKDh7Ww9tu5TIAaOOUrefBEvTW9YgbH-1zkxICmTNqI Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_472505d0d1284ec7aab1199f2d9b9b0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f815ab4ebda14e749e67e67ca38f627f Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-440814822", "metadata": {"image_type": "test"}}} Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance tempest-invalid-2041167304 could not be found. Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'tempest-invalid-2041167304', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-440814822', 'metadata': {'image_type': 'test'}}}} Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2041167304 could not be found. Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:26.248114 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2041167304 could not be found. Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2041167304 could not be found. Aug 29 05:03:26.252736 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.253493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5b3d81e-37dc-49aa-b6cf-57946596b705 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Returning 404 to user: Instance tempest-invalid-2041167304 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:26.254436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5b3d81e-37dc-49aa-b6cf-57946596b705 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-2041167304/action" status: 404 len: 101 microversion: 2.1 time: 0.020348 Aug 29 05:03:26.255498 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1564/3068] 10.222.0.20 () {60 vars in 1249 bytes} [Mon Aug 29 05:03:26 2022] POST /compute/v2.1/servers/tempest-invalid-2041167304/action => generated 101 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:03:26.284101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87719c18-212a-42e9-bfe3-a7e1dfb89788 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1999760604"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:26.290679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-87719c18-212a-42e9-bfe3-a7e1dfb89788 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 05:03:26.291949 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-87719c18-212a-42e9-bfe3-a7e1dfb89788 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87719c18-212a-42e9-bfe3-a7e1dfb89788 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Request method failure captured: Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 57 Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEhtvm12ZKXnV93XAa1qRlwhKYhel3A65Sut9R1y3Yv-iw1iqLYQuGrPP11h_KJtY2tdx_y4GygcxN20o5pyBf6ASkFH7p182OTww_DlWGUbW9rtjLFiKaXw7pXt9Fjr7Bk1mKDh7Ww9tu5TIAaOOUrefBEvTW9YgbH-1zkxICmTNqI Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_472505d0d1284ec7aab1199f2d9b9b0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f815ab4ebda14e749e67e67ca38f627f Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: {"createImage": {"name": "tempest-test-snap-1999760604"}} Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1999760604'}}} Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.295120 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87719c18-212a-42e9-bfe3-a7e1dfb89788 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-87719c18-212a-42e9-bfe3-a7e1dfb89788 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.030777 Aug 29 05:03:26.303084 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1565/3069] 10.222.0.20 () {60 vars in 1275 bytes} [Mon Aug 29 05:03:26 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:26.320228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87f1c950-9ca6-4d26-860b-828fecd04521 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1890095200"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:26.322526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-87f1c950-9ca6-4d26-860b-828fecd04521 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 05:03:26.323043 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-87f1c950-9ca6-4d26-860b-828fecd04521 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87f1c950-9ca6-4d26-860b-828fecd04521 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Request method failure captured: Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 57 Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEhtvm12ZKXnV93XAa1qRlwhKYhel3A65Sut9R1y3Yv-iw1iqLYQuGrPP11h_KJtY2tdx_y4GygcxN20o5pyBf6ASkFH7p182OTww_DlWGUbW9rtjLFiKaXw7pXt9Fjr7Bk1mKDh7Ww9tu5TIAaOOUrefBEvTW9YgbH-1zkxICmTNqI Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_472505d0d1284ec7aab1199f2d9b9b0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f815ab4ebda14e749e67e67ca38f627f Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: {"createImage": {"name": "tempest-test-snap-1890095200"}} Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1890095200'}}} Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.326705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.331912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.331912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.331912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.331912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.331912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.331912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:26.331912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:26.331912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 05:03:26.331912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.340236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87f1c950-9ca6-4d26-860b-828fecd04521 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:26.341299 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-87f1c950-9ca6-4d26-860b-828fecd04521 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.033059 Aug 29 05:03:26.350097 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1566/3070] 10.222.0.20 () {60 vars in 1281 bytes} [Mon Aug 29 05:03:26 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:26.355905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:26.356428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:26.362782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.363295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.363725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.364919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.365372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.365791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.381931 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] HTTP exception thrown: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Request method failure captured: Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 HTTP/1.1 Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEhtvm12ZKXnV93XAa1qRlwhKYhel3A65Sut9R1y3Yv-iw1iqLYQuGrPP11h_KJtY2tdx_y4GygcxN20o5pyBf6ASkFH7p182OTww_DlWGUbW9rtjLFiKaXw7pXt9Fjr7Bk1mKDh7Ww9tu5TIAaOOUrefBEvTW9YgbH-1zkxICmTNqI Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_472505d0d1284ec7aab1199f2d9b9b0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f815ab4ebda14e749e67e67ca38f627f Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'd9017bb8-cc8e-46d0-86ba-763c9fe82cd2'} Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:26.384004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Returning 404 to user: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-38558184-cb5e-4eb6-99e9-38fa1808a516 tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 404 len: 111 microversion: 2.1 time: 0.038629 Aug 29 05:03:26.394502 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1567/3071] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:26 2022] DELETE /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:26.420290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:26.420953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] [instance: d9017bb8-cc8e-46d0-86ba-763c9fe82cd2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:26.427253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.427745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.428263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.428975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.429433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.429856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.473974 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] HTTP exception thrown: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Request method failure captured: Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 HTTP/1.1 Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEhtvm12ZKXnV93XAa1qRlwhKYhel3A65Sut9R1y3Yv-iw1iqLYQuGrPP11h_KJtY2tdx_y4GygcxN20o5pyBf6ASkFH7p182OTww_DlWGUbW9rtjLFiKaXw7pXt9Fjr7Bk1mKDh7Ww9tu5TIAaOOUrefBEvTW9YgbH-1zkxICmTNqI Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_472505d0d1284ec7aab1199f2d9b9b0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/472505d0d1284ec7aab1199f2d9b9b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 472505d0d1284ec7aab1199f2d9b9b0b Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-240440655 Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f815ab4ebda14e749e67e67ca38f627f Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesNegativeTestJSON-240440655-project Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'd9017bb8-cc8e-46d0-86ba-763c9fe82cd2'} Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:26.475717 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.479705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:26.479705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:26.479705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:26.479705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:26.479705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:26.479705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. Aug 29 05:03:26.479705 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:26.479705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] Returning 404 to user: Instance d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:26.479705 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af81a386-df34-4cb1-b2ad-3142258921df tempest-ImagesNegativeTestJSON-240440655 tempest-ImagesNegativeTestJSON-240440655-project] 10.222.0.20 "GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2" status: 404 len: 111 microversion: 2.1 time: 0.079330 Aug 29 05:03:26.484145 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1568/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:26 2022] GET /compute/v2.1/servers/d9017bb8-cc8e-46d0-86ba-763c9fe82cd2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:26.824780 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3714f688-6f4f-4029-8e65-4fc957534f9e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/26e803ce-0093-445e-ab96-56a85f0a963b" status: 202 len: 0 microversion: 2.1 time: 0.684878 Aug 29 05:03:26.825470 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1505/3073] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:26 2022] DELETE /compute/v2.1/os-security-groups/26e803ce-0093-445e-ab96-56a85f0a963b => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:26.843201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18f7ef87-61bf-4761-92df-b266256f4a72 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'create', calling method: .version_select at 0x7f1abd87a3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-637616912", "description": "tempest-description-132820648"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:26.921510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:26.922706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: d8f8d726-cea8-47a1-8b08-3c6ddae3f11f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:26.938309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.939104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.940437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:26.945949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:26.946796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:26.947892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:27.256354 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18f7ef87-61bf-4761-92df-b266256f4a72 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.416715 Aug 29 05:03:27.270870 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1569/3074] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:03:26 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:27.277152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:27.280450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:27.314214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:27.314713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:27.325695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:27.327069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:27.328754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:27.330335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:27.372322 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 HTTP/1.1 Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '73dfa6f9-babd-4bec-a4e9-95e5829e2fd5'} Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:27.374533 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.378829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:27.378829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:27.378829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:27.378829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:27.378829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:27.378829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.378829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.380545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:27.383191 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-26b000f8-e4e5-4c0f-8264-273f7924b708 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 404 len: 111 microversion: 2.1 time: 0.110201 Aug 29 05:03:27.384425 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1570/3075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:27 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:27.396859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:27.397825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:27.405913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:27.406599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:27.407209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:27.408107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:27.409388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:27.409990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:27.486027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:27.499168 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9638b05a-b4a2-4bf5-9f2f-e863c2f3129c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/d8f8d726-cea8-47a1-8b08-3c6ddae3f11f" status: 200 len: 1506 microversion: 2.1 time: 0.581565 Aug 29 05:03:27.499749 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1506/3076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:26 2022] GET /compute/v2.1/servers/d8f8d726-cea8-47a1-8b08-3c6ddae3f11f => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:03:27.505200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-072b6cea-152e-4630-ba1a-ad7668d5373e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Action: 'update', calling method: .version_select at 0x7f1ab95c4790>, body: {"security_group": {"name": "tempest-sg-hth-1028683091", "description": "tempest-description-hth-1668024862"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:27.861489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:27.878482 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb0d2717-fc21-4b6e-8b5a-66d1ebcbbf79 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1351 microversion: 2.1 time: 0.490681 Aug 29 05:03:27.879954 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1571/3077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:27 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1351 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:27.890369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:27.892559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:27.909745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:27.910175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:27.910611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:27.915236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:27.917473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:27.917932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:27.962925 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 HTTP/1.1 Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '73dfa6f9-babd-4bec-a4e9-95e5829e2fd5'} Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:27.967723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7539fe59-00ad-4a3f-a8bc-d963b445c820 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 404 len: 111 microversion: 2.1 time: 0.088414 Aug 29 05:03:27.972163 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1572/3078] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:27 2022] DELETE /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:27.978326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:27.979057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: d8f8d726-cea8-47a1-8b08-3c6ddae3f11f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:27.985627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:27.986370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:27.986990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:27.987875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:27.989008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:27.989719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.018415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: d8f8d726-cea8-47a1-8b08-3c6ddae3f11f] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:03:28.173186 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-65bf1fba-bc0a-4e36-986b-3ea58c9c450c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d8f8d726-cea8-47a1-8b08-3c6ddae3f11f" status: 204 len: 0 microversion: 2.1 time: 0.201169 Aug 29 05:03:28.174596 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1573/3079] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:27 2022] DELETE /compute/v2.1/servers/d8f8d726-cea8-47a1-8b08-3c6ddae3f11f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:03:28.188132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-48f8700b-6fc1-41da-93d9-6ef1b037c3c7 req-ae5ad57c-7a33-4b05-a83a-a9efcaedac42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dfa6f9-babd-4bec-a4e9-95e5829e2fd5", "name": "network-vif-deleted", "tag": "42615650-c176-47e5-b155-cd885ba7347b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:28.201337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-48f8700b-6fc1-41da-93d9-6ef1b037c3c7 req-ae5ad57c-7a33-4b05-a83a-a9efcaedac42 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.202802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-48f8700b-6fc1-41da-93d9-6ef1b037c3c7 req-ae5ad57c-7a33-4b05-a83a-a9efcaedac42 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.203383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-48f8700b-6fc1-41da-93d9-6ef1b037c3c7 req-ae5ad57c-7a33-4b05-a83a-a9efcaedac42 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.220433 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-48f8700b-6fc1-41da-93d9-6ef1b037c3c7 req-ae5ad57c-7a33-4b05-a83a-a9efcaedac42 service nova] Creating event network-vif-deleted:42615650-c176-47e5-b155-cd885ba7347b for instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 on n-h1-854119-9 Aug 29 05:03:28.234210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-48f8700b-6fc1-41da-93d9-6ef1b037c3c7 req-ae5ad57c-7a33-4b05-a83a-a9efcaedac42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056122 Aug 29 05:03:28.234839 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1574/3080] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:28.242566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-072b6cea-152e-4630-ba1a-ad7668d5373e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/7c03302f-c8df-4277-9fd0-030c9a897ea9" status: 200 len: 218 microversion: 2.1 time: 0.741460 Aug 29 05:03:28.243173 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1507/3081] 10.222.0.20 () {60 vars in 1290 bytes} [Mon Aug 29 05:03:27 2022] PUT /compute/v2.1/os-security-groups/7c03302f-c8df-4277-9fd0-030c9a897ea9 => generated 218 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:28.254794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:28.255831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:28.256471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:28.257968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:28.263701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.267362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.267837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.268744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.269210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.269637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.275077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.275593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.279381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.281981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.284112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.284764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.328002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 18f1144e-5344-49b5-8b05-244d389b3060] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:03:28.335075 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 HTTP/1.1 Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '73dfa6f9-babd-4bec-a4e9-95e5829e2fd5'} Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.336798 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.340731 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.340731 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.340731 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.340731 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:28.340731 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:28.340731 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. Aug 29 05:03:28.340731 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.340731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:28.342937 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06b89a7e-c181-4d1c-a789-9f628cb729dc tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5" status: 404 len: 111 microversion: 2.1 time: 0.099026 Aug 29 05:03:28.344946 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1575/3082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:28 2022] GET /compute/v2.1/servers/73dfa6f9-babd-4bec-a4e9-95e5829e2fd5 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:28.373387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75b8ec2e-1f12-4619-b041-eee502a11909 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1abd89b820>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:28.429573 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-402ee957-2a51-4f83-85af-b8b90c5d930b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060" status: 204 len: 0 microversion: 2.1 time: 0.183987 Aug 29 05:03:28.438873 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1508/3083] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:28 2022] DELETE /compute/v2.1/servers/18f1144e-5344-49b5-8b05-244d389b3060 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:03:28.450743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:28.451330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:28.471973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.475392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.476059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.478691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.484154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.484776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.510787 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb HTTP/1.1 Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '23c25788-08f4-4d5a-8f8d-372ed53b2fcb'} Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:28.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.518315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.520677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:28.522535 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-90d0eba5-eff7-45ba-b1ea-3f31d002d189 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 404 len: 111 microversion: 2.1 time: 0.081451 Aug 29 05:03:28.523564 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1509/3084] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:28 2022] DELETE /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:28.533456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:28.534730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 23c25788-08f4-4d5a-8f8d-372ed53b2fcb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:28.545197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.545990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.547164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.548193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.548998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.549673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.570316 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb HTTP/1.1 Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '23c25788-08f4-4d5a-8f8d-372ed53b2fcb'} Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.572392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.577170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.577170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.577170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.577170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:28.577170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:28.577170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. Aug 29 05:03:28.577170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.579328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 23c25788-08f4-4d5a-8f8d-372ed53b2fcb could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:28.580455 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-db03d006-e5b8-45b8-bcbc-b97d96c118c5 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb" status: 404 len: 111 microversion: 2.1 time: 0.052753 Aug 29 05:03:28.581343 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1510/3085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:28 2022] GET /compute/v2.1/servers/23c25788-08f4-4d5a-8f8d-372ed53b2fcb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:28.590456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:28.591481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:28.600083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.600894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.603571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.604541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.605280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.605962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.627647 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 HTTP/1.1 Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'b65e5f2d-e369-4e32-a10f-d3c261c15e87'} Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:28.630940 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.635486 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.637861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:28.638909 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1fc0cba9-0ba8-40ae-b993-9ebe47203218 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 404 len: 111 microversion: 2.1 time: 0.053413 Aug 29 05:03:28.639944 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1511/3086] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:28 2022] DELETE /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:28.648603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:28.649552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: b65e5f2d-e369-4e32-a10f-d3c261c15e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:28.651119 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75b8ec2e-1f12-4619-b041-eee502a11909 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/7c03302f-c8df-4277-9fd0-030c9a897ea9" status: 200 len: 218 microversion: 2.1 time: 0.304908 Aug 29 05:03:28.652187 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1576/3087] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:03:28 2022] GET /compute/v2.1/os-security-groups/7c03302f-c8df-4277-9fd0-030c9a897ea9 => generated 218 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:28.659589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.661264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.662976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.664029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:28.664678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:28.665269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:28.671464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-441f284e-1867-4120-b23c-791fa4efa0d0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1abd87b9d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:28.685934 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 HTTP/1.1 Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'b65e5f2d-e369-4e32-a10f-d3c261c15e87'} Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:28.688134 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.692660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:28.692660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:28.692660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:28.692660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:28.692660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:28.692660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. Aug 29 05:03:28.692660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:28.701401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance b65e5f2d-e369-4e32-a10f-d3c261c15e87 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:28.701401 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03a1f27a-1a01-4539-a903-a5855d5f537f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87" status: 404 len: 111 microversion: 2.1 time: 0.054654 Aug 29 05:03:28.701401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1512/3088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:28 2022] GET /compute/v2.1/servers/b65e5f2d-e369-4e32-a10f-d3c261c15e87 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:28.712946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1876245141", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "3608634f-c657-4632-a57c-89ec30d24b5a"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:28.798641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] validate_networks() for [('3608634f-c657-4632-a57c-89ec30d24b5a', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:03:29.975723 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-441f284e-1867-4120-b23c-791fa4efa0d0 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/7c03302f-c8df-4277-9fd0-030c9a897ea9" status: 202 len: 0 microversion: 2.1 time: 1.314356 Aug 29 05:03:29.976459 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1577/3089] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:28 2022] DELETE /compute/v2.1/os-security-groups/7c03302f-c8df-4277-9fd0-030c9a897ea9 => generated 0 bytes in 1316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:03:29.981522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:29.982284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:30.006709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:30.008587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:30.009061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:30.014484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:30.015455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:30.017589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:30.058736 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 HTTP/1.1 Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8ce6a237-7b7a-47ca-8206-662169d4e217'} Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:30.064966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22e4b653-cb86-405a-b50a-ef66fb27afd0 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 404 len: 111 microversion: 2.1 time: 0.090800 Aug 29 05:03:30.071089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1578/3090] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:29 2022] DELETE /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:30.087515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:30.090292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:30.109246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:30.109768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:30.110219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:30.111105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:30.112324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:30.114308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:30.865981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:30.898338 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0f3b0218-cd09-4f8c-9fac-581a31847299 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1351 microversion: 2.1 time: 0.825609 Aug 29 05:03:30.914441 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1579/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:30 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1351 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:30.937348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:30.938055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:30.958840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:30.959417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:30.959892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:30.960693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:30.961151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:30.961576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.005782 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 HTTP/1.1 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'fa97c4a3-6876-4660-abff-28eeabe14c31'} Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:31.009830 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:31.014460 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b513e619-6093-4024-a04a-223e5822737c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 404 len: 111 microversion: 2.1 time: 0.087647 Aug 29 05:03:31.016258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1580/3092] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:30 2022] DELETE /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:31.036988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:31.037909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 8ce6a237-7b7a-47ca-8206-662169d4e217] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:31.046863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.047365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.047803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.048711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.049449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.049868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.070810 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 HTTP/1.1 Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8ce6a237-7b7a-47ca-8206-662169d4e217'} Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.072758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.078448 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.078448 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.078448 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.078448 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:31.078448 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:31.078448 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. Aug 29 05:03:31.078448 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.081607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 8ce6a237-7b7a-47ca-8206-662169d4e217 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:31.083023 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85557165-b0aa-491f-b46c-53f2645a0ee9 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217" status: 404 len: 111 microversion: 2.1 time: 0.050456 Aug 29 05:03:31.084329 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1581/3093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:31 2022] GET /compute/v2.1/servers/8ce6a237-7b7a-47ca-8206-662169d4e217 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:31.090677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f295f40e-0a57-453d-8c98-e3ff9919b6a2 req-f79c7ef4-2f3c-4d0a-a755-e7edd399c5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3cb6b4d-acca-4003-9615-80df2cffdc58", "tag": "3b7a8ccf-8a67-4962-a826-7c8794637171"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:31.112286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f295f40e-0a57-453d-8c98-e3ff9919b6a2 req-f79c7ef4-2f3c-4d0a-a755-e7edd399c5e4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.112971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f295f40e-0a57-453d-8c98-e3ff9919b6a2 req-f79c7ef4-2f3c-4d0a-a755-e7edd399c5e4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.127254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f295f40e-0a57-453d-8c98-e3ff9919b6a2 req-f79c7ef4-2f3c-4d0a-a755-e7edd399c5e4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.161920 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f295f40e-0a57-453d-8c98-e3ff9919b6a2 req-f79c7ef4-2f3c-4d0a-a755-e7edd399c5e4 service nova] Creating event network-changed:3b7a8ccf-8a67-4962-a826-7c8794637171 for instance a3cb6b4d-acca-4003-9615-80df2cffdc58 on n-h1-854119-9 Aug 29 05:03:31.167368 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f295f40e-0a57-453d-8c98-e3ff9919b6a2 req-f79c7ef4-2f3c-4d0a-a755-e7edd399c5e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081630 Aug 29 05:03:31.167976 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1582/3094] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:31.173844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:31.174822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: fa97c4a3-6876-4660-abff-28eeabe14c31] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:31.184577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.185315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.185934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.186821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.187425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.187999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.222106 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 HTTP/1.1 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'fa97c4a3-6876-4660-abff-28eeabe14c31'} Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.224543 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.228661 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.228661 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.228661 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.228661 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:31.228661 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:31.228661 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. Aug 29 05:03:31.228661 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.229840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Instance fa97c4a3-6876-4660-abff-28eeabe14c31 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:31.230889 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bc1e56fb-a783-4c0e-9741-4bdec96b8166 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31" status: 404 len: 111 microversion: 2.1 time: 0.061569 Aug 29 05:03:31.231466 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1583/3095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:31 2022] GET /compute/v2.1/servers/fa97c4a3-6876-4660-abff-28eeabe14c31 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:31.238734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:31.241459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:03:31.242668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:31.246964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:03:31.247776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:03:31.248406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:03:31.248926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:03:31.250894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.251549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.252165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.253041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.253666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.254290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.267170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.269642 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.270211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.270799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d HTTP/1.1 Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'f7984b96-f6da-4a31-a6ff-548b39c2348d'} Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:31.271053 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23a2ecd5-7db6-48cd-8904-0236521ace3f tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 404 len: 111 microversion: 2.1 time: 0.037604 Aug 29 05:03:31.274923 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1584/3096] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:31 2022] DELETE /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:31.275844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.275844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.276024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.278407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28a125d2-9cc1-416f-afa0-8987f7ea106c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1abd896ee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:31.332295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Getting quotas for project b233cdda0d464bbd9063556d05f94f32. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:31.338983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Getting quotas for user 1b5778008702451e9e25aec8bafb13f3 and project b233cdda0d464bbd9063556d05f94f32. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:31.352822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Going to run 2 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:03:31.357294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:03:31.379067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-28a125d2-9cc1-416f-afa0-8987f7ea106c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 26e803ce-0093-445e-ab96-56a85f0a963b does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:03:31.381856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-28a125d2-9cc1-416f-afa0-8987f7ea106c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group 26e803ce-0093-445e-ab96-56a85f0a963b not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:03:31.382608 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-28a125d2-9cc1-416f-afa0-8987f7ea106c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group 26e803ce-0093-445e-ab96-56a85f0a963b does not exist Aug 29 05:03:31.382608 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-144067c6-3605-489f-b11d-0be2dab4e38a'] Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28a125d2-9cc1-416f-afa0-8987f7ea106c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-security-groups/26e803ce-0093-445e-ab96-56a85f0a963b HTTP/1.1 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group 26e803ce-0093-445e-ab96-56a85f0a963b does not exist Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-144067c6-3605-489f-b11d-0be2dab4e38a'] Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '26e803ce-0093-445e-ab96-56a85f0a963b'} Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:03:31.385909 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 26e803ce-0093-445e-ab96-56a85f0a963b does not exist Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-144067c6-3605-489f-b11d-0be2dab4e38a'] Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 26e803ce-0093-445e-ab96-56a85f0a963b does not exist Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-144067c6-3605-489f-b11d-0be2dab4e38a'] Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 26e803ce-0093-445e-ab96-56a85f0a963b does not exist Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-144067c6-3605-489f-b11d-0be2dab4e38a'] Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 26e803ce-0093-445e-ab96-56a85f0a963b does not exist Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-144067c6-3605-489f-b11d-0be2dab4e38a'] Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28a125d2-9cc1-416f-afa0-8987f7ea106c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group 26e803ce-0093-445e-ab96-56a85f0a963b does not exist Aug 29 05:03:31.390875 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-144067c6-3605-489f-b11d-0be2dab4e38a'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:31.397977 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28a125d2-9cc1-416f-afa0-8987f7ea106c tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/26e803ce-0093-445e-ab96-56a85f0a963b" status: 404 len: 194 microversion: 2.1 time: 0.117488 Aug 29 05:03:31.397977 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1585/3097] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:31 2022] DELETE /compute/v2.1/os-security-groups/26e803ce-0093-445e-ab96-56a85f0a963b => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:31.408461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:31.410989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: f7984b96-f6da-4a31-a6ff-548b39c2348d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:31.416975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=57eb998e-23ed-4714-aa71-9cdf6f18d2d8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:03:31.427337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.427864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.428832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.435494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.437002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.437685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.471529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d HTTP/1.1 Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'f7984b96-f6da-4a31-a6ff-548b39c2348d'} Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.473753 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.477664 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.477664 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.477664 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.477664 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:31.477664 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:31.477664 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. Aug 29 05:03:31.477664 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.482125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance f7984b96-f6da-4a31-a6ff-548b39c2348d could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:31.483341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da142c58-b156-4047-b72a-d2aa4936470d tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d" status: 404 len: 111 microversion: 2.1 time: 0.087203 Aug 29 05:03:31.484486 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1586/3098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:31 2022] GET /compute/v2.1/servers/f7984b96-f6da-4a31-a6ff-548b39c2348d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:31.509196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25a75bc5-bac4-42d6-91ba-4b25f3869496 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1abd9493a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:31.563378 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de684db5-e8a1-4cf4-89cb-60e6df07330c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.859303 Aug 29 05:03:31.569992 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1513/3099] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:03:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 2868 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 05:03:31.574126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-25a75bc5-bac4-42d6-91ba-4b25f3869496 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:03:31.575023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-25a75bc5-bac4-42d6-91ba-4b25f3869496 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:03:31.575653 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-25a75bc5-bac4-42d6-91ba-4b25f3869496 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 does not exist Aug 29 05:03:31.575653 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-51b2373f-bdc1-403a-8a0a-76053b6e4cd2'] Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25a75bc5-bac4-42d6-91ba-4b25f3869496 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-security-groups/b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 HTTP/1.1 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 does not exist Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-51b2373f-bdc1-403a-8a0a-76053b6e4cd2'] Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'b7f3273b-1f8d-4ef8-a390-e123eb9c9b76'} Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:03:31.578073 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 does not exist Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51b2373f-bdc1-403a-8a0a-76053b6e4cd2'] Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 does not exist Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51b2373f-bdc1-403a-8a0a-76053b6e4cd2'] Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 does not exist Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51b2373f-bdc1-403a-8a0a-76053b6e4cd2'] Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 does not exist Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51b2373f-bdc1-403a-8a0a-76053b6e4cd2'] Aug 29 05:03:31.583776 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:31.588596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:31.593014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25a75bc5-bac4-42d6-91ba-4b25f3869496 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 does not exist Aug 29 05:03:31.593014 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-51b2373f-bdc1-403a-8a0a-76053b6e4cd2'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:31.594312 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-25a75bc5-bac4-42d6-91ba-4b25f3869496 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b7f3273b-1f8d-4ef8-a390-e123eb9c9b76" status: 404 len: 194 microversion: 2.1 time: 0.108621 Aug 29 05:03:31.595497 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1587/3100] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:31 2022] DELETE /compute/v2.1/os-security-groups/b7f3273b-1f8d-4ef8-a390-e123eb9c9b76 => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:31.603391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:31.607696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Searching by: {'deleted': False, 'project_id': 'b233cdda0d464bbd9063556d05f94f32'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:03:31.613857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-333530b9-8d94-4500-9097-e9dfdac1ce5e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1abd87b9d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:31.669113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.683049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.683694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.696351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:31.696973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:31.697430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:31.707319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:31.770167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:31.796668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:03:31.892940 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d46a8473-4130-4166-a579-371015f29663 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.315258 Aug 29 05:03:31.892940 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1514/3101] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:03:31 2022] GET /compute/v2.1/servers => generated 1335 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:31.903399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-175559077", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "0e65d1e5-8082-45d2-ad3c-ccc8c3f94eae"}, {"uuid": "e58c8d10-5f51-4c23-9064-3a375bbc1b5b"}, {"uuid": "0e65d1e5-8082-45d2-ad3c-ccc8c3f94eae"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:31.999838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] validate_networks() for [('0e65d1e5-8082-45d2-ad3c-ccc8c3f94eae', None, None, None, None, None), ('e58c8d10-5f51-4c23-9064-3a375bbc1b5b', None, None, None, None, None), ('0e65d1e5-8082-45d2-ad3c-ccc8c3f94eae', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:03:32.089411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-333530b9-8d94-4500-9097-e9dfdac1ce5e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:03:32.090787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-333530b9-8d94-4500-9097-e9dfdac1ce5e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group f7713a38-b55b-4a92-b169-18a118887fd7 not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:03:32.091473 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-333530b9-8d94-4500-9097-e9dfdac1ce5e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:03:32.091473 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-87d27829-30c6-436e-99ae-feeae05eb875'] Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-333530b9-8d94-4500-9097-e9dfdac1ce5e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-security-groups/f7713a38-b55b-4a92-b169-18a118887fd7 HTTP/1.1 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-87d27829-30c6-436e-99ae-feeae05eb875'] Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'f7713a38-b55b-4a92-b169-18a118887fd7'} Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:03:32.093953 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87d27829-30c6-436e-99ae-feeae05eb875'] Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87d27829-30c6-436e-99ae-feeae05eb875'] Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87d27829-30c6-436e-99ae-feeae05eb875'] Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87d27829-30c6-436e-99ae-feeae05eb875'] Aug 29 05:03:32.098561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:32.104781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-333530b9-8d94-4500-9097-e9dfdac1ce5e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group f7713a38-b55b-4a92-b169-18a118887fd7 does not exist Aug 29 05:03:32.104781 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-87d27829-30c6-436e-99ae-feeae05eb875'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:32.104781 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-333530b9-8d94-4500-9097-e9dfdac1ce5e tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f7713a38-b55b-4a92-b169-18a118887fd7" status: 404 len: 194 microversion: 2.1 time: 0.503828 Aug 29 05:03:32.105160 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1588/3102] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:31 2022] DELETE /compute/v2.1/os-security-groups/f7713a38-b55b-4a92-b169-18a118887fd7 => generated 194 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:32.114701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9653045d-b22f-4aea-bcfd-42d534fc539f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:32.116302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9653045d-b22f-4aea-bcfd-42d534fc539f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:33.167287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9653045d-b22f-4aea-bcfd-42d534fc539f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:33.183274 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9653045d-b22f-4aea-bcfd-42d534fc539f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1218 microversion: 2.1 time: 1.076746 Aug 29 05:03:33.185611 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1589/3103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:32 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1218 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:33.196530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:33.199604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:33.218511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:33.221023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:33.221638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:33.225875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:33.228523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:33.229721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:35.104170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:35.127396 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0527f4c2-fd18-4223-b725-08ce70c74f72 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1351 microversion: 2.1 time: 1.935791 Aug 29 05:03:35.129644 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1590/3104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:33 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1351 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:35.166372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c7931e9-7d8b-4a70-bee2-fb801f5b8a55 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1abd8af430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:35.575382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-1c7931e9-7d8b-4a70-bee2-fb801f5b8a55 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:03:35.576028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-1c7931e9-7d8b-4a70-bee2-fb801f5b8a55 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:03:35.576785 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1c7931e9-7d8b-4a70-bee2-fb801f5b8a55 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:03:35.576785 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-b9f0746c-040c-4e6a-ba85-e8dbefc7f043'] Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c7931e9-7d8b-4a70-bee2-fb801f5b8a55 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-security-groups/a0e41b78-a51b-43a2-b2a5-3b4e43041651 HTTP/1.1 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-b9f0746c-040c-4e6a-ba85-e8dbefc7f043'] Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a0e41b78-a51b-43a2-b2a5-3b4e43041651'} Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:03:35.580268 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9f0746c-040c-4e6a-ba85-e8dbefc7f043'] Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9f0746c-040c-4e6a-ba85-e8dbefc7f043'] Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9f0746c-040c-4e6a-ba85-e8dbefc7f043'] Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9f0746c-040c-4e6a-ba85-e8dbefc7f043'] Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c7931e9-7d8b-4a70-bee2-fb801f5b8a55 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group a0e41b78-a51b-43a2-b2a5-3b4e43041651 does not exist Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-b9f0746c-040c-4e6a-ba85-e8dbefc7f043'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c7931e9-7d8b-4a70-bee2-fb801f5b8a55 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a0e41b78-a51b-43a2-b2a5-3b4e43041651" status: 404 len: 194 microversion: 2.1 time: 0.449502 Aug 29 05:03:35.584398 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1591/3105] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:35 2022] DELETE /compute/v2.1/os-security-groups/a0e41b78-a51b-43a2-b2a5-3b4e43041651 => generated 194 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:35.603064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:35.604869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:35.630968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:35.639974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:35.640946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:35.643900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:35.650562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:35.667025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:36.044907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:36.053172 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b76a116a-bc8f-4d16-8d54-0bac67f94b9b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1276 microversion: 2.1 time: 0.469151 Aug 29 05:03:36.053755 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1592/3106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:35 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1276 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:36.066101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0f537db9-115f-47a8-a7ea-9b16167f2fed req-aa18586f-7192-4583-8cfd-e9719b34fd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f8d726-cea8-47a1-8b08-3c6ddae3f11f", "name": "network-vif-deleted", "tag": "26abd5ae-c796-4dee-bda3-b0b09b900eed"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:36.086731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0f537db9-115f-47a8-a7ea-9b16167f2fed req-aa18586f-7192-4583-8cfd-e9719b34fd13 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:36.088608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0f537db9-115f-47a8-a7ea-9b16167f2fed req-aa18586f-7192-4583-8cfd-e9719b34fd13 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:36.089144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0f537db9-115f-47a8-a7ea-9b16167f2fed req-aa18586f-7192-4583-8cfd-e9719b34fd13 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:36.121526 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0f537db9-115f-47a8-a7ea-9b16167f2fed req-aa18586f-7192-4583-8cfd-e9719b34fd13 service nova] Creating event network-vif-deleted:26abd5ae-c796-4dee-bda3-b0b09b900eed for instance d8f8d726-cea8-47a1-8b08-3c6ddae3f11f on n-h1-854119-9 Aug 29 05:03:36.133982 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0f537db9-115f-47a8-a7ea-9b16167f2fed req-aa18586f-7192-4583-8cfd-e9719b34fd13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071378 Aug 29 05:03:36.135226 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1593/3107] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:36.144025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3bce09a0-f9e0-4ed2-a122-6562a6ab7fd6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1abd915b80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:36.385245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-3bce09a0-f9e0-4ed2-a122-6562a6ab7fd6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:03:36.385858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-3bce09a0-f9e0-4ed2-a122-6562a6ab7fd6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group c13a8363-315e-43c1-8515-f0e1d8e71968 not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:03:36.386414 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3bce09a0-f9e0-4ed2-a122-6562a6ab7fd6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:03:36.386414 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-b33d47d9-1cde-4e8e-842c-3df7b09263c2'] Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3bce09a0-f9e0-4ed2-a122-6562a6ab7fd6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-security-groups/c13a8363-315e-43c1-8515-f0e1d8e71968 HTTP/1.1 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-b33d47d9-1cde-4e8e-842c-3df7b09263c2'] Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'c13a8363-315e-43c1-8515-f0e1d8e71968'} Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:03:36.389787 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b33d47d9-1cde-4e8e-842c-3df7b09263c2'] Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b33d47d9-1cde-4e8e-842c-3df7b09263c2'] Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b33d47d9-1cde-4e8e-842c-3df7b09263c2'] Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b33d47d9-1cde-4e8e-842c-3df7b09263c2'] Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3bce09a0-f9e0-4ed2-a122-6562a6ab7fd6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group c13a8363-315e-43c1-8515-f0e1d8e71968 does not exist Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-b33d47d9-1cde-4e8e-842c-3df7b09263c2'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:36.394662 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3bce09a0-f9e0-4ed2-a122-6562a6ab7fd6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c13a8363-315e-43c1-8515-f0e1d8e71968" status: 404 len: 194 microversion: 2.1 time: 0.255390 Aug 29 05:03:36.398020 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1594/3108] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:36 2022] DELETE /compute/v2.1/os-security-groups/c13a8363-315e-43c1-8515-f0e1d8e71968 => generated 194 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:36.405877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:36.406635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:36.432377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:36.432923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:36.433374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:36.434105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:36.434561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:36.436180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:37.863140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:37.874449 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6c95f65f-4edf-41a7-a126-66168ea522bc tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1351 microversion: 2.1 time: 1.476404 Aug 29 05:03:37.879479 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1595/3109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:36 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1351 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:37.894090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad8f60c8-7ed6-434e-9464-a4e46d4385b6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1abd857d30>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:38.495026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG neutronclient.v2_0.client [None req-ad8f60c8-7ed6-434e-9464-a4e46d4385b6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist", "detail": ""}} {{(pid=128872) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 05:03:38.495627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.security_group_api [None req-ad8f60c8-7ed6-434e-9464-a4e46d4385b6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Neutron security group 4374748f-a9f7-48fd-a328-ed051136fc3d not found {{(pid=128872) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 05:03:38.496283 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ad8f60c8-7ed6-434e-9464-a4e46d4385b6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:03:38.496283 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-cb991439-e08b-4d06-9387-1b1142340121'] Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad8f60c8-7ed6-434e-9464-a4e46d4385b6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d HTTP/1.1 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: exception: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-cb991439-e08b-4d06-9387-1b1142340121'] Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '4374748f-a9f7-48fd-a328-ed051136fc3d'} Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 05:03:38.498796 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb991439-e08b-4d06-9387-1b1142340121'] Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb991439-e08b-4d06-9387-1b1142340121'] Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb991439-e08b-4d06-9387-1b1142340121'] Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb991439-e08b-4d06-9387-1b1142340121'] Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad8f60c8-7ed6-434e-9464-a4e46d4385b6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Security group 4374748f-a9f7-48fd-a328-ed051136fc3d does not exist Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: Neutron server returns request_ids: ['req-cb991439-e08b-4d06-9387-1b1142340121'] {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:38.503824 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad8f60c8-7ed6-434e-9464-a4e46d4385b6 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d" status: 404 len: 194 microversion: 2.1 time: 0.618249 Aug 29 05:03:38.506987 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1596/3110] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:37 2022] DELETE /compute/v2.1/os-security-groups/4374748f-a9f7-48fd-a328-ed051136fc3d => generated 194 bytes in 625 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:38.516927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:38.522615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:03:38.523040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:03:38.523304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:03:38.523836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:03:38.524713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:03:38.537789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:38.547044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:38.548739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:38.549769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:38.551884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:38.554065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:38.554744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:38.578427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:38.579040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:38.579490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:38.584341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:38.585056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:38.585495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:38.636192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Getting quotas for project d88eca521500460480561eaa3aaffb1e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:38.660744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Getting quotas for user 4c7ec3047c824b8994376cd3b8b8d796 and project d88eca521500460480561eaa3aaffb1e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:38.733315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:03:38.741636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:03:38.944721 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a6ecad8-8786-497e-a908-de02a1c9f80c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.049759 Aug 29 05:03:38.958433 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1515/3111] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 7060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:03:38.979228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-71e8f06d-500a-4bcb-8318-c36ce8cda344 req-32ee433c-f3a7-4275-a857-0e288f3ca049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18f1144e-5344-49b5-8b05-244d389b3060", "name": "network-vif-deleted", "tag": "f122ba75-45f2-4c3c-9e52-9b4525ed4a3a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:39.026370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-71e8f06d-500a-4bcb-8318-c36ce8cda344 req-32ee433c-f3a7-4275-a857-0e288f3ca049 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:39.026898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-71e8f06d-500a-4bcb-8318-c36ce8cda344 req-32ee433c-f3a7-4275-a857-0e288f3ca049 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:39.027660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-71e8f06d-500a-4bcb-8318-c36ce8cda344 req-32ee433c-f3a7-4275-a857-0e288f3ca049 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:39.054362 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-71e8f06d-500a-4bcb-8318-c36ce8cda344 req-32ee433c-f3a7-4275-a857-0e288f3ca049 service nova] Creating event network-vif-deleted:f122ba75-45f2-4c3c-9e52-9b4525ed4a3a for instance 18f1144e-5344-49b5-8b05-244d389b3060 on n-h1-854119-9 Aug 29 05:03:39.067979 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-71e8f06d-500a-4bcb-8318-c36ce8cda344 req-32ee433c-f3a7-4275-a857-0e288f3ca049 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113224 Aug 29 05:03:39.074841 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1516/3112] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:39.082461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:39.083287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:39.100397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:39.101020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:39.101597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:39.102414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:39.102965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:39.109213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:39.224384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:03:39.244807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:39.264141 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a95858d1-1d42-4c4f-a93c-3fb0e1942c99 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1276 microversion: 2.1 time: 0.757178 Aug 29 05:03:39.281594 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1597/3113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:38 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1276 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:39.289624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:39.293660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:39.309641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:39.312204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:39.312807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:39.313711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:39.316304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:39.316898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:39.698806 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3c54bd41-2de3-4cdb-abe9-2b625641242b tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 204 len: 0 microversion: 2.1 time: 0.619250 Aug 29 05:03:39.709377 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1517/3114] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:39 2022] DELETE /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:03:39.736968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f9902f02-71ff-4664-a9c1-38b5ade34614 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:39.741127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f9902f02-71ff-4664-a9c1-38b5ade34614 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:40.883608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:40.890098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:40.896841 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb8e4f38-ff27-4176-8342-0e717c14601e tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1351 microversion: 2.1 time: 1.613803 Aug 29 05:03:40.897687 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1598/3115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:39 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1351 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:40.902973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:40.913060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:40.930379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:40.931127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:40.931724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:40.932642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:40.933250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:40.933860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:40.964834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f9902f02-71ff-4664-a9c1-38b5ade34614 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:40.976858 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f9902f02-71ff-4664-a9c1-38b5ade34614 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1212 microversion: 2.1 time: 1.266024 Aug 29 05:03:40.977774 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1518/3116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:39 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1212 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:40.987121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:40.987618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:41.000951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.001584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.002018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.008748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.009470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.010067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.050666 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde HTTP/1.1 Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '96a08139-975a-4c7d-9bf2-05a417d9fbde'} Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:41.055915 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.060541 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.064918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:41.066064 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3f03f7b7-bc9f-4cff-8603-66ebb9ec2372 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 404 len: 111 microversion: 2.1 time: 0.087337 Aug 29 05:03:41.067091 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1519/3117] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:40 2022] DELETE /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:41.072249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:41.073122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:41.098055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.100730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.106246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.107272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.108671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.109300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.650848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:41.671315 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c806ffec-6cc3-4a80-8869-38a6bceef749 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1276 microversion: 2.1 time: 0.591344 Aug 29 05:03:41.672740 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1520/3118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:41 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1276 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:41.678324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:41.679166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: 96a08139-975a-4c7d-9bf2-05a417d9fbde] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:41.690656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.691517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.692231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.693122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.693778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.696593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.727889 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde HTTP/1.1 Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '96a08139-975a-4c7d-9bf2-05a417d9fbde'} Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:41.729688 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance 96a08139-975a-4c7d-9bf2-05a417d9fbde could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f7eb1837-a1da-4b48-bbb8-3f516f2e1649 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde" status: 404 len: 111 microversion: 2.1 time: 0.058056 Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1521/3119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:41 2022] GET /compute/v2.1/servers/96a08139-975a-4c7d-9bf2-05a417d9fbde => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:41.747070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:41.770437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.771034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.771485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.772262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.772709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.777733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.811789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 HTTP/1.1 Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'a03db1b0-6fca-4eb2-9579-8903be60ba92'} Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:41.818230 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.822919 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.824733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:41.825762 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b576f106-a803-4a30-ac7b-4e10907347f2 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 404 len: 111 microversion: 2.1 time: 0.086657 Aug 29 05:03:41.832831 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1522/3120] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:03:41 2022] DELETE /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:41.841002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:41.841938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] [instance: a03db1b0-6fca-4eb2-9579-8903be60ba92] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:41.858334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.859002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.859615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.860513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.861120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.861697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.897313 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] HTTP exception thrown: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Request method failure captured: Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 HTTP/1.1 Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEc1079PRbhzxM_Hb1d3ry9RxRIPaGlQx3OWw66xHDMwBSAzopg1VIgAHEOCeZLKFI0sZJx8hXfHgHWGIlVlHXmD9WR6ohHNm7SYiyzQEqGBNS3RYa_GgiiIvrQ2O3f8po-Djt1YWNGBHTefzMEKV_3a7Pov2kqsp7-sg5Antd5bCHA Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8dbc7ce397480d8d31b963dac9688f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8dbc7ce397480d8d31b963dac9688f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c8dbc7ce397480d8d31b963dac9688f Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-665597045 Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d3aaab47eb243c6bf9a0b2e512e7c4a Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-665597045-project Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'a03db1b0-6fca-4eb2-9579-8903be60ba92'} Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:41.901692 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.906619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:41.906619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:41.906619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:41.906619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:41.906619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:41.906619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. Aug 29 05:03:41.906619 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:03:41.908050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] Returning 404 to user: Instance a03db1b0-6fca-4eb2-9579-8903be60ba92 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:41.909101 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2bb333f0-9088-4744-aae2-a8b3c8d9b864 tempest-DeleteServersTestJSON-665597045 tempest-DeleteServersTestJSON-665597045-project] 10.222.0.20 "GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92" status: 404 len: 111 microversion: 2.1 time: 0.071913 Aug 29 05:03:41.913625 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1523/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:41 2022] GET /compute/v2.1/servers/a03db1b0-6fca-4eb2-9579-8903be60ba92 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:03:41.922482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:41.928455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:41.945253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.946020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.946620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:41.947505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:41.948343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:41.948913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:42.491512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:42.500368 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-db9366c3-663f-4e8d-a49a-69d86b2e0c87 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1648 microversion: 2.1 time: 1.601481 Aug 29 05:03:42.512910 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1599/3122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:40 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1648 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:42.517919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:42.518744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:42.528576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:42.532781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:42.533425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:42.534306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:42.536862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:42.538941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:43.085082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:43.094628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aaca003b-60f4-450a-bd94-3a8fac003496 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1351 microversion: 2.1 time: 1.175911 Aug 29 05:03:43.100711 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1524/3123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:41 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1351 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:43.121510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:43.132832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:43.145184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:43.147275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:43.153068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:43.153945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:43.154728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:43.155835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:43.156373 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc68260c-062a-4e10-97d6-bd3b7e84703b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1270 microversion: 2.1 time: 0.641566 Aug 29 05:03:43.156783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:43.158310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:43.160799 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1600/3124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:42 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1270 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:43.535223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:43.537589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:43.538012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:43.544890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:43.555162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:43.556152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:43.560325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:43.561474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:43.562185 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d1fbb3cc-d406-4a5c-9d7e-e5406bcc52c3 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1276 microversion: 2.1 time: 0.460238 Aug 29 05:03:43.563033 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1525/3125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:43 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1276 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:43.566192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:43.567546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:43.842160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0cda20e4-55e7-48d6-bb97-41dd6ed0858b req-e38b6540-6fef-4624-b9d0-dbaf915afa0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57eb998e-23ed-4714-aa71-9cdf6f18d2d8", "tag": "0635a447-7042-4658-95e7-207049a14dfa"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:43.862002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0cda20e4-55e7-48d6-bb97-41dd6ed0858b req-e38b6540-6fef-4624-b9d0-dbaf915afa0c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:43.862626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0cda20e4-55e7-48d6-bb97-41dd6ed0858b req-e38b6540-6fef-4624-b9d0-dbaf915afa0c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:43.862847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0cda20e4-55e7-48d6-bb97-41dd6ed0858b req-e38b6540-6fef-4624-b9d0-dbaf915afa0c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:43.909216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1833f2d2adf84acf98169a3ef701a492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7d2fe02ed74ebe917c21af1d280080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:43.925282 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-05efa567-8375-4c55-b1ee-48bddb123355 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 200 len: 1468 microversion: 2.1 time: 0.393995 Aug 29 05:03:43.933526 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1601/3126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:43 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 1468 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:03:43.934255 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0cda20e4-55e7-48d6-bb97-41dd6ed0858b req-e38b6540-6fef-4624-b9d0-dbaf915afa0c service nova] Creating event network-changed:0635a447-7042-4658-95e7-207049a14dfa for instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 on n-h1-854119-9 Aug 29 05:03:43.949540 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0cda20e4-55e7-48d6-bb97-41dd6ed0858b req-e38b6540-6fef-4624-b9d0-dbaf915afa0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112303 Aug 29 05:03:43.955127 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1526/3127] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:03:44.127126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:44.128284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:44.132049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:44.142114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:44.147819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:44.149021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:44.149967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:44.152875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:44.153565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:44.183706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:44.184727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:44.201825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:44.202329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:44.203081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:44.203946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:44.220550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:44.221198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:44.269946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:44.825900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:44.848978 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-296fe2e6-9c20-4473-b480-3036a08db768 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1270 microversion: 2.1 time: 0.663906 Aug 29 05:03:44.850441 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1527/3128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:44 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1270 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:03:44.862555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:44.868359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:44.887252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:44.887767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:44.899400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:44.900238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:44.900722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:44.904600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:45.530608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:45.539956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a3bfa819-6f12-4240-9f0a-3f7728a9aee4 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1351 microversion: 2.1 time: 1.416925 Aug 29 05:03:45.560878 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1602/3129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:44 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1351 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:45.573816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:45.574476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] [instance: 787ae235-66d8-42b2-8e32-779d88d6af00] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:45.592074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:45.592810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:45.593264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:45.594006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:45.594464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:45.594897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:45.636780 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] HTTP exception thrown: Instance 787ae235-66d8-42b2-8e32-779d88d6af00 could not be found. Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Request method failure captured: Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 HTTP/1.1 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEgSaGstJr4fITEoCrBT9o2MWo0JDvljyxJ4fhIjMdYdVOqgfUVjLoGXKXHQEe5SqVzUsh3OeETXFgZo3MwcTbP2RwSoeAaW0Pt26UkSwZkC4xJ2yovgTao6sJuClkIZqojtxCSB1un7x1n51HMf3Ke4-4SVRsgMWMneQo7ywqrUVcM Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7d2fe02ed74ebe917c21af1d280080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7d2fe02ed74ebe917c21af1d280080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9e7d2fe02ed74ebe917c21af1d280080 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1697127927 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1833f2d2adf84acf98169a3ef701a492 Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-SecurityGroupsTestJSON-1697127927-project Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 787ae235-66d8-42b2-8e32-779d88d6af00 could not be found. Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '787ae235-66d8-42b2-8e32-779d88d6af00'} Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787ae235-66d8-42b2-8e32-779d88d6af00 could not be found. Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787ae235-66d8-42b2-8e32-779d88d6af00 could not be found. Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:03:45.639314 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:45.643263 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:03:45.643263 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:03:45.643263 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:03:45.643263 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:03:45.643263 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:03:45.643263 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787ae235-66d8-42b2-8e32-779d88d6af00 could not be found. Aug 29 05:03:45.643263 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:03:45.643263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Returning 404 to user: Instance 787ae235-66d8-42b2-8e32-779d88d6af00 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:03:45.643772 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9eb5bb3-beb8-481e-8eed-165d34fd74d2 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00" status: 404 len: 111 microversion: 2.1 time: 0.081808 Aug 29 05:03:45.650675 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1603/3130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:45 2022] GET /compute/v2.1/servers/787ae235-66d8-42b2-8e32-779d88d6af00 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:03:45.662883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2ca1732-d98a-40a2-8d34-9e2a469c3f58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1ab9123af0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:46.516914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:46.528491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4e582ad7-0e33-4288-951d-465f40793ab0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1318 microversion: 2.1 time: 1.677027 Aug 29 05:03:46.532078 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1528/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:44 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1318 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:46.544482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:46.545248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:46.569235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:46.570262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:46.572719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:46.573709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:46.575117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:46.575772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:46.818930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:46.834180 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9247c16c-0f36-4dab-8c1c-80e0c617d6d4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1270 microversion: 2.1 time: 0.294062 Aug 29 05:03:46.850994 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1529/3132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:46 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1270 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:46.855900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-eaccdcff-a12c-4562-a4a2-12c1b75338c4 req-ddfbadb6-a510-4ea4-b7c0-64f0268f6fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787ae235-66d8-42b2-8e32-779d88d6af00", "name": "network-vif-deleted", "tag": "61689bd4-c361-4f95-9b8d-62755812544e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:46.890952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eaccdcff-a12c-4562-a4a2-12c1b75338c4 req-ddfbadb6-a510-4ea4-b7c0-64f0268f6fba service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:46.891886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eaccdcff-a12c-4562-a4a2-12c1b75338c4 req-ddfbadb6-a510-4ea4-b7c0-64f0268f6fba service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:46.892407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eaccdcff-a12c-4562-a4a2-12c1b75338c4 req-ddfbadb6-a510-4ea4-b7c0-64f0268f6fba service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:46.914811 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-eaccdcff-a12c-4562-a4a2-12c1b75338c4 req-ddfbadb6-a510-4ea4-b7c0-64f0268f6fba service nova] Creating event network-vif-deleted:61689bd4-c361-4f95-9b8d-62755812544e for instance 787ae235-66d8-42b2-8e32-779d88d6af00 on n-h1-854119-9 Aug 29 05:03:46.919942 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-eaccdcff-a12c-4562-a4a2-12c1b75338c4 req-ddfbadb6-a510-4ea4-b7c0-64f0268f6fba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067540 Aug 29 05:03:46.920758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1530/3133] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:46.929204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5449de66-a262-47a6-91f5-1027d759b130 req-70cc50e7-83ad-4c6b-a9c1-f45fb71d07ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3cb6b4d-acca-4003-9615-80df2cffdc58", "name": "network-vif-plugged", "status": "completed", "tag": "3b7a8ccf-8a67-4962-a826-7c8794637171"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:46.951716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5449de66-a262-47a6-91f5-1027d759b130 req-70cc50e7-83ad-4c6b-a9c1-f45fb71d07ad service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:46.952255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5449de66-a262-47a6-91f5-1027d759b130 req-70cc50e7-83ad-4c6b-a9c1-f45fb71d07ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:46.953008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5449de66-a262-47a6-91f5-1027d759b130 req-70cc50e7-83ad-4c6b-a9c1-f45fb71d07ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:46.968530 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5449de66-a262-47a6-91f5-1027d759b130 req-70cc50e7-83ad-4c6b-a9c1-f45fb71d07ad service nova] Creating event network-vif-plugged:3b7a8ccf-8a67-4962-a826-7c8794637171 for instance a3cb6b4d-acca-4003-9615-80df2cffdc58 on n-h1-854119-9 Aug 29 05:03:46.975202 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5449de66-a262-47a6-91f5-1027d759b130 req-70cc50e7-83ad-4c6b-a9c1-f45fb71d07ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052350 Aug 29 05:03:46.977109 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1531/3134] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:46.986349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:46.993725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:47.013535 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2ca1732-d98a-40a2-8d34-9e2a469c3f58 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9264cb56-54ce-43fd-a958-040b3c7aea25" status: 202 len: 0 microversion: 2.1 time: 1.357931 Aug 29 05:03:47.015636 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1604/3135] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:45 2022] DELETE /compute/v2.1/os-security-groups/9264cb56-54ce-43fd-a958-040b3c7aea25 => generated 0 bytes in 1364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:47.016493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:47.018192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:47.018855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:47.021461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:47.022149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:47.024795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:47.252245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1655090596", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "e8660360-b6cc-44fc-9714-43a67fd1cc2a"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:47.330079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] validate_networks() for [('e8660360-b6cc-44fc-9714-43a67fd1cc2a', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:03:47.696219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:47.714724 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa00f493-ecfa-4448-9cde-c3a9a320ccab tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1351 microversion: 2.1 time: 0.735170 Aug 29 05:03:47.715660 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1532/3136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:46 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1351 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:47.734079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-380bb688-0165-46fe-bf07-76833f4f0fa4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] Calling method '.version_select at 0x7f1abd88a5e0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:48.521563 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-380bb688-0165-46fe-bf07-76833f4f0fa4 tempest-SecurityGroupsTestJSON-1697127927 tempest-SecurityGroupsTestJSON-1697127927-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/d3fb9c4e-2c74-44bc-a53c-08b0794094c8" status: 202 len: 0 microversion: 2.1 time: 0.802479 Aug 29 05:03:48.522539 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1533/3137] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:03:47 2022] DELETE /compute/v2.1/os-security-groups/d3fb9c4e-2c74-44bc-a53c-08b0794094c8 => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:03:48.529641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:48.530257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:48.539095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:48.539873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:48.540550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:48.541904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:48.543075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:48.543701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:48.606665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:48.684411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:03:48.686183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:03:48.686855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:03:48.687621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:03:48.688230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:03:48.703197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:48.706569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:48.707284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:48.712480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:48.713356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:48.713999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:48.741055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Getting quotas for project 0fa590adc4ce4a0ca0249a5abd6340a9. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:03:48.751308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Getting quotas for user e421b5bfaefd430fa53ab461f654a517 and project 0fa590adc4ce4a0ca0249a5abd6340a9. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:03:48.774440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:03:48.779860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:03:48.880584 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a6d806e-d2ab-4604-a529-079214788bc4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.860852 Aug 29 05:03:48.882134 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1605/3138] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:03:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:03:48.887276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:48.887911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:48.895172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:48.895672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:48.896107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:48.896849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:48.897294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:48.899972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:49.706784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:49.715760 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-00c5018a-db1a-49a6-a3ef-d0797bdbb569 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1318 microversion: 2.1 time: 1.191820 Aug 29 05:03:49.716410 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1534/3139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:48 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1318 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:49.740607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:49.749900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:49.760399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:49.763281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:49.764079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:49.765095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:49.767076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:49.768882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:50.421051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:50.431011 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-360edccf-0f88-4b5a-a965-29d7dcc65d47 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1312 microversion: 2.1 time: 1.547763 Aug 29 05:03:50.436922 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1606/3140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:48 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1312 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:50.459607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:50.461902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:50.477494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:50.478037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:50.486936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:50.487735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:50.488248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:50.488724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:50.669414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:50.680936 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bd331279-2fe8-4daa-a9fb-387149ba1666 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1277 microversion: 2.1 time: 0.242316 Aug 29 05:03:50.685043 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1607/3141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:50 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:50.695299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b5d5b54b-62b1-480c-88d5-473b2af6abb1 req-48fd75cb-4019-4cb2-b9f7-5d8d71785aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2091778-a689-4f77-8d54-f6c5dae8d925", "tag": "3238576c-b102-4b5f-addd-e650b3451574"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:50.722830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b5d5b54b-62b1-480c-88d5-473b2af6abb1 req-48fd75cb-4019-4cb2-b9f7-5d8d71785aa1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:50.723367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b5d5b54b-62b1-480c-88d5-473b2af6abb1 req-48fd75cb-4019-4cb2-b9f7-5d8d71785aa1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:50.723799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b5d5b54b-62b1-480c-88d5-473b2af6abb1 req-48fd75cb-4019-4cb2-b9f7-5d8d71785aa1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:50.758771 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b5d5b54b-62b1-480c-88d5-473b2af6abb1 req-48fd75cb-4019-4cb2-b9f7-5d8d71785aa1 service nova] Creating event network-changed:3238576c-b102-4b5f-addd-e650b3451574 for instance e2091778-a689-4f77-8d54-f6c5dae8d925 on n-h1-854119-9 Aug 29 05:03:50.766077 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b5d5b54b-62b1-480c-88d5-473b2af6abb1 req-48fd75cb-4019-4cb2-b9f7-5d8d71785aa1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077974 Aug 29 05:03:50.769515 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1608/3142] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:50.783831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:50.784932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:50.802629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:50.803999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:50.804755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:50.804960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:50.806140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:50.806603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:50.818664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:50.820748 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-94c0486c-54a6-4510-a78a-636fa6a3db3b tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1351 microversion: 2.1 time: 1.083657 Aug 29 05:03:50.823805 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1535/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:49 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1351 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:51.460155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:51.461324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:51.475643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=14 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:51.487056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:51.488773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:51.494547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:51.497004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:51.497658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:51.500887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:52.052523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:52.061928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13fc48e6-f643-4a8b-b01d-235256a4b76f tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1318 microversion: 2.1 time: 1.290518 Aug 29 05:03:52.062515 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1609/3144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:50 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1318 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:52.072547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:52.083133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:52.109875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:52.110368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:52.110803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:52.111513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:52.111956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:52.112411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:52.394183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:52.411343 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1bf3fea0-5c4a-4a63-beb2-7f7346bec309 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1277 microversion: 2.1 time: 0.345301 Aug 29 05:03:52.425969 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1610/3145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:52 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1277 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:52.434573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:52.435858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:52.443909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:52.444669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:52.445434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:52.446800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:52.447445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:52.448026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:52.763097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:52.771144 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-76a4af0f-316f-44b8-8fff-3f931160aa8a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1312 microversion: 2.1 time: 1.321093 Aug 29 05:03:52.776526 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1536/3146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:51 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1312 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:53.085362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:53.085995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:53.097333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:53.097828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:53.098299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:53.099013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:53.102334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:53.104663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:53.152635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:53.165410 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e30288f-0500-43b7-82c8-2c0138ac3f31 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1542 microversion: 2.1 time: 0.735942 Aug 29 05:03:53.167431 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1611/3147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:52 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1542 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:53.190907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a650060-13a7-41cc-8c20-dca0091a16e9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:53.191663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9a650060-13a7-41cc-8c20-dca0091a16e9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:53.203289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a650060-13a7-41cc-8c20-dca0091a16e9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:53.204046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a650060-13a7-41cc-8c20-dca0091a16e9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:53.209719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a650060-13a7-41cc-8c20-dca0091a16e9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:53.210542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a650060-13a7-41cc-8c20-dca0091a16e9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:53.211539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a650060-13a7-41cc-8c20-dca0091a16e9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:53.211973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a650060-13a7-41cc-8c20-dca0091a16e9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:53.346885 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a650060-13a7-41cc-8c20-dca0091a16e9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160191 Aug 29 05:03:53.347490 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1612/3148] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:03:53 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:03:53.432311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:53.432944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:53.441102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:53.448058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:53.448912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:53.449585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:53.450520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:53.451191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:53.451804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:53.459292 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-884ce837-cc6d-49c6-ad22-38efe797ffff tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1318 microversion: 2.1 time: 0.376215 Aug 29 05:03:53.461920 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1537/3149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:53 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:53.597102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:53.608916 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-803a343c-df34-4b75-95a3-94ae610b0a3a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1277 microversion: 2.1 time: 0.180403 Aug 29 05:03:53.629204 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1613/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:53 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:03:53.792165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:53.792769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:53.820038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:53.820933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:53.821584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:53.822500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:53.823120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:53.823708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:54.486031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:54.488046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:54.500868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:54.504958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:54.505567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:54.506949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:54.509887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:54.510399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:55.351115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:55.365263 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-57b66f9c-db6d-4ff3-8c84-c94abe089348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1333 microversion: 2.1 time: 1.573140 Aug 29 05:03:55.367758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1538/3151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:53 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1333 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:55.385253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:55.385938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:55.394208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:55.394710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:55.395213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:55.396027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:55.396708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:55.397137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:55.477250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:55.486456 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-625aa0ff-426f-497d-88a4-c4521cb8ddbb tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1318 microversion: 2.1 time: 1.004516 Aug 29 05:03:55.490815 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1614/3152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:54 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1318 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:03:55.501914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3d80277e-6a34-40e3-be1f-394fc5224652 req-b3cfe157-c865-4370-89e1-1493fc5ef077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57eb998e-23ed-4714-aa71-9cdf6f18d2d8", "name": "network-vif-plugged", "status": "completed", "tag": "0635a447-7042-4658-95e7-207049a14dfa"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:55.520229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3d80277e-6a34-40e3-be1f-394fc5224652 req-b3cfe157-c865-4370-89e1-1493fc5ef077 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:55.520714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3d80277e-6a34-40e3-be1f-394fc5224652 req-b3cfe157-c865-4370-89e1-1493fc5ef077 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:55.521141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3d80277e-6a34-40e3-be1f-394fc5224652 req-b3cfe157-c865-4370-89e1-1493fc5ef077 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:55.554034 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3d80277e-6a34-40e3-be1f-394fc5224652 req-b3cfe157-c865-4370-89e1-1493fc5ef077 service nova] Creating event network-vif-plugged:0635a447-7042-4658-95e7-207049a14dfa for instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 on n-h1-854119-9 Aug 29 05:03:55.559857 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3d80277e-6a34-40e3-be1f-394fc5224652 req-b3cfe157-c865-4370-89e1-1493fc5ef077 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067484 Aug 29 05:03:55.564414 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1615/3153] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:55.678373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:55.689641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-881b0aea-3f0a-450a-b6aa-09100acd3052 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1283 microversion: 2.1 time: 0.320081 Aug 29 05:03:55.691445 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1539/3154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:55 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1283 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:56.390038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:56.391532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:56.422942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:56.423441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:56.424927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:56.426422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:56.427328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:56.427915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:56.509963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:56.511472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:56.521447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:56.522192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:56.522852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:56.524094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:56.524792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:56.525680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:57.523304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:57.534230 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c57c47d-8b4a-4eee-89cd-e906b61918e4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1318 microversion: 2.1 time: 1.028151 Aug 29 05:03:57.547097 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1540/3155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:56 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1318 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:03:57.553590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:57.554751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:57.561810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:57.562626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:57.563221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:57.564188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:57.565065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:57.566048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:57.638383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:57.671733 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de74eb40-bc98-4547-9eb7-c0e6e47ed2c6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1333 microversion: 2.1 time: 1.286433 Aug 29 05:03:57.674437 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1616/3156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:56 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1333 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:57.677755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:57.686785 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be9a133e-b689-4093-b78c-6e4f3e03d6d0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1283 microversion: 2.1 time: 0.138506 Aug 29 05:03:57.690016 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1541/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:57 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1283 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:58.465731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-decf0442-f4d3-4e6c-8c32-f26d7c550959 req-473936e6-31fc-4eb2-b197-d200a6ef6375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3cb6b4d-acca-4003-9615-80df2cffdc58", "tag": "3b7a8ccf-8a67-4962-a826-7c8794637171"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:03:58.488474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-decf0442-f4d3-4e6c-8c32-f26d7c550959 req-473936e6-31fc-4eb2-b197-d200a6ef6375 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:58.490509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-decf0442-f4d3-4e6c-8c32-f26d7c550959 req-473936e6-31fc-4eb2-b197-d200a6ef6375 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:58.492296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-decf0442-f4d3-4e6c-8c32-f26d7c550959 req-473936e6-31fc-4eb2-b197-d200a6ef6375 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:58.517044 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-decf0442-f4d3-4e6c-8c32-f26d7c550959 req-473936e6-31fc-4eb2-b197-d200a6ef6375 service nova] Creating event network-changed:3b7a8ccf-8a67-4962-a826-7c8794637171 for instance a3cb6b4d-acca-4003-9615-80df2cffdc58 on n-h1-854119-9 Aug 29 05:03:58.541450 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-decf0442-f4d3-4e6c-8c32-f26d7c550959 req-473936e6-31fc-4eb2-b197-d200a6ef6375 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078816 Aug 29 05:03:58.544776 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1617/3158] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:03:58.561390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:58.568212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:58.598400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:58.599021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:58.600169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:58.604001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:58.605052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:58.605711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:58.698136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:58.698952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:58.716765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:58.718024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:58.718987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:58.721277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:58.723354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:58.725019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:58.739017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:58.773632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:03:59.636869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:59.653686 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b63e2819-fce4-4fd4-9f2f-08a3ce0f240b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1318 microversion: 2.1 time: 1.097974 Aug 29 05:03:59.654663 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1542/3159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:58 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1318 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:59.659452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:03:59.660063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:03:59.673093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:59.674872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:59.675744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:59.682196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:03:59.682916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:03:59.683561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:03:59.886507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:03:59.900222 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7bcc1d38-08c8-4bab-b1d2-8d4bf799a480 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 1.207983 Aug 29 05:03:59.902135 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1618/3160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:58 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:03:59.979557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-778485e9-9454-4f54-b7aa-cf3af8c6c4c2 req-865cf94e-351f-43ee-8df7-f95ebf1438dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2091778-a689-4f77-8d54-f6c5dae8d925", "name": "network-vif-plugged", "status": "completed", "tag": "3238576c-b102-4b5f-addd-e650b3451574"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:00.001297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-778485e9-9454-4f54-b7aa-cf3af8c6c4c2 req-865cf94e-351f-43ee-8df7-f95ebf1438dd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:00.002170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-778485e9-9454-4f54-b7aa-cf3af8c6c4c2 req-865cf94e-351f-43ee-8df7-f95ebf1438dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:00.003296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-778485e9-9454-4f54-b7aa-cf3af8c6c4c2 req-865cf94e-351f-43ee-8df7-f95ebf1438dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:00.031426 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-778485e9-9454-4f54-b7aa-cf3af8c6c4c2 req-865cf94e-351f-43ee-8df7-f95ebf1438dd service nova] Creating event network-vif-plugged:3238576c-b102-4b5f-addd-e650b3451574 for instance e2091778-a689-4f77-8d54-f6c5dae8d925 on n-h1-854119-9 Aug 29 05:04:00.046259 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-778485e9-9454-4f54-b7aa-cf3af8c6c4c2 req-865cf94e-351f-43ee-8df7-f95ebf1438dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071640 Aug 29 05:04:00.048298 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1619/3161] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:00.677939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:00.679051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:00.691652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:00.704954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:00.705824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:00.706798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:00.707537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:00.708204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:01.020722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:01.037875 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8b87151-149a-4e49-9a29-e299094e54b2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 1.381955 Aug 29 05:04:01.038487 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1543/3162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:03:59 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:01.069315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:01.077288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:01.100527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:01.101036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:01.101471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:01.102190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:01.102639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:01.103055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:02.297693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:02.306276 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-154b84a5-8a8d-4101-8f6a-be7d90df5d11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 1.251330 Aug 29 05:04:02.333003 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1544/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:01 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:02.337889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:02.339287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:02.363922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:02.364456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:02.364873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:02.365591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:02.366035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:02.366461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:02.428256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:02.431567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:02.441048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23a7a3fd-2272-41e6-8793-f5041e6da3c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1318 microversion: 2.1 time: 1.767937 Aug 29 05:04:02.459169 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1620/3164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:00 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1318 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:03.328356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:03.329273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:03.361053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:03.365642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:03.367963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:03.370115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:03.373395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:03.378938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:03.381882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:03.383448 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0aae0619-9661-4acc-bd6f-30803b2e0fde tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 1.049179 Aug 29 05:04:03.387677 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1545/3165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:02 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:03.473903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:03.475128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:03.486640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:03.487524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:03.489680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:03.491031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:03.492827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:03.494858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:03.558796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:04.097887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:04.112151 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2ed2397-670b-4241-89b3-0a606d88ab2b tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 200 len: 1505 microversion: 2.1 time: 0.650162 Aug 29 05:04:04.132594 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1546/3166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:03 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 1505 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:04.138370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "tag": "a758dc84-817f-43d7-9e8d-529e3588a2af"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:04.150468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:04.150962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:04.151404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:04.163891 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] Creating event network-changed:a758dc84-817f-43d7-9e8d-529e3588a2af for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:04.168343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:04.183650 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.860510 Aug 29 05:04:04.189737 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1621/3167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:03 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:04.190976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:04.193427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-419b78e6-3073-4d72-afa9-d297c8e54e46 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002750 Aug 29 05:04:04.194326 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060313 Aug 29 05:04:04.194748 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1622/3168] 10.222.0.20 () {56 vars in 886 bytes} [Mon Aug 29 05:04:04 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 05:04:04.201803 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1547/3169] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:04.202287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:04.203737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:04.205086 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002735 Aug 29 05:04:04.211706 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1548/3170] 10.222.0.20 () {54 vars in 1035 bytes} [Mon Aug 29 05:04:04 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 29 05:04:04.212379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:04.214157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:04.215289 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 29 05:04:04.222305 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1549/3171] 10.222.0.20 () {54 vars in 1041 bytes} [Mon Aug 29 05:04:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:04.222490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:04.224473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:04.225542 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e129f91d-84b4-4192-8784-e8f006acde10 req-fa67efda-83b1-4796-92e6-e2381688df70 service nova] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001618 Aug 29 05:04:04.226442 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1550/3172] 10.222.0.20 () {56 vars in 886 bytes} [Mon Aug 29 05:04:04 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 29 05:04:04.226904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:04.227440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:04.228250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:04.228673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:04.229092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:04.407284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:04.408002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:04.422663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:04.424148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:04.426528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:04.428995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:04.431060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:04.433176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:05.143576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:05.151849 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb3a4719-f9fc-4c57-8560-0486b85dee7c tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8" status: 200 len: 1506 microversion: 2.1 time: 0.955504 Aug 29 05:04:05.155237 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1623/3173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:04 2022] GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 => generated 1506 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:05.299229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:05.312912 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9949f7b8-3fd3-4fcb-9367-bdcd7f8dabdf tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 0.910334 Aug 29 05:04:05.325107 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1551/3174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:04 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:05.336264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:05.336837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:05.341317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-675616986", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "ddb4f3f9-e69a-4892-a399-291ce3099035"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:05.349090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:05.349595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:05.350030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:05.350740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:05.351190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:05.356491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:05.409545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:04:05.419228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] validate_networks() for [('ddb4f3f9-e69a-4892-a399-291ce3099035', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:04:05.555802 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-41038b88-d106-4b01-8789-282fcddf0130 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8" status: 204 len: 0 microversion: 2.1 time: 0.229007 Aug 29 05:04:05.557322 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1552/3175] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:04:05 2022] DELETE /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:04:05.565039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:05.567148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:05.580029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:05.580880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:05.581477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:05.582504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:05.583204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:05.583799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:06.030977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:06.042653 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5b23ecd9-4213-40c7-8bb4-593da56d1569 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.483817 Aug 29 05:04:06.043515 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1553/3176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:05 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:06.051319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:06.051319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:06.069370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:06.069874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:06.070308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:06.071019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:06.071480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:06.072019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:06.105570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:04:06.371189 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6cddd6e3-302b-442d-acea-94d251270331 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 204 len: 0 microversion: 2.1 time: 0.326360 Aug 29 05:04:06.372368 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1554/3177] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:04:06 2022] DELETE /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:04:06.378058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f75ac23c-1fb2-443e-a060-734771f2cdb6 req-dc38f977-481f-4f8e-b66e-dafc0dd0be88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8ac4e6-a814-4021-8602-39425a3b988f", "tag": "fc99705d-32a5-44a4-bc68-8d290d1f18d6"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:06.388394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f75ac23c-1fb2-443e-a060-734771f2cdb6 req-dc38f977-481f-4f8e-b66e-dafc0dd0be88 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:06.389015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f75ac23c-1fb2-443e-a060-734771f2cdb6 req-dc38f977-481f-4f8e-b66e-dafc0dd0be88 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:06.389652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f75ac23c-1fb2-443e-a060-734771f2cdb6 req-dc38f977-481f-4f8e-b66e-dafc0dd0be88 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:06.408919 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f75ac23c-1fb2-443e-a060-734771f2cdb6 req-dc38f977-481f-4f8e-b66e-dafc0dd0be88 service nova] Creating event network-changed:fc99705d-32a5-44a4-bc68-8d290d1f18d6 for instance 9b8ac4e6-a814-4021-8602-39425a3b988f on n-h1-854119-9 Aug 29 05:04:06.435095 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f75ac23c-1fb2-443e-a060-734771f2cdb6 req-dc38f977-481f-4f8e-b66e-dafc0dd0be88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061028 Aug 29 05:04:06.436021 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1555/3178] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:06.441180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:06.441944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:06.461069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:06.461571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:06.462003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:06.468849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:06.469951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:06.470582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:06.643053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:04:06.643672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:04:06.643672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:04:06.644042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:04:06.644535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:04:06.668895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:06.669418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:06.670033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:06.671345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:06.671952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:06.672544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:06.708391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Getting quotas for project c22827f5239842eb8960393603ac0425. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:04:06.726143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Getting quotas for user 91d60a898cd54c4bb8d13e9ee9284c33 and project c22827f5239842eb8960393603ac0425. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:04:06.753609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:04:06.756829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:04:06.849830 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba6dfaf4-3a7f-4499-ac80-123e67bb3df8 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.688636 Aug 29 05:04:06.850670 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1624/3179] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:04:06.859985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:06.860624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:06.871880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:06.872594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:06.873032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:06.874085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:06.876561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:06.878087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:07.467181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:07.483204 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de44af10-11e2-4853-862f-3e5bc6114f21 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 1.045317 Aug 29 05:04:07.484582 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1556/3180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:06 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:07.498638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-90ce81bb-2da2-41b0-8890-5e25ddb0fecd tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:07.499520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-90ce81bb-2da2-41b0-8890-5e25ddb0fecd tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:07.598052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-90ce81bb-2da2-41b0-8890-5e25ddb0fecd tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:07.606401 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-90ce81bb-2da2-41b0-8890-5e25ddb0fecd tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1216 microversion: 2.1 time: 0.120058 Aug 29 05:04:07.609063 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1557/3181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:07 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:07.622532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:07.623219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:07.645915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:07.646424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:07.646865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:07.647346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:07.647815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:07.648028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:07.648481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:07.655519 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f97ed703-bb57-4fe1-b393-57aa22d447fd tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8" status: 200 len: 1512 microversion: 2.1 time: 0.803799 Aug 29 05:04:07.656084 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1625/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:06 2022] GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 => generated 1512 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:07.801527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:07.809678 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60ac0b4a-8132-4cc0-98cb-6f35a5ef0850 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.199175 Aug 29 05:04:07.810263 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1558/3183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:07 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:08.452068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2c719fd8-eed4-4fac-b904-2a7647da998c req-f7e6926c-846c-4c00-b2fd-9c4f982d97a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "tag": "5adaac4c-5aff-4ea2-a542-c2ea2d00086e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:08.468802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2c719fd8-eed4-4fac-b904-2a7647da998c req-f7e6926c-846c-4c00-b2fd-9c4f982d97a3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:08.469294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2c719fd8-eed4-4fac-b904-2a7647da998c req-f7e6926c-846c-4c00-b2fd-9c4f982d97a3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:08.469783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2c719fd8-eed4-4fac-b904-2a7647da998c req-f7e6926c-846c-4c00-b2fd-9c4f982d97a3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:08.483948 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2c719fd8-eed4-4fac-b904-2a7647da998c req-f7e6926c-846c-4c00-b2fd-9c4f982d97a3 service nova] Creating event network-changed:5adaac4c-5aff-4ea2-a542-c2ea2d00086e for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:08.494160 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2c719fd8-eed4-4fac-b904-2a7647da998c req-f7e6926c-846c-4c00-b2fd-9c4f982d97a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045809 Aug 29 05:04:08.499794 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1626/3184] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:08.508347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:08.509065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:08.520711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:08.521509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:08.522341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:08.524548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:08.525649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:08.526612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:08.638033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:08.639170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:08.648755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:08.649380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:08.650288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:08.651500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:08.652585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:08.653236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:08.783676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:08.791047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:08.796994 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa83b59d-c836-44d9-b48e-7cf72fab65ff tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1220 microversion: 2.1 time: 0.168948 Aug 29 05:04:08.798734 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1627/3185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:08 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1220 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:08.803978 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bb56c03f-2f9f-4eb5-b4a0-ce3bff48d675 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 0.298634 Aug 29 05:04:08.805205 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1559/3186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:08 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:08.813958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:08.814879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:08.828448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:08.829092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:08.829531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:08.830255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:08.830700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:08.830865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:08.831435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:08.832356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:08.845617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:08.846506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:08.847129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:08.847890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:08.848667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:08.850051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:09.077342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:09.089415 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-681ce154-60f1-40b7-9ede-2818620acaf0 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8" status: 200 len: 1512 microversion: 2.1 time: 0.289212 Aug 29 05:04:09.092317 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1628/3187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:08 2022] GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 => generated 1512 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:09.115722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:09.126168 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-791c4373-0bf3-4b11-95cc-ba07b77600bb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.299452 Aug 29 05:04:09.126803 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1560/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:08 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:09.818727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:09.819622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:09.826321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:09.828061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:09.829704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:09.830500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:09.831110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:09.831990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:09.833110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:09.833710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:09.839771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:09.840405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:09.841016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:09.841830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:09.842383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:09.842905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:09.924238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:09.935518 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3053ae50-4058-472a-956f-16cc344c7317 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1220 microversion: 2.1 time: 0.121903 Aug 29 05:04:09.937649 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1629/3189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:09 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1220 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:10.030853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:10.038792 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a52495a-80d0-4fc0-a53e-6be601b35a9a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 0.217600 Aug 29 05:04:10.039382 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1561/3190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:09 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:10.113612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:10.114687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:10.121647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:10.122262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:10.122938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:10.123750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:10.124401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:10.125029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:10.148438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:10.149333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:10.155522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:10.167145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:10.167900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:10.168678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:10.169141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:10.169726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:10.454705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:10.464511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06ffade7-3660-4a9b-8f6a-44898f1128d1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.319960 Aug 29 05:04:10.468462 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1562/3191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:10 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:10.482572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:10.503612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-390f3f73-97e3-450d-8b50-bcbc4eec6d2e tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8" status: 200 len: 1512 microversion: 2.1 time: 0.393874 Aug 29 05:04:10.504306 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1630/3192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:10 2022] GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:10.958790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:10.959402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:10.977434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:10.977927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:10.978340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:10.979156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:10.979737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:10.980170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:11.061635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:11.062280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:11.070562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:11.071272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:11.071882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:11.072775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:11.073414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:11.074007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:11.618825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:11.631587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e76d725b-ad29-4636-9cf1-4d5cf9c24017 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1268 microversion: 2.1 time: 0.676626 Aug 29 05:04:11.632424 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1563/3193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:10 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1268 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:11.639044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:11.645045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:11.646337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Searching by: {'deleted': False, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:04:11.652314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:11.653006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:11.653601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:11.654502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:11.655114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:11.656045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:11.690853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:04:11.710260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:11.728219 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f5884312-6150-439b-bba6-d1ccc9674b03 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 332 microversion: 2.1 time: 0.094308 Aug 29 05:04:11.729208 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1564/3194] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:04:11 2022] GET /compute/v2.1/servers => generated 332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:11.734745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-35146c9f-f573-4253-ba7c-449a4f72f206 req-127fe134-78f6-4874-b7e6-30a09092b7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57eb998e-23ed-4714-aa71-9cdf6f18d2d8", "name": "network-vif-unplugged", "status": "completed", "tag": "0635a447-7042-4658-95e7-207049a14dfa"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:11.745802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-35146c9f-f573-4253-ba7c-449a4f72f206 req-127fe134-78f6-4874-b7e6-30a09092b7bb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:11.746598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-35146c9f-f573-4253-ba7c-449a4f72f206 req-127fe134-78f6-4874-b7e6-30a09092b7bb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:11.747322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-35146c9f-f573-4253-ba7c-449a4f72f206 req-127fe134-78f6-4874-b7e6-30a09092b7bb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:11.759932 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-35146c9f-f573-4253-ba7c-449a4f72f206 req-127fe134-78f6-4874-b7e6-30a09092b7bb service nova] Creating event network-vif-unplugged:0635a447-7042-4658-95e7-207049a14dfa for instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 on n-h1-854119-9 Aug 29 05:04:11.767799 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-35146c9f-f573-4253-ba7c-449a4f72f206 req-127fe134-78f6-4874-b7e6-30a09092b7bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037085 Aug 29 05:04:11.773359 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1565/3195] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:11.778740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:11.779081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:11.786695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:11.787190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:11.788142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:11.788346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:11.788802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:11.789459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:12.398394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:12.409308 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d148d6c3-e74a-4d4e-9020-92a3de994127 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 1.351671 Aug 29 05:04:12.411706 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1631/3196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:11 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:12.422893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:12.424523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:12.440191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:12.441040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:12.441674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:12.442538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:12.443144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:12.443753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:12.659127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:12.667273 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9636fee-9082-44ca-bf00-5e26a4f71f77 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.892905 Aug 29 05:04:12.668077 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1566/3197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:11 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:12.686814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:12.692521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:12.693461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Searching by: {'deleted': False, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:04:12.698950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:12.699676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:12.700286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:12.701196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:12.702143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:12.703034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:12.733504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:04:12.782438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:12.788926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:12.789407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:12.789835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:13.493358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:13.506413 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0cded38d-2e9b-488b-ada1-0139004a1c36 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8" status: 200 len: 1512 microversion: 2.1 time: 1.091073 Aug 29 05:04:13.507523 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1632/3198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:12 2022] GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 => generated 1512 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:13.513314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:13.514184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:13.527887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:13.531574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:13.532227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:13.533163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:13.533746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:13.534282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:13.804224 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-db074b23-aba0-4dce-a564-a6f3e9e21a5e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 1.121336 Aug 29 05:04:13.805356 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1567/3199] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 05:04:12 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:13.807235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:13.815912 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c1ab5424-63f4-4ace-bb05-864fa387bdf3 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1274 microversion: 2.1 time: 0.306526 Aug 29 05:04:13.816584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1633/3200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:13 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1274 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:13.821959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5c0a24be-17b6-419e-9f78-b30c9a39eef4 req-2cc0fdc7-a67c-48ee-896c-81950090e5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "tag": "d66987d8-b98e-418f-859f-09b227f23c11"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:13.836507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:13.837978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:13.838298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5c0a24be-17b6-419e-9f78-b30c9a39eef4 req-2cc0fdc7-a67c-48ee-896c-81950090e5b7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:13.838985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5c0a24be-17b6-419e-9f78-b30c9a39eef4 req-2cc0fdc7-a67c-48ee-896c-81950090e5b7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:13.839429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5c0a24be-17b6-419e-9f78-b30c9a39eef4 req-2cc0fdc7-a67c-48ee-896c-81950090e5b7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:13.848574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:13.851129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:13.851947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:13.852651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:13.854620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:13.855287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:13.857033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:13.872645 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5c0a24be-17b6-419e-9f78-b30c9a39eef4 req-2cc0fdc7-a67c-48ee-896c-81950090e5b7 service nova] Creating event network-changed:d66987d8-b98e-418f-859f-09b227f23c11 for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:13.892735 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5c0a24be-17b6-419e-9f78-b30c9a39eef4 req-2cc0fdc7-a67c-48ee-896c-81950090e5b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070892 Aug 29 05:04:13.893874 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1634/3201] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:13.901593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:13.902489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:13.910925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:13.911638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:13.912254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:13.913290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:13.913889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:13.914457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:14.816025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:14.840019 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b23997d-3546-4323-b8a6-53fa08e0b25b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 1.032960 Aug 29 05:04:14.840901 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1568/3202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:13 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:14.868746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce9f81ce-c03b-480a-966a-f1cd7aa77ee1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:14.890252 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ce9f81ce-c03b-480a-966a-f1cd7aa77ee1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034333 Aug 29 05:04:14.902827 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1569/3203] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 05:04:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:14.909414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:14.915090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:14.925429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:14.931648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:14.933999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:14.935099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:14.937732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:14.938704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:14.997952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:15.007719 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee883511-3a77-4614-83a8-751c3888d8dd tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 1.112188 Aug 29 05:04:15.016254 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1635/3204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:13 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:15.029037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:15.035753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:15.048871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:15.053281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:15.054065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:15.054713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:15.055658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:15.056366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:15.057003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:15.180787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:15.191064 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ab6e7fb-d302-4dd2-8200-259638641df1 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8" status: 200 len: 1470 microversion: 2.1 time: 0.286772 Aug 29 05:04:15.197503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:15.206666 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1570/3205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:14 2022] GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 => generated 1470 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:15.209298 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-72162002-6204-4bb1-a810-0bf455228e7e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1274 microversion: 2.1 time: 0.191621 Aug 29 05:04:15.215239 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1636/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:15 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:15.396739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:15.398086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:15.415839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:15.417357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:15.419705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:15.420881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:15.421780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:15.422377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:15.488735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:04:15.712294 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-caf687c1-35d4-4ecd-b01a-597074f15037 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 204 len: 0 microversion: 2.1 time: 0.321749 Aug 29 05:04:15.713187 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1571/3207] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:04:15 2022] DELETE /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:04:15.721576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:15.722447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:15.731585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:15.743473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:15.745081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:15.746107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:15.746886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:15.747496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:15.802286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d3fe873c-3a51-42d3-a99e-9709320dc6ce req-92e1e9c5-2ec6-4d3c-935d-a8256a805eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8ac4e6-a814-4021-8602-39425a3b988f", "name": "network-vif-plugged", "status": "completed", "tag": "fc99705d-32a5-44a4-bc68-8d290d1f18d6"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:15.822796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d3fe873c-3a51-42d3-a99e-9709320dc6ce req-92e1e9c5-2ec6-4d3c-935d-a8256a805eb3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:15.823404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d3fe873c-3a51-42d3-a99e-9709320dc6ce req-92e1e9c5-2ec6-4d3c-935d-a8256a805eb3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:15.823688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d3fe873c-3a51-42d3-a99e-9709320dc6ce req-92e1e9c5-2ec6-4d3c-935d-a8256a805eb3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:15.856353 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d3fe873c-3a51-42d3-a99e-9709320dc6ce req-92e1e9c5-2ec6-4d3c-935d-a8256a805eb3 service nova] Creating event network-vif-plugged:fc99705d-32a5-44a4-bc68-8d290d1f18d6 for instance 9b8ac4e6-a814-4021-8602-39425a3b988f on n-h1-854119-9 Aug 29 05:04:15.867398 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d3fe873c-3a51-42d3-a99e-9709320dc6ce req-92e1e9c5-2ec6-4d3c-935d-a8256a805eb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070054 Aug 29 05:04:15.883817 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1572/3208] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:15.900828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:15.905412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:15.920517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:15.921033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:15.921474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:15.925218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:15.927957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:15.928535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:16.167896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:16.176545 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ed8f0d5-86a7-4388-9bd6-2ad1f2770512 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 0.288422 Aug 29 05:04:16.177314 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1573/3209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:15 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:16.182038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-af0c8278-88df-440c-8d33-cd820aeb21e5 req-e682b15b-b9ef-4f52-9215-0a3ae41e7ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2091778-a689-4f77-8d54-f6c5dae8d925", "name": "network-vif-deleted", "tag": "3238576c-b102-4b5f-addd-e650b3451574"}, {"server_uuid": "57eb998e-23ed-4714-aa71-9cdf6f18d2d8", "name": "network-vif-deleted", "tag": "0635a447-7042-4658-95e7-207049a14dfa"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:16.192806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-af0c8278-88df-440c-8d33-cd820aeb21e5 req-e682b15b-b9ef-4f52-9215-0a3ae41e7ee6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:16.193579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-af0c8278-88df-440c-8d33-cd820aeb21e5 req-e682b15b-b9ef-4f52-9215-0a3ae41e7ee6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:16.194001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-af0c8278-88df-440c-8d33-cd820aeb21e5 req-e682b15b-b9ef-4f52-9215-0a3ae41e7ee6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:16.208963 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-af0c8278-88df-440c-8d33-cd820aeb21e5 req-e682b15b-b9ef-4f52-9215-0a3ae41e7ee6 service nova] Creating event network-vif-deleted:3238576c-b102-4b5f-addd-e650b3451574 for instance e2091778-a689-4f77-8d54-f6c5dae8d925 on n-h1-854119-9 Aug 29 05:04:16.209739 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-af0c8278-88df-440c-8d33-cd820aeb21e5 req-e682b15b-b9ef-4f52-9215-0a3ae41e7ee6 service nova] Creating event network-vif-deleted:0635a447-7042-4658-95e7-207049a14dfa for instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 on n-h1-854119-9 Aug 29 05:04:16.217865 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-af0c8278-88df-440c-8d33-cd820aeb21e5 req-e682b15b-b9ef-4f52-9215-0a3ae41e7ee6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039248 Aug 29 05:04:16.218930 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1574/3210] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:16.224486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:16.225687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:16.232474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:16.233222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:16.234332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:16.235766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:16.236389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:16.236955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:16.266814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:16.276763 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa472bb5-3923-4d42-965f-517c3bc13e33 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1698 microversion: 2.1 time: 0.559090 Aug 29 05:04:16.277423 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1637/3211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:15 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1698 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:16.283996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:16.285386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:16.292022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:16.293711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:16.296316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:16.297567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:16.298112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:16.298543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:16.339108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:16.339586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:16.340060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:16.340527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lazy-loading 'fault' on Instance uuid 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:04:16.457611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5778008702451e9e25aec8bafb13f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b233cdda0d464bbd9063556d05f94f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:16.466393 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-44590a30-2da8-44ee-a242-6882894190c4 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8" status: 200 len: 1308 microversion: 2.1 time: 0.187716 Aug 29 05:04:16.467047 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1638/3212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:16 2022] GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:16.491716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:16.492670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:16.499168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:16.499874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:16.500502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:16.501399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:16.502010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:16.502600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:16.593683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:16.602933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c47f70a9-2b56-4c4d-85a3-12c5c01af704 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.382540 Aug 29 05:04:16.618540 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1575/3213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:16 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:16.684377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:16.734746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:16.744496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:16.756588 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cde58135-7a91-45af-bc60-811d5eec45fe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1316 microversion: 2.1 time: 0.268484 Aug 29 05:04:16.757715 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1639/3214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:16 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:17.200844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:17.202166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:17.210713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:17.211503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:17.212098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:17.214470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:17.215110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:17.215753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:17.299271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:17.300738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:17.315144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:17.315899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:17.316656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:17.318634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:17.321504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:17.322732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:17.336141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:18.232810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:18.260112 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98d28be4-7cd2-4fa7-bbf1-b2ef4042888e tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1698 microversion: 2.1 time: 0.961682 Aug 29 05:04:18.261731 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1640/3215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:17 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1698 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:18.284388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:18.286638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: 57eb998e-23ed-4714-aa71-9cdf6f18d2d8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:18.293633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:18.305619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:18.306927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:18.308327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:18.310424 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a538d704-8772-4902-ba95-4ca44fa6723b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 1.115352 Aug 29 05:04:18.311086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:18.312271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:18.313594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:18.322364 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1576/3216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:17 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:18.333503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:18.334749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:18.335755 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] HTTP exception thrown: Instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 could not be found. Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Request method failure captured: Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 HTTP/1.1 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEh2J-BjZd9CyAzP233107RsjzQ_zv21-4Rc9YJK0n1okisFnLnnfl-lLB02hXNNCgquDTpW6zfCsEPCynoGgAmqMhW1x-ldJkdQ1_1JFh3yzWdcD9sVuDD9e57ENYOLVCwGWrzwhliPdlXFrnV4T7KjkTuba_zYAe9UTWPMPjb12xU Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: b233cdda0d464bbd9063556d05f94f32 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-MultipleCreateTestJSON-1695445923 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b233cdda0d464bbd9063556d05f94f32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b233cdda0d464bbd9063556d05f94f32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b233cdda0d464bbd9063556d05f94f32", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b233cdda0d464bbd9063556d05f94f32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-MultipleCreateTestJSON-1695445923 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: b233cdda0d464bbd9063556d05f94f32 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1695445923 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-MultipleCreateTestJSON-1695445923-project Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1b5778008702451e9e25aec8bafb13f3 Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-MultipleCreateTestJSON-1695445923-project Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 could not be found. Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '57eb998e-23ed-4714-aa71-9cdf6f18d2d8'} Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 could not be found. Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 could not be found. Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:18.338611 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.346697 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:18.346697 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:18.346697 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:18.346697 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:04:18.346697 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:04:18.346697 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 could not be found. Aug 29 05:04:18.346697 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.349516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Returning 404 to user: Instance 57eb998e-23ed-4714-aa71-9cdf6f18d2d8 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:18.351022 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eed8bd8e-4ff0-49ef-a8dc-01ee499b9475 tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8" status: 404 len: 111 microversion: 2.1 time: 0.084778 Aug 29 05:04:18.351542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:18.352039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:18.352470 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1641/3217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:18 2022] GET /compute/v2.1/servers/57eb998e-23ed-4714-aa71-9cdf6f18d2d8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:04:18.352601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:18.353336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:18.353653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:18.354076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:18.363184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:18.364146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:18.371901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:18.372770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:18.373440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:18.374560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:18.375271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:18.376249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:18.824516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:18.826945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:18.838032 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b12d358d-9d2f-44fb-a676-1b447df48348 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.514296 Aug 29 05:04:18.839774 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1577/3218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:18 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:18.844416 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4e40a4eb-e453-488e-bd7a-809c2d611c20 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1316 microversion: 2.1 time: 0.483530 Aug 29 05:04:18.845055 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1642/3219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:18 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:18.861654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:18.862558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] [instance: e2091778-a689-4f77-8d54-f6c5dae8d925] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:18.868430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4b78e0cf-7089-4601-8a7c-d39a9e6c1bab req-c64c6570-3768-40b2-9653-72f7ce1b9d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "434c152b-2c37-4895-85ca-49fe3753e202", "tag": "1bc875cf-1274-4a0d-b378-2e23a965347d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:18.877967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:18.879597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:18.880177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:18.882515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:18.885367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:18.886081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:18.898045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4b78e0cf-7089-4601-8a7c-d39a9e6c1bab req-c64c6570-3768-40b2-9653-72f7ce1b9d34 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:18.904070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4b78e0cf-7089-4601-8a7c-d39a9e6c1bab req-c64c6570-3768-40b2-9653-72f7ce1b9d34 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:18.911550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4b78e0cf-7089-4601-8a7c-d39a9e6c1bab req-c64c6570-3768-40b2-9653-72f7ce1b9d34 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:18.915298 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] HTTP exception thrown: Instance e2091778-a689-4f77-8d54-f6c5dae8d925 could not be found. Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Request method failure captured: Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 HTTP/1.1 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEh2J-BjZd9CyAzP233107RsjzQ_zv21-4Rc9YJK0n1okisFnLnnfl-lLB02hXNNCgquDTpW6zfCsEPCynoGgAmqMhW1x-ldJkdQ1_1JFh3yzWdcD9sVuDD9e57ENYOLVCwGWrzwhliPdlXFrnV4T7KjkTuba_zYAe9UTWPMPjb12xU Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: b233cdda0d464bbd9063556d05f94f32 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-MultipleCreateTestJSON-1695445923 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b233cdda0d464bbd9063556d05f94f32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b233cdda0d464bbd9063556d05f94f32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b233cdda0d464bbd9063556d05f94f32", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b233cdda0d464bbd9063556d05f94f32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-MultipleCreateTestJSON-1695445923 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: b233cdda0d464bbd9063556d05f94f32 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1695445923 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-MultipleCreateTestJSON-1695445923-project Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 1b5778008702451e9e25aec8bafb13f3 Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-MultipleCreateTestJSON-1695445923-project Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance e2091778-a689-4f77-8d54-f6c5dae8d925 could not be found. Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'e2091778-a689-4f77-8d54-f6c5dae8d925'} Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2091778-a689-4f77-8d54-f6c5dae8d925 could not be found. Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2091778-a689-4f77-8d54-f6c5dae8d925 could not be found. Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:18.925671 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.930676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:18.930676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:18.930676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:18.930676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:04:18.930676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:04:18.930676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2091778-a689-4f77-8d54-f6c5dae8d925 could not be found. Aug 29 05:04:18.930676 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:18.931361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] Returning 404 to user: Instance e2091778-a689-4f77-8d54-f6c5dae8d925 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:18.932567 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dcefebd6-fabc-4513-a065-067cf3f0d0ce tempest-MultipleCreateTestJSON-1695445923 tempest-MultipleCreateTestJSON-1695445923-project] 10.222.0.20 "GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925" status: 404 len: 111 microversion: 2.1 time: 0.085770 Aug 29 05:04:18.936590 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1643/3220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:18 2022] GET /compute/v2.1/servers/e2091778-a689-4f77-8d54-f6c5dae8d925 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:04:18.938507 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4b78e0cf-7089-4601-8a7c-d39a9e6c1bab req-c64c6570-3768-40b2-9653-72f7ce1b9d34 service nova] Creating event network-changed:1bc875cf-1274-4a0d-b378-2e23a965347d for instance 434c152b-2c37-4895-85ca-49fe3753e202 on n-h1-854119-9 Aug 29 05:04:18.951572 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4b78e0cf-7089-4601-8a7c-d39a9e6c1bab req-c64c6570-3768-40b2-9653-72f7ce1b9d34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110003 Aug 29 05:04:18.952213 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1578/3221] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:19.286563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:19.287852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:19.294776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:19.295512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:19.296299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:19.297597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:19.298221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:19.298639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:19.333739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:19.334452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:19.343611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:19.344097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:19.348704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:19.353197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:19.353835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:19.354552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:20.034361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:20.047858 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b64f218d-5018-4f9a-9801-3bc1cd1539af tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1698 microversion: 2.1 time: 0.765781 Aug 29 05:04:20.060677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:20.061051 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1644/3222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:19 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1698 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:20.068191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:20.069395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:20.073056 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6c1c624-6b46-47c8-8dc5-671e3f457d4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1325 microversion: 2.1 time: 0.745301 Aug 29 05:04:20.073867 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1579/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:19 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1325 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:20.076807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:20.077884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:20.078554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:20.078944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:20.079554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:20.079956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:20.081035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:20.081689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:20.101022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:20.103724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:20.104258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:20.112977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:20.113552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:20.113989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:20.645074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:20.658294 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-02fb35fa-0387-4eb8-a041-1bf385c64107 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.595831 Aug 29 05:04:20.660533 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1645/3224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:20 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:20.686354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:20.696608 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e4874cee-cf0f-484c-97a5-285a60332996 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1316 microversion: 2.1 time: 0.621506 Aug 29 05:04:20.697417 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1580/3225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:20 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:20.971880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3e1cd9f3-11d0-4ac4-8423-0bfb8958859c req-7d1c2808-4881-42e7-b306-aec8cca2c6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed82919b-2f3a-428a-b8bc-020f08560164", "name": "network-vif-deleted", "tag": "72eb5b7a-13b2-4f9f-ae09-5427c7542daa"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:20.992784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3e1cd9f3-11d0-4ac4-8423-0bfb8958859c req-7d1c2808-4881-42e7-b306-aec8cca2c6d9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:20.993625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3e1cd9f3-11d0-4ac4-8423-0bfb8958859c req-7d1c2808-4881-42e7-b306-aec8cca2c6d9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:20.996054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3e1cd9f3-11d0-4ac4-8423-0bfb8958859c req-7d1c2808-4881-42e7-b306-aec8cca2c6d9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:21.021723 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3e1cd9f3-11d0-4ac4-8423-0bfb8958859c req-7d1c2808-4881-42e7-b306-aec8cca2c6d9 service nova] Creating event network-vif-deleted:72eb5b7a-13b2-4f9f-ae09-5427c7542daa for instance ed82919b-2f3a-428a-b8bc-020f08560164 on n-h1-854119-9 Aug 29 05:04:21.029796 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3e1cd9f3-11d0-4ac4-8423-0bfb8958859c req-7d1c2808-4881-42e7-b306-aec8cca2c6d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063385 Aug 29 05:04:21.031056 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1646/3226] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:21.076663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:21.077489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:21.093646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:21.095094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:21.095562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:21.095805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:21.096713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:21.099275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:21.100150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:21.101260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:21.106941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:21.107449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:21.107889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:21.108660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:21.109113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:21.111234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:21.321908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:21.332485 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95da3b7b-993e-43d8-9e26-add5eee43cd1 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1630 microversion: 2.1 time: 0.260981 Aug 29 05:04:21.334591 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1581/3227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:21 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1630 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:21.578656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:21.590251 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0e90cbc-440e-46b2-879f-aa3bf9851909 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1521 microversion: 2.1 time: 0.499480 Aug 29 05:04:21.597676 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1647/3228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:21 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:21.615682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:21.618514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:21.630769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:21.631828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:21.632368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:21.633396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:21.634241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:21.635019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:21.659360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:21.681474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:21.682116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:21.697860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:21.698666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:21.700264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:21.701949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:21.703120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:21.704870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:21.987860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:22.000484 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51a6afee-ec1c-431b-a4f2-9b15fd1a1b30 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.324096 Aug 29 05:04:22.002869 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1648/3229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:21 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:22.015462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:22.017100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:22.023190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:22.027413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.028291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.028919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:22.029830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.030738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.031379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:22.040699 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-32860bdd-3057-4bf2-86f5-d8e0431faa2c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1521 microversion: 2.1 time: 0.429960 Aug 29 05:04:22.045023 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1582/3230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:21 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:22.069782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-45f01f05-6782-44e9-a7cd-3f722bc0e1ed tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-789210944", "metadata": {"": ""}}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-45f01f05-6782-44e9-a7cd-3f722bc0e1ed tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action HTTP/1.1 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 106 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-789210944", "metadata": {"": ""}}} Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '9b8ac4e6-a814-4021-8602-39425a3b988f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-789210944', 'metadata': {'': ''}}}} Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'': ''} Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:04:22.078393 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-45f01f05-6782-44e9-a7cd-3f722bc0e1ed tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:22.082614 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-45f01f05-6782-44e9-a7cd-3f722bc0e1ed tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action" status: 400 len: 170 microversion: 2.1 time: 0.015967 Aug 29 05:04:22.084820 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1583/3231] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Aug 29 05:04:22 2022] POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action => generated 170 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:04:22.089994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:22.090807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:22.102606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.103137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.103824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:22.104851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.105522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.106157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:22.528550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:22.531969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:22.542551 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b36b32b2-800f-4ab8-923a-717cda318ffd tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1521 microversion: 2.1 time: 0.456573 Aug 29 05:04:22.543588 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0439595d-48b1-4622-a6d6-208742ad3614 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1316 microversion: 2.1 time: 0.533974 Aug 29 05:04:22.547422 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1649/3232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:22 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:22.557319 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1584/3233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:22 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:22.565569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:22.566646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:22.574342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.575134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.575256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:22.575719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:22.576188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:22.578259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.583512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.584273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:22.586858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.587357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.587797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:22.588532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.588986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.589412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:22.716709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:22.750262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:22.761865 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-531ee539-e1f4-4ab3-9a0e-d56b69363255 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1353 microversion: 2.1 time: 0.211631 Aug 29 05:04:22.763509 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1650/3234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:22 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1353 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:22.783762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:22.852087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:22.863445 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-77ca999a-2c54-4697-b458-415c399b2f6b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1521 microversion: 2.1 time: 0.300930 Aug 29 05:04:22.866234 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1585/3235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:22 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:22.890398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0df5ceb-e35d-4b52-9857-f50d5e46cbbe tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1190459431", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0df5ceb-e35d-4b52-9857-f50d5e46cbbe tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action HTTP/1.1 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 619 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1190459431", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '9b8ac4e6-a814-4021-8602-39425a3b988f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1190459431', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:04:22.897694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:04:22.901023 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:22.905806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0df5ceb-e35d-4b52-9857-f50d5e46cbbe tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:22.908893 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0df5ceb-e35d-4b52-9857-f50d5e46cbbe tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action" status: 400 len: 938 microversion: 2.1 time: 0.027427 Aug 29 05:04:22.910163 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1651/3236] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Aug 29 05:04:22 2022] POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action => generated 938 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:04:22.918637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:22.919791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:22.932056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.933988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.934449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:22.935469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:22.936076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:22.936773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:23.034349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:23.035338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:23.046478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:23.047586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:23.048600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:23.049632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:23.050312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:23.051839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:23.286401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:23.303986 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-47d5e492-7081-482a-b047-be3e11dbff07 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1521 microversion: 2.1 time: 0.389632 Aug 29 05:04:23.308225 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1586/3237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:22 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:23.328683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:23.330672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:23.345749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:23.352056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:23.352557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:23.353302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:23.357926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:23.358401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:23.445118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:23.462811 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1852ed8e-92fb-4e06-8141-608a9abe23d3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.439195 Aug 29 05:04:23.463712 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1652/3238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:23 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:23.573778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:23.575334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:23.589695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:23.595772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:23.599490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:23.604343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:23.606745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:23.608070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:23.688107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:23.704136 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-624d654b-34dc-421b-a509-4b7634d10e24 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1521 microversion: 2.1 time: 0.379617 Aug 29 05:04:23.720663 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1587/3239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:23 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:23.729997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea07c15d-c11c-40c2-a87e-1ba62b9a2998 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea07c15d-c11c-40c2-a87e-1ba62b9a2998 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action HTTP/1.1 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 285 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '9b8ac4e6-a814-4021-8602-39425a3b988f', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:23.740042 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea07c15d-c11c-40c2-a87e-1ba62b9a2998 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ea07c15d-c11c-40c2-a87e-1ba62b9a2998 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action" status: 400 len: 619 microversion: 2.1 time: 0.015559 Aug 29 05:04:23.743925 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1588/3240] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Aug 29 05:04:23 2022] POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:04:23.754741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:23.759246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:23.767405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:23.768036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:23.768588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:23.769447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:23.770192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:23.770855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:23.993872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:24.005509 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-67fe7cf1-1b6e-447a-9bc6-039722abe589 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1316 microversion: 2.1 time: 0.435873 Aug 29 05:04:24.006406 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1653/3241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:23 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:24.011547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:24.012485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:24.019641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.020560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.021303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.022241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.022938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.023667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.051882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:24.065616 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9b0fa601-9f79-4c2c-999b-d56ffe932a09 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1521 microversion: 2.1 time: 0.314748 Aug 29 05:04:24.067167 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1589/3242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:23 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:24.090751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:24.091675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:24.110293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.110792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.111227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.113272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.114022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.114676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.134121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ffb030cb5e4cb2a13cd7267f51b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c64d14f0db4bc5a815cca2be384f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:24.147047 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0e35559d-d9c5-4efb-9ba5-e77a7ef05ad3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 200 len: 1353 microversion: 2.1 time: 0.139303 Aug 29 05:04:24.150442 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1654/3243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:24 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 1353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:24.284246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:24.294079 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fad88e3e-ff49-445c-8ba3-4b0b10116795 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1521 microversion: 2.1 time: 0.206758 Aug 29 05:04:24.295102 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1590/3244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:24 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:24.318660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eba0c8aa-ffcc-4431-a26f-f7d70956e6f3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-399618993"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:24.321390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eba0c8aa-ffcc-4431-a26f-f7d70956e6f3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:24.330374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba0c8aa-ffcc-4431-a26f-f7d70956e6f3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.331286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba0c8aa-ffcc-4431-a26f-f7d70956e6f3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.331876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba0c8aa-ffcc-4431-a26f-f7d70956e6f3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.332838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba0c8aa-ffcc-4431-a26f-f7d70956e6f3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.333417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba0c8aa-ffcc-4431-a26f-f7d70956e6f3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.333901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba0c8aa-ffcc-4431-a26f-f7d70956e6f3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.482960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:24.483717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:24.501537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.503295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.504647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.507239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.510166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.512255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.578349 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eba0c8aa-ffcc-4431-a26f-f7d70956e6f3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action" status: 202 len: 0 microversion: 2.1 time: 0.262917 Aug 29 05:04:24.579002 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1655/3245] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:04:24 2022] POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 05:04:24.597798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1342703820"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:24.600490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:24.606982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.607701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.608348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.609266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.609864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.610436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.655542 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Cannot 'createImage' instance 9b8ac4e6-a814-4021-8602-39425a3b988f while it is in task_state image_snapshot_pending Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action HTTP/1.1 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 85 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1342703820"}} Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot 'createImage' instance 9b8ac4e6-a814-4021-8602-39425a3b988f while it is in task_state image_snapshot_pending Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '9b8ac4e6-a814-4021-8602-39425a3b988f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1342703820'}}} Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:04:24.657647 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 9b8ac4e6-a814-4021-8602-39425a3b988f while it is in task_state image_snapshot_pending Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 9b8ac4e6-a814-4021-8602-39425a3b988f while it is in task_state image_snapshot_pending Aug 29 05:04:24.662183 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:04:24.664097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 409 to user: Cannot 'createImage' instance 9b8ac4e6-a814-4021-8602-39425a3b988f while it is in task_state image_snapshot_pending {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:24.665139 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5792f044-f313-44d9-9e36-933681f719dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action" status: 409 len: 167 microversion: 2.1 time: 0.072182 Aug 29 05:04:24.666115 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1656/3246] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:04:24 2022] POST /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f/action => generated 167 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:04:24.683435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f299060b-36b2-4680-9002-fb1b233bba56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '.version_select at 0x7f1ab8b3c160>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:24.869929 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f299060b-36b2-4680-9002-fb1b233bba56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/images/4385a2e7-56f8-4b69-b3c3-aea4fcc547e1" status: 204 len: 0 microversion: 2.1 time: 0.198582 Aug 29 05:04:24.870488 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1657/3247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:24 2022] DELETE /compute/v2.1/images/4385a2e7-56f8-4b69-b3c3-aea4fcc547e1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:04:24.878666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:24.879600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:24.888596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.889083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.889507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.893081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:24.896243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:24.896878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:24.936104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:24.945828 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52f56787-0db2-42d7-808c-fad5682ad3d6 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.466699 Aug 29 05:04:24.950665 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1591/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:24 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:25.025709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:25.026486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:25.032722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:25.033247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:25.034126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:25.035190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:25.036055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:25.036837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:25.961080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:25.970488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:25.971119 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1ddc586-8039-4c67-a016-ce89d993257f tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1316 microversion: 2.1 time: 0.949057 Aug 29 05:04:25.973041 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1592/3249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:25 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1316 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:25.981093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:25.986163 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2fda16b4-a70b-4762-bcec-efca3e45044e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1533 microversion: 2.1 time: 1.110874 Aug 29 05:04:25.991470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] [instance: ed82919b-2f3a-428a-b8bc-020f08560164] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:25.994615 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1658/3250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:24 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1533 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:26.006870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:26.009163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:26.009793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:26.012261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:26.014107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:26.014884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:26.015362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:26.015795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:26.030229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:26.030229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:26.030229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:26.030501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:26.030806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:26.031253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:26.056349 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] HTTP exception thrown: Instance ed82919b-2f3a-428a-b8bc-020f08560164 could not be found. Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Request method failure captured: Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 HTTP/1.1 Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEhhbAAaDgXFhjPNkb1ig7IKZzMy3V9N69L3RaStS8u0xtVZ3yb0YyddLznpbnc2VVtu14B74uHtClTZvB4b7HN3DsMbfpLtaxPrCcJlzrN4n_hU7JEJls58L7SBQgkY0rD429eLkm-X4ys3XsUE923XRNW4A4Qje4rTWnah4h6GaiA Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 24c64d14f0db4bc5a815cca2be384f2d Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-148867563 Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24c64d14f0db4bc5a815cca2be384f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/24c64d14f0db4bc5a815cca2be384f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_24c64d14f0db4bc5a815cca2be384f2d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24c64d14f0db4bc5a815cca2be384f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-148867563 Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 24c64d14f0db4bc5a815cca2be384f2d Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-148867563 Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-148867563-project Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 97ffb030cb5e4cb2a13cd7267f51b2cb Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-148867563-project Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ed82919b-2f3a-428a-b8bc-020f08560164 could not be found. Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ed82919b-2f3a-428a-b8bc-020f08560164'} Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed82919b-2f3a-428a-b8bc-020f08560164 could not be found. Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed82919b-2f3a-428a-b8bc-020f08560164 could not be found. Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:26.057918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:26.062170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:26.062170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:26.062170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:04:26.062170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:04:26.062170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed82919b-2f3a-428a-b8bc-020f08560164 could not be found. Aug 29 05:04:26.062170 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:26.062170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Returning 404 to user: Instance ed82919b-2f3a-428a-b8bc-020f08560164 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:26.062170 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-415cd98a-b920-4960-81ab-27ff7cf60ca3 tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164" status: 404 len: 111 microversion: 2.1 time: 0.085337 Aug 29 05:04:26.062170 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1593/3251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:25 2022] GET /compute/v2.1/servers/ed82919b-2f3a-428a-b8bc-020f08560164 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:04:26.063368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:26.085633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce7c7cc1-cd8f-4439-9297-45e4c6dcba2a tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] Calling method '.version_select at 0x7f1abd8f3ee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:26.124315 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ce7c7cc1-cd8f-4439-9297-45e4c6dcba2a tempest-ServersTestJSON-148867563 tempest-ServersTestJSON-148867563-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288158769" status: 202 len: 0 microversion: 2.1 time: 0.051260 Aug 29 05:04:26.125443 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1594/3252] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 05:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288158769 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:04:26.508555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:26.521182 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f744190d-2efa-4b53-a3ec-0025362aa079 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.524510 Aug 29 05:04:26.521866 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1659/3253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:25 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:26.992101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:26.993256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:27.002809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:27.012359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:27.013049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:27.018197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:27.020359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:27.023728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:27.024238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:27.024667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:27.028047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:27.028568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:27.029003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:27.033918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:27.034397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:27.034943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:27.340296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:27.361953 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f60c28f8-4074-4b41-862d-494132268227 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1539 microversion: 2.1 time: 0.352004 Aug 29 05:04:27.365874 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1660/3254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:27 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1539 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:27.380294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:27.389766 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc2189d8-3bb9-4fb4-8ef5-84c1b6b08743 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1316 microversion: 2.1 time: 0.402713 Aug 29 05:04:27.390352 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1595/3255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:26 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:27.542569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:27.543206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:27.549642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:27.550386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:27.550928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:27.551786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:27.552449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:27.553126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:27.748551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:27.757652 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2aada19b-7945-4985-a66e-62b468aa9dba tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.219177 Aug 29 05:04:27.758264 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1661/3256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:27 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:28.049434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a9eca8a2-cc8a-40bd-a36b-b046431a2238 req-b925dacc-4917-47aa-aabe-ae9abec2fa5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434c152b-2c37-4895-85ca-49fe3753e202", "name": "network-vif-plugged", "status": "completed", "tag": "1bc875cf-1274-4a0d-b378-2e23a965347d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:28.059670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9eca8a2-cc8a-40bd-a36b-b046431a2238 req-b925dacc-4917-47aa-aabe-ae9abec2fa5c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:28.060152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9eca8a2-cc8a-40bd-a36b-b046431a2238 req-b925dacc-4917-47aa-aabe-ae9abec2fa5c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:28.060571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9eca8a2-cc8a-40bd-a36b-b046431a2238 req-b925dacc-4917-47aa-aabe-ae9abec2fa5c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:28.072620 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a9eca8a2-cc8a-40bd-a36b-b046431a2238 req-b925dacc-4917-47aa-aabe-ae9abec2fa5c service nova] Creating event network-vif-plugged:1bc875cf-1274-4a0d-b378-2e23a965347d for instance 434c152b-2c37-4895-85ca-49fe3753e202 on n-h1-854119-9 Aug 29 05:04:28.078093 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a9eca8a2-cc8a-40bd-a36b-b046431a2238 req-b925dacc-4917-47aa-aabe-ae9abec2fa5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031956 Aug 29 05:04:28.078794 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1596/3257] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:28.384421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:28.385030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:28.391983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:28.392870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:28.393475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:28.394408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:28.395307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:28.396010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:28.411235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:28.412157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:28.429462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:28.429462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:28.429462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:28.429462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:28.429462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:28.429462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:28.598526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:28.617110 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5dc24ef0-5531-42f7-a9f2-a4d77b330426 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1539 microversion: 2.1 time: 0.236633 Aug 29 05:04:28.618594 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1662/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:28 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1539 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:28.736263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:28.758284 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d06785a-71c4-4966-8cf1-587187e3a62e tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1316 microversion: 2.1 time: 0.349238 Aug 29 05:04:28.761090 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1597/3259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:28 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:28.781026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:28.782287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:28.790693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:28.791574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:28.792252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:28.793260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:28.793871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:28.794567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:29.016362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:29.030644 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cbe818d7-b363-4b7b-8ab1-936968201ba5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.254851 Aug 29 05:04:29.031869 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1663/3260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:28 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:29.639914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:29.640674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:29.655316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:29.655817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:29.658034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:29.658822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:29.663524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:29.664065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:29.781469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:29.782891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:29.793663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:29.797038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:29.797784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:29.799130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:29.799701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:29.800196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:30.048187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:30.062725 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1773bc81-e5a2-49e0-abdb-f926ee3c808f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1539 microversion: 2.1 time: 0.427233 Aug 29 05:04:30.064146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1598/3261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:29 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1539 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:30.074693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:30.075639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:30.092157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:30.093835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:30.094460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:30.096715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:30.097798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:30.098590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:30.133419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:30.145900 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69dcda37-6173-416f-a3ee-9f9bba92ad37 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1316 microversion: 2.1 time: 0.365798 Aug 29 05:04:30.146854 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1664/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:29 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:30.418798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:30.435859 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f7d104fd-6cab-4bc1-a872-7a1536f11464 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.370378 Aug 29 05:04:30.436804 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1599/3263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:30 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:31.084852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:31.089136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:31.097667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.098415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.099022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.099900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.100531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.101108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.167249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:31.167861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:31.180241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.180747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.185445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.186876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.187506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.188101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.613912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:31.628221 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2cdeb13-404f-4e61-ab5a-5e1154fbc32b tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1539 microversion: 2.1 time: 0.543505 Aug 29 05:04:31.629398 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1665/3264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:31 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1539 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:31.640398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:31.640398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:31.646413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:31.656502 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-939a7fd1-efb5-4fa3-a372-ba118abea519 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1505 microversion: 2.1 time: 0.493467 Aug 29 05:04:31.663472 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1600/3265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:31 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:31.682747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.683004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff4958f2-ade6-41fb-b66c-018011856d13 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:31.683811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ff4958f2-ade6-41fb-b66c-018011856d13 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:31.684820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.685475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.686731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.688109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.689588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.694156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff4958f2-ade6-41fb-b66c-018011856d13 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.698528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff4958f2-ade6-41fb-b66c-018011856d13 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.699980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff4958f2-ade6-41fb-b66c-018011856d13 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.700990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff4958f2-ade6-41fb-b66c-018011856d13 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.703337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff4958f2-ade6-41fb-b66c-018011856d13 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.707783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff4958f2-ade6-41fb-b66c-018011856d13 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.781709 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff4958f2-ade6-41fb-b66c-018011856d13 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202/ips" status: 200 len: 109 microversion: 2.1 time: 0.103223 Aug 29 05:04:31.791880 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1601/3266] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:04:31 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202/ips => generated 109 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:04:31.800834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d880fe1e-bd2d-435b-87f1-eb9e2888353c tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:31.801556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d880fe1e-bd2d-435b-87f1-eb9e2888353c tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:31.809844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d880fe1e-bd2d-435b-87f1-eb9e2888353c tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.810666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d880fe1e-bd2d-435b-87f1-eb9e2888353c tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.811400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d880fe1e-bd2d-435b-87f1-eb9e2888353c tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.812505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d880fe1e-bd2d-435b-87f1-eb9e2888353c tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.813110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d880fe1e-bd2d-435b-87f1-eb9e2888353c tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.813681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d880fe1e-bd2d-435b-87f1-eb9e2888353c tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.845507 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d880fe1e-bd2d-435b-87f1-eb9e2888353c tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202/ips" status: 200 len: 109 microversion: 2.1 time: 0.052279 Aug 29 05:04:31.848200 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1602/3267] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:04:31 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202/ips => generated 109 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:31.867665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0cf6823-bded-4dfc-a316-5676d04c9f31 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:31.868996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b0cf6823-bded-4dfc-a316-5676d04c9f31 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:31.882485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0cf6823-bded-4dfc-a316-5676d04c9f31 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.883478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0cf6823-bded-4dfc-a316-5676d04c9f31 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.884272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0cf6823-bded-4dfc-a316-5676d04c9f31 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.887294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0cf6823-bded-4dfc-a316-5676d04c9f31 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.888096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0cf6823-bded-4dfc-a316-5676d04c9f31 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.888792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0cf6823-bded-4dfc-a316-5676d04c9f31 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.934903 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b0cf6823-bded-4dfc-a316-5676d04c9f31 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202/ips/tempest-ServerAddressesTestJSON-1352016499-network" status: 200 len: 94 microversion: 2.1 time: 0.071130 Aug 29 05:04:31.936141 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1603/3268] 10.222.0.20 () {58 vars in 1401 bytes} [Mon Aug 29 05:04:31 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202/ips/tempest-ServerAddressesTestJSON-1352016499-network => generated 94 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:04:31.952523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:31.955044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:31.967367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.968271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.968891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:31.970366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:31.970644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:31.975574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:32.001255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:32.017288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:04:32.033495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:32.051493 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06ed2a91-e6e4-4281-b0db-32f64c34ce41 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.419175 Aug 29 05:04:32.054667 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1666/3269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:31 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:32.168874 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-263f9336-0705-4ef2-ac0a-4b26a4281abe tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "DELETE /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 204 len: 0 microversion: 2.1 time: 0.222785 Aug 29 05:04:32.171773 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1604/3270] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:04:31 2022] DELETE /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:04:32.179739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:32.180416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:32.191078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:32.191586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:32.192013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:32.192748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:32.193200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:32.193618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:32.387588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:32.397463 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17e7912a-ef1a-458c-9a2b-bececb99afe4 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1511 microversion: 2.1 time: 0.221587 Aug 29 05:04:32.403551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1667/3271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:32 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:32.655378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:32.656769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:32.678129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:32.678641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:32.679079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:32.679884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:32.681768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:32.682309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:32.993402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:33.003101 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-116e0dc4-7982-4f35-b9bf-cdd0064f6949 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1534 microversion: 2.1 time: 0.353595 Aug 29 05:04:33.004106 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1605/3272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:32 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1534 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:33.086834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:33.089379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:33.103360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:33.105158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:33.105960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:33.110979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:33.111686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:33.112459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:33.318919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:33.331721 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-52ceaf51-4541-4549-b64d-c7a67e0c2141 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.256458 Aug 29 05:04:33.333161 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1668/3273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:33 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:33.429013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:33.430326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:33.439623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:33.440500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:33.442861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:33.443765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:33.444522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:33.445935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:33.922609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:33.932734 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eaf25758-68ad-45c8-8b24-78260aaae9db tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1511 microversion: 2.1 time: 0.509582 Aug 29 05:04:33.933332 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1606/3274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:33 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1511 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:34.026207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:34.027219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:34.044939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:34.045437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:34.045907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:34.046583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:34.050035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:34.052048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:34.353849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:34.354763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:34.366126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:34.366902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:34.370261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:34.372045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:34.372744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:34.373464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:35.057106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:35.071106 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-105603d3-063e-479b-8a03-760e954092ae tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1521 microversion: 2.1 time: 1.048698 Aug 29 05:04:35.071718 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1669/3275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:34 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1521 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:35.117604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b50026f1-f76c-414e-b247-6e9a0329be51 req-1f699f38-2262-43ec-8882-6ee28ed7c0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "name": "network-vif-plugged", "status": "completed", "tag": "5adaac4c-5aff-4ea2-a542-c2ea2d00086e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:35.164406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b50026f1-f76c-414e-b247-6e9a0329be51 req-1f699f38-2262-43ec-8882-6ee28ed7c0de service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:35.167260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b50026f1-f76c-414e-b247-6e9a0329be51 req-1f699f38-2262-43ec-8882-6ee28ed7c0de service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:35.167933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b50026f1-f76c-414e-b247-6e9a0329be51 req-1f699f38-2262-43ec-8882-6ee28ed7c0de service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:35.173787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:35.183382 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5892611e-4cbe-4c50-9947-f844aa991b76 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.834756 Aug 29 05:04:35.185395 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1607/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:34 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:35.190315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:35.190960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:35.219554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:35.220080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:35.221990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:35.222810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:35.224386 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b50026f1-f76c-414e-b247-6e9a0329be51 req-1f699f38-2262-43ec-8882-6ee28ed7c0de service nova] Creating event network-vif-plugged:5adaac4c-5aff-4ea2-a542-c2ea2d00086e for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:35.226046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:35.226625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:35.238239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b50026f1-f76c-414e-b247-6e9a0329be51 req-1f699f38-2262-43ec-8882-6ee28ed7c0de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160082 Aug 29 05:04:35.244986 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1670/3277] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:35.257075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:35.259696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:35.275998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:35.276777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:35.277221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:35.285019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:35.285543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:35.285995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:35.342178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:04:35.533872 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad83a763-62ed-43f0-aa88-d6bb0f73a572 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 204 len: 0 microversion: 2.1 time: 0.282685 Aug 29 05:04:35.538600 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1671/3278] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:04:35 2022] DELETE /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:04:35.789711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1344743832", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:35.910678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] validate_networks() for [('81af7948-8686-4889-851c-da8f5cb0432d', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:04:36.028599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:36.041402 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c4c251ac-e770-4cc9-8369-e41abd3e1671 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1511 microversion: 2.1 time: 0.852614 Aug 29 05:04:36.053401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1608/3279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:35 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1511 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:36.059937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:36.060842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:36.088322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:36.089334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:36.089940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:36.091255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:36.091916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:36.093341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:36.852807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:36.865190 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-da4dbd95-b2ee-42d5-8eb2-6aeff0aaa184 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1527 microversion: 2.1 time: 0.810606 Aug 29 05:04:36.868089 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1609/3280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:36 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1527 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:36.879058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:36.880824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:36.893780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:36.897693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:36.898577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:36.901852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:36.902602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:36.903627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:37.107880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:04:37.109369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:04:37.110225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:04:37.110955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:04:37.112075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:04:37.132971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:37.135452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:37.136775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:37.141213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:37.142185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:37.145801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:37.176456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Getting quotas for project e0354847e7074255a9b5095f9e589128. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:04:37.185607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Getting quotas for user 7053571eaec54866b01f3c5657ca1e5e and project e0354847e7074255a9b5095f9e589128. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:04:37.202371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:04:37.207667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:04:37.317215 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e4b179df-4de8-49d7-a99e-26f20e8975a3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.776107 Aug 29 05:04:37.322603 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1672/3281] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:04:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:04:37.336654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:37.341167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7245da60-d1be-48b5-aed1-3f93df6c865e req-e423065d-8d9b-403a-a83a-a806126e6f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434c152b-2c37-4895-85ca-49fe3753e202", "name": "network-vif-deleted", "tag": "1bc875cf-1274-4a0d-b378-2e23a965347d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:37.359282 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9e9be80-a721-4ace-a307-4f961ca03b1b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.489719 Aug 29 05:04:37.359876 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1610/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:36 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:37.366091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:37.366862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:37.373961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:37.374688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:37.375140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:37.376010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:37.377211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7245da60-d1be-48b5-aed1-3f93df6c865e req-e423065d-8d9b-403a-a83a-a806126e6f97 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:37.377685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:37.378118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:37.383630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7245da60-d1be-48b5-aed1-3f93df6c865e req-e423065d-8d9b-403a-a83a-a806126e6f97 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:37.384104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7245da60-d1be-48b5-aed1-3f93df6c865e req-e423065d-8d9b-403a-a83a-a806126e6f97 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:37.415435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:37.416339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:37.416937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:37.417575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lazy-loading 'fault' on Instance uuid 434c152b-2c37-4895-85ca-49fe3753e202 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:04:37.424406 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7245da60-d1be-48b5-aed1-3f93df6c865e req-e423065d-8d9b-403a-a83a-a806126e6f97 service nova] Creating event network-vif-deleted:1bc875cf-1274-4a0d-b378-2e23a965347d for instance 434c152b-2c37-4895-85ca-49fe3753e202 on n-h1-854119-9 Aug 29 05:04:37.440037 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7245da60-d1be-48b5-aed1-3f93df6c865e req-e423065d-8d9b-403a-a83a-a806126e6f97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112473 Aug 29 05:04:37.440951 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1673/3283] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:37.451077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-cb72682f-7ded-4045-9f43-56a735b14863 req-3dc68018-96eb-47a4-84a2-f3e02aff1fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "name": "network-vif-plugged", "status": "completed", "tag": "a758dc84-817f-43d7-9e8d-529e3588a2af"}, {"server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "name": "network-vif-plugged", "status": "completed", "tag": "d66987d8-b98e-418f-859f-09b227f23c11"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:37.482915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cb72682f-7ded-4045-9f43-56a735b14863 req-3dc68018-96eb-47a4-84a2-f3e02aff1fcc service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:37.483721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cb72682f-7ded-4045-9f43-56a735b14863 req-3dc68018-96eb-47a4-84a2-f3e02aff1fcc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:37.485452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cb72682f-7ded-4045-9f43-56a735b14863 req-3dc68018-96eb-47a4-84a2-f3e02aff1fcc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:37.518398 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-cb72682f-7ded-4045-9f43-56a735b14863 req-3dc68018-96eb-47a4-84a2-f3e02aff1fcc service nova] Creating event network-vif-plugged:a758dc84-817f-43d7-9e8d-529e3588a2af for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:37.522242 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-cb72682f-7ded-4045-9f43-56a735b14863 req-3dc68018-96eb-47a4-84a2-f3e02aff1fcc service nova] Creating event network-vif-plugged:d66987d8-b98e-418f-859f-09b227f23c11 for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:37.554928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-cb72682f-7ded-4045-9f43-56a735b14863 req-3dc68018-96eb-47a4-84a2-f3e02aff1fcc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.109203 Aug 29 05:04:37.556097 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1674/3284] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:37.569683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e396f4b4-ac6b-4564-bd4b-dfd3c58593cf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:37.574942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e396f4b4-ac6b-4564-bd4b-dfd3c58593cf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:37.601073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d60a898cd54c4bb8d13e9ee9284c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22827f5239842eb8960393603ac0425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:37.614806 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-98396e78-151f-4c42-9fd7-7816d8cb0d9a tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 200 len: 1306 microversion: 2.1 time: 0.253000 Aug 29 05:04:37.628962 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1611/3285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:37 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:37.891299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:37.893538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:37.945540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:37.964268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:37.965970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:37.967694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:37.972830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:37.973726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:37.975741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:38.509123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e396f4b4-ac6b-4564-bd4b-dfd3c58593cf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:38.522474 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e396f4b4-ac6b-4564-bd4b-dfd3c58593cf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1214 microversion: 2.1 time: 0.962808 Aug 29 05:04:38.523101 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1675/3286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:37 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1214 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:38.547249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:38.549004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:38.556767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:38.584041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:38.590239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:38.591039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:38.592276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:38.593498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:38.599832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:39.366595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:39.387668 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3ad75014-468e-4d2e-a244-84b2308315e3 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1527 microversion: 2.1 time: 1.504252 Aug 29 05:04:39.393900 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1612/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:37 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1527 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:39.400293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:39.400919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] [instance: 434c152b-2c37-4895-85ca-49fe3753e202] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:39.433696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:39.434428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:39.435144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:39.437255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:39.437942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:39.439815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:39.459974 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] HTTP exception thrown: Instance 434c152b-2c37-4895-85ca-49fe3753e202 could not be found. Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Request method failure captured: Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 HTTP/1.1 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEjEgQZS1kAxC7wK9BfxZEBVH8mFb0wkQtrT4xEDbKcyPfg-Iw0y9o2GVNfD3kXcBZZ_lrGF3p_oGDsT8kN0z_DMmO6-peewR7UhG3rLe5SGnkVPKCKRcEzmeiI5DtVrtlKWjyCds9MnSPeVJK31tGG1AsKz6CF59p9Q6om4EYqMZnA Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: c22827f5239842eb8960393603ac0425 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerAddressesTestJSON-1928412600 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22827f5239842eb8960393603ac0425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c22827f5239842eb8960393603ac0425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c22827f5239842eb8960393603ac0425", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22827f5239842eb8960393603ac0425"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerAddressesTestJSON-1928412600 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: c22827f5239842eb8960393603ac0425 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1928412600 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerAddressesTestJSON-1928412600-project Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 91d60a898cd54c4bb8d13e9ee9284c33 Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerAddressesTestJSON-1928412600-project Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 434c152b-2c37-4895-85ca-49fe3753e202 could not be found. Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '434c152b-2c37-4895-85ca-49fe3753e202'} Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 434c152b-2c37-4895-85ca-49fe3753e202 could not be found. Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 434c152b-2c37-4895-85ca-49fe3753e202 could not be found. Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:39.471050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:39.475845 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:39.475845 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:39.475845 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:39.475845 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:04:39.475845 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:04:39.475845 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 434c152b-2c37-4895-85ca-49fe3753e202 could not be found. Aug 29 05:04:39.475845 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:39.478576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] Returning 404 to user: Instance 434c152b-2c37-4895-85ca-49fe3753e202 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:39.479667 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b70be118-c555-4b24-b60a-8b8529f467b9 tempest-ServerAddressesTestJSON-1928412600 tempest-ServerAddressesTestJSON-1928412600-project] 10.222.0.20 "GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202" status: 404 len: 111 microversion: 2.1 time: 0.084629 Aug 29 05:04:39.480543 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1613/3288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:39 2022] GET /compute/v2.1/servers/434c152b-2c37-4895-85ca-49fe3753e202 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:04:39.490004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:39.503808 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d50dc90e-36e6-48f8-900f-f9c7e7946198 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.979576 Aug 29 05:04:39.507493 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1676/3289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:38 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:39.545706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:39.546352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:39.555412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:39.558181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:39.558797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:39.559360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:39.559944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:39.560412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:39.667798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:39.680760 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b5c9ca4-abdc-44fb-8b0e-2fd4d6a8362b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1266 microversion: 2.1 time: 0.140502 Aug 29 05:04:39.681676 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1614/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:39 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:40.004737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a1471353-10a5-4b91-98bc-a215c2c92549 req-b2bad669-62fd-4a57-a4d5-08d2b21f75b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8ac4e6-a814-4021-8602-39425a3b988f", "name": "network-vif-deleted", "tag": "fc99705d-32a5-44a4-bc68-8d290d1f18d6"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:40.028174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a1471353-10a5-4b91-98bc-a215c2c92549 req-b2bad669-62fd-4a57-a4d5-08d2b21f75b3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:40.030079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a1471353-10a5-4b91-98bc-a215c2c92549 req-b2bad669-62fd-4a57-a4d5-08d2b21f75b3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:40.031700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a1471353-10a5-4b91-98bc-a215c2c92549 req-b2bad669-62fd-4a57-a4d5-08d2b21f75b3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:40.068049 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a1471353-10a5-4b91-98bc-a215c2c92549 req-b2bad669-62fd-4a57-a4d5-08d2b21f75b3 service nova] Creating event network-vif-deleted:fc99705d-32a5-44a4-bc68-8d290d1f18d6 for instance 9b8ac4e6-a814-4021-8602-39425a3b988f on n-h1-854119-9 Aug 29 05:04:40.108433 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a1471353-10a5-4b91-98bc-a215c2c92549 req-b2bad669-62fd-4a57-a4d5-08d2b21f75b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105495 Aug 29 05:04:40.120864 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1677/3291] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:40.418189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:40.418778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:40.444160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:40.447226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:40.447679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:40.448438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:40.448893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:40.449312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:40.532009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:40.532834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:40.558976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:40.559765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:40.560099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:40.560620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:40.560748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:40.561065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:40.561675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lazy-loading 'fault' on Instance uuid 9b8ac4e6-a814-4021-8602-39425a3b988f {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:04:40.561801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:40.562210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:40.562627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:40.853728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:40.869467 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0920f807-dcd4-4f31-8bf1-4a756f491475 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 200 len: 1315 microversion: 2.1 time: 0.454653 Aug 29 05:04:40.881058 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1615/3292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:40 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:40.886507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:40.886507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:40.893721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:40.894571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:40.895235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:40.896193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:40.896854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:40.899909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:41.072000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:41.086571 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54ee88bf-55fe-4511-a58a-71e31bc21bb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1272 microversion: 2.1 time: 0.214893 Aug 29 05:04:41.086962 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1616/3293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:40 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:41.387905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:41.390993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:41.405891 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f493f543-32eb-42dd-ac3d-9a0c46f86ed0 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1354 microversion: 2.1 time: 0.879105 Aug 29 05:04:41.421185 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1678/3294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:40 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1354 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:41.904314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:41.904974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:41.924208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:41.924624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:41.925176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:41.925936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:41.926570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:41.927290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:41.945247 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f HTTP/1.1 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '9b8ac4e6-a814-4021-8602-39425a3b988f'} Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:41.947841 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:41.952490 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:41.952490 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:41.952490 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:41.952490 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:41.952490 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:04:41.952490 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:04:41.952490 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:04:41.952490 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:41.954688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:41.955860 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9917eb58-65c4-40a7-9944-74a3949e199c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 404 len: 111 microversion: 2.1 time: 0.065349 Aug 29 05:04:41.957223 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1617/3295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:41 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:04:41.975666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-54220069-0a3d-4ea1-a023-fd29909f96fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'create', calling method: .version_select at 0x7f1ab8a25f70>, body: {"keypair": {"name": "tempest-keypair-934403461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh7OtyjIVcCAMt6GtDsdcgg9MquocxFbSw076JcsR3Cdt7W1Ga1ztOVFWYq3qKj3yDBT2bUJ+a88HfGX59FnvxvjgQj8kE+yUVF8SwtzdRNGSBHtbAiw6IIPs62mYblqw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:42.020712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-54220069-0a3d-4ea1-a023-fd29909f96fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Getting quotas for project 0fa590adc4ce4a0ca0249a5abd6340a9. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:04:42.053422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-54220069-0a3d-4ea1-a023-fd29909f96fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Getting quotas for user e421b5bfaefd430fa53ab461f654a517 and project 0fa590adc4ce4a0ca0249a5abd6340a9. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:04:42.097740 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-54220069-0a3d-4ea1-a023-fd29909f96fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133107 Aug 29 05:04:42.098721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1679/3296] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:04:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:42.111828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:42.112576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:42.125785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:42.127238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:42.127695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:42.137205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:42.140553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:42.141944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:42.432481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:42.433261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:42.456159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:42.456739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:42.457186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:42.457914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:42.464572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:42.465172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:42.465307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:42.482409 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-75fc689c-e173-4e83-b922-b7e570842ac8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1314 microversion: 2.1 time: 0.376714 Aug 29 05:04:42.483010 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1618/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:42 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:42.969756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:42.989323 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b279b2ee-b195-45c1-9984-2164bf080e2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1802 microversion: 2.1 time: 0.554346 Aug 29 05:04:42.992416 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1680/3298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:42 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1802 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:43.014571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-266e573f-de03-4888-9949-ee7032f73639 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:43.015775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-266e573f-de03-4888-9949-ee7032f73639 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:43.031614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-266e573f-de03-4888-9949-ee7032f73639 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:43.036795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-266e573f-de03-4888-9949-ee7032f73639 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:43.037693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-266e573f-de03-4888-9949-ee7032f73639 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:43.040148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-266e573f-de03-4888-9949-ee7032f73639 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:43.041836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-266e573f-de03-4888-9949-ee7032f73639 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:43.042497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-266e573f-de03-4888-9949-ee7032f73639 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:43.106046 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-266e573f-de03-4888-9949-ee7032f73639 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe/ips" status: 200 len: 216 microversion: 2.1 time: 0.095663 Aug 29 05:04:43.108064 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1619/3299] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:04:43 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe/ips => generated 216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:43.119395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:43.120698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:43.150498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:43.151010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:43.151450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:43.152198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:43.152676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:43.153078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:43.202291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:04:43.382931 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45418d81-1339-441c-b877-214a88ed529d tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 204 len: 0 microversion: 2.1 time: 0.266950 Aug 29 05:04:43.383802 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1681/3300] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:04:43 2022] DELETE /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:04:43.394400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:43.395720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:43.410701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:43.411957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:43.413631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:43.414818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:43.415520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:43.416227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:43.450610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:43.504727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:43.507094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:43.517919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:43.522582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:43.523643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:43.528019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:43.528880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:43.529534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:44.261085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:44.276970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:44.278154 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4515f8f0-f81b-48aa-92b0-778dfd28c379 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1808 microversion: 2.1 time: 0.889159 Aug 29 05:04:44.282167 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1620/3301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:43 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1808 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:44.299741 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef0b061f-9e08-4a1e-892a-ea2a0cf6493c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1314 microversion: 2.1 time: 0.800273 Aug 29 05:04:44.300632 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1682/3302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:43 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:45.195604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1898079095", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:45.282550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] validate_networks() for [('e8660360-b6cc-44fc-9714-43a67fd1cc2a', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:04:45.303525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:45.304153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:45.341062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:45.341754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:45.342258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:45.343166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:45.343717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:45.344260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:46.223967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:46.241186 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cfb7967f-b857-411e-973d-c030f82a5edf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1808 microversion: 2.1 time: 0.942595 Aug 29 05:04:46.241759 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1683/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:45 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1808 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:46.247100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:46.247898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:46.258072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:46.259058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:46.261332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:46.263006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:46.265023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:46.265696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:47.160695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:47.255362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:47.274301 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0c50a396-05e9-49f8-ad57-b95b7229dcfb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1314 microversion: 2.1 time: 1.030248 Aug 29 05:04:47.275062 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1684/3304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:46 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:47.281326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-48cf9e7f-a313-4293-875a-1e8a5d08a177 req-fd793ebd-a86d-4e9d-86da-33bbaab78be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72dd2804-662c-4aec-9e28-48f7137e0122", "tag": "195dfe40-178f-492d-97ae-18cedf504aba"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:47.313706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-48cf9e7f-a313-4293-875a-1e8a5d08a177 req-fd793ebd-a86d-4e9d-86da-33bbaab78be9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:47.314513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-48cf9e7f-a313-4293-875a-1e8a5d08a177 req-fd793ebd-a86d-4e9d-86da-33bbaab78be9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:47.315265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-48cf9e7f-a313-4293-875a-1e8a5d08a177 req-fd793ebd-a86d-4e9d-86da-33bbaab78be9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:47.330790 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-48cf9e7f-a313-4293-875a-1e8a5d08a177 req-fd793ebd-a86d-4e9d-86da-33bbaab78be9 service nova] Creating event network-changed:195dfe40-178f-492d-97ae-18cedf504aba for instance 72dd2804-662c-4aec-9e28-48f7137e0122 on n-h1-854119-9 Aug 29 05:04:47.338354 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-48cf9e7f-a313-4293-875a-1e8a5d08a177 req-fd793ebd-a86d-4e9d-86da-33bbaab78be9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061664 Aug 29 05:04:47.339241 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1685/3305] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:47.345583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:47.346498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:47.354479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:47.355323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:47.355990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:47.356962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:47.357797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:47.358556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:47.703508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:04:47.706472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:04:47.711137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:04:47.711889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:04:47.712407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:04:47.722899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:47.723409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:47.723878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:47.724823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:47.725515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:47.725935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:47.745831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Getting quotas for project 0fa590adc4ce4a0ca0249a5abd6340a9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:04:47.753013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Getting quotas for user e421b5bfaefd430fa53ab461f654a517 and project 0fa590adc4ce4a0ca0249a5abd6340a9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:04:47.771745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:04:47.774607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:04:47.827270 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a1cfa0f-20ec-4651-8381-897d0e18b6c0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.640046 Aug 29 05:04:47.829004 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1621/3306] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:04:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:04:47.840730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b4196ea-556c-476b-8706-9c6a1cb289bc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:47.842597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8b4196ea-556c-476b-8706-9c6a1cb289bc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:48.034845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8b4196ea-556c-476b-8706-9c6a1cb289bc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:48.043750 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8b4196ea-556c-476b-8706-9c6a1cb289bc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1225 microversion: 2.1 time: 0.207589 Aug 29 05:04:48.044381 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1622/3307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:47 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1225 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:48.128259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:48.144932 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a597e96f-2745-4334-a60c-e52d4bf8c5a4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1808 microversion: 2.1 time: 0.803851 Aug 29 05:04:48.158936 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1686/3308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:47 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1808 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:48.294844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:48.295457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:48.309649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:48.310143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:48.310579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:48.311290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:48.311744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:48.312188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:49.065815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:49.067209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:49.074935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:49.075714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:49.076448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:49.077371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:49.078348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:49.079127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:49.203279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:49.215290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-909fba2d-ff7b-4688-9fad-ea867547263c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1277 microversion: 2.1 time: 0.154163 Aug 29 05:04:49.216546 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1687/3309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:49 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:49.229026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:49.230131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:49.240062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:49.245298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:49.245788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:49.246461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:49.247356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:49.247998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:49.248684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:49.253074 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-db4b066a-d89e-40d4-a0cf-c2d9d67d998d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1314 microversion: 2.1 time: 0.960154 Aug 29 05:04:49.254829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1623/3310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:48 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:49.478435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7957502a-46e2-4cdb-9164-643b2dcc31fe req-040efb25-2509-4930-8606-c9f0214ad390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "name": "network-vif-deleted", "tag": "5adaac4c-5aff-4ea2-a542-c2ea2d00086e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:49.501928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7957502a-46e2-4cdb-9164-643b2dcc31fe req-040efb25-2509-4930-8606-c9f0214ad390 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:49.502436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7957502a-46e2-4cdb-9164-643b2dcc31fe req-040efb25-2509-4930-8606-c9f0214ad390 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:49.504582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7957502a-46e2-4cdb-9164-643b2dcc31fe req-040efb25-2509-4930-8606-c9f0214ad390 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:49.530044 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7957502a-46e2-4cdb-9164-643b2dcc31fe req-040efb25-2509-4930-8606-c9f0214ad390 service nova] Creating event network-vif-deleted:5adaac4c-5aff-4ea2-a542-c2ea2d00086e for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:49.542917 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7957502a-46e2-4cdb-9164-643b2dcc31fe req-040efb25-2509-4930-8606-c9f0214ad390 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069902 Aug 29 05:04:49.543536 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1624/3311] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:04:49.546348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:49.554464 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69afe5f4-0a64-4798-af13-cb78c40f65eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1787 microversion: 2.1 time: 0.336410 Aug 29 05:04:49.555061 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1688/3312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:49 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1787 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:49.907279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-95f33a25-d014-4316-a5d2-b5e2b564ccd3 req-ecf62c39-9b38-42ac-869c-8179acd4b6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "name": "network-vif-unplugged", "status": "completed", "tag": "d66987d8-b98e-418f-859f-09b227f23c11"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:49.930568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-95f33a25-d014-4316-a5d2-b5e2b564ccd3 req-ecf62c39-9b38-42ac-869c-8179acd4b6e8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:49.934457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-95f33a25-d014-4316-a5d2-b5e2b564ccd3 req-ecf62c39-9b38-42ac-869c-8179acd4b6e8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:49.936375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-95f33a25-d014-4316-a5d2-b5e2b564ccd3 req-ecf62c39-9b38-42ac-869c-8179acd4b6e8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:49.971589 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-95f33a25-d014-4316-a5d2-b5e2b564ccd3 req-ecf62c39-9b38-42ac-869c-8179acd4b6e8 service nova] Creating event network-vif-unplugged:d66987d8-b98e-418f-859f-09b227f23c11 for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:49.981169 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-95f33a25-d014-4316-a5d2-b5e2b564ccd3 req-ecf62c39-9b38-42ac-869c-8179acd4b6e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078907 Aug 29 05:04:50.004043 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1625/3313] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:50.239148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:50.239769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:50.250015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:50.250509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:50.250938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:50.262708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:50.262708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:50.262708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:50.274641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:50.275593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:50.286922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:50.288334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:50.288976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:50.291645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:50.293294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:50.295387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:50.381744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:50.394956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f7666ef7-1fa8-4d92-8379-61508a561d7c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1277 microversion: 2.1 time: 0.157165 Aug 29 05:04:50.398126 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1689/3314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:50 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:50.582153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:50.583187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:50.594725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:50.596718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:50.597769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:50.599779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:50.602661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:50.603542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:50.626399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:50.641390 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-38285202-0d2d-4714-8838-f86b0b0eb85b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1314 microversion: 2.1 time: 0.367144 Aug 29 05:04:50.642913 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1626/3315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:50 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:50.867583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:50.878745 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cdf5dfdc-6ae7-4200-b65d-263d8cf64c81 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1766 microversion: 2.1 time: 0.301673 Aug 29 05:04:50.881264 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1690/3316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:50 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1766 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:51.419873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:51.421013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:51.430702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:51.431198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:51.431629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:51.434618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:51.435517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:51.436285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:51.668014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:51.668767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:51.679094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:51.698203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:51.698716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:51.699495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:51.699966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:51.700417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:51.953519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:51.991244 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-70321ba5-f3eb-4a57-84e9-3f36f5aa3cbb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1285 microversion: 2.1 time: 0.576874 Aug 29 05:04:51.992078 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1627/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:51 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1285 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:51.996765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d42ac9ed-70ca-4de1-8f20-2490206e38ad req-afff8421-53de-42bb-880b-0d80c809865a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "name": "network-vif-deleted", "tag": "a758dc84-817f-43d7-9e8d-529e3588a2af"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:52.033434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d42ac9ed-70ca-4de1-8f20-2490206e38ad req-afff8421-53de-42bb-880b-0d80c809865a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:52.035403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d42ac9ed-70ca-4de1-8f20-2490206e38ad req-afff8421-53de-42bb-880b-0d80c809865a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:52.035874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d42ac9ed-70ca-4de1-8f20-2490206e38ad req-afff8421-53de-42bb-880b-0d80c809865a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:52.064077 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d42ac9ed-70ca-4de1-8f20-2490206e38ad req-afff8421-53de-42bb-880b-0d80c809865a service nova] Creating event network-vif-deleted:a758dc84-817f-43d7-9e8d-529e3588a2af for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:52.065546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=12 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:52.081081 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d42ac9ed-70ca-4de1-8f20-2490206e38ad req-afff8421-53de-42bb-880b-0d80c809865a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083786 Aug 29 05:04:52.081834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1628/3318] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:52.116073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:52.116819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:52.139018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:52.139906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:52.141010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:52.142057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:52.142678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:52.143261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:52.629718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:52.641347 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b94fcaac-4b46-4dee-a29e-41ee45db0071 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1314 microversion: 2.1 time: 0.976350 Aug 29 05:04:52.645749 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1691/3319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:51 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1314 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:52.821490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:52.829796 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-baf6f2d2-d99e-4651-8c18-1876696921ab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1495 microversion: 2.1 time: 0.730138 Aug 29 05:04:52.843893 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1629/3320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:52 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1495 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:53.015864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:53.016629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:53.027750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:53.030300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:53.030981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:53.035956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:53.036717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:53.037503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:53.389028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:53.405092 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa0961b0-9464-45e3-9276-b54d5f97a531 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1283 microversion: 2.1 time: 0.393165 Aug 29 05:04:53.409905 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1692/3321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:53 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1283 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:53.665053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:53.665670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:53.674155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:53.674990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:53.675611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:53.676586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:53.677854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:53.679524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:53.852200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:53.852828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:53.859698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:53.860211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:53.860648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:53.861351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:53.861796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:53.869693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:54.163133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:54.183436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b7325c8-529f-4e75-9370-a2ad14ad8958 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 200 len: 1453 microversion: 2.1 time: 0.335250 Aug 29 05:04:54.186048 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1693/3322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:53 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 1453 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:54.448917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1207858774", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "26a4c84a-9585-40ec-84b1-dfafa43e0022"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:54.570819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] validate_networks() for [('26a4c84a-9585-40ec-84b1-dfafa43e0022', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:04:54.828995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:54.852924 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fe67de8c-2601-4422-94b3-88dce7f446fb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1314 microversion: 2.1 time: 1.191213 Aug 29 05:04:54.855685 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1630/3323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:53 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1314 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:54.873610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8c66b564-1ed2-47c7-b923-407d76a0aa76 req-5417a942-6288-4c6d-9d3b-576eb43f66bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24126301-9282-4de3-baec-0f704d4ba8fe", "name": "network-vif-deleted", "tag": "d66987d8-b98e-418f-859f-09b227f23c11"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:54.886990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8c66b564-1ed2-47c7-b923-407d76a0aa76 req-5417a942-6288-4c6d-9d3b-576eb43f66bf service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:54.887758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8c66b564-1ed2-47c7-b923-407d76a0aa76 req-5417a942-6288-4c6d-9d3b-576eb43f66bf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:54.888384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8c66b564-1ed2-47c7-b923-407d76a0aa76 req-5417a942-6288-4c6d-9d3b-576eb43f66bf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:54.915716 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8c66b564-1ed2-47c7-b923-407d76a0aa76 req-5417a942-6288-4c6d-9d3b-576eb43f66bf service nova] Creating event network-vif-deleted:d66987d8-b98e-418f-859f-09b227f23c11 for instance 24126301-9282-4de3-baec-0f704d4ba8fe on n-h1-854119-9 Aug 29 05:04:54.922504 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8c66b564-1ed2-47c7-b923-407d76a0aa76 req-5417a942-6288-4c6d-9d3b-576eb43f66bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055290 Aug 29 05:04:54.923685 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1631/3324] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:04:54.930326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:54.931186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:54.941713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:54.942402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:54.942902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:54.943709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:54.944376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:54.945732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:55.242674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:55.255170 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b38fd3c-e7e4-4dee-9f37-ebfc8c96cc66 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1283 microversion: 2.1 time: 0.328293 Aug 29 05:04:55.268832 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1632/3325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:54 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1283 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:55.268832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:55.268832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:55.288406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:55.289265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:55.290058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:55.291431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:55.295630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:55.298578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:55.339771 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] HTTP exception thrown: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Request method failure captured: Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe HTTP/1.1 Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEidbzraonFmAb2xnmQBgR3UbsfEikD-tKpwoCiy3D-ijsVANund7MmfRmThJL5s8WNYoUeFstKGQygKFyUbfZEEDifpeVSxG-wIeBsvqBSMayCPlt_ysoPdvNXgbTnLGXpcq5KdhICusLQDxaszwry2XF-SVgEr-VP1geEiMEHQUXI Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d88eca521500460480561eaa3aaffb1e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestMultiNic-103650619 Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestMultiNic-103650619-project Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4c7ec3047c824b8994376cd3b8b8d796 Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestMultiNic-103650619-project Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '24126301-9282-4de3-baec-0f704d4ba8fe'} Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:04:55.346717 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:55.352113 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:04:55.352113 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:04:55.352113 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:04:55.352113 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:04:55.352113 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:04:55.352113 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:04:55.352113 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:04:55.355431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Returning 404 to user: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:04:55.356566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a02c5358-ddbb-4d3a-a40f-6444badc8fb9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 404 len: 111 microversion: 2.1 time: 0.099622 Aug 29 05:04:55.376979 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1633/3326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:55 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:04:55.878416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:55.879029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:55.887595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:55.896362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:55.897062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:55.897975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:55.901687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:55.903892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:56.388518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:04:56.389539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:04:56.390369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:04:56.390999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:04:56.391972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:04:56.414522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:56.419842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:56.420566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:56.421629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:56.423872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:56.425792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:56.474472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Getting quotas for project abc73918ceed4dffa2519cceac97a427. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:04:56.492212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Getting quotas for user 5f72a6e1c4474708ac653995f83e79d5 and project abc73918ceed4dffa2519cceac97a427. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:04:56.547739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Going to run 3 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:04:56.550547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:04:56.631487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=334eb281-8961-466f-b7d7-d5072629859f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:04:56.712100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=d0db89ed-8539-42a8-97df-67d499980878,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:04:56.851454 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0e1fa89a-fe22-4da9-bfb5-0487e564ea90 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.663763 Aug 29 05:04:56.865646 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1694/3327] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:04:56.876521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:56.880918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:56.913586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:56.928928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:56.929438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:56.929880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:56.935164 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1a6bd5ee-5f08-4ba2-bc4a-aeb1ce0f532d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1314 microversion: 2.1 time: 1.057214 Aug 29 05:04:56.938308 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1634/3328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:55 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1314 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:04:56.940625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:56.941288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:56.946084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:56.964284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:56.975824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:56.986404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Searching by: {'deleted': False, 'project_id': 'abc73918ceed4dffa2519cceac97a427'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:04:57.034790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:57.035287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:57.035726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:57.036487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:57.036943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:57.037367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:57.085313 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5388c3a3-d326-4773-90db-438074cae94c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.144741 Aug 29 05:04:57.095251 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1635/3329] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:04:56 2022] GET /compute/v2.1/servers => generated 1018 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:57.101759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec83e93b-3a14-454c-9c7d-26c9513d2880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:57.102381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec83e93b-3a14-454c-9c7d-26c9513d2880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:57.252081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ec83e93b-3a14-454c-9c7d-26c9513d2880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:57.265238 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec83e93b-3a14-454c-9c7d-26c9513d2880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1223 microversion: 2.1 time: 0.166284 Aug 29 05:04:57.265713 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1636/3330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:57 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1223 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:57.354531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:57.363771 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ebe4047a-8f63-4cb7-b2d2-53e5679c6054 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1325 microversion: 2.1 time: 0.496788 Aug 29 05:04:57.376047 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1695/3331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:56 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1325 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:57.752597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-13aee2bf-b884-4d9f-b4f7-42430e946da1 req-5484c2f3-af87-461d-b94f-782e34409ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72dd2804-662c-4aec-9e28-48f7137e0122", "name": "network-vif-plugged", "status": "completed", "tag": "195dfe40-178f-492d-97ae-18cedf504aba"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:04:57.779211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-13aee2bf-b884-4d9f-b4f7-42430e946da1 req-5484c2f3-af87-461d-b94f-782e34409ab3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:57.785828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-13aee2bf-b884-4d9f-b4f7-42430e946da1 req-5484c2f3-af87-461d-b94f-782e34409ab3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:57.786618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-13aee2bf-b884-4d9f-b4f7-42430e946da1 req-5484c2f3-af87-461d-b94f-782e34409ab3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:57.821886 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-13aee2bf-b884-4d9f-b4f7-42430e946da1 req-5484c2f3-af87-461d-b94f-782e34409ab3 service nova] Creating event network-vif-plugged:195dfe40-178f-492d-97ae-18cedf504aba for instance 72dd2804-662c-4aec-9e28-48f7137e0122 on n-h1-854119-9 Aug 29 05:04:57.838451 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-13aee2bf-b884-4d9f-b4f7-42430e946da1 req-5484c2f3-af87-461d-b94f-782e34409ab3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083387 Aug 29 05:04:57.839136 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1637/3332] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:04:57.961947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:57.963099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:57.971733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:57.980912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:57.981368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:57.982110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:57.982582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:57.983011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:57.987817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:04:58.292585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2aeae642-3f58-4774-a558-bb987b0aa94d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:58.293933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2aeae642-3f58-4774-a558-bb987b0aa94d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:58.391294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2aeae642-3f58-4774-a558-bb987b0aa94d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:58.407667 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2aeae642-3f58-4774-a558-bb987b0aa94d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1223 microversion: 2.1 time: 0.118328 Aug 29 05:04:58.408961 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1638/3333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:58 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1223 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:58.416060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:58.420347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:58.428316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:58.429048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:58.429775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:58.430719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:58.431390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:58.432033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:59.264674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:59.278971 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f83d020a-6cde-4042-9a4d-d3a6dabfe14e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1314 microversion: 2.1 time: 1.321302 Aug 29 05:04:59.279572 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1696/3334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:57 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1314 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:59.347895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:04:59.384033 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd7d1ce1-deec-409d-9f64-e3334f4629e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1325 microversion: 2.1 time: 0.955950 Aug 29 05:04:59.387706 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1639/3335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:58 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1325 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:04:59.433236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:04:59.434114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:04:59.450107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:59.450871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:59.451565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:04:59.452499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:04:59.453434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:04:59.454093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:00.300214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:00.302601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:00.339415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:00.339918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:00.341098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:00.341834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:00.343794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:00.344436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:00.590865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:00.599624 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4cbbd6c3-0976-431d-ae48-c2851897a93d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1227 microversion: 2.1 time: 1.170137 Aug 29 05:05:00.600839 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1697/3336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:04:59 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1227 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:00.606402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:00.607852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:00.614431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:00.615047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:00.615738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:00.616664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:00.617208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:00.617722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:01.256760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:01.265591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:01.278664 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08163b7f-4a3f-4c9f-8741-a086dca0ce20 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1325 microversion: 2.1 time: 0.675863 Aug 29 05:05:01.279436 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1698/3337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:00 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1325 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:01.281976 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-18db9789-928c-437b-b191-0fb5690fe162 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1500 microversion: 2.1 time: 0.986269 Aug 29 05:05:01.282723 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1640/3338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:00 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1500 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:01.317824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:01.331156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:01.339472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-bcfa1ace-3d91-42c1-b9ae-737dbdf78e04 req-6063218b-646e-41a1-8943-5d240fc20482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7cd86f-8448-48e4-bbaa-114c2681b6d6", "tag": "b02bc271-854c-446d-b7ba-02523ed4a10b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:01.356295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:01.362258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:01.363006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:01.364661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:01.366342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:01.370855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:01.377306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bcfa1ace-3d91-42c1-b9ae-737dbdf78e04 req-6063218b-646e-41a1-8943-5d240fc20482 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:01.380523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bcfa1ace-3d91-42c1-b9ae-737dbdf78e04 req-6063218b-646e-41a1-8943-5d240fc20482 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:01.381030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bcfa1ace-3d91-42c1-b9ae-737dbdf78e04 req-6063218b-646e-41a1-8943-5d240fc20482 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:01.412171 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-bcfa1ace-3d91-42c1-b9ae-737dbdf78e04 req-6063218b-646e-41a1-8943-5d240fc20482 service nova] Creating event network-changed:b02bc271-854c-446d-b7ba-02523ed4a10b for instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 on n-h1-854119-9 Aug 29 05:05:01.443057 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-bcfa1ace-3d91-42c1-b9ae-737dbdf78e04 req-6063218b-646e-41a1-8943-5d240fc20482 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149666 Aug 29 05:05:01.443751 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1699/3339] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:01.493232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lazy-loading 'flavor' on Instance uuid 72dd2804-662c-4aec-9e28-48f7137e0122 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:05:01.623368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:01.624394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:01.642478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:01.645632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:01.646233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:01.648969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:01.649575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:01.650170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:01.750766 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4105a88b-63b6-42da-b2f1-960435c70c58 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "POST /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122/action" status: 200 len: 32 microversion: 2.1 time: 0.436063 Aug 29 05:05:01.754797 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1641/3340] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:05:01 2022] POST /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:05:01.778771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:01.780223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:01.793987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:01.794767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:01.795693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:01.796657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:01.797357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:01.797924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:01.991505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:02.004783 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a8ad0c2-8e9a-4758-9f00-3f7ce23cc754 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1293 microversion: 2.1 time: 0.384731 Aug 29 05:05:02.006657 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1700/3341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:01 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1293 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:02.320338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:02.321171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:02.337148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:02.338089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:02.339868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:02.342368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:02.344940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:02.345650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:02.958352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:02.967789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4ba3c8c1-2fcd-496e-a8cc-151bc78e7ecd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 1.206920 Aug 29 05:05:02.969081 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1642/3342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:01 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:03.029910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:03.030719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:03.041094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:03.041764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:03.042467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:03.049365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:03.050107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:03.050701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:03.092624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:03.850067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:03.862185 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f0f2ae6e-5fae-43c4-b32f-32e33a969bac tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1281 microversion: 2.1 time: 0.836390 Aug 29 05:05:03.863181 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1643/3343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:03 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1281 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:03.945164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:03.964008 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-89624e7d-aba1-4cad-b58e-586650ec1bf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1325 microversion: 2.1 time: 1.648582 Aug 29 05:05:03.965385 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1701/3344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:02 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1325 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:03.998381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:03.999502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:04.008808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:04.009897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:04.011114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:04.012783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:04.013508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:04.018255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:04.884280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:04.885123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:04.904092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:04.904874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:04.905511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:04.906645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:04.907453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:04.908038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:05.057678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:05.076457 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bea4e282-120a-439a-abc8-a25ea8e81321 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1281 microversion: 2.1 time: 0.195876 Aug 29 05:05:05.080562 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1702/3345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:04 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1281 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:05.087556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:05.088788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:05.112159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:05.113253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:05.114025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:05.115099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:05.115736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:05.116520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:05.364743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:05.377358 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d9a060ce-820c-4ae0-8764-58330fae53d4 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 1.386207 Aug 29 05:05:05.380156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:05.384595 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1644/3346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:03 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:05.400470 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d020348-7192-4bee-aae1-94cc805f5296 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1325 microversion: 2.1 time: 0.318159 Aug 29 05:05:05.401079 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1703/3347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:05 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:06.103169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:06.104313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:06.116957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:06.118942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:06.120074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:06.122875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:06.123460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:06.124202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:06.409073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:06.409682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:06.422762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:06.423266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:06.427958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:06.429083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:06.429727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:06.430341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:06.477620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:06.533726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:07.058826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:07.206245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:07.220926 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a6f05a9-c5da-4ed1-b997-63c8d676d07d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 0.816026 Aug 29 05:05:07.221885 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1704/3348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:06 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:07.234469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:07.235800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:07.235966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:07.255986 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b5cf3300-3fea-49ad-9234-f23af0387a6c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1323 microversion: 2.1 time: 1.154973 Aug 29 05:05:07.259107 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1645/3349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:06 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1323 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:07.275628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1327920721", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "2e1f3c5f-92d8-44db-a202-cc08ac9958f1"}, {"uuid": "8f72f5be-5862-4d52-928d-34281845903d"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:07.277553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:07.278192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:07.278646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:07.279394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:07.279871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:07.280332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:07.390204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] validate_networks() for [('2e1f3c5f-92d8-44db-a202-cc08ac9958f1', None, None, None, None, None), ('8f72f5be-5862-4d52-928d-34281845903d', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:05:07.912950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:07.932951 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-efeb152c-4ae9-49b4-92dd-f396a261217a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1325 microversion: 2.1 time: 0.706798 Aug 29 05:05:07.933874 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1705/3350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:07 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1325 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:08.254511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-456d0af0-0e74-4b25-9fab-58bdbb3e2c8d tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Action: 'create', calling method: .version_select at 0x7f1ab8b494c0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:08.265627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:08.281829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-456d0af0-0e74-4b25-9fab-58bdbb3e2c8d tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Getting quotas for project 318f65cc4f6449ee888e8980c93f5367. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:05:08.289127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-456d0af0-0e74-4b25-9fab-58bdbb3e2c8d tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Getting quotas for user f52de0ca9f4147a385d8abddb3b02574 and project 318f65cc4f6449ee888e8980c93f5367. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:05:08.393642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-456d0af0-0e74-4b25-9fab-58bdbb3e2c8d tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Getting quotas for project 318f65cc4f6449ee888e8980c93f5367. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:05:08.396739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:08.404403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-456d0af0-0e74-4b25-9fab-58bdbb3e2c8d tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Getting quotas for user f52de0ca9f4147a385d8abddb3b02574 and project 318f65cc4f6449ee888e8980c93f5367. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:05:08.420906 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-456d0af0-0e74-4b25-9fab-58bdbb3e2c8d tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.387328 Aug 29 05:05:08.421957 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1706/3351] 10.222.0.20 () {62 vars in 1214 bytes} [Mon Aug 29 05:05:08 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:05:08.427091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:08.427941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:08.435089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:08.435859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:08.436490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:08.437401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:08.438023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:08.438702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:09.837744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:09.849687 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b268a79c-cfdd-4984-9668-d071bec8a9d3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 1.426251 Aug 29 05:05:09.862090 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1707/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:08 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:09.873219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:09.874067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:09.881076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:09.890360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:09.891721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:09.892952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:09.893728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:09.894889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:10.995371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:11.026698 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7f6356b5-c235-4686-86c1-8b23a0a99fcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1323 microversion: 2.1 time: 1.157674 Aug 29 05:05:11.027945 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1708/3353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:09 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1323 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:11.033006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b94837c-7379-42b9-a901-73c83656b5ad tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:11.051689 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b94837c-7379-42b9-a901-73c83656b5ad tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.022400 Aug 29 05:05:11.059910 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1709/3354] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 29 05:05:11 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:05:11.066670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:11.067953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:11.076683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:11.077458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:11.078477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:11.079462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:11.080076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:11.080709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:12.106723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:05:12.108365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:05:12.109369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:05:12.113982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:05:12.115080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:05:12.130602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:12.140651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:12.141539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:12.142205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:12.144053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:12.147752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:12.149254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:12.191642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Getting quotas for project d88eca521500460480561eaa3aaffb1e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:05:12.209396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Getting quotas for user 4c7ec3047c824b8994376cd3b8b8d796 and project d88eca521500460480561eaa3aaffb1e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:05:12.223714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:05:12.226515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:05:12.306568 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-946de759-6865-418b-929e-88105feae01f tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.035276 Aug 29 05:05:12.315744 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1646/3355] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:05:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 5045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:05:12.331425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:12.332044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:12.373900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:12.376494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:12.379137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:12.381537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:12.382722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:12.384010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:12.533015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:12.550975 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-64f87f81-6214-4a80-a7e8-b29ee3447e57 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1325 microversion: 2.1 time: 1.487027 Aug 29 05:05:12.564920 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1710/3356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:11 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1325 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:12.574106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-895138bb-ee5d-4af7-9552-f5131039d73f tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:12.601157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-895138bb-ee5d-4af7-9552-f5131039d73f tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/9fe5f964-a991-48ab-aaab-0a70994aa26e" status: 200 len: 235 microversion: 2.64 time: 0.030810 Aug 29 05:05:12.601706 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1711/3357] 10.222.0.20 () {60 vars in 1304 bytes} [Mon Aug 29 05:05:12 2022] GET /compute/v2.1/os-server-groups/9fe5f964-a991-48ab-aaab-0a70994aa26e => generated 235 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:05:12.620923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:12.625453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:12.674155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:12.674724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:12.675202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:12.675867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:12.676323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:12.676744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:12.762101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:05:12.944467 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-95f1eed3-9769-4e99-80db-eed78cd07082 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 204 len: 0 microversion: 2.1 time: 0.336775 Aug 29 05:05:12.946244 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1712/3358] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:05:12 2022] DELETE /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:05:12.978332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:12.979395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:13.000361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:13.003728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:13.005861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:13.011068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:13.015632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:13.016887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:13.462879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:13.490800 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a6ece75f-33e1-4bed-b6a5-5f0abf8565cd tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 1.162034 Aug 29 05:05:13.495003 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1647/3359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:12 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:13.501714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:13.505885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:13.520759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:13.524872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:13.525688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:13.526652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:13.527120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:13.529848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:13.786877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:13.809785 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a063586a-7d9e-4be9-986d-b7eabe680f1c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1217 microversion: 2.1 time: 0.313213 Aug 29 05:05:13.810496 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1648/3360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:13 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1217 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:13.820861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb88166a-6dde-4ecb-8ec6-b27465a13ca6 tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:13.880232 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eb88166a-6dde-4ecb-8ec6-b27465a13ca6 tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/9fe5f964-a991-48ab-aaab-0a70994aa26e" status: 204 len: 0 microversion: 2.64 time: 0.068315 Aug 29 05:05:13.881595 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1649/3361] 10.222.0.20 () {60 vars in 1307 bytes} [Mon Aug 29 05:05:13 2022] DELETE /compute/v2.1/os-server-groups/9fe5f964-a991-48ab-aaab-0a70994aa26e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:05:13.887640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:13.901925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:13.917273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:13.929951 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-10f2e7f4-eb2b-43a3-ae0a-6bd54951ada5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1323 microversion: 2.1 time: 0.982452 Aug 29 05:05:13.930689 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1713/3362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:12 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1323 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:13.933073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:13.933761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:13.936154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:13.937079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:13.938843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:13.939446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:13.940705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-11875c20-8ee0-4032-8186-6b708ca96086 req-f22e60d7-4e56-4c6e-986a-721e220c1389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7cd86f-8448-48e4-bbaa-114c2681b6d6", "name": "network-vif-plugged", "status": "completed", "tag": "b02bc271-854c-446d-b7ba-02523ed4a10b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:13.959355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-11875c20-8ee0-4032-8186-6b708ca96086 req-f22e60d7-4e56-4c6e-986a-721e220c1389 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:13.965957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-11875c20-8ee0-4032-8186-6b708ca96086 req-f22e60d7-4e56-4c6e-986a-721e220c1389 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:13.966591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-11875c20-8ee0-4032-8186-6b708ca96086 req-f22e60d7-4e56-4c6e-986a-721e220c1389 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:13.993128 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-11875c20-8ee0-4032-8186-6b708ca96086 req-f22e60d7-4e56-4c6e-986a-721e220c1389 service nova] Creating event network-vif-plugged:b02bc271-854c-446d-b7ba-02523ed4a10b for instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 on n-h1-854119-9 Aug 29 05:05:14.001171 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-11875c20-8ee0-4032-8186-6b708ca96086 req-f22e60d7-4e56-4c6e-986a-721e220c1389 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068836 Aug 29 05:05:14.002638 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1714/3363] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:14.009291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:14.010225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:14.017864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:14.018442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:14.018881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:14.019595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:14.020255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:14.020685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:14.041773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:15.228562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:15.269403 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad304f91-b85b-4737-8981-6ae05427d6b5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1325 microversion: 2.1 time: 1.260690 Aug 29 05:05:15.270575 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1715/3364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:14 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1325 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:15.290886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fee3000a-077d-477f-8a82-87b7abe39f6a tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:15.338132 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-fee3000a-077d-477f-8a82-87b7abe39f6a tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] HTTP exception thrown: Instance group 9fe5f964-a991-48ab-aaab-0a70994aa26e could not be found. Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fee3000a-077d-477f-8a82-87b7abe39f6a tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Request method failure captured: Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-server-groups/9fe5f964-a991-48ab-aaab-0a70994aa26e HTTP/1.1 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkDCia8977X-5hwuCBM92oV_XBJTIxeQuOqOSGehc9YPHeKogUJKwkNhqMGSdo6GkUtEiso_WJYTnwmSe3KY54xO1fizujDuv_YMWlZb0ExTflTWfBenTV2PnrkEuEpZ28MOoAeZ0S3zPMP678bGPRdokf9kaGG8NhHguqZ1vCIy8g Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.64 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 318f65cc4f6449ee888e8980c93f5367 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerGroup264TestJSON-132814133 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/318f65cc4f6449ee888e8980c93f5367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/318f65cc4f6449ee888e8980c93f5367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_318f65cc4f6449ee888e8980c93f5367", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/318f65cc4f6449ee888e8980c93f5367"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerGroup264TestJSON-132814133 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 318f65cc4f6449ee888e8980c93f5367 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerGroup264TestJSON-132814133 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerGroup264TestJSON-132814133-project Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f52de0ca9f4147a385d8abddb3b02574 Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerGroup264TestJSON-132814133-project Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance group 9fe5f964-a991-48ab-aaab-0a70994aa26e could not be found. Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '9fe5f964-a991-48ab-aaab-0a70994aa26e'} Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9fe5f964-a991-48ab-aaab-0a70994aa26e could not be found. Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9fe5f964-a991-48ab-aaab-0a70994aa26e could not be found. Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:15.348456 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:15.353966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:15.353966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:15.353966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:05:15.353966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:05:15.353966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9fe5f964-a991-48ab-aaab-0a70994aa26e could not be found. Aug 29 05:05:15.353966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:15.355913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fee3000a-077d-477f-8a82-87b7abe39f6a tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] Returning 404 to user: Instance group 9fe5f964-a991-48ab-aaab-0a70994aa26e could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:15.357234 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fee3000a-077d-477f-8a82-87b7abe39f6a tempest-ServerGroup264TestJSON-132814133 tempest-ServerGroup264TestJSON-132814133-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/9fe5f964-a991-48ab-aaab-0a70994aa26e" status: 404 len: 117 microversion: 2.64 time: 0.082832 Aug 29 05:05:15.358415 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1716/3365] 10.222.0.20 () {60 vars in 1307 bytes} [Mon Aug 29 05:05:15 2022] DELETE /compute/v2.1/os-server-groups/9fe5f964-a991-48ab-aaab-0a70994aa26e => generated 117 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:05:15.373340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-09270979-c565-4dee-96ec-f15c7340256a req-fd4d7ed9-ef4e-471b-9631-daa70e0639aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7077aa-3941-41dd-8a39-0398f9f70ac0", "tag": "d25cbfd5-3d36-46f4-82d6-6f6e54b18aa8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:15.386298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-09270979-c565-4dee-96ec-f15c7340256a req-fd4d7ed9-ef4e-471b-9631-daa70e0639aa service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:15.387092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-09270979-c565-4dee-96ec-f15c7340256a req-fd4d7ed9-ef4e-471b-9631-daa70e0639aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:15.387722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-09270979-c565-4dee-96ec-f15c7340256a req-fd4d7ed9-ef4e-471b-9631-daa70e0639aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:15.413784 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-09270979-c565-4dee-96ec-f15c7340256a req-fd4d7ed9-ef4e-471b-9631-daa70e0639aa service nova] Creating event network-changed:d25cbfd5-3d36-46f4-82d6-6f6e54b18aa8 for instance 6c7077aa-3941-41dd-8a39-0398f9f70ac0 on n-h1-854119-9 Aug 29 05:05:15.421792 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-09270979-c565-4dee-96ec-f15c7340256a req-fd4d7ed9-ef4e-471b-9631-daa70e0639aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060613 Aug 29 05:05:15.423313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1717/3366] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:15.430874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:15.432049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:15.439026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:15.439787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:15.440540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:15.441437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:15.442222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:15.442970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:15.461982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:15.475441 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97a2a111-96dd-474d-8769-fb16054ba492 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1666 microversion: 2.1 time: 1.592447 Aug 29 05:05:15.476437 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1650/3367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:13 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1666 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:15.484523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:15.485375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:15.506320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:15.506823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:15.507254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:15.507962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:15.508440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:15.514221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:15.629300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:15.644721 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b857446f-e4ab-4910-9ff9-ec431d273852 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1273 microversion: 2.1 time: 0.165747 Aug 29 05:05:15.645651 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1651/3368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:15 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:15.650162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:15.656471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:15.672610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:15.674854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:15.675773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:15.677743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:15.679967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:15.680676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:16.095467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:16.104163 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39db30b2-3593-4e39-a161-f60bd7a27ac9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 0.679304 Aug 29 05:05:16.118344 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1718/3369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:15 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:16.292059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:16.293009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:16.306952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:16.307811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:16.313231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:16.314158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:16.314735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:16.316642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:16.762830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:16.781109 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ca0d674-f5e1-4b66-b66f-7a126894bf5c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1323 microversion: 2.1 time: 1.134372 Aug 29 05:05:16.796003 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1652/3370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:15 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1323 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:16.805361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:16.807488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:16.815124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:16.818674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:16.819384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:16.821169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:16.821815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:16.825240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:17.710190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:17.719608 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f1d175b1-cda0-41c8-87ef-3adb05ab8b14 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1325 microversion: 2.1 time: 1.431323 Aug 29 05:05:17.722724 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1719/3371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:16 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1325 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:17.727472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:17.728168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:17.738245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:17.739181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:17.739809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:17.740782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:17.741426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:17.742030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:17.929785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:17.939855 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-673fc879-eeb9-4406-998e-d58db115d656 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1271 microversion: 2.1 time: 0.216002 Aug 29 05:05:17.941130 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1720/3372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:17 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:17.946006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:17.946793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:17.953308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:17.953994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:17.954705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:17.955652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:17.956285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:17.956858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:18.126002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:18.135970 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-976f4a71-a71f-4fdb-9828-56f15541572d tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1666 microversion: 2.1 time: 1.338452 Aug 29 05:05:18.136942 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1653/3373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:16 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1666 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:18.142299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-bc14e343-053a-4057-9ab0-38beab1b4ec4 req-35eb864e-cdc1-470e-8c7c-7d753f8f20f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0db89ed-8539-42a8-97df-67d499980878", "tag": "ed6b63ab-4b36-4451-b859-ff5b06e53d2a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:18.157706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bc14e343-053a-4057-9ab0-38beab1b4ec4 req-35eb864e-cdc1-470e-8c7c-7d753f8f20f6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:18.159001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bc14e343-053a-4057-9ab0-38beab1b4ec4 req-35eb864e-cdc1-470e-8c7c-7d753f8f20f6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:18.159824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bc14e343-053a-4057-9ab0-38beab1b4ec4 req-35eb864e-cdc1-470e-8c7c-7d753f8f20f6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:18.206650 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-bc14e343-053a-4057-9ab0-38beab1b4ec4 req-35eb864e-cdc1-470e-8c7c-7d753f8f20f6 service nova] Creating event network-changed:ed6b63ab-4b36-4451-b859-ff5b06e53d2a for instance d0db89ed-8539-42a8-97df-67d499980878 on n-h1-854119-9 Aug 29 05:05:18.214244 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-bc14e343-053a-4057-9ab0-38beab1b4ec4 req-35eb864e-cdc1-470e-8c7c-7d753f8f20f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075789 Aug 29 05:05:18.215652 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1654/3374] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:18.227346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:18.228276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:18.245452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:18.247376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:18.247376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:18.248203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:18.248767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:18.249456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:18.413290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:19.477996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:19.492703 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c1309d2-1b6e-4afb-a21f-932a70387703 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 1.548972 Aug 29 05:05:19.494657 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1721/3375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:17 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:19.508812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:19.509831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:19.524611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:19.527264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:19.527935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:19.530243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:19.534999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:19.536008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:19.640630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:19.658057 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-273fe6b1-7677-4eb3-8019-5d6619573858 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1323 microversion: 2.1 time: 1.439929 Aug 29 05:05:19.671831 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1655/3376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:18 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1323 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:19.677318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:19.678182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:19.693039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:19.693846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:19.694474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:19.695377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:19.696050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:19.704220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:19.962788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:19.977662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-147ad15f-be46-426a-8b6e-a9f1ba4ab9fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1271 microversion: 2.1 time: 0.304261 Aug 29 05:05:19.980752 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1656/3377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:19 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:19.985793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:19.986522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:20.015998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:20.021815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:20.027762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:20.028929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:20.033358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:20.034169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:20.274164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:20.282554 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b0eae9bb-9d82-4a5f-b6fa-ee1e75c2cfc8 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1598 microversion: 2.1 time: 0.300525 Aug 29 05:05:20.283436 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1657/3378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:19 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1598 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:20.296360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:20.304112 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f90801ae-fd8c-4cc3-9cd0-343ba2b0270e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1521 microversion: 2.1 time: 0.808434 Aug 29 05:05:20.308281 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1722/3379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:19 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1521 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:20.330189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:20.330946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:20.338816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:20.339836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:20.340604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:20.341547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:20.342208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:20.342801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:20.543162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:20.545787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:20.555058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:20.556195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:20.556867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:20.558227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:20.558876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:20.559487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:20.781709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:20.793559 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9150acc5-0c57-4b2a-9132-cfe20fc5887f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1521 microversion: 2.1 time: 0.467650 Aug 29 05:05:20.812802 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1658/3380] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:20 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:20.819409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:20.820325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:20.827103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:20.828318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:20.829034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:20.829894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:20.830582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:20.831157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:21.163831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:21.198347 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad5a4d93-d6f5-43e4-a883-bb6eca6df02b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 0.683217 Aug 29 05:05:21.199058 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1723/3381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:20 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:21.207678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7cd8b384-dab8-4779-b28e-839b5a80176f req-670699a5-35c0-4f89-b8cb-5a8af6a2c6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334eb281-8961-466f-b7d7-d5072629859f", "tag": "3975f2be-1e47-4a9d-9f76-e793253242a9"}, {"server_uuid": "a3cb6b4d-acca-4003-9615-80df2cffdc58", "name": "network-vif-deleted", "tag": "3b7a8ccf-8a67-4962-a826-7c8794637171"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:21.266165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7cd8b384-dab8-4779-b28e-839b5a80176f req-670699a5-35c0-4f89-b8cb-5a8af6a2c6eb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:21.267278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7cd8b384-dab8-4779-b28e-839b5a80176f req-670699a5-35c0-4f89-b8cb-5a8af6a2c6eb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:21.271118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7cd8b384-dab8-4779-b28e-839b5a80176f req-670699a5-35c0-4f89-b8cb-5a8af6a2c6eb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:21.322868 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7cd8b384-dab8-4779-b28e-839b5a80176f req-670699a5-35c0-4f89-b8cb-5a8af6a2c6eb service nova] Creating event network-changed:3975f2be-1e47-4a9d-9f76-e793253242a9 for instance 334eb281-8961-466f-b7d7-d5072629859f on n-h1-854119-9 Aug 29 05:05:21.325793 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7cd8b384-dab8-4779-b28e-839b5a80176f req-670699a5-35c0-4f89-b8cb-5a8af6a2c6eb service nova] Creating event network-vif-deleted:3b7a8ccf-8a67-4962-a826-7c8794637171 for instance a3cb6b4d-acca-4003-9615-80df2cffdc58 on n-h1-854119-9 Aug 29 05:05:21.359259 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7cd8b384-dab8-4779-b28e-839b5a80176f req-670699a5-35c0-4f89-b8cb-5a8af6a2c6eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.156900 Aug 29 05:05:21.364685 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1724/3382] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:21.393619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-223ac692-14fd-4262-832a-7e28afa0c1c5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1628242298"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:21.401449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-223ac692-14fd-4262-832a-7e28afa0c1c5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:21.419138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-223ac692-14fd-4262-832a-7e28afa0c1c5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:21.419951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-223ac692-14fd-4262-832a-7e28afa0c1c5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:21.421989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-223ac692-14fd-4262-832a-7e28afa0c1c5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:21.422924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-223ac692-14fd-4262-832a-7e28afa0c1c5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:21.426636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-223ac692-14fd-4262-832a-7e28afa0c1c5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:21.427285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-223ac692-14fd-4262-832a-7e28afa0c1c5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:21.466753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:21.476097 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f1c2b073-e554-440c-98fa-bf1ddbd6c880 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1323 microversion: 2.1 time: 0.661846 Aug 29 05:05:21.478152 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1659/3383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:20 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1323 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:21.490531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:21.492975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:21.507640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:21.527806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:21.528374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:21.536339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:21.537164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:21.553608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:21.930142 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-223ac692-14fd-4262-832a-7e28afa0c1c5 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6/action" status: 202 len: 0 microversion: 2.1 time: 0.562469 Aug 29 05:05:21.936810 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1725/3384] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:05:21 2022] POST /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 05:05:21.960478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:21.961502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:21.968541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:21.969481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:21.969759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:21.970762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:21.971434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:21.972017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:22.158468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:22.218874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:22.234163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:22.251535 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9fba3723-70bf-497b-a3b6-d135b1b36d07 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1310 microversion: 2.1 time: 0.309696 Aug 29 05:05:22.253979 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1726/3385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:21 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1310 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:22.266049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0205d57-7e59-4fda-8432-50ef80e7d83c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '.version_select at 0x7f1abd96c160>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:22.491956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0205d57-7e59-4fda-8432-50ef80e7d83c tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/images/c63082d9-77de-48c1-a058-5e491c6b9b4c" status: 204 len: 0 microversion: 2.1 time: 0.236099 Aug 29 05:05:22.492899 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1727/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:22 2022] DELETE /compute/v2.1/images/c63082d9-77de-48c1-a058-5e491c6b9b4c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:05:22.500231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:22.501020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:22.518361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:22.519264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:22.519934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:22.524731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:22.525803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:22.529744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:22.592889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:22.603953 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-170f1836-586b-498a-8304-d437c140f12e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1313 microversion: 2.1 time: 1.122621 Aug 29 05:05:22.606511 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1660/3387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:21 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1313 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:22.612372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:22.613348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:22.632680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:22.633812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:22.634270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:22.635296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:22.637841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:22.638358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:23.679888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:23.691736 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bacdb334-8a0a-477e-bf93-21308b3f2cd9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1323 microversion: 2.1 time: 1.083980 Aug 29 05:05:23.692414 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1661/3388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:22 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1323 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:23.697366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf658d59-d80e-493e-a6b2-c6c67b2ac91d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '.version_select at 0x7f1ab8ad7a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:23.722071 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-bf658d59-d80e-493e-a6b2-c6c67b2ac91d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Image not found. Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf658d59-d80e-493e-a6b2-c6c67b2ac91d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/images/c63082d9-77de-48c1-a058-5e491c6b9b4c HTTP/1.1 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: exception: Image not found. Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'c63082d9-77de-48c1-a058-5e491c6b9b4c'} Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c63082d9-77de-48c1-a058-5e491c6b9b4c Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 05:05:23.722795 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c63082d9-77de-48c1-a058-5e491c6b9b4c could not be found. Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:05:23.727231 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:23.733585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:23.734031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf658d59-d80e-493e-a6b2-c6c67b2ac91d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Image not found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:23.734363 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e63e93d2-f5ad-42d8-ad0d-736774785c5a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 1.239277 Aug 29 05:05:23.737762 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf658d59-d80e-493e-a6b2-c6c67b2ac91d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/images/c63082d9-77de-48c1-a058-5e491c6b9b4c" status: 404 len: 62 microversion: 2.1 time: 0.038369 Aug 29 05:05:23.737762 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1662/3389] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:05:23 2022] GET /compute/v2.1/images/c63082d9-77de-48c1-a058-5e491c6b9b4c => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:05:23.744570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:23.745490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:23.748312 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1728/3390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:22 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:23.753812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:23.754576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:23.755342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:23.756360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:23.757023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:23.757653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:23.769879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:23.771105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:23.781600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:23.782454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:23.783123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:23.784434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:23.785148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:23.785785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:23.810032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:23.980047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95652f6c355c41e28e3e6f635a6f4868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de791761bfd5463a82ecf6dc0b598a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:23.988532 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-168a9a08-d217-4d45-8561-a70f9acae8f9 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 200 len: 1310 microversion: 2.1 time: 0.249431 Aug 29 05:05:23.995116 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1663/3391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:23 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 1310 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:24.002709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:24.003669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:24.010206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:24.011048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:24.011697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:24.012507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:24.013034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:24.013523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:24.445618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:24.456959 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51ddb4f3-fa7a-453a-a7d6-5d06d9ff1526 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1313 microversion: 2.1 time: 0.705287 Aug 29 05:05:24.457655 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1729/3392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:23 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:24.575077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ae015d87-ddc4-4c36-8e6d-832fee86022d req-583f486d-f6c3-461d-b9ed-dadf58957eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7077aa-3941-41dd-8a39-0398f9f70ac0", "name": "network-vif-plugged", "status": "completed", "tag": "d25cbfd5-3d36-46f4-82d6-6f6e54b18aa8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:24.605924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ae015d87-ddc4-4c36-8e6d-832fee86022d req-583f486d-f6c3-461d-b9ed-dadf58957eb4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:24.610321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ae015d87-ddc4-4c36-8e6d-832fee86022d req-583f486d-f6c3-461d-b9ed-dadf58957eb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:24.611234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ae015d87-ddc4-4c36-8e6d-832fee86022d req-583f486d-f6c3-461d-b9ed-dadf58957eb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:24.665552 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ae015d87-ddc4-4c36-8e6d-832fee86022d req-583f486d-f6c3-461d-b9ed-dadf58957eb4 service nova] Creating event network-vif-plugged:d25cbfd5-3d36-46f4-82d6-6f6e54b18aa8 for instance 6c7077aa-3941-41dd-8a39-0398f9f70ac0 on n-h1-854119-9 Aug 29 05:05:24.680966 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ae015d87-ddc4-4c36-8e6d-832fee86022d req-583f486d-f6c3-461d-b9ed-dadf58957eb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110283 Aug 29 05:05:24.687261 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1730/3393] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:05:24.714828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:24.715054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:24.722757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:24.723255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:24.723880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:24.724624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:24.725068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:24.725730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:25.010375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:25.024180 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72c71fcd-a32e-42fc-919d-6fdc1f776c43 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1541 microversion: 2.1 time: 1.028026 Aug 29 05:05:25.039409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1664/3394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:23 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1541 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:25.044637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:25.053082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:25.070061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:25.070638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:25.075979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:25.082125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:25.083269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:25.084375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:26.199810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:26.209196 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b815c86-8820-444a-b161-68b581e39bd4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1323 microversion: 2.1 time: 1.499230 Aug 29 05:05:26.224882 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1731/3395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:24 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1323 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:26.242154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:26.243341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] [instance: a3cb6b4d-acca-4003-9615-80df2cffdc58] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:26.249812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:26.250567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:26.251177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:26.252042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:26.252735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:26.253317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:26.269536 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] HTTP exception thrown: Instance a3cb6b4d-acca-4003-9615-80df2cffdc58 could not be found. Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Request method failure captured: Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 HTTP/1.1 Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEiSK0wAOF4y38SS2KZru7Ei9dlI7HrzNYZ9XJ_pAMy3H4jql4NRInGPfHF_DTyfsigaUHR7AcZTG8d4Ox2LM_rVP26e37Ja-g6EkY1onoTKkvWUQktrruQe7iJ7QZLWrlJ5U79Lc9biUGV__M4hwKh7f80xyZCkJp0iwL6AKQUI6ic Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: de791761bfd5463a82ecf6dc0b598a2e Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestFqdnHostnames-961103801 Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de791761bfd5463a82ecf6dc0b598a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de791761bfd5463a82ecf6dc0b598a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de791761bfd5463a82ecf6dc0b598a2e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de791761bfd5463a82ecf6dc0b598a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestFqdnHostnames-961103801 Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: de791761bfd5463a82ecf6dc0b598a2e Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-961103801 Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestFqdnHostnames-961103801-project Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 95652f6c355c41e28e3e6f635a6f4868 Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestFqdnHostnames-961103801-project Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance a3cb6b4d-acca-4003-9615-80df2cffdc58 could not be found. Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a3cb6b4d-acca-4003-9615-80df2cffdc58'} Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3cb6b4d-acca-4003-9615-80df2cffdc58 could not be found. Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3cb6b4d-acca-4003-9615-80df2cffdc58 could not be found. Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:26.271694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:26.277636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:26.277636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:26.277636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:26.277636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:05:26.277636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:05:26.277636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3cb6b4d-acca-4003-9615-80df2cffdc58 could not be found. Aug 29 05:05:26.277636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:26.279549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Returning 404 to user: Instance a3cb6b4d-acca-4003-9615-80df2cffdc58 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:26.280805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ab98fbc-27c4-4d61-8a83-2f21662487cf tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58" status: 404 len: 111 microversion: 2.1 time: 0.054555 Aug 29 05:05:26.284879 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1732/3396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:26 2022] GET /compute/v2.1/servers/a3cb6b4d-acca-4003-9615-80df2cffdc58 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:05:26.298981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:26.299324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:26.312501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:26.313363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:26.315183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:26.317465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:26.319933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:26.320108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:26.321193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:26.332069 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f26bb8b2-9b2a-4e9a-8a3a-e25553dbf31d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 1.291137 Aug 29 05:05:26.344147 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1665/3397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:25 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:26.350006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:26.350006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:26.364513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:26.365159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:26.365753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:26.366482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:26.366968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:26.367353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:27.448790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:27.463280 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a6e4fc0-5ac4-401b-9f15-0288aed5fb2c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 1.175603 Aug 29 05:05:27.465335 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1733/3398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:26 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:27.473462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e650c323-5df7-4453-87c3-d2fada03dea1 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] Calling method '.version_select at 0x7f1ab8716790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:27.501157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e650c323-5df7-4453-87c3-d2fada03dea1 tempest-ServersTestFqdnHostnames-961103801 tempest-ServersTestFqdnHostnames-961103801-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-769570994" status: 202 len: 0 microversion: 2.1 time: 0.034359 Aug 29 05:05:27.502457 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1734/3399] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:05:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-769570994 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:05:27.508605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:27.510153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:27.517797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:27.518659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:27.519311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:27.520904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:27.521867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:27.522541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:27.599736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:27.614084 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28413ef4-76e1-49b3-9c75-b110a3dbaf8d tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1533 microversion: 2.1 time: 1.274966 Aug 29 05:05:27.615617 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1666/3400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:26 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1533 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:27.620689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:27.625333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:27.638927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:27.639697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:27.640392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:27.641313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:27.642274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:27.642728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:28.395011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:28.424457 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-080a18ab-75ff-4980-b3fe-1fa3b6f89b98 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1323 microversion: 2.1 time: 0.920563 Aug 29 05:05:28.425640 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1735/3401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:27 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1323 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:28.455241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:28.484981 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eb7cd19b-7dfe-40cc-857a-3a27b31a1a1d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 0.867863 Aug 29 05:05:28.490571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:28.491796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:28.500685 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1667/3402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:27 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:28.510319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:28.515437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:28.515938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:28.516736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:28.520738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:28.521589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:28.565325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:28.638553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:28.639166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:28.653502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:28.654387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:28.655032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:28.656039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:28.656640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:28.657165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:29.131686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:29.141553 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22c0b557-6549-4570-954d-aba8be669b2b tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.655924 Aug 29 05:05:29.142041 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1736/3403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:28 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:29.156036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e8e07451-5a54-4118-a221-008e4e1e695d req-02ef9387-bc2a-4077-b724-cb3cb65654a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0db89ed-8539-42a8-97df-67d499980878", "name": "network-vif-plugged", "status": "completed", "tag": "ed6b63ab-4b36-4451-b859-ff5b06e53d2a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:29.164132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:29.172155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e8e07451-5a54-4118-a221-008e4e1e695d req-02ef9387-bc2a-4077-b724-cb3cb65654a3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:29.172833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e8e07451-5a54-4118-a221-008e4e1e695d req-02ef9387-bc2a-4077-b724-cb3cb65654a3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:29.173754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e8e07451-5a54-4118-a221-008e4e1e695d req-02ef9387-bc2a-4077-b724-cb3cb65654a3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:29.181761 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a15b6141-93b5-4f12-a279-52cff3b03f25 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1539 microversion: 2.1 time: 0.545251 Aug 29 05:05:29.185094 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1668/3404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:28 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1539 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:29.203351 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e8e07451-5a54-4118-a221-008e4e1e695d req-02ef9387-bc2a-4077-b724-cb3cb65654a3 service nova] Creating event network-vif-plugged:ed6b63ab-4b36-4451-b859-ff5b06e53d2a for instance d0db89ed-8539-42a8-97df-67d499980878 on n-h1-854119-9 Aug 29 05:05:29.215027 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e8e07451-5a54-4118-a221-008e4e1e695d req-02ef9387-bc2a-4077-b724-cb3cb65654a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071674 Aug 29 05:05:29.215962 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1737/3405] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:29.294163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-36754b2f-d5f7-4a2a-9010-0046d43cd628 req-7294f176-6f73-4e0a-903f-803ade556337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd9381f-f63a-4acf-8e5b-925d71a52ad4", "tag": "2b7e231e-8a18-41c0-bdec-96acf18a4fd6"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:29.313876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-36754b2f-d5f7-4a2a-9010-0046d43cd628 req-7294f176-6f73-4e0a-903f-803ade556337 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:29.315312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-36754b2f-d5f7-4a2a-9010-0046d43cd628 req-7294f176-6f73-4e0a-903f-803ade556337 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:29.315878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-36754b2f-d5f7-4a2a-9010-0046d43cd628 req-7294f176-6f73-4e0a-903f-803ade556337 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:29.335597 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-36754b2f-d5f7-4a2a-9010-0046d43cd628 req-7294f176-6f73-4e0a-903f-803ade556337 service nova] Creating event network-changed:2b7e231e-8a18-41c0-bdec-96acf18a4fd6 for instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 on n-h1-854119-9 Aug 29 05:05:29.345180 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-36754b2f-d5f7-4a2a-9010-0046d43cd628 req-7294f176-6f73-4e0a-903f-803ade556337 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056878 Aug 29 05:05:29.346693 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1669/3406] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:29.446761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:29.447829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:29.462939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:29.463436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:29.463874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:29.464619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:29.466023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:29.466830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:29.511979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:29.512863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:29.526540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:29.527039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:29.527470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:29.535293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:29.535819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:29.536333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:30.664152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:30.674785 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-11a39329-2196-41ca-89c8-29fa073d4508 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 1.167784 Aug 29 05:05:30.676907 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1670/3407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:29 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:30.689469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:30.690371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:30.707621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:30.708380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:30.708971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:30.709878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:30.710483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:30.711220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:30.832962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:30.853798 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1fefe84e-28ea-4be0-a144-f9b5dec6638b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 200 len: 1515 microversion: 2.1 time: 1.408754 Aug 29 05:05:30.855323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1738/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:29 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 1515 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:30.863837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:30.864722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:30.874197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:30.875214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:30.876190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:30.877258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:30.877944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:30.881315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:31.352824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:31.360760 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f3eb89b2-dc3a-42c3-91bb-7d1ed65c70b1 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.682619 Aug 29 05:05:31.361349 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1671/3409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:30 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:31.371302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:31.377867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:31.385492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:31.386203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:31.386631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:31.387589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:31.388230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:31.388813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:31.623458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:31.665067 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b55c59a-ff52-40e4-940c-386d714a88e2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1539 microversion: 2.1 time: 0.800356 Aug 29 05:05:31.665767 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1739/3410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:30 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1539 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:31.700402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:31.701160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:31.710842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:31.713185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:31.715252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:31.716798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:31.718871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:31.719910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:31.807305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:31.828953 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1103f3cd-ca44-4001-b2db-460ff0d318a1 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 200 len: 1323 microversion: 2.1 time: 0.461267 Aug 29 05:05:31.829558 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1672/3411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:31 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 1323 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:32.239110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:32.249841 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2236432-8bb2-42ec-91d4-fe94e5d74838 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 0.557347 Aug 29 05:05:32.254022 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1740/3412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:31 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:32.385808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:32.386800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:32.391781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:32.396861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:32.397358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:32.397817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:32.398987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:32.399540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:32.400038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:32.438238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-361172941", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:32.552345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] validate_networks() for [('3159e4ba-c07d-4af7-90e8-d5fd3d7aca16', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:05:33.161470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:33.170057 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f87cfec5-da04-47df-9ccd-a19be0d89c91 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.791726 Aug 29 05:05:33.170862 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1741/3413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:32 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:33.175949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:33.176796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:33.186251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:33.187120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:33.187903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:33.189217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:33.190094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:33.191112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:34.108520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:34.123435 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a13d065e-d626-4a1d-a25c-cd2ce4e41071 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1539 microversion: 2.1 time: 0.950890 Aug 29 05:05:34.136416 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1742/3414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:33 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1539 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:34.145095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:34.145715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:34.163232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:34.164252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:34.165116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:34.166016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:34.166889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:34.167750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:34.456772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:05:34.458390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:05:34.459227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:05:34.460404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:05:34.461817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:05:34.483857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:34.484488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:34.485777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:34.486798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:34.487503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:34.488477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:34.520876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Getting quotas for project 6fad41f329c940c8bcef6b67247e1cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:05:34.533440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Getting quotas for user da89ab97a75e413e9c38071e7ab4f2c3 and project 6fad41f329c940c8bcef6b67247e1cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:05:34.555769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:05:34.559180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:05:34.625220 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-40f7c33f-7f08-4c43-837c-e017d766f816 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.367064 Aug 29 05:05:34.633063 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1673/3415] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:05:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:05:34.643749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-90cde90a-b14a-4a17-9bf6-9c395b9dab59 req-26f31884-7a6f-4917-b85b-852d29cee48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7cd86f-8448-48e4-bbaa-114c2681b6d6", "name": "network-vif-plugged", "status": "completed", "tag": "b02bc271-854c-446d-b7ba-02523ed4a10b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:34.656542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-90cde90a-b14a-4a17-9bf6-9c395b9dab59 req-26f31884-7a6f-4917-b85b-852d29cee48f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:34.657449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-90cde90a-b14a-4a17-9bf6-9c395b9dab59 req-26f31884-7a6f-4917-b85b-852d29cee48f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:34.658111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-90cde90a-b14a-4a17-9bf6-9c395b9dab59 req-26f31884-7a6f-4917-b85b-852d29cee48f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:34.670586 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-90cde90a-b14a-4a17-9bf6-9c395b9dab59 req-26f31884-7a6f-4917-b85b-852d29cee48f service nova] Creating event network-vif-plugged:b02bc271-854c-446d-b7ba-02523ed4a10b for instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 on n-h1-854119-9 Aug 29 05:05:34.678352 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-90cde90a-b14a-4a17-9bf6-9c395b9dab59 req-26f31884-7a6f-4917-b85b-852d29cee48f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043635 Aug 29 05:05:34.679628 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1674/3416] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:34.688482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:34.689451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:34.701086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:34.711238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:34.711896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:34.712753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:34.713709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:34.713709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:34.978470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:35.023922 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c88e9a43-c24a-4aa1-9310-d62049aa2ecc tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 200 len: 1323 microversion: 2.1 time: 0.886669 Aug 29 05:05:35.024558 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1743/3417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:34 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 1323 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:35.044425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:35.046422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:35.059381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:35.059909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:35.060375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:35.061084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:35.061713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:35.062143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:35.547040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:35.555373 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a56ab882-fb2e-471c-9d3e-2dbd71830ccf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 0.874191 Aug 29 05:05:35.559877 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1675/3418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:34 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:35.566688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b451ecf-a1f6-40a5-b435-e877c4e7759c tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:35.580433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0b451ecf-a1f6-40a5-b435-e877c4e7759c tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:35.634681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:35.645290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1fb7d05-dcdb-413e-b3c3-7902a82f20e3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.619385 Aug 29 05:05:35.669199 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1744/3419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:35 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:35.685170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:35.685844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:35.692465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:35.692958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:35.696790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:35.713833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:35.714629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:35.715241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:35.826917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0b451ecf-a1f6-40a5-b435-e877c4e7759c tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:35.844765 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0b451ecf-a1f6-40a5-b435-e877c4e7759c tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1223 microversion: 2.1 time: 0.283549 Aug 29 05:05:35.860693 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1676/3420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:35 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1223 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:35.869205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8282c371-a308-4927-aacf-9126e8c7a2d7 req-ed0fcfd4-90d1-4a20-98ae-90385271194c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd9381f-f63a-4acf-8e5b-925d71a52ad4", "tag": "2fa346ee-e8ce-43e5-a3f5-9ca674745481"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:35.906772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8282c371-a308-4927-aacf-9126e8c7a2d7 req-ed0fcfd4-90d1-4a20-98ae-90385271194c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:35.910445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8282c371-a308-4927-aacf-9126e8c7a2d7 req-ed0fcfd4-90d1-4a20-98ae-90385271194c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:35.910956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8282c371-a308-4927-aacf-9126e8c7a2d7 req-ed0fcfd4-90d1-4a20-98ae-90385271194c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:35.940450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8282c371-a308-4927-aacf-9126e8c7a2d7 req-ed0fcfd4-90d1-4a20-98ae-90385271194c service nova] Creating event network-changed:2fa346ee-e8ce-43e5-a3f5-9ca674745481 for instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 on n-h1-854119-9 Aug 29 05:05:35.950555 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8282c371-a308-4927-aacf-9126e8c7a2d7 req-ed0fcfd4-90d1-4a20-98ae-90385271194c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084915 Aug 29 05:05:35.954153 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1677/3421] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:05:36.045831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:36.046542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:36.064958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:36.067128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:36.069078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:36.070900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:36.071470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:36.071944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:36.392193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:36.406858 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-259a5745-514c-41ef-8e49-080689d454c2 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1539 microversion: 2.1 time: 0.732470 Aug 29 05:05:36.408084 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1745/3422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:35 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1539 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:36.468423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:36.477685 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-813fdbbe-52b0-48c2-b3ec-b6177a842ec9 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 200 len: 1323 microversion: 2.1 time: 0.436220 Aug 29 05:05:36.496260 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1678/3423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:36 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:36.587981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:36.589338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:36.607427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:36.609557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:36.610261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:36.611274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:36.614978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:36.615700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:36.670100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:36.670736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:36.688012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:36.688785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:36.690359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:36.691192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:36.691639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:36.692307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:37.116410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:37.155046 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d5154e1-f052-4e3b-a075-c8fe7355337a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1506 microversion: 2.1 time: 0.551831 Aug 29 05:05:37.155046 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1746/3424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:36 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:37.169556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-70fd71aa-6a69-48f5-b435-c3e6ef5f47e6 req-1d64cc9c-ed32-4af9-8a0a-f0122ebd592d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334eb281-8961-466f-b7d7-d5072629859f", "name": "network-vif-plugged", "status": "completed", "tag": "3975f2be-1e47-4a9d-9f76-e793253242a9"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:37.202358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-70fd71aa-6a69-48f5-b435-c3e6ef5f47e6 req-1d64cc9c-ed32-4af9-8a0a-f0122ebd592d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:37.203150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-70fd71aa-6a69-48f5-b435-c3e6ef5f47e6 req-1d64cc9c-ed32-4af9-8a0a-f0122ebd592d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:37.203568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-70fd71aa-6a69-48f5-b435-c3e6ef5f47e6 req-1d64cc9c-ed32-4af9-8a0a-f0122ebd592d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:37.241922 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-70fd71aa-6a69-48f5-b435-c3e6ef5f47e6 req-1d64cc9c-ed32-4af9-8a0a-f0122ebd592d service nova] Creating event network-vif-plugged:3975f2be-1e47-4a9d-9f76-e793253242a9 for instance 334eb281-8961-466f-b7d7-d5072629859f on n-h1-854119-9 Aug 29 05:05:37.259795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:37.269829 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f33b4bba-76ae-4a90-bf3b-78ac4144147a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.603847 Aug 29 05:05:37.282207 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1679/3425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:36 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:37.287276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:37.292631 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-70fd71aa-6a69-48f5-b435-c3e6ef5f47e6 req-1d64cc9c-ed32-4af9-8a0a-f0122ebd592d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151259 Aug 29 05:05:37.316817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:37.321531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:37.322588 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1747/3426] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:37.346898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:37.348711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:37.352362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:37.356605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:37.357956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:37.360710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:37.431393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:37.434773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:37.444525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:37.458000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:37.460636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:37.461567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:37.462777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:37.464090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:37.570174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:37.579986 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4ad4da97-f1e3-4351-81e8-56a14d13369a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1275 microversion: 2.1 time: 0.296442 Aug 29 05:05:37.590826 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1680/3427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:37 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:37.600177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:37.602145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:37.611377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:37.613300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:37.618415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:37.619729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:37.620490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:37.621186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:38.143258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:38.160162 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22c5ee1a-6be2-4a26-a09f-3d927e5d8de4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1521 microversion: 2.1 time: 0.733767 Aug 29 05:05:38.161066 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1748/3428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:37 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1521 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:38.176066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:38.176937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:38.184403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:38.187883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:38.188737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:38.190320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:38.191162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:38.191791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:38.192802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:38.199771 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b8bb18b7-4fdc-4dd6-baa1-8bb0992d61e4 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 200 len: 1516 microversion: 2.1 time: 0.607547 Aug 29 05:05:38.201635 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1681/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:37 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 1516 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:38.217708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:38.218693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:38.237680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:38.242246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:38.242950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:38.244680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:38.248848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:38.249483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:38.299713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:05:38.354681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:38.443625 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f168cb28-0ef9-46ca-b050-93f27ea9f488 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 204 len: 0 microversion: 2.1 time: 0.240087 Aug 29 05:05:38.445551 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1682/3430] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:05:38 2022] DELETE /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:05:38.453609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:38.476705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:38.477854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:38.490849 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5ca6716e-c4d3-4746-a82e-90e83ae57a3f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1486 microversion: 2.1 time: 0.328438 Aug 29 05:05:38.495039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:38.495853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:38.496603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:38.498325 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1749/3431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:38 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1486 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:38.511277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:38.513398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:38.514324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:38.532969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:38.534223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:38.555841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:38.556740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:38.559230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:38.562049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:38.568761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:38.570942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:39.386222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:39.399340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:39.412520 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a677e3d-9211-417c-a662-9ae03812a095 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 200 len: 1323 microversion: 2.1 time: 0.965267 Aug 29 05:05:39.414170 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1683/3432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:38 2022] GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 1323 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:39.424963 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3802ecb6-f434-44d3-9cce-faf9b93c43ca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.903285 Aug 29 05:05:39.425594 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1750/3433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:38 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:39.436390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:39.437135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:39.443522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:39.444351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:39.445043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:39.445972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:39.446230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:39.446848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:39.447073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:39.447697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:39.462194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:39.463891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:39.465776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:39.466742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:39.482026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:39.483373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:39.622544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:39.634412 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d559a483-71af-4ccf-94da-9ce31694661e tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1283 microversion: 2.1 time: 0.207502 Aug 29 05:05:39.635625 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1751/3434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:39 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1283 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:39.642278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-471984183", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:39.755382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] validate_networks() for [('81af7948-8686-4889-851c-da8f5cb0432d', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:05:39.856233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:39.866985 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8cc73e38-d1ca-40c8-a208-1c6a840968f6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1527 microversion: 2.1 time: 0.451487 Aug 29 05:05:39.867804 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1684/3435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:39 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1527 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:40.434174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:40.435989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:40.449331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:40.450228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:40.450910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:40.455080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:40.455952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:40.456646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:40.712067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:05:40.713900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:05:40.714481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:05:40.714983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:05:40.715500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:05:40.726597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:40.727460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:40.728184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:40.729861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:40.730557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:40.731440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:40.758997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Getting quotas for project e0354847e7074255a9b5095f9e589128. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:05:40.766654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Getting quotas for user 7053571eaec54866b01f3c5657ca1e5e and project e0354847e7074255a9b5095f9e589128. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:05:40.786498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:05:40.789418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:05:40.902784 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4731eaa4-792c-4da5-88af-205ecfb5c1a5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.264966 Aug 29 05:05:40.903672 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1752/3436] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:05:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:05:40.916255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:40.917654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:40.926246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:40.927918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:40.928684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:40.930005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:40.930828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:40.931490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:41.078001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:41.087525 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d60f46da-01f5-4222-aa7d-28d8894212c5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 200 len: 1323 microversion: 2.1 time: 0.657108 Aug 29 05:05:41.103521 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1685/3437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:40 2022] GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 1323 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:41.112172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:41.112800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:41.139023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:41.139995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:41.143999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:41.144951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:41.145425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:41.147727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:41.406512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:41.425134 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b7971f69-32a7-4ece-87cf-17c00f3c7bc7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1281 microversion: 2.1 time: 0.326952 Aug 29 05:05:41.425826 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1686/3438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:41 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1281 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:41.430539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:41.431569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:41.457825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:41.458982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:41.459612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:41.460549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:41.461240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:41.462033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:41.915831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:41.929642 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78a45430-bcee-4021-9ad7-2cd4044f8211 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 1.023803 Aug 29 05:05:41.931020 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1753/3439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:40 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:41.942918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:41.943926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:41.963316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:41.964220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:41.964917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:41.965857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:41.966531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:41.967134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:42.185647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:42.196098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:42.209317 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa51d44b-63e5-4aed-9c25-fa80360cc3bf tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1209 microversion: 2.1 time: 0.274707 Aug 29 05:05:42.210048 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1754/3440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:41 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1209 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:42.211512 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7a945c3a-4fbd-4ab1-9d51-5cd9fb87dbe1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1527 microversion: 2.1 time: 0.784204 Aug 29 05:05:42.223769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3a27f24d-ab34-40be-8b43-3c9265f52d57 req-c3460907-62a0-49ba-9250-c2db27c5a460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7cd86f-8448-48e4-bbaa-114c2681b6d6", "name": "network-vif-unplugged", "status": "completed", "tag": "b02bc271-854c-446d-b7ba-02523ed4a10b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:42.230825 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1687/3441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:41 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1527 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:42.245686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:42.246309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:42.260341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3a27f24d-ab34-40be-8b43-3c9265f52d57 req-c3460907-62a0-49ba-9250-c2db27c5a460 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:42.261129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3a27f24d-ab34-40be-8b43-3c9265f52d57 req-c3460907-62a0-49ba-9250-c2db27c5a460 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:42.262472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:42.262973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:42.263403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3a27f24d-ab34-40be-8b43-3c9265f52d57 req-c3460907-62a0-49ba-9250-c2db27c5a460 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:42.263534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:42.264134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:42.268365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:42.268832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:42.271728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:42.297831 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3a27f24d-ab34-40be-8b43-3c9265f52d57 req-c3460907-62a0-49ba-9250-c2db27c5a460 service nova] Creating event network-vif-unplugged:b02bc271-854c-446d-b7ba-02523ed4a10b for instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 on n-h1-854119-9 Aug 29 05:05:42.308141 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3a27f24d-ab34-40be-8b43-3c9265f52d57 req-c3460907-62a0-49ba-9250-c2db27c5a460 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094921 Aug 29 05:05:42.315337 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1755/3442] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:42.451680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:42.453583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:42.467054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:42.469497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:42.470722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:42.472374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:42.472843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:42.473273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:42.667502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:42.677520 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-79995252-5be3-4baf-abe7-c062c101c0c5 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1281 microversion: 2.1 time: 0.231394 Aug 29 05:05:42.696957 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1756/3443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:42 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1281 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:42.951827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:42.953710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:42.966159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:42.970044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:42.970599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:42.978161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:42.978759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:42.979681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:43.171483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:43.182245 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9c127930-3b99-4105-9ad8-04defc87737a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 200 len: 1515 microversion: 2.1 time: 0.952004 Aug 29 05:05:43.183667 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1688/3444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:42 2022] GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 1515 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:43.211098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:43.212227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:43.220392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:43.221410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:43.222250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:43.223765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:43.224614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:43.225289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:43.258242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:05:43.382164 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-222b2920-e5df-4161-9542-65e1aa8e9fa8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "DELETE /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 204 len: 0 microversion: 2.1 time: 0.181236 Aug 29 05:05:43.385758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1689/3445] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:05:43 2022] DELETE /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:05:43.392561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:43.393470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:43.406224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:43.406790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:43.407220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:43.408097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:43.408823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:43.409461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:43.949834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:43.961876 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f002049e-31be-4973-a53e-88099e3ed44d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1271 microversion: 2.1 time: 0.574545 Aug 29 05:05:43.963493 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1690/3446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:43 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1271 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:43.971508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:43.978681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:43.988347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:43.989862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:43.990754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:43.992165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:43.993013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:43.993695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:44.014824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:44.023032 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2d3bacc-5420-4ea3-8ebe-cae4dd3fe7f9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 1.075671 Aug 29 05:05:44.023633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1757/3447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:42 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:44.040257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:44.040792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:44.047883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:44.049260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:44.049871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:44.050770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:44.051416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:44.052191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:44.126582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:44.138425 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86665350-7605-48ad-8d30-1fff4d2869b1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1485 microversion: 2.1 time: 0.171515 Aug 29 05:05:44.139038 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1691/3448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:43 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1485 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:44.144531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:44.152979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:44.166572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:44.167160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:44.167595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:44.168446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:44.168901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:44.169325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:44.508913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:44.860323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:44.869433 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4dea88e3-a8cc-4657-b968-b3734ecfe900 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 200 len: 1521 microversion: 2.1 time: 0.844730 Aug 29 05:05:44.871918 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1758/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:44 2022] GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 1521 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:44.952422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:44.962491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-70adfa58-cddd-45e5-80be-29e546b54fee tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.821708 Aug 29 05:05:44.981555 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1692/3450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:44 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:44.988246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:44.989200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:44.995805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:44.996635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:44.997332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:44.998480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:44.999166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:44.999806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:45.095427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:45.107542 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bbfe2274-5ed4-4f84-b8a5-a1bb683ce7a2 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1271 microversion: 2.1 time: 0.121545 Aug 29 05:05:45.108399 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1693/3451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:44 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:45.115291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:45.115899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:45.133119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:45.134166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:45.136948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:45.141349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:45.143718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:45.146035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:45.300508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-4e9fa25e-395f-440a-a0f1-f3c46d097995 req-1379f8c0-a9be-4656-b061-b7571b43b316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7cd86f-8448-48e4-bbaa-114c2681b6d6", "name": "network-vif-deleted", "tag": "b02bc271-854c-446d-b7ba-02523ed4a10b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:45.320518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4e9fa25e-395f-440a-a0f1-f3c46d097995 req-1379f8c0-a9be-4656-b061-b7571b43b316 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:45.321287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4e9fa25e-395f-440a-a0f1-f3c46d097995 req-1379f8c0-a9be-4656-b061-b7571b43b316 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:45.321908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4e9fa25e-395f-440a-a0f1-f3c46d097995 req-1379f8c0-a9be-4656-b061-b7571b43b316 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:45.346956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-4e9fa25e-395f-440a-a0f1-f3c46d097995 req-1379f8c0-a9be-4656-b061-b7571b43b316 service nova] Creating event network-vif-deleted:b02bc271-854c-446d-b7ba-02523ed4a10b for instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 on n-h1-854119-9 Aug 29 05:05:45.353092 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-4e9fa25e-395f-440a-a0f1-f3c46d097995 req-1379f8c0-a9be-4656-b061-b7571b43b316 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.479545 Aug 29 05:05:45.354409 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1759/3452] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:45.365418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:45.366420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:45.374250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:45.375046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:45.375751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:45.376974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:45.377598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:45.378442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:45.521289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:45.536951 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb029040-eb90-4808-8040-6f474eb6ffeb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1310 microversion: 2.1 time: 0.179283 Aug 29 05:05:45.541331 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1760/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:45 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:45.551848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:45.564340 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6ef98001-ef19-4878-a6e4-be5f61aa9bff tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.453318 Aug 29 05:05:45.565375 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1694/3454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:45 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:45.900430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:45.901177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:45.917088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:45.917580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:45.918431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:45.919348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:45.920041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:45.920680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:45.985911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:45.986585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:45.988910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:46.001813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:46.003988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:46.004873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:46.006930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:46.007600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:46.008405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:46.094777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:46.107219 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab85cff0-2186-4773-9d0d-6d0d8fab36b0 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 200 len: 1521 microversion: 2.1 time: 0.219991 Aug 29 05:05:46.108333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1761/3455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:45 2022] GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:46.129463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:46.130605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:46.138928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:46.140065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:46.140880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:46.142236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:46.143145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:46.143840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:46.213868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:46.229955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fca41287-e04d-4c0d-a96f-8e8dd80aadcb tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.248045 Aug 29 05:05:46.231178 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1695/3456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:45 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:46.304098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:46.315942 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5692d6f-f482-45c6-b511-51d9c47ab641 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1313 microversion: 2.1 time: 0.191510 Aug 29 05:05:46.316861 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1762/3457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:46 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:46.560831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:46.561951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:46.569330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:46.570232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:46.570750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:46.571560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:46.572156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:46.572674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:46.588444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:46.589068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:46.597432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:46.598452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:46.599300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:46.600532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:46.601321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:46.601911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:46.651600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:46.663553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bccd9e9b-9bf7-4b9d-8fe7-18220b4b5786 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 200 len: 1310 microversion: 2.1 time: 0.106618 Aug 29 05:05:46.664469 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1696/3458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:46 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:46.782418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:46.791984 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3f3725f3-c193-4e73-8bf2-8c36d52eccf3 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.206578 Aug 29 05:05:46.793166 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1763/3459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:46 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:47.129449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:47.130480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:47.140154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:47.140913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:47.141541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:47.142519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:47.143137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:47.143729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:47.167404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:47.261184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:47.262132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:47.279098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:47.281553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:47.284758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:47.285738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:47.289479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:47.290116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:48.061671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:48.073579 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7f4a0a16-bef5-4e42-9109-4bd171563c11 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 200 len: 1521 microversion: 2.1 time: 0.948238 Aug 29 05:05:48.084208 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1697/3460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:47 2022] GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 1521 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:48.091754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:48.092956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:48.101919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:48.102696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:48.103412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:48.105985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:48.112872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:48.113323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:48.421336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:48.432410 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6e82b60-81ca-4a17-ba5e-6048008f798a tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 1.183919 Aug 29 05:05:48.446223 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1764/3461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:47 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:48.456545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:48.457307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:48.471439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:48.472772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:48.473236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:48.474101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:48.474734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:48.475321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:48.507282 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 HTTP/1.1 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7e7cd86f-8448-48e4-bbaa-114c2681b6d6'} Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:48.534992 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:48.540510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:48.540510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:48.540510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:48.540510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:48.540510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:05:48.540510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:05:48.540510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:05:48.540510 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:48.548263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:48.552072 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-658326f3-5e68-4665-86b1-ddbaf27cfb4e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 404 len: 111 microversion: 2.1 time: 0.104198 Aug 29 05:05:48.554801 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1765/3462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:48 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:05:48.621681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:48.622718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:48.648894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:48.650027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:48.650695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:48.654196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:48.655002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:48.658237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:49.657256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:49.672381 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b5eb1bb3-20a2-4194-9b5f-955033b7c5f8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1313 microversion: 2.1 time: 1.586620 Aug 29 05:05:49.673169 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1698/3463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:48 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1313 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:49.699755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2007509494", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:49.846003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] validate_networks() for [('e8660360-b6cc-44fc-9714-43a67fd1cc2a', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:05:49.965049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:49.973867 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75d4d8b4-7a16-47d8-a70a-0f247e554abf tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 1.417818 Aug 29 05:05:50.007366 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1766/3464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:48 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:50.017122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:50.018833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:50.034549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:50.038149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:50.039757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:50.041457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:50.042751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:50.044018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:50.749883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:50.777098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:50.857167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:50.873432 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45304dd4-f26c-4ae8-a885-4c366667b809 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 200 len: 1521 microversion: 2.1 time: 0.863274 Aug 29 05:05:50.875615 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1767/3465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:50 2022] GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 1521 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:50.892081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:50.894437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:50.907272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:50.909067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:50.911351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:50.912485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:50.913173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:50.913945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:52.181193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:05:52.182222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:05:52.183618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:05:52.184325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:05:52.185323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:05:52.208751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:52.209741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:52.212437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:52.213210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:52.219697 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6ca0ddc0-f8f1-4749-9820-dbf392f3df02 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 1.341272 Aug 29 05:05:52.219923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:52.220608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:52.222655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:52.234086 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1768/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:50 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:52.290204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Getting quotas for project 0fa590adc4ce4a0ca0249a5abd6340a9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:05:52.309460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Getting quotas for user e421b5bfaefd430fa53ab461f654a517 and project 0fa590adc4ce4a0ca0249a5abd6340a9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:05:52.328061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:05:52.330861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:05:52.425491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7d82c1a3-4676-43d8-aa11-fdd7c574ae41 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.738351 Aug 29 05:05:52.432631 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1699/3467] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:05:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:05:52.438935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:52.439955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:52.447376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:52.448271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:52.448958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:52.449893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:52.450837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:52.451867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:52.529240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b50ba472-2717-48c2-848c-d9a5442e4b24 req-aaf5fd70-11bb-414d-ad03-8b65d946c2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9381f-f63a-4acf-8e5b-925d71a52ad4", "name": "network-vif-plugged", "status": "completed", "tag": "2b7e231e-8a18-41c0-bdec-96acf18a4fd6"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:52.570133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b50ba472-2717-48c2-848c-d9a5442e4b24 req-aaf5fd70-11bb-414d-ad03-8b65d946c2a2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:52.570619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b50ba472-2717-48c2-848c-d9a5442e4b24 req-aaf5fd70-11bb-414d-ad03-8b65d946c2a2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:52.571048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b50ba472-2717-48c2-848c-d9a5442e4b24 req-aaf5fd70-11bb-414d-ad03-8b65d946c2a2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:52.598726 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b50ba472-2717-48c2-848c-d9a5442e4b24 req-aaf5fd70-11bb-414d-ad03-8b65d946c2a2 service nova] Creating event network-vif-plugged:2b7e231e-8a18-41c0-bdec-96acf18a4fd6 for instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 on n-h1-854119-9 Aug 29 05:05:52.612105 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b50ba472-2717-48c2-848c-d9a5442e4b24 req-aaf5fd70-11bb-414d-ad03-8b65d946c2a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376620 Aug 29 05:05:52.614249 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1769/3468] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:52.631916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:52.632861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:52.646778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:52.647574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:52.648424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:52.649311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:52.650095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:52.650701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:53.447995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:53.454068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:53.464024 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5802ad31-7346-4c4b-9d0c-15bf2709ddab tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.847831 Aug 29 05:05:53.476169 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d802bf1-f8b6-4498-8f63-4cfe0c0cf4b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1313 microversion: 2.1 time: 1.029808 Aug 29 05:05:53.476169 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1700/3469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:52 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1313 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:53.476842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1770/3470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:52 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:53.483596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:53.484467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:53.491640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:53.492532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:53.493141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:53.493866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-2984092b-a91b-4ae7-b00e-90482c31dd24 req-c9cd500a-5fd8-4acd-9507-a2a6a6d6e7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334eb281-8961-466f-b7d7-d5072629859f", "name": "network-vif-deleted", "tag": "3975f2be-1e47-4a9d-9f76-e793253242a9"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:53.494291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:53.494945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:53.496463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:53.514104 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] HTTP exception thrown: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Request method failure captured: Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f HTTP/1.1 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEj1ZcKZMML85kTpd--r-G5iKFAAv3qj5E1H-i5zwZmCZkjGc4LoyNm5OY-UVhHq-V2W9MUys3pXOfp6DGKN7BB3pW-cVBFCgbIk1-4c3ArwOeX4g4STFi_CDzUdEnaV6519ACeUG2r4gP2w8XylnlpU9LHoic0mpgKyqSFhg1nRKMU Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abc73918ceed4dffa2519cceac97a427", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 5f72a6e1c4474708ac653995f83e79d5 Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '334eb281-8961-466f-b7d7-d5072629859f'} Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:53.516089 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:53.521257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:53.521257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:53.521257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:53.521257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:53.521257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:05:53.521257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:05:53.521257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:53.521257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:05:53.522776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Returning 404 to user: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:53.523801 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1772b17-b8c4-45d1-abca-807b68edd51e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 404 len: 111 microversion: 2.1 time: 0.045793 Aug 29 05:05:53.528682 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1771/3471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:53 2022] GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:05:53.530519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2984092b-a91b-4ae7-b00e-90482c31dd24 req-c9cd500a-5fd8-4acd-9507-a2a6a6d6e7a8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:53.531148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2984092b-a91b-4ae7-b00e-90482c31dd24 req-c9cd500a-5fd8-4acd-9507-a2a6a6d6e7a8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:53.531846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2984092b-a91b-4ae7-b00e-90482c31dd24 req-c9cd500a-5fd8-4acd-9507-a2a6a6d6e7a8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:53.535746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:53.537345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:53.545486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:53.546164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:53.546908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:53.548023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:53.548748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:53.549348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:53.571127 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2984092b-a91b-4ae7-b00e-90482c31dd24 req-c9cd500a-5fd8-4acd-9507-a2a6a6d6e7a8 service nova] Creating event network-vif-deleted:3975f2be-1e47-4a9d-9f76-e793253242a9 for instance 334eb281-8961-466f-b7d7-d5072629859f on n-h1-854119-9 Aug 29 05:05:53.593796 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-2984092b-a91b-4ae7-b00e-90482c31dd24 req-c9cd500a-5fd8-4acd-9507-a2a6a6d6e7a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118123 Aug 29 05:05:53.594679 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1701/3472] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:53.698655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1244185967", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "388b126b-eb59-4ecb-aa93-a85eefd19dca"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:53.718271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:53.727344 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc0714d8-e466-450d-9dd8-5f6e8b1e314f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1221 microversion: 2.1 time: 0.197255 Aug 29 05:05:53.731375 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1772/3473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:53 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:53.742221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:53.742834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:53.765676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:53.765676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:53.765676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:53.765676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:53.767398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:53.768573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:53.849679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] validate_networks() for [('388b126b-eb59-4ecb-aa93-a85eefd19dca', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:05:54.955994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:54.967077 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-62abfd00-156d-42ea-9e98-0e08bb50ec7f tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 1.232741 Aug 29 05:05:54.967984 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1773/3474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:53 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:54.972834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:54.977783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:54.978667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'abc73918ceed4dffa2519cceac97a427'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:05:55.002833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:55.006328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:55.007577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:55.008411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:55.008880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:55.009303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:55.130965 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3810fa0-0a95-4308-a4ab-e669a280229f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.161667 Aug 29 05:05:55.131549 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1774/3475] 10.222.0.20 () {58 vars in 1230 bytes} [Mon Aug 29 05:05:54 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:05:55.144271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:55.144864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:55.151432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:55.152183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:55.152790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:55.153671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:55.154274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:55.154848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:55.527544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:55.530437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:55.539607 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ea3db94-95fc-4769-8797-a22d73cf486c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.399290 Aug 29 05:05:55.540308 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1775/3476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:55 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:55.550020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:55.552912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:55.561007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:55.561768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:55.562788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:55.563667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:55.564359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:55.564944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:55.848639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:05:55.849681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:05:55.850313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:05:55.850869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:05:55.851431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:05:55.862923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:55.863231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:55.863923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:55.865024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:55.866112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:55.866748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:55.917053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:55.925123 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cb67660e-0d75-4774-9698-dd4baac61def tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1313 microversion: 2.1 time: 0.383573 Aug 29 05:05:55.929070 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1776/3477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:55 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:55.945739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b0cba5b9-b44d-4700-9993-5a6455a5f159 req-8f92a2b2-8e64-4994-9617-85dccec3c46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9381f-f63a-4acf-8e5b-925d71a52ad4", "name": "network-vif-plugged", "status": "completed", "tag": "2fa346ee-e8ce-43e5-a3f5-9ca674745481"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:55.949062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Getting quotas for project 062852699f4a47e98070dc8ae543db6a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:05:55.955911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Getting quotas for user 00048986d35b4cb1934a71d10a851d6d and project 062852699f4a47e98070dc8ae543db6a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:05:55.963101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b0cba5b9-b44d-4700-9993-5a6455a5f159 req-8f92a2b2-8e64-4994-9617-85dccec3c46d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:55.964376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b0cba5b9-b44d-4700-9993-5a6455a5f159 req-8f92a2b2-8e64-4994-9617-85dccec3c46d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:55.966118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b0cba5b9-b44d-4700-9993-5a6455a5f159 req-8f92a2b2-8e64-4994-9617-85dccec3c46d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:55.973441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:05:55.976659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:05:55.994154 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b0cba5b9-b44d-4700-9993-5a6455a5f159 req-8f92a2b2-8e64-4994-9617-85dccec3c46d service nova] Creating event network-vif-plugged:2fa346ee-e8ce-43e5-a3f5-9ca674745481 for instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 on n-h1-854119-9 Aug 29 05:05:56.004836 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b0cba5b9-b44d-4700-9993-5a6455a5f159 req-8f92a2b2-8e64-4994-9617-85dccec3c46d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073137 Aug 29 05:05:56.008395 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1777/3478] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:56.016052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.017125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:56.024215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.024748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.025178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.025880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.026572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.026995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.036806 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ddc00f7-0e2b-4a30-8b9a-60374dc22e4d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.440570 Aug 29 05:05:56.037934 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1702/3479] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:05:56.042785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-59c0d749-25b6-451f-9a7a-8bba4cb93d58 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-59c0d749-25b6-451f-9a7a-8bba4cb93d58 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Request method failure captured: Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEj1ZcKZMML85kTpd--r-G5iKFAAv3qj5E1H-i5zwZmCZkjGc4LoyNm5OY-UVhHq-V2W9MUys3pXOfp6DGKN7BB3pW-cVBFCgbIk1-4c3ArwOeX4g4STFi_CDzUdEnaV6519ACeUG2r4gP2w8XylnlpU9LHoic0mpgKyqSFhg1nRKMU Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abc73918ceed4dffa2519cceac97a427", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5f72a6e1c4474708ac653995f83e79d5 Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: action_args: {} Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 05:05:56.050944 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-59c0d749-25b6-451f-9a7a-8bba4cb93d58 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-59c0d749-25b6-451f-9a7a-8bba4cb93d58 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.013905 Aug 29 05:05:56.061906 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1703/3480] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:05:56.068935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e8bfed16-d3c8-446a-bb00-5e9e349ebf93 req-8e0fbd81-351b-4961-b0f8-b67e7f2a275f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4deb89cd-20c8-4174-9970-7ffe664b03fe", "tag": "4c4aefb9-cb29-4bb5-a591-a6eb1f8970c8"}, {"name": "network-changed", "server_uuid": "d98cdfa7-19c5-4b83-b324-c53bf858f564", "tag": "942a04fc-71eb-4291-bef0-beffb9f6166b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:56.110604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e8bfed16-d3c8-446a-bb00-5e9e349ebf93 req-8e0fbd81-351b-4961-b0f8-b67e7f2a275f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.112505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e8bfed16-d3c8-446a-bb00-5e9e349ebf93 req-8e0fbd81-351b-4961-b0f8-b67e7f2a275f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.112941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e8bfed16-d3c8-446a-bb00-5e9e349ebf93 req-8e0fbd81-351b-4961-b0f8-b67e7f2a275f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.135600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:56.141660 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e8bfed16-d3c8-446a-bb00-5e9e349ebf93 req-8e0fbd81-351b-4961-b0f8-b67e7f2a275f service nova] Creating event network-changed:4c4aefb9-cb29-4bb5-a591-a6eb1f8970c8 for instance 4deb89cd-20c8-4174-9970-7ffe664b03fe on n-h1-854119-9 Aug 29 05:05:56.142762 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e8bfed16-d3c8-446a-bb00-5e9e349ebf93 req-8e0fbd81-351b-4961-b0f8-b67e7f2a275f service nova] Creating event network-changed:942a04fc-71eb-4291-bef0-beffb9f6166b for instance d98cdfa7-19c5-4b83-b324-c53bf858f564 on n-h1-854119-9 Aug 29 05:05:56.147961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e4c4226-a423-4520-befb-5dba5180f343 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1283 microversion: 2.1 time: 0.138096 Aug 29 05:05:56.149686 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1778/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1283 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:56.155407 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e8bfed16-d3c8-446a-bb00-5e9e349ebf93 req-8e0fbd81-351b-4961-b0f8-b67e7f2a275f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096980 Aug 29 05:05:56.156676 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1704/3482] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:56.160187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.160957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:56.168444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-33389405-586e-4eb6-8383-2ec8f5d993cb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.177626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.178184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.178300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-33389405-586e-4eb6-8383-2ec8f5d993cb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:56.178576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.179295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.179738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.180189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.291420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-33389405-586e-4eb6-8383-2ec8f5d993cb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:56.300714 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-33389405-586e-4eb6-8383-2ec8f5d993cb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1218 microversion: 2.1 time: 0.142346 Aug 29 05:05:56.306161 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1705/3483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:56.316447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.326939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:56.328962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Searching by: {'deleted': False, 'project_id': 'abc73918ceed4dffa2519cceac97a427'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:05:56.344406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.344976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.346423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.348872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.349459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.351311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.409107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:05:56.475481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:56.483559 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-425bae99-fd41-40c0-a50f-d70fe3010049 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.332617 Aug 29 05:05:56.488248 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc868694-7433-4503-a568-0eecc2129dcf tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.179936 Aug 29 05:05:56.489535 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1706/3484] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers => generated 683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:56.503895 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1779/3485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:56.512319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.519717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:56.520359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.compute.servers [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Removing options 'limit' from query {{(pid=128871) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 05:05:56.521186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Searching by: {'deleted': False, 'project_id': 'abc73918ceed4dffa2519cceac97a427'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:05:56.526807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.527595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.528430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.529312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.533542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.534231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.560784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.561400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:56.568316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.573250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.573903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.574815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.577954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.578610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.610958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:05:56.703652 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2d874d20-f0ff-4d4e-9708-7fa8e5f4194b tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.203731 Aug 29 05:05:56.705453 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1707/3486] 10.222.0.20 () {58 vars in 1144 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:56.723276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dbee7c86-a466-47d3-87a7-30d1c7000011 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dbee7c86-a466-47d3-87a7-30d1c7000011 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Request method failure captured: Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEj1ZcKZMML85kTpd--r-G5iKFAAv3qj5E1H-i5zwZmCZkjGc4LoyNm5OY-UVhHq-V2W9MUys3pXOfp6DGKN7BB3pW-cVBFCgbIk1-4c3ArwOeX4g4STFi_CDzUdEnaV6519ACeUG2r4gP2w8XylnlpU9LHoic0mpgKyqSFhg1nRKMU Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abc73918ceed4dffa2519cceac97a427", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5f72a6e1c4474708ac653995f83e79d5 Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: action_args: {} Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi '-1' Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 05:05:56.735079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 05:05:56.739942 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.744852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dbee7c86-a466-47d3-87a7-30d1c7000011 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:56.746946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dbee7c86-a466-47d3-87a7-30d1c7000011 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.031988 Aug 29 05:05:56.748423 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1708/3487] 10.222.0.20 () {58 vars in 1142 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:05:56.781565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-359777a2-e0bc-4892-ae40-1091c3d7c29f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-359777a2-e0bc-4892-ae40-1091c3d7c29f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Request method failure captured: Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEj1ZcKZMML85kTpd--r-G5iKFAAv3qj5E1H-i5zwZmCZkjGc4LoyNm5OY-UVhHq-V2W9MUys3pXOfp6DGKN7BB3pW-cVBFCgbIk1-4c3ArwOeX4g4STFi_CDzUdEnaV6519ACeUG2r4gP2w8XylnlpU9LHoic0mpgKyqSFhg1nRKMU Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abc73918ceed4dffa2519cceac97a427", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5f72a6e1c4474708ac653995f83e79d5 Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: action_args: {} Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'testing' Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 05:05:56.789203 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:56.795742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-359777a2-e0bc-4892-ae40-1091c3d7c29f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:56.797383 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-359777a2-e0bc-4892-ae40-1091c3d7c29f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.036666 Aug 29 05:05:56.802225 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1709/3488] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:05:56.840942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d3349a5d-5d62-43c3-b12e-5ee9cb11251e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.852994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d3349a5d-5d62-43c3-b12e-5ee9cb11251e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:56.857512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d3349a5d-5d62-43c3-b12e-5ee9cb11251e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'abc73918ceed4dffa2519cceac97a427'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:05:56.884860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.compute.servers [None req-d3349a5d-5d62-43c3-b12e-5ee9cb11251e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Flavor 'non_existing_flavor' could not be found {{(pid=128871) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 29 05:05:56.888947 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d3349a5d-5d62-43c3-b12e-5ee9cb11251e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.064644 Aug 29 05:05:56.890467 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1710/3489] 10.222.0.20 () {58 vars in 1178 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:05:56.911055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:56.948872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:56.953220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'abc73918ceed4dffa2519cceac97a427'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:05:56.970765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.972868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.973732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:56.976362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:56.980678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:56.981670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.091779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:57.103934 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4047389-c811-4c84-a099-debcdbe2e0ef tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.547203 Aug 29 05:05:57.109843 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1780/3490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:57.142673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:57.145825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:57.160764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.161657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.162271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.163284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.163913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.164540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.173394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e78520d4-d292-47a6-886b-2b20dcf4a22c tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.273743 Aug 29 05:05:57.174442 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1711/3491] 10.222.0.20 () {58 vars in 1174 bytes} [Mon Aug 29 05:05:56 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:05:57.190888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:57.191652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:57.194222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:57.200369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.201690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.202455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.203729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.204666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.205319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.417586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:57.429120 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-014618af-ba4a-4b91-ac5b-c58d1fd10918 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1313 microversion: 2.1 time: 0.305262 Aug 29 05:05:57.429715 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1781/3492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:57 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:57.449560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:57.469441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:57.471294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'abc73918ceed4dffa2519cceac97a427'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:05:57.482753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.483542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.488225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.490047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.491373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.492725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.497579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:57.508415 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1af2f3fb-b30c-4c15-b6c0-6f5778032f0a tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.332654 Aug 29 05:05:57.509619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1712/3493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:57 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:57.515022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:57.516529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:57.525287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.526255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.527214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.529627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.530308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.531383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.643425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:57.644468 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-be9c4678-35ca-46b9-9a2e-a78245f80678 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.208182 Aug 29 05:05:57.647272 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1782/3494] 10.222.0.20 () {58 vars in 1184 bytes} [Mon Aug 29 05:05:57 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:05:57.660853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:57.661726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:57.669086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.669762 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b8cc0a16-03fb-4366-bdc6-494cd368937f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1222 microversion: 2.1 time: 0.155595 Aug 29 05:05:57.670151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.670545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.671058 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1713/3495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:57 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:57.671319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.671895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.672460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.680980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:57.686187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:57.687315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Searching by: {'deleted': False, 'project_id': 'abc73918ceed4dffa2519cceac97a427'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:05:57.693147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.693869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.694490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.695417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.697149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.697770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:57.749559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:05:57.791729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:57.800517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:57.801059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:57.801613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.044564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:58.054402 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7997726b-ff34-491b-83c0-688a293816f8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.396327 Aug 29 05:05:58.055804 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1783/3496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:57 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:58.129949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:58.131278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:58.134638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:58.141223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.152855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.153314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.154059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.154515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.154936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.218451 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e03723d-b9b8-445c-a91d-ee4eabded41d tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.544630 Aug 29 05:05:58.238497 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1714/3497] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 05:05:57 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:58.246137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f7f6c56-0ff8-44fb-90c0-acffe0625ad5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:58.252299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5f7f6c56-0ff8-44fb-90c0-acffe0625ad5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:58.253528 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5f7f6c56-0ff8-44fb-90c0-acffe0625ad5 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012830 Aug 29 05:05:58.265359 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1715/3498] 10.222.0.20 () {58 vars in 1178 bytes} [Mon Aug 29 05:05:58 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:05:58.276737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:58.285508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:58.286237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Searching by: {'deleted': False, 'project_id': 'abc73918ceed4dffa2519cceac97a427'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:05:58.309514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.309965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.310484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.311261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.311717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.312159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.377875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:05:58.432434 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1cba8055-76bf-498f-a60d-fc06040672ce tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.165459 Aug 29 05:05:58.440527 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1716/3499] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:05:58 2022] GET /compute/v2.1/servers => generated 683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:05:58.446755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:58.448611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:58.459353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.460194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.460855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.462812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.463775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.464552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.488429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] HTTP exception thrown: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:58.488794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Request method failure captured: Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f HTTP/1.1 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEj1ZcKZMML85kTpd--r-G5iKFAAv3qj5E1H-i5zwZmCZkjGc4LoyNm5OY-UVhHq-V2W9MUys3pXOfp6DGKN7BB3pW-cVBFCgbIk1-4c3ArwOeX4g4STFi_CDzUdEnaV6519ACeUG2r4gP2w8XylnlpU9LHoic0mpgKyqSFhg1nRKMU Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abc73918ceed4dffa2519cceac97a427", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5f72a6e1c4474708ac653995f83e79d5 Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '334eb281-8961-466f-b7d7-d5072629859f'} Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:05:58.494961 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:58.500401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Returning 404 to user: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:58.501412 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a96d7e7f-f783-410d-b562-689c797ba483 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "DELETE /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 404 len: 111 microversion: 2.1 time: 0.058882 Aug 29 05:05:58.506966 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1717/3500] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:05:58 2022] DELETE /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:05:58.509455 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f64cb3a6-22c6-470c-a765-cf8d96f377eb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.383377 Aug 29 05:05:58.510041 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1784/3501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:58 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:05:58.516526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:58.523462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:58.533138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.533647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:58.534282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:58.535662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.537133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.541248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.541895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.542512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.551957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.552506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.554282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.556587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.557070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.557507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.579977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:05:58.722409 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2ca1c016-ef64-481d-bd59-1326cefcc02f tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 204 len: 0 microversion: 2.1 time: 0.209931 Aug 29 05:05:58.722673 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1785/3502] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:05:58 2022] DELETE /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:05:58.729609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:58.730305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:58.745180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.751125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.751789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:58.752602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:58.756214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:58.756731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.061723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:59.079098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-330b54b8-c9c3-4576-827d-3f8ab43810a8 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.355043 Aug 29 05:05:59.080044 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1786/3503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:58 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:59.105639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:59.107332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:59.124825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.125624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.127866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.130329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.131733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.133598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.167932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:59.178272 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5c45f325-3904-4099-a707-ba2287835541 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1313 microversion: 2.1 time: 0.669830 Aug 29 05:05:59.195367 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1718/3504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:58 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1313 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:59.205639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:59.209835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:59.221000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.222972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.223716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.224838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.225715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.226355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.254383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:05:59.368206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:59.377341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6aa1112f-48d9-4e2b-b71c-08b90e3c5f53 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1222 microversion: 2.1 time: 0.283583 Aug 29 05:05:59.392893 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1787/3505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:59 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:59.399261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:59.399882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:59.406532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.407029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.407472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.408291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.408753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.409169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.458464 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-11b7d18b-6837-4a1b-b812-a762d250d428 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 204 len: 0 microversion: 2.1 time: 0.261470 Aug 29 05:05:59.459704 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1719/3506] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:05:59 2022] DELETE /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:05:59.470430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:59.471179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 334eb281-8961-466f-b7d7-d5072629859f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:59.477644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.478435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.479095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.480340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.480957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.481698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.502953 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] HTTP exception thrown: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Request method failure captured: Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f HTTP/1.1 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEj1ZcKZMML85kTpd--r-G5iKFAAv3qj5E1H-i5zwZmCZkjGc4LoyNm5OY-UVhHq-V2W9MUys3pXOfp6DGKN7BB3pW-cVBFCgbIk1-4c3ArwOeX4g4STFi_CDzUdEnaV6519ACeUG2r4gP2w8XylnlpU9LHoic0mpgKyqSFhg1nRKMU Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abc73918ceed4dffa2519cceac97a427", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5f72a6e1c4474708ac653995f83e79d5 Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '334eb281-8961-466f-b7d7-d5072629859f'} Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:59.505153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:05:59.510641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:59.510641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:05:59.510641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:05:59.510641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:05:59.510641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:05:59.510641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:05:59.510641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. Aug 29 05:05:59.510641 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:05:59.512562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Returning 404 to user: Instance 334eb281-8961-466f-b7d7-d5072629859f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:05:59.513660 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f8689f89-50e6-480c-b330-0a7a7bfbdc02 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f" status: 404 len: 111 microversion: 2.1 time: 0.048095 Aug 29 05:05:59.514755 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1720/3507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:59 2022] GET /compute/v2.1/servers/334eb281-8961-466f-b7d7-d5072629859f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:05:59.540771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5e9ae518-08d5-429e-abd1-4415e8211967 req-ddeb46f3-64e7-48bb-adfc-a2272b4e17ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55906af1-bc5a-4ef9-9421-a375ff759471", "tag": "5e9393af-ed59-4b59-85a5-bd6753153bef"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:05:59.566086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5e9ae518-08d5-429e-abd1-4415e8211967 req-ddeb46f3-64e7-48bb-adfc-a2272b4e17ad service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.566563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5e9ae518-08d5-429e-abd1-4415e8211967 req-ddeb46f3-64e7-48bb-adfc-a2272b4e17ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.568077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5e9ae518-08d5-429e-abd1-4415e8211967 req-ddeb46f3-64e7-48bb-adfc-a2272b4e17ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.696269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:05:59.718064 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4fa6d1cf-ab73-4091-a11c-ece4d748327b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.323883 Aug 29 05:05:59.718584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1788/3508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:59 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:05:59.747853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:05:59.748652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:05:59.761628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.762123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.762560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.763276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:05:59.763732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:05:59.768725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:05:59.986912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:05:59.993356 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5e9ae518-08d5-429e-abd1-4415e8211967 req-ddeb46f3-64e7-48bb-adfc-a2272b4e17ad service nova] Creating event network-changed:5e9393af-ed59-4b59-85a5-bd6753153bef for instance 55906af1-bc5a-4ef9-9421-a375ff759471 on n-h1-854119-9 Aug 29 05:06:00.001556 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5e9ae518-08d5-429e-abd1-4415e8211967 req-ddeb46f3-64e7-48bb-adfc-a2272b4e17ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483911 Aug 29 05:06:00.003956 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1721/3509] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:00.036157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:00.039991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:00.057157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.058398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.059124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.061345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.062844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.063266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.092257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:00.101719 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-596361bc-e2d2-4b5e-9bee-7dadc506e9e8 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 200 len: 1522 microversion: 2.1 time: 0.363297 Aug 29 05:06:00.102311 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1789/3510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:05:59 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:00.117722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:00.129658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:00.154239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.155353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.160501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.161257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.161716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.164509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.478095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:00.496246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:00.514677 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9f6e56fe-6a41-4006-9a7f-2c0fa8bb95fb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.507478 Aug 29 05:06:00.518214 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dc786b74-abf7-4633-8276-12def9536e64 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.405152 Aug 29 05:06:00.520307 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1722/3511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:00 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:00.522511 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1790/3512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:00 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:00.533987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:00.534944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:00.535753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:00.538571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:00.554303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.554801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.555356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.557300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.558005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.558151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.558962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.559757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.560691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.561695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.563797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.564070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.694805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:00.706070 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f9640e53-4d25-4889-91ea-d0377d562011 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1214 microversion: 2.1 time: 0.180773 Aug 29 05:06:00.716196 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1791/3513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:00 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:00.746261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:00.746261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:00.751886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.753108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.753677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.754427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:00.754958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:00.755499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:00.760178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:00.874150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:00.885618 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0da3befe-57f8-4b86-add2-398f0fadcb08 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1313 microversion: 2.1 time: 0.364141 Aug 29 05:06:00.886558 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1723/3514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:00 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:01.036905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:01.045093 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-88a1f218-b15e-4d67-ae34-8b2ee0df2779 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.304237 Aug 29 05:06:01.045659 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1792/3515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:00 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:01.125446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:01.125979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:01.132570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.133063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.133505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.134212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.134671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.135095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.331782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:01.340087 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-879a1ecb-799e-4397-bca6-bec66a395f2a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 200 len: 1522 microversion: 2.1 time: 0.218519 Aug 29 05:06:01.340675 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1724/3516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:01 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:01.543640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:01.544491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:01.548927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:01.550340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:01.552612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.553244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.554036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.554899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.555512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.556104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.557936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.558525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.559171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.560296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.560963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.561434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.791546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:01.801563 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d0233be-4224-4970-a613-352c2f3c4cf4 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.257321 Aug 29 05:06:01.819840 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1725/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:01 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:01.824918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:01.826403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:01.834733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.835958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.836713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.837777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.838660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.839278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.858729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:01.872925 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16307e68-83e5-4b11-9b64-e2c381bb4ecb tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.333698 Aug 29 05:06:01.874261 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1793/3518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:01 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:01.880090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b539cafa-94ea-40d2-b5a9-9d31f7d35414 req-f14caf7a-e0b6-45a7-a429-597e7ca59791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98cdfa7-19c5-4b83-b324-c53bf858f564", "name": "network-vif-plugged", "status": "completed", "tag": "942a04fc-71eb-4291-bef0-beffb9f6166b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:01.891166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b539cafa-94ea-40d2-b5a9-9d31f7d35414 req-f14caf7a-e0b6-45a7-a429-597e7ca59791 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.891907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b539cafa-94ea-40d2-b5a9-9d31f7d35414 req-f14caf7a-e0b6-45a7-a429-597e7ca59791 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.892607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b539cafa-94ea-40d2-b5a9-9d31f7d35414 req-f14caf7a-e0b6-45a7-a429-597e7ca59791 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.908091 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b539cafa-94ea-40d2-b5a9-9d31f7d35414 req-f14caf7a-e0b6-45a7-a429-597e7ca59791 service nova] Creating event network-vif-plugged:942a04fc-71eb-4291-bef0-beffb9f6166b for instance d98cdfa7-19c5-4b83-b324-c53bf858f564 on n-h1-854119-9 Aug 29 05:06:01.914126 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b539cafa-94ea-40d2-b5a9-9d31f7d35414 req-f14caf7a-e0b6-45a7-a429-597e7ca59791 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037906 Aug 29 05:06:01.916576 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1794/3519] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:01.922760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:01.923797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:01.931212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.931959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.932605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.933525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:01.934129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:01.934706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:01.949528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:01.959887 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0d91725c-fe00-4cff-928a-c1c9338ede50 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1214 microversion: 2.1 time: 0.138905 Aug 29 05:06:01.977865 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1726/3520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:01 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:02.066411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:02.067633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:02.074882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:02.075369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:02.075798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:02.076564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:02.077011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:02.077426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:02.099743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:02.107545 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76fc9eed-1cd9-4030-8971-6c254a6f7b77 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1313 microversion: 2.1 time: 0.189584 Aug 29 05:06:02.119650 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1795/3521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:01 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:02.246475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:02.258886 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4478244e-853d-414e-81cb-abe2496229f9 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.196326 Aug 29 05:06:02.262204 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1727/3522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:02 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:02.361956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:02.362842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:02.371651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:02.372441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:02.373098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:02.374301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:02.375080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:02.375748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:02.519106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:02.527006 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4835639c-b3ea-4271-82a9-d2986f835164 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 200 len: 1522 microversion: 2.1 time: 0.169193 Aug 29 05:06:02.527574 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1796/3523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:02 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:02.826817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:02.828644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:02.840872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:02.846198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:02.846744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:02.848914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:02.849622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:02.850292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:02.895309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:02.897045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:02.907312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:02.907835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:02.908491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:02.909414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:02.910021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:02.910589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:04.341319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:04.346505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:04.353402 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5a32064f-3c33-44bf-b681-3bcb8a33c351 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 1.529832 Aug 29 05:06:04.364432 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5b960fce-7df9-4558-bce2-0264d26b0bca tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 1.467842 Aug 29 05:06:04.364432 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1797/3524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:02 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:04.368451 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1728/3525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:02 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:04.371512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:04.372178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:04.377777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:04.379799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:04.391552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:04.394196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:04.397099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:04.398050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:04.399321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:04.400981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:04.401640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:04.403702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:04.404477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:04.410164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:04.410668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:04.417175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:04.722123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:04.735960 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-68b48592-09ea-4ce9-882b-6e2b665ca832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1276 microversion: 2.1 time: 0.373867 Aug 29 05:06:04.737345 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1798/3526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:04 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1276 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:04.761627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:04.762319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:04.769180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:04.769746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:04.770358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:04.771336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:04.772211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:04.773019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:05.062219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:05.072104 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0410049-0c37-4055-ab60-dfd349c5958f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1313 microversion: 2.1 time: 0.702307 Aug 29 05:06:05.075777 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1729/3527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:04 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1313 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:05.093010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:05.095243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:05.114959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:05.116046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:05.116740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:05.118638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:05.120297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:05.122483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:05.390529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:05.402804 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8bd15dc2-1f8b-4f5a-8301-c64a0f0ab8b1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.647266 Aug 29 05:06:05.405858 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1799/3528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:04 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:05.420180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:05.421601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:05.456887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:05.460198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:05.460838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:05.462196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:05.463539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:05.473423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:05.706397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:05.718748 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6eb7dab6-91bc-4a0c-965b-52170818c361 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 200 len: 1522 microversion: 2.1 time: 0.641756 Aug 29 05:06:05.725237 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1730/3529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:05 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:05.729967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:05.732078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:05.750412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:05.752303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:05.753016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:05.754505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:05.755306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:05.756085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:06.061935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:06.073160 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f8fce348-e41b-48ee-a801-bf3e2aed7c11 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1334 microversion: 2.1 time: 0.665860 Aug 29 05:06:06.092472 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1800/3530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:05 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1334 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:06.104719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:06.107276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:06.121894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:06.129186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:06.129641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:06.130384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:06.130838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:06.131254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:06.563933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:06.574065 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e797ffb3-5626-4c04-b41b-d1b66b8d7b3f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.847632 Aug 29 05:06:06.575038 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1731/3531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:05 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:06.581718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-30383511-88c2-4a4d-b159-8ba33ef30503 req-a6f533fe-71e5-4406-96b3-2ae6c8e2dbac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deb89cd-20c8-4174-9970-7ffe664b03fe", "name": "network-vif-plugged", "status": "completed", "tag": "4c4aefb9-cb29-4bb5-a591-a6eb1f8970c8"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:06.597511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-30383511-88c2-4a4d-b159-8ba33ef30503 req-a6f533fe-71e5-4406-96b3-2ae6c8e2dbac service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:06.598248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-30383511-88c2-4a4d-b159-8ba33ef30503 req-a6f533fe-71e5-4406-96b3-2ae6c8e2dbac service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:06.599471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-30383511-88c2-4a4d-b159-8ba33ef30503 req-a6f533fe-71e5-4406-96b3-2ae6c8e2dbac service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:06.649748 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-30383511-88c2-4a4d-b159-8ba33ef30503 req-a6f533fe-71e5-4406-96b3-2ae6c8e2dbac service nova] Creating event network-vif-plugged:4c4aefb9-cb29-4bb5-a591-a6eb1f8970c8 for instance 4deb89cd-20c8-4174-9970-7ffe664b03fe on n-h1-854119-9 Aug 29 05:06:06.664784 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-30383511-88c2-4a4d-b159-8ba33ef30503 req-a6f533fe-71e5-4406-96b3-2ae6c8e2dbac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087473 Aug 29 05:06:06.671314 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1732/3532] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:06.678201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:06.679291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:06.690348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:06.691438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:06.692204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:06.693477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:06.694708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:06.695824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:06.925988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:06.944240 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d770b2b-90f0-490b-af53-ac45973e462c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1318 microversion: 2.1 time: 0.850045 Aug 29 05:06:06.957943 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1801/3533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:06 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1318 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:06.969810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:06.970896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:06.979869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:06.980535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:06.981075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:06.981885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:06.982442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:06.983402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:07.301322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:07.316289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:07.326711 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af92e2ac-111d-4d9f-abbd-374a33fde96b tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.365276 Aug 29 05:06:07.327361 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2bbea056-a15d-47a4-8678-5d5f1dbb69df tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1499 microversion: 2.1 time: 0.653926 Aug 29 05:06:07.328260 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1733/3534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:06 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1499 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:07.333248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-be5b2e7a-d0a1-4ac7-9a62-a3461c0d89eb req-538db9cf-e27e-4aa5-962e-348744d97cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0db89ed-8539-42a8-97df-67d499980878", "name": "network-vif-deleted", "tag": "ed6b63ab-4b36-4451-b859-ff5b06e53d2a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:07.340375 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1802/3535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:06 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:07.345334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-be5b2e7a-d0a1-4ac7-9a62-a3461c0d89eb req-538db9cf-e27e-4aa5-962e-348744d97cb3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:07.346093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-be5b2e7a-d0a1-4ac7-9a62-a3461c0d89eb req-538db9cf-e27e-4aa5-962e-348744d97cb3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:07.346878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-be5b2e7a-d0a1-4ac7-9a62-a3461c0d89eb req-538db9cf-e27e-4aa5-962e-348744d97cb3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:07.350024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:07.350800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:07.363092 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-be5b2e7a-d0a1-4ac7-9a62-a3461c0d89eb req-538db9cf-e27e-4aa5-962e-348744d97cb3 service nova] Creating event network-vif-deleted:ed6b63ab-4b36-4451-b859-ff5b06e53d2a for instance d0db89ed-8539-42a8-97df-67d499980878 on n-h1-854119-9 Aug 29 05:06:07.364764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:07.365255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:07.365688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:07.367930 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-be5b2e7a-d0a1-4ac7-9a62-a3461c0d89eb req-538db9cf-e27e-4aa5-962e-348744d97cb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038259 Aug 29 05:06:07.368227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:07.369125 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1734/3536] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:07.370205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:07.371411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:07.374358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:07.375061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:07.381697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:07.382190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:07.382631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:07.383330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:07.383786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:07.384262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:07.415859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:07.416639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:07.417354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:07.418219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lazy-loading 'fault' on Instance uuid d0db89ed-8539-42a8-97df-67d499980878 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:06:07.573455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:07.790948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=16 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:08.033842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f72a6e1c4474708ac653995f83e79d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc73918ceed4dffa2519cceac97a427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:08.042624 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b439f11a-f11f-469e-a0b7-c9c03517309e tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 200 len: 1313 microversion: 2.1 time: 0.700902 Aug 29 05:06:08.053307 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1803/3537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:07 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:08.070225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e8e2c496-9dca-4f4d-a547-9a3706d268ca req-e8e91c3a-5458-4ac3-a285-3a31bab8a6ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27d2be2f-eb5c-4b80-a822-cf3e1c839b9b", "tag": "afc7eb66-5a91-4927-ab51-f7dc6c9df0e1"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:08.081591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e8e2c496-9dca-4f4d-a547-9a3706d268ca req-e8e91c3a-5458-4ac3-a285-3a31bab8a6ed service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.086812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e8e2c496-9dca-4f4d-a547-9a3706d268ca req-e8e91c3a-5458-4ac3-a285-3a31bab8a6ed service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.087258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e8e2c496-9dca-4f4d-a547-9a3706d268ca req-e8e91c3a-5458-4ac3-a285-3a31bab8a6ed service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.124712 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e8e2c496-9dca-4f4d-a547-9a3706d268ca req-e8e91c3a-5458-4ac3-a285-3a31bab8a6ed service nova] Creating event network-changed:afc7eb66-5a91-4927-ab51-f7dc6c9df0e1 for instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b on n-h1-854119-9 Aug 29 05:06:08.130543 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e8e2c496-9dca-4f4d-a547-9a3706d268ca req-e8e91c3a-5458-4ac3-a285-3a31bab8a6ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075661 Aug 29 05:06:08.132182 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1804/3538] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:08.145453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:08.151448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:08.172539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.180056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.181012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.182504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.183181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.184326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.234100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lazy-loading 'flavor' on Instance uuid d98cdfa7-19c5-4b83-b324-c53bf858f564 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:06:08.282784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:08.291231 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-19934c78-6580-48dd-85b1-9e7da83b078a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1669 microversion: 2.1 time: 0.920943 Aug 29 05:06:08.307425 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1735/3539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:07 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1669 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:08.309540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:08.312400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:08.323148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.325799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.326572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.328967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.329943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.330737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.353866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=14 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:08.356154 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8e24c54d-1ea4-4172-a870-ab4b57d679ea tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "POST /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564/action" status: 200 len: 32 microversion: 2.1 time: 0.221255 Aug 29 05:06:08.357282 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1805/3540] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:06:08 2022] POST /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:06:08.365952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:08.366992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:08.373770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.375396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.376057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.377064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.377733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.378394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.680796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:08.689197 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf5b3e75-56d9-43ac-a38b-35318e915a92 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.391731 Aug 29 05:06:08.689894 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1736/3541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:08 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:08.694955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9638e4a3-5755-41a8-8c72-3b2b186f43d5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:08.695544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9638e4a3-5755-41a8-8c72-3b2b186f43d5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:08.703202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638e4a3-5755-41a8-8c72-3b2b186f43d5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.703883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638e4a3-5755-41a8-8c72-3b2b186f43d5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.704506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638e4a3-5755-41a8-8c72-3b2b186f43d5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.705452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638e4a3-5755-41a8-8c72-3b2b186f43d5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.705907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638e4a3-5755-41a8-8c72-3b2b186f43d5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.706339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9638e4a3-5755-41a8-8c72-3b2b186f43d5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.733026 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9638e4a3-5755-41a8-8c72-3b2b186f43d5 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4/ips" status: 200 len: 179 microversion: 2.1 time: 0.041963 Aug 29 05:06:08.733884 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1737/3542] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:06:08 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4/ips => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:08.739844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:08.740791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:08.747228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.747792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.748347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.749071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.749523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.749942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.750467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:08.760498 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-01fcd636-b811-4a80-a687-8e4d95d1421b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1318 microversion: 2.1 time: 0.401713 Aug 29 05:06:08.776309 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1806/3543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:08 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:08.781690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:08.783297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:08.790105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.797181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.797927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:08.799836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:08.800409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:08.800897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.096904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:09.100784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:09.103932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:09.107085 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ee09287-fd9d-4650-8278-b5d6e73efdf3 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.371975 Aug 29 05:06:09.111195 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-34fea80c-24bb-4060-a8d0-05b4c5544463 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.333409 Aug 29 05:06:09.112076 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1807/3544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:08 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:09.116742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:09.117346 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1738/3545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:08 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:09.117515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:09.124738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.124978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:09.125427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.125834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.125989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: d0db89ed-8539-42a8-97df-67d499980878] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:09.126661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.127301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.127856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.134579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.134579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.134579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.135025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.136141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.136669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.153201 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] HTTP exception thrown: Instance d0db89ed-8539-42a8-97df-67d499980878 could not be found. Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Request method failure captured: Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 HTTP/1.1 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEj1ZcKZMML85kTpd--r-G5iKFAAv3qj5E1H-i5zwZmCZkjGc4LoyNm5OY-UVhHq-V2W9MUys3pXOfp6DGKN7BB3pW-cVBFCgbIk1-4c3ArwOeX4g4STFi_CDzUdEnaV6519ACeUG2r4gP2w8XylnlpU9LHoic0mpgKyqSFhg1nRKMU Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abc73918ceed4dffa2519cceac97a427", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5f72a6e1c4474708ac653995f83e79d5 Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance d0db89ed-8539-42a8-97df-67d499980878 could not be found. Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'd0db89ed-8539-42a8-97df-67d499980878'} Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0db89ed-8539-42a8-97df-67d499980878 could not be found. Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0db89ed-8539-42a8-97df-67d499980878 could not be found. Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.154829 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0db89ed-8539-42a8-97df-67d499980878 could not be found. Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Returning 404 to user: Instance d0db89ed-8539-42a8-97df-67d499980878 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30d1af2e-b741-4410-97e7-c93604b0c75a tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878" status: 404 len: 111 microversion: 2.1 time: 0.037540 Aug 29 05:06:09.159578 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1739/3546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:09 2022] GET /compute/v2.1/servers/d0db89ed-8539-42a8-97df-67d499980878 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:09.161896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:06:09.165308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:09.165894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] [instance: 6c7077aa-3941-41dd-8a39-0398f9f70ac0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:09.172320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.173325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.173325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.173954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.174412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.175516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.189976 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] HTTP exception thrown: Instance 6c7077aa-3941-41dd-8a39-0398f9f70ac0 could not be found. Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Request method failure captured: Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 HTTP/1.1 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEj1ZcKZMML85kTpd--r-G5iKFAAv3qj5E1H-i5zwZmCZkjGc4LoyNm5OY-UVhHq-V2W9MUys3pXOfp6DGKN7BB3pW-cVBFCgbIk1-4c3ArwOeX4g4STFi_CDzUdEnaV6519ACeUG2r4gP2w8XylnlpU9LHoic0mpgKyqSFhg1nRKMU Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abc73918ceed4dffa2519cceac97a427", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abc73918ceed4dffa2519cceac97a427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: abc73918ceed4dffa2519cceac97a427 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1657695362 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5f72a6e1c4474708ac653995f83e79d5 Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ListServersNegativeTestJSON-1657695362-project Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6c7077aa-3941-41dd-8a39-0398f9f70ac0 could not be found. Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6c7077aa-3941-41dd-8a39-0398f9f70ac0'} Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7077aa-3941-41dd-8a39-0398f9f70ac0 could not be found. Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7077aa-3941-41dd-8a39-0398f9f70ac0 could not be found. Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.191946 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7077aa-3941-41dd-8a39-0398f9f70ac0 could not be found. Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] Returning 404 to user: Instance 6c7077aa-3941-41dd-8a39-0398f9f70ac0 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1f7b6462-01a0-4ba8-8a55-513b3b483694 tempest-ListServersNegativeTestJSON-1657695362 tempest-ListServersNegativeTestJSON-1657695362-project] 10.222.0.20 "GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0" status: 404 len: 111 microversion: 2.1 time: 0.031855 Aug 29 05:06:09.200864 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1740/3547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:09 2022] GET /compute/v2.1/servers/6c7077aa-3941-41dd-8a39-0398f9f70ac0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:09.242299 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5bd905e8-8c29-44e4-a128-fbafb6957d3c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 204 len: 0 microversion: 2.1 time: 0.128675 Aug 29 05:06:09.242879 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1808/3548] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:06:09 2022] DELETE /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:06:09.251489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:09.252522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:09.258329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.258810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.259241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.259927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.260478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.260873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.279372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:09.404768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-81f24916-f29e-4f0a-af8e-e6c98f2cb3eb req-f80a4072-6552-4129-baa9-99b0c30e0e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7077aa-3941-41dd-8a39-0398f9f70ac0", "name": "network-vif-deleted", "tag": "d25cbfd5-3d36-46f4-82d6-6f6e54b18aa8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:09.414510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-81f24916-f29e-4f0a-af8e-e6c98f2cb3eb req-f80a4072-6552-4129-baa9-99b0c30e0e9b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.415058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-81f24916-f29e-4f0a-af8e-e6c98f2cb3eb req-f80a4072-6552-4129-baa9-99b0c30e0e9b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.415530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-81f24916-f29e-4f0a-af8e-e6c98f2cb3eb req-f80a4072-6552-4129-baa9-99b0c30e0e9b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.427151 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-81f24916-f29e-4f0a-af8e-e6c98f2cb3eb req-f80a4072-6552-4129-baa9-99b0c30e0e9b service nova] Creating event network-vif-deleted:d25cbfd5-3d36-46f4-82d6-6f6e54b18aa8 for instance 6c7077aa-3941-41dd-8a39-0398f9f70ac0 on n-h1-854119-9 Aug 29 05:06:09.432318 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-81f24916-f29e-4f0a-af8e-e6c98f2cb3eb req-f80a4072-6552-4129-baa9-99b0c30e0e9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032782 Aug 29 05:06:09.433007 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1809/3549] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:09.605838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:09.623413 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa4020b9-d8fe-4605-aaa8-1422f3e4840e tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1675 microversion: 2.1 time: 0.375972 Aug 29 05:06:09.624447 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1741/3550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:09 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1675 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:09.718284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:09.718981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:09.729940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.730500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.730995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.731762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.732454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.733082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.786144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:09.786930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:09.793902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.794679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.795514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:09.796565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:09.797177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:09.797748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:10.111383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:10.125785 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11f1d9d2-fae9-469c-98a8-8060304c228f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.415843 Aug 29 05:06:10.127135 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1810/3551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:09 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:10.132790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:10.133913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:10.134650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:10.145603 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22ffa343-f404-4029-9973-293663075f95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1318 microversion: 2.1 time: 0.366859 Aug 29 05:06:10.146503 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1742/3552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:09 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:10.147845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:10.148635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:10.149303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:10.150273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:10.151215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:10.151865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:10.162474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:10.163340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:10.169589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:10.170295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:10.170886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:10.173108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:10.173797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:10.174223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:10.447298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:10.457517 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba584f1d-0fdf-48e4-910f-d48c3cfa2501 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.328936 Aug 29 05:06:10.459940 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1811/3553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:10 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:10.510908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:10.518933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-283891df-1ba5-410d-b613-435ab5df7e0c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.371435 Aug 29 05:06:10.523688 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1743/3554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:10 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:10.647123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:10.648058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:10.657044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:10.666771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:10.667664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:10.668833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:10.670511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:10.671148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:11.081337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:11.101260 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a3273f92-b88c-4db3-89ab-05e5595a3e51 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1675 microversion: 2.1 time: 0.458739 Aug 29 05:06:11.117491 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1812/3555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:10 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1675 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:11.147384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:11.148104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:11.156262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:11.157517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:11.158137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:11.159055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:11.159723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:11.160634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:11.167431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:11.168420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:11.181184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:11.181659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:11.182082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:11.182843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:11.183213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:11.183623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:11.608020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:11.616046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:11.624226 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd0a9c39-ad35-404e-a0f3-459885d2af26 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.480668 Aug 29 05:06:11.653012 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ddbe4c66-a63d-44c6-84bb-93aaa6a20c2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1318 microversion: 2.1 time: 0.468085 Aug 29 05:06:11.654141 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1744/3556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:11 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:11.655886 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1813/3557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:11 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:11.660737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:11.664928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:11.666260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:11.667164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:11.680377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:11.681178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:11.681972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:11.683163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:11.683855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:11.684823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:11.685446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:11.688156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:11.689023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:11.690198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:11.695072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:11.695924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:12.120220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:12.132461 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f2e74249-57b6-492d-ab93-0fb6bae4ea4e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.475340 Aug 29 05:06:12.133636 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1814/3558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:11 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:12.139001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:12.152757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:12.164452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:12.168094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:12.168972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:12.169724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:12.170198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:12.172858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:12.265846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:12.291535 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f2d7a372-a069-447b-a0e6-42497ff01518 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1323 microversion: 2.1 time: 0.635433 Aug 29 05:06:12.292649 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1745/3559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:11 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:12.661853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:12.662841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:12.672641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:12.674344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:12.677226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:12.679253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:12.681968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:12.683580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:13.053729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:13.062044 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-481da598-d5fd-49cd-b2f6-0276fe7a9709 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1675 microversion: 2.1 time: 0.927170 Aug 29 05:06:13.067782 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1815/3560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:12 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1675 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:13.080574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:13.080574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:13.092693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:13.094081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:13.094935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:13.098866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:13.099340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:13.099773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:13.256150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:13.281394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-85f33365-e2dc-4b33-9b66-851c8346d9dc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.624550 Aug 29 05:06:13.287662 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1746/3561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:12 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:13.298266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:13.300441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:13.308978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:13.309800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:13.310715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:13.311638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:13.312984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:13.313147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:13.633090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:13.643983 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9e67537-36cf-4be7-9dfa-16b3b8d8897f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1318 microversion: 2.1 time: 0.574985 Aug 29 05:06:13.648225 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1816/3562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:13 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:13.664391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:13.665521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:13.671934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:13.675663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:13.676374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:13.677336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:13.685894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:13.686669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:13.692822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:13.710991 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cab839d4-9e41-4dcf-a0fc-f1962e9d3bd7 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.420445 Aug 29 05:06:13.712179 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1747/3563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:13 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:13.977800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:13.987413 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bd9d8df1-463e-4738-900d-12fe6eec6f09 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1520 microversion: 2.1 time: 0.337718 Aug 29 05:06:13.988015 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1817/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:13 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:14.091162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:14.091937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:14.101600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:14.123532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:14.124383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:14.128461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:14.130191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:14.132214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:14.194971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9ee2e59-0a13-47ac-b4ed-a471dc85e9d1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2048490220", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9ee2e59-0a13-47ac-b4ed-a471dc85e9d1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Request method failure captured: Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 243 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkcofUOdVGCPUz13_fqOP75xyQTSM0kP-ku_FHKBnL1BtFeNbGe21zqK_SW_ZyBbppkfJ3CNMpunpNOopQaaGvfGPiadwj62fdugDyUz6rLbTclce0AIdjqL_LpQOhielffkaWQXdoflb2QNsekoyhHJB_F6u7XTTHhF-sBqsuPMkk Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fad41f329c940c8bcef6b67247e1cf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: da89ab97a75e413e9c38071e7ab4f2c3 Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2048490220", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2048490220', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '3159e4ba-c07d-4af7-90e8-d5fd3d7aca16'}]}}} Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:14.199722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9ee2e59-0a13-47ac-b4ed-a471dc85e9d1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9ee2e59-0a13-47ac-b4ed-a471dc85e9d1 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.010066 Aug 29 05:06:14.212356 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1818/3565] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:14 2022] POST /compute/v2.1/servers => generated 175 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:06:14.215344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-58147e95-b532-4094-899a-3240b2f478b8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:14.215344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-58147e95-b532-4094-899a-3240b2f478b8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:14.233760 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-58147e95-b532-4094-899a-3240b2f478b8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] HTTP exception thrown: Instance 1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9 could not be found. Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-58147e95-b532-4094-899a-3240b2f478b8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Request method failure captured: Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9/metadata HTTP/1.1 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkcofUOdVGCPUz13_fqOP75xyQTSM0kP-ku_FHKBnL1BtFeNbGe21zqK_SW_ZyBbppkfJ3CNMpunpNOopQaaGvfGPiadwj62fdugDyUz6rLbTclce0AIdjqL_LpQOhielffkaWQXdoflb2QNsekoyhHJB_F6u7XTTHhF-sBqsuPMkk Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fad41f329c940c8bcef6b67247e1cf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: da89ab97a75e413e9c38071e7ab4f2c3 Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9 could not be found. Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'server_id': '1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9'} Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9 could not be found. Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9 could not be found. Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:14.247185 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:14.255247 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:14.255247 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:14.255247 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9 could not be found. Aug 29 05:06:14.255247 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.255247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-58147e95-b532-4094-899a-3240b2f478b8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Returning 404 to user: Instance 1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:14.255247 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-58147e95-b532-4094-899a-3240b2f478b8 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9/metadata" status: 404 len: 111 microversion: 2.1 time: 0.039645 Aug 29 05:06:14.255247 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1819/3566] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:06:14 2022] GET /compute/v2.1/servers/1f4b3a92-ceab-4ed8-8bfc-ddeb44b693e9/metadata => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:14.301498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:14.302109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:14.311853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:14.312601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:14.312809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:14.322447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:14.327228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:14.328300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:14.694233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:14.702281 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc29e386-98d4-4e03-b7f0-b25043be33e4 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1675 microversion: 2.1 time: 0.614958 Aug 29 05:06:14.708066 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1748/3567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:14 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1675 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:14.713842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc37b79b-73c0-4c00-a5e1-fbe2c19852ab tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-763631305", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc37b79b-73c0-4c00-a5e1-fbe2c19852ab tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Request method failure captured: Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 498 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEkcofUOdVGCPUz13_fqOP75xyQTSM0kP-ku_FHKBnL1BtFeNbGe21zqK_SW_ZyBbppkfJ3CNMpunpNOopQaaGvfGPiadwj62fdugDyUz6rLbTclce0AIdjqL_LpQOhielffkaWQXdoflb2QNsekoyhHJB_F6u7XTTHhF-sBqsuPMkk Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fad41f329c940c8bcef6b67247e1cf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da89ab97a75e413e9c38071e7ab4f2c3 Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-763631305", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-763631305', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3159e4ba-c07d-4af7-90e8-d5fd3d7aca16'}]}}} Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 05:06:14.726755 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:14.730108 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:14.738083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc37b79b-73c0-4c00-a5e1-fbe2c19852ab tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:14.741062 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc37b79b-73c0-4c00-a5e1-fbe2c19852ab tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.031501 Aug 29 05:06:14.746049 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1749/3568] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:14 2022] POST /compute/v2.1/servers => generated 687 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:06:14.753311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:14.757814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:14.758067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:14.775252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:14.775829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:14.776415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:14.778201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:14.780436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e19a2f3-c353-49a0-8102-4bdf1c0cfed6 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.482670 Aug 29 05:06:14.781047 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1820/3569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:14 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:14.781229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:14.781744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:14.810606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:14.811328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:14.836240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:14.839309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:14.839776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:14.843338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:14.848067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:14.848607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:15.307314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:15.309511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:15.315971 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0d85f3f9-90e7-439f-af29-3a23bbee771a tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.518893 Aug 29 05:06:15.316591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1821/3570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:14 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:15.323406 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eef66d93-00a0-46d5-8485-a383190102f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1318 microversion: 2.1 time: 0.575395 Aug 29 05:06:15.329169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5670f4d6-74c0-4871-9837-acb3a4f0df7b req-ccbc768e-919f-4230-8369-e3526240c568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d2be2f-eb5c-4b80-a822-cf3e1c839b9b", "name": "network-vif-plugged", "status": "completed", "tag": "afc7eb66-5a91-4927-ab51-f7dc6c9df0e1"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:15.330430 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1750/3571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:14 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:15.357482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0c63728-d631-4676-ab88-eea458e7a266 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-618199592", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:15.365486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5670f4d6-74c0-4871-9837-acb3a4f0df7b req-ccbc768e-919f-4230-8369-e3526240c568 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:15.365966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5670f4d6-74c0-4871-9837-acb3a4f0df7b req-ccbc768e-919f-4230-8369-e3526240c568 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:15.366392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5670f4d6-74c0-4871-9837-acb3a4f0df7b req-ccbc768e-919f-4230-8369-e3526240c568 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0c63728-d631-4676-ab88-eea458e7a266 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Request method failure captured: Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 499 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEkcofUOdVGCPUz13_fqOP75xyQTSM0kP-ku_FHKBnL1BtFeNbGe21zqK_SW_ZyBbppkfJ3CNMpunpNOopQaaGvfGPiadwj62fdugDyUz6rLbTclce0AIdjqL_LpQOhielffkaWQXdoflb2QNsekoyhHJB_F6u7XTTHhF-sBqsuPMkk Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fad41f329c940c8bcef6b67247e1cf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da89ab97a75e413e9c38071e7ab4f2c3 Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-618199592", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-618199592', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3159e4ba-c07d-4af7-90e8-d5fd3d7aca16'}]}}} Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 05:06:15.371216 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.375419 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.380765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0c63728-d631-4676-ab88-eea458e7a266 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:15.382048 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b0c63728-d631-4676-ab88-eea458e7a266 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.035746 Aug 29 05:06:15.383169 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1751/3572] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:15 2022] POST /compute/v2.1/servers => generated 689 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:06:15.406427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5670f4d6-74c0-4871-9837-acb3a4f0df7b req-ccbc768e-919f-4230-8369-e3526240c568 service nova] Creating event network-vif-plugged:afc7eb66-5a91-4927-ab51-f7dc6c9df0e1 for instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b on n-h1-854119-9 Aug 29 05:06:15.411665 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5670f4d6-74c0-4871-9837-acb3a4f0df7b req-ccbc768e-919f-4230-8369-e3526240c568 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086261 Aug 29 05:06:15.412374 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1822/3573] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:15.505753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51fc3a51-2d37-493f-b240-dcaf2c55cca7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-403663406", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51fc3a51-2d37-493f-b240-dcaf2c55cca7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Request method failure captured: Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 753 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEkcofUOdVGCPUz13_fqOP75xyQTSM0kP-ku_FHKBnL1BtFeNbGe21zqK_SW_ZyBbppkfJ3CNMpunpNOopQaaGvfGPiadwj62fdugDyUz6rLbTclce0AIdjqL_LpQOhielffkaWQXdoflb2QNsekoyhHJB_F6u7XTTHhF-sBqsuPMkk Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fad41f329c940c8bcef6b67247e1cf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da89ab97a75e413e9c38071e7ab4f2c3 Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-403663406", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-403663406', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3159e4ba-c07d-4af7-90e8-d5fd3d7aca16'}]}}} Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:06:15.513695 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:06:15.517041 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:06:15.520648 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.520648 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.522162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51fc3a51-2d37-493f-b240-dcaf2c55cca7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:15.525128 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-51fc3a51-2d37-493f-b240-dcaf2c55cca7 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024484 Aug 29 05:06:15.526839 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1752/3574] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:15 2022] POST /compute/v2.1/servers => generated 1197 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 29 05:06:15.621677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f543f9c-cf53-48c2-bc1d-bc2c5c3c0078 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1211576994", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f543f9c-cf53-48c2-bc1d-bc2c5c3c0078 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Request method failure captured: Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 1266 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkcofUOdVGCPUz13_fqOP75xyQTSM0kP-ku_FHKBnL1BtFeNbGe21zqK_SW_ZyBbppkfJ3CNMpunpNOopQaaGvfGPiadwj62fdugDyUz6rLbTclce0AIdjqL_LpQOhielffkaWQXdoflb2QNsekoyhHJB_F6u7XTTHhF-sBqsuPMkk Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fad41f329c940c8bcef6b67247e1cf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: da89ab97a75e413e9c38071e7ab4f2c3 Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1211576994", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3159e4ba-c07d-4af7-90e8-d5fd3d7aca16"}]}} Aug 29 05:06:15.639685 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1211576994', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3159e4ba-c07d-4af7-90e8-d5fd3d7aca16'}]}}} Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.647422 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:06:15.648974 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:06:15.651296 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 05:06:15.651296 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.651296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f543f9c-cf53-48c2-bc1d-bc2c5c3c0078 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:15.651296 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1f543f9c-cf53-48c2-bc1d-bc2c5c3c0078 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.026134 Aug 29 05:06:15.651296 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1823/3575] 10.222.0.20 () {60 vars in 1148 bytes} [Mon Aug 29 05:06:15 2022] POST /compute/v2.1/servers => generated 2221 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 29 05:06:15.651792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-02cf0d83-934e-462e-bffa-a7287825dd2d tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:15.652531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-02cf0d83-934e-462e-bffa-a7287825dd2d tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: ccddabb1-cbf9-471c-a50b-a801b2d6d4bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:15.664517 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-02cf0d83-934e-462e-bffa-a7287825dd2d tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] HTTP exception thrown: Instance ccddabb1-cbf9-471c-a50b-a801b2d6d4bd could not be found. Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-02cf0d83-934e-462e-bffa-a7287825dd2d tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Request method failure captured: Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ccddabb1-cbf9-471c-a50b-a801b2d6d4bd/metadata/test2 HTTP/1.1 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEkcofUOdVGCPUz13_fqOP75xyQTSM0kP-ku_FHKBnL1BtFeNbGe21zqK_SW_ZyBbppkfJ3CNMpunpNOopQaaGvfGPiadwj62fdugDyUz6rLbTclce0AIdjqL_LpQOhielffkaWQXdoflb2QNsekoyhHJB_F6u7XTTHhF-sBqsuPMkk Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fad41f329c940c8bcef6b67247e1cf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da89ab97a75e413e9c38071e7ab4f2c3 Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ccddabb1-cbf9-471c-a50b-a801b2d6d4bd could not be found. Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': 'ccddabb1-cbf9-471c-a50b-a801b2d6d4bd', 'id': 'test2'} Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccddabb1-cbf9-471c-a50b-a801b2d6d4bd could not be found. Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccddabb1-cbf9-471c-a50b-a801b2d6d4bd could not be found. Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:15.666263 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:15.680465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:15.680465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:15.680465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccddabb1-cbf9-471c-a50b-a801b2d6d4bd could not be found. Aug 29 05:06:15.680465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:15.680465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-02cf0d83-934e-462e-bffa-a7287825dd2d tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Returning 404 to user: Instance ccddabb1-cbf9-471c-a50b-a801b2d6d4bd could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:15.680465 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-02cf0d83-934e-462e-bffa-a7287825dd2d tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/ccddabb1-cbf9-471c-a50b-a801b2d6d4bd/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.019807 Aug 29 05:06:15.681304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:15.681978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:15.686762 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1753/3576] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Aug 29 05:06:15 2022] GET /compute/v2.1/servers/ccddabb1-cbf9-471c-a50b-a801b2d6d4bd/metadata/test2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:15.714998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:15.715505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:15.715997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:15.716676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:15.717125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:15.723839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:15.725815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:15.732243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:15.735009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:15.735954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:15.742003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:15.743139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:15.743788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:15.744470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:15.799835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:06:15.961839 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73646335-12ba-453c-bf98-765dcf6a1f38 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 204 len: 0 microversion: 2.1 time: 0.283577 Aug 29 05:06:15.962635 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1824/3577] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:06:15 2022] DELETE /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:06:15.972716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:15.973776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:15.992515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:15.993322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:15.995412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:15.996978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:15.998575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:15.999189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:16.031329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:16.451016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:16.469102 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dde2aba8-c568-4ec0-8d30-609b00250669 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1675 microversion: 2.1 time: 0.749122 Aug 29 05:06:16.470505 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1754/3578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:15 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1675 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:16.487452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:16.489035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:16.495652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:16.498564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:16.499194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:16.501228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:16.501689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:16.502119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:16.602668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:16.611276 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b394b291-cb9d-4d44-a853-ac64e477c4f0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.646667 Aug 29 05:06:16.612464 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1825/3579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:15 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:16.621847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:16.622713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:16.654463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:16.656293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:16.659733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:16.660619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:16.663541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:16.664276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:16.664864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:16.938844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:16.953579 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3e494486-e2bc-4b50-9cbb-0d4c1d58b709 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1526 microversion: 2.1 time: 0.481254 Aug 29 05:06:16.954176 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1755/3580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:16 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1526 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:16.984698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:16.986375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:17.007644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:17.018267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:17.019098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:17.020036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:17.020696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:17.021322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:17.219443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:17.227871 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69c43a58-da68-421b-8161-c61236cea3dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.609906 Aug 29 05:06:17.233795 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1826/3581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:16 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:17.414435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5a58534a-17ab-474a-a955-b3e093e1d8b1 req-c5f5221b-5a0b-48a6-887f-03b369c22fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9381f-f63a-4acf-8e5b-925d71a52ad4", "name": "network-vif-deleted", "tag": "2b7e231e-8a18-41c0-bdec-96acf18a4fd6"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:17.432210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:17.440307 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9b1850e7-6c2b-47e8-903c-b9f14d5cbbab tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1318 microversion: 2.1 time: 0.471438 Aug 29 05:06:17.443443 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1756/3582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:16 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:17.445249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5a58534a-17ab-474a-a955-b3e093e1d8b1 req-c5f5221b-5a0b-48a6-887f-03b369c22fb2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:17.445822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5a58534a-17ab-474a-a955-b3e093e1d8b1 req-c5f5221b-5a0b-48a6-887f-03b369c22fb2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:17.446265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5a58534a-17ab-474a-a955-b3e093e1d8b1 req-c5f5221b-5a0b-48a6-887f-03b369c22fb2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:17.472051 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5a58534a-17ab-474a-a955-b3e093e1d8b1 req-c5f5221b-5a0b-48a6-887f-03b369c22fb2 service nova] Creating event network-vif-deleted:2b7e231e-8a18-41c0-bdec-96acf18a4fd6 for instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 on n-h1-854119-9 Aug 29 05:06:17.479566 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5a58534a-17ab-474a-a955-b3e093e1d8b1 req-c5f5221b-5a0b-48a6-887f-03b369c22fb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244221 Aug 29 05:06:17.480553 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1827/3583] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:17.490714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:17.491338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:17.508242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:17.508753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:17.509187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:17.509901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:17.510353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:17.512491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:17.636346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:17.637055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:17.657325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:17.657833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:17.658271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:17.658981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:17.659433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:17.659854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:19.286938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:19.304633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c7ec3047c824b8994376cd3b8b8d796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eca521500460480561eaa3aaffb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:19.313052 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0988ae21-35f1-4602-ac28-2ea6e4b7b8a0 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 1.680453 Aug 29 05:06:19.316447 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1828/3584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:17 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:19.326858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:19.332766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:19.335225 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-343a7586-3502-43f8-a5e7-0ae33a175410 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 200 len: 1654 microversion: 2.1 time: 1.848308 Aug 29 05:06:19.346285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:19.348280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:19.349147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:19.350583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:19.351246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:19.351966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:19.354626 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1757/3585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:17 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 1654 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:19.367396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:19.368028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:19.383882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:19.384768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:19.386468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:19.388817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:19.389516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:19.392146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:20.511354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:20.523781 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8f5ac31c-ce25-42f2-a01c-7b15aba9b0c5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 1.167904 Aug 29 05:06:20.536146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1758/3586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:19 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:20.540625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:20.541502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:20.541987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da89ab97a75e413e9c38071e7ab4f2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fad41f329c940c8bcef6b67247e1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:20.553625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:20.554368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:20.554976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:20.555857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:20.556507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:20.557129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:20.560862 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ace37ac0-3365-46de-93a0-a65e83a9d283 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 200 len: 1526 microversion: 2.1 time: 1.242003 Aug 29 05:06:20.561753 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1829/3587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:19 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 1526 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:20.585325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-cd5829db-b601-4e0f-84c4-642608c492d3 req-a0737cff-4d79-48f4-98f5-7ed1d538e0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55906af1-bc5a-4ef9-9421-a375ff759471", "name": "network-vif-plugged", "status": "completed", "tag": "5e9393af-ed59-4b59-85a5-bd6753153bef"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:20.623311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd5829db-b601-4e0f-84c4-642608c492d3 req-a0737cff-4d79-48f4-98f5-7ed1d538e0e6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:20.626512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd5829db-b601-4e0f-84c4-642608c492d3 req-a0737cff-4d79-48f4-98f5-7ed1d538e0e6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:20.627688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd5829db-b601-4e0f-84c4-642608c492d3 req-a0737cff-4d79-48f4-98f5-7ed1d538e0e6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:20.666147 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-cd5829db-b601-4e0f-84c4-642608c492d3 req-a0737cff-4d79-48f4-98f5-7ed1d538e0e6 service nova] Creating event network-vif-plugged:5e9393af-ed59-4b59-85a5-bd6753153bef for instance 55906af1-bc5a-4ef9-9421-a375ff759471 on n-h1-854119-9 Aug 29 05:06:20.693338 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-cd5829db-b601-4e0f-84c4-642608c492d3 req-a0737cff-4d79-48f4-98f5-7ed1d538e0e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123703 Aug 29 05:06:20.708713 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1830/3588] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:20.724619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-05613423-2c3e-41b6-a920-175f8b8f7c6a req-9be5cd50-20cf-4d46-876f-5200a369b4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9381f-f63a-4acf-8e5b-925d71a52ad4", "name": "network-vif-deleted", "tag": "2fa346ee-e8ce-43e5-a3f5-9ca674745481"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:20.788663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-05613423-2c3e-41b6-a920-175f8b8f7c6a req-9be5cd50-20cf-4d46-876f-5200a369b4ef service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:20.789592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-05613423-2c3e-41b6-a920-175f8b8f7c6a req-9be5cd50-20cf-4d46-876f-5200a369b4ef service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:20.793343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-05613423-2c3e-41b6-a920-175f8b8f7c6a req-9be5cd50-20cf-4d46-876f-5200a369b4ef service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:20.839642 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-05613423-2c3e-41b6-a920-175f8b8f7c6a req-9be5cd50-20cf-4d46-876f-5200a369b4ef service nova] Creating event network-vif-deleted:2fa346ee-e8ce-43e5-a3f5-9ca674745481 for instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 on n-h1-854119-9 Aug 29 05:06:20.856540 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-05613423-2c3e-41b6-a920-175f8b8f7c6a req-9be5cd50-20cf-4d46-876f-5200a369b4ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144384 Aug 29 05:06:20.859162 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1831/3589] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:20.870558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:20.872958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:20.886806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:20.896153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:20.897003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:20.899160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:20.900228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:20.900894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:21.372498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:21.386134 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8ce68e6-74d0-41d4-879c-d74e605425b5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1507 microversion: 2.1 time: 0.859200 Aug 29 05:06:21.391203 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1759/3590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:20 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1507 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:21.425848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:21.428561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:21.449694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:21.455046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:21.457418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:21.460377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:21.463986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:21.464824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:21.465445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:21.473972 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6dabcc23-f2ec-4f2b-a585-c1ea21c42ecc tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.612588 Aug 29 05:06:21.475862 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1832/3591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:20 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:21.489989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8b4b7e3e-3057-4ed3-9ff5-9257faafdc31 req-61b37e0e-b055-4913-a531-fdf5a89c9ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deb89cd-20c8-4174-9970-7ffe664b03fe", "name": "network-vif-deleted", "tag": "4c4aefb9-cb29-4bb5-a591-a6eb1f8970c8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:21.505686 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] HTTP exception thrown: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Request method failure captured: Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 HTTP/1.1 Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEidbzraonFmAb2xnmQBgR3UbsfEikD-tKpwoCiy3D-ijsVANund7MmfRmThJL5s8WNYoUeFstKGQygKFyUbfZEEDifpeVSxG-wIeBsvqBSMayCPlt_ysoPdvNXgbTnLGXpcq5KdhICusLQDxaszwry2XF-SVgEr-VP1geEiMEHQUXI Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d88eca521500460480561eaa3aaffb1e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4c7ec3047c824b8994376cd3b8b8d796 Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ddd9381f-f63a-4acf-8e5b-925d71a52ad4'} Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:21.508075 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:21.513272 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:21.513272 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:21.513272 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:21.513272 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:21.513272 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:21.513272 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:21.513272 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:21.513768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b4b7e3e-3057-4ed3-9ff5-9257faafdc31 req-61b37e0e-b055-4913-a531-fdf5a89c9ffc service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:21.513768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b4b7e3e-3057-4ed3-9ff5-9257faafdc31 req-61b37e0e-b055-4913-a531-fdf5a89c9ffc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:21.514338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b4b7e3e-3057-4ed3-9ff5-9257faafdc31 req-61b37e0e-b055-4913-a531-fdf5a89c9ffc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:21.528218 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8b4b7e3e-3057-4ed3-9ff5-9257faafdc31 req-61b37e0e-b055-4913-a531-fdf5a89c9ffc service nova] Creating event network-vif-deleted:4c4aefb9-cb29-4bb5-a591-a6eb1f8970c8 for instance 4deb89cd-20c8-4174-9970-7ffe664b03fe on n-h1-854119-9 Aug 29 05:06:21.529276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Returning 404 to user: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:21.531746 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-80f3c6d6-9468-4a5d-859f-4bdf38c3a4e9 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 404 len: 111 microversion: 2.1 time: 0.138884 Aug 29 05:06:21.536004 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8b4b7e3e-3057-4ed3-9ff5-9257faafdc31 req-61b37e0e-b055-4913-a531-fdf5a89c9ffc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056909 Aug 29 05:06:21.539486 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1760/3592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:21 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:21.550372 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1833/3593] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:21.553772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:21.555635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:21.567008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:21.567726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:21.572438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:21.575180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:21.576699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:21.580287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:21.582824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:21.584868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:21.585711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:21.587835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:21.588324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:21.589042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:21.591776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:21.593948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.120445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:22.136469 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7d5117a8-fc72-4d9b-8eeb-7c0961d12de5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.581314 Aug 29 05:06:22.137713 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1834/3594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:21 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:22.149276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:22.152753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] [instance: 4deb89cd-20c8-4174-9970-7ffe664b03fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:22.176774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.178425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.178895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.183019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.185449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.186091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.220626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] HTTP exception thrown: Instance 4deb89cd-20c8-4174-9970-7ffe664b03fe could not be found. Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Request method failure captured: Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe HTTP/1.1 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkcofUOdVGCPUz13_fqOP75xyQTSM0kP-ku_FHKBnL1BtFeNbGe21zqK_SW_ZyBbppkfJ3CNMpunpNOopQaaGvfGPiadwj62fdugDyUz6rLbTclce0AIdjqL_LpQOhielffkaWQXdoflb2QNsekoyhHJB_F6u7XTTHhF-sBqsuPMkk Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fad41f329c940c8bcef6b67247e1cf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fad41f329c940c8bcef6b67247e1cf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6fad41f329c940c8bcef6b67247e1cf2 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-124030650 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: da89ab97a75e413e9c38071e7ab4f2c3 Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-124030650-project Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 4deb89cd-20c8-4174-9970-7ffe664b03fe could not be found. Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '4deb89cd-20c8-4174-9970-7ffe664b03fe'} Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4deb89cd-20c8-4174-9970-7ffe664b03fe could not be found. Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4deb89cd-20c8-4174-9970-7ffe664b03fe could not be found. Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:22.222352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4deb89cd-20c8-4174-9970-7ffe664b03fe could not be found. Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] Returning 404 to user: Instance 4deb89cd-20c8-4174-9970-7ffe664b03fe could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:22.229048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-38f75619-717c-4e3b-bb44-d66a50c78701 tempest-ServerMetadataNegativeTestJSON-124030650 tempest-ServerMetadataNegativeTestJSON-124030650-project] 10.222.0.20 "GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe" status: 404 len: 111 microversion: 2.1 time: 0.083255 Aug 29 05:06:22.232037 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1835/3595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:22 2022] GET /compute/v2.1/servers/4deb89cd-20c8-4174-9970-7ffe664b03fe => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:22.234739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:22.246825 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-051897bc-d857-4ffa-ba08-b6a89e79c4ac tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1507 microversion: 2.1 time: 0.705461 Aug 29 05:06:22.247420 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1761/3596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:21 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1507 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:22.270101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:22.272912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:22.275268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:22.280558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.281046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.281473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.282205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.282653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.283256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.396321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:22.421651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:06:22.422079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:06:22.422551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:06:22.423144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:06:22.423663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:06:22.549728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:22.562854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.563360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.565751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.568069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.568588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.569972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.636022 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d15df9cc-fc4a-4c40-99ee-9faf13f0012a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "POST /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b/action" status: 202 len: 1109 microversion: 2.1 time: 0.367638 Aug 29 05:06:22.650509 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1762/3597] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:06:22 2022] POST /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b/action => generated 1109 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 29 05:06:22.662026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:22.665581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:22.677673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.678221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.678886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.679850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.689104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4185fc53-63ff-43a1-8a2a-2ca430f50533 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1009625428", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:22.694541 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4185fc53-63ff-43a1-8a2a-2ca430f50533 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] HTTP exception thrown: min_count must be <= max_count Aug 29 05:06:22.695156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.695871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4185fc53-63ff-43a1-8a2a-2ca430f50533 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Request method failure captured: Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 184 Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDElNanW_2fVnctITixnqswVLItXNxrlgbSp_5xQfipVTLTvcNE5WbP_k-VNPeotwOLHYYGtLYy27uc8OGtT0DrqfYF3Sl5-JJM4d9L6lQguLRWZ_klR59PNaWfi_CwE2C6v9XM5AI3_VUoszRThZb2-fs_cFbvlL9k_jJG8horG6kpE Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f9ba04939674b5197c3609c9749500c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e2dba2ac6855449bb0290ee3a44a2fc5 Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1009625428", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: exception: min_count must be <= max_count Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1009625428', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 29 05:06:22.700997 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:22.709305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4185fc53-63ff-43a1-8a2a-2ca430f50533 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Returning 400 to user: min_count must be <= max_count {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:22.710168 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4185fc53-63ff-43a1-8a2a-2ca430f50533 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.477307 Aug 29 05:06:22.711795 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1836/3598] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:22 2022] POST /compute/v2.1/servers => generated 74 bytes in 479 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 05:06:22.717548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:22.719354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:22.740823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.741308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.741735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.742435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.742876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.743289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.939766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:22.947737 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c5e254f-c46c-4626-8d59-253d33ee5dcb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1325 microversion: 2.1 time: 0.296081 Aug 29 05:06:22.953085 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1763/3599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:22 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:22.963636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1f35da3d-01b1-44ae-9c4f-6a4a38c04da8 req-a32d5419-42a7-4d84-82c1-c56997cd1c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deb89cd-20c8-4174-9970-7ffe664b03fe", "name": "network-vif-unplugged", "status": "completed", "tag": "4c4aefb9-cb29-4bb5-a591-a6eb1f8970c8"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:22.981874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1f35da3d-01b1-44ae-9c4f-6a4a38c04da8 req-a32d5419-42a7-4d84-82c1-c56997cd1c17 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:22.984763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1f35da3d-01b1-44ae-9c4f-6a4a38c04da8 req-a32d5419-42a7-4d84-82c1-c56997cd1c17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:22.986815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1f35da3d-01b1-44ae-9c4f-6a4a38c04da8 req-a32d5419-42a7-4d84-82c1-c56997cd1c17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:22.998264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:23.010324 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b99d42db-e1bb-4e09-9c37-69d10cd26fbd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.297547 Aug 29 05:06:23.016201 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1837/3600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:22 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:23.019293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97d0e908-699c-4226-bf64-f703226564ac tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1226629804", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "max_count": 0}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:23.020958 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1f35da3d-01b1-44ae-9c4f-6a4a38c04da8 req-a32d5419-42a7-4d84-82c1-c56997cd1c17 service nova] Creating event network-vif-unplugged:4c4aefb9-cb29-4bb5-a591-a6eb1f8970c8 for instance 4deb89cd-20c8-4174-9970-7ffe664b03fe on n-h1-854119-9 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97d0e908-699c-4226-bf64-f703226564ac tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Request method failure captured: Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 168 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDElNanW_2fVnctITixnqswVLItXNxrlgbSp_5xQfipVTLTvcNE5WbP_k-VNPeotwOLHYYGtLYy27uc8OGtT0DrqfYF3Sl5-JJM4d9L6lQguLRWZ_klR59PNaWfi_CwE2C6v9XM5AI3_VUoszRThZb2-fs_cFbvlL9k_jJG8horG6kpE Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f9ba04939674b5197c3609c9749500c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e2dba2ac6855449bb0290ee3a44a2fc5 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1226629804", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "max_count": 0}} Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1226629804', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'max_count': 0}}} Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 0 Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:06:23.026759 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.034283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97d0e908-699c-4226-bf64-f703226564ac tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:23.043495 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-97d0e908-699c-4226-bf64-f703226564ac tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015927 Aug 29 05:06:23.045901 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1838/3601] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:06:23.047243 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1f35da3d-01b1-44ae-9c4f-6a4a38c04da8 req-a32d5419-42a7-4d84-82c1-c56997cd1c17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091398 Aug 29 05:06:23.050975 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1764/3602] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:23.159381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:23.160013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:23.171048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa6a528b-c02c-477f-b7ea-0c78906b7dda tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1893632613", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "max_count": 2.5}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:23.174590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:23.175277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:23.176098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:23.177100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa6a528b-c02c-477f-b7ea-0c78906b7dda tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Request method failure captured: Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 170 Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDElNanW_2fVnctITixnqswVLItXNxrlgbSp_5xQfipVTLTvcNE5WbP_k-VNPeotwOLHYYGtLYy27uc8OGtT0DrqfYF3Sl5-JJM4d9L6lQguLRWZ_klR59PNaWfi_CwE2C6v9XM5AI3_VUoszRThZb2-fs_cFbvlL9k_jJG8horG6kpE Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f9ba04939674b5197c3609c9749500c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e2dba2ac6855449bb0290ee3a44a2fc5 Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1893632613", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "max_count": 2.5}} Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1893632613', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'max_count': 2.5}}} Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:06:23.177586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 05:06:23.187435 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.192746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:23.192746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:23.197018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa6a528b-c02c-477f-b7ea-0c78906b7dda tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:23.199959 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa6a528b-c02c-477f-b7ea-0c78906b7dda tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.033828 Aug 29 05:06:23.203521 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1765/3603] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:06:23.284278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8acd7c4-3fea-4913-9420-86bdec613803 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1033205449", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 0}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8acd7c4-3fea-4913-9420-86bdec613803 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Request method failure captured: Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 168 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDElNanW_2fVnctITixnqswVLItXNxrlgbSp_5xQfipVTLTvcNE5WbP_k-VNPeotwOLHYYGtLYy27uc8OGtT0DrqfYF3Sl5-JJM4d9L6lQguLRWZ_klR59PNaWfi_CwE2C6v9XM5AI3_VUoszRThZb2-fs_cFbvlL9k_jJG8horG6kpE Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f9ba04939674b5197c3609c9749500c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e2dba2ac6855449bb0290ee3a44a2fc5 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1033205449", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 0}} Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1033205449', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'min_count': 0}}} Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 0 Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:06:23.289232 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.294202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8acd7c4-3fea-4913-9420-86bdec613803 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:23.296602 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d8acd7c4-3fea-4913-9420-86bdec613803 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.014829 Aug 29 05:06:23.299926 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1766/3604] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:06:23.487592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dddbe014-ff3c-4153-88b1-b54c7aa74dd5 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-686026261", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 2.5}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:23.490837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dddbe014-ff3c-4153-88b1-b54c7aa74dd5 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Request method failure captured: Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 169 Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDElNanW_2fVnctITixnqswVLItXNxrlgbSp_5xQfipVTLTvcNE5WbP_k-VNPeotwOLHYYGtLYy27uc8OGtT0DrqfYF3Sl5-JJM4d9L6lQguLRWZ_klR59PNaWfi_CwE2C6v9XM5AI3_VUoszRThZb2-fs_cFbvlL9k_jJG8horG6kpE Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f9ba04939674b5197c3609c9749500c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f9ba04939674b5197c3609c9749500c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 7f9ba04939674b5197c3609c9749500c Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1519070560 Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e2dba2ac6855449bb0290ee3a44a2fc5 Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1519070560-project Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-686026261", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "min_count": 2.5}} Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-686026261', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'min_count': 2.5}}} Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:06:23.499586 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dddbe014-ff3c-4153-88b1-b54c7aa74dd5 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dddbe014-ff3c-4153-88b1-b54c7aa74dd5 tempest-MultipleCreateNegativeTestJSON-1519070560 tempest-MultipleCreateNegativeTestJSON-1519070560-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035441 Aug 29 05:06:23.505860 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1767/3605] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:06:23.527107 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-82bd71ce-3b0c-4293-b249-9718c5829d48 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.373395 Aug 29 05:06:23.529635 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1839/3606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:23 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:23.974264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:23.976088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:23.984733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:23.985646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:23.986699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:23.987757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:23.988085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:23.988914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:24.037231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:24.038943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:24.048308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:24.049352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:24.050129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:24.051227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:24.052150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:24.052793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:24.484816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:24.494732 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a6979516-2a2e-4c53-b7fe-ffe2cc679f56 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1520 microversion: 2.1 time: 0.525443 Aug 29 05:06:24.497710 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1768/3607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:23 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1520 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:24.511432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:24.525558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:24.526240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:24.541952 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ec5753a-ac20-47e0-807d-91d8f349b850 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.511290 Aug 29 05:06:24.543761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:24.544351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:24.544984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:24.549421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:24.550250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:24.554420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:24.560103 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1840/3608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:24 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:24.619868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:06:24.622638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:24.623902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:24.658714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:24.660060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:24.661170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:24.664669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:24.665840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:24.667724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:24.792097 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-26b92446-b98e-4e97-b903-d3dde85f2313 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 204 len: 0 microversion: 2.1 time: 0.270276 Aug 29 05:06:24.792914 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1769/3609] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:06:24 2022] DELETE /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:06:24.803697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:24.804485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:24.810894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:24.811385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:24.811815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:24.812552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:24.813001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:24.813549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:25.453857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:25.468741 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7a95fdfe-8198-4031-a082-3c063653b27b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.906323 Aug 29 05:06:25.469520 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1841/3610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:24 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:25.589402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:25.592777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:25.609502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:25.624739 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-94e24c5f-9948-46ac-b7bf-501f33957ce1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1526 microversion: 2.1 time: 0.821505 Aug 29 05:06:25.625714 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1770/3611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:24 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1526 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:25.631074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:25.638633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:25.644041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:25.644939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:25.645580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:25.646191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:26.098067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:26.113994 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f0172381-a0c6-4cad-963b-dd16768c96ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.538393 Aug 29 05:06:26.119058 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1842/3612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:25 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:26.490037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:26.490914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:26.501857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:26.503381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:26.504055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:26.505004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:26.505693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:26.506392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:26.652341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:26.654024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:26.669721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:26.679904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:26.687804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:26.690425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:26.691685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:26.693749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:27.086950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:27.111871 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17f41595-bf39-4f1e-8573-31e624185911 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.625021 Aug 29 05:06:27.125704 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1771/3613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:26 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:27.251928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:27.262383 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a829e5fe-a8ef-45f3-9c92-6ee9c2b68679 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1526 microversion: 2.1 time: 0.620624 Aug 29 05:06:27.285599 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1843/3614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:26 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1526 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:27.301926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:27.302653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:27.315922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:27.316458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:27.316883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:27.318028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:27.318645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:27.322835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:27.389650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-616589001", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": "none"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:27.496607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:06:27.500732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:06:27.501852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:06:27.505304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:06:27.506283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:06:27.539083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:27.542883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:27.543459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:27.544369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:27.544963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:27.545494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:27.579329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Getting quotas for project d0023b5fb92b4f1cb5d0e1f11a55ad00. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:06:27.589479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Getting quotas for user 9352b59c054f429ab0749938ac76b2c7 and project d0023b5fb92b4f1cb5d0e1f11a55ad00. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:06:27.647581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:06:27.658315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: 9efad459-7955-4a9c-bae2-7ede311b15bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:06:27.792080 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e168b18b-fe2a-4a34-8265-c3e6c97eac7f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.662632 Aug 29 05:06:27.797837 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1772/3615] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 05:06:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 05:06:27.816970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:27.819121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:27.846749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:27.849830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:27.852313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:27.853827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:27.856821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:27.859817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:27.892468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:27.908240 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4fe33f1c-72dc-449a-a3f5-1cbc4e64c1c4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.615530 Aug 29 05:06:27.910109 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1844/3616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:27 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:27.921188 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] HTTP exception thrown: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Request method failure captured: Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 HTTP/1.1 Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEidbzraonFmAb2xnmQBgR3UbsfEikD-tKpwoCiy3D-ijsVANund7MmfRmThJL5s8WNYoUeFstKGQygKFyUbfZEEDifpeVSxG-wIeBsvqBSMayCPlt_ysoPdvNXgbTnLGXpcq5KdhICusLQDxaszwry2XF-SVgEr-VP1geEiMEHQUXI Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d88eca521500460480561eaa3aaffb1e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4c7ec3047c824b8994376cd3b8b8d796 Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ddd9381f-f63a-4acf-8e5b-925d71a52ad4'} Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:27.922943 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:27.928410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:27.929356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2033a4f1-06e0-4f17-b28b-7468c4afd86f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:27.929356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2033a4f1-06e0-4f17-b28b-7468c4afd86f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: 9efad459-7955-4a9c-bae2-7ede311b15bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:27.933437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Returning 404 to user: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:27.936318 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5f7fd84c-5d8d-4d1d-b0ba-18b99c3cde09 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 404 len: 111 microversion: 2.1 time: 0.136987 Aug 29 05:06:27.943299 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1773/3617] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:06:27 2022] DELETE /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:27.953662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6dadb8d1-f02c-4282-97f1-fa30e5766008 req-c36604a5-90c1-4073-b1dd-1a3217bf06b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55906af1-bc5a-4ef9-9421-a375ff759471", "name": "network-vif-deleted", "tag": "5e9393af-ed59-4b59-85a5-bd6753153bef"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:27.979085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6dadb8d1-f02c-4282-97f1-fa30e5766008 req-c36604a5-90c1-4073-b1dd-1a3217bf06b3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:27.981881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6dadb8d1-f02c-4282-97f1-fa30e5766008 req-c36604a5-90c1-4073-b1dd-1a3217bf06b3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:27.983733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6dadb8d1-f02c-4282-97f1-fa30e5766008 req-c36604a5-90c1-4073-b1dd-1a3217bf06b3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.013803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6dadb8d1-f02c-4282-97f1-fa30e5766008 req-c36604a5-90c1-4073-b1dd-1a3217bf06b3 service nova] Creating event network-vif-deleted:5e9393af-ed59-4b59-85a5-bd6753153bef for instance 55906af1-bc5a-4ef9-9421-a375ff759471 on n-h1-854119-9 Aug 29 05:06:28.027602 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6dadb8d1-f02c-4282-97f1-fa30e5766008 req-c36604a5-90c1-4073-b1dd-1a3217bf06b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080858 Aug 29 05:06:28.028631 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1774/3618] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:28.047459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:28.051315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: ddd9381f-f63a-4acf-8e5b-925d71a52ad4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:28.066734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.067703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.074653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.075929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.076623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.077408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.132837 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] HTTP exception thrown: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Request method failure captured: Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 HTTP/1.1 Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEidbzraonFmAb2xnmQBgR3UbsfEikD-tKpwoCiy3D-ijsVANund7MmfRmThJL5s8WNYoUeFstKGQygKFyUbfZEEDifpeVSxG-wIeBsvqBSMayCPlt_ysoPdvNXgbTnLGXpcq5KdhICusLQDxaszwry2XF-SVgEr-VP1geEiMEHQUXI Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d88eca521500460480561eaa3aaffb1e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4c7ec3047c824b8994376cd3b8b8d796 Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ddd9381f-f63a-4acf-8e5b-925d71a52ad4'} Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:28.143679 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Returning 404 to user: Instance ddd9381f-f63a-4acf-8e5b-925d71a52ad4 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6231c08e-aabd-4d75-a45b-11663b8ec86c tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4" status: 404 len: 111 microversion: 2.1 time: 0.114218 Aug 29 05:06:28.151353 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1775/3619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:28 2022] GET /compute/v2.1/servers/ddd9381f-f63a-4acf-8e5b-925d71a52ad4 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:28.157076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:28.157708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:28.182836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.183343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.183784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.184526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.184986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.185410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.214566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2033a4f1-06e0-4f17-b28b-7468c4afd86f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:28.224103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2033a4f1-06e0-4f17-b28b-7468c4afd86f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:28.225613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2033a4f1-06e0-4f17-b28b-7468c4afd86f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:28.226783 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2033a4f1-06e0-4f17-b28b-7468c4afd86f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd" status: 200 len: 1277 microversion: 2.47 time: 0.314362 Aug 29 05:06:28.233861 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1845/3620] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:27 2022] GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd => generated 1277 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:28.245011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:28.245511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:28.279009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.281242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.284859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.288260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.291303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.294676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.339541 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] HTTP exception thrown: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Request method failure captured: Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe HTTP/1.1 Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEidbzraonFmAb2xnmQBgR3UbsfEikD-tKpwoCiy3D-ijsVANund7MmfRmThJL5s8WNYoUeFstKGQygKFyUbfZEEDifpeVSxG-wIeBsvqBSMayCPlt_ysoPdvNXgbTnLGXpcq5KdhICusLQDxaszwry2XF-SVgEr-VP1geEiMEHQUXI Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d88eca521500460480561eaa3aaffb1e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4c7ec3047c824b8994376cd3b8b8d796 Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '24126301-9282-4de3-baec-0f704d4ba8fe'} Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:28.341174 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Returning 404 to user: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-32c61f83-7b9e-4074-97e6-c810e42b114a tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 404 len: 111 microversion: 2.1 time: 0.107731 Aug 29 05:06:28.346210 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1846/3621] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:06:28 2022] DELETE /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:28.363212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:28.364349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:28.401244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.401767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.402213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.402941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.407359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.408635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.521061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.525477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.527700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.531187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lazy-loading 'fault' on Instance uuid 55906af1-bc5a-4ef9-9421-a375ff759471 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:06:28.670620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e421b5bfaefd430fa53ab461f654a517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa590adc4ce4a0ca0249a5abd6340a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:28.693700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-180921a0-914b-42c1-bb27-3c80c140e322 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 200 len: 1315 microversion: 2.1 time: 0.348245 Aug 29 05:06:28.694322 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1847/3622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:28 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:28.724029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1891195986", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": "none"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:28.781619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:28.815435 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f2f8925-625f-4731-b3f1-ef4e02f8931d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.664588 Aug 29 05:06:28.816727 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1776/3623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:28 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:28.828735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:28.831089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] [instance: 24126301-9282-4de3-baec-0f704d4ba8fe] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:28.848228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:06:28.848774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:06:28.849257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:06:28.851152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:06:28.851553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.851758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:06:28.855722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.856358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.857237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.858224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.861652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.885173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.885684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.886124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.887144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.887321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.887744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.922032 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] HTTP exception thrown: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Request method failure captured: Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe HTTP/1.1 Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEidbzraonFmAb2xnmQBgR3UbsfEikD-tKpwoCiy3D-ijsVANund7MmfRmThJL5s8WNYoUeFstKGQygKFyUbfZEEDifpeVSxG-wIeBsvqBSMayCPlt_ysoPdvNXgbTnLGXpcq5KdhICusLQDxaszwry2XF-SVgEr-VP1geEiMEHQUXI Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d88eca521500460480561eaa3aaffb1e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d88eca521500460480561eaa3aaffb1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: d88eca521500460480561eaa3aaffb1e Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestMultiNic-103650619 Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4c7ec3047c824b8994376cd3b8b8d796 Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestMultiNic-103650619-project Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '24126301-9282-4de3-baec-0f704d4ba8fe'} Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:28.926752 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.932322 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:28.932322 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:28.932322 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:28.932322 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:28.932322 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:28.932322 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. Aug 29 05:06:28.932322 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:28.932322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] Returning 404 to user: Instance 24126301-9282-4de3-baec-0f704d4ba8fe could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:28.933860 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d86072d-4a17-4943-8bb6-ef19811ae086 tempest-ServersTestMultiNic-103650619 tempest-ServersTestMultiNic-103650619-project] 10.222.0.20 "GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe" status: 404 len: 111 microversion: 2.1 time: 0.115914 Aug 29 05:06:28.935500 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1777/3624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:28 2022] GET /compute/v2.1/servers/24126301-9282-4de3-baec-0f704d4ba8fe => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:28.955680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:28.956919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:28.962353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Getting quotas for project d0023b5fb92b4f1cb5d0e1f11a55ad00. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:06:28.980876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.983205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.985833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:28.989383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Getting quotas for user 9352b59c054f429ab0749938ac76b2c7 and project d0023b5fb92b4f1cb5d0e1f11a55ad00. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:06:28.989826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:28.990481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:28.991036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:29.020053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:06:29.022958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:06:29.127757 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b420a6ad-b9fe-425a-8634-7760ef5e10b2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.427718 Aug 29 05:06:29.128921 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1848/3625] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 05:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 05:06:29.141437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66b72161-2add-43c2-9371-99903c7a6211 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:29.153836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-66b72161-2add-43c2-9371-99903c7a6211 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:29.259918 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-66b72161-2add-43c2-9371-99903c7a6211 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "PUT /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 992 microversion: 2.47 time: 0.120216 Aug 29 05:06:29.261228 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1849/3626] 10.222.0.20 () {62 vars in 1297 bytes} [Mon Aug 29 05:06:29 2022] PUT /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 992 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:06:29.280757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2872622c-d89a-4474-8f41-275a6fb28eb9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:29.281383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2872622c-d89a-4474-8f41-275a6fb28eb9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:29.460687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2872622c-d89a-4474-8f41-275a6fb28eb9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:29.476188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2872622c-d89a-4474-8f41-275a6fb28eb9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:29.484025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2872622c-d89a-4474-8f41-275a6fb28eb9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:29.486923 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2872622c-d89a-4474-8f41-275a6fb28eb9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1278 microversion: 2.47 time: 0.209000 Aug 29 05:06:29.505262 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1850/3627] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:29 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1278 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:29.715374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:29.716152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 55906af1-bc5a-4ef9-9421-a375ff759471] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:29.739317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:29.743361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:29.745511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:29.747611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:29.750145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:29.751699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:29.802820 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Instance 55906af1-bc5a-4ef9-9421-a375ff759471 could not be found. Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 HTTP/1.1 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 55906af1-bc5a-4ef9-9421-a375ff759471 could not be found. Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '55906af1-bc5a-4ef9-9421-a375ff759471'} Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55906af1-bc5a-4ef9-9421-a375ff759471 could not be found. Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55906af1-bc5a-4ef9-9421-a375ff759471 could not be found. Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.808699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:29.813264 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.813264 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:29.813264 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:29.813264 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:29.813264 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:29.813264 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:29.813264 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55906af1-bc5a-4ef9-9421-a375ff759471 could not be found. Aug 29 05:06:29.813264 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.815366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Instance 55906af1-bc5a-4ef9-9421-a375ff759471 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:29.820283 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ddab6dc7-6214-44e9-838b-74ff164b5ceb tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471" status: 404 len: 111 microversion: 2.1 time: 0.108890 Aug 29 05:06:29.821161 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1851/3628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:29 2022] GET /compute/v2.1/servers/55906af1-bc5a-4ef9-9421-a375ff759471 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:29.831042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-244bfe10-cbb2-46f0-a67c-0bad7c817f5f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '.version_select at 0x7f1ab825c430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:29.886869 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-244bfe10-cbb2-46f0-a67c-0bad7c817f5f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Image not found. Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-244bfe10-cbb2-46f0-a67c-0bad7c817f5f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/images/c63082d9-77de-48c1-a058-5e491c6b9b4c HTTP/1.1 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'c63082d9-77de-48c1-a058-5e491c6b9b4c'} Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c63082d9-77de-48c1-a058-5e491c6b9b4c to delete Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c63082d9-77de-48c1-a058-5e491c6b9b4c could not be found. Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:29.889061 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:29.896998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-244bfe10-cbb2-46f0-a67c-0bad7c817f5f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:29.902626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-244bfe10-cbb2-46f0-a67c-0bad7c817f5f tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/images/c63082d9-77de-48c1-a058-5e491c6b9b4c" status: 404 len: 62 microversion: 2.1 time: 0.076902 Aug 29 05:06:29.903163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:29.903862 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1852/3629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:29 2022] DELETE /compute/v2.1/images/c63082d9-77de-48c1-a058-5e491c6b9b4c => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:06:29.919507 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af80ae92-2528-4352-8af8-ece911947be3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.976351 Aug 29 05:06:29.922150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:29.923220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:29.923388 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1778/3630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:28 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:29.941750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:29.942681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:29.943358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:29.944288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:29.944804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:29.944998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:29.945714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:29.946266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:29.964611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:29.968643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:29.969696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:29.971583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:29.977304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:29.978510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:30.018237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:30.028989 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 HTTP/1.1 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7e7cd86f-8448-48e4-bbaa-114c2681b6d6'} Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:30.031422 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:30.035896 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e2d832dd-0f95-42bd-b68b-f462f1f9a400 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 404 len: 111 microversion: 2.1 time: 0.107037 Aug 29 05:06:30.038322 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1779/3631] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:06:29 2022] DELETE /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:30.055799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:30.056646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 7e7cd86f-8448-48e4-bbaa-114c2681b6d6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:30.065671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:30.066143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:30.066615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:30.067431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:30.068039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:30.068563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:30.092144 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 HTTP/1.1 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7e7cd86f-8448-48e4-bbaa-114c2681b6d6'} Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.093913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Instance 7e7cd86f-8448-48e4-bbaa-114c2681b6d6 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:30.098474 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7470fdc-da9f-479d-9deb-7dcc68910999 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6" status: 404 len: 111 microversion: 2.1 time: 0.053130 Aug 29 05:06:30.101300 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1780/3632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:30 2022] GET /compute/v2.1/servers/7e7cd86f-8448-48e4-bbaa-114c2681b6d6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:30.110931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d13976d7-44f0-4dd7-8918-4369b67ee64e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '.version_select at 0x7f1abd86e040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:30.158957 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d13976d7-44f0-4dd7-8918-4369b67ee64e tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934403461" status: 202 len: 0 microversion: 2.1 time: 0.050593 Aug 29 05:06:30.167713 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1781/3633] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934403461 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:06:30.513288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:30.513910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:30.521663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:30.527001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:30.528305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:30.529260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:30.530971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:30.531445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:30.581154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:30.591421 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5c70b3ce-e46a-45b8-8c64-6acdbafc3a40 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.686394 Aug 29 05:06:30.609166 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1853/3634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:29 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:30.698299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:30.711105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:30.717913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:30.722482 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-213a59d0-578e-4e10-82f5-8da04685c54d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1330 microversion: 2.47 time: 0.213276 Aug 29 05:06:30.723097 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1782/3635] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:30 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1330 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:30.942979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:30.943931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:30.951235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:30.952016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:30.952964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:30.953909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:30.954522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:30.955126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:31.249739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:31.258653 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0b73bb9f-d9e1-4ef7-89d4-d0726f4f9ebb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.319347 Aug 29 05:06:31.268153 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1854/3636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:30 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:31.614026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:31.615159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:31.628467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:31.629244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:31.629860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:31.637190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:31.637940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:31.638547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:31.747395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:31.748420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:31.755515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:31.756099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:31.756630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:31.757886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:31.758540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:31.759046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:32.096913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:32.107489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:32.112953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:32.118787 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bbc8ee55-0b8b-48c4-b1eb-7a1a1f22bced tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1330 microversion: 2.47 time: 0.375391 Aug 29 05:06:32.119303 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1855/3637] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:31 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1330 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:06:32.136489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7f77ae5-49e9-4322-9644-5f1147aca4a1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '.version_select at 0x7f1ab924d700>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:32.166342 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a7f77ae5-49e9-4322-9644-5f1147aca4a1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Image not found. Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7f77ae5-49e9-4322-9644-5f1147aca4a1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/images/4385a2e7-56f8-4b69-b3c3-aea4fcc547e1 HTTP/1.1 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: exception: Image not found. Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '4385a2e7-56f8-4b69-b3c3-aea4fcc547e1'} Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4385a2e7-56f8-4b69-b3c3-aea4fcc547e1 to delete Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4385a2e7-56f8-4b69-b3c3-aea4fcc547e1 could not be found. Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:32.168261 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 05:06:32.173694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.180328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7f77ae5-49e9-4322-9644-5f1147aca4a1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Image not found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:32.180328 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7f77ae5-49e9-4322-9644-5f1147aca4a1 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/images/4385a2e7-56f8-4b69-b3c3-aea4fcc547e1" status: 404 len: 62 microversion: 2.1 time: 0.059438 Aug 29 05:06:32.181543 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1856/3638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:32 2022] DELETE /compute/v2.1/images/4385a2e7-56f8-4b69-b3c3-aea4fcc547e1 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:06:32.188833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:32.189331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:32.196578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:32.197077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:32.197512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:32.198373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:32.198833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:32.199312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:32.216233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f HTTP/1.1 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '9b8ac4e6-a814-4021-8602-39425a3b988f'} Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:32.217800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:32.222646 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a82076f9-d91d-4a84-ac9b-e81b29ab72fa tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 404 len: 111 microversion: 2.1 time: 0.035203 Aug 29 05:06:32.223678 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1857/3639] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:06:32 2022] DELETE /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:32.228965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:32.229586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] [instance: 9b8ac4e6-a814-4021-8602-39425a3b988f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:32.235824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:32.236356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:32.236793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:32.237624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:32.238407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:32.239003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:32.248063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:32.257012 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d662b665-1cba-40c8-94a5-e6d5da23f47d tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.646948 Aug 29 05:06:32.257614 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1783/3640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:31 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] HTTP exception thrown: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Request method failure captured: Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f HTTP/1.1 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEiyvljNjsjHMboQr_upzHqpGAiDvLwGOLB4qS0C5iwrIvJsg9HmFK_hweKKHX_xyZaLsTK-XNxRLe6OW8VvVOkXd63-yuZsowKAR12Iv-l536o8ePg_84Ff23LpN5RoJHUzDeNvvJlup5s_Qs4rKe4KPDGkdLzEXww_Cqv1ZA5P8Sg Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa590adc4ce4a0ca0249a5abd6340a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa590adc4ce4a0ca0249a5abd6340a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0fa590adc4ce4a0ca0249a5abd6340a9 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e421b5bfaefd430fa53ab461f654a517 Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045301273-project Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '9b8ac4e6-a814-4021-8602-39425a3b988f'} Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:06:32.268950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] Returning 404 to user: Instance 9b8ac4e6-a814-4021-8602-39425a3b988f could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21333809-825c-4e9b-8742-7a43af423f59 tempest-ImagesOneServerNegativeTestJSON-2045301273 tempest-ImagesOneServerNegativeTestJSON-2045301273-project] 10.222.0.20 "GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f" status: 404 len: 111 microversion: 2.1 time: 0.045898 Aug 29 05:06:32.276977 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1858/3641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:32 2022] GET /compute/v2.1/servers/9b8ac4e6-a814-4021-8602-39425a3b988f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:06:32.283245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:32.284023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:32.290404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:32.291200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:32.291793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:32.292814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:32.293506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:32.294162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:32.631811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:32.647043 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a69c7403-97ba-4c34-aa7d-c2d697a3ba59 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.366941 Aug 29 05:06:32.648272 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1784/3642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:32 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:33.146434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:33.147317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:33.160657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:33.161272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:33.161714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:33.163953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:33.164457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:33.164894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:33.252193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:33.277745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:33.283840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:33.284868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:33.290074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:33.291250 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d1bbf3b9-c610-4ae5-ba6a-4dcfd7bc5ffd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1330 microversion: 2.47 time: 0.149021 Aug 29 05:06:33.291808 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1859/3643] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:33 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1330 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:33.297575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:33.302877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:33.303522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:33.304910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:33.308717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:33.309564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:33.320743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:33.670188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:33.671807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:33.681022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:33.683828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:33.684716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:33.686472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:33.688228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:33.689687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:33.697963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:33.710569 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7ed9f6c-21cf-450f-b061-490adea077e5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.431505 Aug 29 05:06:33.714664 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1785/3644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:33 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:34.105903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:34.115414 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-86c3f2ba-238d-4165-ba03-9ed3c3af5a9d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.451024 Aug 29 05:06:34.119676 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1860/3645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:33 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:34.314889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:34.315591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:34.328488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:34.329153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:34.330268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:34.339176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:34.344889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:34.345355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:34.518819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:34.530441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:34.536212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:34.539410 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16cc95a4-8f8b-4651-a6b1-9a560801b4a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1348 microversion: 2.47 time: 0.229261 Aug 29 05:06:34.543114 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1786/3646] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:34 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1348 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:34.736651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:34.737275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:34.751599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:34.752219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:34.752723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:34.753520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:34.754040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:34.764888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:35.139484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:35.140805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:35.161244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:35.162024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:35.162661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:35.163580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:35.164252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:35.164852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:35.396782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:35.410639 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-04b5fe84-87c9-4b2d-9a6e-3e7e56cdf5cb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.678437 Aug 29 05:06:35.418326 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1861/3647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:34 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:35.573113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:35.573938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:35.581202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:35.601968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:35.603026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:35.604534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:35.605079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:35.605571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:35.607352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:35.621125 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71758fb3-a362-42e5-bc10-2111c8db0b5f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.483209 Aug 29 05:06:35.627562 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1787/3648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:35 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:36.207200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:36.224181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:36.226367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:36.228357 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-315cc49e-4778-4d1d-afea-e9ee2bc49c53 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1336 microversion: 2.47 time: 0.659513 Aug 29 05:06:36.231073 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1862/3649] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:35 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1336 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:36.438881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:36.440103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:36.455943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:36.456710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:36.457427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:36.459113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:36.461117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:36.461779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:36.646963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:36.648555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:36.662523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:36.672180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:36.675269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:36.679060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:36.682919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:36.684903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:37.284922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:37.297386 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3ecc4056-ec9c-4f4d-91d6-03b995dba06e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.863155 Aug 29 05:06:37.298582 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1788/3650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:36 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:37.305131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:37.310415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:37.329399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:37.330218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:37.331063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:37.331991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:37.335249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:37.336325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:37.561459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:37.604912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:37.615444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:37.620884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:37.629033 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5f6cc978-a44b-4288-8fa2-9447d92c0655 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1336 microversion: 2.47 time: 0.329061 Aug 29 05:06:37.630474 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1789/3651] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:37 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1336 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:37.740109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:37.758239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f01fad3c-55b8-4049-a39a-4ecb4a5c7e8a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 1.116871 Aug 29 05:06:37.772331 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1863/3652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:36 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:38.333468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:38.334514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:38.337646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:38.352952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:38.355335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:38.356037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:38.359529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:38.360324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:38.362111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:38.665233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:38.666030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:38.680111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:38.683085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:38.683816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:38.686022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:38.690282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:38.692351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:38.915331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:39.036803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:39.046321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:39.053404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:39.054818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0d92830-feb2-4163-83aa-ca30deb7b46f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1336 microversion: 2.47 time: 0.394062 Aug 29 05:06:39.059196 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1864/3653] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:38 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1336 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:39.071931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:39.072877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:39.081904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:39.098761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:39.099718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:39.100737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:39.101855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:39.115478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:39.475515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:39.778256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:39.820939 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-66a3518c-dc90-4d97-9319-03d6cd45467b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 1.482870 Aug 29 05:06:39.826355 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1790/3654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:38 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:39.993246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:40.010468 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dd37242d-1a77-456e-8792-ae03961c70a9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.942163 Aug 29 05:06:40.011573 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1865/3655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:39 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:40.101619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:40.102372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:40.126119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:40.126906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:40.127492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:40.129206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:40.129847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:40.130424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:40.321363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:40.335765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:40.341284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:40.347063 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9280d6ec-0c6b-4068-8d54-22020d7f7edd tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1336 microversion: 2.47 time: 0.250603 Aug 29 05:06:40.362896 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1791/3656] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:40 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1336 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:40.856785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:40.857730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:40.891566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:40.895180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:40.902322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:40.908174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:40.909325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:40.913206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:41.043254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:41.044588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:41.055279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:41.058538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:41.059186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:41.061131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:41.063763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:41.064450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:41.655170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:41.705543 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4cb16b2f-e35e-4f98-8b91-a385719af4db tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.854120 Aug 29 05:06:41.723145 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1866/3657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:40 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:41.738421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:41.739059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:41.753854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:41.755985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:41.756736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:41.758068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:41.760941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:41.761569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:41.762413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:41.986374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:42.067535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:42.070612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:42.082813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:42.083368 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a802ff4-d086-4eaf-af4d-0fa4b40e9463 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1357 microversion: 2.47 time: 0.348422 Aug 29 05:06:42.084842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1867/3658] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:41 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1357 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:42.111120 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af8cc3cb-05fb-4e77-94c1-2a8d21390a25 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 1.073321 Aug 29 05:06:42.111995 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1792/3659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:41 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:42.137239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:42.139975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:42.166528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:42.167173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:42.167609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:42.173419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:42.173968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:42.174760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:42.386342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:06:42.386794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:06:42.387243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:06:42.397160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:06:42.397798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:06:42.550531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:42.580625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:42.584641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:42.586925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:42.592854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:42.593294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:42.598654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:42.679324 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d56048b9-0de5-4379-a1ce-d5bc80a334f7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "POST /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001/action" status: 202 len: 1079 microversion: 2.47 time: 0.546113 Aug 29 05:06:42.701710 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1868/3660] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 05:06:42 2022] POST /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001/action => generated 1079 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 05:06:42.725059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:42.725923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:42.745250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:42.745952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:42.748131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:42.749530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:42.751189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:42.751839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:42.752686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:42.757345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:42.763642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:42.764596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:42.765497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:42.766501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:42.767348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:42.768273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:43.098398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:43.109742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:43.120027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:43.121684 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bb116785-7a48-4fa4-8dda-9e03a6f840a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.401303 Aug 29 05:06:43.122280 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1793/3661] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:42 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:43.146413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:43.147150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:43.170771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:43.172555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:43.173201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:43.174102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:43.175931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:43.176555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:43.572550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:43.594847 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9c19f881-a6df-4f24-a158-885e056bf0f5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1485 microversion: 2.1 time: 0.862606 Aug 29 05:06:43.595468 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1869/3662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:42 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1485 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:43.621065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a51bb08f-fedd-4ebe-be87-b1b69c0eb18e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:43.621915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a51bb08f-fedd-4ebe-be87-b1b69c0eb18e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:43.634939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a51bb08f-fedd-4ebe-be87-b1b69c0eb18e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:43.637245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a51bb08f-fedd-4ebe-be87-b1b69c0eb18e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:43.641822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a51bb08f-fedd-4ebe-be87-b1b69c0eb18e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:43.643165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a51bb08f-fedd-4ebe-be87-b1b69c0eb18e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:43.643894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a51bb08f-fedd-4ebe-be87-b1b69c0eb18e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:43.644527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a51bb08f-fedd-4ebe-be87-b1b69c0eb18e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:43.679098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:43.792943 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a51bb08f-fedd-4ebe-be87-b1b69c0eb18e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "POST /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564/action" status: 202 len: 0 microversion: 2.1 time: 0.177064 Aug 29 05:06:43.811673 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1870/3663] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:06:43 2022] POST /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:06:43.825724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:43.826807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:43.843359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:43.848930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:43.865105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:43.870476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:43.873460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:43.874255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:44.598886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:44.621755 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6adb3deb-30e2-4a03-b934-f2ae658f23ea tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 1.486681 Aug 29 05:06:44.625144 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1794/3664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:43 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:44.633768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:44.634578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:44.654512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:44.655315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:44.657591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:44.659416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:44.661393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:44.662030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:44.992777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:45.002592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:45.019956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:45.022376 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7ddf7e53-cec9-4b1a-9fef-3ae7d6ea7e98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.395473 Aug 29 05:06:45.023316 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1795/3665] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:44 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:45.084506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:45.094042 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ec85ef0a-e063-487c-8c8b-8be5f93825bb tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1493 microversion: 2.1 time: 1.276094 Aug 29 05:06:45.112043 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1871/3666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:43 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1493 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:45.663452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:45.667352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:45.699264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:45.701900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:45.702949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:45.706622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:45.709514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:45.710768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:46.046377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:46.047190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:46.069491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:46.070091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:46.070550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:46.071311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:46.071770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:46.072219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:46.255481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:46.272595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:46.277980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:46.279166 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2a4d7ad5-31d1-4d47-b736-d297e9b02455 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.236730 Aug 29 05:06:46.299354 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1872/3667] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:46 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:06:46.309966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:46.310672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:46.321589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:46.326359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:46.327115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:46.329654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:46.338516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:46.342788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:46.407012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:46.417895 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8f8532a-8965-40ba-8bcb-a2392a1cd056 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.770874 Aug 29 05:06:46.421390 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1796/3668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:45 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:46.698939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:46.710596 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-647af98b-986d-4629-99f7-7dc7846048b8 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1493 microversion: 2.1 time: 0.409975 Aug 29 05:06:46.716661 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1873/3669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:46 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1493 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:47.307288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:47.308087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:47.329925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:47.332892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:47.335754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:47.337002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:47.339264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:47.341458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:47.448604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:47.450811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:47.502939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:47.503629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:47.507788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:47.510265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:47.514575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:47.515742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:47.600086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:47.611087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:47.624205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:47.626572 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7d73f7e5-bd30-4938-9204-135968bef174 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.324456 Aug 29 05:06:47.627947 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1797/3670] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:47 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:47.741618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:47.742389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:47.752769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:47.753443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:47.753985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:47.754872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:47.756630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:47.758040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:47.883040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:47.894658 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-922b8019-e4ca-4f56-86d0-f775b973b79a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.453076 Aug 29 05:06:47.901193 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1874/3671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:47 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:48.079720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:48.111433 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be4e5950-39a4-4a5c-9b13-e53c1ee01ca5 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1493 microversion: 2.1 time: 0.374196 Aug 29 05:06:48.132182 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1798/3672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:47 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1493 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:48.382634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1116193751", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "931924b9-0fe5-47f1-afd4-70f3cb38e6fb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:48.499187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] validate_networks() for [('931924b9-0fe5-47f1-afd4-70f3cb38e6fb', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:06:48.654779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:48.655585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:48.672318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:48.672992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:48.673688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:48.674659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:48.675346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:48.676004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:48.877464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:48.904733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:48.910122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:48.916224 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f1070926-aa70-4db3-9cbf-5962dd965388 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.263884 Aug 29 05:06:48.917877 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1799/3673] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:48 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:48.927947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:48.931948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:48.949613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:48.950425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:48.952265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:48.958486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:48.959405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:48.960690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:49.472896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:49.484997 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef9d2e46-3a57-40c2-9e3a-78725e86d6e5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.564663 Aug 29 05:06:49.486621 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1800/3674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:48 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:49.503797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:49.504575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:49.520403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:49.521115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:49.521732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:49.522859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:49.523496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:49.524289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:49.850437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:06:49.852096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:06:49.852795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:06:49.853824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:06:49.854457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:06:49.883225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:49.883718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:49.884445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:49.887138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:49.904218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:49.905055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:49.953331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Getting quotas for project c4134acc38154fcd83d1c50443c42888. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:06:49.967979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Getting quotas for user fe2403ad736f4c70a77705af5ab3e97b and project c4134acc38154fcd83d1c50443c42888. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:06:49.995999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:06:49.999734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:06:50.116841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:50.117769 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5118c918-dae7-44e0-8a5f-90d6b18e42a7 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.215046 Aug 29 05:06:50.118458 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1875/3675] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:06:50.124257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:50.124257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:50.127034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:50.138898 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc6c13bf-878f-4a73-8fd7-e53fa17c5eb9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1499 microversion: 2.1 time: 0.650546 Aug 29 05:06:50.142344 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1801/3676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:49 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1499 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:50.147961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:50.148622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:50.151350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:50.152108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:50.155936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:50.156452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:50.167319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee62481c-1ce0-40d5-ba22-f2792384e2e2 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:50.168285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee62481c-1ce0-40d5-ba22-f2792384e2e2 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:50.198023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:50.642854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:50.656189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:50.659678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:50.661427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-20464442-18ff-433f-b261-97393b45a039 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.542020 Aug 29 05:06:50.665023 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1876/3677] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:50 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:50.673505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee62481c-1ce0-40d5-ba22-f2792384e2e2 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:50.695067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:50.696970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:50.700803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee62481c-1ce0-40d5-ba22-f2792384e2e2 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1216 microversion: 2.1 time: 0.555183 Aug 29 05:06:50.706572 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1802/3678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:50 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1216 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:50.724319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:50.724863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:50.725298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:50.726498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:50.728361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:50.730410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:50.732044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:50.732516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:50.753651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:50.754458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:50.755234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:50.756833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:50.757874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:50.758623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:50.809135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:06:51.007513 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-708bb972-13e8-4a07-924c-d435c19652e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 204 len: 0 microversion: 2.1 time: 0.339521 Aug 29 05:06:51.008245 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1877/3679] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:06:50 2022] DELETE /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:06:51.019073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:51.020059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:51.045389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:51.047578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:51.053204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:51.054263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:51.054909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:51.063926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:51.461921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:51.478286 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d17ded07-445a-495d-bf60-344d9a2c3a27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.765665 Aug 29 05:06:51.491211 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1803/3680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:50 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:51.508859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-725c85be-41d2-4f3c-a921-8b637f6a93a3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd8f3790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:51.587568 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-725c85be-41d2-4f3c-a921-8b637f6a93a3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/f966eda5-3a9e-415e-8e1f-c631f6f2bee7" status: 200 len: 661 microversion: 2.1 time: 0.090387 Aug 29 05:06:51.596061 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1804/3681] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:06:51 2022] GET /compute/v2.1/images/f966eda5-3a9e-415e-8e1f-c631f6f2bee7 => generated 661 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:51.602373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6466c07e-d61e-4c67-b61b-f4fde8ad5557 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd8f3310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:51.638423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:51.649670 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b1d55183-9a2d-48c8-b9bc-9c884af4d59c tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.636869 Aug 29 05:06:51.668817 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1878/3682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:51 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:51.683757 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6466c07e-d61e-4c67-b61b-f4fde8ad5557 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/f966eda5-3a9e-415e-8e1f-c631f6f2bee7" status: 200 len: 661 microversion: 2.1 time: 0.086000 Aug 29 05:06:51.684353 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1805/3683] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:06:51 2022] GET /compute/v2.1/images/f966eda5-3a9e-415e-8e1f-c631f6f2bee7 => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:06:51.690598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:51.691642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:51.727467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:51.733831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:51.734388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:51.735195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:51.735659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:51.736078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:51.747088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:51.748108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:51.764087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:51.767399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:51.769909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:51.773384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:51.774148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:51.774805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:51.995503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:52.003342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:52.004207 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16d56a07-af64-4011-b3f7-81d713f02bd5 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1220 microversion: 2.1 time: 0.282696 Aug 29 05:06:52.017412 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1806/3684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:51 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1220 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:52.026786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:52.029727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:52.031687 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a147eb1-de66-4e90-8707-74f1cb35bdb8 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.344655 Aug 29 05:06:52.045279 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1879/3685] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:51 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:52.503593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:52.504355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:52.519633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:52.520558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:52.521259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:52.522242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:52.522979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:52.525489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:52.676992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:52.677786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:52.693212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:52.693886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:52.694733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:52.701153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:52.701787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:52.702863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:52.785296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:52.794090 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a91aa3f8-aad3-4654-9c1f-3f764fc02ffc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.294984 Aug 29 05:06:52.799773 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1807/3686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:52 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:53.026196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:53.027199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:53.038430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:53.041720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:53.043198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:53.048326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:53.049784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:53.050535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:53.051215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:53.061116 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3149de75-0cff-4c38-b618-44428180910e tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 0.388977 Aug 29 05:06:53.064438 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1880/3687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:52 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:53.078855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:53.079834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:53.089974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:53.093862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:53.094439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:53.096980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:53.099153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:53.101323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:53.244229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:53.254812 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-35915bd8-c89e-4e0a-b2f1-a137210e2457 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1220 microversion: 2.1 time: 0.232553 Aug 29 05:06:53.257777 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1808/3688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:53 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1220 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:53.293117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:53.303149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:53.310455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:53.312083 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d8418d8-2015-4c52-a939-97ecf2b700b5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.246374 Aug 29 05:06:53.315049 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1881/3689] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:53 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:53.341155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-498714f8-67a6-4247-97e8-7ee2b9557b79 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd7cc8b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:53.395848 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-498714f8-67a6-4247-97e8-7ee2b9557b79 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/b7079fa5-3632-4e4c-9e43-2408903d755d" status: 200 len: 662 microversion: 2.1 time: 0.058468 Aug 29 05:06:53.408684 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1809/3690] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:06:53 2022] GET /compute/v2.1/images/b7079fa5-3632-4e4c-9e43-2408903d755d => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:53.422502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dd28ba24-4c66-42e8-baa4-fa0e596827ff tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab825cc10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:53.484145 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dd28ba24-4c66-42e8-baa4-fa0e596827ff tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/b7079fa5-3632-4e4c-9e43-2408903d755d" status: 200 len: 662 microversion: 2.1 time: 0.065533 Aug 29 05:06:53.485185 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1882/3691] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:06:53 2022] GET /compute/v2.1/images/b7079fa5-3632-4e4c-9e43-2408903d755d => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:53.820582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:53.821252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:53.840501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:53.841023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:53.841479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:53.842214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:53.842681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:53.843119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:54.101937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:54.103296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:54.111215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:54.112035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:54.112733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:54.113693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:54.114487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:54.115131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:54.133671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:54.152575 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec8dbde9-6e39-4884-b557-f50468945693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.336884 Aug 29 05:06:54.165973 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1810/3692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:53 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:54.276209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:54.276879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:54.298817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:54.299394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:54.302014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:54.306577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:54.307066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:54.307509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:54.548269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:54.565901 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e2827b5-0b27-48f6-b225-e3c7d6255100 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1220 microversion: 2.1 time: 0.294537 Aug 29 05:06:54.581140 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1811/3693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:54 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1220 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:06:54.591885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:54.591885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:54.598126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:54.598626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:54.599059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:54.600404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:54.601030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:54.601469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:54.865047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:54.912389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:54.920328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:54.927758 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-29a59c90-4e5f-49c9-8e60-b8f0a578b9b3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.343999 Aug 29 05:06:54.944281 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1812/3694] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:54 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:55.081232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5c1de152-0268-456e-8c5f-e29fee91dc0e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab95c4f70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:55.115377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:55.140471 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71303853-0878-459d-9842-00ec21bf32e9 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 1.054683 Aug 29 05:06:55.141141 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1883/3695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:54 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:55.145710 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5c1de152-0268-456e-8c5f-e29fee91dc0e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/781856a4-b37a-40ef-b4a7-f33701b5e16c" status: 200 len: 660 microversion: 2.1 time: 0.072035 Aug 29 05:06:55.147039 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1813/3696] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:06:55 2022] GET /compute/v2.1/images/781856a4-b37a-40ef-b4a7-f33701b5e16c => generated 660 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:55.166983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-882192fe-41ad-4e04-bf9f-819d93257cef tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab820fd30>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:55.179930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:55.180916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:55.190189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:55.190702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:55.191144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:55.191877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:55.192370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:55.192799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:55.256130 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-882192fe-41ad-4e04-bf9f-819d93257cef tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/781856a4-b37a-40ef-b4a7-f33701b5e16c" status: 200 len: 660 microversion: 2.1 time: 0.099430 Aug 29 05:06:55.270350 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1884/3697] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:06:55 2022] GET /compute/v2.1/images/781856a4-b37a-40ef-b4a7-f33701b5e16c => generated 660 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:55.352279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-116509325", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:55.448255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:06:55.539977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:55.552189 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b153060-53c6-47f3-b5c6-bfee529dbf0a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1514 microversion: 2.1 time: 0.377352 Aug 29 05:06:55.562526 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1814/3698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:55 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1514 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:55.588305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:55.590823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:55.622485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:55.628395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:55.628851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:55.638246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:55.638889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:55.639339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:55.994796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:56.012490 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e244ec16-fa80-4a6b-adca-d299cfd44650 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1220 microversion: 2.1 time: 0.428920 Aug 29 05:06:56.016964 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1815/3699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:55 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1220 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:56.029124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:56.034195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:56.048943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:56.049733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:56.050378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:56.051274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:56.052002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:56.059142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:56.214755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:06:56.215214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:06:56.215992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:06:56.216715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:06:56.217126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:06:56.245648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:56.246142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:56.246580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:56.247311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:56.247767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:56.261635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:56.315796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Getting quotas for project 6fa0679374454bf8b0187f3f378db5ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:06:56.340294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Getting quotas for user 2e043126791b4f70903a287e7f8b1a2c and project 6fa0679374454bf8b0187f3f378db5ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:06:56.374969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:06:56.378376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:06:56.384420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:56.418167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:56.427522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:56.429240 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8772a854-5005-4fbf-94b0-c84301ac969c tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.409160 Aug 29 05:06:56.431468 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1816/3700] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:56 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:56.446698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:56.455653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:56.471737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:56.476485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:56.477129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:56.488663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:56.489661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:56.490334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:56.592228 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-db7f5e03-62c3-4c2d-bc5e-2b625a985ef2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240600 Aug 29 05:06:56.605899 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1885/3701] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:06:56.614256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:56.621563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:56.637461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:56.638842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:56.641430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:56.642405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:56.643048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:56.643663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:57.902902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:57.915660 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7774cb3f-9beb-4a72-857f-614d7f7e41e6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1505 microversion: 2.1 time: 1.480966 Aug 29 05:06:57.918519 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1817/3702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:56 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1505 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:57.929245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2010078205", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:57.995466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:58.008931 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c7b90770-57f0-464c-852c-12c921531521 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1520 microversion: 2.1 time: 1.399146 Aug 29 05:06:58.011629 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1886/3703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:56 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1520 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:58.030305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:58.032004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:58.040000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] validate_networks() for None {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:06:58.057369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:58.057868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:58.062806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:58.063621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:58.066170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:58.066650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:58.124351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:06:58.223796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:58.234229 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ab46a4f-e570-4993-90ea-75f00a97b3e1 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1268 microversion: 2.1 time: 0.214901 Aug 29 05:06:58.234803 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1887/3704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:58 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1268 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:58.272358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:58.278713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:58.295177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:58.296372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:58.297051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:58.298894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:58.308621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:58.311289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:58.589275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:06:58.589592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:06:58.590414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:06:58.590992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:06:58.591561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:06:58.612796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:58.619530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:58.619989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:58.621165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:58.621281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:58.621673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:58.656980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:58.676297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:58.682800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:58.684676 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d737162b-4e30-4571-875b-406b64d67cf3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.420413 Aug 29 05:06:58.684958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Getting quotas for project 6fa0679374454bf8b0187f3f378db5ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:06:58.685258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1888/3705] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:58 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:06:58.707858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Getting quotas for user 2e043126791b4f70903a287e7f8b1a2c and project 6fa0679374454bf8b0187f3f378db5ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:06:58.763429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:06:58.769435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:06:58.901776 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-923393e0-17a4-492c-81eb-b0deeb745a4a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981905 Aug 29 05:06:58.902996 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1818/3706] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:06:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:06:58.914262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-280893e2-068f-4591-86c1-1f3c05df05af tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:58.917063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-280893e2-068f-4591-86c1-1f3c05df05af tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:58.938543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:58.939487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:58.958408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:58.958923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:58.959370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:58.960095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:58.960576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:58.961198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:59.361469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:59.371562 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7271968b-330d-49d5-8ca3-04612cd0cef6 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1463 microversion: 2.1 time: 0.437021 Aug 29 05:06:59.377259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-280893e2-068f-4591-86c1-1f3c05df05af tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:59.389020 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1819/3707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:58 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1463 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:59.392440 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-280893e2-068f-4591-86c1-1f3c05df05af tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1218 microversion: 2.1 time: 0.481333 Aug 29 05:06:59.396078 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1889/3708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:58 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1218 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:59.409444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:59.416465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:59.421590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:59.422275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:59.459841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:59.460854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:59.461957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:59.463465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:59.464371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:59.465119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:59.471079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:59.472266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:59.477911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:59.482063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:59.482740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:59.488911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:59.691692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:06:59.703553 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3bd6d8ee-38bb-4026-93bb-ecde15b9a78f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1276 microversion: 2.1 time: 0.305360 Aug 29 05:06:59.711240 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1890/3709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:59 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1276 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:06:59.718028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8ddf9e70-e1a3-46c4-b33e-52905833885c req-c272dd4c-9a66-4c6b-a9ab-335be45758a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98cdfa7-19c5-4b83-b324-c53bf858f564", "name": "network-vif-deleted", "tag": "942a04fc-71eb-4291-bef0-beffb9f6166b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:06:59.751988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8ddf9e70-e1a3-46c4-b33e-52905833885c req-c272dd4c-9a66-4c6b-a9ab-335be45758a1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:59.758532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8ddf9e70-e1a3-46c4-b33e-52905833885c req-c272dd4c-9a66-4c6b-a9ab-335be45758a1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:59.769259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8ddf9e70-e1a3-46c4-b33e-52905833885c req-c272dd4c-9a66-4c6b-a9ab-335be45758a1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:59.817592 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8ddf9e70-e1a3-46c4-b33e-52905833885c req-c272dd4c-9a66-4c6b-a9ab-335be45758a1 service nova] Creating event network-vif-deleted:942a04fc-71eb-4291-bef0-beffb9f6166b for instance d98cdfa7-19c5-4b83-b324-c53bf858f564 on n-h1-854119-9 Aug 29 05:06:59.829404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8ddf9e70-e1a3-46c4-b33e-52905833885c req-c272dd4c-9a66-4c6b-a9ab-335be45758a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114950 Aug 29 05:06:59.834631 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1891/3710] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:06:59.840310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:06:59.862119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:06:59.878945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:59.879592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:59.881741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:06:59.884324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:06:59.885133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:06:59.889328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:00.036225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:00.048319 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed759f53-cba1-457c-a922-814079777784 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1520 microversion: 2.1 time: 0.655289 Aug 29 05:07:00.048985 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1820/3711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:06:59 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1520 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:00.072832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:00.087202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:00.091252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:00.092687 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-173f8851-841d-4697-abbf-c890881b2649 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.256838 Aug 29 05:07:00.098621 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1892/3712] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:06:59 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:00.394353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:00.395843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:00.410061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:00.410061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:00.411232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:00.413375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:00.414902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:00.415379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:00.415722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:00.417766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:00.432462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:00.433085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:00.433462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:00.434229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:00.434679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:00.445850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:00.549286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:00.551070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:00.552953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:00.555142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lazy-loading 'fault' on Instance uuid d98cdfa7-19c5-4b83-b324-c53bf858f564 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:07:00.625902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:00.638770 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5f6d48f2-e681-4025-b9c7-4fd632a410c8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1214 microversion: 2.1 time: 0.225572 Aug 29 05:07:00.643228 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1893/3713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:00 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:00.738268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:00.747993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:00.755176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:00.756037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:00.757667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:00.759529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:00.761050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:00.765144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:00.936728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:00.972525 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f11f941-9753-4296-8ab9-67c8dfe5b98f tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 200 len: 1303 microversion: 2.1 time: 0.554873 Aug 29 05:07:00.973478 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1821/3714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:00 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 1303 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:00.992159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:01.032460 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b9166f2b-9c86-45d5-a3b0-cabea1ab9aaa tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1274 microversion: 2.1 time: 0.304535 Aug 29 05:07:01.033321 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1894/3715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:00 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:01.070236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:01.071586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:01.081192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:01.083116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:01.083737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:01.088019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:01.089717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:01.090328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:01.125238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:01.129692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:01.167049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:01.167251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:01.171209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:01.176072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:01.181957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:01.183795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:01.432450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:01.447612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:01.449500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:01.453996 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f05d02f3-634b-4491-a375-8ca595c5683f tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.335699 Aug 29 05:07:01.460195 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1895/3716] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:01 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:01.660971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:01.661588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:01.671763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:01.672584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:01.673028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:01.673784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:01.674226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:01.674783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:01.885202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:01.905500 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4738fc9b-1cfd-447b-887b-a597ae0ef28e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1278 microversion: 2.1 time: 0.248261 Aug 29 05:07:01.908063 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1896/3717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:01 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:01.997091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:01.997751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: d98cdfa7-19c5-4b83-b324-c53bf858f564] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:02.031563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.032076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.032552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.033284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.033746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.034172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.092231 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] HTTP exception thrown: Instance d98cdfa7-19c5-4b83-b324-c53bf858f564 could not be found. Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Request method failure captured: Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 HTTP/1.1 Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEjjC7yTjAYON9sWgef8i38islEu_iVIFuXZJQhlWE0PYkOlLkP4FdYgwq78x76jvUnl8rchftEmfpZ9gyWZMZJ92OODML5ZtcFXYVrGWDK8fbh9zW9WQwrpmZAAdhIgJQUe5ZfS5gKnLyTWuxRkG1M2VznJEHBgcCh8q0563gnBSUg Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e0354847e7074255a9b5095f9e589128 Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerRescueTestJSON-2102099753 Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0354847e7074255a9b5095f9e589128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e0354847e7074255a9b5095f9e589128"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e0354847e7074255a9b5095f9e589128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0354847e7074255a9b5095f9e589128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerRescueTestJSON-2102099753 Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e0354847e7074255a9b5095f9e589128 Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerRescueTestJSON-2102099753 Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerRescueTestJSON-2102099753-project Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 7053571eaec54866b01f3c5657ca1e5e Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerRescueTestJSON-2102099753-project Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance d98cdfa7-19c5-4b83-b324-c53bf858f564 could not be found. Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'd98cdfa7-19c5-4b83-b324-c53bf858f564'} Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d98cdfa7-19c5-4b83-b324-c53bf858f564 could not be found. Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d98cdfa7-19c5-4b83-b324-c53bf858f564 could not be found. Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:02.094091 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:02.099274 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:02.099274 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:02.099274 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:02.099274 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:07:02.099274 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:07:02.099274 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d98cdfa7-19c5-4b83-b324-c53bf858f564 could not be found. Aug 29 05:07:02.099274 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:02.099274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Returning 404 to user: Instance d98cdfa7-19c5-4b83-b324-c53bf858f564 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:07:02.103007 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85ab15b3-5ba7-45df-a366-c262c49570dc tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564" status: 404 len: 111 microversion: 2.1 time: 0.105472 Aug 29 05:07:02.104203 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1897/3718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:01 2022] GET /compute/v2.1/servers/d98cdfa7-19c5-4b83-b324-c53bf858f564 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:07:02.113690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:02.114458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:02.133869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.135527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.138594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.141191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.142032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.143747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.240603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:02.249798 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9815d13a-88e3-4b1f-a104-a266589d5bd1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1520 microversion: 2.1 time: 1.184419 Aug 29 05:07:02.250436 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1822/3719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:01 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1520 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:02.261327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:02.263426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:02.276766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.282363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.285555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.286594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.287263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.289991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.353146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:07:02.366141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:02.565780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:02.582098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c237c290-b180-45e9-8425-431c59c94868 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1274 microversion: 2.1 time: 0.474322 Aug 29 05:07:02.584757 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15c928c5-e36f-49ec-b1a0-455e457574e3 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 204 len: 0 microversion: 2.1 time: 0.331100 Aug 29 05:07:02.589188 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1823/3721] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:07:02 2022] DELETE /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:07:02.594774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:02.598067 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1898/3721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:02 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1274 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:02.603026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:02.610466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:02.611086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:02.615520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.619811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:02.622033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.622890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.624042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.625455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.626059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.633441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.633983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.634523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.635307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:02.635766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:02.636222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:02.984785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:02.993467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:02.994907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:02.996091 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-25dbd90d-1c51-414f-bfec-cbaafb39d38e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.405584 Aug 29 05:07:03.003289 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1824/3722] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:02 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:03.015054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:03.025311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:03.035703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:03.036217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:03.039760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:03.040548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:03.041015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:03.041444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:03.340890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:03.354613 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8027e08f-ec5a-4cf1-a69e-d586a36be2e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1276 microversion: 2.1 time: 0.348057 Aug 29 05:07:03.356364 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1825/3723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:03 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1276 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:03.368334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:03.370075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:03.381816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:03.384693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:03.386871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:03.387598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:03.392168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:03.392687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:03.946710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:03.961418 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6b90898-d863-4017-a70d-d840bc5a079b tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1492 microversion: 2.1 time: 1.362917 Aug 29 05:07:03.982201 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1899/3724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:02 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1492 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:03.989580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:03.992440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:04.007421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:04.008379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:04.008981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:04.010065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:04.010669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:04.011256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:04.610834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:04.623069 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f28f3372-df5b-4319-9950-fc51e4cb3389 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1520 microversion: 2.1 time: 1.264883 Aug 29 05:07:04.627263 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1826/3725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:03 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1520 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:04.642742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:04.644671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:04.671967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:04.673897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:04.678007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:04.679030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:04.679675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:04.681606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:04.971321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:04.990255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:04.991521 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b20b836e-dffc-4466-922f-2736e2b46d06 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 1.004889 Aug 29 05:07:04.992910 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1900/3726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:03 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:05.003936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:05.005492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:05.006207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:05.006817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:05.020390 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eaf799d9-4fa8-47cb-8e68-50dcae785c26 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.391551 Aug 29 05:07:05.024423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:05.025319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:05.026015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:05.029083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:05.029826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:05.030506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:05.031346 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1827/3727] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:04 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:05.042826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:05.043577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:05.059371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:05.060624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:05.061080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:05.061976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:05.062474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:05.062902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:05.443672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:05.455417 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f1d9fc65-b25b-49d2-af0b-0517dc2352cc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1276 microversion: 2.1 time: 0.460562 Aug 29 05:07:05.456977 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1901/3728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:04 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1276 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:05.646971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:05.647764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:05.656579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:05.662039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:05.662748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:05.663718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:05.664437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:05.665302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:06.280513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:07.039434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:07.049737 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a5e287a-9168-4a99-9b8e-c83c65e32b14 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1520 microversion: 2.1 time: 1.406978 Aug 29 05:07:07.051102 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1902/3729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:05 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1520 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:07.074541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:07.075166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:07.095532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:07.096031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:07.096683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:07.099496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:07.100502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:07.103193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:07.277223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:07.291237 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fef60707-03b6-4962-9391-bf7e8b809836 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1492 microversion: 2.1 time: 2.258755 Aug 29 05:07:07.296818 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1828/3730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:05 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1492 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:07.315918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:07.316574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:07.332295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:07.333055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:07.336053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:07.337132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:07.338326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:07.339763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:07.584039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:07.595236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:07.597490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:07.599566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39f0c44a-96c6-47bb-8201-4ebd87564e8e tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.301574 Aug 29 05:07:07.601628 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1829/3731] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:07 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:07.607551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-df55e8d4-4eab-4ef5-83f9-01babaf6c4e8 req-52a2452e-24e3-4f07-bd4c-baee8bcbf528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d2be2f-eb5c-4b80-a822-cf3e1c839b9b", "name": "network-vif-plugged", "status": "completed", "tag": "afc7eb66-5a91-4927-ab51-f7dc6c9df0e1"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:07.620625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-df55e8d4-4eab-4ef5-83f9-01babaf6c4e8 req-52a2452e-24e3-4f07-bd4c-baee8bcbf528 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:07.621266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-df55e8d4-4eab-4ef5-83f9-01babaf6c4e8 req-52a2452e-24e3-4f07-bd4c-baee8bcbf528 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:07.621843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-df55e8d4-4eab-4ef5-83f9-01babaf6c4e8 req-52a2452e-24e3-4f07-bd4c-baee8bcbf528 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:07.636463 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-df55e8d4-4eab-4ef5-83f9-01babaf6c4e8 req-52a2452e-24e3-4f07-bd4c-baee8bcbf528 service nova] Creating event network-vif-plugged:afc7eb66-5a91-4927-ab51-f7dc6c9df0e1 for instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b on n-h1-854119-9 Aug 29 05:07:07.643125 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-df55e8d4-4eab-4ef5-83f9-01babaf6c4e8 req-52a2452e-24e3-4f07-bd4c-baee8bcbf528 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039869 Aug 29 05:07:07.648401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1830/3732] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:07.662884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:07.663907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:07.696600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:07.701457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:07.702119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:07.703371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:07.705877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:07.706520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:08.131676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:08.146179 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e5ef2412-26fe-461a-9a3f-87056f12987f tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 1.091349 Aug 29 05:07:08.147298 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1903/3733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:07 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:08.152325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:08.155207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:08.162995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:08.163724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:08.165593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:08.182995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:08.185233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:08.186054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:08.197949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:08.210927 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-37d12182-b67d-49d0-a7d7-f90d9400f0d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1276 microversion: 2.1 time: 0.560722 Aug 29 05:07:08.227271 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1831/3734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:07 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1276 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:08.316950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:08.318339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:08.330982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:08.334598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:08.336687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:08.340105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:08.341713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:08.347144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:08.647519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:08.737182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:09.382875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=14 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:09.780461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:09.801907 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f80e8cb7-b36f-4bff-bdfd-d6f68c189672 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1492 microversion: 2.1 time: 1.483526 Aug 29 05:07:09.811242 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1832/3735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:08 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1492 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:09.816742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:09.836593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:09.875919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:09.876443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:09.876878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:09.877593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:09.878043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:09.890155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:09.930041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:09.949264 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7f7cf3dd-3490-4dc8-b8c9-28404159c7e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1520 microversion: 2.1 time: 1.797407 Aug 29 05:07:09.951762 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1904/3736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:08 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1520 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:09.963094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:09.966818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:09.992496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:09.993700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:09.996376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:09.997365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:09.998749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:10.003175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:10.161797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:10.172049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:10.184895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:10.192207 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97ca659b-6d4f-48da-91af-f355c2dda332 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.379388 Aug 29 05:07:10.204174 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1833/3737] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:09 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:10.212471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:10.212471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:10.241156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:10.253631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:10.261492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:10.273098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:10.274563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:10.275925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:11.199600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:11.226895 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7e0df49-c99a-43fc-9219-a57f28fc96c6 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 1.271966 Aug 29 05:07:11.229368 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1905/3738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:09 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:11.247541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a1184d5c-b5e8-47a1-9c24-0319ddd8849f req-56af2e0b-16a8-43eb-add2-3308eaff608e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72dd2804-662c-4aec-9e28-48f7137e0122", "name": "network-vif-unplugged", "status": "completed", "tag": "195dfe40-178f-492d-97ae-18cedf504aba"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:11.261693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:11.299377 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab8eb4e4-d1ac-4581-959f-dacc809c0679 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 1.103055 Aug 29 05:07:11.300100 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1834/3739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:10 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:11.307549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:11.310516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:11.312793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a1184d5c-b5e8-47a1-9c24-0319ddd8849f req-56af2e0b-16a8-43eb-add2-3308eaff608e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:11.313648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a1184d5c-b5e8-47a1-9c24-0319ddd8849f req-56af2e0b-16a8-43eb-add2-3308eaff608e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:11.314100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a1184d5c-b5e8-47a1-9c24-0319ddd8849f req-56af2e0b-16a8-43eb-add2-3308eaff608e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:11.351745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:11.352520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:11.353073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:11.354591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:11.356051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:11.356640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:11.362271 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a1184d5c-b5e8-47a1-9c24-0319ddd8849f req-56af2e0b-16a8-43eb-add2-3308eaff608e service nova] Creating event network-vif-unplugged:195dfe40-178f-492d-97ae-18cedf504aba for instance 72dd2804-662c-4aec-9e28-48f7137e0122 on n-h1-854119-9 Aug 29 05:07:11.373808 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a1184d5c-b5e8-47a1-9c24-0319ddd8849f req-56af2e0b-16a8-43eb-add2-3308eaff608e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141111 Aug 29 05:07:11.374422 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1906/3740] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:11.396269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:11.396982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:11.414302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:11.415981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:11.416680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:11.417863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:11.418546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:11.419593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:11.433544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:11.608035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7053571eaec54866b01f3c5657ca1e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0354847e7074255a9b5095f9e589128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:11.621206 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-40092a8d-93ac-444c-86a2-e5ec886fc207 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 200 len: 1450 microversion: 2.1 time: 0.317199 Aug 29 05:07:11.623390 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1835/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:11 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 1450 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:11.644899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:11.646027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:11.661916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:11.662798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:11.663531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:11.665271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:11.668354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:11.669676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:11.971199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:11.986571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:11.989712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:11.994933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a4e5b854-6e1f-4aba-acba-02f35b1020b9 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.356088 Aug 29 05:07:12.001504 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1836/3742] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:11 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:12.015752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a2d99c58-0be5-41c8-b71c-48e640110089 req-5b9f09c7-6370-459c-a24e-6185cc0e9643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6586f01-a1dc-4e32-907a-f1f03a4fd86a", "tag": "c4e53ec2-94f2-448e-b3f2-26d4aacd2e70"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:12.045889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a2d99c58-0be5-41c8-b71c-48e640110089 req-5b9f09c7-6370-459c-a24e-6185cc0e9643 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:12.046678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a2d99c58-0be5-41c8-b71c-48e640110089 req-5b9f09c7-6370-459c-a24e-6185cc0e9643 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:12.047814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a2d99c58-0be5-41c8-b71c-48e640110089 req-5b9f09c7-6370-459c-a24e-6185cc0e9643 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:12.071551 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a2d99c58-0be5-41c8-b71c-48e640110089 req-5b9f09c7-6370-459c-a24e-6185cc0e9643 service nova] Creating event network-changed:c4e53ec2-94f2-448e-b3f2-26d4aacd2e70 for instance b6586f01-a1dc-4e32-907a-f1f03a4fd86a on n-h1-854119-9 Aug 29 05:07:12.101133 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a2d99c58-0be5-41c8-b71c-48e640110089 req-5b9f09c7-6370-459c-a24e-6185cc0e9643 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097447 Aug 29 05:07:12.104685 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1837/3743] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:12.251687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:12.252476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:12.263648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:12.273010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:12.273758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:12.275040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:12.276090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:12.276606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:13.287211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:13.295555 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5bc843d0-44a8-4d1e-a8ac-823850e1fb2d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1505 microversion: 2.1 time: 1.914096 Aug 29 05:07:13.314537 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1907/3744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:11 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1505 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:13.323811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:13.330301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:13.342252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:13.343065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:13.343706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:13.348712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:13.349475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:13.350415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:13.618441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:13.629303 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-079e5288-cab0-4723-8cc6-51a0930b5a76 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 1.383112 Aug 29 05:07:13.629903 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1838/3745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:12 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:13.641028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:13.644329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] [instance: 72dd2804-662c-4aec-9e28-48f7137e0122] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:13.664322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:13.664827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:13.665263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:13.666187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:13.666814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:13.667408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:13.695325 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] HTTP exception thrown: Instance 72dd2804-662c-4aec-9e28-48f7137e0122 could not be found. Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Request method failure captured: Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 HTTP/1.1 Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEjjC7yTjAYON9sWgef8i38islEu_iVIFuXZJQhlWE0PYkOlLkP4FdYgwq78x76jvUnl8rchftEmfpZ9gyWZMZJ92OODML5ZtcFXYVrGWDK8fbh9zW9WQwrpmZAAdhIgJQUe5ZfS5gKnLyTWuxRkG1M2VznJEHBgcCh8q0563gnBSUg Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e0354847e7074255a9b5095f9e589128 Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerRescueTestJSON-2102099753 Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0354847e7074255a9b5095f9e589128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e0354847e7074255a9b5095f9e589128"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e0354847e7074255a9b5095f9e589128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0354847e7074255a9b5095f9e589128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerRescueTestJSON-2102099753 Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e0354847e7074255a9b5095f9e589128 Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerRescueTestJSON-2102099753 Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerRescueTestJSON-2102099753-project Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 7053571eaec54866b01f3c5657ca1e5e Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerRescueTestJSON-2102099753-project Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 72dd2804-662c-4aec-9e28-48f7137e0122 could not be found. Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '72dd2804-662c-4aec-9e28-48f7137e0122'} Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72dd2804-662c-4aec-9e28-48f7137e0122 could not be found. Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72dd2804-662c-4aec-9e28-48f7137e0122 could not be found. Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:13.701277 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:13.707092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:13.707092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:13.707092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:13.707092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:07:13.707092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:07:13.707092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72dd2804-662c-4aec-9e28-48f7137e0122 could not be found. Aug 29 05:07:13.707092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:13.708626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] Returning 404 to user: Instance 72dd2804-662c-4aec-9e28-48f7137e0122 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:07:13.709924 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-08d1780f-00a9-462c-af09-3aaff0f22a60 tempest-ServerRescueTestJSON-2102099753 tempest-ServerRescueTestJSON-2102099753-project] 10.222.0.20 "GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122" status: 404 len: 111 microversion: 2.1 time: 0.072471 Aug 29 05:07:13.718208 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1839/3746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:13 2022] GET /compute/v2.1/servers/72dd2804-662c-4aec-9e28-48f7137e0122 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:07:13.723442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:13.724281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:13.743368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:13.744312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:13.746790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:13.747812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:13.748479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:13.751654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:13.962978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:13.970006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:13.978370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:13.979819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:13.981056 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3f792a04-c9dc-408a-8942-6b0cc19f43af tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.261618 Aug 29 05:07:13.994320 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1840/3747] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:13 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:14.008845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:14.016453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:14.076759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:14.078034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:14.079478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:14.081599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:14.082419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:14.083057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:14.344457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:14.354288 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7a4b73a-c9b7-4cb6-b2f7-786860940bb0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 1.038273 Aug 29 05:07:14.364467 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1908/3748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:13 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:14.650903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:14.651531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:14.658251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:14.658749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:14.659184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:14.665664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:14.666149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:14.675617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:15.033152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:15.054138 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0dbdf802-ffce-411e-bf35-c6647f368832 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 200 len: 1505 microversion: 2.1 time: 1.054275 Aug 29 05:07:15.055161 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1841/3749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:13 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 1505 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:15.061233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4aa3d3ab-7dc6-4006-903e-09ef91756961 req-21029920-414a-4e08-a966-18858faa181e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72dd2804-662c-4aec-9e28-48f7137e0122", "name": "network-vif-deleted", "tag": "195dfe40-178f-492d-97ae-18cedf504aba"}, {"name": "network-changed", "server_uuid": "a557400d-1409-4dff-b0ae-8b54fd922250", "tag": "dad129e8-e3ea-4e47-929c-0e837a029c60"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:15.096167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4aa3d3ab-7dc6-4006-903e-09ef91756961 req-21029920-414a-4e08-a966-18858faa181e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:15.096984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4aa3d3ab-7dc6-4006-903e-09ef91756961 req-21029920-414a-4e08-a966-18858faa181e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:15.098174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4aa3d3ab-7dc6-4006-903e-09ef91756961 req-21029920-414a-4e08-a966-18858faa181e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:15.131091 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4aa3d3ab-7dc6-4006-903e-09ef91756961 req-21029920-414a-4e08-a966-18858faa181e service nova] Creating event network-vif-deleted:195dfe40-178f-492d-97ae-18cedf504aba for instance 72dd2804-662c-4aec-9e28-48f7137e0122 on n-h1-854119-9 Aug 29 05:07:15.131627 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4aa3d3ab-7dc6-4006-903e-09ef91756961 req-21029920-414a-4e08-a966-18858faa181e service nova] Creating event network-changed:dad129e8-e3ea-4e47-929c-0e837a029c60 for instance a557400d-1409-4dff-b0ae-8b54fd922250 on n-h1-854119-9 Aug 29 05:07:15.150502 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4aa3d3ab-7dc6-4006-903e-09ef91756961 req-21029920-414a-4e08-a966-18858faa181e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.092586 Aug 29 05:07:15.151692 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1842/3750] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:15.157986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:15.166109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:15.173544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:15.174466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:15.175099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:15.176820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:15.177750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:15.178909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:15.224369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:15.233051 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2f87964-e2f1-4294-b904-77d51f516b71 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 0.585259 Aug 29 05:07:15.233951 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1909/3751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:14 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:15.246807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:15.249654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:15.271715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:15.272851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:15.276063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:15.281208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:15.283292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:15.283988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:15.305503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:15.321148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:15.322739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:15.323955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b79555cc-0b13-480f-95b2-0f52649f9e18 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.170800 Aug 29 05:07:15.336610 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1843/3752] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:15 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:15.375861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:07:15.377387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:15.378012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:15.385166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:15.396595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:15.397106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:15.397555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:15.398325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:15.398785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:15.399213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:15.546310 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d88b3535-2185-4e3a-81cf-b1ca7f4d9103 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 204 len: 0 microversion: 2.1 time: 0.309360 Aug 29 05:07:15.551236 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1910/3753] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:07:15 2022] DELETE /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:07:15.780542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1641146352", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "388b126b-eb59-4ecb-aa93-a85eefd19dca"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:15.901724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] validate_networks() for [('388b126b-eb59-4ecb-aa93-a85eefd19dca', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:07:16.297250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:16.309726 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c59a5ee4-56f8-465a-9c40-0a0aa18ecc61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.936013 Aug 29 05:07:16.310645 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1844/3754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:15 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:16.315496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:16.321421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:16.337739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:16.342933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:16.344916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:16.349543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:16.350120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:16.350849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:17.283367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:17.293383 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aa0d2671-567e-4b8f-a481-98c1092ae4d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 0.981307 Aug 29 05:07:17.308844 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1845/3755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:16 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:17.318140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:17.319689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:17.334194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:17.334693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:17.335130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:17.336733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:17.337209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:17.337749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:17.508707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:17.518804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:17.521294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:17.523228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bc65d9d-8671-424f-a6d2-7f64808e43d5 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1366 microversion: 2.47 time: 0.212452 Aug 29 05:07:17.534509 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1846/3756] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:17 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:17.544528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-dc6bc0aa-bdc7-44cf-ab89-62726a3a0482 req-bff18497-15eb-4426-bc51-10c83a98bae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69b5de3-eef5-4ed2-a45c-155cb560423b", "tag": "21ed04b2-af73-45fc-82a5-01ea8dcf9bd3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:17.560087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-dc6bc0aa-bdc7-44cf-ab89-62726a3a0482 req-bff18497-15eb-4426-bc51-10c83a98bae8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:17.561043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-dc6bc0aa-bdc7-44cf-ab89-62726a3a0482 req-bff18497-15eb-4426-bc51-10c83a98bae8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:17.561543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-dc6bc0aa-bdc7-44cf-ab89-62726a3a0482 req-bff18497-15eb-4426-bc51-10c83a98bae8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:17.580451 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-dc6bc0aa-bdc7-44cf-ab89-62726a3a0482 req-bff18497-15eb-4426-bc51-10c83a98bae8 service nova] Creating event network-changed:21ed04b2-af73-45fc-82a5-01ea8dcf9bd3 for instance b69b5de3-eef5-4ed2-a45c-155cb560423b on n-h1-854119-9 Aug 29 05:07:17.589625 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-dc6bc0aa-bdc7-44cf-ab89-62726a3a0482 req-bff18497-15eb-4426-bc51-10c83a98bae8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052180 Aug 29 05:07:17.592638 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1847/3757] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:17.598962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:17.599926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:17.610592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:17.611816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:17.612551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:17.613733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:17.614411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:17.615248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:17.920037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:07:17.920779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:07:17.921265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:07:17.921740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:07:17.922153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:07:17.940661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:17.941949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:17.945219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:17.946502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:17.948157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:17.951156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:17.979182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Getting quotas for project 062852699f4a47e98070dc8ae543db6a. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:07:17.983766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:17.987095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Getting quotas for user 00048986d35b4cb1934a71d10a851d6d and project 062852699f4a47e98070dc8ae543db6a. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:07:17.992608 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bae0a790-6e2f-44fe-bd27-a7df4340c1ed tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.397590 Aug 29 05:07:18.005161 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1848/3758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:17 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:18.006049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:07:18.009357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:07:18.168086 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-81b0352e-e976-408e-97c3-d1278eeaa4dc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.387502 Aug 29 05:07:18.172203 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1911/3759] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:07:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:07:18.180751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-239b3e39-c43e-4a26-a04f-4ef98ff762e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:18.181702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-239b3e39-c43e-4a26-a04f-4ef98ff762e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:18.315025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:18.315650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:18.318216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-239b3e39-c43e-4a26-a04f-4ef98ff762e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:18.328455 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-239b3e39-c43e-4a26-a04f-4ef98ff762e6 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1218 microversion: 2.1 time: 0.151257 Aug 29 05:07:18.329643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:18.330470 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1849/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:18 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:18.334652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:18.335777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:18.337455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:18.339494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:18.342892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:18.549941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:18.550628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:18.563132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:18.568290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:18.574784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:18.576692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:18.577336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:18.578437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:19.036155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:19.073007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:19.085052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:19.090500 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-07b0c451-b790-4150-a016-a6ef165c995d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1384 microversion: 2.47 time: 0.543020 Aug 29 05:07:19.092227 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1850/3761] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:18 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1384 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:07:19.101661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:19.102497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:19.112068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:19.112828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:19.113455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:19.114843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:19.115722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:19.116424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:19.385787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:19.406034 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b3a324fc-6662-442a-8c59-6dadf0f927ab tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 1.090030 Aug 29 05:07:19.407973 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1912/3762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:18 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:19.421484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:19.424183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:19.453340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:19.455845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:19.457782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:19.463063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:19.465064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:19.466497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:19.551037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:19.587743 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e2307dd-9f3f-4e7f-8aac-19cd213a0be2 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.482333 Aug 29 05:07:19.591586 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1851/3763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:19 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:19.629344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:19.638722 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-afc64153-1b9f-4b42-b37b-baf0c38308eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1214 microversion: 2.1 time: 0.228409 Aug 29 05:07:19.653868 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1913/3764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:19 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:20.120589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:20.121204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:20.133659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:20.134150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:20.147243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:20.148013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:20.148512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:20.148936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:20.275733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:20.288802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:20.291717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:20.297640 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c1986544-a74b-4a4f-9ba8-8450c406ca6b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1372 microversion: 2.47 time: 0.181340 Aug 29 05:07:20.299058 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1852/3765] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:20 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:20.428590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:20.429893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:20.451088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:20.453372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:20.456811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:20.457863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:20.458535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:20.459128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:20.616641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:20.618052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:20.627906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:20.628625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:20.629398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:20.630763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:20.631381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:20.631946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:21.070401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:21.093558 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed4b7396-a434-4c71-989d-f410e3f078fd tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 0.668278 Aug 29 05:07:21.094967 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1914/3766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:20 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:21.117721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:21.119669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:21.128722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:21.130729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:21.131345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:21.132289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:21.133789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:21.134373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:21.158127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:21.169552 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ce836d2-46a1-43ff-aced-88e757072abe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.558403 Aug 29 05:07:21.173163 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1853/3767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:20 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:21.245138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:21.258562 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-27293ee1-dfd3-4abf-b29a-58e443483010 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1214 microversion: 2.1 time: 0.160973 Aug 29 05:07:21.261906 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1915/3768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:21 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:21.325239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:21.325866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:21.333725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:21.334555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:21.335240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:21.336211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:21.337131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:21.337750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:21.973222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-218db37e-6728-4721-a18e-df983a82151d req-e95c4353-fe29-4f61-9d3b-93a4e061023e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6586f01-a1dc-4e32-907a-f1f03a4fd86a", "name": "network-vif-plugged", "status": "completed", "tag": "c4e53ec2-94f2-448e-b3f2-26d4aacd2e70"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:22.005216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-218db37e-6728-4721-a18e-df983a82151d req-e95c4353-fe29-4f61-9d3b-93a4e061023e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:22.005944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-218db37e-6728-4721-a18e-df983a82151d req-e95c4353-fe29-4f61-9d3b-93a4e061023e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:22.009872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-218db37e-6728-4721-a18e-df983a82151d req-e95c4353-fe29-4f61-9d3b-93a4e061023e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:22.046409 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-218db37e-6728-4721-a18e-df983a82151d req-e95c4353-fe29-4f61-9d3b-93a4e061023e service nova] Creating event network-vif-plugged:c4e53ec2-94f2-448e-b3f2-26d4aacd2e70 for instance b6586f01-a1dc-4e32-907a-f1f03a4fd86a on n-h1-854119-9 Aug 29 05:07:22.068422 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-218db37e-6728-4721-a18e-df983a82151d req-e95c4353-fe29-4f61-9d3b-93a4e061023e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101817 Aug 29 05:07:22.074361 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1916/3769] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:22.116217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:22.117074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:22.125499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:22.127123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:22.131046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:22.134040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:22.135936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:22.137251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:22.272399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:22.285876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:22.287344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:22.288599 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-74283000-3a10-48d0-a7c2-3ed21b0cef87 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1372 microversion: 2.47 time: 0.970457 Aug 29 05:07:22.297287 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1854/3770] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:21 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1372 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:22.317236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:22.318226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:22.327960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:22.328473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:22.331756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:22.332668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:22.336710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:22.337354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:23.125851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:23.138005 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52a4f086-b473-4710-b1a7-1bfdc4c788d6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.838749 Aug 29 05:07:23.142048 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1855/3771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:22 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:23.152194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:23.153970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:23.169992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:23.170843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:23.171887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:23.172798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:23.173389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:23.173979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:23.332541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:23.343444 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c281b5f8-0fd6-43ec-82ca-08f5a4d053ef tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 1.232011 Aug 29 05:07:23.344049 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1917/3772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:22 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:23.360658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:23.361320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:23.388181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:23.390228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:23.391479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:23.395737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:23.397821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:23.404845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:23.603357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:23.612243 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-98a63ada-3a73-4581-97a1-dfd80085ae71 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1214 microversion: 2.1 time: 0.468811 Aug 29 05:07:23.618741 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1856/3773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:23 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1214 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:23.734559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:23.770314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:23.776767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:23.780672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dc7e7aee-0d4b-4ad7-8aa6-8ad6a368df98 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1372 microversion: 2.47 time: 0.422308 Aug 29 05:07:23.782578 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1918/3774] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:23 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1372 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:24.121261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-49e90467-3a17-4cad-93a0-4ab2832efc88 req-9e6e161a-020c-4a89-b3dc-39009f1972dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d2be2f-eb5c-4b80-a822-cf3e1c839b9b", "name": "network-vif-unplugged", "status": "completed", "tag": "afc7eb66-5a91-4927-ab51-f7dc6c9df0e1"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:24.144727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-49e90467-3a17-4cad-93a0-4ab2832efc88 req-9e6e161a-020c-4a89-b3dc-39009f1972dd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:24.165388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-49e90467-3a17-4cad-93a0-4ab2832efc88 req-9e6e161a-020c-4a89-b3dc-39009f1972dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:24.166217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-49e90467-3a17-4cad-93a0-4ab2832efc88 req-9e6e161a-020c-4a89-b3dc-39009f1972dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:24.167175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:24.168361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:24.181916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:24.183990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:24.185331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:24.187855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:24.190254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:24.195614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:24.209616 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-49e90467-3a17-4cad-93a0-4ab2832efc88 req-9e6e161a-020c-4a89-b3dc-39009f1972dd service nova] Creating event network-vif-unplugged:afc7eb66-5a91-4927-ab51-f7dc6c9df0e1 for instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b on n-h1-854119-9 Aug 29 05:07:24.236916 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-49e90467-3a17-4cad-93a0-4ab2832efc88 req-9e6e161a-020c-4a89-b3dc-39009f1972dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112592 Aug 29 05:07:24.238201 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1857/3775] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:24.366758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:24.367513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:24.378880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:24.384694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:24.385370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:24.386230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:24.396088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:24.396723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:24.862265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:24.875107 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d7ab7706-5ff1-49a4-8cac-71c2a8a84f69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.710939 Aug 29 05:07:24.875956 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1919/3776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:24 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:24.886332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:24.890719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:24.902774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:24.903650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:24.904894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:24.908948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:24.909506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:24.910092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:24.921117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:24.929499 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-baaa4b50-caf9-42c1-9004-3f19ffd12ba4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1316 microversion: 2.1 time: 0.567729 Aug 29 05:07:24.944067 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1858/3777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:24 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:24.949543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-9513f1ea-9ff2-404c-a742-73b3a4fdafa0 req-99b1ff37-8057-4a6b-b8fb-9b767b6fc5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d2be2f-eb5c-4b80-a822-cf3e1c839b9b", "name": "network-vif-deleted", "tag": "afc7eb66-5a91-4927-ab51-f7dc6c9df0e1"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:24.960558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9513f1ea-9ff2-404c-a742-73b3a4fdafa0 req-99b1ff37-8057-4a6b-b8fb-9b767b6fc5ad service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:24.961251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9513f1ea-9ff2-404c-a742-73b3a4fdafa0 req-99b1ff37-8057-4a6b-b8fb-9b767b6fc5ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:24.961839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9513f1ea-9ff2-404c-a742-73b3a4fdafa0 req-99b1ff37-8057-4a6b-b8fb-9b767b6fc5ad service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:24.975995 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-9513f1ea-9ff2-404c-a742-73b3a4fdafa0 req-99b1ff37-8057-4a6b-b8fb-9b767b6fc5ad service nova] Creating event network-vif-deleted:afc7eb66-5a91-4927-ab51-f7dc6c9df0e1 for instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b on n-h1-854119-9 Aug 29 05:07:24.981630 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-9513f1ea-9ff2-404c-a742-73b3a4fdafa0 req-99b1ff37-8057-4a6b-b8fb-9b767b6fc5ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036064 Aug 29 05:07:24.982737 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1859/3778] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:24.989786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:24.990637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:24.997946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:24.998620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:24.999538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:25.000614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:25.001459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:25.002254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:25.066564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:25.079884 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-efa6be95-499f-497a-8da3-d2a6dd454d24 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1270 microversion: 2.1 time: 0.201087 Aug 29 05:07:25.080902 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1920/3779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:24 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:25.117413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:25.131712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:25.135088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:25.136683 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-21c9242a-4091-4d4c-8b1e-b5f168a604f1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1357 microversion: 2.47 time: 0.152735 Aug 29 05:07:25.137938 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1860/3780] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:24 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:25.174327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:25.188011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:25.202300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Searching by: {'deleted': False, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:07:25.232223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:25.235208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:25.235806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:25.237178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:25.237802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:25.238372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:25.422728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:07:25.541185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:25.549593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:25.553241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:25.554216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:25.573141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:25.575453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:25.699796 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5c09ed69-09dc-4a00-a19d-ba1f4259c51a tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.540020 Aug 29 05:07:25.700437 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1921/3781] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Aug 29 05:07:25 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:25.729330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:25.729837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:25.745720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:25.747384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:25.748377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:25.749687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:25.750521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:25.751374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:25.756713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:25.787290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:07:25.912056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:25.916014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:25.927756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:25.928326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:25.928777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:25.934668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:25.934668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:25.935098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:25.972996 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-62e7dc87-4ba2-4684-944a-833e43e4797d tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 204 len: 0 microversion: 2.47 time: 0.245124 Aug 29 05:07:25.974177 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1861/3782] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:07:25 2022] DELETE /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:07:25.981451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:25.982141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:26.009879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.010977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.011645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.012565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.013142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.013659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.328903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:26.331214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:26.349906 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2624c7dd-09d4-4897-ace3-63b8ece6968f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.446223 Aug 29 05:07:26.352446 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1922/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:25 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:26.372325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:26.373356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:26.374505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:26.386110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.386608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.386921 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ae36be33-1432-43b3-a3c1-ff132c79e5e8 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1504 microversion: 2.1 time: 0.409665 Aug 29 05:07:26.387074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.402819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.403010 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1862/3784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:25 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1504 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:26.403086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.403086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.403233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:26.403233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:26.403233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.403666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.404403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.410118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.416261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.416941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.557808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:26.583943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-57a529ae-a437-419e-b455-a2177bc33ddf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1270 microversion: 2.1 time: 0.193888 Aug 29 05:07:26.600848 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1863/3785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:26 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:26.606443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:26.612476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9b263305-f55f-4b7a-98bb-3f9d23ab5f32 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:26.615323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:26.617746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:26.619596 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-593deb50-9ccd-47ea-9d20-685a9ba9039b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1363 microversion: 2.47 time: 0.265656 Aug 29 05:07:26.620196 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1923/3786] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:26 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:26.624471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9b263305-f55f-4b7a-98bb-3f9d23ab5f32 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:26.632547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b263305-f55f-4b7a-98bb-3f9d23ab5f32 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.633204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b263305-f55f-4b7a-98bb-3f9d23ab5f32 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.633805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b263305-f55f-4b7a-98bb-3f9d23ab5f32 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.634646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b263305-f55f-4b7a-98bb-3f9d23ab5f32 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.635238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b263305-f55f-4b7a-98bb-3f9d23ab5f32 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.635803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b263305-f55f-4b7a-98bb-3f9d23ab5f32 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.715324 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9b263305-f55f-4b7a-98bb-3f9d23ab5f32 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.112949 Aug 29 05:07:26.716581 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1864/3787] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Aug 29 05:07:26 2022] DELETE /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a/os-server-password => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:07:26.732012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39bbf83a-5afa-467d-b6dc-ba209ca1577c tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:26.732558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39bbf83a-5afa-467d-b6dc-ba209ca1577c tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:26.746859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39bbf83a-5afa-467d-b6dc-ba209ca1577c tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.747351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39bbf83a-5afa-467d-b6dc-ba209ca1577c tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.747783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39bbf83a-5afa-467d-b6dc-ba209ca1577c tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.754559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39bbf83a-5afa-467d-b6dc-ba209ca1577c tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.755074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39bbf83a-5afa-467d-b6dc-ba209ca1577c tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.755522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39bbf83a-5afa-467d-b6dc-ba209ca1577c tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.788477 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39bbf83a-5afa-467d-b6dc-ba209ca1577c tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.065346 Aug 29 05:07:26.802144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:26.803566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:26.808493 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1924/3788] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Aug 29 05:07:26 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a/os-server-password => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:07:26.815791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.816989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.817728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.818615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:26.819407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:26.820059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:26.903691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:07:27.083160 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95d6ce05-1f68-413a-b063-f36049fa5feb tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 204 len: 0 microversion: 2.1 time: 0.283003 Aug 29 05:07:27.086275 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1865/3789] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:07:26 2022] DELETE /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:07:27.096247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:27.096927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:27.106621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:27.107324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:27.112720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:27.113586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:27.114036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:27.114453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:27.534002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:27.542068 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5db2f804-b009-4627-b230-b92d1169b017 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1510 microversion: 2.1 time: 0.451801 Aug 29 05:07:27.545809 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1925/3790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:27 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:27.552529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:27.554467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:27.564021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:27.564681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:27.565185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:27.567220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:27.567862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:27.571899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:27.667381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6ef4f6ec-6a47-4734-bc97-05f1c1c3de13 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] Calling method '.version_select at 0x7f1ab8fab430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:27.831951 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6ef4f6ec-6a47-4734-bc97-05f1c1c3de13 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55/defaults" status: 200 len: 371 microversion: 2.1 time: 0.472836 Aug 29 05:07:27.835577 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1866/3791] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:07:27 2022] GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55/defaults => generated 371 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:27.848112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:27.849362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:27.855986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:27.862837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:27.863271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:27.864799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:27.865357 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f8f48b01-cb68-49ba-a48c-15e183402058 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.317395 Aug 29 05:07:27.865941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:27.866538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:27.876305 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1926/3792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:27 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:27.879351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:27.880438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:27.881151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:27.897090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:27.897927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:27.900559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:27.901484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:27.903514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:27.904661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:28.041371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:28.058134 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-89820966-7773-4a15-8d9e-ab8ff2c28d2c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1278 microversion: 2.1 time: 0.219059 Aug 29 05:07:28.059337 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1867/3793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:27 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:28.059780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:28.069315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:28.070759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:28.071933 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-48a59198-fd1a-4060-b465-ba0e79659715 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1363 microversion: 2.47 time: 0.203318 Aug 29 05:07:28.072561 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1927/3794] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:27 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:28.074492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5471c81-9af7-4620-9a0c-fe7ff5d06c26 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] Calling method '.version_select at 0x7f1abd87b160>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:28.172677 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5471c81-9af7-4620-9a0c-fe7ff5d06c26 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55" status: 200 len: 371 microversion: 2.1 time: 0.111719 Aug 29 05:07:28.174215 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1868/3795] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 05:07:28 2022] GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55 => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:28.187387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4e211ab8-09d7-415a-9396-7a7c8fa5a418 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] Calling method '.version_select at 0x7f1ab8240f70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:28.275962 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4e211ab8-09d7-415a-9396-7a7c8fa5a418 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55/defaults" status: 200 len: 371 microversion: 2.1 time: 0.092587 Aug 29 05:07:28.278921 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1928/3796] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:07:28 2022] GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55/defaults => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:07:28.292186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9d63fd04-8b1d-46f7-80f9-00046082e109 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] Calling method '.version_select at 0x7f1ab95c4ca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:28.495448 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9d63fd04-8b1d-46f7-80f9-00046082e109 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55" status: 200 len: 371 microversion: 2.1 time: 0.206458 Aug 29 05:07:28.520913 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1869/3797] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 05:07:28 2022] GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55 => generated 371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:28.521125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-edc4fc44-ec54-4659-bb0a-6e00231ca869 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] Calling method '.version_select at 0x7f1ab836e550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:28.567177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:28.578414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:28.585509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:28.586093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:28.586600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:28.587384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:28.589127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:28.589639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:28.699724 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-edc4fc44-ec54-4659-bb0a-6e00231ca869 tempest-QuotasTestJSON-410093426 tempest-QuotasTestJSON-410093426-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55?user_id=4ef57392758e4e6abf532b2e7d82c585" status: 200 len: 371 microversion: 2.1 time: 0.183200 Aug 29 05:07:28.710854 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1929/3798] 10.222.0.20 () {58 vars in 1323 bytes} [Mon Aug 29 05:07:28 2022] GET /compute/v2.1/os-quota-sets/f0817edd1b2547e996b29cb997ae6e55?user_id=4ef57392758e4e6abf532b2e7d82c585 => generated 371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:07:28.887244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:28.887967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:28.901548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:28.902257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:28.902857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:28.909491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:28.910186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:28.911128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:29.359564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:29.369036 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8bc5cc6-b4e6-4fb3-82ea-1fe28d3794d4 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1510 microversion: 2.1 time: 0.805767 Aug 29 05:07:29.376282 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1870/3799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:28 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1510 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:29.393682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:29.394615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:29.403432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:29.404146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:29.404951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:29.406185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:29.406961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:29.408147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:29.526953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:29.541297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:29.543694 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9fd131be-f0ba-4a11-ba46-25ec3a67fcd3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.660298 Aug 29 05:07:29.546893 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1930/3800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:28 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:29.553342 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-088e3af4-3089-449c-a98e-c00b617d43d3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1276 microversion: 2.1 time: 0.174939 Aug 29 05:07:29.554308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:29.555099 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1871/3801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:29 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:29.555572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:29.583487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:29.586985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:29.593647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:29.595441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:29.597373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:29.599003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:29.802418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a96819d0-8fe9-44c0-9e09-1d9953941688 req-96011044-e5c3-4529-8d99-e38c179788d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6586f01-a1dc-4e32-907a-f1f03a4fd86a", "name": "network-vif-deleted", "tag": "c4e53ec2-94f2-448e-b3f2-26d4aacd2e70"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:29.814205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a96819d0-8fe9-44c0-9e09-1d9953941688 req-96011044-e5c3-4529-8d99-e38c179788d0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:29.815168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a96819d0-8fe9-44c0-9e09-1d9953941688 req-96011044-e5c3-4529-8d99-e38c179788d0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:29.815715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a96819d0-8fe9-44c0-9e09-1d9953941688 req-96011044-e5c3-4529-8d99-e38c179788d0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:29.848234 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a96819d0-8fe9-44c0-9e09-1d9953941688 req-96011044-e5c3-4529-8d99-e38c179788d0 service nova] Creating event network-vif-deleted:c4e53ec2-94f2-448e-b3f2-26d4aacd2e70 for instance b6586f01-a1dc-4e32-907a-f1f03a4fd86a on n-h1-854119-9 Aug 29 05:07:29.862367 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a96819d0-8fe9-44c0-9e09-1d9953941688 req-96011044-e5c3-4529-8d99-e38c179788d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063853 Aug 29 05:07:29.870577 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1872/3802] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:07:30.109972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d14b0f68-845f-458a-b984-d38b2de89cb6 req-d578c726-30c7-40fb-80f0-dd0cc83a9bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a557400d-1409-4dff-b0ae-8b54fd922250", "name": "network-vif-plugged", "status": "completed", "tag": "dad129e8-e3ea-4e47-929c-0e837a029c60"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:30.121972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d14b0f68-845f-458a-b984-d38b2de89cb6 req-d578c726-30c7-40fb-80f0-dd0cc83a9bb6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:30.122631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d14b0f68-845f-458a-b984-d38b2de89cb6 req-d578c726-30c7-40fb-80f0-dd0cc83a9bb6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:30.123209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d14b0f68-845f-458a-b984-d38b2de89cb6 req-d578c726-30c7-40fb-80f0-dd0cc83a9bb6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:30.139389 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d14b0f68-845f-458a-b984-d38b2de89cb6 req-d578c726-30c7-40fb-80f0-dd0cc83a9bb6 service nova] Creating event network-vif-plugged:dad129e8-e3ea-4e47-929c-0e837a029c60 for instance a557400d-1409-4dff-b0ae-8b54fd922250 on n-h1-854119-9 Aug 29 05:07:30.145574 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d14b0f68-845f-458a-b984-d38b2de89cb6 req-d578c726-30c7-40fb-80f0-dd0cc83a9bb6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041120 Aug 29 05:07:30.146727 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1873/3803] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:07:30.328784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:30.340309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:30.341999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:30.343825 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3df91e1-b6f5-45b1-9a5f-97f5265cc5bb tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1363 microversion: 2.47 time: 0.795400 Aug 29 05:07:30.356140 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1931/3804] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:29 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1363 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:30.397116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:30.397951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:30.404985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:30.405974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:30.405974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:30.406641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:30.407099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:30.407792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:30.459935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:30.460568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:30.461099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:30.461723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lazy-loading 'fault' on Instance uuid b6586f01-a1dc-4e32-907a-f1f03a4fd86a {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:07:30.566589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:30.567811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:30.588406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:30.589076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:30.589694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:30.590571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:30.591166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:30.591734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:30.800614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:30.810017 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0e84ca89-c62e-406c-86fe-a04d7d1c5171 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1306 microversion: 2.1 time: 0.417219 Aug 29 05:07:30.810803 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1874/3805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:30 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1306 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:30.815945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:30.816963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:30.844437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:30.845299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:30.846016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:30.846908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:30.847368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:30.847764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:31.158321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:31.167512 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-91b3432e-27aa-4d87-8650-05089e64a3e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1276 microversion: 2.1 time: 0.355430 Aug 29 05:07:31.172177 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1875/3806] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:30 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:31.348220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:31.359300 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c111093e-858d-4f72-aa35-ca1ac898a368 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.796507 Aug 29 05:07:31.360348 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1932/3807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:30 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:31.369841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:31.371051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:31.389299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:31.394136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:31.397121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:31.397993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:31.400560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:31.401117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:31.549831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:31.569485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:31.571609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:31.573646 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71bfe1db-f5d4-4978-b764-a2a37c216eb7 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1363 microversion: 2.47 time: 0.210127 Aug 29 05:07:31.574757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1876/3808] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:31 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:07:31.835443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:31.836230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:31.877192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:31.878059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:31.878642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:31.879529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:31.880130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:31.881724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:31.968061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:31.973215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:31.974070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:31.974863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lazy-loading 'fault' on Instance uuid b6586f01-a1dc-4e32-907a-f1f03a4fd86a {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:07:32.069391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:32.078594 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-532f7c35-4ff3-418e-ba48-4f954ce83f14 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1306 microversion: 2.1 time: 0.250124 Aug 29 05:07:32.079467 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1933/3809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:31 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1306 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:32.273177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:32.273864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:32.291935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:32.295198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:32.295870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:32.298300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:32.302200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:32.302920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:32.316006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:32.383770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:32.385018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:32.401216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:32.401216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:32.401216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:32.401216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:32.409749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:32.409749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:32.635394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:32.657726 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-273fdcfb-73d8-4c80-8d70-bcd69fc70fdf tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 0.378802 Aug 29 05:07:32.658411 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1877/3810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:32 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:32.686243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:32.686903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:32.701969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:32.703633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:32.704079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:32.704821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:32.705289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:32.707857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:32.795424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:32.811449 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9d94ca9d-fd0d-4dcd-bf74-a935bdaf34ce tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.432076 Aug 29 05:07:32.812463 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1934/3811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:32 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:32.849438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:32.867329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:32.869287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:32.870808 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a306d365-119a-4152-99d3-c497274683b1 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1363 microversion: 2.47 time: 0.192822 Aug 29 05:07:32.884733 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1878/3812] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:32 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:33.100439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:33.101781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:33.104292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:33.109806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:33.110556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:33.111050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:33.112150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:33.113151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:33.113815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:33.156352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:33.157131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:33.157756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:33.158861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lazy-loading 'fault' on Instance uuid b6586f01-a1dc-4e32-907a-f1f03a4fd86a {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:07:33.243694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2403ad736f4c70a77705af5ab3e97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4134acc38154fcd83d1c50443c42888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:33.257210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37f7524f-1d1f-48ae-ad87-58ab82a7302b tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 200 len: 1306 microversion: 2.1 time: 0.160823 Aug 29 05:07:33.258027 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1935/3813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:33 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:33.678532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:33.679155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:33.696451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:33.698069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:33.703871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:33.715044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:33.715711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:33.716305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:33.839685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:33.841968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:33.869837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:33.873574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:33.880626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:33.881427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:33.881908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:33.882341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:34.466923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:34.482799 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ea25eddc-8b82-4be5-9a33-b1d09efd72b4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 0.800613 Aug 29 05:07:34.483487 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1879/3814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:33 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:34.501187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:34.501800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:34.520100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:34.520617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:34.521057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:34.521779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:34.522229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:34.522659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:34.604063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:34.604831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:34.605404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:34.605999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lazy-loading 'fault' on Instance uuid e8ff13b1-32d8-4802-bbfe-f0bbd9089001 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:07:34.658682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:34.679438 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-273eeb95-17f8-435b-95a9-cb0511a45cfe tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.848135 Aug 29 05:07:34.685986 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1936/3815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:33 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:34.697901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:34.699559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] [instance: b6586f01-a1dc-4e32-907a-f1f03a4fd86a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:34.722604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:34.724043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:34.725627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:34.727588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:34.728597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:34.731669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:34.762825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:34.768189 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] HTTP exception thrown: Instance b6586f01-a1dc-4e32-907a-f1f03a4fd86a could not be found. Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Request method failure captured: Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a HTTP/1.1 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDElnJpibtr2PleXEpqugdYZS453sIuAAxxuS5Hl5w2uboN6wdd0lx7_TAweJD9BGF9etrsIEb634FVEiCMoTqy0jeDShLo3g28C6fqb-cb4_YzxUxQb7x4vfHhLw47xIqP4ObbdPNjzD1dUUKNPU8KUrKzk7wirjpb8uq6_BPm6a318 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: c4134acc38154fcd83d1c50443c42888 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerPasswordTestJSON-2111353484 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4134acc38154fcd83d1c50443c42888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4134acc38154fcd83d1c50443c42888"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4134acc38154fcd83d1c50443c42888", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4134acc38154fcd83d1c50443c42888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerPasswordTestJSON-2111353484 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: c4134acc38154fcd83d1c50443c42888 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2111353484 Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerPasswordTestJSON-2111353484-project Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: fe2403ad736f4c70a77705af5ab3e97b Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerPasswordTestJSON-2111353484-project Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance b6586f01-a1dc-4e32-907a-f1f03a4fd86a could not be found. Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'b6586f01-a1dc-4e32-907a-f1f03a4fd86a'} Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6586f01-a1dc-4e32-907a-f1f03a4fd86a could not be found. Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6586f01-a1dc-4e32-907a-f1f03a4fd86a could not be found. Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:34.771601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:34.774862 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:34.774862 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:34.774862 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:34.774862 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:07:34.774862 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:07:34.774862 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6586f01-a1dc-4e32-907a-f1f03a4fd86a could not be found. Aug 29 05:07:34.774862 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:34.775211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:34.775211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:34.775400 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-785add1e-3e2d-45a2-912b-e16d23e88c02 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 200 len: 1368 microversion: 2.47 time: 0.278210 Aug 29 05:07:34.779037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] Returning 404 to user: Instance b6586f01-a1dc-4e32-907a-f1f03a4fd86a could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:07:34.781731 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea99f9c0-7e24-45d1-a4d5-8d5bc8f2d109 tempest-ServerPasswordTestJSON-2111353484 tempest-ServerPasswordTestJSON-2111353484-project] 10.222.0.20 "GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a" status: 404 len: 111 microversion: 2.1 time: 0.092652 Aug 29 05:07:34.785770 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1937/3816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:34 2022] GET /compute/v2.1/servers/b6586f01-a1dc-4e32-907a-f1f03a4fd86a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:07:34.806262 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1880/3817] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:34 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 1368 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:35.504442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:35.505799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:35.509633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:35.525115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:35.525961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:35.528701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:35.529624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:35.530261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:35.531584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:35.711703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:35.712581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:35.729067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:35.733153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:35.733986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:35.734850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:35.735588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:35.736108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:36.809317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:36.830892 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee47ca19-6ae8-42d4-a885-a985dd2db1d2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 1.331554 Aug 29 05:07:36.832195 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1938/3818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:35 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:36.837222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:36.838137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: e8ff13b1-32d8-4802-bbfe-f0bbd9089001] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:36.848329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:36.855773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:36.856412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:36.860394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:36.860994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:36.861549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:36.883861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:36.897503 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e01eac13-151b-45f2-bec9-cc4d47a45c61 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 1.190640 Aug 29 05:07:36.898758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1881/3819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:35 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:36.907882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b3974d8c-f556-43b0-8470-37077621f72f req-bb29a3ef-72e4-4a1f-9c3b-fc5aea81d2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69b5de3-eef5-4ed2-a45c-155cb560423b", "name": "network-vif-plugged", "status": "completed", "tag": "21ed04b2-af73-45fc-82a5-01ea8dcf9bd3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:36.909111 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] HTTP exception thrown: Instance e8ff13b1-32d8-4802-bbfe-f0bbd9089001 could not be found. Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Request method failure captured: Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 HTTP/1.1 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDElSRWfFY9DX5P0qP18wqMINPTNxVyV8LVKU8enWW8D-jOuorgaMsF9BRVX66JmJejNcEjm1t__1Ujn415piad0MC7UCNxAMA7RHBLMJ88z2F0s1yoGrrkhk4TtBMuzxAIFqpma8UGpF0TQLX-ab_fzB8vf4nN8GbL3rYkKIJDKZ_6U Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: d0023b5fb92b4f1cb5d0e1f11a55ad00 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerShowV247Test-1515992941 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0023b5fb92b4f1cb5d0e1f11a55ad00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0023b5fb92b4f1cb5d0e1f11a55ad00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0023b5fb92b4f1cb5d0e1f11a55ad00", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0023b5fb92b4f1cb5d0e1f11a55ad00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerShowV247Test-1515992941 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: d0023b5fb92b4f1cb5d0e1f11a55ad00 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerShowV247Test-1515992941 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerShowV247Test-1515992941-project Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 9352b59c054f429ab0749938ac76b2c7 Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerShowV247Test-1515992941-project Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance e8ff13b1-32d8-4802-bbfe-f0bbd9089001 could not be found. Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'e8ff13b1-32d8-4802-bbfe-f0bbd9089001'} Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ff13b1-32d8-4802-bbfe-f0bbd9089001 could not be found. Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ff13b1-32d8-4802-bbfe-f0bbd9089001 could not be found. Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:36.916560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:36.919666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:36.919666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:36.919666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:36.919666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:07:36.919666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:07:36.919666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ff13b1-32d8-4802-bbfe-f0bbd9089001 could not be found. Aug 29 05:07:36.919666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:07:36.927804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Returning 404 to user: Instance e8ff13b1-32d8-4802-bbfe-f0bbd9089001 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:07:36.933479 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-90e07cbf-d071-4e4c-ac37-6a6e93471bf4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001" status: 404 len: 111 microversion: 2.47 time: 0.100051 Aug 29 05:07:36.937766 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1939/3820] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:36 2022] GET /compute/v2.1/servers/e8ff13b1-32d8-4802-bbfe-f0bbd9089001 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:07:36.952157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:36.956904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b3974d8c-f556-43b0-8470-37077621f72f req-bb29a3ef-72e4-4a1f-9c3b-fc5aea81d2f0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:36.957836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: 9efad459-7955-4a9c-bae2-7ede311b15bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:36.961550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b3974d8c-f556-43b0-8470-37077621f72f req-bb29a3ef-72e4-4a1f-9c3b-fc5aea81d2f0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:36.962286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b3974d8c-f556-43b0-8470-37077621f72f req-bb29a3ef-72e4-4a1f-9c3b-fc5aea81d2f0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:36.970286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:36.973716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:36.976178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:36.985204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:36.987854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:36.988568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:36.998951 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b3974d8c-f556-43b0-8470-37077621f72f req-bb29a3ef-72e4-4a1f-9c3b-fc5aea81d2f0 service nova] Creating event network-vif-plugged:21ed04b2-af73-45fc-82a5-01ea8dcf9bd3 for instance b69b5de3-eef5-4ed2-a45c-155cb560423b on n-h1-854119-9 Aug 29 05:07:37.010091 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b3974d8c-f556-43b0-8470-37077621f72f req-bb29a3ef-72e4-4a1f-9c3b-fc5aea81d2f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109902 Aug 29 05:07:37.017841 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1882/3821] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:37.034807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: 9efad459-7955-4a9c-bae2-7ede311b15bd] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:07:37.136676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:37.195290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aec832a5-04e7-4048-bc0c-aa24c51bad52 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd" status: 204 len: 0 microversion: 2.47 time: 0.256136 Aug 29 05:07:37.202068 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1940/3822] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:07:36 2022] DELETE /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:07:37.213218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:37.214120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: 9efad459-7955-4a9c-bae2-7ede311b15bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:37.223021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:37.227176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:37.232389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:37.233180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:37.234209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:37.234875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:37.239769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:37.443252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b7037d80-4bb0-4dde-8fee-dbd851cf6e6e req-bc032547-2a22-4336-b1f6-4f498dd3288b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae7b907-079c-4ae2-806b-1cc81f663e39", "tag": "b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:37.462426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b7037d80-4bb0-4dde-8fee-dbd851cf6e6e req-bc032547-2a22-4336-b1f6-4f498dd3288b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:37.463256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b7037d80-4bb0-4dde-8fee-dbd851cf6e6e req-bc032547-2a22-4336-b1f6-4f498dd3288b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:37.463921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b7037d80-4bb0-4dde-8fee-dbd851cf6e6e req-bc032547-2a22-4336-b1f6-4f498dd3288b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:37.483878 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b7037d80-4bb0-4dde-8fee-dbd851cf6e6e req-bc032547-2a22-4336-b1f6-4f498dd3288b service nova] Creating event network-changed:b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9 for instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 on n-h1-854119-9 Aug 29 05:07:37.498953 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b7037d80-4bb0-4dde-8fee-dbd851cf6e6e req-bc032547-2a22-4336-b1f6-4f498dd3288b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060072 Aug 29 05:07:37.499984 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1941/3823] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:07:37.546261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:37.566129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:37.567911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:37.569372 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c0e36ba2-c9d8-4542-9d11-c351cb3c60a2 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd" status: 200 len: 1362 microversion: 2.47 time: 0.362634 Aug 29 05:07:37.570145 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1883/3824] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:37 2022] GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:07:37.860567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:37.861288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:37.876547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:37.877051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:37.877498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:37.878227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:37.878683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:37.879110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:37.927262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:37.927897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:37.971594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:37.972024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:37.985518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:37.988829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:37.991089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:37.996337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:38.440208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:38.456839 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28861f2e-bf2e-427a-b6c1-3e7c1f4556af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 0.601478 Aug 29 05:07:38.457743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:38.462796 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1942/3825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:37 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:38.548834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:38.563117 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c5d9240-7184-47a1-9312-f2535777e1e5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.638658 Aug 29 05:07:38.566289 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1884/3826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:37 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:38.606005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:38.606564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: 9efad459-7955-4a9c-bae2-7ede311b15bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:38.620602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:38.620978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:38.621757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:38.622649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:38.623241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:38.623922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:38.690416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=12 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:38.830734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:38.845302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:38.848101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:38.850100 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e1a04b5-7b11-4397-a6a9-300812fee54b tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd" status: 200 len: 1362 microversion: 2.47 time: 0.253121 Aug 29 05:07:38.869425 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1943/3827] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:38 2022] GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:39.486758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:39.487379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:39.501169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:39.504816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:39.505446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:39.506465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:39.507064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:39.507621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:39.588325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:39.589025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:39.596148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:39.596644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:39.597081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:39.610064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:39.610566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:39.611006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:40.196535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:40.213936 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-04c02f7f-ba49-41ec-8a53-82738fe0f0b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1318 microversion: 2.1 time: 0.627726 Aug 29 05:07:40.215876 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1944/3828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:39 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:40.228739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:40.231272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: 9efad459-7955-4a9c-bae2-7ede311b15bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:40.249890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:40.251370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:40.253332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:40.255583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:40.257346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:40.258580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:40.297762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:40.316429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-10c1b7d9-62c4-4ffe-86f0-2762b00d0989 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 0.833851 Aug 29 05:07:40.320176 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1885/3829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:39 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:40.411202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:40.418405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:40.419197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:40.419900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lazy-loading 'fault' on Instance uuid 9efad459-7955-4a9c-bae2-7ede311b15bd {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:07:40.804333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:40.816723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:40.818348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9352b59c054f429ab0749938ac76b2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0023b5fb92b4f1cb5d0e1f11a55ad00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:40.820640 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a3b734aa-9a85-443d-a4ad-cee738fac1e3 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd" status: 200 len: 1367 microversion: 2.47 time: 0.601202 Aug 29 05:07:40.832876 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1945/3830] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:40 2022] GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd => generated 1367 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:41.236037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:41.236686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:41.246039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:41.246538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:41.246973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:41.247684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:41.248160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:41.248591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:41.340908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:41.341546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:41.365076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:41.365582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:41.366024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:41.374144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:41.374877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:41.375469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:41.872644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:41.884491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ff27c47-e06b-4649-b077-7c32d7f0bf65 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1468 microversion: 2.1 time: 0.652159 Aug 29 05:07:41.885783 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1886/3831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:41 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1468 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:41.942580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:41.943200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] [instance: 9efad459-7955-4a9c-bae2-7ede311b15bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:41.972764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:41.973291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:41.973738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:41.974480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:41.974939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:41.975364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:41.987947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:42.003194 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ce5279d5-85f6-472c-a3a3-4800971c8ebc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 0.666161 Aug 29 05:07:42.009298 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1946/3832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:41 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:42.018394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:42.023295 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] HTTP exception thrown: Instance 9efad459-7955-4a9c-bae2-7ede311b15bd could not be found. Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Request method failure captured: Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd HTTP/1.1 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDElSRWfFY9DX5P0qP18wqMINPTNxVyV8LVKU8enWW8D-jOuorgaMsF9BRVX66JmJejNcEjm1t__1Ujn415piad0MC7UCNxAMA7RHBLMJ88z2F0s1yoGrrkhk4TtBMuzxAIFqpma8UGpF0TQLX-ab_fzB8vf4nN8GbL3rYkKIJDKZ_6U Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: d0023b5fb92b4f1cb5d0e1f11a55ad00 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerShowV247Test-1515992941 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0023b5fb92b4f1cb5d0e1f11a55ad00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0023b5fb92b4f1cb5d0e1f11a55ad00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0023b5fb92b4f1cb5d0e1f11a55ad00", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0023b5fb92b4f1cb5d0e1f11a55ad00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerShowV247Test-1515992941 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: d0023b5fb92b4f1cb5d0e1f11a55ad00 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerShowV247Test-1515992941 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerShowV247Test-1515992941-project Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 9352b59c054f429ab0749938ac76b2c7 Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerShowV247Test-1515992941-project Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 9efad459-7955-4a9c-bae2-7ede311b15bd could not be found. Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '9efad459-7955-4a9c-bae2-7ede311b15bd'} Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efad459-7955-4a9c-bae2-7ede311b15bd could not be found. Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efad459-7955-4a9c-bae2-7ede311b15bd could not be found. Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:07:42.025208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:42.028570 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:07:42.028570 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:07:42.028570 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:07:42.028570 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:07:42.028570 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:07:42.028570 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efad459-7955-4a9c-bae2-7ede311b15bd could not be found. Aug 29 05:07:42.028570 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:07:42.028927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:42.030425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] Returning 404 to user: Instance 9efad459-7955-4a9c-bae2-7ede311b15bd could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:07:42.031466 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-51abd797-8db3-4de3-8b2e-52dcfd2b47e4 tempest-ServerShowV247Test-1515992941 tempest-ServerShowV247Test-1515992941-project] 10.222.0.20 "GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd" status: 404 len: 111 microversion: 2.47 time: 0.126428 Aug 29 05:07:42.032612 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1887/3833] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:41 2022] GET /compute/v2.1/servers/9efad459-7955-4a9c-bae2-7ede311b15bd => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:07:42.061468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:42.062008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:42.062446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:42.063162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:42.063614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:42.064038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:42.912567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:42.926422 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2040ad1c-aa69-4377-88a7-e5d6f6b4b846 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250" status: 200 len: 1466 microversion: 2.1 time: 0.915121 Aug 29 05:07:42.940633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1947/3834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:42 2022] GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 => generated 1466 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:42.951044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2fabdbd5-e016-458e-8b6b-1bb8a375e76e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-280653409"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:42.953906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2fabdbd5-e016-458e-8b6b-1bb8a375e76e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:42.971175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fabdbd5-e016-458e-8b6b-1bb8a375e76e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:42.971422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fabdbd5-e016-458e-8b6b-1bb8a375e76e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:42.971861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fabdbd5-e016-458e-8b6b-1bb8a375e76e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:42.972607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fabdbd5-e016-458e-8b6b-1bb8a375e76e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:42.973379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fabdbd5-e016-458e-8b6b-1bb8a375e76e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:42.973493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fabdbd5-e016-458e-8b6b-1bb8a375e76e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:43.029215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:43.030280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:43.062916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:43.063704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:43.064349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:43.065260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:43.066604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:43.069326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:43.698217 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2fabdbd5-e016-458e-8b6b-1bb8a375e76e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "POST /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250/action" status: 202 len: 0 microversion: 2.1 time: 0.750974 Aug 29 05:07:43.717056 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1888/3835] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:07:42 2022] POST /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 05:07:43.739280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6ffeb786-cfcb-4b7e-b497-66606167e4cd tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9c7d670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:43.832259 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6ffeb786-cfcb-4b7e-b497-66606167e4cd tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.113370 Aug 29 05:07:43.833272 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1889/3836] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:43 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:44.395659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff69137c-18f0-445c-8b05-d46e0fdccb4f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'create', calling method: .version_select at 0x7f1ab9c4b280>, body: {"keypair": {"name": "tempest-keypair-2143162548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq6Y3s1aR74hZgIpu9pTUvf1MVmRGqiWeYCPXIAiowEOr9d1Nm5DrK7S//AGOyqWNaesNmyaEpU6uCw5XMO8yuHErchzK9HILtGZSzYkIp/Qztif7tfJHFYn4vSmS+qaA=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:44.436148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ff69137c-18f0-445c-8b05-d46e0fdccb4f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Getting quotas for project 7f948ec6a5b043ed8ea6bac997a4c2c4. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:07:44.451228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ff69137c-18f0-445c-8b05-d46e0fdccb4f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Getting quotas for user e283b8db0cfc47acac0ca482a69005d6 and project 7f948ec6a5b043ed8ea6bac997a4c2c4. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:07:44.477950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:44.492682 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-72dc83cb-483a-408d-9577-5fff840f6d80 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 1.467153 Aug 29 05:07:44.494643 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1948/3837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:43 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:44.522636 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff69137c-18f0-445c-8b05-d46e0fdccb4f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.430251 Aug 29 05:07:44.524325 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1890/3838] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 05:07:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 432 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 05:07:44.863481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-323bf621-cc3c-4ef6-b74b-958d8d1547cf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8ac71f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:44.948658 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-323bf621-cc3c-4ef6-b74b-958d8d1547cf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.104154 Aug 29 05:07:44.951737 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1949/3839] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:44 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:45.519431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:45.520188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:45.531043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:45.541167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:45.542273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:45.543484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:45.544381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:45.544998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:45.965791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-326f3026-27f2-48cb-b01b-c2f45474fde7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab895e940>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:46.044052 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-326f3026-27f2-48cb-b01b-c2f45474fde7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.079881 Aug 29 05:07:46.045117 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1950/3840] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:45 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:46.175408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:46.189399 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2d7540df-5acb-46c3-87f5-b2ff4bfc2693 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 0.673854 Aug 29 05:07:46.190845 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1891/3841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:45 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:46.369269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-566349688", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": "none"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:46.512049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:07:46.512528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:07:46.513003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:07:46.513408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:07:46.513813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:07:46.537471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:46.537888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:46.538327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:46.539094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:46.539712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:46.539966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:46.586055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Getting quotas for project f0076c5bb1984fe6baec0d410a89b9f4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:07:46.601258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Getting quotas for user 30ad1c63259f4e64bce5f040c988a848 and project f0076c5bb1984fe6baec0d410a89b9f4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:07:46.649999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:07:46.652373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:07:46.789634 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a062ba7-84a6-41b4-bedb-64cb8e3e310d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.723350 Aug 29 05:07:46.795808 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1951/3842] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 05:07:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 05:07:46.804363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-21e9adfa-0d5f-4d2c-ac00-6d298c5c095c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:46.804993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-21e9adfa-0d5f-4d2c-ac00-6d298c5c095c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:47.050280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21e9adfa-0d5f-4d2c-ac00-6d298c5c095c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:47.059552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1506f8cf-9511-4dc9-9af0-2c9c93d6fb04 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab89684c0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:47.078027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21e9adfa-0d5f-4d2c-ac00-6d298c5c095c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:47.079581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21e9adfa-0d5f-4d2c-ac00-6d298c5c095c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:47.107257 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-21e9adfa-0d5f-4d2c-ac00-6d298c5c095c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1277 microversion: 2.57 time: 0.306869 Aug 29 05:07:47.109357 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1892/3843] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:46 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:47.126104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ff4c7b37-136e-4ee0-b588-33f28cdcd3e4 req-31f30962-f8b9-4125-8645-88a267910e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae7b907-079c-4ae2-806b-1cc81f663e39", "name": "network-vif-plugged", "status": "completed", "tag": "b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:47.162560 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1506f8cf-9511-4dc9-9af0-2c9c93d6fb04 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.107311 Aug 29 05:07:47.163536 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1952/3844] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:47 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:47.175564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ff4c7b37-136e-4ee0-b588-33f28cdcd3e4 req-31f30962-f8b9-4125-8645-88a267910e11 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:47.176287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ff4c7b37-136e-4ee0-b588-33f28cdcd3e4 req-31f30962-f8b9-4125-8645-88a267910e11 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:47.180346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ff4c7b37-136e-4ee0-b588-33f28cdcd3e4 req-31f30962-f8b9-4125-8645-88a267910e11 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:47.209496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:47.210265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:47.222482 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ff4c7b37-136e-4ee0-b588-33f28cdcd3e4 req-31f30962-f8b9-4125-8645-88a267910e11 service nova] Creating event network-vif-plugged:b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9 for instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 on n-h1-854119-9 Aug 29 05:07:47.224404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:47.225668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:47.226113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:47.229322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:47.229817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:47.235153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:47.236100 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ff4c7b37-136e-4ee0-b588-33f28cdcd3e4 req-31f30962-f8b9-4125-8645-88a267910e11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124027 Aug 29 05:07:47.239128 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1893/3845] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:47.847125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:47.856500 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-909381d2-ca39-413f-975b-2313cc88ab26 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 0.650916 Aug 29 05:07:47.881352 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1953/3846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:47 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:48.154491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:48.159869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:48.178100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0875322-a866-448d-b398-957f44fa4dd7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab821d280>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:48.185076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:48.187327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:48.189019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:48.198876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:48.199804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:48.201080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:48.283234 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0875322-a866-448d-b398-957f44fa4dd7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.109340 Aug 29 05:07:48.292242 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1954/3847] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:48 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:48.391429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:48.408328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:48.417972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:48.419190 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3e30ff62-3762-4c86-a860-102bc122101a tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1281 microversion: 2.57 time: 0.282124 Aug 29 05:07:48.419762 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1894/3848] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:48 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:48.815564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-103772399", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cf872f9-411d-4b12-a18e-aa8246afb4db"}], "security_groups": [{"name": "tempest-securitygroup--1274135271"}], "key_name": "tempest-keypair-2143162548", "user_data": "}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:48.884497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:48.885345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:48.903456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:48.907747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:48.909762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:48.914234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:48.914720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:48.918000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:49.072940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] validate_networks() for [('5cf872f9-411d-4b12-a18e-aa8246afb4db', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:07:49.754701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:49.772550 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15f6625b-570c-4d72-b962-ffa2036a3514 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1318 microversion: 2.1 time: 0.891608 Aug 29 05:07:49.773180 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1895/3849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:48 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1318 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:49.788954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-79b306d3-92a6-400e-a149-108bda0b26ad tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9bac430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:49.893879 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-79b306d3-92a6-400e-a149-108bda0b26ad tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.113001 Aug 29 05:07:49.895754 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1896/3850] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:49 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:49.913451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:49.922336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:49.971015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:49.972155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:49.975081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:49.977688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:49.978191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:49.978634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:50.291018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:50.313036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:50.332798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:50.340778 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0c6ff5fe-aacc-4a98-a769-19fdcb8de67e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1329 microversion: 2.57 time: 0.442760 Aug 29 05:07:50.342555 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1897/3851] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:49 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1329 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:50.603461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:07:50.603869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:07:50.605214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:07:50.605214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:07:50.605459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:07:50.622428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:50.624567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:50.625404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:50.627933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:50.628438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:50.628874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:50.683194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Getting quotas for project 7f948ec6a5b043ed8ea6bac997a4c2c4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:07:50.696483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Getting quotas for user e283b8db0cfc47acac0ca482a69005d6 and project 7f948ec6a5b043ed8ea6bac997a4c2c4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:07:50.739287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:07:50.744695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:07:50.795847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:50.797676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:50.805621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:50.811614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:50.812452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:50.825060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:50.826216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:50.828729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:50.845127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:50.945499 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08c3e30b-b6c4-4e7f-9062-bcd697c0f2f0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.135654 Aug 29 05:07:50.956753 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1955/3852] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 05:07:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 05:07:50.961981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9d780ddd-9481-4b0d-9fdc-9ce9bef5f62a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab895e040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:51.054798 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9d780ddd-9481-4b0d-9fdc-9ce9bef5f62a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.102282 Aug 29 05:07:51.055898 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1956/3853] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:50 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:51.066287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b6b4e51-9054-4401-848a-002884dc4c39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:51.066916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1b6b4e51-9054-4401-848a-002884dc4c39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:51.281316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b6b4e51-9054-4401-848a-002884dc4c39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:51.301329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b6b4e51-9054-4401-848a-002884dc4c39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:51.302863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b6b4e51-9054-4401-848a-002884dc4c39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:51.313681 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b6b4e51-9054-4401-848a-002884dc4c39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1281 microversion: 2.20 time: 0.256389 Aug 29 05:07:51.314296 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1957/3854] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:51 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1281 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:51.374915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:51.375509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:51.387567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:51.388068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:51.388533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:51.399225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:51.399720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:51.401903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:51.407939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:51.414153 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-35f9f27a-e9a8-48f8-9cc5-1ab539fab703 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1507 microversion: 2.1 time: 0.622299 Aug 29 05:07:51.419473 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1898/3855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:50 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:51.449047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:51.449926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:51.466003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:51.466755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:51.468747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:51.470193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:51.472781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:51.473818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:51.593153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:51.614963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:51.624467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:51.628964 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43780272-dcd6-4e6d-b448-b71f8a8d261d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1335 microversion: 2.57 time: 0.258403 Aug 29 05:07:51.633262 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1958/3856] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:51 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1335 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:07:51.854252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:51.865882 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b748e6c9-1f23-436d-a1c2-eac03528d5fc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1507 microversion: 2.1 time: 0.421005 Aug 29 05:07:51.866526 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1899/3857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:51 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:07:51.889103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98837706-b968-4ec9-8fbd-5a93a0a8c5ce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:51.892089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98837706-b968-4ec9-8fbd-5a93a0a8c5ce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:51.911047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98837706-b968-4ec9-8fbd-5a93a0a8c5ce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:51.918270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98837706-b968-4ec9-8fbd-5a93a0a8c5ce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:51.922803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98837706-b968-4ec9-8fbd-5a93a0a8c5ce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:51.927654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98837706-b968-4ec9-8fbd-5a93a0a8c5ce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:51.932570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98837706-b968-4ec9-8fbd-5a93a0a8c5ce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:51.939434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98837706-b968-4ec9-8fbd-5a93a0a8c5ce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:52.070364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55aff2db-a555-4336-8d2f-c0b94fca0c06 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9bac430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:52.137586 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-55aff2db-a555-4336-8d2f-c0b94fca0c06 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.071275 Aug 29 05:07:52.140636 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1900/3858] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:52 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:52.145159 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98837706-b968-4ec9-8fbd-5a93a0a8c5ce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "PUT /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1079 microversion: 2.1 time: 0.260281 Aug 29 05:07:52.152497 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1959/3859] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:07:51 2022] PUT /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1079 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:52.169302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:52.176046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:52.204053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:52.204831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:52.205415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:52.206291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:52.206889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:52.207462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:52.343667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:52.347214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:52.370916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:52.371424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:52.380405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:52.382386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:52.388788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:52.389586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:52.668697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:52.698378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:52.711818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:52.719512 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cdd8041a-4cb1-428f-8072-143039d168a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1285 microversion: 2.20 time: 0.377676 Aug 29 05:07:52.738872 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1960/3860] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:52 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1285 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:07:52.761249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d33aadf2-eeb8-41cb-b37d-c9291b499201 req-08094e91-4e15-44ab-b126-958c340cbdfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a557400d-1409-4dff-b0ae-8b54fd922250", "name": "network-vif-plugged", "status": "completed", "tag": "dad129e8-e3ea-4e47-929c-0e837a029c60"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:52.784533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:52.799528 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ba42f17-7185-4663-8624-1eb6786f2a95 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1505 microversion: 2.1 time: 0.631208 Aug 29 05:07:52.801846 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1901/3861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:52 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1505 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:52.808078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d33aadf2-eeb8-41cb-b37d-c9291b499201 req-08094e91-4e15-44ab-b126-958c340cbdfe service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:52.811050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d33aadf2-eeb8-41cb-b37d-c9291b499201 req-08094e91-4e15-44ab-b126-958c340cbdfe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:52.813486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d33aadf2-eeb8-41cb-b37d-c9291b499201 req-08094e91-4e15-44ab-b126-958c340cbdfe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:52.825017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:52.825868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:52.842491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:52.845209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:52.845655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:52.846386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:52.848009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:52.848496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:52.881865 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d33aadf2-eeb8-41cb-b37d-c9291b499201 req-08094e91-4e15-44ab-b126-958c340cbdfe service nova] Creating event network-vif-plugged:dad129e8-e3ea-4e47-929c-0e837a029c60 for instance a557400d-1409-4dff-b0ae-8b54fd922250 on n-h1-854119-9 Aug 29 05:07:52.907730 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d33aadf2-eeb8-41cb-b37d-c9291b499201 req-08094e91-4e15-44ab-b126-958c340cbdfe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167150 Aug 29 05:07:52.932200 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1961/3862] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:07:52.950980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:52.957524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:52.972622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:52.992302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:52.993654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:52.994578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:52.995198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:52.995815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:53.176996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:53.208876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:53.222118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:53.229389 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d879ecf-a3de-470d-b0ee-6c6a38bb2729 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1335 microversion: 2.57 time: 0.425517 Aug 29 05:07:53.230325 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1902/3863] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:52 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1335 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:53.236409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8635550-b81a-42e9-9681-1647c560cd85 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9c15ca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:53.303451 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8635550-b81a-42e9-9681-1647c560cd85 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.070657 Aug 29 05:07:53.304734 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1903/3864] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:53 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:53.730919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:53.746322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:53.747055 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3754d95e-6d60-4a1e-af1d-66de31183d00 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1505 microversion: 2.1 time: 0.809782 Aug 29 05:07:53.747889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:53.767248 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1962/3865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:52 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1505 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:53.769154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:53.771555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:53.776762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:53.777676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:53.781203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:53.788396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:53.793899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:53.794951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:53.803402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:53.804205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:53.804895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:53.805640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:53.808252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:53.809009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:54.081933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:07:54.087914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:07:54.093321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:07:54.094440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:07:54.095073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:07:54.210964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:54.283281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:54.306199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:54.310611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:54.315901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:54.321589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:54.324989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:54.326988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:54.435403 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43128778-98cc-4d50-8533-1389451f7536 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "POST /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39/action" status: 202 len: 1111 microversion: 2.1 time: 0.666676 Aug 29 05:07:54.445911 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1963/3866] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:07:53 2022] POST /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39/action => generated 1111 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 05:07:54.470226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:54.475671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:54.498449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:54.509441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:54.509922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:54.510813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:54.511279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:54.511707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:54.676100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:54.690229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:54.703736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:54.709551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:54.716973 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef5cc667-314b-413c-8748-c73d6f7d6c4f tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1335 microversion: 2.57 time: 0.256846 Aug 29 05:07:54.731944 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1964/3867] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:54 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1335 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:54.738918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:54.742114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:54.743303 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83579b04-6fb9-4c5f-8663-2d30de75c33c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1333 microversion: 2.20 time: 1.001148 Aug 29 05:07:54.743869 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1904/3868] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:53 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1333 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:54.750785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-714c86ea-325f-4fe8-83eb-bcd0809e77ef tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b47a60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:54.760080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:54.782378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:54.809145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:54.812049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:54.812790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:54.813402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:54.814835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:54.818359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:54.864911 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-714c86ea-325f-4fe8-83eb-bcd0809e77ef tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.129328 Aug 29 05:07:54.873179 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1965/3869] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:54 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:55.574712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:55.589344 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-294be7fa-b6ea-4fc8-bab3-f37222848d33 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.833067 Aug 29 05:07:55.608446 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1905/3870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:54 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:55.755010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:55.756274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:55.772005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:55.773276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:55.796857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:55.809601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:55.810446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:55.811730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:55.812457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:55.816101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:55.816880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:55.817816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:55.818478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:55.821780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:55.822546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:55.830700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:56.207592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:56.214397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:56.227217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:56.231351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:56.236464 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a0154d46-d07a-4c44-bd9c-dbcefdf6272d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1339 microversion: 2.20 time: 0.468868 Aug 29 05:07:56.237846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:56.245438 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1906/3871] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:55 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1339 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:56.248065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:56.256269 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a5eced3-a596-418d-9cd1-4ddf17d9d762 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1356 microversion: 2.57 time: 0.501799 Aug 29 05:07:56.259233 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1966/3872] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:55 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1356 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:56.265360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed446309-e61e-4f7e-bdae-680288f24b1f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9b95c10>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:56.284825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:56.294314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:56.319765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:56.320304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:56.320752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:56.328670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:56.329296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:56.333935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:56.373554 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed446309-e61e-4f7e-bdae-680288f24b1f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.120472 Aug 29 05:07:56.376365 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1907/3873] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:56 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:56.391786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2d34a8ff-a3bb-4638-9357-8b197f7adc3f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Action: 'create', calling method: .version_select at 0x7f1ab9a298b0>, body: {"keypair": {"name": "tempest-keypair-615073839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4lu7u3zYop0z7hEoabva/FcbEC74PAWMae5slMIPDErpXN25WfFmSZYqcZMD3ogVfx7WuWIxx0rbatlI9COb8w1l/2N3NTDL25RG5JMgExxZcHP1eScYKOYQ5k6pE+ww=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:07:56.462858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-2d34a8ff-a3bb-4638-9357-8b197f7adc3f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Getting quotas for project 297d3fab7a624f05a703f620d94bad83. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:07:56.476478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-2d34a8ff-a3bb-4638-9357-8b197f7adc3f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Getting quotas for user 657822daf4f044319d5d6440e501cde6 and project 297d3fab7a624f05a703f620d94bad83. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:07:56.503949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:07:56.514481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:07:56.514902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:07:56.515409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:07:56.515825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:07:56.516277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:07:56.548851 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2d34a8ff-a3bb-4638-9357-8b197f7adc3f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.169584 Aug 29 05:07:56.549842 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1908/3874] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 05:07:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 05:07:56.633740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:56.643589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:56.644286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:56.644949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:56.645829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:56.646435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:56.647181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:56.648188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:56.649493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:56.678788 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a88931b3-ee92-425b-9bc5-5398088fd43b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "POST /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6/action" status: 202 len: 1137 microversion: 2.57 time: 0.398295 Aug 29 05:07:56.683986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:56.686319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:56.692956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:56.694997 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1967/3875] 10.222.0.20 () {62 vars in 1320 bytes} [Mon Aug 29 05:07:56 2022] POST /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6/action => generated 1137 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 05:07:56.695569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:56.698188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:56.698657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:56.703296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:56.703915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:56.728682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:56.729187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:56.730025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:56.731277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:56.732024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:56.732624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:57.226245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:57.238758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:57.243363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:57.245612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-177b68e3-d128-4dce-9287-516e36a2ea09 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.546623 Aug 29 05:07:57.275160 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1968/3876] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:56 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:57.282991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:57.283578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:57.291548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:57.292382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:57.292968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:57.294042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:57.294648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:57.295221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:57.610789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:57.619410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:57.620902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:57.627095 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f6c67ce7-b5e7-4962-83d6-713750afe441 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1339 microversion: 2.20 time: 0.350206 Aug 29 05:07:57.627698 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1969/3877] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:57 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1339 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:57.654041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-480d56cb-3e77-44e0-89d9-03f87fe01e6d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8240c10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:57.726121 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-480d56cb-3e77-44e0-89d9-03f87fe01e6d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.084596 Aug 29 05:07:57.736608 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1970/3878] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:57 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:58.276382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:58.277708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:58.293180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:58.294030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:58.294792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:58.297007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:58.297661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:58.301931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:58.478397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:58.488035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:58.495794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:58.499879 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-446295b4-1626-47ef-9cd6-c8eb8bc9a68d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.227461 Aug 29 05:07:58.520551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1971/3879] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:58 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:07:58.653319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:58.654957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:58.668967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:58.669470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:58.669914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:58.670669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:58.671121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:58.671543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:58.790015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:58.790436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:58.800277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:58.812412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:58.813966 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5f295468-0c80-4ac6-ae66-4691442e53dc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1339 microversion: 2.20 time: 0.165786 Aug 29 05:07:58.814747 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1972/3880] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:58 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:58.816657 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-80dcd7be-876d-44a4-8b80-004be134ea61 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 2.192370 Aug 29 05:07:58.819892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-72f44683-fa53-4b0c-a1d0-78799f83f22a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab86a7f70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:58.829448 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1909/3881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:56 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:58.895488 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-72f44683-fa53-4b0c-a1d0-78799f83f22a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.079450 Aug 29 05:07:58.896538 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1973/3882] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:07:58 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:07:59.529669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:59.530742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:59.543341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:59.549702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:59.550439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:59.551368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:59.552046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:59.552638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:59.838553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:59.839236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:59.850746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:59.858206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:59.862574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:59.863195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:59.863954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:59.872706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:59.873316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:59.873809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:59.875332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:07:59.876573 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-939ce004-6131-452c-9300-962c4016c73c tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.351838 Aug 29 05:07:59.888704 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1910/3883] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:59 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:07:59.893875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:07:59.902748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:07:59.926134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:59.926854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:59.932841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:07:59.933854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:07:59.934484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:07:59.934924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:00.610880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:00.635104 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03891b9b-a258-4ec3-8aaf-d7a82ba81348 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.741004 Aug 29 05:08:00.635843 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1911/3884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:07:59 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:00.654603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6ae19cb4-1f3a-4ae1-9cf8-3d374eb4bc16 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab97dfe50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:00.660143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:00.789100 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6ae19cb4-1f3a-4ae1-9cf8-3d374eb4bc16 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.144231 Aug 29 05:08:00.790912 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1912/3885] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:00 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:00.837725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:00.865846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:00.869300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:00.870925 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6745ee5a-f230-4140-9943-8182af5cb269 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1407 microversion: 2.20 time: 1.036348 Aug 29 05:08:00.889613 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1974/3886] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:07:59 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1407 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:00.907144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:00.907765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:00.941973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:00.942504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:00.942976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:00.943692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:00.945507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:00.945507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:01.097990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:01.113837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:01.115197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:01.116465 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d6f9084-e0b5-4f81-8a22-f40e9a4b961d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.213598 Aug 29 05:08:01.117047 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1913/3887] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:00 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:01.656469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:01.657108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:01.662246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=14 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:01.669646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:01.683343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:01.692218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:01.693276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:01.694160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:01.696303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:01.804337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b653620-4ecd-4c0f-89d5-36428ca72f77 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab95c7280>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:01.913214 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0b653620-4ecd-4c0f-89d5-36428ca72f77 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.112707 Aug 29 05:08:01.915983 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1914/3888] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:01 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:01.941490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:01.942375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:01.961018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:01.964592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:01.965049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:01.965803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:01.966341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:01.966670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:02.549435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:02.554393 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cd32560b-693f-4e84-be4f-ffa9504d52e2 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.901642 Aug 29 05:08:02.555982 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1975/3889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:01 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:02.568048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3f2c6b90-3130-4e41-9c7e-70cc12c73b84 req-d6f787a4-564e-462b-a005-a7ce5747fe3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904b4106-5845-40b8-8f26-7eacf31b54b8", "tag": "fbfd57c9-7dce-4a91-982f-cfa91fd489ee"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:02.597673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3f2c6b90-3130-4e41-9c7e-70cc12c73b84 req-d6f787a4-564e-462b-a005-a7ce5747fe3e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:02.598163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3f2c6b90-3130-4e41-9c7e-70cc12c73b84 req-d6f787a4-564e-462b-a005-a7ce5747fe3e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:02.598602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3f2c6b90-3130-4e41-9c7e-70cc12c73b84 req-d6f787a4-564e-462b-a005-a7ce5747fe3e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:02.631705 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3f2c6b90-3130-4e41-9c7e-70cc12c73b84 req-d6f787a4-564e-462b-a005-a7ce5747fe3e service nova] Creating event network-changed:fbfd57c9-7dce-4a91-982f-cfa91fd489ee for instance 904b4106-5845-40b8-8f26-7eacf31b54b8 on n-h1-854119-9 Aug 29 05:08:02.646104 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3f2c6b90-3130-4e41-9c7e-70cc12c73b84 req-d6f787a4-564e-462b-a005-a7ce5747fe3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088286 Aug 29 05:08:02.649079 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1976/3890] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:02.670202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:02.671408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:02.688036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:02.688563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:02.689004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:02.689723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:02.690176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:02.690600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:02.772845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:02.791415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:02.804989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:02.813310 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-46747b64-6527-41c9-ae71-502e0029abda tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1407 microversion: 2.20 time: 0.895521 Aug 29 05:08:02.814074 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1915/3891] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:01 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1407 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:02.936139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:02.939057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-944f2f04-f7bc-4fd2-bed5-b6361dc478b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9b95b80>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:02.956610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:02.958406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:02.959813 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a34d373f-76df-4a7f-aeee-3916c8dce202 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.308166 Aug 29 05:08:02.960418 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1977/3892] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:02 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:03.010734 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-944f2f04-f7bc-4fd2-bed5-b6361dc478b4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.076363 Aug 29 05:08:03.011458 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1916/3893] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:02 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:03.578066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:03.578720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:03.587034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:03.592098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:03.592798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:03.593702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:03.594315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:03.594914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:03.838217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:03.839109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:03.860599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:03.867108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:03.873079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:03.876155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:03.876851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:03.903406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:04.103708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:04.117717 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b14d10cc-c6e1-4d2a-9bc6-4b49a281a06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.544191 Aug 29 05:08:04.128307 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1978/3894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:03 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:04.135880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:04.142522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:04.163146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:04.163804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:04.164090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:04.172620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:04.174991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:04.175286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:04.741347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:04.757553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:04.761708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:04.767467 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69abb97c-310f-4a40-84f2-f63f37fa5fee tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.638321 Aug 29 05:08:04.770608 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1979/3895] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:04 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:04.791039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e4d2baaa-eb38-4e59-a7b7-fd560036367c tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd7fd9d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:04.891405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:04.908425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:04.911648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:04.915703 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a2a2a9a-ec2b-47b7-9713-7df4fc275b7a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1407 microversion: 2.20 time: 1.081900 Aug 29 05:08:04.921572 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1917/3896] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:03 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1407 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:08:04.927728 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e4d2baaa-eb38-4e59-a7b7-fd560036367c tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.155091 Aug 29 05:08:04.928357 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1980/3897] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:04 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:05.138957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:05.141177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:05.159664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:05.160215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:05.165008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:05.167765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:05.168462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:05.171153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:05.223459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-328433741", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:05.373135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] validate_networks() for [('d1bf7399-59b6-40f0-9041-d1ee9491f26a', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:08:05.845961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:05.860051 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-be575b4a-ac47-4e1b-b1c3-10c92a55a048 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.724668 Aug 29 05:08:05.875596 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1981/3898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:05 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:05.892957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-910092072", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "851a92a3-69a9-4513-adb3-18f1b3db4e04"}, {"port": "e3c9708f-d535-4684-8742-633d367275e3", "tag": "port-1"}, {"port": "48cc496b-b13a-4bc9-a9d5-d3a3dd570ddf", "tag": "port-2"}, {"uuid": "a1b79db7-fd96-4c74-bf3d-0008d074ec44", "tag": "net-1"}, {"uuid": "a1b79db7-fd96-4c74-bf3d-0008d074ec44"}, {"uuid": "0e883f25-b221-4af8-b1e0-3aa9a9d38e81", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0e883f25-b221-4af8-b1e0-3aa9a9d38e81", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "49bddc28-c4c6-4d74-8ede-b848431f4ad6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "920f7b09-179e-4078-b282-079f09bb5804", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fb029070-3bee-4583-b3a6-111a96e945fa", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--525217550"}], "key_name": "tempest-keypair-615073839", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:06.234078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] validate_networks() for [('851a92a3-69a9-4513-adb3-18f1b3db4e04', None, None, None, None, None), (None, None, 'e3c9708f-d535-4684-8742-633d367275e3', None, None, None), (None, None, '48cc496b-b13a-4bc9-a9d5-d3a3dd570ddf', None, None, None), ('a1b79db7-fd96-4c74-bf3d-0008d074ec44', None, None, None, None, None), ('a1b79db7-fd96-4c74-bf3d-0008d074ec44', None, None, None, None, None), ('0e883f25-b221-4af8-b1e0-3aa9a9d38e81', '10.2.2.100', None, None, None, None), ('0e883f25-b221-4af8-b1e0-3aa9a9d38e81', '10.2.2.200', None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:08:06.507233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=10 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:06.560148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:08:06.560611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:08:06.565787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:08:06.566277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:08:06.566881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:08:06.584640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:06.585111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:06.585550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:06.586290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:06.586749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:06.591180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:06.635343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Getting quotas for project 198e073d8d724cc88a1b75643a1e4be3. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:08:06.647000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Getting quotas for user 4d5a5f174a0f4d139901452e9a358a82 and project 198e073d8d724cc88a1b75643a1e4be3. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:08:06.683314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:08:06.686323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:08:06.836800 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a5b04c8-a983-42e2-af97-816ec0eacd42 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.910991 Aug 29 05:08:06.844619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1918/3899] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:08:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:08:06.853838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:06.857139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:06.877323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:06.877990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:06.878854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:06.881628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:06.882388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:06.883171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:07.131157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:07.148901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:07.150645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:07.159853 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c47c0fc0-550b-45f6-a95d-8ad60b098ddb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.313599 Aug 29 05:08:07.161146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1919/3900] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:06 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:07.173494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:07.176736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:07.194411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:07.196737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:07.199715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:07.203378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:07.206863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:07.208813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:07.928966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:07.952746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:07.955254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:07.958194 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d804afc5-de6f-433f-83e5-bde55f8056ea tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1407 microversion: 2.20 time: 0.795380 Aug 29 05:08:07.959598 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1920/3901] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:07 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1407 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:07.966248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c138abea-42fb-4066-99eb-39f246c887f5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9796d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:08.047850 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c138abea-42fb-4066-99eb-39f246c887f5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.085978 Aug 29 05:08:08.048711 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1921/3902] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:07 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:08.081872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:08.082677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:08.089876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:08.119004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:08.119505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:08.119951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:08.120737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:08.124383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:08.124714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:08.320594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:08.329987 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be33c431-1ee3-4c0d-9c9c-741c3e54b8ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1226 microversion: 2.1 time: 0.276940 Aug 29 05:08:08.343858 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1922/3903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:08 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1226 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:08.365440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:08.371115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:08.386280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:08.386772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:08.387216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:08.387925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:08.396752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:08.397975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:08.446706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:08.838421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:08.866336 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d6d0f74-ff75-4bdf-a21a-b4b2ccf21055 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.521090 Aug 29 05:08:08.873552 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1923/3904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:08 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:08.886671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:08.887511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:08.916979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:08.917481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:08.917925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:08.918632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:08.919080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:08.919494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:09.153415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:09.185236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:09.187454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:09.188723 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06e40a57-1e2a-43e1-9377-3e7740a69bba tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.313911 Aug 29 05:08:09.189306 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1924/3905] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:08 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:09.208097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:09.208744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:09.246234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:09.246727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:09.247156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:09.247862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:09.257638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:09.258163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:10.175102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:10.192548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:10.200695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:10.203367 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2380c61-30d5-4487-91e3-36cf1a3a4e71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1407 microversion: 2.20 time: 1.011990 Aug 29 05:08:10.204526 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1925/3906] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:09 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1407 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:10.210209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9abb0379-0c2a-44a1-abaf-aaff06307b85 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9a29d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:10.288946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9abb0379-0c2a-44a1-abaf-aaff06307b85 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.083135 Aug 29 05:08:10.297899 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1926/3907] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:10 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:10.303212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1075563650", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "970448b5-a0c5-4163-bcf4-71ff3dfc9117"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:10.392070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] validate_networks() for [('970448b5-a0c5-4163-bcf4-71ff3dfc9117', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:08:11.562456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:08:11.563690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:08:11.564422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:08:11.565046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:08:11.565859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:08:11.578775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:11.579534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:11.580199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:11.581077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:11.582901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:11.583483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:11.606401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Getting quotas for project 0f44f29199a24350984567f7ef8c670e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:08:11.612611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Getting quotas for user 7540db831bbe4326af010ddf50a57681 and project 0f44f29199a24350984567f7ef8c670e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:08:11.631591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:08:11.635228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:08:11.730165 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9f9c9e63-df8a-4c22-853c-74666422c488 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.430865 Aug 29 05:08:11.745179 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1927/3908] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:08:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:08:11.750335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:11.769869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:11.801382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:11.807674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:11.808429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:11.810019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:11.813291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:11.816268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:12.496924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:12.506438 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86c839e4-8627-4eaf-9001-c0430fb58b53 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.759978 Aug 29 05:08:12.513050 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1928/3909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:11 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:12.532107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:12.533049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:12.548111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:12.548958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:12.549587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:12.550493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:12.551133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:12.551745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:12.832290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:12.848395 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52f207df-aa52-4d9c-be30-dd09c82d85eb tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.325814 Aug 29 05:08:12.849638 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1929/3910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:12 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:12.854886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:12.855963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:12.868854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:12.871777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:12.872483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:12.873504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:12.880976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:12.881910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:13.079041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:13.110808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:13.122903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:13.129710 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-56fe67cc-7b5d-4f27-b353-8792a0fafb96 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.278533 Aug 29 05:08:13.144179 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1930/3911] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:12 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:13.166416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-92c6d489-07a8-446b-82cc-c4a262e16351 req-0ebe4963-ede0-4d45-995a-b88e151dd573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904b4106-5845-40b8-8f26-7eacf31b54b8", "name": "network-vif-plugged", "status": "completed", "tag": "fbfd57c9-7dce-4a91-982f-cfa91fd489ee"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:13.204157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-92c6d489-07a8-446b-82cc-c4a262e16351 req-0ebe4963-ede0-4d45-995a-b88e151dd573 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:13.205978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-92c6d489-07a8-446b-82cc-c4a262e16351 req-0ebe4963-ede0-4d45-995a-b88e151dd573 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:13.206781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-92c6d489-07a8-446b-82cc-c4a262e16351 req-0ebe4963-ede0-4d45-995a-b88e151dd573 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:13.256048 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-92c6d489-07a8-446b-82cc-c4a262e16351 req-0ebe4963-ede0-4d45-995a-b88e151dd573 service nova] Creating event network-vif-plugged:fbfd57c9-7dce-4a91-982f-cfa91fd489ee for instance 904b4106-5845-40b8-8f26-7eacf31b54b8 on n-h1-854119-9 Aug 29 05:08:13.266281 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-92c6d489-07a8-446b-82cc-c4a262e16351 req-0ebe4963-ede0-4d45-995a-b88e151dd573 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118816 Aug 29 05:08:13.266982 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1931/3912] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:13.273920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:13.274918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:13.286482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:13.286482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:13.286482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:13.286839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:13.287308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:13.294194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:13.771504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:13.780732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:13.782168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:13.783300 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9235fda0-1b64-4afc-b34f-34ca2e8db7d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1407 microversion: 2.20 time: 0.513675 Aug 29 05:08:13.796777 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1932/3913] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:13 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:13.802792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-536167f9-6748-429e-a877-f643393ca351 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9bac4c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:13.857385 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-536167f9-6748-429e-a877-f643393ca351 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1454 microversion: 2.1 time: 0.058895 Aug 29 05:08:13.858655 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1933/3914] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:13 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:13.887043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:13.899479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:13.922957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:13.923463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:13.925960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:13.927041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:13.927674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:13.931509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.112921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:14.121124 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2d07ec04-c920-433f-ac7c-283d5ffbef3e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1289 microversion: 2.1 time: 0.261259 Aug 29 05:08:14.132898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:08:14.133722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:08:14.134095 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1934/3915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:13 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1289 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:14.134289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:08:14.135042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:08:14.135473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:08:14.139024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:14.139992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:14.147882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.148558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.148681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.149172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.149402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.149611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.150347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.150517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.150801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.151232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.151360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.151900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.175588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Getting quotas for project 297d3fab7a624f05a703f620d94bad83. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:08:14.183361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Getting quotas for user 657822daf4f044319d5d6440e501cde6 and project 297d3fab7a624f05a703f620d94bad83. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:08:14.379819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:08:14.382741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='49bddc28-c4c6-4d74-8ede-b848431f4ad6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='920f7b09-179e-4078-b282-079f09bb5804',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb029070-3bee-4583-b3a6-111a96e945fa',volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:08:14.455712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:14.466162 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-620ef3c4-7a00-47ab-ae5c-8a17c6237ff2 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.330894 Aug 29 05:08:14.472451 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1935/3916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:14 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:14.484506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:14.485582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:14.500470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.501293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.501937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.502962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.511542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.512577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.812177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:14.824072 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5910af95-f349-4f22-b9c5-be1328ded2ae tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.349698 Aug 29 05:08:14.825050 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1936/3917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:14 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:14.843450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:14.845572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:14.854516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.854703 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c5227bb-e415-46de-8171-a340b7144908 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 8.974350 Aug 29 05:08:14.861441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.862172 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1982/3918] 10.222.0.20 () {62 vars in 1189 bytes} [Mon Aug 29 05:08:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 8979 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 05:08:14.862172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fb943ab8-cb8a-45f7-a8d0-d09ad40f3de2 req-572916df-646e-42e4-8648-d81a5accd0da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c461c080-6686-43e2-9daa-c00ef907fcd9", "tag": "02ece434-f770-4816-b5a3-6ceebff2b6fc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:14.863500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.864546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.865168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.865800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.873416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb943ab8-cb8a-45f7-a8d0-d09ad40f3de2 req-572916df-646e-42e4-8648-d81a5accd0da service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.874457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb943ab8-cb8a-45f7-a8d0-d09ad40f3de2 req-572916df-646e-42e4-8648-d81a5accd0da service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.875547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb943ab8-cb8a-45f7-a8d0-d09ad40f3de2 req-572916df-646e-42e4-8648-d81a5accd0da service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.888787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:14.891998 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fb943ab8-cb8a-45f7-a8d0-d09ad40f3de2 req-572916df-646e-42e4-8648-d81a5accd0da service nova] Creating event network-changed:02ece434-f770-4816-b5a3-6ceebff2b6fc for instance c461c080-6686-43e2-9daa-c00ef907fcd9 on n-h1-854119-9 Aug 29 05:08:14.898307 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fb943ab8-cb8a-45f7-a8d0-d09ad40f3de2 req-572916df-646e-42e4-8648-d81a5accd0da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041055 Aug 29 05:08:14.901368 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1983/3919] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:14.906866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:14.907559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:14.914942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.915429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.915869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:14.916600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:14.917038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:14.917455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:15.043693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.054732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.056654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.058631 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9661035b-877b-4ec6-aff3-dd0a4f6ffb42 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.232289 Aug 29 05:08:15.060099 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1937/3920] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:14 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:15.065136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b361b5b-86d4-45a5-833c-9ffcdd2c128c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:15.066913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3b361b5b-86d4-45a5-833c-9ffcdd2c128c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:15.185215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3b361b5b-86d4-45a5-833c-9ffcdd2c128c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.206780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3b361b5b-86d4-45a5-833c-9ffcdd2c128c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.214268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3b361b5b-86d4-45a5-833c-9ffcdd2c128c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.214378 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b361b5b-86d4-45a5-833c-9ffcdd2c128c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1284 microversion: 2.42 time: 0.152590 Aug 29 05:08:15.225283 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1938/3921] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:15 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:15.230848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.235099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-18ee39fa-2b7a-43cd-acef-27644fd77f99 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab95c70d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:15.246629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.249700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.250882 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-53b71116-a378-4062-a9ca-f03b0b635219 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1407 microversion: 2.20 time: 0.348350 Aug 29 05:08:15.264156 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1984/3922] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:14 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:15.269850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:15.270846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:15.291266 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-18ee39fa-2b7a-43cd-acef-27644fd77f99 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1463 microversion: 2.1 time: 0.064646 Aug 29 05:08:15.292465 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1939/3923] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:15 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1463 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:15.294719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:15.295509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:15.296811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:15.299964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:15.300803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:15.301435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:15.310030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1068d54a-b4cb-4b78-99c2-bd16691a5280 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9782d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:15.387021 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1068d54a-b4cb-4b78-99c2-bd16691a5280 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 200 len: 1463 microversion: 2.1 time: 0.082013 Aug 29 05:08:15.387899 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1940/3924] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:15 2022] GET /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 1463 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:15.401771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:15.402813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:15.409754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:15.412762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:15.412762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:15.412762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:15.412762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:15.414199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:15.742581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:15.753742 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45e8721f-9db3-449f-a2c9-e56ad39a2014 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1277 microversion: 2.1 time: 0.495452 Aug 29 05:08:15.756066 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1985/3925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:15 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1277 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:15.766024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:15.767261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:15.775423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:15.776865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:15.777518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:15.778431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:15.779656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:15.780378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.042292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:16.051275 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b090e612-b384-445e-a6ef-ad484ea95d68 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250" status: 200 len: 1466 microversion: 2.1 time: 0.654278 Aug 29 05:08:16.052090 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1941/3926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:15 2022] GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 => generated 1466 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:16.056768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:16.057528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:16.064707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.065434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.066044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.067064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.067652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.068235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.123086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:16.131753 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed0097f5-5175-4d69-898f-bdf4be584b96 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.374454 Aug 29 05:08:16.144189 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1986/3927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:15 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:16.144189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4cbb5431-7d97-47b4-8747-e7b18aed5cac tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-52833718"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:16.144189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4cbb5431-7d97-47b4-8747-e7b18aed5cac tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:16.148527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbb5431-7d97-47b4-8747-e7b18aed5cac tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.149015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbb5431-7d97-47b4-8747-e7b18aed5cac tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.149475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbb5431-7d97-47b4-8747-e7b18aed5cac tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.150171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbb5431-7d97-47b4-8747-e7b18aed5cac tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.150623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbb5431-7d97-47b4-8747-e7b18aed5cac tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.151063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4cbb5431-7d97-47b4-8747-e7b18aed5cac tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.372798 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4cbb5431-7d97-47b4-8747-e7b18aed5cac tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "POST /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b/action" status: 202 len: 0 microversion: 2.1 time: 0.238506 Aug 29 05:08:16.373621 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1987/3928] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:08:16 2022] POST /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 05:08:16.381526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:16.382826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:16.390779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.391497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.392073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.393196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.393790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.394916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.436316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:16.447280 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a5629a0-5b8e-4a4c-bfbf-2db3257e71cc tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.393978 Aug 29 05:08:16.449412 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1942/3929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:16 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:16.467628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:16.468732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:16.483022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.483511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.483940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.484670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.489895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.491356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.557228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:16.568742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:16.570498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:16.571997 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b32d2a3a-071c-425a-99f8-0dc6bdca23be tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.197145 Aug 29 05:08:16.573257 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1988/3930] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:16 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:16.592245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:16.593033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:16.599626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.600843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.601442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.602285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.602874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.603429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.650701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:16.660843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:16.662281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:16.663435 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e847b2c7-55f6-4066-a2d5-5e8e0e5fead5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1574 microversion: 2.42 time: 0.212613 Aug 29 05:08:16.664006 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1943/3931] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:16 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1574 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:16.675399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e73c13ae-b2d6-4901-a370-95b797c722ca tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9b95160>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:16.738423 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e73c13ae-b2d6-4901-a370-95b797c722ca tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.073141 Aug 29 05:08:16.739020 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1944/3932] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:16 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:16.775490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:16.776105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:16.782243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.783048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.783468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:16.784299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:16.785007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:16.785431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.027123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.037090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.038811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.040103 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5072e31-dc98-4455-b0cd-3c57e3d8dffe tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1598 microversion: 2.20 time: 0.465752 Aug 29 05:08:17.040889 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1989/3933] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:16 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1598 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:17.065557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-911c4124-ab05-45c2-8661-4bc8c6e85fcb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:17.066706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-911c4124-ab05-45c2-8661-4bc8c6e85fcb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:17.075347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-911c4124-ab05-45c2-8661-4bc8c6e85fcb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.076681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-911c4124-ab05-45c2-8661-4bc8c6e85fcb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.077657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-911c4124-ab05-45c2-8661-4bc8c6e85fcb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.079632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-911c4124-ab05-45c2-8661-4bc8c6e85fcb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.081327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-911c4124-ab05-45c2-8661-4bc8c6e85fcb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.082278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-911c4124-ab05-45c2-8661-4bc8c6e85fcb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.120567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.133851 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1dbfae41-4918-4b2e-878e-2ef8b621d723 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.360554 Aug 29 05:08:17.134878 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1945/3934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:16 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:17.156719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:17.157511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:17.164515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.165108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.165610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.166377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.166896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.167393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.202908 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-911c4124-ab05-45c2-8661-4bc8c6e85fcb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.143742 Aug 29 05:08:17.204354 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1990/3935] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 29 05:08:17 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:08:17.470449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:17.471060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:17.477240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.478063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.478706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.479680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.480288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.480769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.591284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.600310 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-887814ac-2fa5-4dd2-892f-48687d89c485 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.448705 Aug 29 05:08:17.600900 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1946/3936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:17 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:17.609233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:17.610072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:17.617458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.618276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.619055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.619840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.620392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.620882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.643341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:17.788654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.801456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.804218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.806604 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0cf5fb83-d160-4ef5-b017-0e7a9a6c98cc tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.204485 Aug 29 05:08:17.807864 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1947/3937] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:17 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:17.813290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:17.813892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:17.820476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.821245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.821972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.822894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:17.824298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:17.825101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:17.891089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.901443 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a649a847-1270-4235-a3e0-0b8bb86f5306 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.435050 Aug 29 05:08:17.903166 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1991/3938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:17 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:17.925281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9bb00a47-da65-4a1a-b727-19a9a7944a5b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b3c4c0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:17.966717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.978940 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9bb00a47-da65-4a1a-b727-19a9a7944a5b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.060787 Aug 29 05:08:17.979668 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1992/3939] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:17 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:17.987135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.988980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:17.990429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aa9e6349-157b-47c6-89a3-7da105a6dd89 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1574 microversion: 2.42 time: 0.181295 Aug 29 05:08:17.991204 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1948/3940] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:17 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:18.155335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:18.156047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:18.162782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:18.163368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:18.163871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:18.164685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:18.165200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:18.165898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:18.625242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:18.626412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:18.645610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:18.646374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:18.646983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:18.647725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:18.648254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:18.648682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:18.805965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:18.815560 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c734fcf3-36bf-4d4b-9c42-6194c79d1b44 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.664437 Aug 29 05:08:18.829513 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1993/3941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:18 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:18.837289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-cd066e84-1900-4460-bc6a-56d0b64a818c req-32e2c1fd-1226-4c2b-b3e0-24c8c3515491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f4c4a5-d88a-42bb-8cda-837036cad036", "tag": "ff92d680-9393-4240-bef3-e118882fe71e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:18.847804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd066e84-1900-4460-bc6a-56d0b64a818c req-32e2c1fd-1226-4c2b-b3e0-24c8c3515491 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:18.848653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd066e84-1900-4460-bc6a-56d0b64a818c req-32e2c1fd-1226-4c2b-b3e0-24c8c3515491 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:18.850171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cd066e84-1900-4460-bc6a-56d0b64a818c req-32e2c1fd-1226-4c2b-b3e0-24c8c3515491 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:18.863410 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-cd066e84-1900-4460-bc6a-56d0b64a818c req-32e2c1fd-1226-4c2b-b3e0-24c8c3515491 service nova] Creating event network-changed:ff92d680-9393-4240-bef3-e118882fe71e for instance e8f4c4a5-d88a-42bb-8cda-837036cad036 on n-h1-854119-9 Aug 29 05:08:18.868924 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-cd066e84-1900-4460-bc6a-56d0b64a818c req-32e2c1fd-1226-4c2b-b3e0-24c8c3515491 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037989 Aug 29 05:08:18.869777 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1994/3942] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:18.875540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:18.876512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:18.883955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:18.884881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:18.885636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:18.886668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:18.887336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:18.887968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:18.990716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:19.010388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:19.018165 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-170b34f6-7381-44ef-8b23-bf85d151c8bb tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.397967 Aug 29 05:08:19.018775 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1949/3943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:18 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:19.035793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:19.037744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:19.038873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:19.039599 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8d787dea-04cf-4fad-998d-61b53fa5a54e tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.168325 Aug 29 05:08:19.039964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:19.040556 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1995/3944] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:18 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:19.046612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:19.047126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:19.047824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:19.048800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:19.048926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a433cf12-4d52-4bf2-a46b-1bc6fc86fb9c tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab895e3a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:19.049596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:19.050229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:19.114947 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a433cf12-4d52-4bf2-a46b-1bc6fc86fb9c tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.073211 Aug 29 05:08:19.115535 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1996/3945] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:19 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:19.125989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:19.126858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:19.134066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:19.134707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:19.135176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:19.135954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:19.136509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:19.137088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:19.244169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:19.256450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:19.258218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:19.259469 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9be3053f-582c-41cc-bd0a-bd4ad3af2e9d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1574 microversion: 2.42 time: 0.143019 Aug 29 05:08:19.260041 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1997/3946] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:19 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1574 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:19.264791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-000070a1-0472-464c-af8e-19a97a5b5f45 req-7ad2794c-1570-466f-946b-b1b7eb7d9d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a557400d-1409-4dff-b0ae-8b54fd922250", "name": "network-vif-unplugged", "status": "completed", "tag": "dad129e8-e3ea-4e47-929c-0e837a029c60"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:19.274630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-000070a1-0472-464c-af8e-19a97a5b5f45 req-7ad2794c-1570-466f-946b-b1b7eb7d9d84 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:19.275359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-000070a1-0472-464c-af8e-19a97a5b5f45 req-7ad2794c-1570-466f-946b-b1b7eb7d9d84 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:19.275801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-000070a1-0472-464c-af8e-19a97a5b5f45 req-7ad2794c-1570-466f-946b-b1b7eb7d9d84 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:19.289698 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-000070a1-0472-464c-af8e-19a97a5b5f45 req-7ad2794c-1570-466f-946b-b1b7eb7d9d84 service nova] Creating event network-vif-unplugged:dad129e8-e3ea-4e47-929c-0e837a029c60 for instance a557400d-1409-4dff-b0ae-8b54fd922250 on n-h1-854119-9 Aug 29 05:08:19.295172 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-000070a1-0472-464c-af8e-19a97a5b5f45 req-7ad2794c-1570-466f-946b-b1b7eb7d9d84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033724 Aug 29 05:08:19.295777 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1998/3947] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:19.307448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:19.315344 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d307d85-8fd5-4ae4-adb6-18f02f620146 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.280272 Aug 29 05:08:19.316352 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1950/3948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:19 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:19.850242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:19.851645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:19.860608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:19.861445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:19.862175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:19.863275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:19.864095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:19.865350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.047093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:20.048326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:20.055914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:20.058622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:20.059319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.060533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:20.061478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:20.062194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.077033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:20.087391 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cec11c00-8694-4199-8719-0f6fd1fcb9e5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.241821 Aug 29 05:08:20.088323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 1999/3949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:19 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:20.093574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:20.094430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:20.114975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:20.115487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:20.124225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.126226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:20.127429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:20.128226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.219610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:20.230679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:20.232545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:20.234200 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a11a0e02-cd4f-4475-a038-b2bf36c5a4fd tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.144618 Aug 29 05:08:20.245341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:20.253889 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2000/3950] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:20 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:20.254646 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f95652b-3578-4f6f-a2f3-6abe0c497035 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.211445 Aug 29 05:08:20.255379 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1951/3951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:20 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:20.263707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f278b5a-846b-43ff-9967-92ede1679fe9 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab89c0b80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:20.283974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:20.284724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:20.291084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:20.291592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:20.292024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.292775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:20.293378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:20.293809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.316239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f278b5a-846b-43ff-9967-92ede1679fe9 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.061027 Aug 29 05:08:20.316878 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2001/3952] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:20 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:20.337280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:20.338154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:20.345709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:20.346427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:20.347058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.347996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:20.348617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:20.349195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.367198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:20.377086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:20.378901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:20.380175 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a70b72c-becc-4186-91d3-2148bd218856 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1574 microversion: 2.42 time: 0.100253 Aug 29 05:08:20.393600 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1952/3953] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:20 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1574 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:20.509834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:20.535668 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4c9ca272-43e1-4c09-9a5b-36e8f7eec8f4 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.202352 Aug 29 05:08:20.548159 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2002/3954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:20 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:20.939369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-61b0cfc1-079c-419c-a614-489b7cd12801 req-d538bc51-2d5b-4146-b587-e602c7ac65dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904b4106-5845-40b8-8f26-7eacf31b54b8", "tag": "fbfd57c9-7dce-4a91-982f-cfa91fd489ee"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:20.951431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-61b0cfc1-079c-419c-a614-489b7cd12801 req-d538bc51-2d5b-4146-b587-e602c7ac65dd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:20.952108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-61b0cfc1-079c-419c-a614-489b7cd12801 req-d538bc51-2d5b-4146-b587-e602c7ac65dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:20.953048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-61b0cfc1-079c-419c-a614-489b7cd12801 req-d538bc51-2d5b-4146-b587-e602c7ac65dd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:20.965154 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-61b0cfc1-079c-419c-a614-489b7cd12801 req-d538bc51-2d5b-4146-b587-e602c7ac65dd service nova] Creating event network-changed:fbfd57c9-7dce-4a91-982f-cfa91fd489ee for instance 904b4106-5845-40b8-8f26-7eacf31b54b8 on n-h1-854119-9 Aug 29 05:08:20.973560 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-61b0cfc1-079c-419c-a614-489b7cd12801 req-d538bc51-2d5b-4146-b587-e602c7ac65dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039284 Aug 29 05:08:20.974864 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1953/3955] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:21.113989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:21.114764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:21.135674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:21.136493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:21.137032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:21.139312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:21.140407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:21.142346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:21.263211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:21.265161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:21.283636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:21.288815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:21.290078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:21.291049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:21.291728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:21.296757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:21.595904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:21.975235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:21.991897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:21.993377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:21.995733 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-abe00ba6-c1f2-4609-b8c8-ae9acb934022 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.738360 Aug 29 05:08:21.996684 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1954/3956] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:21 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:22.003578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:22.004455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:22.012053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:22.013755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:22.014359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:22.015234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:22.015908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:22.017102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:22.495623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:22.498800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:22.508030 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f1c66474-ffd5-4c88-b72a-d87331e371fd tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 1.399134 Aug 29 05:08:22.510689 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2003/3957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:21 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:22.524800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a9035a1-e3a2-4eaa-b64e-aa96066a7b9c tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab82404c0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:22.561855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:22.576984 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-452872cd-2663-41b3-beff-1339f61f129e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.578473 Aug 29 05:08:22.581509 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1955/3958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:21 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:22.593857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:22.594699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:22.605515 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a9035a1-e3a2-4eaa-b64e-aa96066a7b9c tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.092930 Aug 29 05:08:22.606400 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2004/3959] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:22 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:22.611797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:22.612649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:22.614101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:22.614599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:22.615188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:22.616710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:22.619499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:22.619886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:22.620273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:22.620546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:22.621052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:22.621989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:22.622638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:22.623333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:22.843164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:22.855275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:22.857148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:22.858304 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b073036a-0ad0-4cb3-9c53-71373528af17 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1592 microversion: 2.42 time: 0.275345 Aug 29 05:08:22.859088 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1956/3960] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:22 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1592 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:23.019125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:23.019748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:23.032465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:23.033152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:23.033743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:23.034606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:23.035209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:23.035781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:23.212729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:23.226926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:23.229535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:23.231179 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-878a81db-fd16-477c-8f9d-523a9be07a82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.216049 Aug 29 05:08:23.248337 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1957/3961] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:23 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:08:23.258404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:23.271078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1d0c69fe-1383-4e58-ad62-e3c123ad41af tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.663434 Aug 29 05:08:23.271865 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2005/3962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:22 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:23.536834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:23.537718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:23.550512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:23.553140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:23.564321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:23.566033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:23.572399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:23.573733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:23.604251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:23.605093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:23.624585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:23.625110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:23.625557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:23.626286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:23.640058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:23.640543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:24.165117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:24.193020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:24.231723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:24.237820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:24.243717 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff5f2209-45f6-440d-aade-ace20c2d613e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.641438 Aug 29 05:08:24.245118 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2006/3963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:23 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:24.246856 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f8605ab8-de96-4ae3-ba85-ad5ec40651d3 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.714540 Aug 29 05:08:24.261717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7696488-a454-46fa-ac37-6ee2777c3f87 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd7f0f70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:24.262388 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1958/3964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:23 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:24.271835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-08566bd8-8c2e-4229-aa19-e009ce744c8d req-2dfb6239-231c-4132-ae4f-df49f306314a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69b5de3-eef5-4ed2-a45c-155cb560423b", "name": "network-vif-plugged", "status": "completed", "tag": "21ed04b2-af73-45fc-82a5-01ea8dcf9bd3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:24.294091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-08566bd8-8c2e-4229-aa19-e009ce744c8d req-2dfb6239-231c-4132-ae4f-df49f306314a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:24.294875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-08566bd8-8c2e-4229-aa19-e009ce744c8d req-2dfb6239-231c-4132-ae4f-df49f306314a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:24.295443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-08566bd8-8c2e-4229-aa19-e009ce744c8d req-2dfb6239-231c-4132-ae4f-df49f306314a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:24.315946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-08566bd8-8c2e-4229-aa19-e009ce744c8d req-2dfb6239-231c-4132-ae4f-df49f306314a service nova] Creating event network-vif-plugged:21ed04b2-af73-45fc-82a5-01ea8dcf9bd3 for instance b69b5de3-eef5-4ed2-a45c-155cb560423b on n-h1-854119-9 Aug 29 05:08:24.317942 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7696488-a454-46fa-ac37-6ee2777c3f87 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.068563 Aug 29 05:08:24.318670 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2007/3965] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:24 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:24.326277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:24.327951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:24.330966 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-08566bd8-8c2e-4229-aa19-e009ce744c8d req-2dfb6239-231c-4132-ae4f-df49f306314a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067028 Aug 29 05:08:24.331587 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1959/3966] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:24.336638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:24.336933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:24.337322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:24.337865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:24.338597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:24.339536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:24.340238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:24.340949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:24.351917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:24.352695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:24.353271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:24.354120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:24.354713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:24.355281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:24.524396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:24.558504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:24.566976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:24.569537 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-46497e95-a9e1-4190-9c7e-99de70831880 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.236500 Aug 29 05:08:24.588337 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1960/3967] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:24 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:24.605137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:24.606319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:24.614616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:24.615150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:24.615599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:24.616833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:24.617956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:24.618747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:25.063626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:25.074478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:25.076216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:25.077989 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ca8ebc28-5041-4d8f-b3d6-504c71cc689c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1659 microversion: 2.42 time: 0.757732 Aug 29 05:08:25.078557 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2008/3968] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:24 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1659 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:25.093326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:25.101751 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c44da012-ca18-4c0e-9e40-9431d14bbdc9 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.511323 Aug 29 05:08:25.102340 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1961/3969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:24 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:25.272548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:25.275610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:25.276442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:25.277440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:25.288797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=14 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:25.295141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:25.295645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:25.296085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:25.296913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:25.297496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:25.297924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:25.298640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:25.299718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:25.300316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:25.301347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:25.303738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:25.304452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:25.518695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:25.530761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:25.533747 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-97f3afe0-bcd2-4c98-9d1e-2a7d99208d7c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.267873 Aug 29 05:08:25.534784 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2009/3970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:25 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:25.539802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d734a1a2-73c2-42ed-97b2-d9d3554f4600 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab89c0b80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:25.541271 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ace2298c-0de6-49c3-9d04-b60a7c1532b5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.274616 Aug 29 05:08:25.548727 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1962/3971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:25 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:25.585773 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d734a1a2-73c2-42ed-97b2-d9d3554f4600 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.049632 Aug 29 05:08:25.586547 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2010/3972] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:25 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:25.598065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:25.598677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:25.604793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:25.605273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:25.605896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:25.606593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:25.607043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:25.607497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:25.673792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:25.683401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:25.684887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:25.686156 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1871a408-2a54-412e-bbf2-b71d8e31c0a9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.092002 Aug 29 05:08:25.686729 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1963/3973] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:25 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:26.102708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:26.103662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:26.110652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.111349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.111874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.112717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.113389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.113909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.123028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:26.123797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:26.141853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.142508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.143046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.143860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.144440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.144964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.373450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:26.376093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:26.396348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:26.396564 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b57a2762-49d4-4e20-ad63-c205cbc1b06d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.277242 Aug 29 05:08:26.397047 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1964/3974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:26 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:26.409204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1e0ee39a-5997-4991-9433-45f1f9074394 req-a4616199-a3c2-4c36-9f59-4cd0d8d76567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c461c080-6686-43e2-9daa-c00ef907fcd9", "name": "network-vif-plugged", "status": "completed", "tag": "02ece434-f770-4816-b5a3-6ceebff2b6fc"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:26.409332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:26.410486 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fcf1c1ff-b4cf-456f-b130-8250f43239b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1659 microversion: 2.42 time: 0.312052 Aug 29 05:08:26.413216 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2011/3975] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:26 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1659 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:26.429162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1e0ee39a-5997-4991-9433-45f1f9074394 req-a4616199-a3c2-4c36-9f59-4cd0d8d76567 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.429554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1e0ee39a-5997-4991-9433-45f1f9074394 req-a4616199-a3c2-4c36-9f59-4cd0d8d76567 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.436473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1e0ee39a-5997-4991-9433-45f1f9074394 req-a4616199-a3c2-4c36-9f59-4cd0d8d76567 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.449750 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1e0ee39a-5997-4991-9433-45f1f9074394 req-a4616199-a3c2-4c36-9f59-4cd0d8d76567 service nova] Creating event network-vif-plugged:02ece434-f770-4816-b5a3-6ceebff2b6fc for instance c461c080-6686-43e2-9daa-c00ef907fcd9 on n-h1-854119-9 Aug 29 05:08:26.455114 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1e0ee39a-5997-4991-9433-45f1f9074394 req-a4616199-a3c2-4c36-9f59-4cd0d8d76567 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056408 Aug 29 05:08:26.455796 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1965/3976] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:26.564400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:26.565161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:26.566384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:26.566628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:26.580204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.585213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.585895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.586516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.587429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.588088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.588803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.589400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.590055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.593191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.593739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.595493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.599888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:26.825270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:26.829185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:26.833825 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6acb630d-bf19-418b-937c-55b13b270eb5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.276801 Aug 29 05:08:26.840086 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-526ca62b-e710-4f44-98c6-4f9d0dfe2e9c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.285884 Aug 29 05:08:26.842434 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2012/3977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:26 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:26.844763 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1966/3978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:26 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:26.850326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-61fe173a-90d2-42a6-831c-6d8c85afe219 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b47a60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:26.854110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:26.855492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:26.862829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.863312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.863751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.864491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:26.865191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:26.865620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:26.917178 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-61fe173a-90d2-42a6-831c-6d8c85afe219 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.072396 Aug 29 05:08:26.924750 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2013/3979] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:26 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:26.943859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:26.952864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:26.954316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:26.955491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83a65423-420d-4b0d-8257-0e318a3497d7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.106410 Aug 29 05:08:26.956192 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1967/3980] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:26 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:27.421436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:27.422056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:27.424015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:27.430149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:27.430634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:27.431060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:27.431839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:27.432451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:27.432868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:27.437036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:27.437860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:27.444799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:27.445637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:27.446228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:27.447616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:27.448253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:27.448840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:27.662979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:27.672430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:27.674293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:27.675451 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3298a3c7-183d-4dbb-bb82-f2d9dbbda191 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1659 microversion: 2.42 time: 0.242755 Aug 29 05:08:27.676012 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1968/3981] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:27 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1659 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:08:27.679787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:27.689014 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd6ac979-7789-488d-b44a-ca85d79460c7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.272550 Aug 29 05:08:27.703102 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2014/3982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:27 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:27.858048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:27.858762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:27.862823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:27.863621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:27.864590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:27.866269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:27.866957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:27.867547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:27.868467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:27.869113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:27.869857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:27.871632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:27.872209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:27.872643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:27.873397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:27.873849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:27.874453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:28.097509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:28.108560 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1fef0f32-9dda-4664-baf4-fdef0b6c6ff6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.256377 Aug 29 05:08:28.110695 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1969/3983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:27 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:28.116867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b59e8644-6fa8-494a-9344-ce7652779770 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9718a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:28.128820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:28.138018 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af4de34d-7759-4dff-9020-7fe9a7262c88 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.278935 Aug 29 05:08:28.152022 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2015/3984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:27 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:28.158393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:28.159179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:28.166324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:28.166968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:28.167702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:28.168587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:28.169210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:28.169662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:28.172295 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b59e8644-6fa8-494a-9344-ce7652779770 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.059772 Aug 29 05:08:28.176352 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1970/3985] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:28 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:28.237949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:28.246984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:28.248518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:28.250132 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-19b420ab-0451-431a-9379-f8e9b16229f0 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1365 microversion: 2.57 time: 0.096666 Aug 29 05:08:28.256287 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2016/3986] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:28 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:28.699365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:28.700273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:28.709975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:28.710472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:28.710907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:28.711614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:28.711951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:28.712451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:28.712556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:28.712846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:28.720278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:28.720879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:28.721413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:28.722201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:28.722867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:28.723471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:28.919597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:28.920191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:28.928925 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d1158c05-c1d4-499f-a792-fc640e878780 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.221457 Aug 29 05:08:28.929873 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2017/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:28 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:28.931595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:28.933048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:28.934188 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-47611d0e-cbb1-434f-bf7d-566a14a3daf6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1659 microversion: 2.42 time: 0.239856 Aug 29 05:08:28.934738 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1971/3988] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:28 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1659 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:29.129721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:29.130344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:29.136750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.137248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.137701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:29.138540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.138907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.139328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:29.159755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:29.160597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:29.167298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.167801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.168376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:29.176429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.183069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.183617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:29.438459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:29.457914 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9dfb0a02-f119-4d72-9690-4bb2db28d1b9 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.332031 Aug 29 05:08:29.472703 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2018/3989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:29 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:29.478303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22901f40-d27b-47ba-905e-4f2fa01173a6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b2d040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:29.489593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:29.498957 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-924dc256-0d17-4543-a7e1-b48084896fb4 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.343558 Aug 29 05:08:29.499566 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1972/3990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:29 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:29.515647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:29.516326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:29.524811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.525321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.525758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:29.526478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.526936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.527362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:29.531401 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22901f40-d27b-47ba-905e-4f2fa01173a6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.057272 Aug 29 05:08:29.533929 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2019/3991] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:29 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:29.627712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:29.639572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:29.643470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:29.645835 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed9d544a-7b38-46f7-b245-e351c062ded3 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1383 microversion: 2.57 time: 0.137663 Aug 29 05:08:29.647210 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1973/3992] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:29 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1383 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:29.954160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:29.954910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:29.956621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:29.957269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:29.962671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.963179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.963619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:29.964357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.964817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.965254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:29.970456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.970952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.971387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:29.972092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:29.975596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:29.976083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:30.235533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:30.236920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:30.246030 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b28add62-709e-4423-a5fd-47984a45c242 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1516 microversion: 2.1 time: 0.298740 Aug 29 05:08:30.246841 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2020/3993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:29 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1516 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:30.247025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:30.260466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:30.261737 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-13c4beba-3592-4c19-959f-655c51c08ca3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1705 microversion: 2.42 time: 0.309606 Aug 29 05:08:30.262411 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1974/3994] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:29 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1705 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:30.479728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:30.480710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:30.487688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:30.488440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:30.489111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:30.489804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:30.490405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:30.491063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:30.522371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:30.523339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:30.531468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:30.531967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:30.532439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:30.533169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:30.537718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:30.538394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:30.802123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:30.811703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:30.824239 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-afa21521-981d-49b4-9f42-a9cadfdb682e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.306094 Aug 29 05:08:30.825177 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1975/3995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:30 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:30.844567 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df8448d8-5e5a-459b-a28d-3f20c2bb1ee8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.348512 Aug 29 05:08:30.845464 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2021/3996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:30 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:30.851039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e40ce184-7f32-4049-a0a2-f292d3ea6754 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9677310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:30.856155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:30.856856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:30.863979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:30.864742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:30.865388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:30.866328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:30.866993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:30.867634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:30.913773 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e40ce184-7f32-4049-a0a2-f292d3ea6754 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.072850 Aug 29 05:08:30.915004 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1976/3997] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:30 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:30.964813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:30.991797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:30.997778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:31.001956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b1e661b-d55b-461c-bf56-b2f6bac1bbc6 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1371 microversion: 2.57 time: 0.155216 Aug 29 05:08:31.002555 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2022/3998] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:30 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:31.276387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:31.278568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:31.285986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:31.286759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:31.304612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:31.308432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:31.309139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:31.312378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:31.313042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:31.313592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:31.314197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:31.314972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:31.317020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:31.318009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:31.319649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:31.321569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:31.832809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:31.859236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:31.865223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:31.866836 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-419e57c1-3056-45e0-8a89-90e0b3a27c91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1751 microversion: 2.42 time: 0.585351 Aug 29 05:08:31.877892 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2023/3999] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:31 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1751 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:31.882906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2381704f-a9fd-4e52-90c0-11db84bd7c22 req-99a7d937-9931-4114-a3fa-9735a46a8305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f4c4a5-d88a-42bb-8cda-837036cad036", "name": "network-vif-plugged", "status": "completed", "tag": "ff92d680-9393-4240-bef3-e118882fe71e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:31.892623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:31.902149 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-021cd55a-dff4-407b-bc6c-19e6aa39b1a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1522 microversion: 2.1 time: 0.637199 Aug 29 05:08:31.904528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2381704f-a9fd-4e52-90c0-11db84bd7c22 req-99a7d937-9931-4114-a3fa-9735a46a8305 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:31.905594 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1977/4000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:31 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:31.909108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2381704f-a9fd-4e52-90c0-11db84bd7c22 req-99a7d937-9931-4114-a3fa-9735a46a8305 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:31.913782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2381704f-a9fd-4e52-90c0-11db84bd7c22 req-99a7d937-9931-4114-a3fa-9735a46a8305 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:31.923961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:31.925475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:31.934453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:31.935628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:31.936728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:31.938065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:31.938724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:31.939479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:31.948390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2381704f-a9fd-4e52-90c0-11db84bd7c22 req-99a7d937-9931-4114-a3fa-9735a46a8305 service nova] Creating event network-vif-plugged:ff92d680-9393-4240-bef3-e118882fe71e for instance e8f4c4a5-d88a-42bb-8cda-837036cad036 on n-h1-854119-9 Aug 29 05:08:31.958421 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2381704f-a9fd-4e52-90c0-11db84bd7c22 req-99a7d937-9931-4114-a3fa-9735a46a8305 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078982 Aug 29 05:08:31.959294 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2024/4001] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:31.968060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:31.969573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:31.978275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:31.978997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:31.979898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:31.981219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:31.981833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:31.982472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:32.287824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:32.303297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:32.303842 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-907eccf6-3754-434e-917a-eaa1f38ba908 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.396909 Aug 29 05:08:32.304683 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1978/4002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:31 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:32.312330 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57543c15-a64e-4e2e-8e3c-d5dd38a4c194 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.350423 Aug 29 05:08:32.312916 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2025/4003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:31 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:32.322645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:32.331329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64a61a81-7f46-4d2e-9af0-0abec9ae3d71 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab97a2310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:32.333049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:32.341057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:32.344845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:32.345633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:32.346718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:32.347872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:32.349564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:32.393491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:32.395063 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64a61a81-7f46-4d2e-9af0-0abec9ae3d71 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.089082 Aug 29 05:08:32.397064 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1979/4004] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:32 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:32.474480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:32.484907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:32.486867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:32.491985 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4bd7aeb6-622e-4a5d-9afb-6479a81d41e8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1371 microversion: 2.57 time: 0.173332 Aug 29 05:08:32.492859 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2026/4005] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:32 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:32.904550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:32.905483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:32.912204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:32.912711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:32.913152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:32.913873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:32.914330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:32.915010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:32.927888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:32.928984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:32.938129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:32.939035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:32.939648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:32.942225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:32.943015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:32.944365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:33.150427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:33.164381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:33.171428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:33.172958 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1349aa8e-4e68-4e61-8ede-84c8ad652a80 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1751 microversion: 2.42 time: 0.274796 Aug 29 05:08:33.188590 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1980/4006] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:32 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1751 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:33.231483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:33.241483 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c1d6d622-c2ee-4a96-9de1-54ee68c947fe tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1522 microversion: 2.1 time: 0.318374 Aug 29 05:08:33.242098 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2027/4007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:32 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:33.325689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:33.327170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:33.335648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:33.335963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:33.336682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:33.337387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:33.337781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:33.338883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:33.340005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:33.340668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:33.352246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:33.353110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:33.354381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:33.356065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:33.357628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:33.358955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:33.699884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:33.710140 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bd25663-ec5b-4916-b562-41dc801d8544 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.388136 Aug 29 05:08:33.716098 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1981/4008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:33 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:33.723447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3719bb9-edfa-4cc9-a00e-16e53ca8ef07 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9b95790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:33.748816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:33.760896 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-496d05da-50f7-4f5f-8cf9-db0015189b86 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.429434 Aug 29 05:08:33.762836 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2028/4009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:33 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:33.768417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:33.769658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:33.776647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:33.777354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:33.777976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:33.779038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:33.779705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:33.780399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:33.805315 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3719bb9-edfa-4cc9-a00e-16e53ca8ef07 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.087416 Aug 29 05:08:33.806031 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1982/4010] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:33 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:33.878902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:33.889000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:33.890722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:33.892266 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3fe25053-b27d-4608-8f9c-54b9c68fd7b9 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1371 microversion: 2.57 time: 0.128184 Aug 29 05:08:33.893094 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2029/4011] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:33 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:33.973319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-fa72d8eb-497c-4023-b99b-37f604c995af req-7e08c265-648e-43da-8c45-8e4f3e6317d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae7b907-079c-4ae2-806b-1cc81f663e39", "name": "network-vif-unplugged", "status": "completed", "tag": "b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:33.993141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fa72d8eb-497c-4023-b99b-37f604c995af req-7e08c265-648e-43da-8c45-8e4f3e6317d7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:33.993923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fa72d8eb-497c-4023-b99b-37f604c995af req-7e08c265-648e-43da-8c45-8e4f3e6317d7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:33.994480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fa72d8eb-497c-4023-b99b-37f604c995af req-7e08c265-648e-43da-8c45-8e4f3e6317d7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:34.019761 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-fa72d8eb-497c-4023-b99b-37f604c995af req-7e08c265-648e-43da-8c45-8e4f3e6317d7 service nova] Creating event network-vif-unplugged:b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9 for instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 on n-h1-854119-9 Aug 29 05:08:34.026017 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-fa72d8eb-497c-4023-b99b-37f604c995af req-7e08c265-648e-43da-8c45-8e4f3e6317d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056415 Aug 29 05:08:34.026646 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1983/4012] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:08:34.198682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:34.199664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:34.217590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:34.218046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:34.218495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:34.219217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:34.219845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:34.220454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:34.269935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:34.272577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:34.279977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:34.281040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:34.281728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:34.282632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:34.283289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:34.283893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:34.518467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:34.540730 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6cb5c62d-548a-4cbf-931f-798a98cbeb0f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1522 microversion: 2.1 time: 0.281093 Aug 29 05:08:34.554451 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1984/4013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:34 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:34.600672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:34.619642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:34.621517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:34.623218 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f61dfd1b-e058-4486-8260-bbc5b4eebd2a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1751 microversion: 2.42 time: 0.430103 Aug 29 05:08:34.624211 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2030/4014] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:34 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1751 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:34.735459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:34.736277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:34.744160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:34.749564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:34.750701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:34.753521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:34.759330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:34.760048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:34.786682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:34.789266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:34.806069 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:08:34.809030 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:08:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 (ip 10.222.0.20) !!! Aug 29 05:08:34.812480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:34.817093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:34.820097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:34.822405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:34.823762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:34.825399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:35.086618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:35.094990 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-477bad45-ab54-48dc-b00c-183f880ebecc tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.314487 Aug 29 05:08:35.097141 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2031/4015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:34 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:35.114536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-537a20c6-73a3-4105-8814-9a9f63c0da1f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd87a3a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:35.167062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:35.176883 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd60d0c2-fbaf-4805-9065-33a3b94dae8a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.446110 Aug 29 05:08:35.178357 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1985/4016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:34 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:35.181427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-537a20c6-73a3-4105-8814-9a9f63c0da1f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.083189 Aug 29 05:08:35.182547 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2032/4017] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:35 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:35.191664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:35.192321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:35.201489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:35.202616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:35.203640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:35.204612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:35.205206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:35.205785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:35.321243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:35.348161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:35.349921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:35.351210 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16bd3216-bc2f-4597-a62e-39f4b262d13b tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1371 microversion: 2.57 time: 0.171671 Aug 29 05:08:35.351787 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1986/4018] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:35 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:35.563366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:35.564093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:35.571857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:35.572703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:35.573365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:35.574294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:35.574951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:35.575577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:35.649664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:35.650273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:35.661264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:35.664158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:35.667325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:35.668323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:35.668952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:35.669601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:35.723802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:35.817704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:35.830688 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9016612b-7332-4c25-b27f-d5322fef087f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1522 microversion: 2.1 time: 0.272300 Aug 29 05:08:35.844586 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2033/4019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:35 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:35.961445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:35.974902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:35.976925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:35.978309 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6523d394-eb65-4499-87f9-2bd58143e4c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1751 microversion: 2.42 time: 0.333684 Aug 29 05:08:35.992146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1987/4020] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:35 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1751 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:36.116301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:36.117048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:36.123660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:36.124206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:36.124657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:36.136088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:36.138755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:36.139216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:36.196054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f30ba73-0794-47c4-8bc2-fa7e2e2ec4f8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9757d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:36.288037 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f30ba73-0794-47c4-8bc2-fa7e2e2ec4f8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.096021 Aug 29 05:08:36.291549 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1988/4021] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:36 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:36.304998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:36.306413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:36.326485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:36.328858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:36.331394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:36.333441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:36.334820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:36.337535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:36.550713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:36.561854 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ad3503c-e928-40fd-b376-f2fa5d32551f tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1322 microversion: 2.1 time: 0.267387 Aug 29 05:08:36.562758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1989/4022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:36 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:36.571063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:36.571249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:36.572895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:36.581619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:36.582130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:36.582593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:36.583325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:36.583811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:36.584402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:36.585483 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84a56423-d2de-447f-a344-f1cb37056519 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.473780 Aug 29 05:08:36.607275 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2034/4023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:36 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:36.851127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:36.853578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:36.874691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:36.883217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:36.884982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:36.885767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:36.886248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:36.886679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:37.974745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:37.994169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:37.998517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:38.005506 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eb52c893-bb1e-4544-ac12-dcdf14971d89 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1371 microversion: 2.57 time: 1.440469 Aug 29 05:08:38.008283 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1990/4024] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:36 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1371 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:38.030078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:38.032472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:38.057493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:38.059882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:38.061119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:38.064132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:38.067383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:38.067869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:38.321503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:38.337890 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08f0a8af-2870-406e-afc5-f9c47125546d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1522 microversion: 2.1 time: 1.489422 Aug 29 05:08:38.344950 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2035/4025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:36 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1522 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:38.357248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6a50dbc-f663-43ba-aac6-d03aec921da1 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8ac7e50>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:38.474124 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6a50dbc-f663-43ba-aac6-d03aec921da1 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.127576 Aug 29 05:08:38.475812 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2036/4026] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:38 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:38.483988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:38.501487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:38.543894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:38.544566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:38.545073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:38.545892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:38.549598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:38.550341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:38.717670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:38.739209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:38.745579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:38.748726 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64ef59e2-2083-4982-9f1c-f93d6e093f01 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1751 microversion: 2.42 time: 0.735004 Aug 29 05:08:38.749743 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1991/4027] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:38 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1751 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:38.757243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:38.758132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:38.767346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:38.768371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:38.774906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:38.782593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:38.783673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:38.787262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.097671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:39.111709 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de287f0c-77de-4943-826f-5a9bfe1ac266 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1517 microversion: 2.1 time: 0.634882 Aug 29 05:08:39.112375 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2037/4028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:38 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1517 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:39.129929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:39.130556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:39.147242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.147665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.148114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.148948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.149409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.149836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.221529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:39.231086 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a35816b0-d3df-4b86-91f4-a7a46f956087 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.478078 Aug 29 05:08:39.231692 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1992/4029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:38 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:39.251242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:39.253570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:39.261130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.261880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.262517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.263423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.264028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.264872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.300977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:39.312760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:39.317056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lazy-loading 'flavor' on Instance uuid c461c080-6686-43e2-9daa-c00ef907fcd9 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:08:39.317683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:39.323532 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f144fbb5-50a9-4770-948a-3eb74809dbc5 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1371 microversion: 2.57 time: 0.207268 Aug 29 05:08:39.325005 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2038/4030] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:39 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:39.359792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:39.360765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:39.372288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.373861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.374515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.375445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.377007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.377720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.477986 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4eac81ac-328b-4cf2-94fa-f224d2b091ee tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action" status: 200 len: 32 microversion: 2.1 time: 0.231156 Aug 29 05:08:39.483332 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1993/4031] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:08:39 2022] POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:08:39.490994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:39.491888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:39.499785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.500445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.501132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.502038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.502501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.503027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.784421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:39.797269 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f8ab3c15-1dd1-4c31-b332-71edab63229b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1522 microversion: 2.1 time: 0.440702 Aug 29 05:08:39.814302 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2039/4032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:39 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:39.824473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11cfd042-fb0f-4f14-958e-3a26c088ba44 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd87a8b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:39.871525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:39.880542 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ecaf0e40-eca0-4ebb-aab1-05fc55f99faf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.394843 Aug 29 05:08:39.892827 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1994/4033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:39 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:39.892827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:39.892827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:39.907431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.907930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.914282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.915131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:39.915618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:39.916070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:39.928492 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11cfd042-fb0f-4f14-958e-3a26c088ba44 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.112092 Aug 29 05:08:39.929620 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2040/4034] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:39 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:39.956270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a2eb5354-a114-4533-811f-9905745f1691 req-ab85eda2-803c-4145-ad3b-d6e8c2dd9c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae7b907-079c-4ae2-806b-1cc81f663e39", "name": "network-vif-plugged", "status": "completed", "tag": "b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:40.018882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a2eb5354-a114-4533-811f-9905745f1691 req-ab85eda2-803c-4145-ad3b-d6e8c2dd9c9f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:40.028266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a2eb5354-a114-4533-811f-9905745f1691 req-ab85eda2-803c-4145-ad3b-d6e8c2dd9c9f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:40.029063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a2eb5354-a114-4533-811f-9905745f1691 req-ab85eda2-803c-4145-ad3b-d6e8c2dd9c9f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:40.076408 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a2eb5354-a114-4533-811f-9905745f1691 req-ab85eda2-803c-4145-ad3b-d6e8c2dd9c9f service nova] Creating event network-vif-plugged:b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9 for instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 on n-h1-854119-9 Aug 29 05:08:40.090048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a2eb5354-a114-4533-811f-9905745f1691 req-ab85eda2-803c-4145-ad3b-d6e8c2dd9c9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145824 Aug 29 05:08:40.092313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2041/4035] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:40.195517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:40.210101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:40.212970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:40.214203 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-378ded1f-fcc4-4d87-9237-0e6ecbe1f2be tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1797 microversion: 2.42 time: 0.328771 Aug 29 05:08:40.214767 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1995/4036] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:39 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1797 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:40.255102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:40.256270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:40.283957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:40.288611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:40.289693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:40.294456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:40.297765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:40.299575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:40.352256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:40.352861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:40.361290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:40.361791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:40.362230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:40.362950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:40.363433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:40.363875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:40.547042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:40.556460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:40.557926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:40.559168 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ebfb8e85-b8f5-4640-bf86-7afc91335b82 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1371 microversion: 2.57 time: 0.210826 Aug 29 05:08:40.559669 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1996/4037] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:40 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:40.757602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:40.771925 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f3881c7-e159-4484-9f08-48bbaf5e2ad1 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1319 microversion: 2.1 time: 0.521828 Aug 29 05:08:40.788568 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2042/4038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:40 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:40.819296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:40.820576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:40.834999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:40.838415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:40.841080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:40.842064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:40.845307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:40.848623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:40.906298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:40.907173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:40.918318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:40.920731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:40.921472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:40.924649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:40.925653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:40.926504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:41.610013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:41.618033 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71f7a35c-962d-437d-8f2b-fbc238221483 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1522 microversion: 2.1 time: 0.802649 Aug 29 05:08:41.621946 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1997/4039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:40 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1522 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:41.635187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed1679ef-4723-4fe4-bacf-b459fbbd5b69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9c7d8b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:41.706639 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed1679ef-4723-4fe4-bacf-b459fbbd5b69 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.083401 Aug 29 05:08:41.707236 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1998/4040] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:41 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:41.724400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:41.725026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:41.731356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:41.731908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:41.732374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:41.733094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:41.733551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:41.733971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:41.783535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:41.805106 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ba202b5-26a5-4214-bfed-3385f8ef2d08 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.902948 Aug 29 05:08:41.806602 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2043/4041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:40 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:41.814609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:41.816013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:41.830349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:41.831388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:41.832109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:41.834775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:41.836249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:41.836911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:41.989155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.007913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.013971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.016880 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0887346-cee0-4f54-aef8-b89761c02fff tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1356 microversion: 2.57 time: 0.208191 Aug 29 05:08:42.029326 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2044/4042] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:41 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1356 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:42.053299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:42.053990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:42.068700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:42.069448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:42.069888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:42.070602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:42.076644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:42.077595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:42.176370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.187053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.192984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.194261 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-85f3c4f3-58a5-4b67-97b6-253ffa8f9ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1797 microversion: 2.42 time: 0.486058 Aug 29 05:08:42.201575 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 1999/4043] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:41 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1797 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:42.206941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:42.207436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:42.242417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:42.243220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:42.243839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:42.244770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:42.245401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:42.246026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:42.309000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:08:42.469186 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ac830a0-e36d-4213-b9db-35a43aafff1d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 204 len: 0 microversion: 2.57 time: 0.266189 Aug 29 05:08:42.474848 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2000/4044] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:08:42 2022] DELETE /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:08:42.481889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:42.487659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:42.507116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:42.510048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:42.510694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:42.511620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:42.515393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:42.516092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:42.673871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.683446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.685515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.686968 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8bf35d32-28f0-4827-9f0b-1f636bc616b7 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1362 microversion: 2.57 time: 0.210692 Aug 29 05:08:42.704074 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2001/4045] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:42 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:42.706028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:42.709357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:42.710205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:42.717082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:42.717827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:42.718444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:42.719424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:42.719964 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-363eb680-b08d-460e-9861-d7fde7e753b8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1508 microversion: 2.1 time: 0.688837 Aug 29 05:08:42.720292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:42.720901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:42.722846 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2045/4046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:42 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1508 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:42.748289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:42.749158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-087235ab-995e-4888-b217-23e83ecfda73 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8a1f790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:42.980289 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-087235ab-995e-4888-b217-23e83ecfda73 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1453 microversion: 2.1 time: 0.256231 Aug 29 05:08:42.981024 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2046/4047] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:42 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1453 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:42.997446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:43.000552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:43.021748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:43.024619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:43.026046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:43.028373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:43.030994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:43.033482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:43.114868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:43.199966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:43.225077 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7bef0a4f-403c-45bf-b1f6-7ff06eeb6164 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1522 microversion: 2.1 time: 0.515901 Aug 29 05:08:43.225636 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2002/4048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:42 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:43.243786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:43.246186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:43.265644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:43.267716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:43.270699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:43.272020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:43.272695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:43.273269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:44.520706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:44.532745 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5eef95ba-abd0-4945-b8e5-635067f7ad2c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 1.550514 Aug 29 05:08:44.550756 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2047/4049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:42 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:44.565827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:44.566804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:44.578084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:44.579655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:44.580376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:44.581337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:44.582044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:44.582900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:44.585273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:44.602669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:44.605661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:44.610404 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-63612bfd-67c2-42c1-a185-28fb233f7163 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1843 microversion: 2.42 time: 1.383545 Aug 29 05:08:44.613752 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2003/4050] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:43 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1843 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:44.631780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0bebbbcc-9973-4379-b1d1-3b2e1fc56c47 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab95481f0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:44.713868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:44.726314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:44.732926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:44.734423 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-15103028-3a0e-4161-a88f-5ffac1d388fb tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1362 microversion: 2.57 time: 0.182203 Aug 29 05:08:44.737487 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2048/4051] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:44 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:44.759593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:44.762019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:44.777804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:44.782310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:44.782964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:44.783921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:44.784560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:44.791389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:45.110518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:45.126005 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6dc1f157-3cc7-4ce1-ac3b-fbe261a03032 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1507 microversion: 2.1 time: 0.385311 Aug 29 05:08:45.140449 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2049/4052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:44 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:45.152424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:45.158830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:45.178099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:45.179535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:45.181156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:45.183414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:45.185724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:45.187056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:45.497695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:45.507011 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e1217fad-c24a-44de-888f-adca792e4918 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 200 len: 1507 microversion: 2.1 time: 0.360906 Aug 29 05:08:45.512017 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2050/4053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:45 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:45.534026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:45.534766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:45.545455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:45.546061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:45.546570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:45.549351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:45.552371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:45.552725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:45.611026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:08:45.780948 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8603610c-9c9f-42bb-a192-3c23bbd1094f tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 204 len: 0 microversion: 2.1 time: 0.253068 Aug 29 05:08:45.782350 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2051/4054] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:08:45 2022] DELETE /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:08:45.804020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:45.807306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:45.822410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:45.823321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:45.823971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:45.826128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:45.826801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:45.828046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:46.434430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:46.443197 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-12f2edae-1be7-4885-92a3-e76fd85b8869 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.659498 Aug 29 05:08:46.462825 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2052/4055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:45 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:46.482855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:46.484151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:46.489911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:46.497427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:46.498144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:46.499200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:46.499748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:46.500523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:46.846119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:46.861546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:46.862935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:46.865684 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37dc732f-e7e2-4359-b3dd-9b5e48fe69da tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1843 microversion: 2.42 time: 0.400757 Aug 29 05:08:46.867788 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2053/4056] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:46 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1843 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:46.889654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:46.890522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:46.907138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:46.907939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:46.920005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:46.921329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:46.922034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:46.922694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:47.037760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:47.053402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:47.056205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ad1c63259f4e64bce5f040c988a848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0076c5bb1984fe6baec0d410a89b9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:47.058493 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a555d16f-3835-4e34-84de-60665a3fe31d tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 200 len: 1362 microversion: 2.57 time: 0.187441 Aug 29 05:08:47.061735 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2054/4057] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:46 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:47.082180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1027925306", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "388b126b-eb59-4ecb-aa93-a85eefd19dca"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:50.827974 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0bebbbcc-9973-4379-b1d1-3b2e1fc56c47 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1462 microversion: 2.1 time: 6.209234 Aug 29 05:08:50.834384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] validate_networks() for [('388b126b-eb59-4ecb-aa93-a85eefd19dca', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:08:50.838274 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2004/4058] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:44 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1462 bytes in 6224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:51.021616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-47928391", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "c07c9d01-1e8c-4c0b-9dd1-4101e74cf8b0"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:51.078973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] validate_networks() for [('c07c9d01-1e8c-4c0b-9dd1-4101e74cf8b0', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:08:52.023396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:08:52.023870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:08:52.024342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:08:52.031278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:08:52.031716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:08:52.044818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.045581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.046027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.046767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.047225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.047654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.067209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Getting quotas for project 062852699f4a47e98070dc8ae543db6a. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:08:52.072763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Getting quotas for user 00048986d35b4cb1934a71d10a851d6d and project 062852699f4a47e98070dc8ae543db6a. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:08:52.087802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:08:52.090903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:08:52.144224 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39fb554a-15e0-4d7f-8871-291d025b6ce8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.081211 Aug 29 05:08:52.145127 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2055/4059] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:08:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 5083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:08:52.149846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c04ca072-d9a9-4635-82e7-2b7ec3232dfd req-b7183701-d40b-4be5-9889-741a8e09ce17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "tag": "3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:52.160601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c04ca072-d9a9-4635-82e7-2b7ec3232dfd req-b7183701-d40b-4be5-9889-741a8e09ce17 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.161302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c04ca072-d9a9-4635-82e7-2b7ec3232dfd req-b7183701-d40b-4be5-9889-741a8e09ce17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.161932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c04ca072-d9a9-4635-82e7-2b7ec3232dfd req-b7183701-d40b-4be5-9889-741a8e09ce17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.181412 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c04ca072-d9a9-4635-82e7-2b7ec3232dfd req-b7183701-d40b-4be5-9889-741a8e09ce17 service nova] Creating event network-changed:3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:08:52.189862 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c04ca072-d9a9-4635-82e7-2b7ec3232dfd req-b7183701-d40b-4be5-9889-741a8e09ce17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042556 Aug 29 05:08:52.191368 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2056/4060] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:52.198100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:52.198804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:52.206103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.206365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:08:52.206850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.206952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:08:52.207274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:08:52.207621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.207764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:08:52.208078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:08:52.208668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.209129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.209605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.232797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.233282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.234700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.235617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.236263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.236868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.258760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Getting quotas for project 0f947e806fdf4a7f861e4f16217d5dd8. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:08:52.266351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Getting quotas for user d908a07c67bb4cf2a8342dea5db1ca17 and project 0f947e806fdf4a7f861e4f16217d5dd8. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:08:52.280989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:08:52.283945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:08:52.360751 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a003f937-9e0c-4085-a1db-7a082ff42083 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520092 Aug 29 05:08:52.362576 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2005/4061] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:08:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:08:52.373144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:52.373887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:52.389663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.390241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.391110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.391942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.392648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.393159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.539151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:52.551978 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f38e7326-dd17-4294-b45b-5ac7d804585e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.358890 Aug 29 05:08:52.553205 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2057/4062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:52 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:52.558753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:52.559525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] [instance: 1f2aaa79-cfbf-413c-833a-522ca978eec6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:52.567403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.568088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.568762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.570701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:52.571472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:52.572338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:52.597702 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] HTTP exception thrown: Instance 1f2aaa79-cfbf-413c-833a-522ca978eec6 could not be found. Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Request method failure captured: Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 HTTP/1.1 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEmhvRaJ-Ni-nDEx6t3WQ2OkCg2ckiaoNQn49jydQh7FM1scO84CRuKztMierQ2M80SSlJ1m4JPTyAU1Uh5pyrR76T2u9H6oVRdwT662ndcEkIJehE5NnkSSQuPqfg9HdvcLkftVgcXdwGT0Oif33mUoIYqFqUSx-QHHN90StN6IOtM Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.57 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f0076c5bb1984fe6baec0d410a89b9f4 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerShowV257Test-833423615 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0076c5bb1984fe6baec0d410a89b9f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0076c5bb1984fe6baec0d410a89b9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0076c5bb1984fe6baec0d410a89b9f4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0076c5bb1984fe6baec0d410a89b9f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerShowV257Test-833423615 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f0076c5bb1984fe6baec0d410a89b9f4 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerShowV257Test-833423615 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerShowV257Test-833423615-project Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 30ad1c63259f4e64bce5f040c988a848 Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerShowV257Test-833423615-project Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 1f2aaa79-cfbf-413c-833a-522ca978eec6 could not be found. Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '1f2aaa79-cfbf-413c-833a-522ca978eec6'} Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2aaa79-cfbf-413c-833a-522ca978eec6 could not be found. Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2aaa79-cfbf-413c-833a-522ca978eec6 could not be found. Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:08:52.599794 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2aaa79-cfbf-413c-833a-522ca978eec6 could not be found. Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] Returning 404 to user: Instance 1f2aaa79-cfbf-413c-833a-522ca978eec6 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-003b778b-088e-4469-8bf5-ee0c2ace8af8 tempest-ServerShowV257Test-833423615 tempest-ServerShowV257Test-833423615-project] 10.222.0.20 "GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6" status: 404 len: 111 microversion: 2.57 time: 0.046978 Aug 29 05:08:52.603506 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2058/4063] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:52 2022] GET /compute/v2.1/servers/1f2aaa79-cfbf-413c-833a-522ca978eec6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:08:52.607662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70c27a7b-18d9-4061-90f3-e359d9400455 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd896430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:52.676486 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70c27a7b-18d9-4061-90f3-e359d9400455 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 200 len: 1462 microversion: 2.1 time: 0.072774 Aug 29 05:08:52.686323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2059/4064] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:52 2022] GET /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 1462 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:52.686323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0bf314f-7ba8-4a9d-aeae-e015129e6a58 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:52.686323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a0bf314f-7ba8-4a9d-aeae-e015129e6a58 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:52.691804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:52.906299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a0bf314f-7ba8-4a9d-aeae-e015129e6a58 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:52.951855 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0bf314f-7ba8-4a9d-aeae-e015129e6a58 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1218 microversion: 2.1 time: 0.271709 Aug 29 05:08:52.952798 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2060/4065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:52 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1218 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:52.977850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5294c18d-2af8-4a87-ab26-c844cab8658e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:52.978498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5294c18d-2af8-4a87-ab26-c844cab8658e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:53.121716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:53.136983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:53.138508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5294c18d-2af8-4a87-ab26-c844cab8658e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:53.145551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:53.148385 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97de48dc-d27a-4637-a0ed-90aecabc1cbc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.783710 Aug 29 05:08:53.151684 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5294c18d-2af8-4a87-ab26-c844cab8658e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1212 microversion: 2.1 time: 0.197799 Aug 29 05:08:53.153014 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2006/4066] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:52 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:53.164348 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2061/4067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:52 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1212 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:53.173183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:53.174629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:53.191052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:53.191783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:53.192821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:53.193758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:53.194905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:53.196682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:53.521459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:53.536442 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4a959893-f437-4c33-b90f-055e4a52dfe7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1468 microversion: 2.1 time: 0.380320 Aug 29 05:08:53.551412 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2007/4068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:53 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1468 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:53.558211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea52d3d9-b1e3-4645-8b14-a8ec9f544041 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-66502511"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:53.562046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea52d3d9-b1e3-4645-8b14-a8ec9f544041 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:53.576880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:53.578079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:53.586769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea52d3d9-b1e3-4645-8b14-a8ec9f544041 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:53.589459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea52d3d9-b1e3-4645-8b14-a8ec9f544041 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:53.589933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:53.590355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea52d3d9-b1e3-4645-8b14-a8ec9f544041 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:53.590492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:53.591289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:53.592987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:53.593332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea52d3d9-b1e3-4645-8b14-a8ec9f544041 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:53.593835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:53.594087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea52d3d9-b1e3-4645-8b14-a8ec9f544041 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:53.594594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea52d3d9-b1e3-4645-8b14-a8ec9f544041 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:53.594943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:53.886134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:53.905060 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de62e134-3430-4ec2-b108-23c45a16d1b7 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.332296 Aug 29 05:08:53.905916 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2008/4069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:53 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:53.922117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-157fa35c-ab4a-410d-8087-ff9b3a281ae4 req-50e9e068-a88d-4515-92c8-a965d4728c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69b5de3-eef5-4ed2-a45c-155cb560423b", "name": "network-vif-unplugged", "status": "completed", "tag": "21ed04b2-af73-45fc-82a5-01ea8dcf9bd3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:53.938198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-157fa35c-ab4a-410d-8087-ff9b3a281ae4 req-50e9e068-a88d-4515-92c8-a965d4728c2d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:53.939127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-157fa35c-ab4a-410d-8087-ff9b3a281ae4 req-50e9e068-a88d-4515-92c8-a965d4728c2d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:53.939699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-157fa35c-ab4a-410d-8087-ff9b3a281ae4 req-50e9e068-a88d-4515-92c8-a965d4728c2d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:53.969504 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-157fa35c-ab4a-410d-8087-ff9b3a281ae4 req-50e9e068-a88d-4515-92c8-a965d4728c2d service nova] Creating event network-vif-unplugged:21ed04b2-af73-45fc-82a5-01ea8dcf9bd3 for instance b69b5de3-eef5-4ed2-a45c-155cb560423b on n-h1-854119-9 Aug 29 05:08:53.977649 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-157fa35c-ab4a-410d-8087-ff9b3a281ae4 req-50e9e068-a88d-4515-92c8-a965d4728c2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069362 Aug 29 05:08:53.980743 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2009/4070] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:53.992955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:53.994541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:54.012849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:54.013551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:54.013979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:54.017009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:54.017753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:54.020691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:54.053472 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea52d3d9-b1e3-4645-8b14-a8ec9f544041 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "POST /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250/action" status: 202 len: 0 microversion: 2.1 time: 0.500165 Aug 29 05:08:54.056679 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2062/4071] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:08:53 2022] POST /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 05:08:54.071617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f98c1cde-19d0-4339-8e92-2a6a6de88e82 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab89c04c0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:54.152386 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f98c1cde-19d0-4339-8e92-2a6a6de88e82 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.089581 Aug 29 05:08:54.156363 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2063/4072] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:54 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:54.176875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:54.177612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:54.195822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:54.198441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:54.201146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:54.201928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:54.202725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:54.203159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:54.275920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:54.295088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf619315-3a75-4b28-b982-a645ca1118bd tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1270 microversion: 2.1 time: 0.312863 Aug 29 05:08:54.304414 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2010/4073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:53 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1270 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:54.313681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:54.316182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:54.342338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:54.343366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:54.344348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:54.345276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:54.345916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:54.346400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:54.368220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:54.381598 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16c148d1-15e8-46aa-ba83-4538b133c6b5 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1264 microversion: 2.1 time: 0.209264 Aug 29 05:08:54.383471 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2064/4074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:54 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:54.391151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "tag": "e3c9708f-d535-4684-8742-633d367275e3"}, {"server_uuid": "8ae7b907-079c-4ae2-806b-1cc81f663e39", "name": "network-vif-deleted", "tag": "b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9"}, {"name": "network-changed", "server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "tag": "48cc496b-b13a-4bc9-a9d5-d3a3dd570ddf"}, {"name": "network-changed", "server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "tag": "850262b4-7c71-4de1-88fe-1b5865d1c466"}, {"name": "network-changed", "server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "tag": "9d491664-1c7c-402d-acbf-553a52de93b5"}, {"name": "network-changed", "server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "tag": "004afcee-7c72-4360-ad7c-0a6d16dcc727"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:54.408572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:54.415933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:54.417672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:54.443688 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Creating event network-changed:e3c9708f-d535-4684-8742-633d367275e3 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:08:54.444587 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Creating event network-vif-deleted:b31b944e-4027-4fb0-b9d3-1bc7b3aba7f9 for instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 on n-h1-854119-9 Aug 29 05:08:54.446053 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Creating event network-changed:48cc496b-b13a-4bc9-a9d5-d3a3dd570ddf for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:08:54.447590 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Creating event network-changed:850262b4-7c71-4de1-88fe-1b5865d1c466 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:08:54.448644 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Creating event network-changed:9d491664-1c7c-402d-acbf-553a52de93b5 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:08:54.449599 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] Creating event network-changed:004afcee-7c72-4360-ad7c-0a6d16dcc727 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:08:54.462951 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ab6ab1b5-f285-494e-9efa-5ca703dde419 req-f2b42db6-20d7-46a9-af0e-9573c5b45a74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1018 microversion: 2.1 time: 0.077920 Aug 29 05:08:54.464057 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2065/4075] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 1018 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:54.641354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:54.654477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:54.656389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:54.658548 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5101367-563b-4b4a-8e9f-eb6d6f38bd62 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.351797 Aug 29 05:08:54.659794 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2011/4076] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:54 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:54.933104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:54.934055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:54.944074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:54.944638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:54.945077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:54.945785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:54.946240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:54.947017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:55.169085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d63356e-69d4-4e83-94bc-3aa2b1d6cc54 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab96e5d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:55.247603 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d63356e-69d4-4e83-94bc-3aa2b1d6cc54 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.082415 Aug 29 05:08:55.248355 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2012/4077] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:55 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:55.317461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:55.318402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:55.329997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:55.331349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:55.333791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:55.336035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:55.336740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:55.337944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:55.535607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:55.549636 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-637a6427-a40d-4791-8285-8a5c174778e0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1276 microversion: 2.1 time: 0.237302 Aug 29 05:08:55.555020 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2013/4078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:55 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:55.559903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:55.563061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:55.578187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:55.578893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:55.579495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:55.580387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:55.580987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:55.581618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:55.719778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:55.733513 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c7fef0b3-5bb6-4085-9248-4887cf5efd15 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1270 microversion: 2.1 time: 0.177088 Aug 29 05:08:55.735363 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2014/4079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:55 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:55.745556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:55.746317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:55.754323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:55.755147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:55.755989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:55.757329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:55.757962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:55.758771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:55.815730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:55.826765 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28ac19ac-c9f6-42c5-9d23-e2a47a424cf1 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.904840 Aug 29 05:08:55.827683 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2066/4080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:54 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:56.262727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2bca14cb-de19-413f-bf64-d891846050bb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd8003a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:56.335286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:56.338212 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2bca14cb-de19-413f-bf64-d891846050bb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.079260 Aug 29 05:08:56.346453 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2067/4081] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:56 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:56.347135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:56.348731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:56.350012 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab56d6d7-0eaa-4d6e-8adf-8c200339a69f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.613023 Aug 29 05:08:56.364577 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2015/4082] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:55 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:56.488508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-cb27e84b-67ac-4c8b-94f7-07270b03fc88 req-c69d4612-efb9-4a57-99fc-4518ec820958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "tag": "d28a6416-ee20-43fb-9e41-ae5f2d7565ce"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:08:56.499160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cb27e84b-67ac-4c8b-94f7-07270b03fc88 req-c69d4612-efb9-4a57-99fc-4518ec820958 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:56.499642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cb27e84b-67ac-4c8b-94f7-07270b03fc88 req-c69d4612-efb9-4a57-99fc-4518ec820958 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:56.500244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-cb27e84b-67ac-4c8b-94f7-07270b03fc88 req-c69d4612-efb9-4a57-99fc-4518ec820958 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:56.518885 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-cb27e84b-67ac-4c8b-94f7-07270b03fc88 req-c69d4612-efb9-4a57-99fc-4518ec820958 service nova] Creating event network-changed:d28a6416-ee20-43fb-9e41-ae5f2d7565ce for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:08:56.527093 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-cb27e84b-67ac-4c8b-94f7-07270b03fc88 req-c69d4612-efb9-4a57-99fc-4518ec820958 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043702 Aug 29 05:08:56.527993 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2068/4083] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:08:56.575446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:56.576850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:56.591181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:56.592867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:56.593522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:56.594942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:56.596074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:56.596787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:56.743739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:56.752052 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7c107f6-884b-4cc8-acc1-b79c9bb6fe03 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1276 microversion: 2.1 time: 0.181502 Aug 29 05:08:56.753235 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2016/4084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:56 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:56.755296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:56.756101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:56.765091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:56.767032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:56.769319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:56.770618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:56.772430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:56.772974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:56.790500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:56.848148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:56.848694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:56.851723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:08:56.856330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:56.857090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:56.857694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:56.858737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:56.859332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:56.859903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:56.941685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:56.953521 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bc7977d3-958c-4453-9722-df681a7036bd tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1270 microversion: 2.1 time: 0.202420 Aug 29 05:08:56.955035 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2069/4085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:56 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1270 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:57.267441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:57.285792 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af7af382-9374-4d37-baa7-91b0cebbe6e6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.441428 Aug 29 05:08:57.286434 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2017/4086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:56 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:08:57.353982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7723fe37-2399-4d60-8e28-14a3f53516b1 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd8000d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:57.374216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:57.375445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:57.383588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:57.384554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:57.385341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:57.386459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:57.387223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:57.387965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:57.436700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7723fe37-2399-4d60-8e28-14a3f53516b1 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.086715 Aug 29 05:08:57.446078 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2070/4087] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:57 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:57.772912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:57.773757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:57.782174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:57.783041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:57.783633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:57.784517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:57.785136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:57.785704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:58.006977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:58.025505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:58.029426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:58.031242 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2fb66a71-f990-4f82-b180-84bf48c1a268 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.661254 Aug 29 05:08:58.032409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2018/4088] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:57 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:58.040477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:58.041283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:58.050036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:58.050689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:58.051232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:58.052300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:58.052998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:58.053516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:58.580694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:58.589816 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fcd1c500-96b3-4e40-b7f1-26a9b6baa519 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.820910 Aug 29 05:08:58.592572 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2071/4089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:57 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:58.605127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:58.605747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:58.613811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:58.614699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:58.615687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:58.616656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:58.617349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:58.617950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:58.939689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:58.949988 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-05eb95b2-f5f4-4995-8b9a-41844e610bf2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.916353 Aug 29 05:08:58.950777 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2019/4090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:58 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:58.956409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-604b4969-c364-4d30-b97c-9a95ca2e6361 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b92b80>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:59.024272 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-604b4969-c364-4d30-b97c-9a95ca2e6361 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.071977 Aug 29 05:08:59.025781 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2020/4091] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:08:58 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:59.060815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:59.061442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:59.069251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:59.069801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:59.070167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:59.071504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:59.072199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:59.072984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:59.123963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:59.134291 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4032b1dc-4223-4ae3-b98a-7f89701ac672 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.540480 Aug 29 05:08:59.135789 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2072/4092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:58 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:08:59.596642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:59.610181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:59.613466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:59.613953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:08:59.614201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:59.616367 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-45676cae-9d3b-4a45-a933-e50b7a970451 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.561879 Aug 29 05:08:59.620205 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2021/4093] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:08:59 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:08:59.623684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:59.624198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:59.624634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:59.625335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:59.625781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:59.626363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:59.970830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:08:59.971766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:08:59.982295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:59.984612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:59.985890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:08:59.989439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:08:59.990160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:08:59.990932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:00.111198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:00.122065 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c21b4e3b-0376-48e5-921e-a19d01e16d27 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.514904 Aug 29 05:09:00.123275 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2073/4094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:59 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:00.140832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-63ba34ad-391e-41ed-ba6b-27014aebcb1d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd896b80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:00.197838 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-63ba34ad-391e-41ed-ba6b-27014aebcb1d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.073365 Aug 29 05:09:00.198612 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2074/4095] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:00 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:00.204359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:00.205158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:00.219764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:00.220659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:00.221309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:00.222222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:00.225202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:00.225768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:00.585609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:00.596534 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86ca8a3a-49aa-4a36-abdc-74c4a6804ee2 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.629438 Aug 29 05:09:00.597995 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2022/4096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:08:59 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:00.642113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:00.643358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:00.653072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:00.654198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:00.655141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:00.656004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:00.657645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:00.658387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:00.693537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:00.721714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:00.729569 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5c11fcd5-9a67-43d5-a23a-67885db5b904 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.529621 Aug 29 05:09:00.742895 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2075/4097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:00 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:00.748431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6e507426-2e1a-443f-bf8e-c1a234e20199 req-d4420946-77e4-480e-954e-4ddd0f6af3fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fd1a9f-a063-404a-b7c9-d5ac8059c254", "tag": "27834b14-8be1-4e5c-b649-9d78b9cd17fb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:00.759489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6e507426-2e1a-443f-bf8e-c1a234e20199 req-d4420946-77e4-480e-954e-4ddd0f6af3fa service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:00.760170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6e507426-2e1a-443f-bf8e-c1a234e20199 req-d4420946-77e4-480e-954e-4ddd0f6af3fa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:00.760765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6e507426-2e1a-443f-bf8e-c1a234e20199 req-d4420946-77e4-480e-954e-4ddd0f6af3fa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:00.776679 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6e507426-2e1a-443f-bf8e-c1a234e20199 req-d4420946-77e4-480e-954e-4ddd0f6af3fa service nova] Creating event network-changed:27834b14-8be1-4e5c-b649-9d78b9cd17fb for instance c8fd1a9f-a063-404a-b7c9-d5ac8059c254 on n-h1-854119-9 Aug 29 05:09:00.781802 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6e507426-2e1a-443f-bf8e-c1a234e20199 req-d4420946-77e4-480e-954e-4ddd0f6af3fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037279 Aug 29 05:09:00.786821 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2076/4098] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:01.143327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:01.144207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:01.153543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:01.154435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:01.155348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:01.156373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:01.157462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:01.158685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:01.667836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:01.680426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:01.684811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:01.686835 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-888fbf9e-d8ce-45f0-964e-f7a666c146a5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 1.051587 Aug 29 05:09:01.691193 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2023/4099] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:00 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:09:01.697260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ad3bc5f-83f2-4f92-9a65-a20280e68245 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8bce700>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:01.767031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:01.783894 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ad3bc5f-83f2-4f92-9a65-a20280e68245 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.091299 Aug 29 05:09:01.785026 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06a9c5f7-aabd-4c07-a2f4-3cd0fe6abfce tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.643170 Aug 29 05:09:01.786079 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2024/4100] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:01 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:01.788782 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2077/4101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:01 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:01.797458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:01.798536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:01.804328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:01.808253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:01.818081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:01.818574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:01.820721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:01.822674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:01.824436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:01.824910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:01.826056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:01.826774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:01.827551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:01.827977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:01.828320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:01.828774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:02.058012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:02.247869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:02.275410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:02.328032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:02.341372 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-97d64e77-cd92-45c2-b16a-5fb23e6b319b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.547190 Aug 29 05:09:02.342889 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2078/4102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:01 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:02.348582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-dabe0e4c-f46a-4334-b0b7-1d1062c983c7 req-b3682c0d-a208-4e20-a6de-4ae414ab8348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a557400d-1409-4dff-b0ae-8b54fd922250", "name": "network-vif-plugged", "status": "completed", "tag": "dad129e8-e3ea-4e47-929c-0e837a029c60"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:02.359921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dabe0e4c-f46a-4334-b0b7-1d1062c983c7 req-b3682c0d-a208-4e20-a6de-4ae414ab8348 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:02.360763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dabe0e4c-f46a-4334-b0b7-1d1062c983c7 req-b3682c0d-a208-4e20-a6de-4ae414ab8348 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:02.361373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dabe0e4c-f46a-4334-b0b7-1d1062c983c7 req-b3682c0d-a208-4e20-a6de-4ae414ab8348 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:02.385873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-dabe0e4c-f46a-4334-b0b7-1d1062c983c7 req-b3682c0d-a208-4e20-a6de-4ae414ab8348 service nova] Creating event network-vif-plugged:dad129e8-e3ea-4e47-929c-0e837a029c60 for instance a557400d-1409-4dff-b0ae-8b54fd922250 on n-h1-854119-9 Aug 29 05:09:02.395577 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-dabe0e4c-f46a-4334-b0b7-1d1062c983c7 req-b3682c0d-a208-4e20-a6de-4ae414ab8348 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050382 Aug 29 05:09:02.396261 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2079/4103] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:02.438265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:02.447982 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4bfb5e68-308b-4007-9f13-787ad17076ba tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.659605 Aug 29 05:09:02.448803 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2025/4104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:01 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:02.719089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:02.719792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:02.731536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:02.732033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:02.732496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:02.733202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:02.733697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:02.734122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:02.800566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9c1869d2-10f3-4623-b4bf-3d0c083f1cbb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b48e50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:02.869050 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9c1869d2-10f3-4623-b4bf-3d0c083f1cbb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.072265 Aug 29 05:09:02.876672 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2026/4105] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:02 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:02.876672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:02.876672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:02.882328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:02.882880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:02.883519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:02.884777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:02.885944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:02.886545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:03.020228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:03.038403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:03.040067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:03.041752 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb720872-3f20-4242-a580-deb08410d39a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.327665 Aug 29 05:09:03.043397 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2080/4106] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:02 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:03.049071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fe0d5425-d676-4d1e-99d4-693fc40a9edf req-025a633b-f16a-48fa-a6fa-906004ad2d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d2207f-963c-488e-9d2a-4f4f6f0926c2", "tag": "d6c5968c-8f17-4d75-8060-1770f4239f5a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:03.061716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fe0d5425-d676-4d1e-99d4-693fc40a9edf req-025a633b-f16a-48fa-a6fa-906004ad2d2f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:03.062180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fe0d5425-d676-4d1e-99d4-693fc40a9edf req-025a633b-f16a-48fa-a6fa-906004ad2d2f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:03.062601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fe0d5425-d676-4d1e-99d4-693fc40a9edf req-025a633b-f16a-48fa-a6fa-906004ad2d2f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:03.076468 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fe0d5425-d676-4d1e-99d4-693fc40a9edf req-025a633b-f16a-48fa-a6fa-906004ad2d2f service nova] Creating event network-changed:d6c5968c-8f17-4d75-8060-1770f4239f5a for instance 23d2207f-963c-488e-9d2a-4f4f6f0926c2 on n-h1-854119-9 Aug 29 05:09:03.082413 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fe0d5425-d676-4d1e-99d4-693fc40a9edf req-025a633b-f16a-48fa-a6fa-906004ad2d2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037371 Aug 29 05:09:03.083024 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2081/4107] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:03.084416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:03.093426 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aac8e5bc-b8d1-479c-bee6-de9c84b06136 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.222055 Aug 29 05:09:03.094104 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2027/4108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:02 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:03.364292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:03.370866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:03.372102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:03.379526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:03.380007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:03.380537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:03.381171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:03.381616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:03.382029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:03.469634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:03.470483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:03.482957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:03.484091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:03.484781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:03.485986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:03.487495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:03.488294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:03.623877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:03.631863 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e44673be-26ce-41a4-a424-f92767514112 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.268531 Aug 29 05:09:03.645690 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2082/4109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:03 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:03.672715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:03.681294 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-70bab70d-c7f5-4239-8cf8-5dfb15ad5df8 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.216084 Aug 29 05:09:03.696333 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2028/4110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:03 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:03.886768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2488079-553a-48ad-8661-51bedf04ed27 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd89b8b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:03.943246 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2488079-553a-48ad-8661-51bedf04ed27 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.060521 Aug 29 05:09:03.944330 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2083/4111] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:03 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:04.066196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:04.066812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:04.073441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:04.074014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:04.074535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:04.075407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:04.076156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:04.076594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:04.113712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:04.114893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:04.122058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:04.122797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:04.123403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:04.124140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:04.124548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:04.125112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:04.352750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:04.370084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:04.373273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:04.375146 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8902b921-cf91-43c0-80e1-61450a0ec7fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.312725 Aug 29 05:09:04.376036 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2029/4112] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:04 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:04.378218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:04.394921 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6b5803cd-0991-4ef1-bc1f-985dfff8e8a5 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.284854 Aug 29 05:09:04.399543 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2084/4113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:04 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:04.653734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:04.654783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:04.662620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:04.663598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:04.664072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:04.665056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:04.665580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:04.666067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:04.702082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:04.703036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:04.714332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:04.714873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:04.715301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:04.716162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:04.716625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:04.717061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:04.878353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:04.899255 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cbb39cf3-9771-4844-a9ab-d04c4f91664c tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.241865 Aug 29 05:09:04.900590 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2030/4114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:04 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:04.955753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:04.959919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4da78188-17a8-4db1-99ae-78c7d6e171b1 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b1cf70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:04.967164 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3e29193b-a5e7-4558-b5c4-6a3695f88232 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.268945 Aug 29 05:09:04.968045 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2085/4115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:04 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:05.029538 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4da78188-17a8-4db1-99ae-78c7d6e171b1 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.074111 Aug 29 05:09:05.036948 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2031/4116] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:04 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:05.399151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:05.399672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:05.406320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:05.406989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:05.407530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:05.408274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:05.408725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:05.409175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:05.423149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:05.426937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:05.447308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:05.447804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:05.448269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:05.449015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:05.449469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:05.449915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:05.674013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:05.685132 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-711a0c42-85b6-41ab-b876-a619474d7eec tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.267744 Aug 29 05:09:05.686772 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2032/4117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:05 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:05.693919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:05.713759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:05.715440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:05.717360 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c786a259-3c0e-488e-950a-ab220df583eb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.321660 Aug 29 05:09:05.717933 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2086/4118] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:05 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:05.926972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:05.927693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:05.934300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:05.935008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:05.935537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:05.936493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:05.940358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:05.940358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:05.991576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:05.992739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:05.999793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:06.000372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:06.000836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:06.001535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:06.002151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:06.002570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:06.120803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:06.130757 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f669d9f-f4e6-43a1-a1cb-6273659f1ed5 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.208318 Aug 29 05:09:06.132837 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2033/4119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:05 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:06.138943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5128ff20-42f6-47dd-9101-fb7fa38b4de7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab97e4af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:06.182275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:06.192782 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7c9531e1-5364-41b0-881c-1d7bbd1e8149 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.205763 Aug 29 05:09:06.194716 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5128ff20-42f6-47dd-9101-fb7fa38b4de7 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.060542 Aug 29 05:09:06.195303 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2034/4120] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:06 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:06.202646 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2087/4121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:05 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:06.718083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:06.718687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:06.721749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b327fb8b-ef44-432b-96b0-b75483fee9a5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6630291-76c5-4615-b385-fce5dfe5b6e1", "device": "/dev/sdb"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:06.724489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b327fb8b-ef44-432b-96b0-b75483fee9a5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:06.725024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:06.725505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:06.725933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:06.726660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:06.727063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:06.727480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:06.730997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b327fb8b-ef44-432b-96b0-b75483fee9a5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:06.731494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b327fb8b-ef44-432b-96b0-b75483fee9a5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:06.731923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b327fb8b-ef44-432b-96b0-b75483fee9a5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:06.732681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b327fb8b-ef44-432b-96b0-b75483fee9a5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:06.733135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b327fb8b-ef44-432b-96b0-b75483fee9a5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:06.733555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b327fb8b-ef44-432b-96b0-b75483fee9a5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:06.865650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:06.873424 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69a0719b-b078-4fa9-a44e-cb0b349f5509 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.160720 Aug 29 05:09:06.873998 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2035/4122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:06 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:06.878588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:06.879196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:06.884948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:06.885430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:06.885865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:06.886555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:06.887007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:06.887473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:07.077003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:07.086609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:07.088062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:07.089230 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9f013318-4672-4856-a479-8450e2afc941 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.214179 Aug 29 05:09:07.089776 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2036/4123] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:06 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:07.153636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:07.154381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:07.161451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:07.161964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:07.162407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:07.163118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:07.163582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:07.164255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:07.311986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:07.319832 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72067643-eb85-4375-8da7-bf5c0662d7ef tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.170294 Aug 29 05:09:07.320523 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2037/4124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:07 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:07.328522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:07.329295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:07.335490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:07.336057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:07.336638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:07.337392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:07.337837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:07.338250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:07.517672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:07.525546 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c493917d-b70a-4893-b143-020b6403db5c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.203735 Aug 29 05:09:07.526127 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2038/4125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:07 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:07.531587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-37fbbef4-f2f8-4c4c-ba07-287d1af6f178 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8bbbaf0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:07.574719 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-37fbbef4-f2f8-4c4c-ba07-287d1af6f178 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.047589 Aug 29 05:09:07.575488 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2039/4126] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:07 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:07.902073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:07.902683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:07.920367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:07.920873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:07.921307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:07.922025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:07.922490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:07.922913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:08.078817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:08.087909 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0de1109a-938e-489b-8812-b3aa3ba37a74 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.196767 Aug 29 05:09:08.088785 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2040/4127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:07 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:08.113852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:08.115093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:08.122313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:08.123122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:08.123631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:08.124524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:08.125180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:08.125836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:08.328564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:08.338356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:08.340021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:08.341294 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ee6e0ea-a85e-4e3b-a6d4-0884f35e9b0f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.231901 Aug 29 05:09:08.342038 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2041/4128] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:08 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:09:08.346580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:08.347345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:08.353231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:08.353705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:08.354128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:08.354843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:08.355397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:08.355828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:08.681831 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b327fb8b-ef44-432b-96b0-b75483fee9a5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "POST /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.963776 Aug 29 05:09:08.682561 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2088/4129] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:09:06 2022] POST /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036/os-volume_attachments => generated 194 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:09:08.697847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:08.699359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:08.711256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:08.712297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:08.712733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:08.713505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:08.713875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:08.714296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:08.736305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:08.751251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-14ad9b64-4a80-4a65-ad34-81c60f7bc2e3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.407470 Aug 29 05:09:08.764146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2042/4130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:08 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:08.764146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e4a14a2e-35da-4580-9900-7904654b4eae tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9677d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:08.855894 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e4a14a2e-35da-4580-9900-7904654b4eae tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.100296 Aug 29 05:09:08.857311 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2043/4131] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:08 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:09.110945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:09.112350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:09.122694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:09.123537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:09.124321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:09.125340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:09.126037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:09.126642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:09.423971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:09.441655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:09.448754 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9587030b-fcfd-41ee-8e36-6c1bae805a89 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.763945 Aug 29 05:09:09.462651 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2089/4132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:08 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:09.462651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:09.462651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:09.474051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:09.474756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:09.475565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:09.476633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:09.477242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:09.477922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:09.482145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:09.491767 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-08d6bc93-6ffd-4886-8c99-7f76f0a4747e tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.386488 Aug 29 05:09:09.493593 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2044/4133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:09 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:09.775071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:09.777052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:09.787182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:09.789074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:09.790218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:09.791536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:09.792398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:09.793183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:10.313020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:10.330199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:10.332097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:10.338628 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b36e1089-4d18-4648-af98-8f35edca9779 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.886538 Aug 29 05:09:10.339875 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2090/4134] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:09 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:10.344620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-58bffda8-bfac-4e32-9e7b-ae1bbc0bf636 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab9123040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:10.417983 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-58bffda8-bfac-4e32-9e7b-ae1bbc0bf636 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.076900 Aug 29 05:09:10.418634 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2091/4135] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:10 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:10.427453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c8c73f34-c23f-49ef-a2c0-eb900ad5de39 req-a6b7fb36-8c7a-429d-af34-7ad2a82bcc80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fd1a9f-a063-404a-b7c9-d5ac8059c254", "name": "network-vif-plugged", "status": "completed", "tag": "27834b14-8be1-4e5c-b649-9d78b9cd17fb"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:10.451150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c8c73f34-c23f-49ef-a2c0-eb900ad5de39 req-a6b7fb36-8c7a-429d-af34-7ad2a82bcc80 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:10.451637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c8c73f34-c23f-49ef-a2c0-eb900ad5de39 req-a6b7fb36-8c7a-429d-af34-7ad2a82bcc80 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:10.452069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c8c73f34-c23f-49ef-a2c0-eb900ad5de39 req-a6b7fb36-8c7a-429d-af34-7ad2a82bcc80 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:10.482772 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c8c73f34-c23f-49ef-a2c0-eb900ad5de39 req-a6b7fb36-8c7a-429d-af34-7ad2a82bcc80 service nova] Creating event network-vif-plugged:27834b14-8be1-4e5c-b649-9d78b9cd17fb for instance c8fd1a9f-a063-404a-b7c9-d5ac8059c254 on n-h1-854119-9 Aug 29 05:09:10.491175 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c8c73f34-c23f-49ef-a2c0-eb900ad5de39 req-a6b7fb36-8c7a-429d-af34-7ad2a82bcc80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071097 Aug 29 05:09:10.492072 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2092/4136] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:10.508013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:10.508752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:10.518196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:10.518946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:10.521539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:10.522453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:10.530164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:10.530856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:10.585670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:10.595193 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b6a4c7ce-44be-4d08-aafb-94db78de6683 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.825187 Aug 29 05:09:10.608941 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2045/4137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:09 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:10.614214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:10.615040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:10.633129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:10.633635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:10.634140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:10.634813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:10.635282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:10.635711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:10.646056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:11.231128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:11.239596 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3e05281a-f123-4f47-a19e-85e3ff0acb09 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.746289 Aug 29 05:09:11.244433 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2093/4138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:10 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:11.335164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:11.343828 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ee551bd-65f8-4699-a384-cc67a275f7e8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.733483 Aug 29 05:09:11.344464 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2046/4139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:10 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:11.364184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:11.364184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:11.378086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:11.378645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:11.379094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:11.382886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:11.383414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:11.383903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:11.433725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-85e5f8d0-3106-45c8-bcbc-139ce3a7bdf1 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b48d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:11.532273 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-85e5f8d0-3106-45c8-bcbc-139ce3a7bdf1 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.103138 Aug 29 05:09:11.532870 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2047/4140] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:11 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:11.633087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:11.634369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:11.641586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:11.642292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:11.642878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:11.643754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:11.644386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:11.644953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:11.777182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:11.793701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:11.795542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:11.798680 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-34a9cbe5-5d1c-4b26-8194-fbf7fa081c34 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.439669 Aug 29 05:09:11.812711 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2094/4141] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:11 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:11.934282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:11.943004 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b52a9e90-2c82-47e9-92b7-917e5132a4f0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.315143 Aug 29 05:09:11.946174 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2048/4142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:11 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:12.264348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:12.265996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:12.277214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:12.278012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:12.278675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:12.283257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:12.284058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:12.285904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:12.372481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:12.373559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:12.390531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:12.391412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:12.393642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:12.394952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:12.397549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:12.398338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:13.047556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:13.058118 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-884303c6-3fb6-4368-8c66-c58914df228a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.797974 Aug 29 05:09:13.062215 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2095/4143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:12 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:13.078286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8bb13a82-65ea-434e-8af0-e3b22943ed9a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b2d430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:13.164080 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8bb13a82-65ea-434e-8af0-e3b22943ed9a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.100689 Aug 29 05:09:13.164851 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2096/4144] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:13 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:13.178247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-18fc4d82-0774-4975-aef5-75092b8f13f2 req-22732ac3-7d77-4cb6-a0e4-b80b1da84b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d2207f-963c-488e-9d2a-4f4f6f0926c2", "name": "network-vif-plugged", "status": "completed", "tag": "d6c5968c-8f17-4d75-8060-1770f4239f5a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:13.215258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-18fc4d82-0774-4975-aef5-75092b8f13f2 req-22732ac3-7d77-4cb6-a0e4-b80b1da84b25 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:13.215789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-18fc4d82-0774-4975-aef5-75092b8f13f2 req-22732ac3-7d77-4cb6-a0e4-b80b1da84b25 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:13.216259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-18fc4d82-0774-4975-aef5-75092b8f13f2 req-22732ac3-7d77-4cb6-a0e4-b80b1da84b25 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:13.233356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:13.249107 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-845eda08-7554-484a-b2fd-feed6860b669 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1318 microversion: 2.1 time: 0.880444 Aug 29 05:09:13.264659 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2049/4145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:12 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:13.276048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-18fc4d82-0774-4975-aef5-75092b8f13f2 req-22732ac3-7d77-4cb6-a0e4-b80b1da84b25 service nova] Creating event network-vif-plugged:d6c5968c-8f17-4d75-8060-1770f4239f5a for instance 23d2207f-963c-488e-9d2a-4f4f6f0926c2 on n-h1-854119-9 Aug 29 05:09:13.279104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:13.282766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:13.298375 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-18fc4d82-0774-4975-aef5-75092b8f13f2 req-22732ac3-7d77-4cb6-a0e4-b80b1da84b25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127217 Aug 29 05:09:13.303507 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2097/4146] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:13.308682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:13.316229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:13.317044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:13.330091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:13.331103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:13.345160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:13.346849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:13.352038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:13.369529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:13.370383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:13.372836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:13.373784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:13.376139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:13.378156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:13.897638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:13.921425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:13.923447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:13.924870 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-658bd95c-9675-4592-a69e-a0dce3ae45bb tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.658765 Aug 29 05:09:13.925634 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2050/4147] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:13 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:13.943353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:13.959625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8fa88ce9-6a46-4307-a5a3-eb808aadffa8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.654495 Aug 29 05:09:13.965263 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2098/4148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:13 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:14.081342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:14.082781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:14.106762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.108431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.108893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:14.109644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.110114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.110540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:14.180238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b1af2e4-fcc5-4619-a2a6-5f82dd269ff0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd8af8b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:14.319274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:14.329621 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-656e0abd-ec53-4ab4-bda5-dc00c5487caa tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.253652 Aug 29 05:09:14.343647 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2051/4149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:14 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:14.369311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:14.370279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:14.381352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.382069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.382698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:14.383634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.384812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.385639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:14.394381 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b1af2e4-fcc5-4619-a2a6-5f82dd269ff0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.218873 Aug 29 05:09:14.394974 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2099/4150] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:14 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:14.612158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:14.625139 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39378c87-2d7d-48fe-8c92-008e3508de3c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1507 microversion: 2.1 time: 0.279234 Aug 29 05:09:14.628332 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2052/4151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:14 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:14.647491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:14.648396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:14.682301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.682783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.683223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:14.684312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.684977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.685619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:14.880518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:14.896941 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d771fa9a-3059-4703-b5e0-5e6b0c5a135b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1507 microversion: 2.1 time: 0.253583 Aug 29 05:09:14.898387 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2100/4152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:14 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:14.917399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98bd05f7-4b7e-45f2-a6c4-e0d93efb4bad tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:14.921440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-98bd05f7-4b7e-45f2-a6c4-e0d93efb4bad tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:14.935180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd05f7-4b7e-45f2-a6c4-e0d93efb4bad tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.935827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd05f7-4b7e-45f2-a6c4-e0d93efb4bad tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.936310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd05f7-4b7e-45f2-a6c4-e0d93efb4bad tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:14.937166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd05f7-4b7e-45f2-a6c4-e0d93efb4bad tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.937682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd05f7-4b7e-45f2-a6c4-e0d93efb4bad tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.938522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd05f7-4b7e-45f2-a6c4-e0d93efb4bad tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:14.953621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:14.954591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:14.962860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.965942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.967693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:14.968654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:14.971476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:14.972111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:15.045736 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-98bd05f7-4b7e-45f2-a6c4-e0d93efb4bad tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "PUT /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1079 microversion: 2.1 time: 0.131478 Aug 29 05:09:15.058013 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2053/4153] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:09:14 2022] PUT /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1079 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:15.058013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:15.058013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:15.061428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:15.061923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:15.062634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:15.063410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:15.063925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:15.064394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:15.321722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:15.330734 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa0ec57f-8710-466c-8fa7-cde0da6298d3 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.282535 Aug 29 05:09:15.348711 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2054/4154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:15 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:15.349067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:15.355601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:15.362343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:15.363620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:15.365424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:15.367140 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71bbf6b1-2c3e-4f98-828c-cff1e8f55cc5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.417898 Aug 29 05:09:15.368328 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2101/4155] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:14 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:15.373508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:15.377602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:15.380091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:15.380347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:15.381396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:15.382726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:15.384508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:15.385884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:15.388939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:15.389177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:15.389978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:15.390993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:15.392006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:15.392616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:15.694796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:15.716475 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc62da06-e738-49ac-a763-c79804e7c6a7 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1505 microversion: 2.1 time: 0.364263 Aug 29 05:09:15.717544 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2055/4156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:15 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:15.749727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8ead752-3e17-40c1-a42c-621a0a5e4673 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd847550>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:15.768705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:15.782031 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-267531ad-c346-4cf6-b32f-895ce0f5af1e tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.412395 Aug 29 05:09:15.785297 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2102/4157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:15 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:15.797285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:15.807028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:15.830313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:15.837467 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8ead752-3e17-40c1-a42c-621a0a5e4673 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.102972 Aug 29 05:09:15.838265 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2056/4158] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:15 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:15.838653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:15.839316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:15.840093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:15.840658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:15.841090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.065555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:16.088943 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9cdc1519-53d0-4338-b577-1ba2740bce55 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1505 microversion: 2.1 time: 0.302039 Aug 29 05:09:16.089515 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2103/4159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:15 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:16.110345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c3baa82f-ee83-49e0-a937-775e844730c8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:16.112919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c3baa82f-ee83-49e0-a937-775e844730c8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:16.119202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3baa82f-ee83-49e0-a937-775e844730c8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.119691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3baa82f-ee83-49e0-a937-775e844730c8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.120932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3baa82f-ee83-49e0-a937-775e844730c8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.122580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3baa82f-ee83-49e0-a937-775e844730c8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.123187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3baa82f-ee83-49e0-a937-775e844730c8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.123766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3baa82f-ee83-49e0-a937-775e844730c8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.228230 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c3baa82f-ee83-49e0-a937-775e844730c8 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "PUT /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1081 microversion: 2.1 time: 0.121840 Aug 29 05:09:16.228915 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2057/4160] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:09:16 2022] PUT /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1081 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:16.250848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:16.251975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:16.258739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.259508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.260181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.261238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.261982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.262632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.355681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:16.357692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:16.366885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.368832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.373872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.375473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.377087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.377755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.426941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:16.443689 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6ea75db8-abca-45f3-bee3-20b7ed46034b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1507 microversion: 2.1 time: 0.196500 Aug 29 05:09:16.458358 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2104/4161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:16 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:16.490218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:16.490874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:16.500042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.500832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.501425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.502660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.503270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.503847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.905114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:16.945834 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dd8ee39e-4f71-4244-8d89-be902d80e3f6 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.594036 Aug 29 05:09:16.949475 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2058/4162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:16 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:16.957287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:16.958693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:16.968614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.970143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.970869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.972434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:16.972872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:16.973451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:16.988326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:16.998604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:17.005063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:17.009014 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-58f9fa9f-a8d5-4a19-b32d-116488e0a0cc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.528957 Aug 29 05:09:17.028303 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2105/4163] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:16 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:17.033861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:17.034680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:17.041655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.044377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.045148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:17.048446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.049840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.050572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:17.360350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:17.373590 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b650e231-cb61-4693-8f24-a96bb5698ad0 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1507 microversion: 2.1 time: 0.422853 Aug 29 05:09:17.377240 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2059/4164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:16 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1507 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:17.384469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b74ccd14-e650-44be-89bf-6c8e58ff1431 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8a89430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:17.399622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:17.411208 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13f73e52-bfbb-40d8-b0e0-415197b2b02c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1312 microversion: 2.1 time: 0.381524 Aug 29 05:09:17.416226 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2106/4165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:17 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1312 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:17.436886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:17.437460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:17.442201 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b74ccd14-e650-44be-89bf-6c8e58ff1431 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.063741 Aug 29 05:09:17.448988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.449475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.449939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:17.450656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.450897 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2060/4166] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:17 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:17.451265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.451702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:17.485827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:09:17.608334 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8de6526d-6759-4412-993d-5e8b52a33ed3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 204 len: 0 microversion: 2.1 time: 0.185494 Aug 29 05:09:17.608987 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2107/4167] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:09:17 2022] DELETE /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:17.622195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:17.622866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:17.630489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.631156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.631729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:17.632618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.633501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.635015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:17.666512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:09:17.749315 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Instance is already in deleting state, ignoring this request Aug 29 05:09:17.750275 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf09469f-7e8d-4d3f-ac88-9c4f3e63bc47 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 204 len: 0 microversion: 2.1 time: 0.132694 Aug 29 05:09:17.750870 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2061/4168] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:09:17 2022] DELETE /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:17.760770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:17.761800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:17.769424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.770193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.770820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:17.771746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.772458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.773070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:17.944351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:17.958875 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2940d6b1-0067-4fa2-b4ec-66a69d3014d1 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1513 microversion: 2.1 time: 0.203024 Aug 29 05:09:17.959974 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2108/4169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:17 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:17.970188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:17.971053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:17.978361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.979263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.979913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:17.980918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:17.981593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:17.982087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:18.035214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:18.036277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:18.042664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:18.043424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:18.043998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:18.044859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:18.045452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:18.046048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:18.071165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:18.261227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:18.273579 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8282f368-2d6d-42d2-9715-78b5b1898668 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1523 microversion: 2.1 time: 0.307486 Aug 29 05:09:18.274701 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2062/4170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:17 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:18.297219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:18.306932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:18.308375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:18.309748 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-608d596c-9335-4eb0-9ed4-0088c5a8e3c6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.278541 Aug 29 05:09:18.324499 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2109/4171] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:18 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:18.437991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:18.439310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:18.448341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:18.449137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:18.449819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:18.450712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:18.453357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:18.453985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:18.461995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ed37b3a-defc-47c4-99c2-77521ca381dc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab91c5dc0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:18.463884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:18.603195 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ed37b3a-defc-47c4-99c2-77521ca381dc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.148955 Aug 29 05:09:18.611033 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2110/4172] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:18 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:18.642836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:18.652685 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-63e69b81-aca4-4705-9b05-48b456e024ee tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1495 microversion: 2.1 time: 0.218899 Aug 29 05:09:18.653313 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2063/4173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:18 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1495 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:18.980227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:18.980910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:18.991473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:18.992885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:18.993477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:18.994346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:18.994960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:18.995391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:19.295029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:19.295929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:19.301915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:19.308803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:19.311893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:19.312700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:19.313298 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0aade54-e1d8-4b6d-805c-9f15a237cfc3 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1513 microversion: 2.1 time: 0.336250 Aug 29 05:09:19.313897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:19.314478 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2111/4174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:18 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1513 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:19.314683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:19.315118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:19.338321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:19.338942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:19.354509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:19.355007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:19.355442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:19.356684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:19.359021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:19.360769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:19.737481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:19.752277 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b3c0963d-d38b-4aca-81bf-442cd23f8aab tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1503 microversion: 2.1 time: 0.457846 Aug 29 05:09:19.753741 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2064/4175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:19 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1503 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:19.758877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4253f70a-b8f9-4757-b1ff-da50fea402a6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8ad7d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:19.849370 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4253f70a-b8f9-4757-b1ff-da50fea402a6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.094216 Aug 29 05:09:19.850097 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2065/4176] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:19 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:19.860789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-40839774-d9b2-401b-888f-97e8c93c6687 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Action: 'create', calling method: .version_select at 0x7f1ab8ad7940>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-628567055", "description": "tempest-description-1479861761"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:20.229084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:20.241515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:20.243414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:20.245763 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dec293f9-32b7-47c4-9116-6d27c1e73c76 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.912904 Aug 29 05:09:20.247703 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2112/4177] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:19 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:20.339521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:20.340552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:20.353230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:20.353931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:20.354552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:20.355450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:20.356877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:20.357677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:21.170322 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-40839774-d9b2-401b-888f-97e8c93c6687 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.319062 Aug 29 05:09:21.170934 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2066/4178] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Aug 29 05:09:19 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:21.176778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c2e735f-1bdc-4300-bdaa-c475477d33c6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8690430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:21.191646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:21.201711 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-afbfa213-ca80-4c9b-bfe8-fb5482de3b6a tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1513 microversion: 2.1 time: 0.866642 Aug 29 05:09:21.205032 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2113/4179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:20 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1513 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:21.225334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-628567055"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:21.226194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:21.228657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:21.234026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:21.235250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:21.235887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:21.236845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:21.237838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:21.238591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:21.322451 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c2e735f-1bdc-4300-bdaa-c475477d33c6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.150184 Aug 29 05:09:21.323167 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2067/4180] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:21 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:21.343715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:21.349804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:21.382495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:21.383002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:21.383478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:21.384221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:21.384701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:21.385191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:21.591988 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.network.security_group_api [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Adding security group 9ef0d07b-da19-4eb7-986a-9700f93c2cb8 to port 02ece434-f770-4816-b5a3-6ceebff2b6fc Aug 29 05:09:22.041563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:22.061479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:22.064571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:22.066310 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f21baa2d-fe04-4d94-9292-6c1ac459312c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.732512 Aug 29 05:09:22.081889 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2068/4181] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:21 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:22.091991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-9259de96-fe54-4272-bc62-75b4864ce300 req-0d22d9be-d545-4f19-8139-f277eb227b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fd1a9f-a063-404a-b7c9-d5ac8059c254", "name": "network-vif-deleted", "tag": "27834b14-8be1-4e5c-b649-9d78b9cd17fb"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:22.125272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9259de96-fe54-4272-bc62-75b4864ce300 req-0d22d9be-d545-4f19-8139-f277eb227b18 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:22.126011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9259de96-fe54-4272-bc62-75b4864ce300 req-0d22d9be-d545-4f19-8139-f277eb227b18 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:22.126660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9259de96-fe54-4272-bc62-75b4864ce300 req-0d22d9be-d545-4f19-8139-f277eb227b18 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:22.156835 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-9259de96-fe54-4272-bc62-75b4864ce300 req-0d22d9be-d545-4f19-8139-f277eb227b18 service nova] Creating event network-vif-deleted:27834b14-8be1-4e5c-b649-9d78b9cd17fb for instance c8fd1a9f-a063-404a-b7c9-d5ac8059c254 on n-h1-854119-9 Aug 29 05:09:22.165561 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-9259de96-fe54-4272-bc62-75b4864ce300 req-0d22d9be-d545-4f19-8139-f277eb227b18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078217 Aug 29 05:09:22.166549 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2069/4182] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:22.234442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:22.237497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:22.251722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:22.254203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:22.254865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:22.259212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:22.259961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:22.260639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:22.311666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:22.314110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:22.314712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:22.315276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lazy-loading 'fault' on Instance uuid c8fd1a9f-a063-404a-b7c9-d5ac8059c254 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:09:22.418905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:22.436228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c4b23dee-4eec-45a9-9d13-d36148a81a4b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1308 microversion: 2.1 time: 0.204873 Aug 29 05:09:22.439810 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2070/4183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:22 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:22.465891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ebd0221-0197-4ce4-9aa6-6e84ca213a9f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8ad7670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:22.550088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8ebd0221-0197-4ce4-9aa6-6e84ca213a9f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.106520 Aug 29 05:09:22.552860 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2071/4184] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:22 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:22.674052 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f9ebe00d-6029-49de-b636-d197fcec5619 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action" status: 202 len: 0 microversion: 2.1 time: 1.467614 Aug 29 05:09:22.674685 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2114/4185] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:09:21 2022] POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action => generated 0 bytes in 1469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:09:22.683220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-628567055"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:22.684445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:22.697617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:22.698128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:22.698578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:22.699312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:22.699808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:22.719104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:22.953761 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.network.security_group_api [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Removing security group 9ef0d07b-da19-4eb7-986a-9700f93c2cb8 from port 02ece434-f770-4816-b5a3-6ceebff2b6fc Aug 29 05:09:23.102700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:23.107985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:23.125483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:23.125979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:23.126416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:23.127134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:23.127586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:23.128012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:23.494483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:23.512041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:23.513865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:23.515878 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-040f64e6-d169-4436-985b-923664cad2b0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.425689 Aug 29 05:09:23.516657 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2115/4186] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:23 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:09:23.534158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:23.535204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:23.553320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:23.556087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:23.557843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:23.561241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:23.562302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:23.565906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:23.617601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:09:23.686945 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8700f8e5-7841-4ed3-8e0c-59ad6e25f0bc tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action" status: 202 len: 0 microversion: 2.1 time: 1.004299 Aug 29 05:09:23.690888 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2072/4187] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:09:22 2022] POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action => generated 0 bytes in 1012 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:09:23.714258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:23.715512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:23.729504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:23.730594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:23.731316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:23.732501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:23.733225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:23.733853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:23.785381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:23.786300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:23.786945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:23.788938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lazy-loading 'fault' on Instance uuid c8fd1a9f-a063-404a-b7c9-d5ac8059c254 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:09:23.865424 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8434c396-460b-4ea5-abdd-c0cc82a7436a tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "DELETE /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 204 len: 0 microversion: 2.1 time: 0.347347 Aug 29 05:09:23.866035 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2116/4188] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:09:23 2022] DELETE /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:23.888944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-520ff3da-8cbe-4ee0-b625-cf1a725f044c tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd949c10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:23.947174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00048986d35b4cb1934a71d10a851d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062852699f4a47e98070dc8ae543db6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:23.963830 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f09acd3e-21e1-46e2-9a43-a796803a17db tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 200 len: 1308 microversion: 2.1 time: 0.265041 Aug 29 05:09:23.965863 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2073/4189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:23 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:23.972146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98f416a3-ef45-4cd9-b0fa-0145bf1690b0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Action: 'create', calling method: .version_select at 0x7f1abd847e50>, body: {"pool": null} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:24.013625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-520ff3da-8cbe-4ee0-b625-cf1a725f044c tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.132170 Aug 29 05:09:24.014229 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2117/4190] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:23 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:24.023098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:24.037851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:24.049119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:24.051029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:24.051661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:24.057719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:24.058473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:24.059260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:24.428511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:24.442555 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3c7956a1-6849-4cdb-b41a-0a61eba39547 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1501 microversion: 2.1 time: 0.423206 Aug 29 05:09:24.443331 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2118/4191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:24 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:24.460632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ce23b910-c3d4-4c1f-9326-b1b9c8a986fb req-278542f7-a683-48d3-af5c-d2c651da9b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c461c080-6686-43e2-9daa-c00ef907fcd9", "tag": "02ece434-f770-4816-b5a3-6ceebff2b6fc"}, {"name": "network-changed", "server_uuid": "c461c080-6686-43e2-9daa-c00ef907fcd9", "tag": "02ece434-f770-4816-b5a3-6ceebff2b6fc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:24.475542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ce23b910-c3d4-4c1f-9326-b1b9c8a986fb req-278542f7-a683-48d3-af5c-d2c651da9b02 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:24.482393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ce23b910-c3d4-4c1f-9326-b1b9c8a986fb req-278542f7-a683-48d3-af5c-d2c651da9b02 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:24.483251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ce23b910-c3d4-4c1f-9326-b1b9c8a986fb req-278542f7-a683-48d3-af5c-d2c651da9b02 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:24.510946 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ce23b910-c3d4-4c1f-9326-b1b9c8a986fb req-278542f7-a683-48d3-af5c-d2c651da9b02 service nova] Creating event network-changed:02ece434-f770-4816-b5a3-6ceebff2b6fc for instance c461c080-6686-43e2-9daa-c00ef907fcd9 on n-h1-854119-9 Aug 29 05:09:24.514631 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ce23b910-c3d4-4c1f-9326-b1b9c8a986fb req-278542f7-a683-48d3-af5c-d2c651da9b02 service nova] Creating event network-changed:02ece434-f770-4816-b5a3-6ceebff2b6fc for instance c461c080-6686-43e2-9daa-c00ef907fcd9 on n-h1-854119-9 Aug 29 05:09:24.530250 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ce23b910-c3d4-4c1f-9326-b1b9c8a986fb req-278542f7-a683-48d3-af5c-d2c651da9b02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085439 Aug 29 05:09:24.531254 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2119/4192] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:24.545587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:24.546812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:24.559621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:24.566975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:24.567651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:24.568572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:24.569138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:24.569733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:25.400774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:25.412278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:25.424346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:25.425600 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d02ec280-2ec3-4526-82df-2b2e49e9e467 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.887818 Aug 29 05:09:25.426599 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2120/4193] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:24 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:25.431592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:25.438173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: c8fd1a9f-a063-404a-b7c9-d5ac8059c254] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:25.447305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:25.455226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:25.455754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:25.456698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:25.457190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:25.457628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:25.498506 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] HTTP exception thrown: Instance c8fd1a9f-a063-404a-b7c9-d5ac8059c254 could not be found. Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Request method failure captured: Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 HTTP/1.1 Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkwMuz_ZECEF_vTMgmpFRGfO3kOqjJmfoGjL5LRQRZNtp05U_UiNHgWc6zVK4zDXi2343o0Xc_NJO1n7ZCi-GFGoYBOEfehIUZAh48XjXDu7TAtbfIV_aICnaKnjukfJ2cqIwQUX8w1IKO2LFO6ZBZJZHOJFsZEda-78hNkWbdKQk0 Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_062852699f4a47e98070dc8ae543db6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 00048986d35b4cb1934a71d10a851d6d Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance c8fd1a9f-a063-404a-b7c9-d5ac8059c254 could not be found. Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'c8fd1a9f-a063-404a-b7c9-d5ac8059c254'} Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fd1a9f-a063-404a-b7c9-d5ac8059c254 could not be found. Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fd1a9f-a063-404a-b7c9-d5ac8059c254 could not be found. Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:25.504588 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:25.509285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:25.509285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:25.509285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:25.509285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:09:25.509285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:09:25.509285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fd1a9f-a063-404a-b7c9-d5ac8059c254 could not be found. Aug 29 05:09:25.509285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:25.509285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Returning 404 to user: Instance c8fd1a9f-a063-404a-b7c9-d5ac8059c254 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:09:25.510014 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d5740a2-054b-45ea-91a5-320875838373 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254" status: 404 len: 111 microversion: 2.1 time: 0.078324 Aug 29 05:09:25.514061 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2121/4194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:25 2022] GET /compute/v2.1/servers/c8fd1a9f-a063-404a-b7c9-d5ac8059c254 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:09:25.520420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1fe1ad10-0c13-4896-89df-d99b2172816d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8b49280>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:25.587914 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1fe1ad10-0c13-4896-89df-d99b2172816d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.072677 Aug 29 05:09:25.588788 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2122/4195] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:25 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:25.603131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:25.604043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:25.610803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:25.611531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:25.612149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:25.613024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:25.613629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:25.614199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.167579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:26.180462 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-89382769-6ee8-440e-a995-418d709a750c tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1501 microversion: 2.1 time: 0.582403 Aug 29 05:09:26.181304 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2123/4196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:25 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1501 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:26.191926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:26.194596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:26.210711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.211209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.211651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.227019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.228501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.229497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.248502 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] HTTP exception thrown: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Request method failure captured: Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 HTTP/1.1 Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkwMuz_ZECEF_vTMgmpFRGfO3kOqjJmfoGjL5LRQRZNtp05U_UiNHgWc6zVK4zDXi2343o0Xc_NJO1n7ZCi-GFGoYBOEfehIUZAh48XjXDu7TAtbfIV_aICnaKnjukfJ2cqIwQUX8w1IKO2LFO6ZBZJZHOJFsZEda-78hNkWbdKQk0 Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_062852699f4a47e98070dc8ae543db6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 00048986d35b4cb1934a71d10a851d6d Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8ae7b907-079c-4ae2-806b-1cc81f663e39'} Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:09:26.250561 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.254795 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.257841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Returning 404 to user: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:09:26.258911 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a95224b0-bd68-4f9e-9300-1764b8cf824c tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 404 len: 111 microversion: 2.1 time: 0.073654 Aug 29 05:09:26.259700 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2124/4197] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:09:26 2022] DELETE /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:09:26.269598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:26.271053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 8ae7b907-079c-4ae2-806b-1cc81f663e39] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:26.278372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.279678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.281520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.282811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.283463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.284279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.302891 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] HTTP exception thrown: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Request method failure captured: Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 HTTP/1.1 Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkwMuz_ZECEF_vTMgmpFRGfO3kOqjJmfoGjL5LRQRZNtp05U_UiNHgWc6zVK4zDXi2343o0Xc_NJO1n7ZCi-GFGoYBOEfehIUZAh48XjXDu7TAtbfIV_aICnaKnjukfJ2cqIwQUX8w1IKO2LFO6ZBZJZHOJFsZEda-78hNkWbdKQk0 Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_062852699f4a47e98070dc8ae543db6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 00048986d35b4cb1934a71d10a851d6d Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8ae7b907-079c-4ae2-806b-1cc81f663e39'} Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:26.305384 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.309240 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.309240 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:26.309240 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:26.309240 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:09:26.309240 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:09:26.309240 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. Aug 29 05:09:26.309240 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.311211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Returning 404 to user: Instance 8ae7b907-079c-4ae2-806b-1cc81f663e39 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:09:26.312469 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e75f22d-6e40-4bcb-83a9-5866a413d59d tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39" status: 404 len: 111 microversion: 2.1 time: 0.047754 Aug 29 05:09:26.313527 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2125/4198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:26 2022] GET /compute/v2.1/servers/8ae7b907-079c-4ae2-806b-1cc81f663e39 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:09:26.322158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:26.322930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:26.330397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.331330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.331956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.333341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.334014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.334626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.353530 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] HTTP exception thrown: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Request method failure captured: Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b HTTP/1.1 Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkwMuz_ZECEF_vTMgmpFRGfO3kOqjJmfoGjL5LRQRZNtp05U_UiNHgWc6zVK4zDXi2343o0Xc_NJO1n7ZCi-GFGoYBOEfehIUZAh48XjXDu7TAtbfIV_aICnaKnjukfJ2cqIwQUX8w1IKO2LFO6ZBZJZHOJFsZEda-78hNkWbdKQk0 Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_062852699f4a47e98070dc8ae543db6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 00048986d35b4cb1934a71d10a851d6d Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '27d2be2f-eb5c-4b80-a822-cf3e1c839b9b'} Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:09:26.356072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.359641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.361457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Returning 404 to user: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:09:26.362492 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-41ee710f-0ef3-4826-b7a8-3457ace38f3b tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 404 len: 111 microversion: 2.1 time: 0.044834 Aug 29 05:09:26.363545 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2126/4199] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:09:26 2022] DELETE /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:09:26.377180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:26.378202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] [instance: 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:26.385412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.386204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.386800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.387794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.388434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.389016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.407844 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] HTTP exception thrown: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Request method failure captured: Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b HTTP/1.1 Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEkwMuz_ZECEF_vTMgmpFRGfO3kOqjJmfoGjL5LRQRZNtp05U_UiNHgWc6zVK4zDXi2343o0Xc_NJO1n7ZCi-GFGoYBOEfehIUZAh48XjXDu7TAtbfIV_aICnaKnjukfJ2cqIwQUX8w1IKO2LFO6ZBZJZHOJFsZEda-78hNkWbdKQk0 Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_062852699f4a47e98070dc8ae543db6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/062852699f4a47e98070dc8ae543db6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 062852699f4a47e98070dc8ae543db6a Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1405841779 Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 00048986d35b4cb1934a71d10a851d6d Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerDiskConfigTestJSON-1405841779-project Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '27d2be2f-eb5c-4b80-a822-cf3e1c839b9b'} Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:26.410139 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.414169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:26.414169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:26.414169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:26.414169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:09:26.414169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:09:26.414169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. Aug 29 05:09:26.414169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:26.415771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] Returning 404 to user: Instance 27d2be2f-eb5c-4b80-a822-cf3e1c839b9b could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:09:26.416891 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1f8289e3-de6d-43f5-87f4-7c4abb565015 tempest-ServerDiskConfigTestJSON-1405841779 tempest-ServerDiskConfigTestJSON-1405841779-project] 10.222.0.20 "GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b" status: 404 len: 111 microversion: 2.1 time: 0.047692 Aug 29 05:09:26.417713 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2127/4200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:26 2022] GET /compute/v2.1/servers/27d2be2f-eb5c-4b80-a822-cf3e1c839b9b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:09:26.456311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:26.457234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:26.467671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.470314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.470959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:26.472004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:26.472700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:26.473799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:27.951882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:28.060493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:28.065099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:28.089233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09892524-9585-478a-94b6-407775095ae0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 1.639359 Aug 29 05:09:28.119363 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2128/4201] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:26 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:09:28.140614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab1635f1-9a99-412c-92a7-98c1120a30b6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd949ee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:28.266231 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-98f416a3-ef45-4cd9-b0fa-0145bf1690b0 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.297113 Aug 29 05:09:28.266992 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2074/4202] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Aug 29 05:09:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:28.285475 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab1635f1-9a99-412c-92a7-98c1120a30b6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1453 microversion: 2.1 time: 0.162863 Aug 29 05:09:28.286336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:28.297038 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2129/4203] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:28 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:28.298324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:28.310846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.118"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:28.315486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=90 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:28.344529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:28.346972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:28.358262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:28.362237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:28.363235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:28.369578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:28.370026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:28.391623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:28.393526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:28.400087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:28.404780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:28.411848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:28.413223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:28.491828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "refresh_cache-c461c080-6686-43e2-9daa-c00ef907fcd9" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 05:09:28.492336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquired lock "refresh_cache-c461c080-6686-43e2-9daa-c00ef907fcd9" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 05:09:28.713982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:28.725960 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e9e10db-5a5d-4ca5-bc2c-de55a3ff4e0d tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1459 microversion: 2.1 time: 0.450696 Aug 29 05:09:28.727873 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2075/4204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:28 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1459 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:28.890292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-961c2d08-9156-465a-8d1c-577a3b261d40 req-0dafdd71-fac5-442f-8849-c4de8f2275ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d2207f-963c-488e-9d2a-4f4f6f0926c2", "name": "network-vif-deleted", "tag": "d6c5968c-8f17-4d75-8060-1770f4239f5a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:28.921163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-961c2d08-9156-465a-8d1c-577a3b261d40 req-0dafdd71-fac5-442f-8849-c4de8f2275ed service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:28.921664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-961c2d08-9156-465a-8d1c-577a3b261d40 req-0dafdd71-fac5-442f-8849-c4de8f2275ed service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:28.926247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-961c2d08-9156-465a-8d1c-577a3b261d40 req-0dafdd71-fac5-442f-8849-c4de8f2275ed service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:28.963527 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-961c2d08-9156-465a-8d1c-577a3b261d40 req-0dafdd71-fac5-442f-8849-c4de8f2275ed service nova] Creating event network-vif-deleted:d6c5968c-8f17-4d75-8060-1770f4239f5a for instance 23d2207f-963c-488e-9d2a-4f4f6f0926c2 on n-h1-854119-9 Aug 29 05:09:28.969463 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-961c2d08-9156-465a-8d1c-577a3b261d40 req-0dafdd71-fac5-442f-8849-c4de8f2275ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084095 Aug 29 05:09:28.971083 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2076/4205] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:09:29.120894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:29.122056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:29.135401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:29.136234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:29.137108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:29.138315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:29.139177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:29.139806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:29.814718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:29.835576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:29.839062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:29.840399 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69aad015-1373-48e9-aec7-18566c9acbff tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.724889 Aug 29 05:09:29.840975 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2077/4206] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:29 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:09:29.860595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d52851d-cb38-452a-8835-366b42dfbbd4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8690ca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:29.967195 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d52851d-cb38-452a-8835-366b42dfbbd4 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1462 microversion: 2.1 time: 0.118398 Aug 29 05:09:29.968680 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2078/4207] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:29 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1462 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:29.974957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:29.976050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:29.990092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:29.991137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:29.991779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:29.992766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:29.993463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:29.994093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:30.054140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:30.057724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:30.059339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:30.061372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lazy-loading 'fault' on Instance uuid 23d2207f-963c-488e-9d2a-4f4f6f0926c2 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:09:30.767256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd908a07c67bb4cf2a8342dea5db1ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f947e806fdf4a7f861e4f16217d5dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:30.776837 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3cf95a28-da8b-4524-8ef2-c1f252506169 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 200 len: 1302 microversion: 2.1 time: 0.805593 Aug 29 05:09:30.779325 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2079/4208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:29 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 1302 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:30.796285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-46ea2669-722e-4da2-b25b-e7f576a134d5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd847940>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:30.882640 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-46ea2669-722e-4da2-b25b-e7f576a134d5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 200 len: 1462 microversion: 2.1 time: 0.100413 Aug 29 05:09:30.883722 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2080/4209] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:30 2022] GET /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 1462 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:30.901754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:30.902586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:30.921216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:30.926269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:30.926992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:30.928105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:30.928741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:30.929320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:31.423903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:31.436684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:31.448776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:31.453153 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bbfffe78-d192-46da-af81-43532c6251c7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.568256 Aug 29 05:09:31.472558 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2081/4210] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:30 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:31.484018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:31.490222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:31.525560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:31.529176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:31.541193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:31.545759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:31.546465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:31.547082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:32.085991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:32.094245 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e73514b-1a7c-48da-9e83-acdcf586a620 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250" status: 200 len: 1466 microversion: 2.1 time: 0.620215 Aug 29 05:09:32.094814 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2082/4211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:31 2022] GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 => generated 1466 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:32.113793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:32.114411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] [instance: 23d2207f-963c-488e-9d2a-4f4f6f0926c2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:32.142244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:32.144421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:32.144962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:32.145778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:32.148576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:32.149246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:32.167772 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] HTTP exception thrown: Instance 23d2207f-963c-488e-9d2a-4f4f6f0926c2 could not be found. Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Request method failure captured: Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 HTTP/1.1 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEna4eYIDrpmHE9l3nzsi3GGWqwhdgt2mEUWmHYujdG7LJQ7g5lLtmzqmUUZy2sngExkBlwKFBC7pQ6J0vmhNiAbAEfJGlmAsgJXgA-xqBGui1GuycLl1IlSkpIPu5TxIo0wFYw-_VAU0JCBAXIwHcv_euwXlO55AgzbHI-Hjx95_X0 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0f947e806fdf4a7f861e4f16217d5dd8 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesActionsTest-933381985 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f947e806fdf4a7f861e4f16217d5dd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f947e806fdf4a7f861e4f16217d5dd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f947e806fdf4a7f861e4f16217d5dd8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f947e806fdf4a7f861e4f16217d5dd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesActionsTest-933381985 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0f947e806fdf4a7f861e4f16217d5dd8 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesActionsTest-933381985 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesActionsTest-933381985-project Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d908a07c67bb4cf2a8342dea5db1ca17 Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesActionsTest-933381985-project Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 23d2207f-963c-488e-9d2a-4f4f6f0926c2 could not be found. Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '23d2207f-963c-488e-9d2a-4f4f6f0926c2'} Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d2207f-963c-488e-9d2a-4f4f6f0926c2 could not be found. Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d2207f-963c-488e-9d2a-4f4f6f0926c2 could not be found. Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:32.169880 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:32.173491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:32.173491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:32.173491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:32.173491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:09:32.173491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:09:32.173491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d2207f-963c-488e-9d2a-4f4f6f0926c2 could not be found. Aug 29 05:09:32.173491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:32.175257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] Returning 404 to user: Instance 23d2207f-963c-488e-9d2a-4f4f6f0926c2 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:09:32.176347 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-76f3d18f-f2d1-4ef4-9021-6cbc12fba973 tempest-VolumesActionsTest-933381985 tempest-VolumesActionsTest-933381985-project] 10.222.0.20 "GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2" status: 404 len: 111 microversion: 2.1 time: 0.074210 Aug 29 05:09:32.180646 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2083/4212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:32 2022] GET /compute/v2.1/servers/23d2207f-963c-488e-9d2a-4f4f6f0926c2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:09:32.185621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af24fc67-696a-47c6-ab1d-89a16ae909be tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd820700>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:32.344824 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af24fc67-696a-47c6-ab1d-89a16ae909be tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-08-29T05%3A06%3A54Z" status: 200 len: 1897 microversion: 2.1 time: 0.162792 Aug 29 05:09:32.346514 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2084/4213] 10.222.0.20 () {58 vars in 1199 bytes} [Mon Aug 29 05:09:32 2022] GET /compute/v2.1/images?changes-since=2022-08-29T05%3A06%3A54Z => generated 1897 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:32.359904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ddfe1cd-b757-4bbb-ab89-41abf3c25d2f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8ad7040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:32.445192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Building network info cache for instance {{(pid=128872) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 05:09:32.483634 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ddfe1cd-b757-4bbb-ab89-41abf3c25d2f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-911294193" status: 200 len: 484 microversion: 2.1 time: 0.127410 Aug 29 05:09:32.485147 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2085/4214] 10.222.0.20 () {58 vars in 1229 bytes} [Mon Aug 29 05:09:32 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-911294193 => generated 484 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:09:32.500512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:32.502397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:32.515549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:32.516054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:32.516528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:32.517253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:32.517712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:32.518140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:33.096804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:33.114588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:33.116476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:33.117770 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-41652ca2-56ec-4d15-99ee-1cbb25638f9c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.631484 Aug 29 05:09:33.140267 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2086/4215] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:32 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:33.152590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0da120c2-401c-4ced-9b6c-e88b18aff78e req-656a71a6-5a01-4b4a-9a9d-caa6951b5247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c461c080-6686-43e2-9daa-c00ef907fcd9", "tag": "02ece434-f770-4816-b5a3-6ceebff2b6fc"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:33.175713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0da120c2-401c-4ced-9b6c-e88b18aff78e req-656a71a6-5a01-4b4a-9a9d-caa6951b5247 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:33.176227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0da120c2-401c-4ced-9b6c-e88b18aff78e req-656a71a6-5a01-4b4a-9a9d-caa6951b5247 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:33.176662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0da120c2-401c-4ced-9b6c-e88b18aff78e req-656a71a6-5a01-4b4a-9a9d-caa6951b5247 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:33.208419 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0da120c2-401c-4ced-9b6c-e88b18aff78e req-656a71a6-5a01-4b4a-9a9d-caa6951b5247 service nova] Creating event network-changed:02ece434-f770-4816-b5a3-6ceebff2b6fc for instance c461c080-6686-43e2-9daa-c00ef907fcd9 on n-h1-854119-9 Aug 29 05:09:33.221315 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0da120c2-401c-4ced-9b6c-e88b18aff78e req-656a71a6-5a01-4b4a-9a9d-caa6951b5247 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077494 Aug 29 05:09:33.226950 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2087/4216] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:33.233893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9d1431f7-4876-42af-b8e6-07990064c433 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8ad7d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:33.332712 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9d1431f7-4876-42af-b8e6-07990064c433 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images?server=a557400d-1409-4dff-b0ae-8b54fd922250" status: 200 len: 955 microversion: 2.1 time: 0.104343 Aug 29 05:09:33.333548 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2088/4217] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Aug 29 05:09:33 2022] GET /compute/v2.1/images?server=a557400d-1409-4dff-b0ae-8b54fd922250 => generated 955 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:33.348154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-38f8a6fd-0a88-449d-bddc-d3121469cd40 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd81daf0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:33.529265 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-38f8a6fd-0a88-449d-bddc-d3121469cd40 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2Fb69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 483 microversion: 2.1 time: 0.184900 Aug 29 05:09:33.542363 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2089/4218] 10.222.0.20 () {58 vars in 1317 bytes} [Mon Aug 29 05:09:33 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2Fb69b5de3-eef5-4ed2-a45c-155cb560423b => generated 483 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:33.554907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-200875db-69a1-48be-8bc0-39d66d4192a6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8ad74c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:33.637897 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-200875db-69a1-48be-8bc0-39d66d4192a6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2Fb69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 483 microversion: 2.1 time: 0.093837 Aug 29 05:09:33.647330 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2090/4219] 10.222.0.20 () {58 vars in 1303 bytes} [Mon Aug 29 05:09:33 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2Fb69b5de3-eef5-4ed2-a45c-155cb560423b => generated 483 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:33.662339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-31251a2a-6c3e-40b4-86f2-2c838ab9a059 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8690280>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:33.980448 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-31251a2a-6c3e-40b4-86f2-2c838ab9a059 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3275 microversion: 2.1 time: 0.331820 Aug 29 05:09:33.991649 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2091/4220] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 29 05:09:33 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3275 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:33.998009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-092e0e6f-7264-4c64-b47b-c3790fb62580 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8bce310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:34.111779 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-092e0e6f-7264-4c64-b47b-c3790fb62580 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1426 microversion: 2.1 time: 0.118890 Aug 29 05:09:34.113682 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2092/4221] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 29 05:09:33 2022] GET /compute/v2.1/images?type=snapshot => generated 1426 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:34.133194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8d189e40-ec10-4a52-a0f1-89abcfdecc67 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8690d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:34.233012 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8d189e40-ec10-4a52-a0f1-89abcfdecc67 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 620 microversion: 2.1 time: 0.107386 Aug 29 05:09:34.234281 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2093/4222] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 05:09:34 2022] GET /compute/v2.1/images?limit=1 => generated 620 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:34.242960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:34.244150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:34.261217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:34.262449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:34.263804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:34.265331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:34.269112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:34.269804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:34.783427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Updating instance_info_cache with network_info: [{"id": "02ece434-f770-4816-b5a3-6ceebff2b6fc", "address": "fa:16:3e:b9:5a:6a", "network": {"id": "d1bf7399-59b6-40f0-9041-d1ee9491f26a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-229695419-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "198e073d8d724cc88a1b75643a1e4be3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap02ece434-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128872) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:09:34.802448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Releasing lock "refresh_cache-c461c080-6686-43e2-9daa-c00ef907fcd9" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 05:09:34.808746 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6411c23c-b9e0-4c2e-8abc-7346f4d2a9db tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action" status: 202 len: 0 microversion: 2.1 time: 6.509742 Aug 29 05:09:34.811118 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2130/4223] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:09:28 2022] POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action => generated 0 bytes in 6514 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 05:09:34.829123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba9f1b79-a25c-4218-b420-3e9a57b94c5d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab910be50>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:34.991785 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba9f1b79-a25c-4218-b420-3e9a57b94c5d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-08-29T05%3A06%3A49Z" status: 200 len: 6328 microversion: 2.1 time: 0.177611 Aug 29 05:09:34.992441 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2131/4224] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Aug 29 05:09:34 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-29T05%3A06%3A49Z => generated 6328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:35.010182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fa4d6c72-e567-4b4b-948e-427298cfb710 req-59918d4e-3067-4499-92e0-92f7bac23321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a557400d-1409-4dff-b0ae-8b54fd922250", "name": "network-vif-unplugged", "status": "completed", "tag": "dad129e8-e3ea-4e47-929c-0e837a029c60"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:35.031079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fa4d6c72-e567-4b4b-948e-427298cfb710 req-59918d4e-3067-4499-92e0-92f7bac23321 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:35.031561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fa4d6c72-e567-4b4b-948e-427298cfb710 req-59918d4e-3067-4499-92e0-92f7bac23321 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:35.031993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fa4d6c72-e567-4b4b-948e-427298cfb710 req-59918d4e-3067-4499-92e0-92f7bac23321 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:35.068780 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fa4d6c72-e567-4b4b-948e-427298cfb710 req-59918d4e-3067-4499-92e0-92f7bac23321 service nova] Creating event network-vif-unplugged:dad129e8-e3ea-4e47-929c-0e837a029c60 for instance a557400d-1409-4dff-b0ae-8b54fd922250 on n-h1-854119-9 Aug 29 05:09:35.075863 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fa4d6c72-e567-4b4b-948e-427298cfb710 req-59918d4e-3067-4499-92e0-92f7bac23321 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080637 Aug 29 05:09:35.076931 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2132/4225] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:35.084338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.118"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:35.623611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:35.645170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:35.646618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:35.647842 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52ce3654-f1d8-4a21-8a85-e08e40868bfe tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 1.412413 Aug 29 05:09:35.649220 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2094/4226] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:34 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:35.654419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6ee960bb-8973-4c76-9773-e82e25e5d3a5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd8474c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:35.709675 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6ee960bb-8973-4c76-9773-e82e25e5d3a5 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-911294193" status: 200 len: 664 microversion: 2.1 time: 0.058891 Aug 29 05:09:35.710265 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2095/4227] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Aug 29 05:09:35 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-911294193 => generated 664 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:35.725331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d0c8e74f-8899-40e4-a876-407a9e083d64 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd847310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:35.732206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:35.740762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:35.741521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:35.742125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:35.744226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:35.750395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:35.750852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:35.756787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:35.799359 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d0c8e74f-8899-40e4-a876-407a9e083d64 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2Fb69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1465 microversion: 2.1 time: 0.077137 Aug 29 05:09:35.810048 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2096/4228] 10.222.0.20 () {58 vars in 1338 bytes} [Mon Aug 29 05:09:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2Fb69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1465 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:35.816073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-61c75dce-0201-4202-b2a0-13897c09ea5d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd847040>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:35.878475 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-61c75dce-0201-4202-b2a0-13897c09ea5d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2Fb69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1465 microversion: 2.1 time: 0.066418 Aug 29 05:09:35.890020 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2097/4229] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Aug 29 05:09:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2Fb69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1465 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:35.894953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e41d864-fb7d-435d-ad03-a313ac9601a6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab97e4820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:36.058218 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e41d864-fb7d-435d-ad03-a313ac9601a6 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.166969 Aug 29 05:09:36.076621 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2098/4230] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 29 05:09:35 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:36.084885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf34c44d-49eb-4feb-b9ee-84fa57b1688d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8625670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:36.233770 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf34c44d-49eb-4feb-b9ee-84fa57b1688d tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4372 microversion: 2.1 time: 0.153489 Aug 29 05:09:36.234641 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2099/4231] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 29 05:09:36 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:36.256589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bc3391b-5dd0-42d1-90a2-73584376cf72 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8690280>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:36.324001 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8bc3391b-5dd0-42d1-90a2-73584376cf72 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/6e3fd38c-90a0-4677-991e-152affedd0a1" status: 200 len: 784 microversion: 2.1 time: 0.076831 Aug 29 05:09:36.324689 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2100/4232] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 05:09:36 2022] GET /compute/v2.1/images/6e3fd38c-90a0-4677-991e-152affedd0a1 => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:36.341888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-995207e2-e7af-4390-bd86-cb1dad9689fd tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd847790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:36.403496 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-995207e2-e7af-4390-bd86-cb1dad9689fd tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.067289 Aug 29 05:09:36.404079 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2101/4233] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 05:09:36 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:36.421011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-baa76d34-facd-4047-8255-04f903b49bdc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab86250d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:36.565942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "refresh_cache-c461c080-6686-43e2-9daa-c00ef907fcd9" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 05:09:36.566395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquired lock "refresh_cache-c461c080-6686-43e2-9daa-c00ef907fcd9" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 05:09:37.621696 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-baa76d34-facd-4047-8255-04f903b49bdc tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "DELETE /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f" status: 204 len: 0 microversion: 2.1 time: 1.204602 Aug 29 05:09:37.622284 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2102/4234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:36 2022] DELETE /compute/v2.1/images/2727d6ae-aee5-49a1-803a-d7916b87b11f => generated 0 bytes in 1206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:09:37.630586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:37.631197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:37.668742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:37.669259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:37.674571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:37.675407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:37.675904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:37.676445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:38.402536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:38.416953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:38.420667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:38.425624 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4366569c-e25d-411c-99c4-fa4beafac65e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.798815 Aug 29 05:09:38.426359 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2103/4235] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:37 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:38.441843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b66524f7-2299-4fdf-8a75-e055f0defa6b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd847430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:38.842958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Building network info cache for instance {{(pid=128872) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 29 05:09:39.657291 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b66524f7-2299-4fdf-8a75-e055f0defa6b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "DELETE /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403" status: 204 len: 0 microversion: 2.1 time: 1.228693 Aug 29 05:09:39.658485 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2104/4236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:38 2022] DELETE /compute/v2.1/images/638f1b64-156a-4303-a454-d888a16ba403 => generated 0 bytes in 1230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:39.666459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e169fd97-58e2-46ca-9cd1-da2f64e9c44e req-6bf5acc4-f962-4950-807c-8f1185882714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c461c080-6686-43e2-9daa-c00ef907fcd9", "tag": "02ece434-f770-4816-b5a3-6ceebff2b6fc"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:39.697460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e169fd97-58e2-46ca-9cd1-da2f64e9c44e req-6bf5acc4-f962-4950-807c-8f1185882714 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:39.699278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e169fd97-58e2-46ca-9cd1-da2f64e9c44e req-6bf5acc4-f962-4950-807c-8f1185882714 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:39.700860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e169fd97-58e2-46ca-9cd1-da2f64e9c44e req-6bf5acc4-f962-4950-807c-8f1185882714 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:39.725649 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e169fd97-58e2-46ca-9cd1-da2f64e9c44e req-6bf5acc4-f962-4950-807c-8f1185882714 service nova] Creating event network-changed:02ece434-f770-4816-b5a3-6ceebff2b6fc for instance c461c080-6686-43e2-9daa-c00ef907fcd9 on n-h1-854119-9 Aug 29 05:09:39.731923 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e169fd97-58e2-46ca-9cd1-da2f64e9c44e req-6bf5acc4-f962-4950-807c-8f1185882714 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071593 Aug 29 05:09:39.734497 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2105/4237] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:39.740449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:39.741695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:39.754963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:39.755676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:39.756357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:39.757280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:39.757904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:39.758655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:39.799260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:40.490331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:40.508243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:40.518091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:40.520541 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a09f6b9d-ee35-429e-b90c-673d65ace6e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.783532 Aug 29 05:09:40.532208 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2106/4238] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:39 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:40.555123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60da3b20-ae7e-4a89-9ae3-a14784799916 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8637ca0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:41.466489 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60da3b20-ae7e-4a89-9ae3-a14784799916 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "DELETE /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02" status: 204 len: 0 microversion: 2.1 time: 0.929671 Aug 29 05:09:41.467080 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2107/4239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:40 2022] DELETE /compute/v2.1/images/1bbd294e-0752-4bbf-84ec-5958c0c69a02 => generated 0 bytes in 931 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:41.475465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:41.476380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:41.495103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:41.496747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:41.497427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:41.498363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:41.499009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:41.499639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:41.563449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:09:41.763835 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ef9f3cf-1d76-45fd-b690-aa9898c814b8 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 204 len: 0 microversion: 2.1 time: 0.292164 Aug 29 05:09:41.765069 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2108/4240] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:09:41 2022] DELETE /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:41.770713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:41.781132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:41.789540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:41.805024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:41.805761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:41.806654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:41.807761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:41.808416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:41.822943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Updating instance_info_cache with network_info: [{"id": "02ece434-f770-4816-b5a3-6ceebff2b6fc", "address": "fa:16:3e:b9:5a:6a", "network": {"id": "d1bf7399-59b6-40f0-9041-d1ee9491f26a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-229695419-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "198e073d8d724cc88a1b75643a1e4be3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap02ece434-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128872) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:09:41.843465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Releasing lock "refresh_cache-c461c080-6686-43e2-9daa-c00ef907fcd9" {{(pid=128872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 05:09:41.844876 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cbe5985c-aade-4a34-b3ff-e4d82ac7256e tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action" status: 202 len: 0 microversion: 2.1 time: 6.765657 Aug 29 05:09:41.852066 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2133/4241] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:09:35 2022] POST /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9/action => generated 0 bytes in 6767 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 05:09:41.873583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:41.878761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:41.907168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:41.907869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:41.914100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:41.917906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:41.918578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:41.919413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:42.634180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:42.643115 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2e502d02-e05d-4299-ae98-417b0ed89247 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1474 microversion: 2.1 time: 0.789656 Aug 29 05:09:42.651007 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2134/4242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:41 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1474 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:42.658820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff191d9d-bab5-4085-97cf-a331be00dbb8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '.version_select at 0x7f1abd98a160>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:42.730580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:42.749043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:42.751384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:42.753438 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6b0316e6-0f9e-4935-8968-d78b101d8c8b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.987017 Aug 29 05:09:42.755356 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2109/4243] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:41 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:43.872460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-843735583", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "fdc11167-ab40-49ed-9802-f277560ad1e0"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:44.004486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] validate_networks() for [('fdc11167-ab40-49ed-9802-f277560ad1e0', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:09:45.411452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:09:45.412023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:09:45.412570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:09:45.413180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:09:45.413765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:09:45.424862 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff191d9d-bab5-4085-97cf-a331be00dbb8 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/50e3b5b1-044f-49be-8fd2-ecb693a0739d" status: 202 len: 0 microversion: 2.1 time: 2.772541 Aug 29 05:09:45.425488 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2135/4244] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:09:42 2022] DELETE /compute/v2.1/os-floating-ips/50e3b5b1-044f-49be-8fd2-ecb693a0739d => generated 0 bytes in 2774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:09:45.430965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:45.431534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:45.439215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:45.439933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:45.442749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:45.443785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:45.445557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:45.447612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:45.447739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:45.451217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:45.451815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:45.455736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:45.456268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:45.456716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:45.511097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Getting quotas for project 837cd50a143e4e6e9a20045803e6670e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:09:45.526057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Getting quotas for user 0b9fae766ccc4b3fb70675a9cae7ffca and project 837cd50a143e4e6e9a20045803e6670e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:09:45.557579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:09:45.564787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:09:45.658950 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97b39dc0-ad1d-451e-88e9-f736c7eb05fc tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.064818 Aug 29 05:09:45.660349 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2110/4245] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:09:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:09:45.665926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:45.666818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:45.673726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:45.674521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:45.675344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:45.676324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:45.676985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:45.678002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:46.163669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:46.196540 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-25638e05-2044-4b6d-a3ef-ff55ff451848 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1474 microversion: 2.1 time: 0.768758 Aug 29 05:09:46.200822 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2136/4246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:45 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1474 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:46.224021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:46.233323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:46.240405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:46.240902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:46.241347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:46.242100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:46.242536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:46.242965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:46.273672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:46.298799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:46.306695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:46.310634 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1a34f447-8ee6-4992-a4a6-c0784118f3d8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.647926 Aug 29 05:09:46.312845 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2111/4247] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:45 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:46.323222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c30e6fe0-b382-4eb6-bd88-a1b943385c1b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '.version_select at 0x7f1ab8b48700>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:46.471329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lazy-loading 'services' on Instance uuid e8f4c4a5-d88a-42bb-8cda-837036cad036 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:09:46.632817 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0e5fc59-21cc-4029-8008-5f542b928677 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036/os-volume_attachments/b6630291-76c5-4615-b385-fce5dfe5b6e1" status: 202 len: 0 microversion: 2.1 time: 0.417486 Aug 29 05:09:46.633446 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2137/4248] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:09:46 2022] DELETE /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036/os-volume_attachments/b6630291-76c5-4615-b385-fce5dfe5b6e1 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:09:46.667200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:46.670640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:46.706051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:46.706899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:46.707207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:46.708064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:46.712634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:46.713098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:46.839933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c30e6fe0-b382-4eb6-bd88-a1b943385c1b tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9ef0d07b-da19-4eb7-986a-9700f93c2cb8" status: 202 len: 0 microversion: 2.1 time: 0.525572 Aug 29 05:09:46.840942 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2112/4249] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:09:46 2022] DELETE /compute/v2.1/os-security-groups/9ef0d07b-da19-4eb7-986a-9700f93c2cb8 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:09:46.850106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-67998766-3e5e-4e4c-aa5f-47109f7a9991 req-60f0c78a-bd70-4741-8edb-fc10587c908c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69b5de3-eef5-4ed2-a45c-155cb560423b", "name": "network-vif-deleted", "tag": "21ed04b2-af73-45fc-82a5-01ea8dcf9bd3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:46.887657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-67998766-3e5e-4e4c-aa5f-47109f7a9991 req-60f0c78a-bd70-4741-8edb-fc10587c908c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:46.893897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-67998766-3e5e-4e4c-aa5f-47109f7a9991 req-60f0c78a-bd70-4741-8edb-fc10587c908c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:46.895919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-67998766-3e5e-4e4c-aa5f-47109f7a9991 req-60f0c78a-bd70-4741-8edb-fc10587c908c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:46.936815 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-67998766-3e5e-4e4c-aa5f-47109f7a9991 req-60f0c78a-bd70-4741-8edb-fc10587c908c service nova] Creating event network-vif-deleted:21ed04b2-af73-45fc-82a5-01ea8dcf9bd3 for instance b69b5de3-eef5-4ed2-a45c-155cb560423b on n-h1-854119-9 Aug 29 05:09:46.952603 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-67998766-3e5e-4e4c-aa5f-47109f7a9991 req-60f0c78a-bd70-4741-8edb-fc10587c908c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110013 Aug 29 05:09:46.953533 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2113/4250] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:46.967793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:46.968767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:46.981014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:46.989492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:46.990404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:46.991206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:47.003097 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7324fef8-74c3-4bc6-a4c5-bd3e57ae305e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1228 microversion: 2.1 time: 0.353754 Aug 29 05:09:47.016037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:47.016037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:47.016037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:47.016769 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2138/4251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:46 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1228 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:47.050398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:09:47.188757 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1de4e22d-cdd4-4df6-a24e-5ec0dc185724 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 204 len: 0 microversion: 2.1 time: 0.233382 Aug 29 05:09:47.190175 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2114/4252] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:09:46 2022] DELETE /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:47.199097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:47.199717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:47.207605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:47.208432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:47.209124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:47.210127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:47.210784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:47.211619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:47.222297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:47.223016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:47.233865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:47.234366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:47.234785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:47.235497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:47.235951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:47.240868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:47.312545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:47.313069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:47.313512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:47.314346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lazy-loading 'fault' on Instance uuid b69b5de3-eef5-4ed2-a45c-155cb560423b {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:09:47.395826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:47.408702 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-831156d5-9eea-45c5-9e10-ee65187c359f tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1308 microversion: 2.1 time: 0.187895 Aug 29 05:09:47.409912 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2115/4253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:47 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:47.421661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:47.422497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:47.430664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:47.431493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:47.432261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:47.433242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:47.434192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:47.434961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:47.665848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:47.676395 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3cdd3ac7-779d-486e-9205-cb5979a04930 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1509 microversion: 2.1 time: 0.481181 Aug 29 05:09:47.688408 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2139/4254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:47 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1509 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:47.795528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:47.844919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:47.852705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:47.862058 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f8104de4-7836-4169-beca-a8348431b80f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.445571 Aug 29 05:09:47.864449 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2116/4255] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:47 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:48.023002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:48.023623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:48.034476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:48.040821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:48.041415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:48.042181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:48.042694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:48.043189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:48.189183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:48.204102 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d9bc5ca5-eb2c-4091-80ff-7e242fca281e tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1276 microversion: 2.1 time: 0.184925 Aug 29 05:09:48.216628 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2140/4256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:48 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:48.430817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:48.432570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:48.441161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:48.442009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:48.442601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:48.443527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:48.444164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:48.444737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:48.499997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:48.500524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:48.500955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:48.501415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lazy-loading 'fault' on Instance uuid b69b5de3-eef5-4ed2-a45c-155cb560423b {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:09:48.571860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:48.583345 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-34fed39f-3038-4035-bffb-ff3a9494594e tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 200 len: 1308 microversion: 2.1 time: 0.156886 Aug 29 05:09:48.585967 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2117/4257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:48 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:48.700867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:48.701492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:48.730403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:48.730945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:48.732783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:48.733960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:48.736446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:48.738349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:48.895179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:48.896470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:48.921388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:48.923264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:48.924324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:48.925361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:48.926371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:48.927011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.237977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:49.252939 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28a4eb39-7b4f-4909-807e-d0ab829becb9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1509 microversion: 2.1 time: 0.558831 Aug 29 05:09:49.254144 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2141/4258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:48 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1509 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:49.262941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5edfe76b-211b-4432-a4b8-0b9bda781ed1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:49.265799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5edfe76b-211b-4432-a4b8-0b9bda781ed1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:49.279879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5edfe76b-211b-4432-a4b8-0b9bda781ed1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:49.289160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5edfe76b-211b-4432-a4b8-0b9bda781ed1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:49.289924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5edfe76b-211b-4432-a4b8-0b9bda781ed1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.291466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5edfe76b-211b-4432-a4b8-0b9bda781ed1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:49.292395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5edfe76b-211b-4432-a4b8-0b9bda781ed1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:49.293094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5edfe76b-211b-4432-a4b8-0b9bda781ed1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.324281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:49.336958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:49.338555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:49.340067 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-92a0b972-60ad-420e-80b3-ab960071f44e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.456729 Aug 29 05:09:49.345527 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5edfe76b-211b-4432-a4b8-0b9bda781ed1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/ips" status: 200 len: 151 microversion: 2.20 time: 0.085015 Aug 29 05:09:49.352776 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2142/4259] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Aug 29 05:09:49 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:09:49.353469 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2118/4260] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:48 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:09:49.357623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ba8e98f6-7a75-4d7c-adca-20356bc4c41a req-a3b20076-9874-4d36-bdc0-1e36ea090cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-plugged", "status": "completed", "tag": "3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:49.362595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:49.363673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:49.375143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:49.375633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:49.376062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.376527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ba8e98f6-7a75-4d7c-adca-20356bc4c41a req-a3b20076-9874-4d36-bdc0-1e36ea090cf5 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:49.377123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ba8e98f6-7a75-4d7c-adca-20356bc4c41a req-a3b20076-9874-4d36-bdc0-1e36ea090cf5 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:49.378247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ba8e98f6-7a75-4d7c-adca-20356bc4c41a req-a3b20076-9874-4d36-bdc0-1e36ea090cf5 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.378734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:49.379203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:49.379799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.474948 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ba8e98f6-7a75-4d7c-adca-20356bc4c41a req-a3b20076-9874-4d36-bdc0-1e36ea090cf5 service nova] Creating event network-vif-plugged:3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:09:49.504721 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ba8e98f6-7a75-4d7c-adca-20356bc4c41a req-a3b20076-9874-4d36-bdc0-1e36ea090cf5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147781 Aug 29 05:09:49.522396 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2143/4261] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:49.542767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:49.569812 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b461e1ea-ad31-41a6-a8f6-b9967a1191ad tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1276 microversion: 2.1 time: 0.211596 Aug 29 05:09:49.570439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2119/4262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:49 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:49.607911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:49.608647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: b69b5de3-eef5-4ed2-a45c-155cb560423b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:49.626155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:49.632503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:49.633267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.643687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:49.645682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:49.647445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.682873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] HTTP exception thrown: Instance b69b5de3-eef5-4ed2-a45c-155cb560423b could not be found. Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Request method failure captured: Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b HTTP/1.1 Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDElog8ql8amcyYfkG55vsqTaQyriwB8S9aS1rENmU6-ehfxaSureHiaZnzax6Rk4Vpb68m57smKGaZxEcQERhJUuQJxFE7fhkd_sFlBRJ7BkIY1ifatUwFHKn-NzclBdV-qwpjObIuTa5LqRPSgP_mRlTn5qVlk6WDzVAgPvBdVM6bc Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6fa0679374454bf8b0187f3f378db5ea Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ListImageFiltersTestJSON-1446886894 Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa0679374454bf8b0187f3f378db5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa0679374454bf8b0187f3f378db5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa0679374454bf8b0187f3f378db5ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa0679374454bf8b0187f3f378db5ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ListImageFiltersTestJSON-1446886894 Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6fa0679374454bf8b0187f3f378db5ea Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1446886894 Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ListImageFiltersTestJSON-1446886894-project Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 2e043126791b4f70903a287e7f8b1a2c Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ListImageFiltersTestJSON-1446886894-project Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance b69b5de3-eef5-4ed2-a45c-155cb560423b could not be found. Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'b69b5de3-eef5-4ed2-a45c-155cb560423b'} Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69b5de3-eef5-4ed2-a45c-155cb560423b could not be found. Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69b5de3-eef5-4ed2-a45c-155cb560423b could not be found. Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:49.687289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:49.691143 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:49.691143 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:49.691143 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:49.691143 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:09:49.691143 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:09:49.691143 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69b5de3-eef5-4ed2-a45c-155cb560423b could not be found. Aug 29 05:09:49.691143 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:49.694049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Returning 404 to user: Instance b69b5de3-eef5-4ed2-a45c-155cb560423b could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:09:49.695961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dc297f7d-e49c-4f2e-a14b-83778d9123fb tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b" status: 404 len: 111 microversion: 2.1 time: 0.093815 Aug 29 05:09:49.698620 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2144/4263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:49 2022] GET /compute/v2.1/servers/b69b5de3-eef5-4ed2-a45c-155cb560423b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:09:49.720368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:49.721277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:49.747632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:49.753213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:49.753953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.758012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:49.758621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:49.761075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:49.840010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:09:49.973456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:50.052940 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87f21240-3971-41a7-b572-99ebf287a4f0 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250" status: 204 len: 0 microversion: 2.1 time: 0.345803 Aug 29 05:09:50.060366 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2120/4264] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:09:49 2022] DELETE /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:50.066100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:50.066974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:50.078958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:50.085501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:50.086184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:50.087170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:50.087758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:50.088326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:50.276510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:50.279739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:50.293036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:50.294147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:50.296036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:50.298338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:50.299376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:50.315157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:51.126564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:51.147082 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3ec94eb5-247d-48c0-881a-783d392e397b tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250" status: 200 len: 1472 microversion: 2.1 time: 1.085370 Aug 29 05:09:51.160147 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2145/4265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:50 2022] GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 => generated 1472 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:51.176571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:51.177565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:51.192506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:51.194322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:51.197765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:51.201497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:51.202740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:51.203578 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c0f9a88-addd-4e59-92dd-c5bdfa2694a9 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1509 microversion: 2.1 time: 0.932314 Aug 29 05:09:51.205462 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2121/4266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:50 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1509 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:51.215773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:51.218923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:51.219503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:51.219682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:51.233947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:51.238784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:51.239261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:51.240172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:51.240638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:51.241059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:51.450257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:51.463646 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9e82c933-39f4-471d-ad0a-c51c3973cc77 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1276 microversion: 2.1 time: 0.253846 Aug 29 05:09:51.464562 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2122/4267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:51 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:51.696238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:51.720001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:51.724807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:51.728247 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-46faab42-1a91-4c86-bf11-a3e2f3edb1df tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.573831 Aug 29 05:09:51.730551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2146/4268] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:51 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:51.794236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-682d12ca-1df2-40c1-926a-580063bf2b43 req-78ca3b4a-da4c-441c-9809-daa149196505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-plugged", "status": "completed", "tag": "e3c9708f-d535-4684-8742-633d367275e3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:51.809677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-682d12ca-1df2-40c1-926a-580063bf2b43 req-78ca3b4a-da4c-441c-9809-daa149196505 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:51.812775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-682d12ca-1df2-40c1-926a-580063bf2b43 req-78ca3b4a-da4c-441c-9809-daa149196505 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:51.813385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-682d12ca-1df2-40c1-926a-580063bf2b43 req-78ca3b4a-da4c-441c-9809-daa149196505 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:51.837580 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-682d12ca-1df2-40c1-926a-580063bf2b43 req-78ca3b4a-da4c-441c-9809-daa149196505 service nova] Creating event network-vif-plugged:e3c9708f-d535-4684-8742-633d367275e3 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:09:51.856721 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-682d12ca-1df2-40c1-926a-580063bf2b43 req-78ca3b4a-da4c-441c-9809-daa149196505 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066714 Aug 29 05:09:51.857994 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2123/4269] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:52.173156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:52.174525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:52.179720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:52.198307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:52.198896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:52.199330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:52.200261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:52.200656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:52.201076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:52.231237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:52.231931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:52.243490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:52.244458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:52.245292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:52.246545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:52.247648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:52.248542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:52.757371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:52.767776 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3014f5ad-ef45-49c1-88a5-09dd091a8f4a tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1509 microversion: 2.1 time: 0.541609 Aug 29 05:09:52.768937 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2124/4270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:52 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1509 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:52.782297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:52.783632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:52.792109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:52.793956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:52.794791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:52.795964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:52.796660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:52.797267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:52.845272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:52.857595 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1d4c72ba-e2bf-459e-b197-41e05706fdf3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250" status: 200 len: 1472 microversion: 2.1 time: 0.688603 Aug 29 05:09:52.871956 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2147/4271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:52 2022] GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 => generated 1472 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:52.871956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:52.871956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:52.877859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:52.878523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:52.879070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:52.880446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:52.880996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:52.881510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:53.061757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:53.072608 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd41d5dd-78d8-4878-a01d-ac9d3cd46548 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1282 microversion: 2.1 time: 0.302356 Aug 29 05:09:53.088224 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2125/4272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:52 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1282 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:53.142218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:53.142771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:53.153652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:53.154150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:53.154596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:53.156687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:53.156687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:53.156687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:53.208655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lazy-loading 'flavor' on Instance uuid 904b4106-5845-40b8-8f26-7eacf31b54b8 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:09:53.332539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:53.353623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:53.359539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:53.363872 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9504a8f-647a-4dda-a792-5fcdf46c2509 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.502648 Aug 29 05:09:53.367537 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2148/4273] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:52 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:53.407381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-41882bfb-eaeb-4193-bbd5-cf15d8c6bc2f req-0103d7e5-f78b-4c98-9641-89470e46b796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c461c080-6686-43e2-9daa-c00ef907fcd9", "name": "network-vif-deleted", "tag": "02ece434-f770-4816-b5a3-6ceebff2b6fc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:53.458807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-41882bfb-eaeb-4193-bbd5-cf15d8c6bc2f req-0103d7e5-f78b-4c98-9641-89470e46b796 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:53.464671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-41882bfb-eaeb-4193-bbd5-cf15d8c6bc2f req-0103d7e5-f78b-4c98-9641-89470e46b796 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:53.466700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-41882bfb-eaeb-4193-bbd5-cf15d8c6bc2f req-0103d7e5-f78b-4c98-9641-89470e46b796 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:53.519546 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-41882bfb-eaeb-4193-bbd5-cf15d8c6bc2f req-0103d7e5-f78b-4c98-9641-89470e46b796 service nova] Creating event network-vif-deleted:02ece434-f770-4816-b5a3-6ceebff2b6fc for instance c461c080-6686-43e2-9daa-c00ef907fcd9 on n-h1-854119-9 Aug 29 05:09:53.530397 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-41882bfb-eaeb-4193-bbd5-cf15d8c6bc2f req-0103d7e5-f78b-4c98-9641-89470e46b796 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128429 Aug 29 05:09:53.534384 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2149/4274] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:09:53.663861 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-490e78e3-eb25-4b35-a696-7a9b88c2e2b6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/action" status: 202 len: 0 microversion: 2.20 time: 0.531602 Aug 29 05:09:53.669105 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2126/4275] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 05:09:53 2022] POST /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:53.675410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:53.676144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:53.688010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:53.688784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:53.691465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:53.692394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:53.693041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:53.697162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:53.791049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:53.791931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:53.794347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:53.816340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:53.818596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:53.819928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:53.821623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:53.825174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:53.825729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:53.921093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:53.922482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:53.923026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:53.923728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lazy-loading 'fault' on Instance uuid c461c080-6686-43e2-9daa-c00ef907fcd9 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:09:53.989008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5a5f174a0f4d139901452e9a358a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198e073d8d724cc88a1b75643a1e4be3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:54.001056 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-622f98d5-ae35-49e3-8cf9-6b002c70d523 tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 200 len: 1312 microversion: 2.1 time: 0.211901 Aug 29 05:09:54.001608 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2127/4276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:53 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 1312 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:54.014413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:54.015899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:54.031635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:54.037060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:54.037440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:54.037569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:54.038316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:54.038869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:54.040077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:54.054885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:54.058744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:54.061971 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1855c4b2-8e6b-42c9-acd0-42498790afe6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.390016 Aug 29 05:09:54.076262 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2150/4277] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:53 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:54.097206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:54.097914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:54.105605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:54.106124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:54.106597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:54.107309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:54.108014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:54.109349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:54.248908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:54.252945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:54.264546 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4c95d20f-d13f-4dbb-a86d-48d75b82bf07 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1282 microversion: 2.1 time: 0.173113 Aug 29 05:09:54.269515 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2151/4278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:54 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:54.396845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:54.398775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:54.412398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:54.413846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:54.415905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:54.417306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:54.418752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:54.419347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:54.583380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:54.592460 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f0c9bbd5-724a-4180-b216-35a8ed04c7bf tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250" status: 200 len: 1472 microversion: 2.1 time: 0.589765 Aug 29 05:09:54.596072 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2128/4279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:54 2022] GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 => generated 1472 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:55.023387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:55.024078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] [instance: c461c080-6686-43e2-9daa-c00ef907fcd9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:55.034611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.036634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.037175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.037949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.039604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.041895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.059267 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] HTTP exception thrown: Instance c461c080-6686-43e2-9daa-c00ef907fcd9 could not be found. Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Request method failure captured: Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 HTTP/1.1 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEm057nonzULtz8piBQhflmt95YXpBX1THKZgPQsjFUeAw4UY275bABdXeKCrmlkY8p3Jc2HhEbC9BMxTV0qULunSBjpEQvHSQ99jXFPhjCKCSTHyDmwrguiqH_jSX7O1nj_Yi4yMJefz4RS-dzcUqOomFr8QcqnIgfunnrrNrhiH2s Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 198e073d8d724cc88a1b75643a1e4be3 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1940059284 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/198e073d8d724cc88a1b75643a1e4be3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/198e073d8d724cc88a1b75643a1e4be3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_198e073d8d724cc88a1b75643a1e4be3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/198e073d8d724cc88a1b75643a1e4be3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1940059284 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 198e073d8d724cc88a1b75643a1e4be3 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1940059284 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerRescueTestJSONUnderV235-1940059284-project Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4d5a5f174a0f4d139901452e9a358a82 Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1940059284-project Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance c461c080-6686-43e2-9daa-c00ef907fcd9 could not be found. Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'c461c080-6686-43e2-9daa-c00ef907fcd9'} Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c461c080-6686-43e2-9daa-c00ef907fcd9 could not be found. Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c461c080-6686-43e2-9daa-c00ef907fcd9 could not be found. Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:55.071990 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:55.076471 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:55.076471 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:55.076471 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:55.076471 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:55.076471 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:09:55.076471 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:09:55.076471 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c461c080-6686-43e2-9daa-c00ef907fcd9 could not be found. Aug 29 05:09:55.076471 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:09:55.076471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] Returning 404 to user: Instance c461c080-6686-43e2-9daa-c00ef907fcd9 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:09:55.080950 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64af9d00-ca85-45c3-94c6-dbd389ba87cf tempest-ServerRescueTestJSONUnderV235-1940059284 tempest-ServerRescueTestJSONUnderV235-1940059284-project] 10.222.0.20 "GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9" status: 404 len: 111 microversion: 2.1 time: 0.062763 Aug 29 05:09:55.081552 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2129/4280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:55 2022] GET /compute/v2.1/servers/c461c080-6686-43e2-9daa-c00ef907fcd9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:09:55.091325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:55.091945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:55.104322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:55.107773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.108528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.109319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.111401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.115077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.116731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.130512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:55.131995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:55.144099 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-477b7a7f-700b-41fd-9476-da033fc6a123 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.752048 Aug 29 05:09:55.149065 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2152/4281] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:54 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:55.300930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:55.301686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:55.318944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.319686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.322251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.323231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.323875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.324348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.493047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:55.543345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:55.689657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:55.710516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:55.724630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:55.737445 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12a8e1e2-01a3-4c0e-8b7b-cf20df01299a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.639152 Aug 29 05:09:55.738230 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2130/4282] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:55 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:09:55.743530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:55.763726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:55.775455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.783637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.786152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.789081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.790537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.790981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.874550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.875044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.875481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.875936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lazy-loading 'fault' on Instance uuid a557400d-1409-4dff-b0ae-8b54fd922250 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:09:55.880306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:55.904986 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5ddf669a-0d94-4861-b664-d669cc4fc750 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1324 microversion: 2.1 time: 0.607517 Aug 29 05:09:55.905626 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2153/4283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:55 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1324 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:55.936063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-236d7893-d341-47f1-90c6-60f713c975e4 req-49983d44-f782-4c5d-ba75-6790592ebe80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a557400d-1409-4dff-b0ae-8b54fd922250", "name": "network-vif-deleted", "tag": "dad129e8-e3ea-4e47-929c-0e837a029c60"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:55.951064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-236d7893-d341-47f1-90c6-60f713c975e4 req-49983d44-f782-4c5d-ba75-6790592ebe80 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:55.957036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-236d7893-d341-47f1-90c6-60f713c975e4 req-49983d44-f782-4c5d-ba75-6790592ebe80 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:55.958092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-236d7893-d341-47f1-90c6-60f713c975e4 req-49983d44-f782-4c5d-ba75-6790592ebe80 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:55.986045 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-236d7893-d341-47f1-90c6-60f713c975e4 req-49983d44-f782-4c5d-ba75-6790592ebe80 service nova] Creating event network-vif-deleted:dad129e8-e3ea-4e47-929c-0e837a029c60 for instance a557400d-1409-4dff-b0ae-8b54fd922250 on n-h1-854119-9 Aug 29 05:09:55.996892 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-236d7893-d341-47f1-90c6-60f713c975e4 req-49983d44-f782-4c5d-ba75-6790592ebe80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065003 Aug 29 05:09:55.997519 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2154/4284] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:56.055512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e043126791b4f70903a287e7f8b1a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa0679374454bf8b0187f3f378db5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:56.069338 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0b0df4e2-6900-47a3-a3a4-5dc89b07e419 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250" status: 200 len: 1307 microversion: 2.1 time: 0.329795 Aug 29 05:09:56.083710 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2131/4285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:55 2022] GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:09:56.170159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:56.171424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:56.187698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:56.191096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:56.192657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:56.193656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:56.197078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:56.198798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:56.676411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:56.692338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-dfb4aa04-621a-4d5b-8e09-470d90f564ac req-c83d9a14-1bc1-46c5-bc6b-44e8ec765190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-plugged", "status": "completed", "tag": "d28a6416-ee20-43fb-9e41-ae5f2d7565ce"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:56.705372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:56.713581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-dfb4aa04-621a-4d5b-8e09-470d90f564ac req-c83d9a14-1bc1-46c5-bc6b-44e8ec765190 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:56.715574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:56.722008 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c8f0a98b-50d4-4d47-a42f-e79d784410e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.557986 Aug 29 05:09:56.722813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-dfb4aa04-621a-4d5b-8e09-470d90f564ac req-c83d9a14-1bc1-46c5-bc6b-44e8ec765190 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:56.723373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-dfb4aa04-621a-4d5b-8e09-470d90f564ac req-c83d9a14-1bc1-46c5-bc6b-44e8ec765190 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:56.724080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2155/4286] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:56 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:56.748699 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-dfb4aa04-621a-4d5b-8e09-470d90f564ac req-c83d9a14-1bc1-46c5-bc6b-44e8ec765190 service nova] Creating event network-vif-plugged:d28a6416-ee20-43fb-9e41-ae5f2d7565ce for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:09:56.765212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:56.766217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:56.770443 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-dfb4aa04-621a-4d5b-8e09-470d90f564ac req-c83d9a14-1bc1-46c5-bc6b-44e8ec765190 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082423 Aug 29 05:09:56.773968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:56.775203 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2132/4287] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:09:56.783080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:56.783598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:56.784442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:56.784898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:56.785400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:56.927501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:56.928370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:56.935259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:56.935740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:56.936197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:56.943665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:56.944194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:56.944637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:57.171594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:57.198582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:57.200520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:57.202290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37d89b2b-0ec8-47e0-a11f-caa09a7a0ef4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.441164 Aug 29 05:09:57.203078 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2156/4288] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:56 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:57.220193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:57.221174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] [instance: a557400d-1409-4dff-b0ae-8b54fd922250] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:57.227991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:57.228886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:57.229565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:57.230869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:57.231530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:57.232227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:57.247924 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] HTTP exception thrown: Instance a557400d-1409-4dff-b0ae-8b54fd922250 could not be found. Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Request method failure captured: Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 HTTP/1.1 Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDElog8ql8amcyYfkG55vsqTaQyriwB8S9aS1rENmU6-ehfxaSureHiaZnzax6Rk4Vpb68m57smKGaZxEcQERhJUuQJxFE7fhkd_sFlBRJ7BkIY1ifatUwFHKn-NzclBdV-qwpjObIuTa5LqRPSgP_mRlTn5qVlk6WDzVAgPvBdVM6bc Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6fa0679374454bf8b0187f3f378db5ea Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ListImageFiltersTestJSON-1446886894 Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa0679374454bf8b0187f3f378db5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa0679374454bf8b0187f3f378db5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa0679374454bf8b0187f3f378db5ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa0679374454bf8b0187f3f378db5ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ListImageFiltersTestJSON-1446886894 Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6fa0679374454bf8b0187f3f378db5ea Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1446886894 Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ListImageFiltersTestJSON-1446886894-project Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 2e043126791b4f70903a287e7f8b1a2c Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ListImageFiltersTestJSON-1446886894-project Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance a557400d-1409-4dff-b0ae-8b54fd922250 could not be found. Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a557400d-1409-4dff-b0ae-8b54fd922250'} Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a557400d-1409-4dff-b0ae-8b54fd922250 could not be found. Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a557400d-1409-4dff-b0ae-8b54fd922250 could not be found. Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:09:57.250021 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:57.253641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:09:57.253641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:09:57.253641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:09:57.253641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:09:57.253641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:09:57.253641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a557400d-1409-4dff-b0ae-8b54fd922250 could not be found. Aug 29 05:09:57.253641 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:09:57.257583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Returning 404 to user: Instance a557400d-1409-4dff-b0ae-8b54fd922250 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:09:57.259092 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb5092df-c504-4c9f-bd1c-d77733a4879a tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250" status: 404 len: 111 microversion: 2.1 time: 0.054474 Aug 29 05:09:57.260267 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2157/4289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:57 2022] GET /compute/v2.1/servers/a557400d-1409-4dff-b0ae-8b54fd922250 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:09:57.269342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39f636a4-d6fe-4f1a-8b84-a0aa61187724 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd98a820>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:58.017539 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39f636a4-d6fe-4f1a-8b84-a0aa61187724 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "DELETE /compute/v2.1/images/781856a4-b37a-40ef-b4a7-f33701b5e16c" status: 204 len: 0 microversion: 2.1 time: 0.752286 Aug 29 05:09:58.019026 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2158/4290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:57 2022] DELETE /compute/v2.1/images/781856a4-b37a-40ef-b4a7-f33701b5e16c => generated 0 bytes in 754 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:58.024448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:58.025606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:58.043039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:58.047210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:58.049503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:58.052652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:58.054874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:58.056666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:58.103217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:58.134679 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b4e41ae6-0cb9-4088-bfb2-d4f724346da7 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1324 microversion: 2.1 time: 1.207705 Aug 29 05:09:58.150652 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2133/4291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:56 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1324 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:58.183006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e506d2a-583b-4316-bc23-70d4a3dded93 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1ab8637670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:58.555305 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e506d2a-583b-4316-bc23-70d4a3dded93 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "DELETE /compute/v2.1/images/b7079fa5-3632-4e4c-9e43-2408903d755d" status: 204 len: 0 microversion: 2.1 time: 0.400953 Aug 29 05:09:58.555897 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2134/4292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:58 2022] DELETE /compute/v2.1/images/b7079fa5-3632-4e4c-9e43-2408903d755d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:58.563871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:58.565293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:58.581204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:58.581991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:58.582633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:58.583558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:58.594724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:58.595702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:58.941118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:58.952338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:58.954823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:58.956455 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d4f8ccd6-5cfd-4db2-b1a2-1a1aa7439c72 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.936182 Aug 29 05:09:58.957368 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2159/4293] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:58 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:58.962411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5659a586-80f0-4452-aa62-5537d01ab69e req-f9efedf0-2585-434e-9bc4-9c75007e1714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e71b5d5-b550-45e3-8b9a-0cd8168e8acc", "tag": "e106e4ce-8b64-4b90-9599-559f4c8ec9e1"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:58.973343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5659a586-80f0-4452-aa62-5537d01ab69e req-f9efedf0-2585-434e-9bc4-9c75007e1714 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:58.974089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5659a586-80f0-4452-aa62-5537d01ab69e req-f9efedf0-2585-434e-9bc4-9c75007e1714 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:58.974686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5659a586-80f0-4452-aa62-5537d01ab69e req-f9efedf0-2585-434e-9bc4-9c75007e1714 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:58.987792 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5659a586-80f0-4452-aa62-5537d01ab69e req-f9efedf0-2585-434e-9bc4-9c75007e1714 service nova] Creating event network-changed:e106e4ce-8b64-4b90-9599-559f4c8ec9e1 for instance 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc on n-h1-854119-9 Aug 29 05:09:58.999294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:59.002423 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5659a586-80f0-4452-aa62-5537d01ab69e req-f9efedf0-2585-434e-9bc4-9c75007e1714 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042478 Aug 29 05:09:59.003511 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2160/4294] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:59.012540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6536c08d-8d9d-44f5-8c09-dc5e1608d6c3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] Calling method '.version_select at 0x7f1abd98aa60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:59.015969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:59.020315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:59.024587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9af796a2-3df1-4abf-b684-0b5fdb8fd678 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.464747 Aug 29 05:09:59.027003 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2135/4295] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:58 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:09:59.033427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-2b30bd8a-4566-45b0-8a37-e59808e447ea req-f8f12d92-d6ae-422f-8bd2-957c2df1f586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-plugged", "status": "completed", "tag": "9d491664-1c7c-402d-acbf-553a52de93b5"}, {"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-plugged", "status": "completed", "tag": "004afcee-7c72-4360-ad7c-0a6d16dcc727"}, {"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-plugged", "status": "completed", "tag": "48cc496b-b13a-4bc9-a9d5-d3a3dd570ddf"}, {"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-plugged", "status": "completed", "tag": "850262b4-7c71-4de1-88fe-1b5865d1c466"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:09:59.046666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2b30bd8a-4566-45b0-8a37-e59808e447ea req-f8f12d92-d6ae-422f-8bd2-957c2df1f586 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:59.047258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2b30bd8a-4566-45b0-8a37-e59808e447ea req-f8f12d92-d6ae-422f-8bd2-957c2df1f586 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:59.047827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2b30bd8a-4566-45b0-8a37-e59808e447ea req-f8f12d92-d6ae-422f-8bd2-957c2df1f586 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:59.063819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2b30bd8a-4566-45b0-8a37-e59808e447ea req-f8f12d92-d6ae-422f-8bd2-957c2df1f586 service nova] Creating event network-vif-plugged:9d491664-1c7c-402d-acbf-553a52de93b5 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:09:59.064797 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2b30bd8a-4566-45b0-8a37-e59808e447ea req-f8f12d92-d6ae-422f-8bd2-957c2df1f586 service nova] Creating event network-vif-plugged:004afcee-7c72-4360-ad7c-0a6d16dcc727 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:09:59.065847 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2b30bd8a-4566-45b0-8a37-e59808e447ea req-f8f12d92-d6ae-422f-8bd2-957c2df1f586 service nova] Creating event network-vif-plugged:48cc496b-b13a-4bc9-a9d5-d3a3dd570ddf for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:09:59.066556 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2b30bd8a-4566-45b0-8a37-e59808e447ea req-f8f12d92-d6ae-422f-8bd2-957c2df1f586 service nova] Creating event network-vif-plugged:850262b4-7c71-4de1-88fe-1b5865d1c466 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:09:59.075911 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-2b30bd8a-4566-45b0-8a37-e59808e447ea req-f8f12d92-d6ae-422f-8bd2-957c2df1f586 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.047026 Aug 29 05:09:59.079860 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2136/4296] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:09:59.157350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:59.158334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:59.174714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:59.175209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:59.175674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:59.176430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:59.176875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:59.177292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:59.425967 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6536c08d-8d9d-44f5-8c09-dc5e1608d6c3 tempest-ListImageFiltersTestJSON-1446886894 tempest-ListImageFiltersTestJSON-1446886894-project] 10.222.0.20 "DELETE /compute/v2.1/images/f966eda5-3a9e-415e-8e1f-c631f6f2bee7" status: 204 len: 0 microversion: 2.1 time: 0.420926 Aug 29 05:09:59.426650 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2161/4297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:59 2022] DELETE /compute/v2.1/images/f966eda5-3a9e-415e-8e1f-c631f6f2bee7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:59.452876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:59.453663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:59.463682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:59.472849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:59.473414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:59.477175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:59.477920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:59.478543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:59.545407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:09:59.558087 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7966f53b-1c0f-4b12-bd6d-8b14b7ae78ff tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1324 microversion: 2.1 time: 0.404369 Aug 29 05:09:59.559132 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2137/4298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:59 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:09:59.582246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:09:59.785238 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7a187fb-3e88-41c0-9ba1-13386de71d2c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 204 len: 0 microversion: 2.1 time: 0.353575 Aug 29 05:09:59.786316 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2162/4299] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:09:59 2022] DELETE /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:09:59.794857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:59.795462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:09:59.808307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:59.809078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:59.809657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:59.810729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:09:59.811380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:09:59.824534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:09:59.871662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:09:59.995736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:09:59.997447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:00.012055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:00.016699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:00.017354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:00.021132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:00.021763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:00.022380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:00.242640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:00.253450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-261b57c1-715a-4bf7-8a06-ae576aba4bad tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1514 microversion: 2.1 time: 0.462454 Aug 29 05:10:00.272765 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2138/4300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:09:59 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1514 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:00.282283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:00.284110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:00.301162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:00.301877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:00.302485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:00.303852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:00.306486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:00.309067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:00.758961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:00.770727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:00.776948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:00.778444 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47482d53-b32e-4bfa-86da-8618757b2988 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.790398 Aug 29 05:10:00.783036 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2163/4301] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:09:59 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:00.788034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:00.788684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:00.817349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:00.818485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:00.819171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:00.820153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:00.820812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:00.821468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:00.951820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:00.962346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:00.970862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:00.972245 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f2e97fe9-b39b-4e4a-8d0d-78456206cee9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.698353 Aug 29 05:10:00.972917 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2139/4302] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:00 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:01.123463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:01.138367 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a312e5b-0d82-4b0e-a7a4-b38d0d05756b tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1324 microversion: 2.1 time: 0.353881 Aug 29 05:10:01.140371 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2164/4303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:00 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:01.274800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:01.275389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:01.288479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:01.289240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:01.290016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:01.290994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:01.291602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:01.292252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:01.658053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:01.667067 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-319a7f31-8358-4e74-a876-85d5e87306c5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1514 microversion: 2.1 time: 0.396238 Aug 29 05:10:01.668425 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2140/4304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:01 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1514 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:01.814670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:01.815829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:01.838792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:01.842744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:01.844636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:01.847018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:01.847663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:01.849790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:01.997441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:01.998190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:02.026736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:02.027298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:02.031728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:02.032628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:02.037676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:02.038259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:02.618309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:02.628946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:02.631499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:02.642337 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1114e2ae-5850-4b0f-b576-bf995b778dec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.649533 Aug 29 05:10:02.642963 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2141/4305] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:01 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:02.656784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:02.661279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:02.662981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:02.668600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:02.670485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:02.672012 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3cf27111-c54e-416c-8b84-2f55f44c65b5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 0.862691 Aug 29 05:10:02.673180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2165/4306] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:01 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:02.684556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:02.685049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:02.685481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:02.695557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:02.696449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:02.697050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:02.698132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:02.704091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:02.718686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:02.722595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:02.723186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:02.724094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:02.724730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:02.726938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:03.067832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:03.083277 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2cd85426-13f0-4984-ae5a-a00faf54ed15 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1324 microversion: 2.1 time: 0.429666 Aug 29 05:10:03.087669 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2142/4307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:02 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:03.121259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:03.130341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-add8140d-c89e-4cf8-8fdc-076811807e30 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1514 microversion: 2.1 time: 0.441367 Aug 29 05:10:03.131562 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2166/4308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:02 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1514 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:03.676638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:03.677931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:03.687576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:03.688574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:03.690397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:03.691501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:03.694537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:03.695209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:03.700723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:03.702447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:03.715404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:03.730191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:03.730715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:03.731488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:03.731972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:03.739542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:04.690117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:04.703183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:04.718176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:04.719466 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-25ab84ca-d390-4c13-b0f8-f823df2782cd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 1.048821 Aug 29 05:10:04.732551 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2143/4309] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:03 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:04.740822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:04.741453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:04.760002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:04.760787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:04.761426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:04.762362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:04.762965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:04.763552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:05.065496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:05.116226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:05.119644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:05.122189 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a667e0fb-be24-4bea-8de6-b3e8084c10a2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1873 microversion: 2.42 time: 1.426612 Aug 29 05:10:05.140219 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2167/4310] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:03 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1873 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:05.147955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:05.149531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:05.156551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:05.157108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:05.157636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:05.158409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:05.159010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:05.159541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:05.531240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:05.546425 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-88e188c6-8aa4-4b87-8e88-d207c87354d0 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1324 microversion: 2.1 time: 0.806719 Aug 29 05:10:05.547502 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2144/4311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:04 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1324 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:05.747329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:05.750263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:05.769083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:05.769586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:05.772205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:05.772965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:05.773428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:05.773907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:05.878512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:05.890237 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3ac0ff6c-317f-4545-a2cb-00a8d4c23cc5 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1514 microversion: 2.1 time: 0.746262 Aug 29 05:10:05.892602 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2168/4312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:05 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1514 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:06.148633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:06.149922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:06.162393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:06.163104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:06.165394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:06.170063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:06.170780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:06.171384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:06.583936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:06.595153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:06.601100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:06.602362 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28745985-156b-4b88-8563-a37bc010fdef tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.860229 Aug 29 05:10:06.603742 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2145/4313] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:05 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:06.608566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:06.609175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:06.628724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:06.629283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:06.629737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:06.630469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:06.630917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:06.631338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:07.089519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:07.102409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:07.111219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:07.115864 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80057b29-73b6-4ccd-a746-d311802124f2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2828 microversion: 2.42 time: 0.972202 Aug 29 05:10:07.120852 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2169/4314] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:06 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2828 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:07.131626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:07.133287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:07.150948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:07.152364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:07.156439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:07.157724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:07.159151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:07.160404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:07.204509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:07.216930 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a5091814-06ef-4997-9cc6-e28cfa5319aa tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1324 microversion: 2.1 time: 0.612025 Aug 29 05:10:07.220202 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2146/4315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:06 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1324 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:07.229211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-bde5e39c-6df8-4bbf-9058-fbe5a056b220 req-c26c121f-1aa1-4f97-baf2-b51de09289bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f4c4a5-d88a-42bb-8cda-837036cad036", "name": "network-vif-deleted", "tag": "ff92d680-9393-4240-bef3-e118882fe71e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:07.260484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bde5e39c-6df8-4bbf-9058-fbe5a056b220 req-c26c121f-1aa1-4f97-baf2-b51de09289bb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:07.261319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bde5e39c-6df8-4bbf-9058-fbe5a056b220 req-c26c121f-1aa1-4f97-baf2-b51de09289bb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:07.261907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bde5e39c-6df8-4bbf-9058-fbe5a056b220 req-c26c121f-1aa1-4f97-baf2-b51de09289bb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:07.282089 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-bde5e39c-6df8-4bbf-9058-fbe5a056b220 req-c26c121f-1aa1-4f97-baf2-b51de09289bb service nova] Creating event network-vif-deleted:ff92d680-9393-4240-bef3-e118882fe71e for instance e8f4c4a5-d88a-42bb-8cda-837036cad036 on n-h1-854119-9 Aug 29 05:10:07.306139 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-bde5e39c-6df8-4bbf-9058-fbe5a056b220 req-c26c121f-1aa1-4f97-baf2-b51de09289bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084357 Aug 29 05:10:07.306785 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2147/4316] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:10:07.312314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3cbc2186-06da-447b-b968-575cae39c17a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:07.318479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3cbc2186-06da-447b-b968-575cae39c17a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:07.332050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cbc2186-06da-447b-b968-575cae39c17a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:07.333018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cbc2186-06da-447b-b968-575cae39c17a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:07.333659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cbc2186-06da-447b-b968-575cae39c17a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:07.334590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cbc2186-06da-447b-b968-575cae39c17a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:07.335224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cbc2186-06da-447b-b968-575cae39c17a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:07.335827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3cbc2186-06da-447b-b968-575cae39c17a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:07.345704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:07.367888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:07.378298 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fe1a7991-3da5-4038-b262-e95e87e4fce4 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 200 len: 1472 microversion: 2.1 time: 0.256160 Aug 29 05:10:07.378917 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2170/4317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:07 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:07.559056 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3cbc2186-06da-447b-b968-575cae39c17a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.250598 Aug 29 05:10:07.559977 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2148/4318] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 29 05:10:07 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705/os-interface => generated 1832 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:07.634584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:07.635208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:07.647480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:07.658031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:07.659639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:07.661816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:07.665413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:07.666443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:08.175131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:08.191468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:08.196694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:08.199928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab308dd2-34ba-4c05-bda5-896bd805e05b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.570286 Aug 29 05:10:08.201194 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2171/4319] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:07 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:08.243349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:08.244580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:08.255098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:08.260695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:08.261833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:08.262916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:08.263925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:08.267069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:08.400082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:08.401096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: e8f4c4a5-d88a-42bb-8cda-837036cad036] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:08.411922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:08.413922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:08.415788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:08.416588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:08.417113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:08.419645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:08.454351 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] HTTP exception thrown: Instance e8f4c4a5-d88a-42bb-8cda-837036cad036 could not be found. Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Request method failure captured: Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 HTTP/1.1 Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDElRgZp8Jt0SkIk_-YjBKC0fOLzGe1aaWDpJSnmU_6vHBJweC2SZhRXkyu8evZdqeH1z6HgsIzohLbihI_45-dB1HNu08LVOFvYLiaArO-aBXdauSTVnvQjvhHfW7JpRIK8ofA4yLwPuaxeoVgvemlbYmoYXgTMFucnYRZk-y4-6BFE Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0f44f29199a24350984567f7ef8c670e Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesSnapshotTestJSON-217438411 Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f44f29199a24350984567f7ef8c670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f44f29199a24350984567f7ef8c670e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f44f29199a24350984567f7ef8c670e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f44f29199a24350984567f7ef8c670e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesSnapshotTestJSON-217438411 Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0f44f29199a24350984567f7ef8c670e Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-217438411 Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesSnapshotTestJSON-217438411-project Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 7540db831bbe4326af010ddf50a57681 Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesSnapshotTestJSON-217438411-project Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance e8f4c4a5-d88a-42bb-8cda-837036cad036 could not be found. Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'e8f4c4a5-d88a-42bb-8cda-837036cad036'} Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f4c4a5-d88a-42bb-8cda-837036cad036 could not be found. Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f4c4a5-d88a-42bb-8cda-837036cad036 could not be found. Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:10:08.462125 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:08.467064 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:08.467064 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:10:08.467064 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:10:08.467064 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:10:08.467064 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:10:08.467064 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f4c4a5-d88a-42bb-8cda-837036cad036 could not be found. Aug 29 05:10:08.467064 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:08.467064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Returning 404 to user: Instance e8f4c4a5-d88a-42bb-8cda-837036cad036 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:10:08.467064 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18cfa37b-2359-4234-8811-da240bfc8d37 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036" status: 404 len: 111 microversion: 2.1 time: 0.068128 Aug 29 05:10:08.478820 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2172/4320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:08 2022] GET /compute/v2.1/servers/e8f4c4a5-d88a-42bb-8cda-837036cad036 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:10:08.614339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2fcb858d-188f-4f86-978c-f7bb549836fb req-068133a8-130a-44f4-81b4-6273b8e9ae3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e71b5d5-b550-45e3-8b9a-0cd8168e8acc", "name": "network-vif-plugged", "status": "completed", "tag": "e106e4ce-8b64-4b90-9599-559f4c8ec9e1"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:08.639500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2fcb858d-188f-4f86-978c-f7bb549836fb req-068133a8-130a-44f4-81b4-6273b8e9ae3a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:08.640541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2fcb858d-188f-4f86-978c-f7bb549836fb req-068133a8-130a-44f4-81b4-6273b8e9ae3a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:08.641126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2fcb858d-188f-4f86-978c-f7bb549836fb req-068133a8-130a-44f4-81b4-6273b8e9ae3a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:08.679098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2fcb858d-188f-4f86-978c-f7bb549836fb req-068133a8-130a-44f4-81b4-6273b8e9ae3a service nova] Creating event network-vif-plugged:e106e4ce-8b64-4b90-9599-559f4c8ec9e1 for instance 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc on n-h1-854119-9 Aug 29 05:10:08.693938 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2fcb858d-188f-4f86-978c-f7bb549836fb req-068133a8-130a-44f4-81b4-6273b8e9ae3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079598 Aug 29 05:10:08.695834 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2173/4321] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:10:08.766689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:08.786656 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d5f46ff-a9ba-459b-b536-d64e00f70688 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1324 microversion: 2.1 time: 0.549046 Aug 29 05:10:08.794681 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2149/4322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:08 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1324 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:09.228014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:09.228838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:09.243178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:09.247201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:09.248059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:09.249083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:09.249846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:09.251289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:09.631192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:09.643856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:09.648320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:09.649594 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ce058e24-f625-4162-9458-65a2de246100 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.427435 Aug 29 05:10:09.655431 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2174/4323] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:09 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:09.811776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:09.813188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:09.831393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:09.835933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:09.836569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:09.837477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:09.849705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:09.850569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:10.357859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:10.376982 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a95fd27a-3987-4563-b009-723ce3efd5ac tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1324 microversion: 2.1 time: 0.569329 Aug 29 05:10:10.378954 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2150/4324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:09 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1324 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:10.676026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:10.676717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:10.700145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:10.700647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:10.701093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:10.701811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:10.702613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:10.703037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:11.401550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:11.403581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:11.423178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:11.444087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:11.446112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:11.447972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:11.454335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:11.454777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:11.486407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:11.502977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:11.507768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:11.511530 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7951ef9-85a1-4eca-9bff-e2642a3d23c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1744 microversion: 2.20 time: 0.840432 Aug 29 05:10:11.540826 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2175/4325] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:10 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1744 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:12.537555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:12.538217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:12.551009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:12.551522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:12.551968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:12.552724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:12.553188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:12.553617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:12.618132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:12.651869 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d83bc8fc-a24f-4d57-8ba4-9f6ec0536523 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1521 microversion: 2.1 time: 1.254481 Aug 29 05:10:12.654085 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2151/4326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:11 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1521 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:12.679615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:12.684601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:12.699954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:12.700757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:12.701703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:12.703246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:12.703957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:12.704588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:12.748066 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] HTTP exception thrown: Action 999 not found Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Request method failure captured: Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc/os-instance-actions/999 HTTP/1.1 Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEoX8XyiESivTk3r4Zo2iYKRe2gBAAJN_kbd-ATw9dwt3UHFYi1GPlkany4PJn3VHXZuvUixkp1PAEMOpzY8EojH1qXbMwmOQInu1eAuuKcOGyh35qqignmgbKwTHjYYP3-3hHDUJr7ErT6OBNvO9Kl3Oxm_amhObUZS5SyNWfLPz_c Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 837cd50a143e4e6e9a20045803e6670e Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-773740264 Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/837cd50a143e4e6e9a20045803e6670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/837cd50a143e4e6e9a20045803e6670e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_837cd50a143e4e6e9a20045803e6670e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/837cd50a143e4e6e9a20045803e6670e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-773740264 Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 837cd50a143e4e6e9a20045803e6670e Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-773740264 Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-InstanceActionsNegativeTestJSON-773740264-project Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 0b9fae766ccc4b3fb70675a9cae7ffca Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-773740264-project Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: exception: Action 999 not found Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': '6e71b5d5-b550-45e3-8b9a-0cd8168e8acc', 'id': '999'} Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 29 05:10:12.762381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:10:12.767269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Returning 404 to user: Action 999 not found {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:10:12.769577 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7a892aa-95f4-4fc7-9165-42ea55663179 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.094345 Aug 29 05:10:12.770372 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2152/4327] 10.222.0.20 () {58 vars in 1308 bytes} [Mon Aug 29 05:10:12 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc/os-instance-actions/999 => generated 66 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:10:12.780755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d06bc870-a06e-46fe-846d-1d589aa22a52 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '.version_select at 0x7f1ab85f1f70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:12.781557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d06bc870-a06e-46fe-846d-1d589aa22a52 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 0e8e22b6-2dc5-4326-ae10-5177a2b57605] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:12.787798 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-d06bc870-a06e-46fe-846d-1d589aa22a52 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] HTTP exception thrown: Instance 0e8e22b6-2dc5-4326-ae10-5177a2b57605 could not be found. Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d06bc870-a06e-46fe-846d-1d589aa22a52 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Request method failure captured: Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/0e8e22b6-2dc5-4326-ae10-5177a2b57605/os-instance-actions HTTP/1.1 Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEoX8XyiESivTk3r4Zo2iYKRe2gBAAJN_kbd-ATw9dwt3UHFYi1GPlkany4PJn3VHXZuvUixkp1PAEMOpzY8EojH1qXbMwmOQInu1eAuuKcOGyh35qqignmgbKwTHjYYP3-3hHDUJr7ErT6OBNvO9Kl3Oxm_amhObUZS5SyNWfLPz_c Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 837cd50a143e4e6e9a20045803e6670e Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-773740264 Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/837cd50a143e4e6e9a20045803e6670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/837cd50a143e4e6e9a20045803e6670e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_837cd50a143e4e6e9a20045803e6670e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/837cd50a143e4e6e9a20045803e6670e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-773740264 Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 837cd50a143e4e6e9a20045803e6670e Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-773740264 Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-InstanceActionsNegativeTestJSON-773740264-project Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 0b9fae766ccc4b3fb70675a9cae7ffca Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-773740264-project Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 0e8e22b6-2dc5-4326-ae10-5177a2b57605 could not be found. Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': '0e8e22b6-2dc5-4326-ae10-5177a2b57605'} Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8e22b6-2dc5-4326-ae10-5177a2b57605 could not be found. Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:10:12.790539 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8e22b6-2dc5-4326-ae10-5177a2b57605 could not be found. Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8e22b6-2dc5-4326-ae10-5177a2b57605 could not be found. Aug 29 05:10:12.794918 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:10:12.796964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d06bc870-a06e-46fe-846d-1d589aa22a52 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Returning 404 to user: Instance 0e8e22b6-2dc5-4326-ae10-5177a2b57605 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:10:12.799184 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d06bc870-a06e-46fe-846d-1d589aa22a52 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/0e8e22b6-2dc5-4326-ae10-5177a2b57605/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.021934 Aug 29 05:10:12.801754 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2153/4328] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Aug 29 05:10:12 2022] GET /compute/v2.1/servers/0e8e22b6-2dc5-4326-ae10-5177a2b57605/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:10:12.813990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:12.819272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:12.836901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:12.837577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:12.838180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:12.839999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:12.841884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:12.842481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:12.923131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:10:13.062729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:13.077852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:13.081810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:13.086977 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-074a4d25-7e6a-4af2-8049-862d7a41f3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1744 microversion: 2.20 time: 0.553346 Aug 29 05:10:13.092828 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2176/4329] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:12 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1744 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:10:13.125966 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-668fe15a-8002-49f3-af8d-068e62524e5d tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 204 len: 0 microversion: 2.1 time: 0.317884 Aug 29 05:10:13.126757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2154/4330] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:10:12 2022] DELETE /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:10:13.135796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:13.136530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:13.152693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:13.153112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:13.153805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:13.156501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:13.156973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:13.157394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:13.642270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-00667338-0eff-43f3-8fe5-3db718b07f1f req-e012bb78-96ee-4ea7-94f4-1ad4222cf292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "tag": "3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:13.676400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-00667338-0eff-43f3-8fe5-3db718b07f1f req-e012bb78-96ee-4ea7-94f4-1ad4222cf292 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:13.677278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-00667338-0eff-43f3-8fe5-3db718b07f1f req-e012bb78-96ee-4ea7-94f4-1ad4222cf292 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:13.681192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-00667338-0eff-43f3-8fe5-3db718b07f1f req-e012bb78-96ee-4ea7-94f4-1ad4222cf292 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:13.719379 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-00667338-0eff-43f3-8fe5-3db718b07f1f req-e012bb78-96ee-4ea7-94f4-1ad4222cf292 service nova] Creating event network-changed:3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:10:13.752693 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-00667338-0eff-43f3-8fe5-3db718b07f1f req-e012bb78-96ee-4ea7-94f4-1ad4222cf292 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112983 Aug 29 05:10:13.754325 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2155/4331] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:10:14.113803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:14.115021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:14.136352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:14.139538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:14.140327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:14.141436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:14.146098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:14.147042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:14.245829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:14.343939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:14.377990 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9d3239d0-fea2-42de-8706-4fca0dd513f9 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1527 microversion: 2.1 time: 1.246403 Aug 29 05:10:14.380888 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2177/4332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:13 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1527 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:14.527017 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:10:14.527681 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:10:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 (ip 10.222.0.20) !!! Aug 29 05:10:14.751082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:14.781102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:14.818626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:14.820464 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-818443f7-32b5-4e82-b918-c475d33bf0f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1744 microversion: 2.20 time: 0.712596 Aug 29 05:10:14.824901 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2156/4333] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:14 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1744 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:15.403735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:15.405218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:15.428592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:15.429490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:15.430216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:15.444283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:15.447754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:15.450153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:15.852294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:15.853322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:15.870122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:15.871581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:15.877356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:15.878636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:15.879374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:15.880189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:16.586966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:16.602209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:16.604078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:16.607943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3f58442f-1b13-475f-81bd-f4f18feabd30 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 0.761490 Aug 29 05:10:16.612890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:16.627250 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2157/4334] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:15 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:10:16.627455 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bc3d4ff0-9447-47fb-8eb3-681d43291e57 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1527 microversion: 2.1 time: 1.228127 Aug 29 05:10:16.628318 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2178/4335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:15 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1527 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:17.632802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:17.634050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:17.645811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:17.648011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:17.648758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:17.650545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:17.651205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:17.652443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:17.653201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:17.657978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:17.667170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:17.667656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:17.668096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:17.668862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:17.669315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:17.669742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:18.288969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:18.301062 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9906b7e0-1bab-4ef6-b325-1960943453af tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1485 microversion: 2.1 time: 0.654496 Aug 29 05:10:18.301665 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2179/4336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:17 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1485 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:18.415877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:18.425683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:18.439796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:18.444679 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-74bf9640-6e3a-4d74-9d53-16563962929d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 0.815714 Aug 29 05:10:18.471378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6d890be6-64df-4407-a089-18b21ade5a85 req-cf732ec8-2310-4e53-bb3b-1d2cd021f142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e71b5d5-b550-45e3-8b9a-0cd8168e8acc", "name": "network-vif-deleted", "tag": "e106e4ce-8b64-4b90-9599-559f4c8ec9e1"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:18.472477 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2158/4337] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:17 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:18.501990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6d890be6-64df-4407-a089-18b21ade5a85 req-cf732ec8-2310-4e53-bb3b-1d2cd021f142 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:18.502904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6d890be6-64df-4407-a089-18b21ade5a85 req-cf732ec8-2310-4e53-bb3b-1d2cd021f142 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:18.505933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6d890be6-64df-4407-a089-18b21ade5a85 req-cf732ec8-2310-4e53-bb3b-1d2cd021f142 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:18.552812 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6d890be6-64df-4407-a089-18b21ade5a85 req-cf732ec8-2310-4e53-bb3b-1d2cd021f142 service nova] Creating event network-vif-deleted:e106e4ce-8b64-4b90-9599-559f4c8ec9e1 for instance 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc on n-h1-854119-9 Aug 29 05:10:18.581941 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6d890be6-64df-4407-a089-18b21ade5a85 req-cf732ec8-2310-4e53-bb3b-1d2cd021f142 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118885 Aug 29 05:10:18.582567 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2180/4338] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:10:19.324566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:19.325197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:19.339522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:19.346230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:19.348614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:19.349539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:19.351274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:19.353836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:19.479672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:19.480567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:19.497918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:19.502574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:19.503118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:19.504669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:19.505181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:19.505571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:19.516671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:19.517160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:19.517588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:19.518043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lazy-loading 'fault' on Instance uuid 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:10:20.305697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9fae766ccc4b3fb70675a9cae7ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837cd50a143e4e6e9a20045803e6670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:20.314942 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-da064f2c-1cf5-4260-a386-63214d924661 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 200 len: 1314 microversion: 2.1 time: 0.995689 Aug 29 05:10:20.316928 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2159/4339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:19 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 1314 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:20.322870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:20.339242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:20.341098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:20.345221 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fbf5065e-6a9c-4046-a613-78fec61fe0be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 0.869878 Aug 29 05:10:20.347374 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2181/4340] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:19 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:10:20.721962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-2b7a36c4-a09f-4790-a546-5bf4cca9635f req-c7aca194-dd67-4a0b-ba6c-160950b6f365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904b4106-5845-40b8-8f26-7eacf31b54b8", "name": "network-vif-plugged", "status": "completed", "tag": "fbfd57c9-7dce-4a91-982f-cfa91fd489ee"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:20.745618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2b7a36c4-a09f-4790-a546-5bf4cca9635f req-c7aca194-dd67-4a0b-ba6c-160950b6f365 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:20.746113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2b7a36c4-a09f-4790-a546-5bf4cca9635f req-c7aca194-dd67-4a0b-ba6c-160950b6f365 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:20.746608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2b7a36c4-a09f-4790-a546-5bf4cca9635f req-c7aca194-dd67-4a0b-ba6c-160950b6f365 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:20.771875 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2b7a36c4-a09f-4790-a546-5bf4cca9635f req-c7aca194-dd67-4a0b-ba6c-160950b6f365 service nova] Creating event network-vif-plugged:fbfd57c9-7dce-4a91-982f-cfa91fd489ee for instance 904b4106-5845-40b8-8f26-7eacf31b54b8 on n-h1-854119-9 Aug 29 05:10:20.794488 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-2b7a36c4-a09f-4790-a546-5bf4cca9635f req-c7aca194-dd67-4a0b-ba6c-160950b6f365 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076525 Aug 29 05:10:20.798425 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2160/4341] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:10:21.338755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:21.340437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] [instance: 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:21.357325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:21.359903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:21.361230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:21.364606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:21.366177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:21.367569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:21.375009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:21.376155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:21.399923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:21.401989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:21.405721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:21.408763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:21.413812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:21.414545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:21.435227 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] HTTP exception thrown: Instance 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc could not be found. Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Request method failure captured: Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc HTTP/1.1 Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEoX8XyiESivTk3r4Zo2iYKRe2gBAAJN_kbd-ATw9dwt3UHFYi1GPlkany4PJn3VHXZuvUixkp1PAEMOpzY8EojH1qXbMwmOQInu1eAuuKcOGyh35qqignmgbKwTHjYYP3-3hHDUJr7ErT6OBNvO9Kl3Oxm_amhObUZS5SyNWfLPz_c Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 837cd50a143e4e6e9a20045803e6670e Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-773740264 Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/837cd50a143e4e6e9a20045803e6670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/837cd50a143e4e6e9a20045803e6670e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_837cd50a143e4e6e9a20045803e6670e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/837cd50a143e4e6e9a20045803e6670e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-773740264 Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 837cd50a143e4e6e9a20045803e6670e Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-773740264 Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-InstanceActionsNegativeTestJSON-773740264-project Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 0b9fae766ccc4b3fb70675a9cae7ffca Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-773740264-project Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc could not be found. Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6e71b5d5-b550-45e3-8b9a-0cd8168e8acc'} Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc could not be found. Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc could not be found. Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:21.448356 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:10:21.456699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:21.456699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:10:21.456699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:10:21.456699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:10:21.456699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:10:21.456699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:10:21.456699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc could not be found. Aug 29 05:10:21.456699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:10:21.490532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] Returning 404 to user: Instance 6e71b5d5-b550-45e3-8b9a-0cd8168e8acc could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:10:21.491447 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2ad4c47-7275-4b4c-b740-3d49120e4132 tempest-InstanceActionsNegativeTestJSON-773740264 tempest-InstanceActionsNegativeTestJSON-773740264-project] 10.222.0.20 "GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc" status: 404 len: 111 microversion: 2.1 time: 0.157200 Aug 29 05:10:21.492431 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2182/4342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:21 2022] GET /compute/v2.1/servers/6e71b5d5-b550-45e3-8b9a-0cd8168e8acc => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:10:22.035651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-574230659", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "970448b5-a0c5-4163-bcf4-71ff3dfc9117"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:22.109725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:22.124382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:22.129202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:22.134402 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-49ff48da-2c54-4d87-9184-5f2ee2ce2204 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 0.765045 Aug 29 05:10:22.135411 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2161/4343] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:21 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:22.201162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] validate_networks() for [('970448b5-a0c5-4163-bcf4-71ff3dfc9117', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:10:23.158172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:23.158947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:23.184053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:23.184809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:23.187863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:23.190475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:23.195228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:23.199455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:23.815915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:23.834488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:23.842865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:23.845463 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-14bd3b26-3e5b-4420-8e3b-fcfd6160040a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 0.691417 Aug 29 05:10:23.853216 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2162/4344] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:23 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:24.023819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e84929c7-5cd6-4343-90cf-2f7d8ecdfec8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Action: 'create', calling method: .version_select at 0x7f1ab8637940>, body: {"keypair": {"name": "tempest-keypair-278366381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCm03Y9NJQoLcQJp9YoYdekOswkZ7+N/iooQSSkapMdxg+M/XRpLaRH601d/n+ngCLeH1hmzlAswud0BgiZa8XrUsDsXDsYF/cc1yyoZMXV5EvxAEP2Q7p54Llmf2SB9g=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:24.031269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:24.067195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-e84929c7-5cd6-4343-90cf-2f7d8ecdfec8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Getting quotas for project ca3846ab054c4ffeb5586099654c9b3b. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:10:24.084361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-e84929c7-5cd6-4343-90cf-2f7d8ecdfec8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Getting quotas for user 7304421b62ad4eaaaeddc94c23ac9dba and project ca3846ab054c4ffeb5586099654c9b3b. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:10:24.141418 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e84929c7-5cd6-4343-90cf-2f7d8ecdfec8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.286473 Aug 29 05:10:24.142311 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2163/4345] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:10:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:10:24.879015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:24.880502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:24.904170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:24.913197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:24.917518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:24.923616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:24.929280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:24.932172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:26.366124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:26.378319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:26.379785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:26.387652 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87a54d84-eb59-439f-91d5-24b2acf98f71 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 1.507309 Aug 29 05:10:26.391959 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2164/4346] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:24 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:26.456711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:10:26.457306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:10:26.458787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:10:26.459211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:10:26.460251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:10:26.466449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:26.482508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:26.483387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:26.484697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:26.493654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:26.495281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:26.496047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:26.528706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Getting quotas for project 0f44f29199a24350984567f7ef8c670e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:10:26.539079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Getting quotas for user 7540db831bbe4326af010ddf50a57681 and project 0f44f29199a24350984567f7ef8c670e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:10:26.586202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:10:26.589265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:10:26.746605 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c586e247-04a1-41ac-b4ff-4bfb2ba95187 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.716266 Aug 29 05:10:26.748148 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2183/4347] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:10:26.759051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b770306-dd68-4610-b236-5458accc5b7d tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:26.759837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8b770306-dd68-4610-b236-5458accc5b7d tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:27.025466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8b770306-dd68-4610-b236-5458accc5b7d tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:27.037282 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8b770306-dd68-4610-b236-5458accc5b7d tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1218 microversion: 2.1 time: 0.282644 Aug 29 05:10:27.041813 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2165/4348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:26 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1218 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:27.415560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:27.416093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:27.431468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:27.431969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:27.438851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:27.439737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:27.440254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:27.440692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:27.944601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:27.962918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:27.967514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:27.971560 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6c451eda-cb65-45ef-b9b5-eb6b3596a4a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 0.561125 Aug 29 05:10:27.983922 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2184/4349] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:27 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:28.063393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ca44de4b-e2ba-4ac1-9ebe-dac1c9c6c9f8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:28.064807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ca44de4b-e2ba-4ac1-9ebe-dac1c9c6c9f8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:28.209241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ca44de4b-e2ba-4ac1-9ebe-dac1c9c6c9f8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:28.227496 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ca44de4b-e2ba-4ac1-9ebe-dac1c9c6c9f8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1218 microversion: 2.1 time: 0.167188 Aug 29 05:10:28.249037 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2166/4350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:28 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:29.002555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:29.004663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:29.021408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:29.028431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:29.032636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:29.034825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:29.038439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:29.040657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:29.198801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1959247951", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:29.345777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] validate_networks() for [('de84ed4b-7ac8-4504-ae7e-3c04abeb53cb', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:10:30.117742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:30.169369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:30.172606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:30.186365 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d4d74bd-a80a-4f3a-ac22-355b1a9000d2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 1.186007 Aug 29 05:10:30.191530 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2167/4351] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:28 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:30.214939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:30.219758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:30.236547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:30.240364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:30.242790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:30.243948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:30.246377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:30.247095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:30.515266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:30.537503 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8dd369f6-d6ab-4843-9c9d-74236e652af8 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1276 microversion: 2.1 time: 0.339936 Aug 29 05:10:30.538383 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2168/4352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:30 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1276 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:31.220300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:31.223001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:31.251602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:31.253137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:31.255271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:31.260352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:31.261161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:31.281535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:32.969362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:32.996352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:32.998295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:33.000148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:10:33.000771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:10:33.001122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:10:33.001542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:10:33.001958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:10:33.016040 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a602d81d-df0e-494e-a02e-7d08adbbc660 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 1.801471 Aug 29 05:10:33.032166 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2169/4353] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:31 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:33.032166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:33.032891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:33.033213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:33.033406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:33.033854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:33.036733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:33.036733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:33.036733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:33.047564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:33.048971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:33.050385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:33.056015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:33.056697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:33.057294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:33.129852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Getting quotas for project 2c01935816574154a5c9832f4bd94886. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:10:33.149929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Getting quotas for user d27af7c7f74d41c8882f29888c70ebdd and project 2c01935816574154a5c9832f4bd94886. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:10:33.219899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:10:33.222211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:10:33.305098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6f63b7e6-0a77-42aa-ad09-539abcc3f875 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.688871 Aug 29 05:10:33.314805 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2185/4354] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:10:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:10:33.326048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7152a1b0-2feb-4a14-b427-4fe26bd3fd21 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:33.327442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7152a1b0-2feb-4a14-b427-4fe26bd3fd21 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:33.645639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7152a1b0-2feb-4a14-b427-4fe26bd3fd21 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:33.658712 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7152a1b0-2feb-4a14-b427-4fe26bd3fd21 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1217 microversion: 2.1 time: 0.334295 Aug 29 05:10:33.666847 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2186/4355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:33 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1217 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:10:33.882166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:33.896505 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5209fa82-ffe6-4def-bb49-7695eefa01e6 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 0.871161 Aug 29 05:10:33.899354 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2170/4356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:33 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:34.044981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:34.045864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:34.057888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:34.061865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:34.064651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:34.065564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:34.069906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:34.073409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:34.684770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc5ea9fa-e7d5-46dd-93b7-7b07b2539945 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:34.685598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc5ea9fa-e7d5-46dd-93b7-7b07b2539945 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:36.254997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc5ea9fa-e7d5-46dd-93b7-7b07b2539945 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:36.279682 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc5ea9fa-e7d5-46dd-93b7-7b07b2539945 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1217 microversion: 2.1 time: 1.594402 Aug 29 05:10:36.286864 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2171/4357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:34 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1217 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:10:36.303317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:36.306331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:36.321880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:36.324357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:36.324999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:36.325884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:36.328747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:36.329375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:36.742550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:36.772019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:36.778105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:36.793369 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-986210cb-1233-40a6-b969-528b9b8bac7f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 2.752431 Aug 29 05:10:36.801415 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2187/4358] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:34 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 2761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:37.310065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:37.310692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:37.325753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:37.333091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:37.337273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:37.341066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:37.341562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:37.349665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:38.215459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:38.223080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=78 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:38.230221 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a75f617f-b9cd-46e5-8ae3-8e8d8b993d15 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1275 microversion: 2.1 time: 0.924607 Aug 29 05:10:38.248425 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2188/4359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:37 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1275 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:38.254997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:38.255869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:38.265973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:38.266752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:38.267517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:38.268767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:38.269424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:38.270006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:38.648704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:38.664882 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d2f32a5e-a804-4f89-949d-e82ca2c355d2 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 2.376150 Aug 29 05:10:38.671915 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2172/4360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:36 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 2384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:38.931097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:38.944838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:38.947518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:38.950153 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f471c7b6-7cea-4cf6-bce6-c152e333dff3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 0.700097 Aug 29 05:10:38.950934 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2189/4361] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:38 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:39.257037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:39.258472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:39.277895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:39.280535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:39.281345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:39.284453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:39.285803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:39.286506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:39.689055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:39.689987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:39.722517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:39.724960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:39.738923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:39.744286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:39.748323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:39.770923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:40.351528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:40.381200 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-67ace2dc-c7d3-41b2-869a-6617128d7941 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1275 microversion: 2.1 time: 1.127860 Aug 29 05:10:40.386511 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2173/4362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:39 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1275 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:40.416300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:40.423528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:40.455059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:40.455059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:40.455059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:40.455059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:40.455059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:40.455059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:41.286788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:41.296834 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab0c60a6-390a-4b8d-8c2d-024bee72c356 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 1.613414 Aug 29 05:10:41.298108 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2190/4363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:39 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:41.408956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:41.409823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:41.431546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:41.432137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:41.442700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:41.447534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:41.451173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:41.451658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:41.547474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:41.564789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:41.566241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:41.581251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1052683b-739a-498e-b856-8eff67da47bf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 1.191159 Aug 29 05:10:41.594108 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2174/4364] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:40 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:42.322023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:42.322847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:42.348004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:42.348601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:42.349232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:42.350496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:42.350496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:42.351555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:43.085509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:43.347416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:43.380217 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f044097-042c-4c2f-863e-376ac44346f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 1.975173 Aug 29 05:10:43.389732 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2191/4365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:41 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:43.394997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:43.397649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:43.426093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:43.427023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:43.427707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:43.428720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:43.429558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:43.430256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:43.659761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=14 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:44.050449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:44.075542 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b92d6bfd-5e33-4bb4-8290-251f8efb1529 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 1.753708 Aug 29 05:10:44.077401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2175/4366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:42 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:44.098963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0892f9b5-3e26-4ed6-ac83-4b7cb04977a6 req-1b3b690a-4a0b-4779-881f-35717c25c7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886db681-da58-4c61-aaa2-386a1a69f8a4", "tag": "bc864747-a6c8-4df3-b067-4d7e895b92f1"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:44.148881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0892f9b5-3e26-4ed6-ac83-4b7cb04977a6 req-1b3b690a-4a0b-4779-881f-35717c25c7a4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:44.168160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0892f9b5-3e26-4ed6-ac83-4b7cb04977a6 req-1b3b690a-4a0b-4779-881f-35717c25c7a4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:44.168671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0892f9b5-3e26-4ed6-ac83-4b7cb04977a6 req-1b3b690a-4a0b-4779-881f-35717c25c7a4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:44.196528 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0892f9b5-3e26-4ed6-ac83-4b7cb04977a6 req-1b3b690a-4a0b-4779-881f-35717c25c7a4 service nova] Creating event network-changed:bc864747-a6c8-4df3-b067-4d7e895b92f1 for instance 886db681-da58-4c61-aaa2-386a1a69f8a4 on n-h1-854119-9 Aug 29 05:10:44.213291 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0892f9b5-3e26-4ed6-ac83-4b7cb04977a6 req-1b3b690a-4a0b-4779-881f-35717c25c7a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122321 Aug 29 05:10:44.216443 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2176/4367] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:10:44.423494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:44.426244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:44.450564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:44.457970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:44.461290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:44.464395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:44.468733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:44.469582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:44.486009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:44.496748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:44.498588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:44.502467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:44.503760 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb240b54-1422-4822-ba2e-85eaf6ea6f23 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 1.112670 Aug 29 05:10:44.515483 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2192/4368] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:43 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:44.981058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:45.002566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-43ed4d99-88c7-4b30-815d-be66b19cb345 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 0.591036 Aug 29 05:10:45.013888 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2177/4369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:44 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:10:45.101256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:45.101879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:45.128254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:45.128757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:45.129192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:45.129910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:45.130360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:45.130803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:45.539021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:45.541291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:45.581100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:45.588417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:45.593902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:45.599535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:45.606476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:45.609745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:46.271429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=10 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:46.460262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:46.477766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:46.479760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:46.487202 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-da8305b2-7ff1-4ded-90b3-4f7ace2b9f63 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 0.954153 Aug 29 05:10:46.487755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:46.489286 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2178/4370] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:45 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:10:46.496926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:46.497747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:46.512636 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e7b6c1c-a82d-4f81-9148-e0bf6b044d9f tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 1.415088 Aug 29 05:10:46.517625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:46.518745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:46.519517 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2193/4371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:45 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:46.531609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:46.533711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:46.536602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:46.537476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:46.850169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:46.863416 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-079005b6-4467-4316-8cf4-262918035933 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 0.372315 Aug 29 05:10:46.864085 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2179/4372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:46 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:47.038221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-436f24d7-54a9-43b6-8236-ccd7ba5e62d5 req-992f2375-5d45-4c61-8fb0-62f6f802c28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c83cae9-ef18-4723-9742-bb5e40f1b115", "tag": "b5b79f0a-b188-414c-99ed-082280f4ef23"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:47.059398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-436f24d7-54a9-43b6-8236-ccd7ba5e62d5 req-992f2375-5d45-4c61-8fb0-62f6f802c28a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:47.060586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-436f24d7-54a9-43b6-8236-ccd7ba5e62d5 req-992f2375-5d45-4c61-8fb0-62f6f802c28a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:47.061262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-436f24d7-54a9-43b6-8236-ccd7ba5e62d5 req-992f2375-5d45-4c61-8fb0-62f6f802c28a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:47.081417 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-436f24d7-54a9-43b6-8236-ccd7ba5e62d5 req-992f2375-5d45-4c61-8fb0-62f6f802c28a service nova] Creating event network-changed:b5b79f0a-b188-414c-99ed-082280f4ef23 for instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 on n-h1-854119-9 Aug 29 05:10:47.091691 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-436f24d7-54a9-43b6-8236-ccd7ba5e62d5 req-992f2375-5d45-4c61-8fb0-62f6f802c28a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391281 Aug 29 05:10:47.097629 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2194/4373] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:10:47.515516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:47.516370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:47.550997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:47.551874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:47.559373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:47.560051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:47.560614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:47.561770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:47.563568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:47.564325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:47.564971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:47.565666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:47.567269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:47.572087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:47.572972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:47.574176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:48.560040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:48.605296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:48.616045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:48.619466 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a5cf452-2ef0-46d8-9198-f427ca7328be tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1739 microversion: 2.20 time: 1.108057 Aug 29 05:10:48.629825 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2180/4374] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:47 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1739 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:48.660137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:48.664596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:48.712334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:48.714085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:48.719672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:48.721275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:48.725382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:48.727691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:48.820790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:48.840404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0aeff028-109d-43e1-886c-29c487f87f7c tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 1.291542 Aug 29 05:10:48.844230 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2195/4375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:47 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:49.659037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:49.659891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:49.694982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:49.699858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:49.703857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:49.704972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:49.709793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:49.712660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:50.078156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:50.095170 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-df067a93-84bc-4ab9-bde1-68f92463889c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 1.459118 Aug 29 05:10:50.095938 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2181/4376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:48 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:50.120003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:50.121287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:50.147582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:50.151230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:50.152104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:50.153092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:50.155310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:50.156679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:50.852596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:50.881355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:50.887769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:50.891461 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aeb3e623-7d6c-42f1-93e9-b0227ec7dadf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1721 microversion: 2.20 time: 1.236207 Aug 29 05:10:50.894633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2196/4377] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:49 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1721 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:51.119650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:51.120710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:51.135864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:51.136896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:51.137604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:51.140933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:51.147366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:51.150330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:51.493879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:51.512369 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc5e38de-b123-4006-942f-9b2847f8d9ce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 1.414669 Aug 29 05:10:51.513015 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2182/4378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:50 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:51.729472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3a91ebd6-94c0-499b-a50e-79c33ca9c392 req-7ab4d91c-b8c2-43a5-9f23-fab055f28b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904b4106-5845-40b8-8f26-7eacf31b54b8", "name": "network-vif-unplugged", "status": "completed", "tag": "fbfd57c9-7dce-4a91-982f-cfa91fd489ee"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:51.759814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3a91ebd6-94c0-499b-a50e-79c33ca9c392 req-7ab4d91c-b8c2-43a5-9f23-fab055f28b39 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:51.760361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3a91ebd6-94c0-499b-a50e-79c33ca9c392 req-7ab4d91c-b8c2-43a5-9f23-fab055f28b39 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:51.762755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3a91ebd6-94c0-499b-a50e-79c33ca9c392 req-7ab4d91c-b8c2-43a5-9f23-fab055f28b39 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:51.798867 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3a91ebd6-94c0-499b-a50e-79c33ca9c392 req-7ab4d91c-b8c2-43a5-9f23-fab055f28b39 service nova] Creating event network-vif-unplugged:fbfd57c9-7dce-4a91-982f-cfa91fd489ee for instance 904b4106-5845-40b8-8f26-7eacf31b54b8 on n-h1-854119-9 Aug 29 05:10:51.810169 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3a91ebd6-94c0-499b-a50e-79c33ca9c392 req-7ab4d91c-b8c2-43a5-9f23-fab055f28b39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086656 Aug 29 05:10:51.814715 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2183/4379] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:10:51.925985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:51.926687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:51.938517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:51.941535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:51.942005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:51.942748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:51.947691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:51.948331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:52.108936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:52.119080 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2789b5aa-75f2-4634-b47a-9dde2172da5a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 1.004539 Aug 29 05:10:52.119789 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2197/4380] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:51 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:10:52.313325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:52.324941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:52.326652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:52.330926 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-77a9d182-3032-4758-9dd8-76d409efdd51 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1721 microversion: 2.20 time: 0.410370 Aug 29 05:10:52.352270 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2184/4381] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:51 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1721 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:52.537493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:52.538185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:52.552289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:52.555286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:52.555771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:52.559773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:52.561042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:52.563510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:52.846914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:52.869109 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a11cc7ad-0257-46a0-a7e8-d9d040ebbdce tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 0.337745 Aug 29 05:10:52.870124 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2198/4382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:52 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:53.142993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:53.143657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:53.159556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:53.164248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:53.164845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:53.167695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:53.172237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:53.174266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:53.363399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:53.364027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:53.377233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:53.377742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:53.380596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:53.381342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:53.381810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:53.382249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:54.632151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:54.655910 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e5878ba-817f-4717-bb60-f05c87e84d40 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 1.516656 Aug 29 05:10:54.667064 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2185/4383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:53 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:54.675271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:54.681689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:54.704027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:54.707318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:54.709708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:54.710403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:54.714154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:54.717127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:54.718041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:54.859032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:54.869777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:54.876924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:54.879929 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-efde3b1f-935e-4319-b05e-61d57fd98063 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1721 microversion: 2.20 time: 1.522536 Aug 29 05:10:54.887628 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2199/4384] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:53 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1721 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:54.896204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:54.898413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:54.914789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:54.915725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:54.916361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:54.917311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:54.919224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:54.919822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:55.704063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:55.717199 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cc40655b-ae5e-4b90-81ac-8922e9ddd590 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 1.047467 Aug 29 05:10:55.720961 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2186/4385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:54 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:56.046514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-09f42c74-2fe4-4af6-b025-ae8dc649296b req-2b8926f7-e266-4622-8872-08b8643621d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886db681-da58-4c61-aaa2-386a1a69f8a4", "name": "network-vif-plugged", "status": "completed", "tag": "bc864747-a6c8-4df3-b067-4d7e895b92f1"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:56.059372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-09f42c74-2fe4-4af6-b025-ae8dc649296b req-2b8926f7-e266-4622-8872-08b8643621d0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:56.060164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-09f42c74-2fe4-4af6-b025-ae8dc649296b req-2b8926f7-e266-4622-8872-08b8643621d0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:56.060777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-09f42c74-2fe4-4af6-b025-ae8dc649296b req-2b8926f7-e266-4622-8872-08b8643621d0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:56.075080 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-09f42c74-2fe4-4af6-b025-ae8dc649296b req-2b8926f7-e266-4622-8872-08b8643621d0 service nova] Creating event network-vif-plugged:bc864747-a6c8-4df3-b067-4d7e895b92f1 for instance 886db681-da58-4c61-aaa2-386a1a69f8a4 on n-h1-854119-9 Aug 29 05:10:56.082055 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-09f42c74-2fe4-4af6-b025-ae8dc649296b req-2b8926f7-e266-4622-8872-08b8643621d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359472 Aug 29 05:10:56.083737 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2187/4386] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:10:56.090263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:56.091379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:56.098828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:56.100093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:56.100799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:56.101793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:56.102470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:56.103110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:56.169511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:56.200266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:56.202638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:56.205486 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2abbe256-904a-489c-836e-cae14abf181f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2947 microversion: 2.42 time: 1.316516 Aug 29 05:10:56.208842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2200/4387] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:54 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2947 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:56.222967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:56.224758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:56.233540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:56.249305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:56.250520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:56.254494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:56.255736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:56.256976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:56.697559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:56.722759 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0d5b226a-a46e-4b22-9024-892256182c0b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 0.637411 Aug 29 05:10:56.723375 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2188/4388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:56 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:56.734372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:56.735926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22396070-f9c1-472f-a7aa-8be75a06358a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:56.739475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22396070-f9c1-472f-a7aa-8be75a06358a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:56.748799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:56.750466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:56.752342 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ec50d62-25ef-41f7-8b91-c636fb601308 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1721 microversion: 2.20 time: 0.540355 Aug 29 05:10:56.759380 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2201/4389] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:56 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1721 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:56.765110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:56.766017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:56.768619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22396070-f9c1-472f-a7aa-8be75a06358a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:56.774618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22396070-f9c1-472f-a7aa-8be75a06358a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:56.775670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22396070-f9c1-472f-a7aa-8be75a06358a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:56.776478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22396070-f9c1-472f-a7aa-8be75a06358a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:56.776944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22396070-f9c1-472f-a7aa-8be75a06358a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:56.777369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22396070-f9c1-472f-a7aa-8be75a06358a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:56.779541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:56.786141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:56.787987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:56.790004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:56.791883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:56.793924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:56.794396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:57.445174 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22396070-f9c1-472f-a7aa-8be75a06358a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.718582 Aug 29 05:10:57.446025 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2189/4390] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 29 05:10:56 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705/os-interface => generated 1832 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:10:57.462209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:57.488244 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e59b7b8-c26c-4197-ae9e-817a2b4c5303 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1318 microversion: 2.1 time: 0.719702 Aug 29 05:10:57.491145 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2202/4391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:56 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1318 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:57.744598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:57.745975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:57.775726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:57.779887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:57.781914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:57.784875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:57.787220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:57.787735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:57.788698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:57.789354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:57.801627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:57.802397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:57.802981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:57.809358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:57.810084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:57.810667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:58.653471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:58.669687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:58.671618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:58.673655 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e42a89a7-6e63-466a-9a2d-f1c25f3c760c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1664 microversion: 2.20 time: 0.891192 Aug 29 05:10:58.675755 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2203/4392] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:10:57 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1664 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:10:58.682557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:58.683924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:58.693712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:58.694947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:58.695996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:58.698917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:58.700071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:58.702742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:58.836245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:58.847579 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-413a5dc0-2ee7-4f05-beab-30a888248e67 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 1.107988 Aug 29 05:10:58.867268 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2190/4393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:57 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:58.880279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42277cd4-4476-4f52-b4cf-a63491371f57 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "493eaf9a-6baf-47bf-9345-608838080478"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:58.887694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42277cd4-4476-4f52-b4cf-a63491371f57 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:58.908413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42277cd4-4476-4f52-b4cf-a63491371f57 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:58.911214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42277cd4-4476-4f52-b4cf-a63491371f57 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:58.911830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42277cd4-4476-4f52-b4cf-a63491371f57 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:58.913966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42277cd4-4476-4f52-b4cf-a63491371f57 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:58.914878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42277cd4-4476-4f52-b4cf-a63491371f57 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:58.919217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42277cd4-4476-4f52-b4cf-a63491371f57 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:59.263285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:10:59.276448 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1f8f3b7a-445a-46dd-8003-cd4fc26b6d4a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1507 microversion: 2.1 time: 0.599218 Aug 29 05:10:59.277660 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2204/4394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:58 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1507 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:10:59.298493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25c1bf11-b9f4-4b3b-9b42-ee535581637e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e93bbcf0-cca9-4ea8-97b1-24bd2e463a9a", "device": "/dev/sdb"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:10:59.309978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-25c1bf11-b9f4-4b3b-9b42-ee535581637e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:59.336457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25c1bf11-b9f4-4b3b-9b42-ee535581637e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:59.341133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25c1bf11-b9f4-4b3b-9b42-ee535581637e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:59.341820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25c1bf11-b9f4-4b3b-9b42-ee535581637e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:59.349431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25c1bf11-b9f4-4b3b-9b42-ee535581637e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:59.350343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25c1bf11-b9f4-4b3b-9b42-ee535581637e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:59.350990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25c1bf11-b9f4-4b3b-9b42-ee535581637e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:59.643166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:10:59.679945 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42277cd4-4476-4f52-b4cf-a63491371f57 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.809670 Aug 29 05:10:59.687022 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2191/4395] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Aug 29 05:10:58 2022] POST /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 188 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:10:59.868667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:10:59.869304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:10:59.885668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:59.886195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:59.886644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:10:59.887375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:10:59.902529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:10:59.905438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:00.133617 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-25c1bf11-b9f4-4b3b-9b42-ee535581637e tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "POST /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821496 Aug 29 05:11:00.138920 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2205/4396] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:10:59 2022] POST /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4/os-volume_attachments => generated 194 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:11:00.168394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:00.173703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:00.202236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:00.204950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:00.205443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:00.210576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:00.211434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:00.213325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:00.529908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128872) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 05:11:00.775211 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9d5b1629-6a17-4557-8741-d364befa6be9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/action" status: 202 len: 0 microversion: 2.20 time: 0.631640 Aug 29 05:11:00.784209 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2206/4397] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 05:11:00 2022] POST /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:11:00.807904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:00.809249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:00.824222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:00.825029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:00.825149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:00.830541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:00.831057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:00.831706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:01.318019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:01.326510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:01.338418 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1852710a-8a7c-450a-8cc7-5bb3beebe680 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 1.471288 Aug 29 05:11:01.341728 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2192/4398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:10:59 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:01.363008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b584f964-ec21-487b-9886-fc579ee5793c req-955d0014-aa5f-4811-8a9a-d6561f955d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c83cae9-ef18-4723-9742-bb5e40f1b115", "name": "network-vif-plugged", "status": "completed", "tag": "b5b79f0a-b188-414c-99ed-082280f4ef23"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:01.380533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b584f964-ec21-487b-9886-fc579ee5793c req-955d0014-aa5f-4811-8a9a-d6561f955d3f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:01.381393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b584f964-ec21-487b-9886-fc579ee5793c req-955d0014-aa5f-4811-8a9a-d6561f955d3f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:01.382162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b584f964-ec21-487b-9886-fc579ee5793c req-955d0014-aa5f-4811-8a9a-d6561f955d3f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:01.450200 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b584f964-ec21-487b-9886-fc579ee5793c req-955d0014-aa5f-4811-8a9a-d6561f955d3f service nova] Creating event network-vif-plugged:b5b79f0a-b188-414c-99ed-082280f4ef23 for instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 on n-h1-854119-9 Aug 29 05:11:01.479463 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b584f964-ec21-487b-9886-fc579ee5793c req-955d0014-aa5f-4811-8a9a-d6561f955d3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133243 Aug 29 05:11:01.482972 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2193/4399] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:01.895714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:01.913026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:01.914490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:01.931470 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eefc8648-2622-41af-babe-c0b3308e61f5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1750 microversion: 2.20 time: 1.128460 Aug 29 05:11:01.933076 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2207/4400] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:00 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1750 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:02.372069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:02.373556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:02.399762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:02.400920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:02.401608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:02.402600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:02.404643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:02.405409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:02.957337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:02.957775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:02.976552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:02.981274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:02.981770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:02.986494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:02.990583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:02.991391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:04.358847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:04.376641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8cdc2e3-394d-4d84-8b7e-3caef3f91d6a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1317 microversion: 2.1 time: 2.010317 Aug 29 05:11:04.396571 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2194/4401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:02 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1317 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:04.705212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:04.731003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:04.741886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:04.747651 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1efdbc4e-fabc-4241-b40d-751de1d90708 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1750 microversion: 2.20 time: 1.793827 Aug 29 05:11:04.751234 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2208/4402] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:02 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1750 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:11:05.419894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:05.421101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:05.429965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:05.432676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:05.433306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:05.434267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:05.438315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:05.439495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:05.779218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:05.780569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:05.796051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:05.797565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:05.798365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:05.801749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:05.802564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:05.805167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:06.888004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:06.906615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c4a12160-02a2-4cb4-91c9-24e16506bf89 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 1.492447 Aug 29 05:11:06.913608 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2195/4403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:05 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:07.128627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:07.133808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1963781842", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:07.147046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:07.155393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:07.156928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d4c33040-c101-4dba-90a7-947b83c5e394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1752 microversion: 2.20 time: 1.383026 Aug 29 05:11:07.157791 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2209/4404] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:05 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1752 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:07.246434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] validate_networks() for [('de84ed4b-7ac8-4504-ae7e-3c04abeb53cb', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:11:08.185386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:08.187192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:08.202153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:08.202937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:08.203580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:08.204550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:08.205193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:08.205765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:08.514905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:08.528598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:08.533667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:08.535356 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-05e69b18-b1b9-4c45-85de-7a1cc2f152c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1752 microversion: 2.20 time: 0.353993 Aug 29 05:11:08.555163 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2210/4405] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:08 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1752 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:09.048736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:11:09.049120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:11:09.049694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:11:09.049971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:11:09.050587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:11:09.068515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:09.075779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:09.082060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:09.083155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:09.083807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:09.084429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:09.128821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Getting quotas for project 2c01935816574154a5c9832f4bd94886. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:11:09.145485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Getting quotas for user d27af7c7f74d41c8882f29888c70ebdd and project 2c01935816574154a5c9832f4bd94886. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:11:09.177856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:11:09.180154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:11:09.286355 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-40984b80-7689-4a82-a59b-57c12891e82a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.156531 Aug 29 05:11:09.299075 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2196/4406] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:11:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:11:09.304420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d1d36f6-edb5-4b9f-a145-7a8fffc5a84a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:09.306152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d1d36f6-edb5-4b9f-a145-7a8fffc5a84a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:09.431911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9481f702-d7b8-48ac-89b4-a70da77d27e5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'create', calling method: .version_select at 0x7f1ab9270a60>, body: {"keypair": {"name": "tempest-keypair-1109037849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBGtZGl92WlNVE/MPSIe62Gpw7oVZXvQu26PXYxDCC65L1ld8VNMd8XHo6OpuUexwU7FF6UGk5kExDjee61x96L0EDwT8QYczai+zlcyJ66I/XFIE+58fgTl1Oi6O5tGw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:09.471925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9481f702-d7b8-48ac-89b4-a70da77d27e5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for project 164260d628ac492481d9d3524036abf8. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:11:09.483165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9481f702-d7b8-48ac-89b4-a70da77d27e5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for user 6fb88aef408746868abb4053768c18c4 and project 164260d628ac492481d9d3524036abf8. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:11:09.541672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9481f702-d7b8-48ac-89b4-a70da77d27e5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.241407 Aug 29 05:11:09.542341 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2211/4407] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:11:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:11:09.562524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:09.563387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:09.572611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d1d36f6-edb5-4b9f-a145-7a8fffc5a84a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:09.575120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:09.575814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:09.577548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:09.580945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:09.581603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:09.582401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:09.583266 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d1d36f6-edb5-4b9f-a145-7a8fffc5a84a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1217 microversion: 2.1 time: 0.281410 Aug 29 05:11:09.588828 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2197/4408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:09 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1217 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:10.054412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:10.071283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:10.079596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:10.081233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5f609c1b-4ae9-4131-b0d4-66152d79841f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1752 microversion: 2.20 time: 0.522553 Aug 29 05:11:10.089885 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2212/4409] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:09 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1752 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:11:10.615063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:10.616035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:10.629271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:10.630385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:10.631421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:10.636805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:10.637517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:10.640902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:10.889336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:10.926283 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ecff7c0-2a56-46b4-947c-157c3567888d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1213 microversion: 2.1 time: 0.316697 Aug 29 05:11:10.930548 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2198/4410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:10 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1213 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:11.118284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:11.119167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:11.135420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:11.136496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:11.140279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:11.141525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:11.144040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:11.145259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:11.420831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:11.435499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:11.439882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:11.443060 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b058a4d-73d5-4401-b2d1-936d10b37d5d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1752 microversion: 2.20 time: 0.329100 Aug 29 05:11:11.447290 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2213/4411] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:11 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1752 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:11.960418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:11.961144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:11.983142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:11.983661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:11.986808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:11.988805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:11.991144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:11.996560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:12.150923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:12.173676 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17b0aef8-bc3e-4f5e-a286-698a1e0a4273 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1275 microversion: 2.1 time: 0.222719 Aug 29 05:11:12.176413 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2199/4412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:11 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:12.473075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:12.474293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:12.494009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:12.498216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:12.500609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:12.501708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:12.504357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:12.506362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:12.766224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:12.780171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:12.789358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:12.791613 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f0e371a4-141d-4a39-af06-11655a786d0c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1752 microversion: 2.20 time: 0.323214 Aug 29 05:11:12.792541 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2214/4413] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:12 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1752 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:13.071217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1584807944", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9"}], "security_groups": [{"name": "tempest-securitygroup--2012100402"}], "key_name": "tempest-keypair-1109037849", "user_data": "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:13.197140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:13.215471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:13.235486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:13.236450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:13.237215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:13.238176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:13.238789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:13.239897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:13.499879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] validate_networks() for [('538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:11:13.766122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:13.778680 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a35634d8-9a5d-4908-b611-5f8dfe682fef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1317 microversion: 2.1 time: 0.585922 Aug 29 05:11:13.780418 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2215/4414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:13 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:13.821114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:13.823148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:13.832172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:13.833566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:13.834378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:13.835386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:13.836000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:13.836767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:14.268025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:14.288442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:14.290519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:14.292058 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c8a37246-eca1-409b-8ac4-bd46a7faae1a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1752 microversion: 2.20 time: 0.476990 Aug 29 05:11:14.292737 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2216/4415] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:13 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1752 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:14.609270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:11:14.609760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:11:14.610235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:11:14.610702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:11:14.611205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:11:14.625623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:14.629271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:14.629846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:14.632657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:14.633211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:14.641785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:14.678677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:11:14.687482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for user 6fb88aef408746868abb4053768c18c4 and project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:11:14.717033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:11:14.726857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:11:14.795014 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-81bcf8d4-01e1-4575-bc62-b27e33c46f07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.729185 Aug 29 05:11:14.797990 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2200/4416] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:11:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:11:14.810390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:14.811005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:14.824614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55b8ad97-b2e3-4868-844e-d55c19e10708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:14.825824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-55b8ad97-b2e3-4868-844e-d55c19e10708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:14.827563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:14.830876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:14.831593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:14.832650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:14.833492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:14.836321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:15.163316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-55b8ad97-b2e3-4868-844e-d55c19e10708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:15.204985 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-55b8ad97-b2e3-4868-844e-d55c19e10708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1239 microversion: 2.1 time: 0.391510 Aug 29 05:11:15.221109 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2201/4417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:14 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1239 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:15.235569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4971d7db-3fba-425f-856c-5a86c6ae2de3 req-79fc67e3-ffa5-4f2a-91e0-7e679279fe25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb1b817-f286-4fee-bd85-ecac579e5be2", "tag": "d8bdf103-2b90-4437-88ba-21e6087ef3ba"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:15.263132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4971d7db-3fba-425f-856c-5a86c6ae2de3 req-79fc67e3-ffa5-4f2a-91e0-7e679279fe25 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:15.263605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4971d7db-3fba-425f-856c-5a86c6ae2de3 req-79fc67e3-ffa5-4f2a-91e0-7e679279fe25 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:15.264065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4971d7db-3fba-425f-856c-5a86c6ae2de3 req-79fc67e3-ffa5-4f2a-91e0-7e679279fe25 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:15.302689 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4971d7db-3fba-425f-856c-5a86c6ae2de3 req-79fc67e3-ffa5-4f2a-91e0-7e679279fe25 service nova] Creating event network-changed:d8bdf103-2b90-4437-88ba-21e6087ef3ba for instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 on n-h1-854119-9 Aug 29 05:11:15.317145 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4971d7db-3fba-425f-856c-5a86c6ae2de3 req-79fc67e3-ffa5-4f2a-91e0-7e679279fe25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091671 Aug 29 05:11:15.317786 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2202/4418] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:15.333858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:15.334587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:15.349672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:15.350171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:15.350608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:15.351322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:15.351773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:15.352258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:15.616425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:15.639617 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f05d9eda-0e36-46f5-bba7-9e9b19200415 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1317 microversion: 2.1 time: 0.833198 Aug 29 05:11:15.642035 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2217/4419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:14 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1317 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:16.097823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-337587526", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e39f9ae3-92e4-4423-9328-d54186a921da"}], "security_groups": [{"name": "tempest-securitygroup--1939242300"}], "key_name": "tempest-keypair-278366381", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "84829139-3c0b-4106-ab7b-d37a6f404e4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:16.834622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:16.851758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:16.864335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:16.866016 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8154af2e-98ac-402b-9e73-db0c3c97aa42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1752 microversion: 2.20 time: 1.547030 Aug 29 05:11:16.867173 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2203/4420] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:15 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1752 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:16.872705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:16.873316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:16.884497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:16.885495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:16.886114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:16.886997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:16.888664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:16.889097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:16.891092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] validate_networks() for [('e39f9ae3-92e4-4423-9328-d54186a921da', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:11:17.179730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:17.187892 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6bd6fc94-1adf-4418-a34d-d0158a464264 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1291 microversion: 2.1 time: 0.319485 Aug 29 05:11:17.200987 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2204/4421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:16 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1291 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:17.206460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:17.207250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:17.213528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:17.221636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:17.222423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:17.223361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:17.224806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:17.225456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:17.603132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:17.615034 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8613aaba-4237-41e5-ade5-697a25347b58 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1317 microversion: 2.1 time: 0.411523 Aug 29 05:11:17.642181 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2205/4422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:17 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:17.738385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Getting quotas for project ca3846ab054c4ffeb5586099654c9b3b. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:11:17.746199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Getting quotas for user 7304421b62ad4eaaaeddc94c23ac9dba and project ca3846ab054c4ffeb5586099654c9b3b. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:11:17.761858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:11:17.762898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:11:17.763818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:11:17.764467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:11:17.765065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:11:17.775856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:17.776655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:17.777269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:17.778177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:17.778825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:17.779423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:17.808147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Getting quotas for project ca3846ab054c4ffeb5586099654c9b3b. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:11:17.816867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Getting quotas for user 7304421b62ad4eaaaeddc94c23ac9dba and project ca3846ab054c4ffeb5586099654c9b3b. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:11:17.894663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:17.895384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:17.905516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:17.906018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:17.909673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:17.911056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:17.912919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:17.913731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:17.936942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:11:17.940647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84829139-3c0b-4106-ab7b-d37a6f404e4e',volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:11:18.182067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:18.197401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:18.202985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:18.206847 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-38d57379-f146-4401-9907-4ae00a3485d1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1752 microversion: 2.20 time: 0.317055 Aug 29 05:11:18.224662 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e69b8250-c0b4-46fa-93fd-24f9bbb894fe tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.132958 Aug 29 05:11:18.226177 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2218/4423] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:11:16 2022] POST /compute/v2.1/servers => generated 407 bytes in 2137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:11:18.236361 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2206/4424] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:17 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1752 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:18.238275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:18.240800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:18.254427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-76d11688-4a04-4b03-9bba-7ed6af763978 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:18.256270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:18.257817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:18.259373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-76d11688-4a04-4b03-9bba-7ed6af763978 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:18.259999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:18.260957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:18.264433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:18.265075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:18.409078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:18.412161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-76d11688-4a04-4b03-9bba-7ed6af763978 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:18.422192 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cf750344-483b-4f9a-8867-cee83a07d30b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1291 microversion: 2.1 time: 0.194033 Aug 29 05:11:18.422313 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-76d11688-4a04-4b03-9bba-7ed6af763978 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1120 microversion: 2.1 time: 0.183455 Aug 29 05:11:18.433440 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2207/4425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:18 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1120 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:18.437567 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2219/4426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:18 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1291 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:18.637659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:18.638277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:18.649101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:18.649883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:18.651357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:18.653182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:18.653835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:18.654406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:19.077945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:19.097193 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-caddbba6-d708-48f2-80fa-3b85956cdbe5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1317 microversion: 2.1 time: 0.463461 Aug 29 05:11:19.113339 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2208/4427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:18 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:19.236085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:19.236728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:19.251953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:19.253033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:19.254364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:19.255396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:19.256941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:19.257598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:19.446153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:19.447213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:19.518931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:19.526965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:19.527424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:19.529052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:19.529527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:19.529958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:19.804528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:19.820445 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5c86365-53db-4455-80de-c987da310605 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1162 microversion: 2.1 time: 0.378770 Aug 29 05:11:19.822322 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2209/4428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:19 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1162 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:19.847222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:19.852668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:19.876423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:19.877272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:19.877708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:19.879590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:19.884990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:19.887446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:20.085111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:20.101416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:20.103192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:20.108824 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5657ead4-d075-470f-879f-02982f5d68e3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1752 microversion: 2.20 time: 0.877348 Aug 29 05:11:20.109435 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2220/4429] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:19 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1752 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:20.131095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:20.131882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:20.135703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:20.147739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:20.148139 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-32ee7002-4243-4469-ad92-d3e006274dbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1297 microversion: 2.1 time: 0.323624 Aug 29 05:11:20.150356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:20.150831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:20.155982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:20.159219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:20.159219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:20.160266 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2210/4430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:19 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1297 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:20.469013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:20.483286 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69eee520-ac17-4d68-894a-cf6edc8f99c3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1317 microversion: 2.1 time: 0.355608 Aug 29 05:11:20.483897 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2221/4431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:20 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:20.845625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:20.847435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:20.892113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:20.895149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:20.895879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:20.897536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:20.898219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:20.899709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:21.058048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:21.067883 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bcb76872-8c15-4fae-9b32-d19a36497634 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1218 microversion: 2.1 time: 0.227907 Aug 29 05:11:21.073286 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2211/4432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:20 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1218 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:21.135296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:21.136216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:21.145763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:21.149193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:21.151227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:21.152215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:21.154154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:21.155754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:21.190069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:21.191919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:21.209440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:21.210725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:21.213011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:21.213983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:21.216379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:21.218402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:21.232370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:21.956845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:21.968403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:21.970302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:21.973479 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-783d3287-630d-43c0-a3c1-de06a48a3095 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.842129 Aug 29 05:11:21.994323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2222/4433] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:21 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:22.024922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:22.040489 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87bb2939-d83f-485f-ad03-584d65af46e8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 0.861384 Aug 29 05:11:22.041611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:22.042493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:22.053922 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2212/4434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:21 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:22.072233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:22.074746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:22.078608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:22.081350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:22.082959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:22.084174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:22.095096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:22.095996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:22.112205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:22.112979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:22.113606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:22.114535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:22.115143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:22.116511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:22.377381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:22.388081 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d10bc3f9-4c47-45f6-98d7-e4f8c94b424f tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1236 microversion: 2.1 time: 0.296998 Aug 29 05:11:22.400148 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2213/4435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:22 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1236 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:22.731305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:22.745005 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80ad884e-72e8-421a-868c-2639579f4de9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1317 microversion: 2.1 time: 0.730448 Aug 29 05:11:22.746459 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2223/4436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:21 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:23.002839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:23.003532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:23.018185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:23.021906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:23.027184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:23.029915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:23.031708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:23.040582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:23.061344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:23.062200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:23.075322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:23.075833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:23.076315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:23.092079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:23.103439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:23.103578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:24.484614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:24.505076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:24.510668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:24.516419 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-920447b4-bb68-4a52-8159-111e8219e2c1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 1.519000 Aug 29 05:11:24.518266 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2214/4437] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:22 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:24.544880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:24.547503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:24.564843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:24.565387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:24.565833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:24.566714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:24.567259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:24.567699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:24.570825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:24.674801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:24.721610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:24.734763 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-48a729e8-af3c-44c9-a026-340aef0b5952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 1.675432 Aug 29 05:11:24.735312 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2224/4438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:23 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:24.763176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:24.765710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:24.790406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:24.790912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:24.791341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:24.792056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:24.792536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:24.792958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:25.364828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:25.379790 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-74e45982-266c-4155-9561-c7851d6341b6 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1236 microversion: 2.1 time: 0.856211 Aug 29 05:11:25.381798 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2215/4439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:24 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1236 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:25.394443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-507b6156-4e1e-4d6c-a58e-b1e81636ee9b req-dda48848-7e3e-4352-bcb3-209a59e2fff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb1b817-f286-4fee-bd85-ecac579e5be2", "name": "network-vif-plugged", "status": "completed", "tag": "d8bdf103-2b90-4437-88ba-21e6087ef3ba"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:25.418728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:25.422868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-507b6156-4e1e-4d6c-a58e-b1e81636ee9b req-dda48848-7e3e-4352-bcb3-209a59e2fff7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:25.423507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-507b6156-4e1e-4d6c-a58e-b1e81636ee9b req-dda48848-7e3e-4352-bcb3-209a59e2fff7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:25.423993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-507b6156-4e1e-4d6c-a58e-b1e81636ee9b req-dda48848-7e3e-4352-bcb3-209a59e2fff7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:25.467637 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-507b6156-4e1e-4d6c-a58e-b1e81636ee9b req-dda48848-7e3e-4352-bcb3-209a59e2fff7 service nova] Creating event network-vif-plugged:d8bdf103-2b90-4437-88ba-21e6087ef3ba for instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 on n-h1-854119-9 Aug 29 05:11:25.473211 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-507b6156-4e1e-4d6c-a58e-b1e81636ee9b req-dda48848-7e3e-4352-bcb3-209a59e2fff7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090224 Aug 29 05:11:25.474097 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2216/4440] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:25.543250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:25.544431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:25.560454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:25.561407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:25.562049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:25.562975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:25.563654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:25.564335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:25.698766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:25.710718 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-89764890-42d6-4569-80cd-0c154fa050c8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1317 microversion: 2.1 time: 0.969768 Aug 29 05:11:25.711326 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2225/4441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:24 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1317 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:25.757033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:25.757779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:25.777735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:25.778526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:25.786270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:25.787305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:25.788031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:25.788666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:26.289708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:26.329918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:26.333257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:26.334855 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c8549779-49b0-41fc-be82-558e4d1dd048 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.796037 Aug 29 05:11:26.339413 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2217/4442] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:25 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:11:26.401015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:26.401653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:26.411365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:26.411876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:26.412357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:26.413092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:26.425380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:26.425848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:26.460555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:26.469855 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9c836319-385b-4c0e-b81f-a9edb0a9d4eb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 0.718621 Aug 29 05:11:26.476633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2226/4443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:25 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:26.748087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:26.751403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:26.775144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:26.782029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:26.782771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:26.783754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:26.784448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:26.785038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:27.790146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:27.827759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=14 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:27.868024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:27.873890 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7e9f16c-1cad-41c3-9a51-4d3728feb236 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1304 microversion: 2.1 time: 1.476834 Aug 29 05:11:27.874523 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2218/4444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:26 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1304 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:27.905318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3a2145d1-e582-443f-9b10-e8acf2eeeaaa req-2a1c906d-9b1a-4c4d-889c-bfbe7f3b6760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:27.963023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3a2145d1-e582-443f-9b10-e8acf2eeeaaa req-2a1c906d-9b1a-4c4d-889c-bfbe7f3b6760 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:27.982822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3a2145d1-e582-443f-9b10-e8acf2eeeaaa req-2a1c906d-9b1a-4c4d-889c-bfbe7f3b6760 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:27.983294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3a2145d1-e582-443f-9b10-e8acf2eeeaaa req-2a1c906d-9b1a-4c4d-889c-bfbe7f3b6760 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:28.036822 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3a2145d1-e582-443f-9b10-e8acf2eeeaaa req-2a1c906d-9b1a-4c4d-889c-bfbe7f3b6760 service nova] Creating event network-changed:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:11:28.063362 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3a2145d1-e582-443f-9b10-e8acf2eeeaaa req-2a1c906d-9b1a-4c4d-889c-bfbe7f3b6760 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176851 Aug 29 05:11:28.065730 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2219/4445] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:28.086082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:28.092376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:28.116481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:28.118214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:28.119284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:28.122299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:28.125720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:28.126938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:28.159473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:28.175164 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d93abad8-7dfb-4f3c-bbcb-32701525490c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1317 microversion: 2.1 time: 1.440597 Aug 29 05:11:28.185495 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2227/4446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:26 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1317 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:28.194605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:28.201126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:28.222884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:28.228793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:28.229656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:28.230338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:28.231332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:28.236434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:28.237363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:28.421562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=18 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:30.044703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:30.047514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:30.063241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:30.063938 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73d27b39-3d4e-4a17-a639-728439e64aa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 1.875458 Aug 29 05:11:30.064752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:30.065944 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e6f72842-67d3-4173-baa6-0dce4a38161c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 1.995806 Aug 29 05:11:30.066394 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2228/4447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:28 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:30.080903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1504987936", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:30.084802 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2220/4448] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:28 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:30.095144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:30.096007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:30.113264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:30.113773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:30.114200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:30.114913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:30.115374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:30.118990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:30.183856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:11:30.794656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:30.814603 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30dc9af7-5bfe-4529-b4df-3e99af8da88e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1304 microversion: 2.1 time: 0.728396 Aug 29 05:11:30.833814 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2221/4449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:30 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1304 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:30.844903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:30.845535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:30.861797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:30.862325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:30.862752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:30.863635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:30.863930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:30.864394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:31.579110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:11:31.579616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:11:31.579980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:11:31.583469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:11:31.584500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:11:31.596802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:31.597287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:31.597716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:31.603491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:31.604362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:31.605120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:31.638719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Getting quotas for project e86492c077c64249a9c6da549c33c4c1. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:11:31.644664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Getting quotas for user 0c1b71b178a94f2ba84143ea631683c2 and project e86492c077c64249a9c6da549c33c4c1. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:11:31.668310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:11:31.672070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:11:31.681965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:31.706685 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-559dc778-2fbd-452f-870d-026715182e14 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1505 microversion: 2.1 time: 0.871672 Aug 29 05:11:31.707606 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2222/4450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:30 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1505 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:31.712458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-437ccbfa-7b41-4c5d-902a-9c4013364515 req-fb9a3fe2-b267-416b-a51b-a02e07ac4248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629b4b3c-90af-4afb-8b2e-1f018dd22d01", "tag": "e91c536f-9ec2-47c7-8d8a-f1c46464c3bc"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:31.729884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-437ccbfa-7b41-4c5d-902a-9c4013364515 req-fb9a3fe2-b267-416b-a51b-a02e07ac4248 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:31.730744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-437ccbfa-7b41-4c5d-902a-9c4013364515 req-fb9a3fe2-b267-416b-a51b-a02e07ac4248 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:31.731395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-437ccbfa-7b41-4c5d-902a-9c4013364515 req-fb9a3fe2-b267-416b-a51b-a02e07ac4248 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:31.747406 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-437ccbfa-7b41-4c5d-902a-9c4013364515 req-fb9a3fe2-b267-416b-a51b-a02e07ac4248 service nova] Creating event network-changed:e91c536f-9ec2-47c7-8d8a-f1c46464c3bc for instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 on n-h1-854119-9 Aug 29 05:11:31.753327 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-437ccbfa-7b41-4c5d-902a-9c4013364515 req-fb9a3fe2-b267-416b-a51b-a02e07ac4248 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044163 Aug 29 05:11:31.754294 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2223/4451] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:31.761563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:31.762572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:31.762704 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22e4a468-b9f1-4868-a87e-90eb2d48f9be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694652 Aug 29 05:11:31.763303 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2229/4452] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:11:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:11:31.769439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:31.769638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:31.778376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:31.779261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:31.780050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:31.781230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:31.781958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:31.782565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:31.783950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:31.785119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:31.785665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:31.786509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:31.787076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:31.787592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:32.741698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:32.773090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:32.775402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:32.779341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-02d893c7-7db5-420d-88ff-2e02cc1211a0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 1.014958 Aug 29 05:11:32.783604 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2230/4453] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:31 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:32.793920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:32.803543 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dfc12ba1-770e-493b-99a9-25470e1febc4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 1.047698 Aug 29 05:11:32.805674 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2224/4454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:31 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:32.813430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:32.815187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c4609836-b3d3-490d-8009-b43f0e769e9d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:32.816339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:32.818377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c4609836-b3d3-490d-8009-b43f0e769e9d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:32.841804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:32.843099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:32.843566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:32.847395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:32.847965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:32.851005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:32.980503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:11:33.034916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c4609836-b3d3-490d-8009-b43f0e769e9d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:33.043084 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c4609836-b3d3-490d-8009-b43f0e769e9d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1214 microversion: 2.1 time: 0.236082 Aug 29 05:11:33.046180 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2225/4455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:32 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:33.053350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:33.060706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:33.079660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:33.080677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:33.084812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:33.086765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:33.087462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:33.088065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:33.359587 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b962adc-71fc-4dec-907a-18b1629b6521 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 204 len: 0 microversion: 2.1 time: 0.561165 Aug 29 05:11:33.362233 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2231/4456] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:11:32 2022] DELETE /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:11:33.391344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:33.396782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:33.426926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:33.427976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:33.429329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:33.432482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:33.436587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:33.437261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:33.511032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:33.519830 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b778c3f0-4e87-4df7-8484-fb644eb36393 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.470546 Aug 29 05:11:33.523846 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2226/4457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:33 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:33.680377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:33.694212 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee4a7d79-2eea-4858-a650-0b2994a27661 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1511 microversion: 2.1 time: 0.322696 Aug 29 05:11:33.701171 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2232/4458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:33 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:33.812239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:33.812903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:33.824908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:33.825414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:33.825850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:33.827092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:33.827730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:33.828862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:33.835050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:33.837838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:33.858994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:33.859162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:33.859500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:33.860540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:33.861451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:33.862765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:34.071818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:34.088342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:34.089788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:34.091220 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-817e514b-ed10-412a-9b5c-f4c16a75806a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.282923 Aug 29 05:11:34.091979 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2227/4459] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:33 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:34.100187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:34.105059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:34.119386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:34.121052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:34.121721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:34.122316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:34.123183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:34.123817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:34.124424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:34.127801 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-749b7314-c429-41b1-a6f2-b1741c237e0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 0.297691 Aug 29 05:11:34.128437 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2233/4460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:33 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:34.207198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:34.225628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1e7befd2-0f71-4591-ad57-e76858b6ed79 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1266 microversion: 2.1 time: 0.129020 Aug 29 05:11:34.226449 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2228/4461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:34 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:34.550246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:34.551094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:34.563085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:34.569058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:34.569623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:34.570474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:34.571851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:34.571851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:34.726538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:34.728085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:34.746100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:34.749624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:34.750838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:34.755585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:34.757537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:34.759419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:35.134758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:35.147625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-598d3151-32d7-4381-b534-fa2d2a4d403e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.607257 Aug 29 05:11:35.149615 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2234/4462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:34 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:35.173430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:35.175531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:35.193237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:35.195521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:35.196370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:35.199865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:35.202328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:35.203263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:35.226303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:35.249591 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15711846-b3fc-4662-853e-f7bb1011b759 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1511 microversion: 2.1 time: 0.534486 Aug 29 05:11:35.251763 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2229/4463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:34 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1511 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:35.263095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:35.263969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:35.289169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:35.291228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:35.292538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:35.298945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:35.300688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:35.305841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:35.637529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:35.658167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:35.672469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:35.674030 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-74144b78-75bf-43d8-977a-c7e0729ebf3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.520263 Aug 29 05:11:35.676745 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2235/4464] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:35 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:35.704926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:35.705860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:35.723872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:35.726235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:35.727814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:35.730822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:35.732395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:35.733769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:35.758475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:35.771689 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-295136ed-e356-49a6-8628-d14cbc9e5dc1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 0.516625 Aug 29 05:11:35.772970 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2230/4465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:35 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:36.129789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:36.158110 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0d04a94f-e3ba-4874-9843-f47c0d27a6f3 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1266 microversion: 2.1 time: 0.477078 Aug 29 05:11:36.166874 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2236/4466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:35 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1266 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:36.189274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:36.189899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:36.204344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:36.207485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:36.208211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:36.209142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:36.210906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:36.211614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:36.275322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:36.276384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:36.313522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:36.314969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:36.324936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:36.328825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:36.329973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:36.332803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:37.455098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:37.462744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:37.472549 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-214f6400-3c5c-4351-b82a-6779bc7816d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1511 microversion: 2.1 time: 1.201554 Aug 29 05:11:37.473172 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2237/4467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:36 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1511 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:37.496147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:37.499297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:37.535999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:37.537689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:37.540918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:37.542549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:37.545158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:37.549374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:37.735846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:37.755632 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2c0d497-be7a-4abb-a1c4-5a2c911889eb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 1.586128 Aug 29 05:11:37.758804 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2231/4468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:36 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:37.774094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:37.774730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:37.821067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:37.823088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:37.823558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:37.851464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:37.854624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:37.857729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:39.091964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:39.114435 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9b87c824-a1f3-4d50-9fb9-ad305b29fa97 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 1.351709 Aug 29 05:11:39.139422 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2232/4469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:37 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:39.158820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:39.163156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:39.197752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:39.198769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:39.199216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:39.204793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:39.205277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:39.205716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:39.523892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:39.536459 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ecca5517-9d77-4ada-8f66-86eb13e8e6e7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1272 microversion: 2.1 time: 0.390170 Aug 29 05:11:39.550936 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2233/4470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:39 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1272 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:39.567713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:39.568369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:39.568984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:39.584008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:39.584538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:39.585017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:39.591974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:39.592249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:39.592771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:39.593209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:39.596459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:39.600178 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ca6e8de-d167-4c18-afcf-ebdbca43aa16 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 2.119712 Aug 29 05:11:39.603527 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2238/4471] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:37 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:39.615476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:39.617473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:39.642891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:39.644594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:39.646490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:39.647585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:39.651031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:39.651914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:41.087427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:41.090107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:41.109002 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b806a9f-9033-41e9-8453-03fe5863e4dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1469 microversion: 2.1 time: 1.551780 Aug 29 05:11:41.109825 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2234/4472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:39 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1469 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:41.121742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b373abd7-04ed-4d57-882d-fe60713f8568 req-4b3a05e7-9179-4da3-9671-9a47e6752de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "name": "network-vif-plugged", "status": "completed", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:41.161181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b373abd7-04ed-4d57-882d-fe60713f8568 req-4b3a05e7-9179-4da3-9671-9a47e6752de1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:41.165135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b373abd7-04ed-4d57-882d-fe60713f8568 req-4b3a05e7-9179-4da3-9671-9a47e6752de1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:41.168717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b373abd7-04ed-4d57-882d-fe60713f8568 req-4b3a05e7-9179-4da3-9671-9a47e6752de1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:41.207552 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b373abd7-04ed-4d57-882d-fe60713f8568 req-4b3a05e7-9179-4da3-9671-9a47e6752de1 service nova] Creating event network-vif-plugged:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:11:41.219068 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b373abd7-04ed-4d57-882d-fe60713f8568 req-4b3a05e7-9179-4da3-9671-9a47e6752de1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105062 Aug 29 05:11:41.222720 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2235/4473] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:41.235949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:41.242031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:41.262159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:41.264807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:41.265425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:41.266321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:41.272027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:41.272837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:41.622036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:41.662735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:41.873076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:41.885801 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4cb93e3a-0c3b-4bce-a46d-b661f42bd028 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 0.661509 Aug 29 05:11:41.904002 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2236/4474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:41 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:41.916182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:41.917205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:41.937880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:41.938733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:41.939533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:41.940740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:41.942474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:41.943069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:42.120292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:42.133946 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-989bd35f-932f-45a9-9c85-9e804761cbb0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 2.527694 Aug 29 05:11:42.135426 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2239/4475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:39 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 2531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:42.142345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:42.143445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:42.154923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:42.155942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:42.157080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:42.158864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:42.161060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:42.165985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:42.180531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:42.188686 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-da81220b-8859-489a-8276-d68ea5a0a4b7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1272 microversion: 2.1 time: 0.283085 Aug 29 05:11:42.204296 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2237/4476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:41 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:42.215137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7baf74a5-6f84-4e25-93f4-aeede232c80e req-f71b0ba4-5788-42b0-b4b1-13e8e37e7a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb1b817-f286-4fee-bd85-ecac579e5be2", "name": "network-vif-deleted", "tag": "d8bdf103-2b90-4437-88ba-21e6087ef3ba"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:42.242782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7baf74a5-6f84-4e25-93f4-aeede232c80e req-f71b0ba4-5788-42b0-b4b1-13e8e37e7a21 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:42.252944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7baf74a5-6f84-4e25-93f4-aeede232c80e req-f71b0ba4-5788-42b0-b4b1-13e8e37e7a21 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:42.255311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7baf74a5-6f84-4e25-93f4-aeede232c80e req-f71b0ba4-5788-42b0-b4b1-13e8e37e7a21 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:42.284240 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7baf74a5-6f84-4e25-93f4-aeede232c80e req-f71b0ba4-5788-42b0-b4b1-13e8e37e7a21 service nova] Creating event network-vif-deleted:d8bdf103-2b90-4437-88ba-21e6087ef3ba for instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 on n-h1-854119-9 Aug 29 05:11:42.323868 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7baf74a5-6f84-4e25-93f4-aeede232c80e req-f71b0ba4-5788-42b0-b4b1-13e8e37e7a21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107048 Aug 29 05:11:42.332393 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2238/4477] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:42.346198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:42.361516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:42.394474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:42.395001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:42.395428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:42.399075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:42.399644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:42.400163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:42.573013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:42.581571 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eeea33a5-ef41-4be8-9f1d-ecd1fa9547e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1302 microversion: 2.1 time: 0.246751 Aug 29 05:11:42.583330 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2239/4478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:42 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1302 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:42.632017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:42.641635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:42.643091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:42.644341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3a30e00-3e61-4883-8b16-96100b04c4d9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.507438 Aug 29 05:11:42.653555 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2240/4479] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:42 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:42.909697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:42.910697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:42.920218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:42.921110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:42.921836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:42.922715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:42.923318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:42.923890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:43.043080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:43.144727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:43.144871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:43.159830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:43.160627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:43.160792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:43.161704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:43.162324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:43.162925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:43.368187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lazy-loading 'services' on Instance uuid 886db681-da58-4c61-aaa2-386a1a69f8a4 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:11:43.446484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:43.459931 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8281ef0b-7997-492b-a0a6-17654c5dd039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1365 microversion: 2.1 time: 0.554321 Aug 29 05:11:43.466342 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2240/4480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:42 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1365 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:43.472100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:43.473127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:43.482651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:43.483764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:43.484646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:43.485935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:43.486603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:43.487488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:43.505426 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a1dfcf8-24e0-425c-a98e-906e9e583a5a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "DELETE /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4/os-volume_attachments/e93bbcf0-cca9-4ea8-97b1-24bd2e463a9a" status: 202 len: 0 microversion: 2.1 time: 0.364714 Aug 29 05:11:43.506153 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2241/4481] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:11:43 2022] DELETE /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4/os-volume_attachments/e93bbcf0-cca9-4ea8-97b1-24bd2e463a9a => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:11:43.533771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:43.541155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:43.561589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:43.562455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:43.564352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:43.565331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:43.567773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:43.571838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:43.738484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:43.756221 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e02edfe1-15d2-4516-8c6f-2a1533aae8f0 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.288424 Aug 29 05:11:43.772272 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2241/4482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:43 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:43.779033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:43.780567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:43.789955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:43.790774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:43.791370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:43.792364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:43.793053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:43.794657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:44.125285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:44.131608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:44.136800 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c921316f-81c5-4915-9abc-8c397a267905 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1302 microversion: 2.1 time: 0.362665 Aug 29 05:11:44.144095 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c7f95000-b90d-4595-8fde-45d94170c115 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.636202 Aug 29 05:11:44.152929 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2242/4483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:43 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:44.158204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:44.158828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:44.164358 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2242/4484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:43 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1302 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:44.166254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:44.166645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:44.167096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:44.167882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:44.168437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:44.169355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:44.347802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:44.365140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:44.366574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:44.367909 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37fd982c-079a-4f0c-80a3-c76a6f7c6adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.213592 Aug 29 05:11:44.368768 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2243/4485] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:44 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:44.488650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:44.489315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:44.498958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:44.499739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:44.500400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:44.501153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:44.501627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:44.502030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:44.656289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:44.665542 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-78a08e6d-b4f3-4c14-8ff0-b5973e32f660 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1553 microversion: 2.1 time: 0.182405 Aug 29 05:11:44.680456 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2243/4486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:44 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:44.686871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b6fa29ac-f126-4528-8527-2358b5ccc307 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:44.687362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b6fa29ac-f126-4528-8527-2358b5ccc307 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:44.693747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6fa29ac-f126-4528-8527-2358b5ccc307 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:44.694324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6fa29ac-f126-4528-8527-2358b5ccc307 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:44.694778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6fa29ac-f126-4528-8527-2358b5ccc307 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:44.695488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6fa29ac-f126-4528-8527-2358b5ccc307 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:44.696013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6fa29ac-f126-4528-8527-2358b5ccc307 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:44.696468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6fa29ac-f126-4528-8527-2358b5ccc307 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:44.776005 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b6fa29ac-f126-4528-8527-2358b5ccc307 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093003 Aug 29 05:11:44.777431 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2244/4487] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:11:44 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:44.781031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:44.781894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:44.791534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:44.792399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:44.793554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:44.794642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:44.795299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:44.795947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:45.111862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:45.127735 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1547e46a-3043-41c1-b06d-f46ecb274b85 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.352187 Aug 29 05:11:45.129010 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2244/4488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:44 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:45.166590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:45.169772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:45.173376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:45.174154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:45.184102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:45.184630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:45.186279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:45.186957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:45.187610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:45.189070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:45.189483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:45.190234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:45.190691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:45.191107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:45.195876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:45.196479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:45.377254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:45.389404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-caca11ba-a5f9-4b08-9337-a8125d6550bc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1302 microversion: 2.1 time: 0.230148 Aug 29 05:11:45.390327 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2245/4489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:45 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1302 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:45.396611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:45.397517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:45.407719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:45.409035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:45.409448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:45.410336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:45.411224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:45.411996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:45.555300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:45.566587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-239e2078-680d-47f3-bebb-0fa38202fe78 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.402295 Aug 29 05:11:45.569407 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2245/4490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:45 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:45.693589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:45.706221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:45.709976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:45.722409 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8063be26-14e8-43ee-ac24-0753c375f51b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.329724 Aug 29 05:11:45.724154 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2246/4491] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:45 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:46.153904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:46.154634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:46.162120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:46.163064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:46.164148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:46.164542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:46.165249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:46.165898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:46.302208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8b564cd5-1064-4044-acaf-cc43b659aeb9 req-2a6c41ba-24ee-4c10-935f-a37a15550a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:46.317120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b564cd5-1064-4044-acaf-cc43b659aeb9 req-2a6c41ba-24ee-4c10-935f-a37a15550a26 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:46.318037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b564cd5-1064-4044-acaf-cc43b659aeb9 req-2a6c41ba-24ee-4c10-935f-a37a15550a26 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:46.318692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b564cd5-1064-4044-acaf-cc43b659aeb9 req-2a6c41ba-24ee-4c10-935f-a37a15550a26 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:46.333035 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8b564cd5-1064-4044-acaf-cc43b659aeb9 req-2a6c41ba-24ee-4c10-935f-a37a15550a26 service nova] Creating event network-changed:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:11:46.344681 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8b564cd5-1064-4044-acaf-cc43b659aeb9 req-2a6c41ba-24ee-4c10-935f-a37a15550a26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054814 Aug 29 05:11:46.346815 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2247/4492] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:46.422233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:46.429668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:46.431454 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-391bd434-380c-47f3-ac0c-b4d7aab6c716 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.281615 Aug 29 05:11:46.439806 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2246/4493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:46 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:46.457477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:46.477453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:46.478241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:46.479294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:46.480437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:46.481082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:46.481876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:46.583035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:46.589634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:46.590250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:46.605225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:46.606071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:46.606974 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0973bfd9-563a-4596-a662-ff66cafe491c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1302 microversion: 2.1 time: 0.198964 Aug 29 05:11:46.607936 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2248/4494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:46 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1302 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:46.620513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:46.622596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:46.623290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:46.623953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:46.750402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:46.751015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:46.759178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:46.760004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:46.760731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:46.761701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:46.762363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:46.762992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:46.820203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:46.829814 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b707e43-17f4-4073-ab4d-363e9ab4d137 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.243917 Aug 29 05:11:46.832951 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2247/4495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:46 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:46.971903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:46.982832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:46.984303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:46.985507 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fe1894d1-3170-40f9-b69f-cfa7e655bb7d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.240011 Aug 29 05:11:47.001473 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2249/4496] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:46 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:11:47.465140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:47.469158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:47.478998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:47.479714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:47.480347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:47.481752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:47.482425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:47.483666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:47.627863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:47.628518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:47.637774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:47.638574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:47.639217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:47.640147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:47.640798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:47.641445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:47.730907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:47.731745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:47.732533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:47.733370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lazy-loading 'fault' on Instance uuid 7bb1b817-f286-4fee-bd85-ecac579e5be2 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:11:47.832791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:47.841489 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3de76ee5-8277-4955-8143-121b314b5aef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1307 microversion: 2.1 time: 0.217394 Aug 29 05:11:47.842089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2250/4497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:47 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:47.850596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:47.851507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:47.858464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:47.859036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:47.859540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:47.860358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:47.860971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:47.861400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:47.998770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:48.007709 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4edf5a2b-6772-4e9e-ac4c-1032c1553045 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.546383 Aug 29 05:11:48.008725 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2248/4498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:47 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:48.013432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:48.014039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:48.022634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:48.024277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:48.024828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:48.025617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:48.027130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:48.027300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:48.342865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:48.354808 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f489e0b4-2e8e-4f15-b62e-ad44a43bc655 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.507822 Aug 29 05:11:48.356216 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2251/4499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:47 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:48.852145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:48.864039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:48.864683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:48.866933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:48.868532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:48.870047 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a92bc45-d6f0-4bae-a775-0d52a90a60a1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.860376 Aug 29 05:11:48.872108 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2249/4500] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:48 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:48.879369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:48.880095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:48.880709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:48.882603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:48.883938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:48.887096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:48.940711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:48.941193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:48.941801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:48.942408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lazy-loading 'fault' on Instance uuid 7bb1b817-f286-4fee-bd85-ecac579e5be2 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:11:49.014256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:49.028364 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff75e978-1e44-492f-b0f4-9524f2753435 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1307 microversion: 2.1 time: 0.165491 Aug 29 05:11:49.029759 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2252/4501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:48 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1307 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:49.029881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:49.030451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:49.039244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:49.040150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:49.040804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:49.041892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:49.042420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:49.042910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:49.350036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:49.360147 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a42df3ca-ea77-480c-9d8e-4cc2984ef008 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.335839 Aug 29 05:11:49.360761 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2250/4502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:49 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:49.375757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:49.376406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:49.382879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:49.383458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:49.383914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:49.384628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:49.385085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:49.385512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:49.553089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-864a688e-81c6-4590-ab32-5f34338cdfec req-26a488fc-bb22-49ad-91d3-17bde1068aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20361c4d-b9ef-4ec6-b95c-fb009c452212", "tag": "3fe6e7a8-eab5-4997-b647-7a7b466f0918"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:49.569988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-864a688e-81c6-4590-ab32-5f34338cdfec req-26a488fc-bb22-49ad-91d3-17bde1068aea service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:49.571228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-864a688e-81c6-4590-ab32-5f34338cdfec req-26a488fc-bb22-49ad-91d3-17bde1068aea service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:49.572875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-864a688e-81c6-4590-ab32-5f34338cdfec req-26a488fc-bb22-49ad-91d3-17bde1068aea service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:49.592716 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-864a688e-81c6-4590-ab32-5f34338cdfec req-26a488fc-bb22-49ad-91d3-17bde1068aea service nova] Creating event network-changed:3fe6e7a8-eab5-4997-b647-7a7b466f0918 for instance 20361c4d-b9ef-4ec6-b95c-fb009c452212 on n-h1-854119-9 Aug 29 05:11:49.602187 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-864a688e-81c6-4590-ab32-5f34338cdfec req-26a488fc-bb22-49ad-91d3-17bde1068aea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052407 Aug 29 05:11:49.604067 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2251/4503] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:11:49.624777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:49.634408 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16378206-b22b-4692-881f-62fe460dae39 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.262466 Aug 29 05:11:49.635820 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2253/4504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:49 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:49.910832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:49.911541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:49.918521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:49.919030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:49.919471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:49.920239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:49.920691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:49.921120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:50.050992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:50.051542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:50.058620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:50.059112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:50.059537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:50.060281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:50.060728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:50.061145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:50.067569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:50.109324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:50.116623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:50.117547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:50.118136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:50.118740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lazy-loading 'fault' on Instance uuid 7bb1b817-f286-4fee-bd85-ecac579e5be2 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:11:50.123146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:50.130758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:50.137008 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3f06d4b0-4624-4483-a694-44b3af55aa0d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.240645 Aug 29 05:11:50.143357 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2252/4505] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:49 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:50.170423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:50.182142 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-962ad52c-9396-42f3-ba01-456c5a7187d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 200 len: 1307 microversion: 2.1 time: 0.135114 Aug 29 05:11:50.182832 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2254/4506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:50 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 1307 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:50.384063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:50.385289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:50.392633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:50.393413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:50.394025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:50.394951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:50.395618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:50.396348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:50.431458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:50.657635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:50.658755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:50.667305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:50.668253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:50.668966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:50.670194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:50.670890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:50.671532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:50.824817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:50.836963 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7de338e1-28d8-4f3c-959b-4648ce485065 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.457915 Aug 29 05:11:50.838941 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2253/4507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:50 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:51.006181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:51.015565 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f270a225-1fb5-4358-beac-665ea31123a7 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.363412 Aug 29 05:11:51.016774 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2255/4508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:50 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:51.161191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:51.162038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:51.171018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.176520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.177066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.177824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.178486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.178907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.203284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:51.204720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:51.219079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.220047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.220804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.221779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.222451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.223233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.257013 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 HTTP/1.1 Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7bb1b817-f286-4fee-bd85-ecac579e5be2'} Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:11:51.260486 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.264558 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:51.264558 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:11:51.264558 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:11:51.264558 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:11:51.264558 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:11:51.264558 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:11:51.264558 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.267528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:11:51.268663 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3d10731d-cc83-447d-a571-5313448b73cf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 404 len: 111 microversion: 2.1 time: 0.069758 Aug 29 05:11:51.273456 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2256/4509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:51 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:11:51.279221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:51.280077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:51.287842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.288615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.289237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.290205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.290801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.291364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.492676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:51.502822 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cfff882b-f06f-4c8f-883a-d9b92c2ad977 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.227025 Aug 29 05:11:51.521719 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2257/4510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:51 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:51.527523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:51.538448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:51.542004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:51.543392 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7db095bc-2acc-473b-abe8-eb66994121de tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.386660 Aug 29 05:11:51.544867 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2254/4511] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:51 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:51.665248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9faca00d-fdd4-47fe-841c-d16ac721e28f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9faca00d-fdd4-47fe-841c-d16ac721e28f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 163 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": 12345, "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 12345 Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:11:51.669107 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9faca00d-fdd4-47fe-841c-d16ac721e28f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9faca00d-fdd4-47fe-841c-d16ac721e28f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.013040 Aug 29 05:11:51.673714 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2258/4512] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:11:51 2022] POST /compute/v2.1/servers => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:11:51.679381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:51.679983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:51.691166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.691668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.692107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.692856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.693313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.693740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.859076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:51.859717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:51.872085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.873036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.873687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.878355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.886367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.887012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.905376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:51.918425 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8954be0f-9864-4040-a7d6-91a03e37cad1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.242697 Aug 29 05:11:51.924198 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2255/4513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:51 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:51.945703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:51.946741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:51.954058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.954813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.955427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:51.956875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:51.957665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:51.958420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:52.263127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:52.276963 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dde7dfde-d93e-4964-a21b-9080799f7bc4 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.421565 Aug 29 05:11:52.277524 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2259/4514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:51 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:52.282422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:52.283398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:52.292952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:52.293552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:52.294232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:52.295178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:52.295740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:52.296376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:52.334187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:52.345650 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b689da2d-e399-4e9d-bc29-4ad8393b073f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.404140 Aug 29 05:11:52.364214 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2256/4515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:51 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:52.570448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:52.571440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:52.577161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:52.595319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:52.595827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:52.596989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:52.597725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:52.598184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:52.598595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:52.614023 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3bd54b49-3f84-44a3-a38f-3f938da45856 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.327011 Aug 29 05:11:52.615664 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2260/4516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:52 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:52.873810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:52.885268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:52.886985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:52.888797 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6b6041bf-2142-4a51-aa79-eb37ed6ea15b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.324776 Aug 29 05:11:52.905271 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2257/4517] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:52 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:11:53.299875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:53.300659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:53.314094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:53.316638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:53.317180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:53.317996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:53.318843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:53.323161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:53.588767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:53.599258 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5016d6b-d665-4b8d-86cf-19946ecbf622 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.304033 Aug 29 05:11:53.601315 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2261/4518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:53 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:53.636874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:53.638137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:53.647978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:53.652957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:53.653604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:53.654491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:53.655090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:53.655923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:53.911890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:53.916473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:53.937811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:53.940264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:53.944560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:53.945763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:53.947995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:53.948731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:53.971226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:53.983248 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dd43a626-8fc2-4817-a362-a43bac1fb21a tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.350964 Aug 29 05:11:53.983857 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2258/4519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:53 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:54.157147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:54.166249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:54.168517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:54.169885 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-647489dd-fd9b-4634-9eb6-cddf6f4e666e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.262092 Aug 29 05:11:54.184509 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2262/4520] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:53 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:54.622909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:54.624003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:54.631605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:54.632097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:54.632559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:54.633581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:54.634043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:54.634453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:54.766079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:54.774433 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d3d0501-c0fc-4b53-9735-0bfc3032a872 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.155796 Aug 29 05:11:54.774933 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2259/4521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:54 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:55.015222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:55.015957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:55.034156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.034651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.035090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.035984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.036463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.036882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.199257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:55.199570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:55.212940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.213668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.214225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.215751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.217098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.219005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.289655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:55.305050 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7cc5dadc-cd51-4da1-a491-d75956a7aedf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.294829 Aug 29 05:11:55.317889 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2263/4522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:55 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:55.317889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9d6a4cd-9a6f-4b81-a0be-8a08dd56acbd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1199950413", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "64a94dfa-3800-438c-9212-a41c88fa9f09", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:55.419992 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-c9d6a4cd-9a6f-4b81-a0be-8a08dd56acbd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Block Device 64a94dfa-3800-438c-9212-a41c88fa9f09 is not bootable. Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9d6a4cd-9a6f-4b81-a0be-8a08dd56acbd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 358 Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1199950413", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "64a94dfa-3800-438c-9212-a41c88fa9f09", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: exception: Block Device 64a94dfa-3800-438c-9212-a41c88fa9f09 is not bootable. Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1199950413', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '64a94dfa-3800-438c-9212-a41c88fa9f09'}], 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 64a94dfa-3800-438c-9212-a41c88fa9f09 is not bootable. Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:11:55.430967 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 64a94dfa-3800-438c-9212-a41c88fa9f09 is not bootable. Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 64a94dfa-3800-438c-9212-a41c88fa9f09 is not bootable. Aug 29 05:11:55.435365 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:11:55.437685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9d6a4cd-9a6f-4b81-a0be-8a08dd56acbd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Block Device 64a94dfa-3800-438c-9212-a41c88fa9f09 is not bootable. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:11:55.438749 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9d6a4cd-9a6f-4b81-a0be-8a08dd56acbd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.131844 Aug 29 05:11:55.439861 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2264/4523] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:11:55 2022] POST /compute/v2.1/servers => generated 110 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:11:55.447818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:55.449184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:55.450002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:55.457987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.458800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.459415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.460348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.461006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.461633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.461788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:55.465224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:55.466675 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-468014c6-5f68-4391-bcc5-7a08a955a42e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.277090 Aug 29 05:11:55.467746 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2260/4524] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:55 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:55.640745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:55.650697 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-986ed65d-d944-48d3-a196-e3d751b4adae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.206541 Aug 29 05:11:55.651333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2265/4525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:55 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:55.654155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:55.654859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:55.657537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=92 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:55.664224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.664807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.665300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.666082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.666605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.667249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.679456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:55.680500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:55.686419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:55.689250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.689595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.690025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.690765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.691357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.691778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.706668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:11:55.859702 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dfcb2f03-c195-49ae-8531-aca6f831e6ab tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "DELETE /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 204 len: 0 microversion: 2.1 time: 0.209885 Aug 29 05:11:55.864575 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2261/4526] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:11:55 2022] DELETE /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:11:55.868798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:55.869500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:55.877554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.878068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.878499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.879197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.879642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.880060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.924403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:55.934264 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8a5628d5-1e5b-415e-ad5c-b16604fda66c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.261857 Aug 29 05:11:55.935013 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2266/4527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:55 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:55.947637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:55.948509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:55.957091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.960449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.960925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:55.961668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:55.962196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:55.962645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:56.234601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:56.245570 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-484b38de-5b70-409f-abe7-d63cdf4a821d tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.382582 Aug 29 05:11:56.246261 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2262/4528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:55 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:56.291903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:56.310476 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e2df3560-a30b-4031-b635-e6315edd7968 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1559 microversion: 2.1 time: 0.369514 Aug 29 05:11:56.312014 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2267/4529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:55 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1559 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:56.327845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:56.328562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:56.343187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:56.344374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:56.344374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:56.345410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:56.345929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:56.346488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:56.504480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:56.506345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:56.515419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:56.519117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:56.519598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:56.520547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:56.521167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:56.521755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:56.649890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:56.670088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2c3c0772-1dc6-4c37-bfee-e1b66095848d tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.336215 Aug 29 05:11:56.675804 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2263/4530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:56 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:56.819880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:56.831261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:56.834556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:56.839906 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0e095dcc-d64e-421b-86fd-9efeb53b0ad2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.346508 Aug 29 05:11:56.847463 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2268/4531] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:56 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:57.277400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:57.277400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:57.284079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:57.284704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:57.285055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:57.285733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:57.286177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:57.286589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:57.339782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:57.340589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:57.348700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:57.349487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:57.350149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:57.351372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:57.352325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:57.353196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:57.592616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:57.596704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:57.605702 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab048ffe-93da-44be-9e16-d1e5dfc78700 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1513 microversion: 2.1 time: 0.273751 Aug 29 05:11:57.620330 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2269/4532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:57 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:57.620540 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec6c749e-9a9e-4b6a-9cbd-4ec371426b1b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.343617 Aug 29 05:11:57.620540 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2264/4533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:57 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:57.697745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:57.699017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:57.707346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:57.708031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:57.708802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:57.709702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:57.710154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:57.710798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:57.874519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:57.877102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:57.879248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:57.889589 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-00e53a7f-9d0f-477c-8406-0d5171f1770b tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.196983 Aug 29 05:11:57.904088 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2270/4534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:57 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:57.909598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:57.910503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:57.911153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:57.912291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:57.912956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:57.913914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:58.077205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:58.088935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:58.091041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:58.093198 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-887ad8a3-dc2a-40fb-9d01-4267bef162f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.225414 Aug 29 05:11:58.108026 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2265/4535] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:57 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:11:58.360837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9c4e5703-f1e6-43a2-b95e-cb5b2c71ad8b req-8beacd5e-cbdb-4bdf-b9ed-d0f30baec1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20361c4d-b9ef-4ec6-b95c-fb009c452212", "name": "network-vif-plugged", "status": "completed", "tag": "3fe6e7a8-eab5-4997-b647-7a7b466f0918"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:58.376952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c4e5703-f1e6-43a2-b95e-cb5b2c71ad8b req-8beacd5e-cbdb-4bdf-b9ed-d0f30baec1eb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:58.377714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c4e5703-f1e6-43a2-b95e-cb5b2c71ad8b req-8beacd5e-cbdb-4bdf-b9ed-d0f30baec1eb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:58.378201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c4e5703-f1e6-43a2-b95e-cb5b2c71ad8b req-8beacd5e-cbdb-4bdf-b9ed-d0f30baec1eb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:58.392414 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9c4e5703-f1e6-43a2-b95e-cb5b2c71ad8b req-8beacd5e-cbdb-4bdf-b9ed-d0f30baec1eb service nova] Creating event network-vif-plugged:3fe6e7a8-eab5-4997-b647-7a7b466f0918 for instance 20361c4d-b9ef-4ec6-b95c-fb009c452212 on n-h1-854119-9 Aug 29 05:11:58.401287 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9c4e5703-f1e6-43a2-b95e-cb5b2c71ad8b req-8beacd5e-cbdb-4bdf-b9ed-d0f30baec1eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046662 Aug 29 05:11:58.402272 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2271/4536] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:11:58.567382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5e81c6e-7f42-486d-affc-5d572319ca81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1072859849", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6e3fd38c-90a0-4677-991e-152affedd0a1", "destination_type": "local"}, {"source_type": "volume", "uuid": "403c6ed5-5dfa-492d-8556-02ae269c4991", "destination_type": "invalid"}], "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5e81c6e-7f42-486d-affc-5d572319ca81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 495 Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1072859849", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6e3fd38c-90a0-4677-991e-152affedd0a1", "destination_type": "local"}, {"source_type": "volume", "uuid": "403c6ed5-5dfa-492d-8556-02ae269c4991", "destination_type": "invalid"}], "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1072859849', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '403c6ed5-5dfa-492d-8556-02ae269c4991', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:11:58.575499 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 05:11:58.581448 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:11:58.583755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5e81c6e-7f42-486d-affc-5d572319ca81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:11:58.584982 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5e81c6e-7f42-486d-affc-5d572319ca81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022654 Aug 29 05:11:58.585658 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2266/4537] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:11:58 2022] POST /compute/v2.1/servers => generated 155 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:11:58.596546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:58.597937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:58.609684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:58.610723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:58.611377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:58.613012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:58.613576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:58.614666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:58.630898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:58.631449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:58.640968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:58.641376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:58.641813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:58.642517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:58.642960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:58.644413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:59.504601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:59.515673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:59.516626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bac3b23e-35e7-47cb-a347-3b56360d5d0d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.925280 Aug 29 05:11:59.527444 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c470cd69-a536-4c2f-a597-68d53fd7793a tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1513 microversion: 2.1 time: 0.902966 Aug 29 05:11:59.540763 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2272/4538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:58 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:59.541163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:59.541954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:59.542077 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2267/4539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:58 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1513 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:11:59.548573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:59.549158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:59.549663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:59.550166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:59.550529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:59.551001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:59.551672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:59.552198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:59.562794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:59.563406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:59.563911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:59.564747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:59.565251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:59.566180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:59.915292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:59.924135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:11:59.935975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:11:59.946665 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-023e525d-20c7-4279-abb9-070e1d8933c5 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.415913 Aug 29 05:11:59.949592 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d180735c-ac0e-46dc-8146-e23cd08f0e65 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.404562 Aug 29 05:11:59.950612 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2268/4540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:59 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:59.956134 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2273/4541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:59 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:11:59.959766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:59.960841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:59.969563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:11:59.970469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:11:59.977476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:59.981227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:59.981748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:59.982262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:59.983167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:59.983719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:59.984045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:59.988760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:59.989498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:11:59.990496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:11:59.991394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:11:59.992080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:00.028627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:00.303521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:00.304449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:00.313118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:00.314557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:00.315132 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80459494-2c61-4ec1-b79e-77b29bc936b5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.357341 Aug 29 05:12:00.315739 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e4ece467-53ed-4a6c-881f-392728e7320d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.363988 Aug 29 05:12:00.316154 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2274/4542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:11:59 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:00.323788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0f9187c3-7fcf-474f-ba5a-d7d586a16262 req-5036a778-3403-4fd8-8ca8-eb7efc1d129e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886db681-da58-4c61-aaa2-386a1a69f8a4", "name": "network-vif-deleted", "tag": "bc864747-a6c8-4df3-b067-4d7e895b92f1"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:00.332985 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2269/4543] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:11:59 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:12:00.339022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0f9187c3-7fcf-474f-ba5a-d7d586a16262 req-5036a778-3403-4fd8-8ca8-eb7efc1d129e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:00.339642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0f9187c3-7fcf-474f-ba5a-d7d586a16262 req-5036a778-3403-4fd8-8ca8-eb7efc1d129e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:00.340143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0f9187c3-7fcf-474f-ba5a-d7d586a16262 req-5036a778-3403-4fd8-8ca8-eb7efc1d129e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:00.365099 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0f9187c3-7fcf-474f-ba5a-d7d586a16262 req-5036a778-3403-4fd8-8ca8-eb7efc1d129e service nova] Creating event network-vif-deleted:bc864747-a6c8-4df3-b067-4d7e895b92f1 for instance 886db681-da58-4c61-aaa2-386a1a69f8a4 on n-h1-854119-9 Aug 29 05:12:00.371313 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0f9187c3-7fcf-474f-ba5a-d7d586a16262 req-5036a778-3403-4fd8-8ca8-eb7efc1d129e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053893 Aug 29 05:12:00.372010 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2275/4544] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:12:00.396491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bad5e70-d884-4efe-babc-36ec777fb9bf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1864336688", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bad5e70-d884-4efe-babc-36ec777fb9bf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 492 Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1864336688", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1864336688', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:00.400895 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 05:12:00.403980 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:00.407127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bad5e70-d884-4efe-babc-36ec777fb9bf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:00.408314 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8bad5e70-d884-4efe-babc-36ec777fb9bf tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.015903 Aug 29 05:12:00.412471 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2270/4545] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:00 2022] POST /compute/v2.1/servers => generated 624 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:12:00.419576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:00.420347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:00.427338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:00.427952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:00.428421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:00.429141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:00.429653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:00.430050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:00.558086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:00.559023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:00.570549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:00.571660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:00.572535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:00.573993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:00.575052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:00.575592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:00.623269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:00.665521 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d7b9e5b2-03ba-4a05-a1f6-8b504269db1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.251329 Aug 29 05:12:00.666044 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2276/4546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:00 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:00.692110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:00.697363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:00.706848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:00.707323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:00.707757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:00.709429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:00.709949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:00.710498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:00.715866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7540db831bbe4326af010ddf50a57681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f44f29199a24350984567f7ef8c670e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:00.728519 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-40ea4524-fd4b-4f95-85be-c2e290246998 tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 200 len: 1303 microversion: 2.1 time: 0.178747 Aug 29 05:12:00.737468 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2271/4547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:00 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:00.980420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:00.982054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:00.988995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:00.989481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:00.990159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:00.991070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:00.991517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:00.995699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.009111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:01.018502 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b90230c2-e2d9-42ee-b8e1-2f3b0d9dd2e4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.333036 Aug 29 05:12:01.019745 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2277/4548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:00 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:01.026080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:01.026991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:01.034396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.035095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.035735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.036686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.037331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.038243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.374450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:01.383770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:01.393161 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c64f022b-1036-48e4-b07e-a93444acb3be tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1314 microversion: 2.1 time: 0.417947 Aug 29 05:12:01.393915 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2272/4549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:00 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:01.404313 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3cb94377-a490-4148-9202-b3134a7c2a3a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.375997 Aug 29 05:12:01.404313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2278/4550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:01 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:01.411784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d42a27a6-54a1-4e4c-910f-bda67c8d6f16 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:01.412338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:01.413152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d42a27a6-54a1-4e4c-910f-bda67c8d6f16 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 416 Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.416090 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d42a27a6-54a1-4e4c-910f-bda67c8d6f16 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d42a27a6-54a1-4e4c-910f-bda67c8d6f16 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.019012 Aug 29 05:12:01.419723 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2279/4551] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:01 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:12:01.423329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.423895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.424439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.425367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.425842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.426431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.429018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:01.429770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:01.440298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.440870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.443699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.443699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.443699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.443699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.660440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:01.672689 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76fff96b-2e29-40f9-8b91-a61b3caab9f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.249099 Aug 29 05:12:01.673791 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2280/4552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:01 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:01.697661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:01.698355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:01.705409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.705627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:01.705906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.706389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.707054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.707624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.708053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.718580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:01.720010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:01.721235 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-172192da-48a4-47c7-ac73-a219bac282c0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.315506 Aug 29 05:12:01.721984 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2273/4553] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:12:01 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:12:01.760930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:01.760930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] [instance: 886db681-da58-4c61-aaa2-386a1a69f8a4] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:01.768086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.768909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.769446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.770245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:01.770943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:01.771606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:01.787801 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] HTTP exception thrown: Instance 886db681-da58-4c61-aaa2-386a1a69f8a4 could not be found. Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Request method failure captured: Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 HTTP/1.1 Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDElRgZp8Jt0SkIk_-YjBKC0fOLzGe1aaWDpJSnmU_6vHBJweC2SZhRXkyu8evZdqeH1z6HgsIzohLbihI_45-dB1HNu08LVOFvYLiaArO-aBXdauSTVnvQjvhHfW7JpRIK8ofA4yLwPuaxeoVgvemlbYmoYXgTMFucnYRZk-y4-6BFE Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0f44f29199a24350984567f7ef8c670e Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesSnapshotTestJSON-217438411 Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f44f29199a24350984567f7ef8c670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f44f29199a24350984567f7ef8c670e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f44f29199a24350984567f7ef8c670e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f44f29199a24350984567f7ef8c670e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesSnapshotTestJSON-217438411 Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0f44f29199a24350984567f7ef8c670e Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-217438411 Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesSnapshotTestJSON-217438411-project Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 7540db831bbe4326af010ddf50a57681 Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesSnapshotTestJSON-217438411-project Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 886db681-da58-4c61-aaa2-386a1a69f8a4 could not be found. Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '886db681-da58-4c61-aaa2-386a1a69f8a4'} Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886db681-da58-4c61-aaa2-386a1a69f8a4 could not be found. Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886db681-da58-4c61-aaa2-386a1a69f8a4 could not be found. Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:01.789930 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.793843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:01.793843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:01.793843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:01.793843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:01.793843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:01.793843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886db681-da58-4c61-aaa2-386a1a69f8a4 could not be found. Aug 29 05:12:01.793843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:01.795707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] Returning 404 to user: Instance 886db681-da58-4c61-aaa2-386a1a69f8a4 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:01.797006 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-63b7cacd-2d8e-457a-83d8-dd8ba28541af tempest-VolumesSnapshotTestJSON-217438411 tempest-VolumesSnapshotTestJSON-217438411-project] 10.222.0.20 "GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4" status: 404 len: 111 microversion: 2.1 time: 0.043682 Aug 29 05:12:01.801763 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2274/4554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:01 2022] GET /compute/v2.1/servers/886db681-da58-4c61-aaa2-386a1a69f8a4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:12:01.887308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:01.904891 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b07a203c-697d-484e-9511-c3e4514efffc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.211305 Aug 29 05:12:01.937102 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2281/4555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:01 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:02.003162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9abcf8c4-4fb8-49a7-8ebf-bca036f73389 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-20978004", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": -1, "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:02.025112 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-9abcf8c4-4fb8-49a7-8ebf-bca036f73389 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Flavor -1 could not be found. Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9abcf8c4-4fb8-49a7-8ebf-bca036f73389 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 204 Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-20978004", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": -1, "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: exception: Flavor -1 could not be found. Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-20978004', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': -1, 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:02.027213 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.031907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9abcf8c4-4fb8-49a7-8ebf-bca036f73389 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:02.040282 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9abcf8c4-4fb8-49a7-8ebf-bca036f73389 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.046519 Aug 29 05:12:02.040902 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2275/4556] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:01 2022] POST /compute/v2.1/servers => generated 73 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 05:12:02.056917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:02.059113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:02.069134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.071556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.072343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.073186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.074635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.075316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.288443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:02.298437 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7a0a5669-025c-4cf5-a49a-2598efac1295 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.250954 Aug 29 05:12:02.306447 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2282/4557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:02 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:02.324183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:02.324961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:02.331615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.332469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.334119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.334955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.335672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.336418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.418296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:02.419235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:02.436426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.439660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.440630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.441393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.441862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.442291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.500756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:02.510188 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a579ad0b-23f5-41e8-aa19-6a4136136a38 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.190355 Aug 29 05:12:02.524155 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2276/4558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:02 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:02.531074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:02.533172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:02.542141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.542999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.543687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.544669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.545918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.546539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.751441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:02.775481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:02.785210 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-751caa69-1f06-456c-aa8f-abbb7f333228 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1463 microversion: 2.1 time: 0.259840 Aug 29 05:12:02.787222 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-546daadf-9db8-4726-9261-6cefcbddf379 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.372959 Aug 29 05:12:02.787692 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2277/4559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:02 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:02.793102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea70d6e0-8262-4b3d-8ee4-92d20d5b6c46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1275035741", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea70d6e0-8262-4b3d-8ee4-92d20d5b6c46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 173 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1275035741", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1275035741', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi -1 Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:12:02.797574 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 05:12:02.801532 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:02.803944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea70d6e0-8262-4b3d-8ee4-92d20d5b6c46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:02.805025 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ea70d6e0-8262-4b3d-8ee4-92d20d5b6c46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.015836 Aug 29 05:12:02.806073 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2283/4561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:02 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:02.806239 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2278/4561] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:02 2022] POST /compute/v2.1/servers => generated 145 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:12:02.823375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-57846839-5cc6-4b53-96f9-6b486bfffe5f req-83413d7f-7733-4bb6-a123-6ee29568a9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904b4106-5845-40b8-8f26-7eacf31b54b8", "name": "network-vif-plugged", "status": "completed", "tag": "fbfd57c9-7dce-4a91-982f-cfa91fd489ee"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:02.824448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:02.826220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:02.833413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-57846839-5cc6-4b53-96f9-6b486bfffe5f req-83413d7f-7733-4bb6-a123-6ee29568a9c7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.833938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-57846839-5cc6-4b53-96f9-6b486bfffe5f req-83413d7f-7733-4bb6-a123-6ee29568a9c7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.834815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-57846839-5cc6-4b53-96f9-6b486bfffe5f req-83413d7f-7733-4bb6-a123-6ee29568a9c7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.843750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.844324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.844781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.847884 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-57846839-5cc6-4b53-96f9-6b486bfffe5f req-83413d7f-7733-4bb6-a123-6ee29568a9c7 service nova] Creating event network-vif-plugged:fbfd57c9-7dce-4a91-982f-cfa91fd489ee for instance 904b4106-5845-40b8-8f26-7eacf31b54b8 on n-h1-854119-9 Aug 29 05:12:02.849563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.850242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.850698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.857910 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-57846839-5cc6-4b53-96f9-6b486bfffe5f req-83413d7f-7733-4bb6-a123-6ee29568a9c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038195 Aug 29 05:12:02.858713 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2284/4562] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:12:02.863921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de55419e-5286-40f6-99a4-003769e34c55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41f7fd8d-764c-4fc0-8103-ec050ad91b7e", "device": "/dev/sdb"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:02.866713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de55419e-5286-40f6-99a4-003769e34c55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:02.873481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de55419e-5286-40f6-99a4-003769e34c55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.874174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de55419e-5286-40f6-99a4-003769e34c55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.874797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de55419e-5286-40f6-99a4-003769e34c55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:02.875661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de55419e-5286-40f6-99a4-003769e34c55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:02.876304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de55419e-5286-40f6-99a4-003769e34c55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:02.876870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de55419e-5286-40f6-99a4-003769e34c55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:03.150628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:03.170500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:03.172290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:03.173686 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4e6fb8eb-bebb-4668-b64c-37ca1770483a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.354280 Aug 29 05:12:03.174894 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2279/4563] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:12:02 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:12:03.179991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:03.182152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:03.217282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:03.218004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:03.218449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:03.219181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:03.219638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:03.220157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:03.365578 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de55419e-5286-40f6-99a4-003769e34c55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "POST /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505589 Aug 29 05:12:03.366520 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2285/4564] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:12:02 2022] POST /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:12:03.437529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:03.447004 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f1ed31a-1750-4f97-8d54-2c9bc5ed3164 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.270827 Aug 29 05:12:03.448056 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2280/4565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:03 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:03.470994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:03.471617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:03.479587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:03.480083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:03.480562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:03.481275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:03.481730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:03.482153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:03.641561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:03.651193 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a93aa238-a16c-406a-9579-7e5da6b5d647 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.185678 Aug 29 05:12:03.651858 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2286/4566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:03 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:03.719544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23b7acec-6c57-4494-9832-359c87bb1a0c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-344005623", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:03.724511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-23b7acec-6c57-4494-9832-359c87bb1a0c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23b7acec-6c57-4494-9832-359c87bb1a0c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 215 Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-344005623", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-344005623', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:03.726031 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23b7acec-6c57-4494-9832-359c87bb1a0c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23b7acec-6c57-4494-9832-359c87bb1a0c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.011953 Aug 29 05:12:03.732044 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2281/4567] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:03 2022] POST /compute/v2.1/servers => generated 123 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:12:03.737056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:03.737671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:03.745175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:03.745674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:03.746123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:03.746910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:03.747362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:03.747782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:03.828033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:03.828800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:03.838306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:03.839115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:03.839958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:03.841386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:03.842215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:03.842879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:04.069022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:04.073954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:04.082846 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b5f423a0-77fa-4ec4-87c2-06cd8a7cb510 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.260345 Aug 29 05:12:04.085009 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-072b8899-262c-4613-a50d-c1b76d9848aa tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.351871 Aug 29 05:12:04.085817 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2287/4568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:03 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:04.088728 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2282/4569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:03 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:04.107917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:04.108553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:04.126721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:04.127478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:04.128068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:04.128960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:04.129567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:04.130140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:04.202336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:04.202978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:04.210149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:04.211152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:04.211986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:04.213061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:04.213675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:04.214265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:04.368758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:04.408681 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dfa1434b-6866-47c7-9418-8f20bd76428b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.274436 Aug 29 05:12:04.420219 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2288/4570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:04 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:04.480092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85c36c86-2139-4e1a-9fc3-770af62a49a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-845618644", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "key_name": "tempest-key-1926662164", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:04.516113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:04.528810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:04.531556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:04.532797 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3257c5db-2201-417f-bf92-aedd0a193f25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.339056 Aug 29 05:12:04.538619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2283/4571] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:12:04 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:12:04.551974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-85c36c86-2139-4e1a-9fc3-770af62a49a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] validate_networks() for [('de84ed4b-7ac8-4504-ae7e-3c04abeb53cb', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:12:04.856078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-85c36c86-2139-4e1a-9fc3-770af62a49a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Invalid key_name provided. Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85c36c86-2139-4e1a-9fc3-770af62a49a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 246 Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-845618644", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "key_name": "tempest-key-1926662164", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid key_name provided. Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-845618644', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'key_name': 'tempest-key-1926662164', 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1926662164 not found for user d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:04.858282 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 29 05:12:04.862912 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:04.864904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85c36c86-2139-4e1a-9fc3-770af62a49a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid key_name provided. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:04.867555 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85c36c86-2139-4e1a-9fc3-770af62a49a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.389122 Aug 29 05:12:04.880061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:04.880939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:04.885589 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2289/4572] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:04 2022] POST /compute/v2.1/servers => generated 70 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 29 05:12:04.890170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:04.897161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:04.897851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:04.900462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:04.907091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:04.907551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:05.041845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-87badcb7-a516-4d28-a9f6-352bcfd3c66b req-d67027ef-4377-4539-919e-33481313ad9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629b4b3c-90af-4afb-8b2e-1f018dd22d01", "name": "network-vif-plugged", "status": "completed", "tag": "e91c536f-9ec2-47c7-8d8a-f1c46464c3bc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:05.075132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-87badcb7-a516-4d28-a9f6-352bcfd3c66b req-d67027ef-4377-4539-919e-33481313ad9f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:05.077750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-87badcb7-a516-4d28-a9f6-352bcfd3c66b req-d67027ef-4377-4539-919e-33481313ad9f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:05.078423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-87badcb7-a516-4d28-a9f6-352bcfd3c66b req-d67027ef-4377-4539-919e-33481313ad9f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:05.108511 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-87badcb7-a516-4d28-a9f6-352bcfd3c66b req-d67027ef-4377-4539-919e-33481313ad9f service nova] Creating event network-vif-plugged:e91c536f-9ec2-47c7-8d8a-f1c46464c3bc for instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 on n-h1-854119-9 Aug 29 05:12:05.124378 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-87badcb7-a516-4d28-a9f6-352bcfd3c66b req-d67027ef-4377-4539-919e-33481313ad9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086617 Aug 29 05:12:05.126630 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2290/4573] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:12:05.149838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:05.151598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:05.168826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:05.169434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:05.170116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:05.170708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:05.171614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:05.172255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:05.172881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:05.183168 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-acc4ca5b-3728-4ced-aacd-f5637eda51c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.306905 Aug 29 05:12:05.183782 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2284/4574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:04 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:05.208713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:05.209964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:05.232092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:05.232627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:05.233083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:05.235267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:05.235376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:05.235775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:05.765922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:05.779432 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b1ecb31b-a53d-4f0a-bad3-94e224870357 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.643969 Aug 29 05:12:05.781613 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2291/4575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:05 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:05.792914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:05.793922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:05.808439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:05.813016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:05.813739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:05.814695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:05.816872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:05.818295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:05.923746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:05.938126 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b23e5a77-13c3-41cc-825a-093b9443f188 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.733825 Aug 29 05:12:05.940906 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2285/4576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:05 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:06.020918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ed93a84-4bf0-49ff-b442-ae9c319e5a88 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-546888048", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:06.099245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:06.117986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:06.125866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:06.128089 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-613fb295-0983-46d2-a35c-0e235bb31e61 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1808 microversion: 2.20 time: 0.344872 Aug 29 05:12:06.129150 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2292/4577] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:12:05 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:12:06.210506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.security_group_api [None req-3ed93a84-4bf0-49ff-b442-ae9c319e5a88 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Neutron security group does_not_exist not found {{(pid=128871) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 29 05:12:06.211943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-3ed93a84-4bf0-49ff-b442-ae9c319e5a88 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ed93a84-4bf0-49ff-b442-ae9c319e5a88 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 257 Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-546888048", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-546888048', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 29 05:12:06.220423 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:06.224780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ed93a84-4bf0-49ff-b442-ae9c319e5a88 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:06.230734 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3ed93a84-4bf0-49ff-b442-ae9c319e5a88 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.208561 Aug 29 05:12:06.230734 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2286/4578] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:06 2022] POST /compute/v2.1/servers => generated 106 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:12:06.235059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:06.235958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:06.243734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:06.254373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:06.255083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:06.256107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:06.256959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:06.269625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:06.278808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:06.594076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:06.608086 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-44c9a34e-3c60-4704-9d04-4b6ccf77e849 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.376583 Aug 29 05:12:06.609225 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2293/4579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:06 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:06.804830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:06.806385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:06.825018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:06.829745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:06.833968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:06.835279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:06.838929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:06.841075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:07.011245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:07.012731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:07.021830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:07.022594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:07.023970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:07.024898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:07.025540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:07.026206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:07.088828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:07.111845 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7f8a8e54-d517-4065-bf72-0fad4b7a6a52 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1292 microversion: 2.1 time: 0.313519 Aug 29 05:12:07.116432 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2294/4580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:06 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1292 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:07.156547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:07.161927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:07.176438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:07.177266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:07.177879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:07.181514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:07.182435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:07.183044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:07.350475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:07.382492 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0731e88d-9623-45b0-b406-d8b8f6a2d31d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.755193 Aug 29 05:12:07.389222 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2287/4581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:06 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:07.407111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b973c633-2d18-4f7a-97d1-a093bfef5885 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:07.408042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b973c633-2d18-4f7a-97d1-a093bfef5885 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: e1f44091-3e0e-4b22-aa3b-4a0159df10b1] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:07.421926 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b973c633-2d18-4f7a-97d1-a093bfef5885 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance e1f44091-3e0e-4b22-aa3b-4a0159df10b1 could not be found. Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b973c633-2d18-4f7a-97d1-a093bfef5885 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/e1f44091-3e0e-4b22-aa3b-4a0159df10b1 HTTP/1.1 Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance e1f44091-3e0e-4b22-aa3b-4a0159df10b1 could not be found. Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'e1f44091-3e0e-4b22-aa3b-4a0159df10b1'} Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f44091-3e0e-4b22-aa3b-4a0159df10b1 could not be found. Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f44091-3e0e-4b22-aa3b-4a0159df10b1 could not be found. Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:07.430868 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:07.434987 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:07.434987 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:07.434987 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:07.434987 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:07.434987 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:07.434987 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:07.434987 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f44091-3e0e-4b22-aa3b-4a0159df10b1 could not be found. Aug 29 05:12:07.434987 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:07.439199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b973c633-2d18-4f7a-97d1-a093bfef5885 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance e1f44091-3e0e-4b22-aa3b-4a0159df10b1 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:07.446497 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b973c633-2d18-4f7a-97d1-a093bfef5885 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e1f44091-3e0e-4b22-aa3b-4a0159df10b1" status: 404 len: 111 microversion: 2.1 time: 0.043374 Aug 29 05:12:07.447753 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2288/4582] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:12:07 2022] DELETE /compute/v2.1/servers/e1f44091-3e0e-4b22-aa3b-4a0159df10b1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:12:07.465536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:07.466554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:07.478649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:07.479553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:07.481439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:07.482505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:07.486207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:07.486938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:07.666119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:07.685211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:07.688815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:07.694300 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-055b1608-112d-4766-b021-f22494ca3950 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1795 microversion: 2.20 time: 0.541204 Aug 29 05:12:07.706552 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2295/4583] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:12:07 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1795 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:12:07.804345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:07.813077 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4fd8fb9f-3cbb-4983-b130-3ef4ba1f2a81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.355968 Aug 29 05:12:07.813661 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2289/4584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:07 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:07.836519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:07.837425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:07.844414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:07.845098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:07.845813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:07.846751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:07.847206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:07.847627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.021413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:08.032424 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4feafcfb-0b79-4e66-b55b-c135185f9c1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.201123 Aug 29 05:12:08.033479 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2296/4585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:07 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:08.052937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b48c7ca-8f4d-4470-bb58-58bdb43eb3dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:08.053542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b48c7ca-8f4d-4470-bb58-58bdb43eb3dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 05:12:08.054124 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-1b48c7ca-8f4d-4470-bb58-58bdb43eb3dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b48c7ca-8f4d-4470-bb58-58bdb43eb3dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 9223372036854775808 could not be found. Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '9223372036854775808'} Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:08.055732 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:08.059706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:08.059706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:08.059706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:08.059706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 29 05:12:08.059706 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.059706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b48c7ca-8f4d-4470-bb58-58bdb43eb3dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:08.059706 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b48c7ca-8f4d-4470-bb58-58bdb43eb3dd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008499 Aug 29 05:12:08.061213 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2290/4586] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Aug 29 05:12:08 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:12:08.069597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:08.071436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:08.078962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.079660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.080289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.082073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.082697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.083415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.135146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:08.135816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:08.149292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.150050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.150727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.151661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.153644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.154983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.387071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:08.403630 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f86b4f37-3a79-4079-bc97-8a453332708a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.337971 Aug 29 05:12:08.421422 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2297/4587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:08 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:08.430505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:08.431113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:08.450728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.454112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.454731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.458161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.458969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.461184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.465158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:08.475893 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-918cf8e8-0784-430e-a43e-4c40fa7db943 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1483 microversion: 2.1 time: 0.345574 Aug 29 05:12:08.480588 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2291/4588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:08 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1483 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:08.525448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b77a5834-ac83-4fe2-9956-8a3ef0fe72a1 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:08.527012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b77a5834-ac83-4fe2-9956-8a3ef0fe72a1 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:08.543672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b77a5834-ac83-4fe2-9956-8a3ef0fe72a1 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.549318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b77a5834-ac83-4fe2-9956-8a3ef0fe72a1 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.552569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b77a5834-ac83-4fe2-9956-8a3ef0fe72a1 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.553610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b77a5834-ac83-4fe2-9956-8a3ef0fe72a1 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.554418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b77a5834-ac83-4fe2-9956-8a3ef0fe72a1 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.555119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b77a5834-ac83-4fe2-9956-8a3ef0fe72a1 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.727124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:08.735462 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11a54468-fa3c-4575-9fae-4b6c52c6b3d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.309144 Aug 29 05:12:08.740320 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2298/4589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:08 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:08.747649 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b77a5834-ac83-4fe2-9956-8a3ef0fe72a1 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233610 Aug 29 05:12:08.748688 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2292/4590] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:12:08 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01/os-interface => generated 284 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:12:08.759283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4dc08ac6-1206-449e-8781-431ee5e9e594 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:08.759944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4dc08ac6-1206-449e-8781-431ee5e9e594 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Failed to fetch instance by id -1 {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 05:12:08.760726 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4dc08ac6-1206-449e-8781-431ee5e9e594 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance -1 could not be found. Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4dc08ac6-1206-449e-8781-431ee5e9e594 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance -1 could not be found. Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '-1'} Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:08.762928 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:08.767699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:08.767699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:08.767699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 29 05:12:08.767699 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:08.769680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4dc08ac6-1206-449e-8781-431ee5e9e594 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:08.774153 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4dc08ac6-1206-449e-8781-431ee5e9e594 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.016865 Aug 29 05:12:08.775719 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2299/4591] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 05:12:08 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:12:08.785894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:08.790679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:08.820765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.838307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.838769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:08.839534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:08.839997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:08.840624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:09.228497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:09.240090 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8a06c963-f9f7-4114-9e41-a243012f1d5b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.459757 Aug 29 05:12:09.240968 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2293/4592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:08 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:09.266953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:09.267574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:09.276285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:09.277168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:09.277841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:09.278715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:09.279564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:09.280352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:09.994705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:10.006785 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-423ea30f-b15d-4ee8-8bc6-81a2ae71ade5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.744383 Aug 29 05:12:10.023887 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2300/4593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:09 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:10.030177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d02ba5a-924b-42a2-96ec-4f9401b94172 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:10.030758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d02ba5a-924b-42a2-96ec-4f9401b94172 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: d57fc8be-0d63-4473-96a4-76f0d2f75dfd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:10.052679 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-4d02ba5a-924b-42a2-96ec-4f9401b94172 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance d57fc8be-0d63-4473-96a4-76f0d2f75dfd could not be found. Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d02ba5a-924b-42a2-96ec-4f9401b94172 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/d57fc8be-0d63-4473-96a4-76f0d2f75dfd/action HTTP/1.1 Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 19 Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: {"forceDelete": {}} Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance d57fc8be-0d63-4473-96a4-76f0d2f75dfd could not be found. Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'd57fc8be-0d63-4473-96a4-76f0d2f75dfd', 'body': {'forceDelete': {}}} Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d57fc8be-0d63-4473-96a4-76f0d2f75dfd could not be found. Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d57fc8be-0d63-4473-96a4-76f0d2f75dfd could not be found. Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:10.062887 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:10.067806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:10.067806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:10.067806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d57fc8be-0d63-4473-96a4-76f0d2f75dfd could not be found. Aug 29 05:12:10.067806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.068691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d02ba5a-924b-42a2-96ec-4f9401b94172 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance d57fc8be-0d63-4473-96a4-76f0d2f75dfd could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:10.069504 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d02ba5a-924b-42a2-96ec-4f9401b94172 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/d57fc8be-0d63-4473-96a4-76f0d2f75dfd/action" status: 404 len: 111 microversion: 2.1 time: 0.043471 Aug 29 05:12:10.073618 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2294/4594] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:10 2022] POST /compute/v2.1/servers/d57fc8be-0d63-4473-96a4-76f0d2f75dfd/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:12:10.079693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:10.080079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:10.092559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:10.092559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:10.093987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:10.097787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:10.097787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:10.098212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:10.385027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:10.399396 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bff3fb47-ff1b-4e12-b5e3-7a5bcd4aa000 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.324413 Aug 29 05:12:10.403165 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2301/4595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:10 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:10.436570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:10.436852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:10.451905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:10.452431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:10.459287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:10.460086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:10.460697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:10.461128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:10.464554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:10.707180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:10.718204 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf5d92d5-bf41-4c9c-bb3d-634e3a343a66 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.296939 Aug 29 05:12:10.719510 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2295/4596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:10 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:10.741387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-30c62700-5e16-4e49-852e-8627680e5026 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:10.744324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-30c62700-5e16-4e49-852e-8627680e5026 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 01eb831d-d0ac-4f95-a8f9-b58b01663a51] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:10.754679 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-30c62700-5e16-4e49-852e-8627680e5026 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 01eb831d-d0ac-4f95-a8f9-b58b01663a51 could not be found. Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-30c62700-5e16-4e49-852e-8627680e5026 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/01eb831d-d0ac-4f95-a8f9-b58b01663a51/action HTTP/1.1 Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 39 Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: {"os-getConsoleOutput": {"length": 10}} Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 01eb831d-d0ac-4f95-a8f9-b58b01663a51 could not be found. Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '01eb831d-d0ac-4f95-a8f9-b58b01663a51', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01eb831d-d0ac-4f95-a8f9-b58b01663a51 could not be found. Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01eb831d-d0ac-4f95-a8f9-b58b01663a51 could not be found. Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.759703 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:10.765434 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:10.765434 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:10.765434 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:10.765434 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:10.765434 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01eb831d-d0ac-4f95-a8f9-b58b01663a51 could not be found. Aug 29 05:12:10.765434 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:10.767241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-30c62700-5e16-4e49-852e-8627680e5026 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 01eb831d-d0ac-4f95-a8f9-b58b01663a51 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:10.768390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-30c62700-5e16-4e49-852e-8627680e5026 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/01eb831d-d0ac-4f95-a8f9-b58b01663a51/action" status: 404 len: 111 microversion: 2.1 time: 0.031190 Aug 29 05:12:10.769466 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2302/4597] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:10 2022] POST /compute/v2.1/servers/01eb831d-d0ac-4f95-a8f9-b58b01663a51/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:12:10.781246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:10.782774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:10.791055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:10.791786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:10.792439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:10.793582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:10.794181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:10.794750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:11.452454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:11.465585 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f57783a-6a66-4979-ae8b-5b03c040de1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.691456 Aug 29 05:12:11.466537 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2296/4598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:10 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:11.492918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:11.493759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:11.513838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:11.514331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:11.514761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:11.517638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:11.518157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:11.518599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:11.842374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:11.852675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:11.854428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:11.855821 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-279b371b-3010-4017-a447-a4a12aa765d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.367146 Aug 29 05:12:11.861534 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2303/4599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:11 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:11.863967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:11.864759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:11.865429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:11.866473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:11.867264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:11.867902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:11.877400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-597bef2c-72ea-4560-b6d3-4e452eec1b85 req-d4807101-a5c6-4a58-b1f0-8d7be4651889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629b4b3c-90af-4afb-8b2e-1f018dd22d01", "tag": "e91c536f-9ec2-47c7-8d8a-f1c46464c3bc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:11.887692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-597bef2c-72ea-4560-b6d3-4e452eec1b85 req-d4807101-a5c6-4a58-b1f0-8d7be4651889 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:11.888209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-597bef2c-72ea-4560-b6d3-4e452eec1b85 req-d4807101-a5c6-4a58-b1f0-8d7be4651889 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:11.888642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-597bef2c-72ea-4560-b6d3-4e452eec1b85 req-d4807101-a5c6-4a58-b1f0-8d7be4651889 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:11.917521 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-597bef2c-72ea-4560-b6d3-4e452eec1b85 req-d4807101-a5c6-4a58-b1f0-8d7be4651889 service nova] Creating event network-changed:e91c536f-9ec2-47c7-8d8a-f1c46464c3bc for instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 on n-h1-854119-9 Aug 29 05:12:11.924438 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-597bef2c-72ea-4560-b6d3-4e452eec1b85 req-d4807101-a5c6-4a58-b1f0-8d7be4651889 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061381 Aug 29 05:12:11.925646 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2304/4600] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:12:11.931412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-073e0fdf-29b0-49fc-8184-85d7d2c1b802 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:11.932493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-073e0fdf-29b0-49fc-8184-85d7d2c1b802 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 8110c946-8751-4c18-99cf-fb771ddba397] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:11.941527 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-073e0fdf-29b0-49fc-8184-85d7d2c1b802 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 8110c946-8751-4c18-99cf-fb771ddba397 could not be found. Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-073e0fdf-29b0-49fc-8184-85d7d2c1b802 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/8110c946-8751-4c18-99cf-fb771ddba397 HTTP/1.1 Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 8110c946-8751-4c18-99cf-fb771ddba397 could not be found. Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8110c946-8751-4c18-99cf-fb771ddba397'} Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8110c946-8751-4c18-99cf-fb771ddba397 could not be found. Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8110c946-8751-4c18-99cf-fb771ddba397 could not be found. Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:11.945767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:11.950255 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:11.950255 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:11.950255 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:11.950255 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8110c946-8751-4c18-99cf-fb771ddba397 could not be found. Aug 29 05:12:11.950255 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:11.952504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-073e0fdf-29b0-49fc-8184-85d7d2c1b802 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 8110c946-8751-4c18-99cf-fb771ddba397 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:11.953818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-073e0fdf-29b0-49fc-8184-85d7d2c1b802 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/8110c946-8751-4c18-99cf-fb771ddba397" status: 404 len: 111 microversion: 2.1 time: 0.026515 Aug 29 05:12:11.954983 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2305/4601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:11 2022] GET /compute/v2.1/servers/8110c946-8751-4c18-99cf-fb771ddba397 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:12:11.963103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:11.964332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:11.971958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:11.972820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:11.973478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:11.974590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:11.976003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:11.977513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:12.387676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:12.400703 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2683be34-18d7-4a77-8a28-d0493bf97944 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.440413 Aug 29 05:12:12.414852 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2306/4602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:11 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:12.415235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:12.415235 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-117cce29-24f8-47cb-8a4d-95afa861bbd8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1483 microversion: 2.1 time: 0.566893 Aug 29 05:12:12.420705 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2297/4603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:11 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1483 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:12.426002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:12.426642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:12.439416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:12.439925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:12.440382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:12.441106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:12.441563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:12.441990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:12.952408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:12.971417 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd1a6b4a-a2a9-4dff-9216-2f196349dea7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.549846 Aug 29 05:12:12.972767 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2307/4604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:12 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:13.068747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3d2b3f1c-0783-40df-95da-e7d27e25f806 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-748265551", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3d2b3f1c-0783-40df-95da-e7d27e25f806 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 237 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-748265551", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-748265551', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.085466 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3d2b3f1c-0783-40df-95da-e7d27e25f806 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3d2b3f1c-0783-40df-95da-e7d27e25f806 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025710 Aug 29 05:12:13.094045 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2298/4605] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:13 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:12:13.098637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:13.098836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:13.110859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:13.111362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:13.111805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:13.112555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:13.113014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:13.113441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:13.381880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:13.390290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-48db1130-73b7-4ce1-ae9e-41b51045f517 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.295902 Aug 29 05:12:13.391468 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2308/4606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:13 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:13.416908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:13.417846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:13.438802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:13.440414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:13.442393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:13.443430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:13.447793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:13.448501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:13.733695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:13.743661 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a0b82973-4b86-4b49-b85a-7f49d6edda81 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.330822 Aug 29 05:12:13.744294 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2299/4607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:13 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:13.831833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aae74c7b-7810-4acc-9095-cd8280a6a2e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-344552958", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aae74c7b-7810-4acc-9095-cd8280a6a2e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 234 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-344552958", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-344552958', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.838800 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 05:12:13.843828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:13.845632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aae74c7b-7810-4acc-9095-cd8280a6a2e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:13.845632 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aae74c7b-7810-4acc-9095-cd8280a6a2e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.018172 Aug 29 05:12:13.846389 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2309/4608] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:13 2022] POST /compute/v2.1/servers => generated 133 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:12:13.855220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:13.856507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:13.864821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:13.865324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:13.865766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:13.866567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:13.867013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:13.867767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:14.130674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:14.141652 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69af007c-ab71-48fd-9800-906a38267146 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.290670 Aug 29 05:12:14.148377 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2300/4609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:13 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:14.169811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:14.171140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:14.178433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:14.188955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:14.189414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:14.195528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:14.196237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:14.196836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:14.534460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:14.544038 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fdf69cff-f335-4cb3-a014-85fde9a6cceb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.377993 Aug 29 05:12:14.547846 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2310/4610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:14 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:14.569345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7eac80fe-dcf5-4c3a-9402-7fe7827c82be tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:14.570012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7eac80fe-dcf5-4c3a-9402-7fe7827c82be tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: db3e4c14-1269-4eaf-87e0-ec9cc8104b11] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:14.579591 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-7eac80fe-dcf5-4c3a-9402-7fe7827c82be tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance db3e4c14-1269-4eaf-87e0-ec9cc8104b11 could not be found. Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7eac80fe-dcf5-4c3a-9402-7fe7827c82be tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/db3e4c14-1269-4eaf-87e0-ec9cc8104b11/action HTTP/1.1 Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 13 Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: {"pause": {}} Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance db3e4c14-1269-4eaf-87e0-ec9cc8104b11 could not be found. Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'db3e4c14-1269-4eaf-87e0-ec9cc8104b11', 'body': {'pause': {}}} Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3e4c14-1269-4eaf-87e0-ec9cc8104b11 could not be found. Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3e4c14-1269-4eaf-87e0-ec9cc8104b11 could not be found. Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:14.589724 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:14.602851 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:14.602851 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:14.602851 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3e4c14-1269-4eaf-87e0-ec9cc8104b11 could not be found. Aug 29 05:12:14.602851 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:14.633575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7eac80fe-dcf5-4c3a-9402-7fe7827c82be tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance db3e4c14-1269-4eaf-87e0-ec9cc8104b11 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:14.636370 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7eac80fe-dcf5-4c3a-9402-7fe7827c82be tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/db3e4c14-1269-4eaf-87e0-ec9cc8104b11/action" status: 404 len: 111 microversion: 2.1 time: 0.071314 Aug 29 05:12:14.641443 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2301/4611] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:14 2022] POST /compute/v2.1/servers/db3e4c14-1269-4eaf-87e0-ec9cc8104b11/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:12:14.645400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:14.646272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:14.655705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:14.656544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:14.657183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:14.658064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:14.658684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:14.659270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:14.890816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:14.921233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1daef3ad-8613-4a0b-96dc-9b49f03d905a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.279467 Aug 29 05:12:14.944652 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2311/4612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:14 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:14.962451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:14.963070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:14.993891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:14.995404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:14.996024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:14.996997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:14.998776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:15.000097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:15.396305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:15.413339 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-46800cf5-2277-4f5e-8c32-43560934e8b0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.455887 Aug 29 05:12:15.438361 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2302/4613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:14 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:15.453354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f4bdb2b-f10c-4a47-a176-e0b49e630398 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:15.454515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1f4bdb2b-f10c-4a47-a176-e0b49e630398 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:15.467092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4bdb2b-f10c-4a47-a176-e0b49e630398 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:15.467892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4bdb2b-f10c-4a47-a176-e0b49e630398 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:15.468592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4bdb2b-f10c-4a47-a176-e0b49e630398 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:15.469694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4bdb2b-f10c-4a47-a176-e0b49e630398 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:15.470408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4bdb2b-f10c-4a47-a176-e0b49e630398 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:15.470906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f4bdb2b-f10c-4a47-a176-e0b49e630398 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:15.633591 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1f4bdb2b-f10c-4a47-a176-e0b49e630398 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 202 len: 0 microversion: 2.1 time: 0.195988 Aug 29 05:12:15.634512 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2312/4614] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:15 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:12:15.642823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:15.656060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:15.699532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:15.704578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:15.705079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:15.705900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:15.706578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:15.709545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:15.991005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:16.004265 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1e356991-463f-4db1-a8ec-de40d57fbd01 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1511 microversion: 2.1 time: 0.365772 Aug 29 05:12:16.004802 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2303/4615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:15 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:17.031904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:17.033261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:17.046100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:17.046635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:17.047082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:17.047772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:17.049723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:17.050158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:17.071066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:17.283102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:17.294828 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-edc3756b-b950-476f-b2b1-1cd5c9fd3846 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1491 microversion: 2.1 time: 0.270263 Aug 29 05:12:17.297749 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2313/4616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:17 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1491 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:17.319442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:17.319998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:17.328436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:17.332786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:17.333521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:17.334621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:17.336679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:17.337323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:17.367153 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Cannot 'pause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state paused Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action HTTP/1.1 Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 13 Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: {"pause": {}} Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: exception: Cannot 'pause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state paused Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115', 'body': {'pause': {}}} Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 in vm_state paused. Cannot pause while the instance is in this state. Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state paused Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:17.368935 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:17.381847 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:17.381847 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:17.381847 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:17.381847 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state paused Aug 29 05:12:17.381847 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:17.381847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 409 to user: Cannot 'pause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state paused {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:17.381847 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-43b646ba-193f-4101-9384-30ab21b185d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 409 len: 143 microversion: 2.1 time: 0.055729 Aug 29 05:12:17.381847 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2304/4617] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:17 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 143 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:12:17.382432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc312322-0bdc-4a5f-b3b2-2dd33f80ce46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:17.382539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc312322-0bdc-4a5f-b3b2-2dd33f80ce46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:17.396541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc312322-0bdc-4a5f-b3b2-2dd33f80ce46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:17.397467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc312322-0bdc-4a5f-b3b2-2dd33f80ce46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:17.399193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc312322-0bdc-4a5f-b3b2-2dd33f80ce46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:17.399964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc312322-0bdc-4a5f-b3b2-2dd33f80ce46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:17.400499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc312322-0bdc-4a5f-b3b2-2dd33f80ce46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:17.400938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc312322-0bdc-4a5f-b3b2-2dd33f80ce46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:17.523825 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc312322-0bdc-4a5f-b3b2-2dd33f80ce46 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 202 len: 0 microversion: 2.1 time: 0.146557 Aug 29 05:12:17.525269 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2314/4618] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:17 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:12:17.533531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:17.534195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:17.544263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:17.545088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:17.549411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:17.550468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:17.554540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:17.555287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:17.770618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:17.779186 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0427b4a8-82d2-4562-b02a-d883d0bde3e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1498 microversion: 2.1 time: 0.249907 Aug 29 05:12:17.779812 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2305/4619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:17 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:18.811863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:18.815992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:18.833011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:18.833859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:18.834453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:18.835928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:18.836694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:18.837335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:19.186183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:19.196462 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-99224afc-a56b-428f-92ed-b9cceb3098ef tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.390335 Aug 29 05:12:19.197701 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2315/4620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:18 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:19.231771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:19.233084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:19.241940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:19.242695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:19.243304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:19.244349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:19.245937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:19.246523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:19.555878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:19.569744 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef6c8009-58ff-4246-8989-6ffac84a2a1b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.349724 Aug 29 05:12:19.570710 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2306/4621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:19 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:19.591758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:19.594433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:19.604808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:19.605202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:19.605656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:19.606349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:19.606796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:19.607215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:19.622134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2/action HTTP/1.1 Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 28 Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: {"reboot": {"type": "SOFT"}} Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7bb1b817-f286-4fee-bd85-ecac579e5be2', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:19.623866 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:19.627950 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:19.630263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:19.630263 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0f828389-16ed-468e-b317-1ff0bf14f263 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2/action" status: 404 len: 111 microversion: 2.1 time: 0.042628 Aug 29 05:12:19.633122 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2316/4622] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:19 2022] POST /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:12:19.642161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:19.643035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:19.649882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:19.650614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:19.651222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:19.652087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:19.652714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:19.653280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:19.813565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:19.824898 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b0ec197f-0b50-438a-816e-c067042bb304 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.187165 Aug 29 05:12:19.826073 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2307/4623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:19 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:19.848422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:19.850028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:19.860209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:19.860996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:19.861639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:19.862612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:19.863279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:19.863916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:20.042490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:20.052078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70a005df-bde9-44e2-b256-8f16a9e129d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.208628 Aug 29 05:12:20.057189 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2317/4624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:19 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:20.083328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f742acb1-5605-48fc-9801-1218a87be60a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:20.085932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f742acb1-5605-48fc-9801-1218a87be60a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 50667b79-ace5-4477-aa62-129d96c4c62e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:20.092638 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f742acb1-5605-48fc-9801-1218a87be60a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 50667b79-ace5-4477-aa62-129d96c4c62e could not be found. Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f742acb1-5605-48fc-9801-1218a87be60a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/50667b79-ace5-4477-aa62-129d96c4c62e/action HTTP/1.1 Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 28 Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: {"reboot": {"type": "SOFT"}} Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 50667b79-ace5-4477-aa62-129d96c4c62e could not be found. Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '50667b79-ace5-4477-aa62-129d96c4c62e', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50667b79-ace5-4477-aa62-129d96c4c62e could not be found. Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50667b79-ace5-4477-aa62-129d96c4c62e could not be found. Aug 29 05:12:20.094771 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50667b79-ace5-4477-aa62-129d96c4c62e could not be found. Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f742acb1-5605-48fc-9801-1218a87be60a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 50667b79-ace5-4477-aa62-129d96c4c62e could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f742acb1-5605-48fc-9801-1218a87be60a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/50667b79-ace5-4477-aa62-129d96c4c62e/action" status: 404 len: 111 microversion: 2.1 time: 0.023134 Aug 29 05:12:20.099612 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2308/4625] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:20 2022] POST /compute/v2.1/servers/50667b79-ace5-4477-aa62-129d96c4c62e/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:12:20.106131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:20.106764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:20.109082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:20.115308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:20.115920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:20.118034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:20.118034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:20.118335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:20.119171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:20.375994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:20.390349 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b1f77a3f-0d61-4854-a2e4-a0d76a7cf752 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.288416 Aug 29 05:12:20.396160 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2318/4626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:20 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:20.414161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:20.415813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:20.425935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:20.426829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:20.427374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:20.428259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:20.429211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:20.430250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:20.643519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:20.662888 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-efd9cb1f-c678-44c2-9c6e-3618b2cba1ab tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.251475 Aug 29 05:12:20.663369 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2309/4627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:20 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:20.684065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:20.687748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:20.695208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:20.696298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:20.696916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:20.698133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:20.698595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:20.699071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:20.715804 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2/action HTTP/1.1 Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 65 Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7bb1b817-f286-4fee-bd85-ecac579e5be2', 'body': {'rebuild': {'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1'}}} Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 05:12:20.717667 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:12:20.722827 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:20.725485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:20.726753 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-752f7283-7c90-4c05-b5e2-cc03d0b065bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2/action" status: 404 len: 111 microversion: 2.1 time: 0.046974 Aug 29 05:12:20.731039 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2319/4628] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:20 2022] POST /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:12:20.736277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:20.737070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:20.744195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:20.744691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:20.745127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:20.746408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:20.746875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:20.747452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:20.996958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:21.007691 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-450774c0-4abc-4cd1-8562-57a53cc11b8e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.273541 Aug 29 05:12:21.019200 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2310/4629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:20 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:21.031352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:21.032869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:21.040576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:21.041494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:21.042316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:21.043250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:21.043911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:21.044609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:21.245606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:21.276169 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2a34ba01-1a34-451e-8104-4896f2c561de tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.247512 Aug 29 05:12:21.280213 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2320/4630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:21 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:21.310307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc24b98d-79a0-4d1e-8242-4c569040d2ed tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:21.313391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc24b98d-79a0-4d1e-8242-4c569040d2ed tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 671b08dc-5b8b-4a0e-b3a5-73496ad6485b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:21.323191 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-dc24b98d-79a0-4d1e-8242-4c569040d2ed tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 671b08dc-5b8b-4a0e-b3a5-73496ad6485b could not be found. Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc24b98d-79a0-4d1e-8242-4c569040d2ed tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/671b08dc-5b8b-4a0e-b3a5-73496ad6485b/action HTTP/1.1 Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 65 Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 671b08dc-5b8b-4a0e-b3a5-73496ad6485b could not be found. Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '671b08dc-5b8b-4a0e-b3a5-73496ad6485b', 'body': {'rebuild': {'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1'}}} Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671b08dc-5b8b-4a0e-b3a5-73496ad6485b could not be found. Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 05:12:21.325397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671b08dc-5b8b-4a0e-b3a5-73496ad6485b could not be found. Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671b08dc-5b8b-4a0e-b3a5-73496ad6485b could not be found. Aug 29 05:12:21.331177 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.334812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc24b98d-79a0-4d1e-8242-4c569040d2ed tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 671b08dc-5b8b-4a0e-b3a5-73496ad6485b could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:21.336063 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc24b98d-79a0-4d1e-8242-4c569040d2ed tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/671b08dc-5b8b-4a0e-b3a5-73496ad6485b/action" status: 404 len: 111 microversion: 2.1 time: 0.038463 Aug 29 05:12:21.340523 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2311/4631] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:21 2022] POST /compute/v2.1/servers/671b08dc-5b8b-4a0e-b3a5-73496ad6485b/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:12:21.349287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:21.349943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:21.361020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:21.362621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:21.363280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:21.364268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:21.364944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:21.366269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:21.573499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:21.583354 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8116f546-9d31-4b6a-90e3-2767223ba2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.241605 Aug 29 05:12:21.584762 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2321/4632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:21 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:21.608858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:21.609631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:21.618817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:21.619471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:21.619994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:21.620851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:21.621424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:21.621980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:21.806486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:21.817638 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e129cd49-9e6d-4856-a2ce-151e0bd2534b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.213238 Aug 29 05:12:21.818829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2312/4633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:21 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:21.840722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5302b3d-dca6-44ed-928e-516935d9bacc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:21.841267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a5302b3d-dca6-44ed-928e-516935d9bacc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:21.847578 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a5302b3d-dca6-44ed-928e-516935d9bacc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77 could not be found. Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5302b3d-dca6-44ed-928e-516935d9bacc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77/action HTTP/1.1 Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 15 Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: {"restore": {}} Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77 could not be found. Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77', 'body': {'restore': {}}} Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77 could not be found. Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77 could not be found. Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:21.849394 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:21.854016 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:21.854016 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:21.854016 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77 could not be found. Aug 29 05:12:21.854016 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:21.854016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5302b3d-dca6-44ed-928e-516935d9bacc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:21.854016 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5302b3d-dca6-44ed-928e-516935d9bacc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77/action" status: 404 len: 111 microversion: 2.1 time: 0.014655 Aug 29 05:12:21.860418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:21.861065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:21.862457 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2322/4634] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:21 2022] POST /compute/v2.1/servers/10cbcaf2-97c4-4f1a-b99c-a7cfd924fa77/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:12:21.868559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:21.869045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:21.869478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:21.870188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:21.870907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:21.871345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:22.120861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:22.130650 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3440652d-a750-4bec-bb4b-d02081f5047f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.274090 Aug 29 05:12:22.152928 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2313/4635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:21 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:22.159318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:22.160754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:22.171389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:22.172307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:22.172928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:22.173809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:22.174417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:22.175063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:22.370336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:22.403174 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d87c66ef-f4b2-40d6-b92c-fae1da1b4b55 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.248327 Aug 29 05:12:22.434254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:22.434790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:22.439591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2323/4636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:22 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:22.443113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:22.445932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:22.446619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:22.447844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:22.449085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:22.449732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:22.450314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:22.514595 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Cannot 'restore' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action HTTP/1.1 Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 15 Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: {"restore": {}} Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: exception: Cannot 'restore' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115', 'body': {'restore': {}}} Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 in vm_state active. Cannot restore while the instance is in this state. Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:22.516417 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:22.520222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:22.520222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:22.520222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:22.520222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:12:22.520222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:22.521210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 409 to user: Cannot 'restore' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:22.523152 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec25d699-edc7-4fd8-a2c7-fe9a2c89a2e0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 409 len: 145 microversion: 2.1 time: 0.093943 Aug 29 05:12:22.524054 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2314/4637] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:22 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 145 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:12:22.536345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:22.536876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:22.547329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:22.548701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:22.550917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:22.551954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:22.553102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:22.553779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:22.801987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:22.813588 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-521bc226-687b-41bc-9a14-a361970b4566 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.285011 Aug 29 05:12:22.814428 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2324/4638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:22 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:22.841375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:22.842797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:22.856659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:22.857169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:22.866059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:22.867212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:22.868497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:22.869303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:23.136297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:23.146830 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7479d0dc-b238-4294-a373-94694a708d1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.309025 Aug 29 05:12:23.147947 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2315/4639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:22 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:23.175484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4eb64a1-1559-4d91-ab8c-87afeaf41a1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:23.179486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a4eb64a1-1559-4d91-ab8c-87afeaf41a1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 11a4580a-086a-48c9-b418-0b6b0a10784e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:23.192970 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a4eb64a1-1559-4d91-ab8c-87afeaf41a1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 11a4580a-086a-48c9-b418-0b6b0a10784e could not be found. Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4eb64a1-1559-4d91-ab8c-87afeaf41a1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/11a4580a-086a-48c9-b418-0b6b0a10784e/action HTTP/1.1 Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 14 Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: {"resume": {}} Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 11a4580a-086a-48c9-b418-0b6b0a10784e could not be found. Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '11a4580a-086a-48c9-b418-0b6b0a10784e', 'body': {'resume': {}}} Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a4580a-086a-48c9-b418-0b6b0a10784e could not be found. Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a4580a-086a-48c9-b418-0b6b0a10784e could not be found. Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:23.202368 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:23.209019 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:23.209019 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:23.209019 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a4580a-086a-48c9-b418-0b6b0a10784e could not be found. Aug 29 05:12:23.209019 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:23.212195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4eb64a1-1559-4d91-ab8c-87afeaf41a1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 11a4580a-086a-48c9-b418-0b6b0a10784e could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:23.218130 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a4eb64a1-1559-4d91-ab8c-87afeaf41a1e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/11a4580a-086a-48c9-b418-0b6b0a10784e/action" status: 404 len: 111 microversion: 2.1 time: 0.053595 Aug 29 05:12:23.222768 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2325/4640] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:23 2022] POST /compute/v2.1/servers/11a4580a-086a-48c9-b418-0b6b0a10784e/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:12:23.227592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:23.228274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:23.242298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:23.243158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:23.243390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:23.244179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:23.244639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:23.245068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:23.276219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:23.571803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:23.582678 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ffd22d23-1806-4323-abf9-ae56bc2044cd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.358899 Aug 29 05:12:23.583960 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2316/4641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:23 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:12:23.606953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:23.607662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:23.619529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:23.622836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:23.623611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:23.624659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:23.628058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:23.628832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:23.997405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:24.007738 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d64c2388-05e7-4d45-907b-ed1e5f881a8f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.404896 Aug 29 05:12:24.011475 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2326/4642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:23 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:24.028066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:24.028660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:24.037706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:24.038230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:24.038671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:24.039381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:24.039829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:24.040273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:24.070073 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Cannot 'resume' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action HTTP/1.1 Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 14 Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: {"resume": {}} Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: exception: Cannot 'resume' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115', 'body': {'resume': {}}} Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 in vm_state active. Cannot resume while the instance is in this state. Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:24.072917 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 409 to user: Cannot 'resume' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-33364bc7-7bc8-4590-8559-90801f5e69d1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 409 len: 144 microversion: 2.1 time: 0.050308 Aug 29 05:12:24.078363 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2317/4643] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:24 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 144 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:12:24.087046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:24.088453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:24.108799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:24.109469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:24.110025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:24.110842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:24.111393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:24.112083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:24.792837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:24.811610 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c0318c95-587e-4c80-822e-909ff5cfa9f8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.730796 Aug 29 05:12:24.823678 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2327/4644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:24 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:24.834688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:24.835485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:24.845906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:24.846924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:24.847850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:24.849007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:24.849764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:24.850461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:25.113469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:25.125058 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-79f5d2bc-0657-433a-a007-7f544c276dee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.295065 Aug 29 05:12:25.127235 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2318/4645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:24 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:25.268438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc3c3bab-8e11-4b34-8fff-ec0656130323 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc3c3bab-8e11-4b34-8fff-ec0656130323 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 160 Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "de84ed4b-7ac8-4504-ae7e-3c04abeb53cb"}]}} Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'server': {'name': '', 'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1', 'flavorRef': '452', 'networks': [{'uuid': 'de84ed4b-7ac8-4504-ae7e-3c04abeb53cb'}]}}} Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi '' Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:12:25.272461 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 05:12:25.276747 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:12:25.279434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc3c3bab-8e11-4b34-8fff-ec0656130323 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:25.283421 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc3c3bab-8e11-4b34-8fff-ec0656130323 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.020159 Aug 29 05:12:25.284008 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2328/4646] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:12:25 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:12:25.295872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:25.297694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:25.306031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:25.306772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:25.308589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:25.309487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:25.315125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:25.315671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:25.600593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:25.614694 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ffcb72d1-ee39-4c20-af75-ea8195979d4b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.322212 Aug 29 05:12:25.620453 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2319/4647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:25 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:25.643121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:25.644256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:25.660008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:25.660769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:25.670285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:25.674144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:25.674824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:25.675409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:26.036234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:26.074947 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ac5c3428-2853-4b95-9493-da122f05ec1c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.436603 Aug 29 05:12:26.077351 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2329/4648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:25 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:26.108161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b0a7e1e-3017-4264-9d49-444d3d8dbdb2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:26.108695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0b0a7e1e-3017-4264-9d49-444d3d8dbdb2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 35040b3f-febc-4b46-8090-76d9d2128392] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:26.119438 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-0b0a7e1e-3017-4264-9d49-444d3d8dbdb2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 35040b3f-febc-4b46-8090-76d9d2128392 could not be found. Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b0a7e1e-3017-4264-9d49-444d3d8dbdb2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/35040b3f-febc-4b46-8090-76d9d2128392/action HTTP/1.1 Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 14 Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: {"shelve": {}} Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 35040b3f-febc-4b46-8090-76d9d2128392 could not be found. Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '35040b3f-febc-4b46-8090-76d9d2128392', 'body': {'shelve': {}}} Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35040b3f-febc-4b46-8090-76d9d2128392 could not be found. Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35040b3f-febc-4b46-8090-76d9d2128392 could not be found. Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:12:26.122092 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:12:26.126890 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:12:26.126890 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:12:26.126890 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35040b3f-febc-4b46-8090-76d9d2128392 could not be found. Aug 29 05:12:26.126890 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:12:26.127868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b0a7e1e-3017-4264-9d49-444d3d8dbdb2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 35040b3f-febc-4b46-8090-76d9d2128392 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:12:26.129156 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0b0a7e1e-3017-4264-9d49-444d3d8dbdb2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/35040b3f-febc-4b46-8090-76d9d2128392/action" status: 404 len: 111 microversion: 2.1 time: 0.030149 Aug 29 05:12:26.132484 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2320/4649] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:26 2022] POST /compute/v2.1/servers/35040b3f-febc-4b46-8090-76d9d2128392/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:12:26.141648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:26.142528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:26.156767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:26.158135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:26.159852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:26.161052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:26.164203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:26.165003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:26.561178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:26.577261 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4769c4ef-4632-45c2-a728-8706d5273aa2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.439387 Aug 29 05:12:26.578323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2330/4650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:26 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:26.601775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:26.602458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:26.609966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:26.610934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:26.611644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:26.612581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:26.613202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:26.613799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:26.976547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:26.992427 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7997e78f-bcf7-47af-8c06-62fb9c41c5ee tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.397264 Aug 29 05:12:26.994716 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2321/4651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:26 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:27.024567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:27.025117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:27.032848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:27.037204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:27.037980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:27.038902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:27.039368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:27.039802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:27.115487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lazy-loading 'flavor' on Instance uuid 7c83cae9-ef18-4723-9742-bb5e40f1b115 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:12:27.237457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:27.478567 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0258168c-403a-4520-b92b-d78ab088f35a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 202 len: 0 microversion: 2.1 time: 0.462438 Aug 29 05:12:27.489044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:27.489660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:27.495206 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2331/4652] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:12:27 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:12:27.500733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:27.501479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:27.502102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:27.502984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:27.506686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:27.507399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:27.827160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:27.843808 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-47dc41bf-3b8f-457f-abd7-1ad9c01f9351 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 0.360045 Aug 29 05:12:27.844855 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2322/4653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:27 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:28.880315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:28.900047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:28.927074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:28.928750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:28.929367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:28.932642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:28.933318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:28.933750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:29.459961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:29.469999 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-60281b45-faf3-4e3e-a098-cc3d354eed54 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 0.604216 Aug 29 05:12:29.483086 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2332/4654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:28 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:30.496936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:30.498430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:30.511917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:30.514153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:30.514776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:30.516026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:30.516638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:30.517446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:31.122687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:31.134481 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-792b8c8d-89c4-4af7-8ccf-adf4bb628eeb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 0.644409 Aug 29 05:12:31.138138 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2323/4655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:30 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:32.161380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:32.162304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:32.184481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:32.185698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:32.186765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:32.189072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:32.190763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:32.192053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:32.466201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:32.488412 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb28e656-15e9-40be-a86a-853c17171916 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 0.331558 Aug 29 05:12:32.490141 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2333/4656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:32 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:33.514475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:33.515032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:33.532809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:33.533786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:33.534495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:33.535442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:33.536982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:33.537770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:33.777104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:33.791594 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6ff2eca9-693c-4ade-bdf8-39a4b91f66ea tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 0.284992 Aug 29 05:12:33.802046 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2324/4657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:33 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:34.825327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:34.827009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:34.841195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:34.842966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:34.844753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:34.845740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:34.847841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:34.851202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:35.488928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:35.498131 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-064f8260-a316-4ac8-8392-9b40dbd23b1d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 0.676873 Aug 29 05:12:35.501349 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2334/4658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:34 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:36.526694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:36.527611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:36.545198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:36.548410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:36.549297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:36.550254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:36.552075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:36.555346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:36.780897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:36.791398 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e9c0cacd-1776-48e1-b37c-d9105a4e8c2f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 0.268792 Aug 29 05:12:36.792655 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2325/4659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:36 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:37.813624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:37.814256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:37.825155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:37.829369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:37.830494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:37.850131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:37.853990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:37.854665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:38.115301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:38.126902 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d665f70c-9992-479d-a273-be9064afe1ba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 0.317496 Aug 29 05:12:38.128573 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2335/4660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:37 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:39.149053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:39.149679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:39.157561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:39.158057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:39.158497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:39.159213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:39.159669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:39.160089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:39.472958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:39.505822 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d8b71c8f-960c-42ab-9465-ced01bdc4eba tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 0.357954 Aug 29 05:12:39.507172 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2326/4661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:39 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:40.532592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:40.533212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:40.540027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:40.540544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:40.540968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:40.541655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:40.542100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:40.542494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:40.677089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:40.685484 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-198ddd52-720a-4d99-bef1-7f00dacd554d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1533 microversion: 2.1 time: 0.157098 Aug 29 05:12:40.686007 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2336/4662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:40 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1533 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:41.709215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:41.710954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:41.719607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:41.720437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:41.720884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:41.721598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:41.722483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:41.723509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:41.939570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:41.952438 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf3d7fdf-ea9f-46c6-8b06-92e410d9d254 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1533 microversion: 2.1 time: 0.247496 Aug 29 05:12:41.966788 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2327/4663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:41 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1533 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:42.974380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:42.975600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:42.986759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:42.990419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:42.991092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:42.992192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:42.994184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:42.994763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:43.219259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:43.240990 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-91a4773f-4d60-4224-a5d0-fac20207e2e7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1533 microversion: 2.1 time: 0.270255 Aug 29 05:12:43.255522 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2337/4664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:42 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1533 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:44.263818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:44.264631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:44.283743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:44.287469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:44.289203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:44.291673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:44.292488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:44.293141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:44.578288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:44.587720 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a59f367e-a8eb-4d7d-b6ba-9f29d1905abb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1533 microversion: 2.1 time: 0.328981 Aug 29 05:12:44.588867 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2328/4665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:44 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1533 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:45.613152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:45.617314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:45.634377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e6aaa4c9-c405-4b78-8e8c-f7b174be3d67 req-a284fe65-45ce-4fe6-8eb2-9f8683cff583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c83cae9-ef18-4723-9742-bb5e40f1b115", "name": "network-vif-plugged", "status": "completed", "tag": "b5b79f0a-b188-414c-99ed-082280f4ef23"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:12:45.648653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:45.649395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:45.650179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:45.651158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:45.651613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:45.652034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:45.670286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e6aaa4c9-c405-4b78-8e8c-f7b174be3d67 req-a284fe65-45ce-4fe6-8eb2-9f8683cff583 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:45.670784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e6aaa4c9-c405-4b78-8e8c-f7b174be3d67 req-a284fe65-45ce-4fe6-8eb2-9f8683cff583 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:45.671207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e6aaa4c9-c405-4b78-8e8c-f7b174be3d67 req-a284fe65-45ce-4fe6-8eb2-9f8683cff583 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:45.714582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e6aaa4c9-c405-4b78-8e8c-f7b174be3d67 req-a284fe65-45ce-4fe6-8eb2-9f8683cff583 service nova] Creating event network-vif-plugged:b5b79f0a-b188-414c-99ed-082280f4ef23 for instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 on n-h1-854119-9 Aug 29 05:12:45.736631 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e6aaa4c9-c405-4b78-8e8c-f7b174be3d67 req-a284fe65-45ce-4fe6-8eb2-9f8683cff583 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112882 Aug 29 05:12:45.744290 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2329/4666] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 05:12:45.957361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:45.966591 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b955b08f-c67f-4451-bcfc-173338b15e32 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1533 microversion: 2.1 time: 0.359587 Aug 29 05:12:45.968274 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2338/4667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:45 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1533 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:46.994121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:46.994837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:47.041653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:47.043165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:47.045836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:47.061352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:47.064450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:47.065739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:47.427212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:47.440707 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7baa0ed1-34a9-4d51-9b57-b98d01f4ca2b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.452471 Aug 29 05:12:47.442973 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2330/4668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:46 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:48.467418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:48.468708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:48.480679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:48.484889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:48.490381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:48.491620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:48.502507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:48.504591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:49.182006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:49.191435 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0624dcf-b35d-4678-b375-88162d269388 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.728245 Aug 29 05:12:49.191980 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2339/4669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:48 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:50.212695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:50.213313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:50.228266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:50.229059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:50.229678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:50.231394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:50.232039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:50.232651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:51.052166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:51.065061 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3acaf2ec-a2b5-4892-9303-382350f0a6c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.856585 Aug 29 05:12:51.066889 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2331/4670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:50 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:52.095696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:52.097006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:52.107377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=42 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:52.110296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:52.112838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:52.124971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:52.126084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:52.127048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:52.128569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:52.543432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:52.552689 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a972b30-84fa-41b8-b3c9-0ca491327e22 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.470137 Aug 29 05:12:52.574432 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2340/4671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:52 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:53.581067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:53.581793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:53.589626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=36 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:53.604339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:53.605296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:53.607797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:53.609918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:53.611127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:53.612912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:53.628387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=82 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:53.873879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:53.897777 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f47aaabf-220a-43b1-bb90-ccf88e2b38ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.320968 Aug 29 05:12:53.899425 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2332/4672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:53 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:54.926538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:54.931778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:54.970939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:54.975071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:54.976736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:54.991499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:55.001111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:55.003453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:55.493226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:55.523991 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea928136-86cb-4f6a-9658-9ab1875275c7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.602095 Aug 29 05:12:55.525366 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2341/4673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:54 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:56.550930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:56.553174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:56.563645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:56.564446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:56.564982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:56.565710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:56.566164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:56.582424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:56.816986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:56.832549 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec805746-4dfa-488f-afcf-333ecb77cdcd tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.285294 Aug 29 05:12:56.833729 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2333/4674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:56 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:57.175262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:57.194744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:57.197057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Searching by: {'deleted': False, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:12:57.224281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:57.240886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:57.241546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:57.243079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:57.243648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:57.245190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:57.324229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:12:57.328073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=66 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:12:57.375963 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4692999d-7cae-43fc-9555-74038ed16a10 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204862 Aug 29 05:12:57.377960 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2342/4675] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:12:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:12:57.393352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:57.408554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:57.413826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Searching by: {'deleted': False, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:12:57.424568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:57.437287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:57.438751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:57.440044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:57.440731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:57.441319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:57.510047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:12:57.593741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:57.611053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:57.611542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:57.611973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:57.860101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:57.860831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:57.876171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:57.876987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:57.882040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:57.882893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:57.883374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:57.883824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:58.033429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-425a0df7-da60-4999-8a11-367c042a363c tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.644837 Aug 29 05:12:58.034501 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2334/4676] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 05:12:57 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:58.060650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-341cd9e7-0029-4cb3-8cd8-648ff03240dc tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:58.072530 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-341cd9e7-0029-4cb3-8cd8-648ff03240dc tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017034 Aug 29 05:12:58.081271 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2335/4677] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 05:12:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:12:58.314105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:58.339352 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b0bc8b7-05ef-4eed-a5a9-6df930272e93 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.483595 Aug 29 05:12:58.345573 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2343/4678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:57 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:58.411554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:58.412547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:58.427008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:58.427991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:58.429017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:58.430036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:58.430758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:58.431513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:58.534059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:12:58.784418 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44530e3b-dd14-4270-9c15-5f08bf14b3fb tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "DELETE /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 204 len: 0 microversion: 2.1 time: 0.376923 Aug 29 05:12:58.794512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:58.795752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:58.799054 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2336/4679] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:12:58 2022] DELETE /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:12:58.808593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:58.809700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:58.812638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:58.813653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:58.814340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:58.815009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:59.094753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:59.103350 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-87b5cee4-9867-4dec-817f-478946de39d8 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1608 microversion: 2.1 time: 0.312847 Aug 29 05:12:59.107520 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2344/4680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:58 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1608 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:12:59.366785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:12:59.367504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:12:59.393354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:59.396052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:59.396884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:59.397862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:12:59.404839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:12:59.405534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:12:59.730578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:12:59.743385 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71af758f-5de3-4b8f-8807-9730b6b0f8f4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.385132 Aug 29 05:12:59.744831 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2337/4681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:12:59 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:00.128199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:00.128984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:00.138909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:00.143241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:00.144014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:00.145026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:00.147254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:00.147960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:00.507975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:00.520664 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ca31a7d5-5133-4354-8ccb-a9548d3a3244 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1608 microversion: 2.1 time: 0.394638 Aug 29 05:13:00.537978 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2345/4682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:00 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1608 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:00.765908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:00.766443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:00.785901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:00.786402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:00.786837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:00.787593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:00.788050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:00.800735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:01.509223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:01.522701 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed4cd5c2-a73e-46d8-9eab-2b93e681f0e9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.761130 Aug 29 05:13:01.525312 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2338/4683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:00 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:01.542455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:01.543742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:01.551135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:01.551876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:01.552493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:01.553442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:01.554049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:01.554667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:02.066208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:02.099148 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c6dc95bc-67eb-4204-9556-7be8a480054e tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1608 microversion: 2.1 time: 0.560554 Aug 29 05:13:02.117532 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2346/4684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:01 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1608 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:02.550133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:02.550866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:02.574211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:02.575744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:02.577224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:02.578621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:02.580837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:02.581655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:03.091100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6693724f-d5f1-47e9-9ba4-b1c7aa5a736e req-13e57adb-fb32-4054-b608-5fef6150b144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629b4b3c-90af-4afb-8b2e-1f018dd22d01", "name": "network-vif-deleted", "tag": "e91c536f-9ec2-47c7-8d8a-f1c46464c3bc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:03.104299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6693724f-d5f1-47e9-9ba4-b1c7aa5a736e req-13e57adb-fb32-4054-b608-5fef6150b144 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:03.105113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6693724f-d5f1-47e9-9ba4-b1c7aa5a736e req-13e57adb-fb32-4054-b608-5fef6150b144 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:03.105723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6693724f-d5f1-47e9-9ba4-b1c7aa5a736e req-13e57adb-fb32-4054-b608-5fef6150b144 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:03.124413 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6693724f-d5f1-47e9-9ba4-b1c7aa5a736e req-13e57adb-fb32-4054-b608-5fef6150b144 service nova] Creating event network-vif-deleted:e91c536f-9ec2-47c7-8d8a-f1c46464c3bc for instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 on n-h1-854119-9 Aug 29 05:13:03.134201 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6693724f-d5f1-47e9-9ba4-b1c7aa5a736e req-13e57adb-fb32-4054-b608-5fef6150b144 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046562 Aug 29 05:13:03.135102 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2347/4685] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:13:03.164850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:03.166225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:03.167138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:03.177208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:03.180508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:03.180992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:03.181744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:03.183763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:03.184659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:03.217260 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0cb59aa8-2bdb-486f-9536-9240128df874 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.674497 Aug 29 05:13:03.217260 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2339/4686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:02 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:03.294606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:03.307346 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a06f750-ab75-4722-9408-61ec65ba7ffa tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1251 microversion: 2.1 time: 0.170047 Aug 29 05:13:03.324177 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2348/4687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:03 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1251 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:03.805119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:03.805709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:03.821105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:03.821610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:03.822054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:03.822782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:03.830985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:03.831489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:03.927572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:13:04.207790 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b129e2a-e694-46db-b4c2-d0a312149426 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 204 len: 0 microversion: 2.42 time: 0.919633 Aug 29 05:13:04.212286 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2340/4688] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:13:03 2022] DELETE /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 05:13:04.220546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:04.221162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:04.228963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:04.240296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:04.244774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:04.247702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:04.248009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:04.248462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:04.248869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:04.249456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:04.257203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:04.259131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:04.259785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:04.262260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:04.265090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:04.266732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:05.301461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:05.313041 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c045a0f0-3100-44af-a3cf-e0063405a151 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 1.074684 Aug 29 05:13:05.325231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2341/4689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:04 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:13:05.347550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:05.359337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:05.360847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:05.361990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:05.364802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:05.369626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a46216d8-2f4b-4f3c-aec8-cfdae9bb89b4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2953 microversion: 2.42 time: 1.153113 Aug 29 05:13:05.387683 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2349/4690] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:04 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2953 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:05.396873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:05.397693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:05.398318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:05.399252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:05.399869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:05.400485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:05.530603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:05.550060 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4286b195-506d-4db3-a6a1-269d7ed1e84b tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1251 microversion: 2.1 time: 0.220971 Aug 29 05:13:05.551123 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2342/4691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:05 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1251 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:06.350737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:06.351378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:06.374948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:06.375495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:06.376512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:06.376623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:06.377130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:06.377618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:06.403049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:06.404305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:06.416067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:06.424846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:06.425616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:06.426587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:06.427238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:06.427923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:07.260852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:07.290666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:07.311304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:07.318187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:07.319568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:07.323817 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-597ef33d-2ccf-439d-89b7-f83f43c8ef83 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2953 microversion: 2.42 time: 0.924657 Aug 29 05:13:07.326853 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e89be938-b586-4267-a252-1f1a012a2b86 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1528 microversion: 2.1 time: 0.985016 Aug 29 05:13:07.327452 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2350/4692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:06 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1528 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:07.328622 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2343/4693] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:06 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2953 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:07.338496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:07.339394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:07.367188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:07.368033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:07.368718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:07.370606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:07.371290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:07.372532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:07.457319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:07.469620 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-674db14b-b6f3-4da7-a202-8140bc4eb7ce tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1251 microversion: 2.1 time: 0.138577 Aug 29 05:13:07.470479 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2344/4694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:07 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1251 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:08.351209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:08.352577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:08.356657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:08.357745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:08.368348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:08.370143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:08.371256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:08.372029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:08.372532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:08.372963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:08.374538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:08.377079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:08.381545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:08.383259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:08.383980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:08.385941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:08.386837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:08.387698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:09.131078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:09.135201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:09.140460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:09.164552 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47f167a9-362d-4733-a2b0-0aff4fbcb104 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1510 microversion: 2.1 time: 0.821152 Aug 29 05:13:09.165558 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2351/4695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:08 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1510 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:09.168601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:09.172050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:09.173350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:09.178569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:09.181501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:09.182595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:09.183047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:09.183963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:09.184670 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2405a519-d20a-4c43-a367-e9fe1e819ba2 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2953 microversion: 2.42 time: 0.835625 Aug 29 05:13:09.189863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:09.190857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:09.194855 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2345/4696] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:08 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2953 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:09.313568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:09.323646 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d9a42b9b-e6c7-4cfb-a1e2-2c08e1029431 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1251 microversion: 2.1 time: 0.157027 Aug 29 05:13:09.328865 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2352/4697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:09 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1251 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:10.190208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:10.193974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:10.218009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:10.218678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:10.218814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:10.219189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:10.219621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:10.220362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:10.223094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:10.223536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:10.227012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:10.227510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:10.227943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:10.229217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:10.229833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:10.231948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:10.567250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:10.591029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:10.602124 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-31a6869a-7443-495d-9055-1a20382061ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1510 microversion: 2.1 time: 0.418336 Aug 29 05:13:10.618821 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2346/4698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:10 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:10.618932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:10.618932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:10.619160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:10.619951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:10.621624 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b3f4a8bd-4724-490e-9ca8-28a9526d38ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2932 microversion: 2.42 time: 0.406353 Aug 29 05:13:10.625156 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2353/4699] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:10 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2932 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:10.632320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:10.633051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:10.633721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:10.634687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:10.635570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:10.636304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:10.731971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:10.742422 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d2635901-92fc-4fb5-aeca-4ad296f2968a tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1251 microversion: 2.1 time: 0.135557 Aug 29 05:13:10.748520 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2347/4700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:10 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1251 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:11.463925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-4a80fbc5-b9a3-4c18-b70d-c69a9a05aa63 req-ecfa1ee4-6d88-463d-bd9d-14308ca15cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c83cae9-ef18-4723-9742-bb5e40f1b115", "name": "network-vif-unplugged", "status": "completed", "tag": "b5b79f0a-b188-414c-99ed-082280f4ef23"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:11.507185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4a80fbc5-b9a3-4c18-b70d-c69a9a05aa63 req-ecfa1ee4-6d88-463d-bd9d-14308ca15cb2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:11.528962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4a80fbc5-b9a3-4c18-b70d-c69a9a05aa63 req-ecfa1ee4-6d88-463d-bd9d-14308ca15cb2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:11.532257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4a80fbc5-b9a3-4c18-b70d-c69a9a05aa63 req-ecfa1ee4-6d88-463d-bd9d-14308ca15cb2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:11.562428 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-4a80fbc5-b9a3-4c18-b70d-c69a9a05aa63 req-ecfa1ee4-6d88-463d-bd9d-14308ca15cb2 service nova] Creating event network-vif-unplugged:b5b79f0a-b188-414c-99ed-082280f4ef23 for instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 on n-h1-854119-9 Aug 29 05:13:11.577962 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-4a80fbc5-b9a3-4c18-b70d-c69a9a05aa63 req-ecfa1ee4-6d88-463d-bd9d-14308ca15cb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120345 Aug 29 05:13:11.579555 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2354/4701] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:11.638898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:11.639509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:11.655077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:11.656236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:11.657021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:11.657723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:11.659538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:11.661762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:11.666731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:11.667382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:11.669318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:11.669811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:11.672790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:11.674938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:11.676535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:11.677162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:12.223332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:12.239725 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d8e9c22f-9c95-4f0c-ae1b-749febfdf721 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1513 microversion: 2.1 time: 0.605124 Aug 29 05:13:12.241047 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2348/4702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:11 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1513 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:12.259208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:12.259738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:12.278042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:12.279231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:12.280087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:12.280875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:12.282969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:12.284066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:12.287580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:12.306104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:12.309675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:12.312739 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-961dad89-b001-4dab-864f-a1ceb8f3950f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2911 microversion: 2.42 time: 0.662834 Aug 29 05:13:12.314388 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2355/4703] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:11 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2911 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:12.333044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:12.337119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:12.358534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:12.359323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:12.359916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:12.366368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:12.367289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:12.368761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:12.383198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:12.385131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:12.388417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:12.389071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lazy-loading 'fault' on Instance uuid 629b4b3c-90af-4afb-8b2e-1f018dd22d01 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:13:12.475353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304421b62ad4eaaaeddc94c23ac9dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3846ab054c4ffeb5586099654c9b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:12.494851 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e854ffa-2ea5-4982-a500-7978c0aeb745 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 200 len: 1256 microversion: 2.1 time: 0.251065 Aug 29 05:13:12.498976 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2349/4704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:12 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 1256 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:12.795287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:12.809698 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16bf5033-2cfd-4ead-a8bd-8bdc735f2313 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1453 microversion: 2.1 time: 0.489971 Aug 29 05:13:12.810299 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2356/4705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:12 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1453 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:12.923763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:12.924380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:12.934862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:12.938665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:12.939296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:12.940227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:12.942291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:12.942925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:13.000485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lazy-loading 'flavor' on Instance uuid 7c83cae9-ef18-4723-9742-bb5e40f1b115 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:13:13.019040 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Cannot 'shelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state shelved_offloaded Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action HTTP/1.1 Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 14 Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: {"shelve": {}} Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: exception: Cannot 'shelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state shelved_offloaded Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115', 'body': {'shelve': {}}} Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:13:13.021090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state shelved_offloaded Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state shelved_offloaded Aug 29 05:13:13.026056 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:13:13.027774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 409 to user: Cannot 'shelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state shelved_offloaded {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:13:13.028851 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af570cdd-6695-4d43-a27a-ebe331311cf0 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 409 len: 155 microversion: 2.1 time: 0.119760 Aug 29 05:13:13.030011 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2350/4706] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:13:12 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 155 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:13:13.038335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:13.039231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:13.050366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:13.052877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:13.060893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:13.061981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:13.062638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:13.063228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:13.123950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128872) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 05:13:13.153214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8a5620a7-6938-4a4f-a430-3ee0213cd846 req-9be00856-757f-4195-98a3-8fa5543508bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-deleted", "tag": "9d491664-1c7c-402d-acbf-553a52de93b5"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:13.170921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8a5620a7-6938-4a4f-a430-3ee0213cd846 req-9be00856-757f-4195-98a3-8fa5543508bd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:13.172100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8a5620a7-6938-4a4f-a430-3ee0213cd846 req-9be00856-757f-4195-98a3-8fa5543508bd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:13.174761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8a5620a7-6938-4a4f-a430-3ee0213cd846 req-9be00856-757f-4195-98a3-8fa5543508bd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:13.206955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8a5620a7-6938-4a4f-a430-3ee0213cd846 req-9be00856-757f-4195-98a3-8fa5543508bd service nova] Creating event network-vif-deleted:9d491664-1c7c-402d-acbf-553a52de93b5 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:13:13.220542 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8a5620a7-6938-4a4f-a430-3ee0213cd846 req-9be00856-757f-4195-98a3-8fa5543508bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069653 Aug 29 05:13:13.223409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2351/4707] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:13.312325 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3765e963-4a2b-40a8-9cab-e3b841d02fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 202 len: 0 microversion: 2.1 time: 0.277702 Aug 29 05:13:13.315760 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2357/4708] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:13:13 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:13:13.325869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:13.327308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:13.338564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:13.346872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:13.347577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:13.350885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:13.351547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:13.352361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:13.352835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:13.353266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:13.370856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:13.373183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:13.373928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:13.374923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:13.375870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:13.376559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:14.110365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:14.129455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:14.131147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:14.132727 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e1164aae-b433-4334-b8a8-ccfeffcca41f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2751 microversion: 2.42 time: 0.790046 Aug 29 05:13:14.133807 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2358/4709] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:13 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2751 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:14.144242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:14.144903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] [instance: 629b4b3c-90af-4afb-8b2e-1f018dd22d01] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:14.161050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:14.161955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:14.164343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:14.167619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:14.168340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:14.173399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:14.178293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:14.200591 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] HTTP exception thrown: Instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 could not be found. Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Request method failure captured: Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 HTTP/1.1 Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEo_RU4Oz-BUrupk-TuSscUVmIOpUGSLbNwCCzBVsEYjN1vW2mhWA8JRprJVI2zuSOP7S7XCHisCAj3BgZdjb66O_yjUBJ25z_CG8rz2VYVlrm4zmMWrL1lclhiopxDc9aH8CGZLcZm5O-rGCWR_RXoQjBauUpNtgN9Lt8yWFeQPvlc Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: ca3846ab054c4ffeb5586099654c9b3b Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestBootFromVolume-1988828493 Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca3846ab054c4ffeb5586099654c9b3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca3846ab054c4ffeb5586099654c9b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca3846ab054c4ffeb5586099654c9b3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca3846ab054c4ffeb5586099654c9b3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestBootFromVolume-1988828493 Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: ca3846ab054c4ffeb5586099654c9b3b Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1988828493 Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestBootFromVolume-1988828493-project Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 7304421b62ad4eaaaeddc94c23ac9dba Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestBootFromVolume-1988828493-project Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 could not be found. Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '629b4b3c-90af-4afb-8b2e-1f018dd22d01'} Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 could not be found. Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 could not be found. Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:13:14.204811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:14.210057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:13:14.210057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:13:14.210057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:13:14.210057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:13:14.210057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:13:14.210057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 could not be found. Aug 29 05:13:14.210057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:14.213043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Returning 404 to user: Instance 629b4b3c-90af-4afb-8b2e-1f018dd22d01 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:13:14.214948 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f93ff354-2914-4a62-921a-fd99018d1985 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01" status: 404 len: 111 microversion: 2.1 time: 0.080122 Aug 29 05:13:14.215725 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2359/4710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:14 2022] GET /compute/v2.1/servers/629b4b3c-90af-4afb-8b2e-1f018dd22d01 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:13:14.221007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a43dcfa1-26e5-4a25-b5d1-ad52be8bcd10 req-04158607-7acd-4792-a819-f742aacaf223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-unplugged", "status": "completed", "tag": "850262b4-7c71-4de1-88fe-1b5865d1c466"}, {"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-unplugged", "status": "completed", "tag": "3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65"}, {"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-unplugged", "status": "completed", "tag": "d28a6416-ee20-43fb-9e41-ae5f2d7565ce"}, {"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-unplugged", "status": "completed", "tag": "004afcee-7c72-4360-ad7c-0a6d16dcc727"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:14.233553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a43dcfa1-26e5-4a25-b5d1-ad52be8bcd10 req-04158607-7acd-4792-a819-f742aacaf223 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:14.234636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a43dcfa1-26e5-4a25-b5d1-ad52be8bcd10 req-04158607-7acd-4792-a819-f742aacaf223 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:14.235258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a43dcfa1-26e5-4a25-b5d1-ad52be8bcd10 req-04158607-7acd-4792-a819-f742aacaf223 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:14.249197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:14.270682 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-706d9035-024f-4bbe-b1f8-7722f6bc3ac1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1461 microversion: 2.1 time: 0.949478 Aug 29 05:13:14.273231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2352/4711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:13 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1461 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:14.284262 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a43dcfa1-26e5-4a25-b5d1-ad52be8bcd10 req-04158607-7acd-4792-a819-f742aacaf223 service nova] Creating event network-vif-unplugged:850262b4-7c71-4de1-88fe-1b5865d1c466 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:13:14.284912 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a43dcfa1-26e5-4a25-b5d1-ad52be8bcd10 req-04158607-7acd-4792-a819-f742aacaf223 service nova] Creating event network-vif-unplugged:3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:13:14.287459 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a43dcfa1-26e5-4a25-b5d1-ad52be8bcd10 req-04158607-7acd-4792-a819-f742aacaf223 service nova] Creating event network-vif-unplugged:d28a6416-ee20-43fb-9e41-ae5f2d7565ce for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:13:14.289202 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a43dcfa1-26e5-4a25-b5d1-ad52be8bcd10 req-04158607-7acd-4792-a819-f742aacaf223 service nova] Creating event network-vif-unplugged:004afcee-7c72-4360-ad7c-0a6d16dcc727 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:13:14.300160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:14.300830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:14.320286 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a43dcfa1-26e5-4a25-b5d1-ad52be8bcd10 req-04158607-7acd-4792-a819-f742aacaf223 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.099775 Aug 29 05:13:14.320898 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2360/4712] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:14.327152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6e04e92-8e20-498e-8f52-51bc66bebd14 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] Calling method '.version_select at 0x7f1ab80ab280>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:14.328899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:14.329402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:14.329874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:14.330541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:14.330985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:14.331406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:14.421052 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6e04e92-8e20-498e-8f52-51bc66bebd14 tempest-ServersTestBootFromVolume-1988828493 tempest-ServersTestBootFromVolume-1988828493-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-278366381" status: 202 len: 0 microversion: 2.1 time: 0.098105 Aug 29 05:13:14.421727 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2361/4713] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-278366381 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:13:14.792148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:14.800726 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ce5495d-a4e9-4468-bd53-5ae12638ca4a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.525033 Aug 29 05:13:14.801313 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2353/4714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:14 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:14.826757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:14.827767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:14.844568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:14.845389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:14.846643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:14.850010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:14.851254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:14.851700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:15.165717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:15.166493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:15.186679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:15.188885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:15.189366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:15.192180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:15.192674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:15.199738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:15.391722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:15.404808 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bbda4b26-a328-4b8b-a29a-1d85b518757b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.577929 Aug 29 05:13:15.407108 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2362/4715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:14 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:15.425501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:15.426625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:15.435043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:15.448964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:15.449703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:15.450629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:15.451573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:15.452171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:15.988262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:16.006410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:16.012563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:16.015086 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-13aa2874-cd0e-4852-a456-940d17721807 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2705 microversion: 2.42 time: 0.853267 Aug 29 05:13:16.032155 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2354/4716] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:15 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2705 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:16.032155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-73dec6f3-a536-4d36-acaf-f944b03c7784 req-02714556-9d78-4f6c-8df1-df99a796e64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-deleted", "tag": "850262b4-7c71-4de1-88fe-1b5865d1c466"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:16.082169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-73dec6f3-a536-4d36-acaf-f944b03c7784 req-02714556-9d78-4f6c-8df1-df99a796e64d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:16.088692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-73dec6f3-a536-4d36-acaf-f944b03c7784 req-02714556-9d78-4f6c-8df1-df99a796e64d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:16.091434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-73dec6f3-a536-4d36-acaf-f944b03c7784 req-02714556-9d78-4f6c-8df1-df99a796e64d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:16.148588 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-73dec6f3-a536-4d36-acaf-f944b03c7784 req-02714556-9d78-4f6c-8df1-df99a796e64d service nova] Creating event network-vif-deleted:850262b4-7c71-4de1-88fe-1b5865d1c466 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:13:16.168774 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-73dec6f3-a536-4d36-acaf-f944b03c7784 req-02714556-9d78-4f6c-8df1-df99a796e64d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147521 Aug 29 05:13:16.169829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2355/4717] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:16.178211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:16.197997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:16.222357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:16.222879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:16.223338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:16.225892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:16.226417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:16.226866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:16.787090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:16.798281 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8308314f-4a63-42a8-aca0-20349bd91e9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1461 microversion: 2.1 time: 1.377478 Aug 29 05:13:16.798950 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2363/4718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:15 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1461 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:17.046341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:17.047049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:17.067896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:17.068517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:17.068970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:17.069713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:17.070174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:17.070603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:17.449752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:17.462834 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-616a6a8c-2bbb-4cf0-aad2-4b6a57cceb07 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 1.291689 Aug 29 05:13:17.465950 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2356/4719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:16 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:17.491523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c3d78a60-93ce-4aeb-bf09-0fd194bdf359 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-32690357"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:17.494775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c3d78a60-93ce-4aeb-bf09-0fd194bdf359 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:17.508599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3d78a60-93ce-4aeb-bf09-0fd194bdf359 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:17.509660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3d78a60-93ce-4aeb-bf09-0fd194bdf359 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:17.511013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3d78a60-93ce-4aeb-bf09-0fd194bdf359 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:17.513048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3d78a60-93ce-4aeb-bf09-0fd194bdf359 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:17.513625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3d78a60-93ce-4aeb-bf09-0fd194bdf359 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:17.515458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3d78a60-93ce-4aeb-bf09-0fd194bdf359 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:17.831055 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c3d78a60-93ce-4aeb-bf09-0fd194bdf359 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.341863 Aug 29 05:13:17.855085 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2357/4720] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:13:17 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 05:13:17.866219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:17.867083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:17.878543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:17.879315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:17.879966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:17.882908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:17.884764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:17.885509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:17.929096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:17.953848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:17.966968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:17.977348 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ac12a852-883b-4f2e-9d4a-b0fc8dc4a16e tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2545 microversion: 2.42 time: 0.926486 Aug 29 05:13:17.978607 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2364/4721] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:17 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2545 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:18.807441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1ebfc78e-d4ea-4035-8b60-e99d4f2bc278 req-f75d85d5-5c06-44e8-94a4-f8e0b14f2249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-deleted", "tag": "004afcee-7c72-4360-ad7c-0a6d16dcc727"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:18.820007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1ebfc78e-d4ea-4035-8b60-e99d4f2bc278 req-f75d85d5-5c06-44e8-94a4-f8e0b14f2249 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:18.841554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1ebfc78e-d4ea-4035-8b60-e99d4f2bc278 req-f75d85d5-5c06-44e8-94a4-f8e0b14f2249 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:18.842014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1ebfc78e-d4ea-4035-8b60-e99d4f2bc278 req-f75d85d5-5c06-44e8-94a4-f8e0b14f2249 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:18.859477 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1ebfc78e-d4ea-4035-8b60-e99d4f2bc278 req-f75d85d5-5c06-44e8-94a4-f8e0b14f2249 service nova] Creating event network-vif-deleted:004afcee-7c72-4360-ad7c-0a6d16dcc727 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:13:18.865939 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-1ebfc78e-d4ea-4035-8b60-e99d4f2bc278 req-f75d85d5-5c06-44e8-94a4-f8e0b14f2249 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062536 Aug 29 05:13:18.867216 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2365/4722] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:13:19.014539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:19.018704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:19.031557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:19.032466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:19.033057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:19.033970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:19.034623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:19.035196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:19.663315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:19.678968 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d02aacd-f9f4-4b41-b924-eb638f877c7a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 1.820904 Aug 29 05:13:19.679576 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2358/4723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:17 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:19.902521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:19.927592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:19.930443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:19.937739 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5b74cac2-71df-4520-8914-9bf245af7969 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2385 microversion: 2.42 time: 0.934538 Aug 29 05:13:19.938614 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2366/4724] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:19 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2385 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:20.707947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:20.708845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:20.727569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:20.728784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:20.730223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:20.732582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:20.734730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:20.735864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:20.968163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:20.969823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:20.979763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:20.980598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:20.981264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:20.983464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:20.984764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:20.985654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:21.542237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:21.554071 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4e4a400-963b-4151-9cf9-fcbb1d477dce tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.849304 Aug 29 05:13:21.560342 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2359/4725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:20 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:21.580087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-fb7ce06d-a67f-469a-a5d4-04e24505bb07 req-03522431-ac16-42d2-b041-14a9155274aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-deleted", "tag": "3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:21.604458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fb7ce06d-a67f-469a-a5d4-04e24505bb07 req-03522431-ac16-42d2-b041-14a9155274aa service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:21.611469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fb7ce06d-a67f-469a-a5d4-04e24505bb07 req-03522431-ac16-42d2-b041-14a9155274aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:21.612149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fb7ce06d-a67f-469a-a5d4-04e24505bb07 req-03522431-ac16-42d2-b041-14a9155274aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:21.639542 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-fb7ce06d-a67f-469a-a5d4-04e24505bb07 req-03522431-ac16-42d2-b041-14a9155274aa service nova] Creating event network-vif-deleted:3c715f67-c0fc-4e7e-a0e7-d509fdbe7f65 for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:13:21.648587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:21.662539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:21.664027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:21.665947 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-fb7ce06d-a67f-469a-a5d4-04e24505bb07 req-03522431-ac16-42d2-b041-14a9155274aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104040 Aug 29 05:13:21.666847 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2360/4726] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:21.670972 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc04aae4-70ac-4579-8fda-77be7cd413e8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 2385 microversion: 2.42 time: 0.708398 Aug 29 05:13:21.675568 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2367/4727] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:20 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 2385 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:22.582180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:22.582881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:22.594715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:22.595217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:22.595654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:22.596392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:22.596851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:22.597274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:22.704760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:22.706929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:22.714468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:22.757209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:22.760899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:22.762669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:22.767005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:22.769370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:22.771182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:22.938517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:22.963035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:23.002293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:23.005584 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ac48d1a6-c7e1-43f2-a70a-781e359b310d tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.306436 Aug 29 05:13:23.014987 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2368/4728] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:22 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:23.117733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:23.142881 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12a44dd7-d3c4-44c3-b628-de8158062f6d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.561782 Aug 29 05:13:23.144738 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2361/4729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:22 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:23.689897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-83c8a32e-e0f8-4a39-91c1-0d5a7ef70c5e req-96055e87-8e44-4b5c-a0bf-9261975e0c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e8bee1-1cc6-4712-8c4a-ab079f4f1705", "name": "network-vif-deleted", "tag": "d28a6416-ee20-43fb-9e41-ae5f2d7565ce"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:23.714462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-83c8a32e-e0f8-4a39-91c1-0d5a7ef70c5e req-96055e87-8e44-4b5c-a0bf-9261975e0c0f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:23.720339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-83c8a32e-e0f8-4a39-91c1-0d5a7ef70c5e req-96055e87-8e44-4b5c-a0bf-9261975e0c0f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:23.721155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-83c8a32e-e0f8-4a39-91c1-0d5a7ef70c5e req-96055e87-8e44-4b5c-a0bf-9261975e0c0f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:23.767495 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-83c8a32e-e0f8-4a39-91c1-0d5a7ef70c5e req-96055e87-8e44-4b5c-a0bf-9261975e0c0f service nova] Creating event network-vif-deleted:d28a6416-ee20-43fb-9e41-ae5f2d7565ce for instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 on n-h1-854119-9 Aug 29 05:13:23.786167 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-83c8a32e-e0f8-4a39-91c1-0d5a7ef70c5e req-96055e87-8e44-4b5c-a0bf-9261975e0c0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096932 Aug 29 05:13:23.789429 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2369/4730] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:24.034220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:24.036673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:24.049218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:24.076815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:24.078427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:24.079993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:24.082996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:24.082996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:24.089046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:24.170714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:24.171406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:24.195749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:24.196380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:24.196803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:24.202528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:24.204022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:24.209117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:24.358907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:24.361908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:24.408281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:24.418741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:24.420964 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-186b4441-3d7c-4898-a199-00e6c7e73b67 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.390655 Aug 29 05:13:24.441884 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2362/4731] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:24 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:24.946112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:24.969299 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-176aad1d-d2b0-46d5-89d2-9f55c29f99e5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.801991 Aug 29 05:13:24.974263 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2370/4732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:24 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:13:25.452560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:25.453242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:25.489459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:25.490293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:25.491003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:25.491919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:25.494267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:25.494914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:25.575197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5c4015fb-6173-4934-afaf-a7eac36c935e req-618b61e4-3a04-4f29-b6e1-1ee5d2365165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "name": "network-vif-plugged", "status": "completed", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:25.605097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5c4015fb-6173-4934-afaf-a7eac36c935e req-618b61e4-3a04-4f29-b6e1-1ee5d2365165 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:25.605590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5c4015fb-6173-4934-afaf-a7eac36c935e req-618b61e4-3a04-4f29-b6e1-1ee5d2365165 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:25.606021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5c4015fb-6173-4934-afaf-a7eac36c935e req-618b61e4-3a04-4f29-b6e1-1ee5d2365165 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:25.692395 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5c4015fb-6173-4934-afaf-a7eac36c935e req-618b61e4-3a04-4f29-b6e1-1ee5d2365165 service nova] Creating event network-vif-plugged:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:13:25.728241 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5c4015fb-6173-4934-afaf-a7eac36c935e req-618b61e4-3a04-4f29-b6e1-1ee5d2365165 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156506 Aug 29 05:13:25.730950 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2371/4733] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:13:25.808011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:25.819176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:25.826404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:25.830982 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-74406739-1cc7-41a4-a001-c3a414ef4893 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.386934 Aug 29 05:13:25.851571 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2363/4734] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:25 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:25.999428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:26.000378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:26.053259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:26.054236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:26.054910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:26.056064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:26.056767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:26.057461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:26.495556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:26.508224 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-db7216f2-c7f6-4c06-95d8-d5320ccff152 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.513409 Aug 29 05:13:26.510730 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2372/4735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:25 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:26.863910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:26.864673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:26.889647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:26.900699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:26.901480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:26.904899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:26.907351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:26.908728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:27.267476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:27.289229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:27.292516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:27.296876 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff85138d-46fd-467e-95e5-d5c0e840f14c tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.440126 Aug 29 05:13:27.316513 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2364/4736] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:26 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:27.534173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:27.534834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:27.559088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:27.563117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:27.563652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:27.564406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:27.564854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:27.565279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:27.848703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23afd87c-fff0-4c8b-98c1-ecba9cc16c33 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:27.850001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23afd87c-fff0-4c8b-98c1-ecba9cc16c33 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:27.866091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23afd87c-fff0-4c8b-98c1-ecba9cc16c33 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:27.866972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23afd87c-fff0-4c8b-98c1-ecba9cc16c33 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:27.867645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23afd87c-fff0-4c8b-98c1-ecba9cc16c33 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:27.868612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23afd87c-fff0-4c8b-98c1-ecba9cc16c33 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:27.869279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23afd87c-fff0-4c8b-98c1-ecba9cc16c33 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:27.869914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23afd87c-fff0-4c8b-98c1-ecba9cc16c33 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:27.957197 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23afd87c-fff0-4c8b-98c1-ecba9cc16c33 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments/493eaf9a-6baf-47bf-9345-608838080478" status: 200 len: 194 microversion: 2.20 time: 0.548742 Aug 29 05:13:27.966733 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2373/4737] 10.222.0.20 () {60 vars in 1454 bytes} [Mon Aug 29 05:13:27 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments/493eaf9a-6baf-47bf-9345-608838080478 => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:28.102386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:28.103004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:28.114916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:28.115769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:28.116532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:28.122092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:28.123873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:28.124557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:28.625539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:28.637983 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d028ab5-982a-4265-b2ff-f33147bce5e3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 1.108404 Aug 29 05:13:28.645919 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2365/4738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:27 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:13:28.675636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:28.676295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:28.691131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lazy-loading 'services' on Instance uuid 904b4106-5845-40b8-8f26-7eacf31b54b8 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:13:28.704706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:28.709885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:28.710800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:28.715648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:28.726013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:28.726454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:28.998817 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c14cf9d0-6485-4a0f-b786-8f995bfe36c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments/493eaf9a-6baf-47bf-9345-608838080478" status: 202 len: 0 microversion: 2.20 time: 0.900714 Aug 29 05:13:29.000061 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2374/4739] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Aug 29 05:13:28 2022] DELETE /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments/493eaf9a-6baf-47bf-9345-608838080478 => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:13:29.022746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-97707962-2b90-425f-92e0-dc353bc11b0e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:29.035993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-97707962-2b90-425f-92e0-dc353bc11b0e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:29.057538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97707962-2b90-425f-92e0-dc353bc11b0e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:29.058431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97707962-2b90-425f-92e0-dc353bc11b0e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:29.059090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97707962-2b90-425f-92e0-dc353bc11b0e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:29.060208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97707962-2b90-425f-92e0-dc353bc11b0e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:29.060903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97707962-2b90-425f-92e0-dc353bc11b0e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:29.061553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-97707962-2b90-425f-92e0-dc353bc11b0e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:29.156524 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-97707962-2b90-425f-92e0-dc353bc11b0e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.142830 Aug 29 05:13:29.159102 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2375/4740] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:29 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:29.211257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:29.231304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:29.240522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:29.243523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee588980-6c96-4500-b1c9-fbb18a7d4a13 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.596387 Aug 29 05:13:29.248156 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2366/4741] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:28 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:29.663112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:29.664153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:29.676032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:29.683559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:29.684067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:29.686734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:29.691202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:29.691822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:30.171314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-00a3a6b1-b45a-4fe2-8354-27f9359a9386 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:30.174330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-00a3a6b1-b45a-4fe2-8354-27f9359a9386 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:30.198615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00a3a6b1-b45a-4fe2-8354-27f9359a9386 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:30.199364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00a3a6b1-b45a-4fe2-8354-27f9359a9386 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:30.200047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00a3a6b1-b45a-4fe2-8354-27f9359a9386 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:30.201286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00a3a6b1-b45a-4fe2-8354-27f9359a9386 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:30.201902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00a3a6b1-b45a-4fe2-8354-27f9359a9386 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:30.205181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00a3a6b1-b45a-4fe2-8354-27f9359a9386 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:30.246848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:30.260157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5bb2f2e7-daeb-440d-8538-d53ccb088412 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.596408 Aug 29 05:13:30.266961 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2376/4742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:29 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:13:30.306662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:30.316446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:30.338231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:30.345810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:30.348678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:30.355586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:30.356656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:30.360782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:30.365318 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-00a3a6b1-b45a-4fe2-8354-27f9359a9386 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.197930 Aug 29 05:13:30.376690 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2367/4743] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:30 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:30.552776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:30.587945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:30.595481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:30.602077 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b2e7a71-6cf5-4d6d-bf54-05e7bac8e45b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.316743 Aug 29 05:13:30.607606 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2377/4744] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:30 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:31.293185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:31.294464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:31.317236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:31.326471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:31.327752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:31.331778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:31.333704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:31.336825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:31.380765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55b55d09-466b-4f48-9ff1-a1c738f24d11 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:31.383446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55b55d09-466b-4f48-9ff1-a1c738f24d11 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:31.403140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b55d09-466b-4f48-9ff1-a1c738f24d11 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:31.410941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b55d09-466b-4f48-9ff1-a1c738f24d11 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:31.424177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b55d09-466b-4f48-9ff1-a1c738f24d11 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:31.433152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b55d09-466b-4f48-9ff1-a1c738f24d11 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:31.435723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b55d09-466b-4f48-9ff1-a1c738f24d11 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:31.436417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b55d09-466b-4f48-9ff1-a1c738f24d11 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:31.561045 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55b55d09-466b-4f48-9ff1-a1c738f24d11 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184387 Aug 29 05:13:31.566290 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2378/4745] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:31 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:31.634730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:31.635830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:31.653855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:31.658831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:31.669056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:31.673507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:31.674327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:31.679461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:31.758986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:31.771704 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-460e820c-f092-4bd5-9174-cba7ca852aa4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.483283 Aug 29 05:13:31.772391 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2368/4746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:31 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:31.795945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:31.879310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:31.905162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:31.907413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:31.909587 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45a40b54-6095-4006-9f87-a4c601d2ebe9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.280293 Aug 29 05:13:31.910657 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2379/4747] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:31 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:32.578063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c3cc8bca-fbfa-41ca-9850-8e456282de6a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:32.581636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c3cc8bca-fbfa-41ca-9850-8e456282de6a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:32.610275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3cc8bca-fbfa-41ca-9850-8e456282de6a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:32.610785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3cc8bca-fbfa-41ca-9850-8e456282de6a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:32.611222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3cc8bca-fbfa-41ca-9850-8e456282de6a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:32.611954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3cc8bca-fbfa-41ca-9850-8e456282de6a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:32.612428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3cc8bca-fbfa-41ca-9850-8e456282de6a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:32.612855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3cc8bca-fbfa-41ca-9850-8e456282de6a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:32.700435 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c3cc8bca-fbfa-41ca-9850-8e456282de6a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126971 Aug 29 05:13:32.713537 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2369/4748] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:32 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:32.793893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:32.795173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:32.805086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:32.809142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:32.812114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:32.814300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:32.821370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:32.824799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:32.933747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:32.934373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:32.962688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:32.963540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:32.966326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:32.967405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:32.970105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:32.971337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:33.256055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:33.266175 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b444b2d-b850-4b5c-a374-2a10ffe8075d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.476100 Aug 29 05:13:33.272048 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2380/4749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:32 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:33.342346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:33.361483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:33.365120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:33.366913 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-43027bb4-e74e-43b6-bfbb-06292f457b7b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.437325 Aug 29 05:13:33.383120 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2370/4750] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:32 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:33.723840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9439abed-0fbc-48a5-9868-87f03fa6c7fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:33.728484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9439abed-0fbc-48a5-9868-87f03fa6c7fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:33.747019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9439abed-0fbc-48a5-9868-87f03fa6c7fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:33.752624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9439abed-0fbc-48a5-9868-87f03fa6c7fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:33.753352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9439abed-0fbc-48a5-9868-87f03fa6c7fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:33.754284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9439abed-0fbc-48a5-9868-87f03fa6c7fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:33.759074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9439abed-0fbc-48a5-9868-87f03fa6c7fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:33.762170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9439abed-0fbc-48a5-9868-87f03fa6c7fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:33.870955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9439abed-0fbc-48a5-9868-87f03fa6c7fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151057 Aug 29 05:13:33.887798 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2381/4751] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:33 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:34.295798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:34.296602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:34.318796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:34.324924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:34.325396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:34.328549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:34.329183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:34.329630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:34.391248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:34.391931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:34.407773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:34.408222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:34.408662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:34.409386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:34.409835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:34.410259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:34.632676 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:13:34.632837 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:13:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 (ip 10.222.0.20) !!! Aug 29 05:13:34.664484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:34.682271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:34.685529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:34.689334 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-214b2699-4e93-4c9a-a9dd-1a8fe763c98a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.299960 Aug 29 05:13:34.691173 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2382/4752] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:34 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:34.897989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45dfc1dc-aad0-4b49-b431-d4e9e1e4191a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:34.900927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45dfc1dc-aad0-4b49-b431-d4e9e1e4191a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:34.943239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45dfc1dc-aad0-4b49-b431-d4e9e1e4191a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:34.943744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45dfc1dc-aad0-4b49-b431-d4e9e1e4191a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:34.951429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45dfc1dc-aad0-4b49-b431-d4e9e1e4191a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:34.952415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45dfc1dc-aad0-4b49-b431-d4e9e1e4191a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:34.952917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45dfc1dc-aad0-4b49-b431-d4e9e1e4191a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:34.953350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45dfc1dc-aad0-4b49-b431-d4e9e1e4191a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:35.050164 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45dfc1dc-aad0-4b49-b431-d4e9e1e4191a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158502 Aug 29 05:13:35.051067 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2383/4753] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:34 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:35.091026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:35.104990 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-838caef4-66fa-4fcc-94b1-8be687583688 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.815718 Aug 29 05:13:35.105792 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2371/4754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:34 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:35.718158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:35.718783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:35.739085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:35.751352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:35.752843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:35.756870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:35.759220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:35.762507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:36.063617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-73e19dfd-a814-4d03-8634-67959728b8c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:36.066427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-73e19dfd-a814-4d03-8634-67959728b8c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:36.089003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73e19dfd-a814-4d03-8634-67959728b8c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:36.089510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73e19dfd-a814-4d03-8634-67959728b8c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:36.094466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73e19dfd-a814-4d03-8634-67959728b8c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:36.096316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73e19dfd-a814-4d03-8634-67959728b8c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:36.096802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73e19dfd-a814-4d03-8634-67959728b8c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:36.097235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73e19dfd-a814-4d03-8634-67959728b8c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:36.156894 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-73e19dfd-a814-4d03-8634-67959728b8c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097582 Aug 29 05:13:36.165093 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2372/4755] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:36 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 05:13:36.171101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:36.172099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:36.180896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:36.181823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:36.182581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:36.183553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:36.184339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:36.185687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:36.524494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:36.543597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:36.549028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:36.551512 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8270c298-2593-4269-82c5-6001285748ba tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.837937 Aug 29 05:13:36.568724 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2384/4756] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:35 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:37.062337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:37.084816 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f9fa4c5-b772-466d-9e45-869ca95e8c45 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.910431 Aug 29 05:13:37.085504 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2373/4757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:36 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:37.172609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0d40f2b-7b78-4020-a3f8-d4d161d05ed7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:37.175622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d0d40f2b-7b78-4020-a3f8-d4d161d05ed7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:37.196891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d40f2b-7b78-4020-a3f8-d4d161d05ed7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:37.204579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d40f2b-7b78-4020-a3f8-d4d161d05ed7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:37.205560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d40f2b-7b78-4020-a3f8-d4d161d05ed7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:37.208652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d40f2b-7b78-4020-a3f8-d4d161d05ed7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:37.212545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d40f2b-7b78-4020-a3f8-d4d161d05ed7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:37.214158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0d40f2b-7b78-4020-a3f8-d4d161d05ed7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:37.332681 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0d40f2b-7b78-4020-a3f8-d4d161d05ed7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.162438 Aug 29 05:13:37.336113 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2385/4758] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:37 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:37.581409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:37.583199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:37.594266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:37.599901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:37.600854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:37.602041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:37.606177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:37.607067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:37.750428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:37.763022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:37.770942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:37.774459 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-48855457-6b40-4a69-a459-30615b24bfe0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.196179 Aug 29 05:13:37.789466 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2374/4759] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:37 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:38.107101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:38.108777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:38.121738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:38.127161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:38.132225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:38.133328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:38.136595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:38.138406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:38.346663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f126bc4-57b3-4ac4-b3b3-50ad39b91118 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:38.350589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5f126bc4-57b3-4ac4-b3b3-50ad39b91118 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:38.374419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f126bc4-57b3-4ac4-b3b3-50ad39b91118 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:38.381694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f126bc4-57b3-4ac4-b3b3-50ad39b91118 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:38.385896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f126bc4-57b3-4ac4-b3b3-50ad39b91118 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:38.387064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f126bc4-57b3-4ac4-b3b3-50ad39b91118 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:38.387756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f126bc4-57b3-4ac4-b3b3-50ad39b91118 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:38.388430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f126bc4-57b3-4ac4-b3b3-50ad39b91118 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:38.500627 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5f126bc4-57b3-4ac4-b3b3-50ad39b91118 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158347 Aug 29 05:13:38.503951 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2375/4760] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:38 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 05:13:38.732544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:38.741217 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cb1d34af-1c00-4656-b73a-c90301443159 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.639071 Aug 29 05:13:38.749895 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2386/4761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:38 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:38.815917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:38.816976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:38.842604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:38.846106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:38.846899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:38.850023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:38.853058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:38.856275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:39.449187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:39.463891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:39.469941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:39.477653 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7291c26e-06e9-4608-8ab2-193bccf3e5a3 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.673493 Aug 29 05:13:39.480859 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2376/4762] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:38 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:39.516332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85164419-0281-491b-9aeb-a5f1d2a2d51e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:39.518814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85164419-0281-491b-9aeb-a5f1d2a2d51e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:39.537414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85164419-0281-491b-9aeb-a5f1d2a2d51e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:39.537930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85164419-0281-491b-9aeb-a5f1d2a2d51e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:39.538379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85164419-0281-491b-9aeb-a5f1d2a2d51e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:39.539133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85164419-0281-491b-9aeb-a5f1d2a2d51e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:39.539599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85164419-0281-491b-9aeb-a5f1d2a2d51e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:39.540031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85164419-0281-491b-9aeb-a5f1d2a2d51e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:39.671894 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85164419-0281-491b-9aeb-a5f1d2a2d51e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159879 Aug 29 05:13:39.672822 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2387/4763] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:39 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:39.767421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:39.768044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:39.791083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:39.791723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:39.792246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:39.806486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:39.812480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:39.816870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:40.316287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:40.332208 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8943e984-71af-4c90-8503-3f46668ba8f1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.568861 Aug 29 05:13:40.346339 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2377/4764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:39 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:40.509006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:40.512573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:40.523638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:40.524434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:40.524652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:40.533040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:40.539558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:40.540320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:40.687254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6224e1a4-0233-408e-aae6-24c3e54df644 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:40.692547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6224e1a4-0233-408e-aae6-24c3e54df644 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:40.727950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6224e1a4-0233-408e-aae6-24c3e54df644 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:40.733470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6224e1a4-0233-408e-aae6-24c3e54df644 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:40.745678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6224e1a4-0233-408e-aae6-24c3e54df644 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:40.747202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6224e1a4-0233-408e-aae6-24c3e54df644 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:40.749336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6224e1a4-0233-408e-aae6-24c3e54df644 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:40.749994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6224e1a4-0233-408e-aae6-24c3e54df644 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:40.873619 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6224e1a4-0233-408e-aae6-24c3e54df644 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.190639 Aug 29 05:13:40.878263 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2378/4765] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:40 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 05:13:41.354949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:41.355491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:41.368257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:41.368774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:41.369218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:41.369937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:41.375975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:41.377700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:41.435638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:42.435258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:42.454217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:42.456464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:42.458067 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6752a695-7cad-4546-a077-07ca857a2e0a tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 1.953673 Aug 29 05:13:42.459386 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2388/4766] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:40 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:42.469033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b3124a9-da5f-4ec3-9ea9-0aa28a52fe5c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:42.478309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b3124a9-da5f-4ec3-9ea9-0aa28a52fe5c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:42.493486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3124a9-da5f-4ec3-9ea9-0aa28a52fe5c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:42.494141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3124a9-da5f-4ec3-9ea9-0aa28a52fe5c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:42.494683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3124a9-da5f-4ec3-9ea9-0aa28a52fe5c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:42.495526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3124a9-da5f-4ec3-9ea9-0aa28a52fe5c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:42.496529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3124a9-da5f-4ec3-9ea9-0aa28a52fe5c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:42.499839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b3124a9-da5f-4ec3-9ea9-0aa28a52fe5c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:42.606594 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b3124a9-da5f-4ec3-9ea9-0aa28a52fe5c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143707 Aug 29 05:13:42.615177 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2389/4767] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:42 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:42.997059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:43.013298 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-031f729d-6327-4d3b-9523-b92537910fd4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 1.662609 Aug 29 05:13:43.014477 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2379/4768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:41 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:43.485285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:43.486796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:43.493816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:43.506585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:43.508733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:43.509749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:43.512690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:43.513390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:43.627234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30ea66bf-298b-4fd1-9517-58e0c6c51c5a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:43.631496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30ea66bf-298b-4fd1-9517-58e0c6c51c5a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:43.652766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ea66bf-298b-4fd1-9517-58e0c6c51c5a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:43.653971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ea66bf-298b-4fd1-9517-58e0c6c51c5a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:43.658578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ea66bf-298b-4fd1-9517-58e0c6c51c5a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:43.659908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ea66bf-298b-4fd1-9517-58e0c6c51c5a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:43.661067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ea66bf-298b-4fd1-9517-58e0c6c51c5a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:43.661798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ea66bf-298b-4fd1-9517-58e0c6c51c5a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:43.749726 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30ea66bf-298b-4fd1-9517-58e0c6c51c5a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126632 Aug 29 05:13:43.753764 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2380/4769] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:43 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:44.035757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:44.037363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:44.046820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:44.051145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:44.052080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:44.053195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:44.054501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:44.058311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:44.468314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:44.483844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:44.491787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:44.494104 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de77dc70-38dd-4be5-bff3-9753a1daea91 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 1.013081 Aug 29 05:13:44.495290 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2390/4770] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:43 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:44.766156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3aa9186b-9e06-4ebb-86fd-4fa019ac4c3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:44.768941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3aa9186b-9e06-4ebb-86fd-4fa019ac4c3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:44.780894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa9186b-9e06-4ebb-86fd-4fa019ac4c3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:44.791465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa9186b-9e06-4ebb-86fd-4fa019ac4c3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:44.797966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa9186b-9e06-4ebb-86fd-4fa019ac4c3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:44.801140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa9186b-9e06-4ebb-86fd-4fa019ac4c3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:44.801969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa9186b-9e06-4ebb-86fd-4fa019ac4c3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:44.802797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa9186b-9e06-4ebb-86fd-4fa019ac4c3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:44.901409 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3aa9186b-9e06-4ebb-86fd-4fa019ac4c3d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139616 Aug 29 05:13:44.902927 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2391/4771] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:44 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:45.345993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:45.355707 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fdcd55f0-b0e0-4bdf-895e-983641f8208e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 1.324541 Aug 29 05:13:45.364335 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2381/4772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:44 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:45.520444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:45.521885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:45.533579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:45.535014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:45.535692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:45.542556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:45.544017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:45.546188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:45.810274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:45.834679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:45.838958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:45.843939 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-436794d9-4e82-4e15-a616-5cda47b0ab44 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.326306 Aug 29 05:13:45.869660 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2392/4773] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:45 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:45.914998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eae9f0e7-4424-4308-900f-3be2743f97ca tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:45.918211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eae9f0e7-4424-4308-900f-3be2743f97ca tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:45.931857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eae9f0e7-4424-4308-900f-3be2743f97ca tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:45.932668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eae9f0e7-4424-4308-900f-3be2743f97ca tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:45.933339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eae9f0e7-4424-4308-900f-3be2743f97ca tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:45.934323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eae9f0e7-4424-4308-900f-3be2743f97ca tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:45.935173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eae9f0e7-4424-4308-900f-3be2743f97ca tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:45.936098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eae9f0e7-4424-4308-900f-3be2743f97ca tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:46.020970 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eae9f0e7-4424-4308-900f-3be2743f97ca tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.110083 Aug 29 05:13:46.022318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2382/4774] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:45 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:13:46.392490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:46.395790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:46.411579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:46.412085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:46.412570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:46.413274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:46.421039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:46.421745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:46.789832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:46.814403 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d4a1cbcc-5319-4a3d-912c-aba505619581 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.425976 Aug 29 05:13:46.815069 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2393/4775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:46 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:46.888701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:46.890697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:46.902104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:46.902761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:46.903500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:46.904290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:46.904859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:46.907272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:47.079602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-daeb040e-564a-4e70-8d2f-daa5a90e14c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:47.082255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-daeb040e-564a-4e70-8d2f-daa5a90e14c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:47.138757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:47.139026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daeb040e-564a-4e70-8d2f-daa5a90e14c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:47.141651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daeb040e-564a-4e70-8d2f-daa5a90e14c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:47.145145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:47.146875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daeb040e-564a-4e70-8d2f-daa5a90e14c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:47.147896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daeb040e-564a-4e70-8d2f-daa5a90e14c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:47.149099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daeb040e-564a-4e70-8d2f-daa5a90e14c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:47.149911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daeb040e-564a-4e70-8d2f-daa5a90e14c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:47.159566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:47.169487 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a36d3c43-ca5d-415f-8159-9ba710f61fd4 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.290245 Aug 29 05:13:47.177035 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2383/4776] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:46 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:47.268165 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-daeb040e-564a-4e70-8d2f-daa5a90e14c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.225823 Aug 29 05:13:47.282055 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2394/4777] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:13:47 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8/os-volume_attachments => generated 25 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:13:47.369422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:47.370332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:47.379926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:47.381117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:47.382801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:47.386034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:47.389745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:47.390430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:47.423171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:13:47.717061 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42aa083e-81d2-4946-a8fb-d430eef2722a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 204 len: 0 microversion: 2.20 time: 0.350811 Aug 29 05:13:47.727129 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2384/4778] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:13:47 2022] DELETE /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:13:47.752039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:47.763909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:47.792788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:47.793621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:47.794427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:47.797083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:47.799080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:47.803086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:48.062125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-453682222", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "33e77a08-72b8-478f-9e9f-2f05a21796dd"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:48.203348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] validate_networks() for [('33e77a08-72b8-478f-9e9f-2f05a21796dd', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:13:48.504439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:48.514800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:48.522149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:48.523714 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d831699d-707d-4298-9fad-4e899de46397 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.786739 Aug 29 05:13:48.541128 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2385/4779] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:47 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:48.562598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:48.563229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:48.584260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:48.588299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:48.589010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:48.590208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:48.590881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:48.592014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:48.991302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:49.000950 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4acb73ca-8c81-4723-96db-7392644fe3bb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.458561 Aug 29 05:13:49.001585 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2386/4780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:48 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:49.013037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:49.016246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:49.036154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:49.038902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:49.039848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:49.040861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:49.042722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:49.044268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:49.410111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:49.448432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:49.449922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:49.451483 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7c8e13d-66cd-46a3-be58-67a0e8d04115 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.445073 Aug 29 05:13:49.468779 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2387/4781] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:49 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:49.548851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:13:49.549739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:13:49.550406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:13:49.551035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:13:49.551697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:13:49.555423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:49.556204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:49.566631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:49.571725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:49.572471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:49.573191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:49.573779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:49.574484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:49.576661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:49.577070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:49.577620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:49.577765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:49.578419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:49.578551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:49.627302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Getting quotas for project 3a5d5831ce444852af1574dcc1dbf942. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:13:49.633355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Getting quotas for user cd7256c6cd9c45c4990452de893dc12d and project 3a5d5831ce444852af1574dcc1dbf942. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:13:49.670725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:13:49.673491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:13:49.784016 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-921961f8-6d6e-44f4-8b17-7b17baa2cc5d tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.126886 Aug 29 05:13:49.787760 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2395/4782] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 05:13:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 05:13:49.803957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c7cf7aec-9c4e-43d9-b599-9d02c8bfb640 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:49.804604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c7cf7aec-9c4e-43d9-b599-9d02c8bfb640 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:49.973170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:49.982525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:49.990040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:49.993068 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-43d53649-7394-4fec-9480-5730cfeaff9a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.441760 Aug 29 05:13:49.996170 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2388/4783] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:49 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:49.997822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7cf7aec-9c4e-43d9-b599-9d02c8bfb640 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:50.006774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7cf7aec-9c4e-43d9-b599-9d02c8bfb640 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:50.008505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:50.011413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:50.020103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7cf7aec-9c4e-43d9-b599-9d02c8bfb640 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:50.021354 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c7cf7aec-9c4e-43d9-b599-9d02c8bfb640 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1258 microversion: 2.21 time: 0.221406 Aug 29 05:13:50.025971 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2396/4784] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:49 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1258 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:50.026272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:50.027545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:50.028624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:50.030656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:50.031087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:50.031269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:50.031747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:50.032726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:50.045647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:50.046504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:50.048926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:50.057208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:50.057932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:50.058512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:50.931475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:50.941702 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0028dc23-1a71-4d2e-beff-323827fe83a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.944224 Aug 29 05:13:50.942629 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2389/4785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:49 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:50.949483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:50.951409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:50.962055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:50.964008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:50.964719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:50.965523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:50.965660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:50.967311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:50.968368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:50.969090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:50.971613 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-50f6a6f1-580a-48b6-b7cc-d3fbdc9130ec tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.944524 Aug 29 05:13:50.972242 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2397/4786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:50 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:51.020313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:51.021859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:51.029457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:51.030441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:51.031420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:51.032948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:51.034016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:51.035134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:51.264646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:51.275081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:51.276755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:51.278724 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87adea71-4a47-468a-b754-ce8b2b29a4e7 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.334585 Aug 29 05:13:51.279781 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2390/4787] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:50 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:51.284719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af5360b4-392e-47a5-9280-337fe74622f1 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:51.289080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af5360b4-392e-47a5-9280-337fe74622f1 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:51.614493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af5360b4-392e-47a5-9280-337fe74622f1 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:51.627707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af5360b4-392e-47a5-9280-337fe74622f1 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:51.630994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af5360b4-392e-47a5-9280-337fe74622f1 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:51.636156 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af5360b4-392e-47a5-9280-337fe74622f1 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1258 microversion: 2.21 time: 0.354065 Aug 29 05:13:51.652146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2391/4788] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:51 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1258 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:51.744148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:51.765002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:51.769408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:51.772475 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-849da137-347e-47f4-b45b-90b823e70f66 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1723 microversion: 2.20 time: 0.756166 Aug 29 05:13:51.775569 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2398/4789] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:51 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1723 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:51.968397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:51.970120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:51.983434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:51.986516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:51.988555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:51.989668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:51.991078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:51.992606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:51.997693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:51.998395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:52.010253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.010750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.022536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:52.023212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.023688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.024330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:52.480613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:52.492970 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bcd225dd-51a8-49f1-bbe0-9ba230b5edc6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.499965 Aug 29 05:13:52.496089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2399/4790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:51 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:52.508613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:52.512360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:52.538588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.540689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.543380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:52.544926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.547603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.548186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:52.638204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:52.663340 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e968ccd9-6c84-495c-ae53-ff2bf1ca948b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.701054 Aug 29 05:13:52.674761 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2392/4791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:51 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:52.691466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:52.692896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:52.716052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.716721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.717354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:52.718295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.718776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.719213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:52.746354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:52.760265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:52.762590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:52.764266 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1f760c10-84cf-4438-a2f9-e6bd999e7ecd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.266942 Aug 29 05:13:52.768518 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2400/4792] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:52 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:52.778563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9558a01e-9c20-4a50-a460-682eda423f20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-958342618"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:52.790937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9558a01e-9c20-4a50-a460-682eda423f20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:52.799815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:52.809536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9558a01e-9c20-4a50-a460-682eda423f20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.810638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9558a01e-9c20-4a50-a460-682eda423f20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.811319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9558a01e-9c20-4a50-a460-682eda423f20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:52.812391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9558a01e-9c20-4a50-a460-682eda423f20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.813092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9558a01e-9c20-4a50-a460-682eda423f20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.813791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9558a01e-9c20-4a50-a460-682eda423f20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:52.908980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:52.926535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:52.938441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:52.941510 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-32e123e2-0d56-4816-b93c-e192ef74c254 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1262 microversion: 2.21 time: 0.265593 Aug 29 05:13:52.943560 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2393/4793] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:52 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1262 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:52.955399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:52.956837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:52.967969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.972895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.974191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:52.976143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:52.977490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:52.981344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:53.238625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:53.255100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:53.270408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:53.271923 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4823e7d6-b1ac-4567-8d80-615283f06703 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1655 microversion: 2.20 time: 0.324340 Aug 29 05:13:53.277153 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2394/4794] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:52 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1655 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:53.336529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9558a01e-9c20-4a50-a460-682eda423f20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.566051 Aug 29 05:13:53.338200 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2401/4795] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:13:52 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 05:13:53.520242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:53.521200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:53.545563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:53.553397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:53.556784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:53.559271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:53.559878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:53.561554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:53.606201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:53.794464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:53.795572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:53.808579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:53.813241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:53.814138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:53.816201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:53.817025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:53.818256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:54.120158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.134545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.136316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.137552 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28f92f2e-0d38-4ce8-9cea-fabbd8784ae6 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.348464 Aug 29 05:13:54.138138 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2402/4796] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:53 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:54.149078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:54.149697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:54.173484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:54.174169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:54.174797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:54.175730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:54.180084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:54.181665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:54.305422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.325475 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f24319f6-5d05-46d1-9eea-c499e84893ff tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.810179 Aug 29 05:13:54.345721 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2395/4797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:53 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:54.356889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d3b6b843-ae91-499d-8637-f2d2fc2289fe req-228c4b7c-6522-4995-9eb3-92eef57d5a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904b4106-5845-40b8-8f26-7eacf31b54b8", "name": "network-vif-deleted", "tag": "fbfd57c9-7dce-4a91-982f-cfa91fd489ee"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:54.368099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:54.369919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.375707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d3b6b843-ae91-499d-8637-f2d2fc2289fe req-228c4b7c-6522-4995-9eb3-92eef57d5a0e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:54.376400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d3b6b843-ae91-499d-8637-f2d2fc2289fe req-228c4b7c-6522-4995-9eb3-92eef57d5a0e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:54.376986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d3b6b843-ae91-499d-8637-f2d2fc2289fe req-228c4b7c-6522-4995-9eb3-92eef57d5a0e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:54.381294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.382744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.387730 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a3670d1-216e-44ec-9212-7932cef5df95 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1328 microversion: 2.21 time: 0.244807 Aug 29 05:13:54.390676 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2403/4798] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:54 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1328 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:54.399930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:54.400821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:54.418049 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d3b6b843-ae91-499d-8637-f2d2fc2289fe req-228c4b7c-6522-4995-9eb3-92eef57d5a0e service nova] Creating event network-vif-deleted:fbfd57c9-7dce-4a91-982f-cfa91fd489ee for instance 904b4106-5845-40b8-8f26-7eacf31b54b8 on n-h1-854119-9 Aug 29 05:13:54.422074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:54.422579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:54.423016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:54.423727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:54.424171 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d3b6b843-ae91-499d-8637-f2d2fc2289fe req-228c4b7c-6522-4995-9eb3-92eef57d5a0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075615 Aug 29 05:13:54.424322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:54.424679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:54.425271 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2396/4799] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:54.475720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:54.476308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:54.476899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:54.477433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lazy-loading 'fault' on Instance uuid 904b4106-5845-40b8-8f26-7eacf31b54b8 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:13:54.528879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.538626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.540680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:54.542994 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9ff2660-7c2b-4105-aa41-d04aad979dd9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 200 len: 1371 microversion: 2.20 time: 0.150259 Aug 29 05:13:54.543936 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2404/4800] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:54 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:54.697373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-fc202aa1-15e8-4dd5-af8b-6008d7343d59 req-7d090e14-f34a-4d2e-9920-3b4d73686fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c83cae9-ef18-4723-9742-bb5e40f1b115", "name": "network-vif-plugged", "status": "completed", "tag": "b5b79f0a-b188-414c-99ed-082280f4ef23"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:54.725293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fc202aa1-15e8-4dd5-af8b-6008d7343d59 req-7d090e14-f34a-4d2e-9920-3b4d73686fb4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:54.728459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fc202aa1-15e8-4dd5-af8b-6008d7343d59 req-7d090e14-f34a-4d2e-9920-3b4d73686fb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:54.729109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fc202aa1-15e8-4dd5-af8b-6008d7343d59 req-7d090e14-f34a-4d2e-9920-3b4d73686fb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:54.784026 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-fc202aa1-15e8-4dd5-af8b-6008d7343d59 req-7d090e14-f34a-4d2e-9920-3b4d73686fb4 service nova] Creating event network-vif-plugged:b5b79f0a-b188-414c-99ed-082280f4ef23 for instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 on n-h1-854119-9 Aug 29 05:13:54.801869 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-fc202aa1-15e8-4dd5-af8b-6008d7343d59 req-7d090e14-f34a-4d2e-9920-3b4d73686fb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109325 Aug 29 05:13:54.802702 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2397/4801] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:55.165110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:55.165796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:55.179882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:55.181575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:55.182086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:55.183960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:55.184482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:55.184917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:55.328769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:55.348362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:55.350264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:55.356923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:55.359189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:55.361710 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b4dbfa1-9ae7-4bce-8a32-b75282aacf41 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.200950 Aug 29 05:13:55.371355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:55.372078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:55.372725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:55.373610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:55.374242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:55.374842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:55.377721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2405/4802] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:55 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:55.414261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:55.414882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:55.427294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:55.427794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:55.428291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:55.429001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:55.429001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:55.429001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:55.568164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:55.584959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:55.588624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:55.590192 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5da88f48-c412-4e5d-aebd-0d5dffc99394 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1316 microversion: 2.21 time: 0.179920 Aug 29 05:13:55.591605 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2406/4803] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:55 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:55.597908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:55.598847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:55.607802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:55.608704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:55.609345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:55.610244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:55.611372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:55.612189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:55.636296 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] HTTP exception thrown: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Request method failure captured: Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 HTTP/1.1 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEmfsS_sPNgL4dC_VoSatyJN5SFMDp4PzY8V5auQDwX6xit3qadtZhmeBEdwjHAvGhQ_hRa-o28pCSBeoNKcop80cKdzb7qrkhf-ORyiT0zn_FymdVjjfzpw0Nzivv3kDH2818L7EbkIR9BeJ8b4FhctqXQzOijO7pVmt7nWXGXh0wU Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f948ec6a5b043ed8ea6bac997a4c2c4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e283b8db0cfc47acac0ca482a69005d6 Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '904b4106-5845-40b8-8f26-7eacf31b54b8'} Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:55.641426 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:13:55.651303 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:55.651303 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:13:55.651303 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:13:55.651303 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:13:55.651303 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:13:55.651303 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:13:55.651303 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:13:55.651303 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:13:55.656615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Returning 404 to user: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:13:55.658468 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3ab40e50-fcd7-4b9f-8444-d4e1c50fcdcf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 404 len: 111 microversion: 2.20 time: 0.064547 Aug 29 05:13:55.664926 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2407/4804] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:55 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:13:55.671715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d779415-68a2-44a0-b5dd-92281d6e55ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '.version_select at 0x7f1ab814f3a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:55.704321 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d779415-68a2-44a0-b5dd-92281d6e55ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143162548" status: 204 len: 0 microversion: 2.20 time: 0.037718 Aug 29 05:13:55.709824 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2408/4805] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 05:13:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143162548 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:13:55.722756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:55.731843 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-43c2d344-c229-402b-948b-ebe0da7315a4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.381525 Aug 29 05:13:55.733171 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2398/4806] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:55 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:56.399789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:56.400552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:56.459757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:56.467138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:56.469802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:56.470590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:56.473506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:56.473961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:56.616857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:56.618259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:56.630354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:56.638700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:56.640673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:56.641689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:56.644768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:56.645533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:56.966523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:56.984805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:56.990992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:56.996212 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eba6bac4-d881-4e30-9697-e4ec4e3979f8 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.605598 Aug 29 05:13:57.015686 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2409/4807] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:56 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:57.027947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:57.029947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:57.044529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:57.045946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:57.055084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:57.055876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:57.059540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:57.060238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:57.137730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:57.150310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:57.159227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:57.163704 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-20927374-6e65-43fb-b223-f5c47592341a tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1358 microversion: 2.21 time: 0.551019 Aug 29 05:13:57.173035 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2399/4808] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:56 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1358 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:57.180496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-52c2cfd2-c05b-4e32-8571-42403c81b9c4 req-518332f6-2608-4d04-91ce-e951afdaaada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "name": "network-vif-unplugged", "status": "completed", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:57.207321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-52c2cfd2-c05b-4e32-8571-42403c81b9c4 req-518332f6-2608-4d04-91ce-e951afdaaada service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:57.208036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-52c2cfd2-c05b-4e32-8571-42403c81b9c4 req-518332f6-2608-4d04-91ce-e951afdaaada service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:57.208364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-52c2cfd2-c05b-4e32-8571-42403c81b9c4 req-518332f6-2608-4d04-91ce-e951afdaaada service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:57.251051 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-52c2cfd2-c05b-4e32-8571-42403c81b9c4 req-518332f6-2608-4d04-91ce-e951afdaaada service nova] Creating event network-vif-unplugged:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:13:57.270363 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-52c2cfd2-c05b-4e32-8571-42403c81b9c4 req-518332f6-2608-4d04-91ce-e951afdaaada service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095654 Aug 29 05:13:57.271375 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2400/4809] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:57.639696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:57.674112 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d045ec87-eb74-4852-9959-992d19f30a42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1519 microversion: 2.1 time: 0.655175 Aug 29 05:13:57.674929 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2410/4810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:57 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1519 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:13:58.022901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:58.023614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:58.047119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:58.047754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:58.054700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:58.059223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:58.060112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:58.062888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:58.197744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:58.198670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:58.211926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:58.212735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:58.215966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:58.216932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:58.217601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:58.220273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:58.223984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:58.247394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:58.255000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:58.256360 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7dac7b58-e422-4ddc-9d12-b71d12ec159f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.238251 Aug 29 05:13:58.260568 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2401/4811] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:58 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:58.513828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:58.524316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:58.534757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:58.536847 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45115333-dd16-445f-81ba-fbae416ab292 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1358 microversion: 2.21 time: 0.344399 Aug 29 05:13:58.553043 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2411/4812] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:58 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:13:58.576985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b5d82e60-7e4b-4983-aa3c-c13ee3aded72 req-3470a2b4-ed43-4377-87d3-0e9bfa2b28b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3795c0-0449-4603-ba12-b2033292af1f", "tag": "b6cfa9c4-f3d4-44ad-9452-ff9132f91d88"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:58.589799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0dd2cb5-043b-4042-b797-2f6ef69a3810 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'create', calling method: .version_select at 0x7f1ab809a280>, body: {"keypair": {"name": "tempest-keypair-2105982994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDHwEUDWsFI88PvVd6zifZ/2dCyjr5cRWJ3ZoZiQT+4As3Rg/Xu4sJlupQ8lmDMO6MLCj0XJrarFlQcGHgraKbkXBFaKfEtPULyXQRR132lGslS43xdLoMAmPYEL0RHDQ=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:13:58.607465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b5d82e60-7e4b-4983-aa3c-c13ee3aded72 req-3470a2b4-ed43-4377-87d3-0e9bfa2b28b7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:58.607966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b5d82e60-7e4b-4983-aa3c-c13ee3aded72 req-3470a2b4-ed43-4377-87d3-0e9bfa2b28b7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:58.627200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b5d82e60-7e4b-4983-aa3c-c13ee3aded72 req-3470a2b4-ed43-4377-87d3-0e9bfa2b28b7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:58.645024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a0dd2cb5-043b-4042-b797-2f6ef69a3810 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Getting quotas for project 7f948ec6a5b043ed8ea6bac997a4c2c4. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:13:58.664035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a0dd2cb5-043b-4042-b797-2f6ef69a3810 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Getting quotas for user e283b8db0cfc47acac0ca482a69005d6 and project 7f948ec6a5b043ed8ea6bac997a4c2c4. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:13:58.670275 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b5d82e60-7e4b-4983-aa3c-c13ee3aded72 req-3470a2b4-ed43-4377-87d3-0e9bfa2b28b7 service nova] Creating event network-changed:b6cfa9c4-f3d4-44ad-9452-ff9132f91d88 for instance 2d3795c0-0449-4603-ba12-b2033292af1f on n-h1-854119-9 Aug 29 05:13:58.679809 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b5d82e60-7e4b-4983-aa3c-c13ee3aded72 req-3470a2b4-ed43-4377-87d3-0e9bfa2b28b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108377 Aug 29 05:13:58.680480 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2402/4813] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:13:58.698225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:58.699267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:58.715483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:58.716415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:58.717035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:58.717926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:58.718544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:58.721681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:58.746984 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0dd2cb5-043b-4042-b797-2f6ef69a3810 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.161236 Aug 29 05:13:58.747890 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2412/4814] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 05:13:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 05:13:59.282884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:59.283852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:59.301164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:59.302082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:59.302744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:59.303711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:59.304538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:59.305174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:59.314322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:59.335529 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bbef7238-f39f-4e4b-b5bf-1424c862c4da tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.641645 Aug 29 05:13:59.337166 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2403/4815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:58 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:13:59.362173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:59.363085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:59.377391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:59.378270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:59.378939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:59.379950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:59.380705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:59.381357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:59.461751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:59.475371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:59.480618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:59.489199 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-813d464e-7fe5-4dab-879e-f1c5b8b4c515 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.210275 Aug 29 05:13:59.490202 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2413/4816] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:59 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:13:59.558997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:59.559606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:59.570041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:59.570555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:59.570992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:59.571704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:59.576593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:59.577344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:59.607794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:13:59.882830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:13:59.894833 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6255eefb-e6c2-4b7f-8435-8021ec9d41a1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.536432 Aug 29 05:13:59.899214 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2404/4817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:59 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:13:59.935163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:13:59.936076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:13:59.943003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:59.944068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:59.945109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:13:59.946071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:13:59.946955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:13:59.947611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:00.017287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:00.029445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:00.030883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:00.032029 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba384f24-81b5-4790-81cf-9e8e246dec00 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1358 microversion: 2.21 time: 0.477059 Aug 29 05:14:00.051537 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2414/4818] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:13:59 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1358 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:00.313036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:00.327277 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23e9c1d4-c00c-45ee-97fa-d79d8a419676 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.398458 Aug 29 05:14:00.327958 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2405/4819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:13:59 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:00.347516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-380f52f3-1d18-4058-81d8-42c15f9dced4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:00.355705 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-380f52f3-1d18-4058-81d8-42c15f9dced4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance cee103fc-0acf-4991-b5a1-3f359e539a9b has no mapping to a cell. Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-380f52f3-1d18-4058-81d8-42c15f9dced4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/cee103fc-0acf-4991-b5a1-3f359e539a9b/action HTTP/1.1 Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 15 Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: {"os-stop": {}} Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance cee103fc-0acf-4991-b5a1-3f359e539a9b has no mapping to a cell. Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'cee103fc-0acf-4991-b5a1-3f359e539a9b', 'body': {'os-stop': {}}} Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance cee103fc-0acf-4991-b5a1-3f359e539a9b has no mapping to a cell. Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:00.363853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee103fc-0acf-4991-b5a1-3f359e539a9b has no mapping to a cell. Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee103fc-0acf-4991-b5a1-3f359e539a9b has no mapping to a cell. Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:00.369310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-380f52f3-1d18-4058-81d8-42c15f9dced4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance cee103fc-0acf-4991-b5a1-3f359e539a9b has no mapping to a cell. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:00.370342 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-380f52f3-1d18-4058-81d8-42c15f9dced4 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/cee103fc-0acf-4991-b5a1-3f359e539a9b/action" status: 404 len: 117 microversion: 2.1 time: 0.026001 Aug 29 05:14:00.374186 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2415/4820] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:00 2022] POST /compute/v2.1/servers/cee103fc-0acf-4991-b5a1-3f359e539a9b/action => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:14:00.379925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:00.380558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:00.387515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:00.388811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:00.389446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:00.390961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:00.392360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:00.393137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:00.516702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:00.517825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:00.541214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:00.541992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:00.542629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:00.543636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:00.544270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:00.545482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:00.647489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:00.747883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:00.756111 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b08d69b5-805c-43e1-bd7d-d2258d484e1a tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.380404 Aug 29 05:14:00.768770 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2406/4821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:00 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:00.780018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:00.780872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:00.787354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:00.788107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:00.788737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:00.789632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:00.790380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:00.790957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:00.814352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:00.862332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:00.866519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:00.869359 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-321f7b1f-69cf-4f5c-bca9-ab19383bffd0 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.357835 Aug 29 05:14:00.872882 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2416/4822] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:00 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:01.061709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:01.063854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:01.082920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.087459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.087965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.094275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.096967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.097446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.111751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:01.123886 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-438e7a36-5010-40b2-8002-0c61a43acfde tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.349188 Aug 29 05:14:01.139944 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2407/4823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:00 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:01.145780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10ee5083-0714-4b2a-aaf4-b3d8fec6e68b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:01.146464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-10ee5083-0714-4b2a-aaf4-b3d8fec6e68b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: e53ca69e-29bb-40c7-895b-bba8d68cbdc0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:01.152453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-10ee5083-0714-4b2a-aaf4-b3d8fec6e68b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance e53ca69e-29bb-40c7-895b-bba8d68cbdc0 could not be found. Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10ee5083-0714-4b2a-aaf4-b3d8fec6e68b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/e53ca69e-29bb-40c7-895b-bba8d68cbdc0/action HTTP/1.1 Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 15 Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: {"suspend": {}} Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance e53ca69e-29bb-40c7-895b-bba8d68cbdc0 could not be found. Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'e53ca69e-29bb-40c7-895b-bba8d68cbdc0', 'body': {'suspend': {}}} Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e53ca69e-29bb-40c7-895b-bba8d68cbdc0 could not be found. Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e53ca69e-29bb-40c7-895b-bba8d68cbdc0 could not be found. Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:01.154491 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:01.158736 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:01.158736 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:01.158736 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e53ca69e-29bb-40c7-895b-bba8d68cbdc0 could not be found. Aug 29 05:14:01.158736 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:01.163082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-10ee5083-0714-4b2a-aaf4-b3d8fec6e68b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance e53ca69e-29bb-40c7-895b-bba8d68cbdc0 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:01.164269 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-10ee5083-0714-4b2a-aaf4-b3d8fec6e68b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/e53ca69e-29bb-40c7-895b-bba8d68cbdc0/action" status: 404 len: 111 microversion: 2.1 time: 0.023108 Aug 29 05:14:01.168698 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2408/4824] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:01 2022] POST /compute/v2.1/servers/e53ca69e-29bb-40c7-895b-bba8d68cbdc0/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:14:01.174621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:01.175844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:01.183688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.184625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.185401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.186350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.187015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.187656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.410895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:01.422758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:01.432160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:01.432160 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18cfe3c1-285e-417b-a34c-f6ad96fa738c tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1358 microversion: 2.21 time: 0.370918 Aug 29 05:14:01.434787 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2417/4825] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:01 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1358 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:01.529962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:01.541762 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-88b998e2-8a3b-40f1-8281-38767cf5434c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.371633 Aug 29 05:14:01.545132 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2409/4826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:01 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:01.573727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:01.576907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:01.589038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.591093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.592633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.597680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.598521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.599185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.636720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:01.785462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76ee6e35-f97d-41cb-92c6-14a604e88688 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'create', calling method: .version_select at 0x7f1ab87063a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1033213198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKW5v4au6+Dm/zub3PSlSKFNPdA25PhUMC6yct7PDA8mw7ekXOzHZEWBT8Xk94urvGTjFi8SR0VqDNt50Rj2GlUI5bF0nNk5dk6itFGHonIhnerpdIAEblb8Zf/MMwjOQ=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:01.826928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-76ee6e35-f97d-41cb-92c6-14a604e88688 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:14:01.842496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-76ee6e35-f97d-41cb-92c6-14a604e88688 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for user 6bcb6393cb0a4e6a857d0d5e960eba01 and project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:14:01.872976 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76ee6e35-f97d-41cb-92c6-14a604e88688 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.436677 Aug 29 05:14:01.873684 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2418/4827] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:14:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:01.880963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:01.890855 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-698e3384-5296-48d0-a89b-0cd17399ebd7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.321358 Aug 29 05:14:01.891855 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2410/4828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:01 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:01.913017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:01.914101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:01.922866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.923174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:01.923807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:01.926134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.926891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.927918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.931040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.931554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.933189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.933682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.934109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.934809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:01.935331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:01.935923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:01.986133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lazy-loading 'flavor' on Instance uuid 7c83cae9-ef18-4723-9742-bb5e40f1b115 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:14:02.073064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:02.099580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:02.105141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:02.110508 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1296a548-4642-4062-84c4-ef9ef0f9c8fd tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.198700 Aug 29 05:14:02.112796 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2419/4829] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:01 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:02.145997 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16ce2e3c-e159-4773-ad11-3b8fb21ce96d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 202 len: 0 microversion: 2.1 time: 0.236770 Aug 29 05:14:02.146941 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2411/4830] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:01 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:14:02.158645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:02.159289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:02.170281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:02.174485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:02.177243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:02.178509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:02.179176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:02.185695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:02.268869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4317a5ae-d8cf-4f49-99d5-6874bfbb5feb req-ba9db861-292d-45c2-a615-e0ac722b6649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "name": "network-vif-plugged", "status": "completed", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:02.298142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4317a5ae-d8cf-4f49-99d5-6874bfbb5feb req-ba9db861-292d-45c2-a615-e0ac722b6649 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:02.299724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4317a5ae-d8cf-4f49-99d5-6874bfbb5feb req-ba9db861-292d-45c2-a615-e0ac722b6649 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:02.302662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4317a5ae-d8cf-4f49-99d5-6874bfbb5feb req-ba9db861-292d-45c2-a615-e0ac722b6649 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:02.339867 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4317a5ae-d8cf-4f49-99d5-6874bfbb5feb req-ba9db861-292d-45c2-a615-e0ac722b6649 service nova] Creating event network-vif-plugged:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:14:02.349101 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4317a5ae-d8cf-4f49-99d5-6874bfbb5feb req-ba9db861-292d-45c2-a615-e0ac722b6649 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084476 Aug 29 05:14:02.352376 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2412/4831] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:14:02.456862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:02.457897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:02.470380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:02.471047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:02.471752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:02.472688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:02.477242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:02.477994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:02.708789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:02.726320 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-93ef2be9-c13f-40a1-8dbb-2dae3fae266b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1514 microversion: 2.1 time: 0.573776 Aug 29 05:14:02.744151 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2420/4832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:02 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1514 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:02.923745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:02.954129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:02.955562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:02.959961 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3a9e181-dd7d-4913-b112-3bcbe7b21f42 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1358 microversion: 2.21 time: 0.508305 Aug 29 05:14:02.960575 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2413/4833] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:02 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1358 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:14:03.135775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:03.136501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:03.148446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:03.149143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:03.149791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:03.150747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:03.151445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:03.153489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:03.358355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:03.382799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:03.387901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:03.392031 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-360ec7e2-ba3f-410c-b2b8-8e82b794c66b tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.260147 Aug 29 05:14:03.393825 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2421/4834] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:03 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:03.512281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-156381925", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cf872f9-411d-4b12-a18e-aa8246afb4db"}], "security_groups": [{"name": "tempest-securitygroup--866209039"}], "key_name": "tempest-keypair-2105982994", "user_data": "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:03.756654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:03.757289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:03.766011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:03.767828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:03.768467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:03.769477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:03.770191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:03.771065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:04.285150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] validate_networks() for [('5cf872f9-411d-4b12-a18e-aa8246afb4db', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:14:04.453078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:04.473797 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a93e2188-1af3-4a51-bf93-9b07843150ae tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1497 microversion: 2.1 time: 0.714853 Aug 29 05:14:04.493763 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2422/4835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:03 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1497 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:04.508653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:04.512371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:04.533698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:04.541189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:04.541625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:04.543472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:04.543953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:04.544448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:05.122535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:05.140966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:05.146765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:05.149803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-92c9ee5f-4ddf-4cbd-8088-f20236e61679 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1358 microversion: 2.21 time: 0.654053 Aug 29 05:14:05.151869 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2423/4836] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:04 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1358 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:05.162018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:05.164337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:05.183258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:05.189538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:05.190565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:05.191443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:05.194816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:05.195709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:05.797680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:05.814297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:05.824930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:05.830539 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e80b0b36-0855-4f53-b163-6891bee88b64 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.677270 Aug 29 05:14:05.849208 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2424/4837] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:05 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:05.856081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:05.856991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:05.867068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:05.867992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:05.868721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:05.870074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:05.870781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:05.871440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:05.908594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lazy-loading 'flavor' on Instance uuid 7c83cae9-ef18-4723-9742-bb5e40f1b115 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:14:05.931781 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Cannot 'suspend' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state suspended Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action HTTP/1.1 Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 15 Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: {"suspend": {}} Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot 'suspend' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state suspended Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115', 'body': {'suspend': {}}} Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 29 05:14:05.933478 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state suspended Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state suspended Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 409 to user: Cannot 'suspend' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state suspended {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:05.937562 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2ad74195-2465-40ee-becd-c02f2bb4e3d2 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 409 len: 148 microversion: 2.1 time: 0.084103 Aug 29 05:14:05.943630 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2425/4838] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:05 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 148 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:14:05.948641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f4e22224-b316-44fb-8775-e36953d02c42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:05.949168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f4e22224-b316-44fb-8775-e36953d02c42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:05.969811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e22224-b316-44fb-8775-e36953d02c42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:05.970324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e22224-b316-44fb-8775-e36953d02c42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:05.970761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e22224-b316-44fb-8775-e36953d02c42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:05.971477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e22224-b316-44fb-8775-e36953d02c42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:05.972001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e22224-b316-44fb-8775-e36953d02c42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:05.972516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4e22224-b316-44fb-8775-e36953d02c42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:06.127222 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f4e22224-b316-44fb-8775-e36953d02c42 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 202 len: 0 microversion: 2.1 time: 0.182238 Aug 29 05:14:06.128245 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2426/4839] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:05 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:14:06.142044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:06.144989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:06.164076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:06.165071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:06.166270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:06.171673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:06.172476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:06.173134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:06.590450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:14:06.593219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:14:06.594376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:14:06.601511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:14:06.603191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:14:06.640651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:06.644740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:06.645400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:06.646390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:06.647043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:06.648648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:06.707998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:06.711211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Getting quotas for project 7f948ec6a5b043ed8ea6bac997a4c2c4. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:14:06.719054 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f55f5f58-bdac-4fc5-9cff-0c9329897673 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1503 microversion: 2.1 time: 0.582412 Aug 29 05:14:06.722150 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2427/4840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:06 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1503 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:06.735321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Getting quotas for user e283b8db0cfc47acac0ca482a69005d6 and project 7f948ec6a5b043ed8ea6bac997a4c2c4. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:14:06.740623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:06.741244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:06.759365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:06.768967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:06.769490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:06.774124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:06.774680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:06.775299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:06.777790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:14:06.782920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:14:06.933664 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ecf8c6f8-88be-4463-b2f3-8bed6d5141fd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.425951 Aug 29 05:14:06.935629 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2414/4841] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 05:14:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 3429 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 05:14:06.945669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ef81ede0-b4ae-440f-bf8a-f41f678768e1 req-69937255-0b8c-4954-be50-a21d845e364f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3795c0-0449-4603-ba12-b2033292af1f", "name": "network-vif-plugged", "status": "completed", "tag": "b6cfa9c4-f3d4-44ad-9452-ff9132f91d88"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:06.983457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ef81ede0-b4ae-440f-bf8a-f41f678768e1 req-69937255-0b8c-4954-be50-a21d845e364f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:06.984460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ef81ede0-b4ae-440f-bf8a-f41f678768e1 req-69937255-0b8c-4954-be50-a21d845e364f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:06.986163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ef81ede0-b4ae-440f-bf8a-f41f678768e1 req-69937255-0b8c-4954-be50-a21d845e364f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:07.039425 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ef81ede0-b4ae-440f-bf8a-f41f678768e1 req-69937255-0b8c-4954-be50-a21d845e364f service nova] Creating event network-vif-plugged:b6cfa9c4-f3d4-44ad-9452-ff9132f91d88 for instance 2d3795c0-0449-4603-ba12-b2033292af1f on n-h1-854119-9 Aug 29 05:14:07.052826 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ef81ede0-b4ae-440f-bf8a-f41f678768e1 req-69937255-0b8c-4954-be50-a21d845e364f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113577 Aug 29 05:14:07.060759 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2415/4842] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:07.085830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:07.086563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:07.104282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:07.104701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:07.107740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:07.110481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:07.111128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:07.112851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:07.125321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:07.620227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:07.656145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:07.672515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:07.673815 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a3bd6b4b-184f-4d71-8c52-88f01f97e0f5 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.606191 Aug 29 05:14:07.677092 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2416/4843] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:07 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:07.690348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6c1568f-df23-4296-b2b4-3b32542681c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:07.700511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6c1568f-df23-4296-b2b4-3b32542681c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:07.980522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6c1568f-df23-4296-b2b4-3b32542681c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:07.995295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6c1568f-df23-4296-b2b4-3b32542681c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:08.002934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6c1568f-df23-4296-b2b4-3b32542681c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:08.008237 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6c1568f-df23-4296-b2b4-3b32542681c4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1281 microversion: 2.20 time: 0.328025 Aug 29 05:14:08.011065 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2417/4844] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:07 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1281 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:08.022602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:08.030284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:08.039722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:08.040667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:08.041317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:08.044836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:08.045590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:08.046310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:08.343356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:08.355315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:08.359551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:08.359551 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c46beff0-027c-406c-9078-76cb4326d00b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1358 microversion: 2.21 time: 1.636324 Aug 29 05:14:08.364913 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2428/4845] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:06 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1358 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:08.421706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:08.436755 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-525f822d-d595-4e7c-beab-db4332d81cf6 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1503 microversion: 2.1 time: 0.419472 Aug 29 05:14:08.437924 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2418/4846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:08 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:08.724646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:08.727751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:08.752559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:08.753621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:08.754495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:08.759169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:08.760633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:08.762216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:09.037500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:09.038194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:09.053251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:09.058676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:09.059377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:09.063472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:09.064276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:09.064914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:09.146184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:09.169089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:09.172885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:09.182269 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2f73ebf-b081-44ec-b63b-72795bca6b1f tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.481446 Aug 29 05:14:09.191591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2429/4847] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:08 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:09.291471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:09.304013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:09.311320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:09.312827 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2f95d66-311f-44be-a8b8-e79c06747024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1277 microversion: 2.20 time: 0.280180 Aug 29 05:14:09.318007 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2419/4848] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:09 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:09.387068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:09.387537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:09.410721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:09.413219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:09.415620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:09.419649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:09.424270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:09.425710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:09.462544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:09.463190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:09.471504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:09.472012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:09.472485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:09.473290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:09.473784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:09.474207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:09.921943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:09.933668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:09.939819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:09.949554 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-991f13cc-64c7-4434-931d-10d93b7b5da2 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1551 microversion: 2.21 time: 0.567350 Aug 29 05:14:09.951317 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2430/4849] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:09 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1551 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:09.977554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:09.978548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:09.984996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:09.986811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:09.987830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:10.005797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:10.006493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:10.007981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:10.073150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:14:10.175615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:10.313461 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c6a48350-2511-4df3-84b8-ed444ed9f42f tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 204 len: 0 microversion: 2.21 time: 0.341443 Aug 29 05:14:10.314651 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2431/4850] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:14:09 2022] DELETE /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:14:10.320462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:10.324064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:10.338610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:10.338889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:10.342738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:10.343432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:10.344434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:10.346293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:10.346908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:10.353629 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44a4f993-c6a0-445b-8293-1b9178165b20 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1503 microversion: 2.1 time: 0.898412 Aug 29 05:14:10.354245 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2420/4851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:09 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1503 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:10.359301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:10.373115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:10.393363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:10.393897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:10.394352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:10.395178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:10.395655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:10.396086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:10.808677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:10.823788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:10.829164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:10.833069 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4f43406-2b2c-47bf-9c81-5777256d2e72 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1557 microversion: 2.21 time: 0.477595 Aug 29 05:14:10.836631 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2421/4852] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:10 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1557 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:10.839458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:10.843755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:10.848029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:10.855602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:10.857653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:10.860048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-043b65fc-1b49-4937-b1fe-4eeffd363924 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.544044 Aug 29 05:14:10.868403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:10.869085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:10.869684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:10.870564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:10.871370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:10.874308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:10.883543 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2432/4853] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:10 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:11.014817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:11.032218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:11.044100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:11.045615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef527567-8641-4b62-b95d-9d0facb96edc tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1351 microversion: 2.20 time: 0.207851 Aug 29 05:14:11.046390 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2422/4854] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:10 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:11.386640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:11.386640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:11.389419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:11.389935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:11.390381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:11.391261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:11.391724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:11.392185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:11.851385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=16 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:11.862425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:11.863805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:11.877138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:11.883162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:11.886894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:11.887736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:11.892590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:11.896885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:12.041295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:12.066580 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b600498b-eb66-4f64-8702-aff7f5e10560 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.693711 Aug 29 05:14:12.071402 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2433/4855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:11 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:12.122516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:12.125289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:12.144151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:12.148988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:12.149612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:12.150568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:12.151099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:12.151497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:12.784109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:12.800608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:12.802184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '657822daf4f044319d5d6440e501cde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297d3fab7a624f05a703f620d94bad83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:12.812157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-60c60fe8-d427-4383-8e37-0b28543a2ffc tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 200 len: 1603 microversion: 2.42 time: 0.715812 Aug 29 05:14:12.812833 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2434/4856] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:12 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 1603 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:12.817722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:12.818335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:12.853711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:12.854377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:12.854630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:12.868862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:12.876780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:12.877610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:12.880442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:12.890015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:12.892338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:12.896370 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a4cf3bf-45c1-489c-abe3-4424df6af749 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1557 microversion: 2.21 time: 1.038002 Aug 29 05:14:12.902541 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2423/4857] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:11 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1557 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:14:12.909193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:12.932159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:12.951668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:12.952529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:12.953155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:12.955765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:12.956482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:12.960642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:13.208893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:13.223005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:13.224505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:13.237326 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-30dd4804-1e12-4f7d-b960-0697ecce9773 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1339 microversion: 2.20 time: 0.423319 Aug 29 05:14:13.242746 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2435/4858] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:12 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1339 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:13.278989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:13.296047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:13.307641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:13.323783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:13.324313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:13.324751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:13.325517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:13.326221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:13.326647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:13.585431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lazy-loading 'services' on Instance uuid 20361c4d-b9ef-4ec6-b95c-fb009c452212 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:14:13.731789 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4c1288b2-1eb0-4084-ae96-e595add3bfaf tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212/os-volume_attachments/41f7fd8d-764c-4fc0-8103-ec050ad91b7e" status: 202 len: 0 microversion: 2.1 time: 0.475754 Aug 29 05:14:13.732853 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2436/4859] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:14:13 2022] DELETE /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212/os-volume_attachments/41f7fd8d-764c-4fc0-8103-ec050ad91b7e => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:14:13.839866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:13.840900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:13.858673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:13.861971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:13.862872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:13.864793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:13.868607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:13.869250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:13.870343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:13.882399 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8b5ba60b-7e85-4c4d-a9ba-ebabca6700d3 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.976837 Aug 29 05:14:13.883043 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2424/4860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:12 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:13.903541 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] HTTP exception thrown: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Request method failure captured: Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 HTTP/1.1 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDElypPl-cIke_gd8_ewNJZpki5_HdPakgNWRXyZBYLK5GedJyaQJniZoXZpJsXcEBlms8e35dSNhCYlJK6Oom0xveIEgSoU5vbDpzI3hVpbcKx6ZF2KmGZ_CHjVHHt4KCjJl7fjkTuh1zB3uUm_lp4gTkv-tpEIjTx2mN6FZUaA5INo Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 297d3fab7a624f05a703f620d94bad83 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-420175854 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297d3fab7a624f05a703f620d94bad83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/297d3fab7a624f05a703f620d94bad83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_297d3fab7a624f05a703f620d94bad83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297d3fab7a624f05a703f620d94bad83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TaggedBootDevicesTest_v242-420175854 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 297d3fab7a624f05a703f620d94bad83 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-420175854 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TaggedBootDevicesTest_v242-420175854-project Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 657822daf4f044319d5d6440e501cde6 Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TaggedBootDevicesTest_v242-420175854-project Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '17e8bee1-1cc6-4712-8c4a-ab079f4f1705'} Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.908492 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:13.912987 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.912987 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:13.912987 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:13.912987 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:13.912987 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:13.912987 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:13.912987 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:13.912987 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.921846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Returning 404 to user: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:13.924644 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e8509fe2-c9f7-4cba-9d0d-d748ccb1a2b9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 404 len: 111 microversion: 2.42 time: 0.087744 Aug 29 05:14:13.925087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f6b7809-57e2-4fa8-a708-b0d72d45c5d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:13.925807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f6b7809-57e2-4fa8-a708-b0d72d45c5d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 48fb5bab-c48c-400d-ad4a-fedac5e49827] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:13.925945 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2437/4861] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:13 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 05:14:13.940208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:13.940535 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-4f6b7809-57e2-4fa8-a708-b0d72d45c5d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 48fb5bab-c48c-400d-ad4a-fedac5e49827 could not be found. Aug 29 05:14:13.942343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f6b7809-57e2-4fa8-a708-b0d72d45c5d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/48fb5bab-c48c-400d-ad4a-fedac5e49827/action HTTP/1.1 Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 15 Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: {"unpause": {}} Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 48fb5bab-c48c-400d-ad4a-fedac5e49827 could not be found. Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '48fb5bab-c48c-400d-ad4a-fedac5e49827', 'body': {'unpause': {}}} Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48fb5bab-c48c-400d-ad4a-fedac5e49827 could not be found. Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48fb5bab-c48c-400d-ad4a-fedac5e49827 could not be found. Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:13.945119 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:13.949799 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:13.949799 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:13.949799 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48fb5bab-c48c-400d-ad4a-fedac5e49827 could not be found. Aug 29 05:14:13.949799 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:13.954705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f6b7809-57e2-4fa8-a708-b0d72d45c5d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 48fb5bab-c48c-400d-ad4a-fedac5e49827 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:13.959625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:13.968436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:13.969045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:13.969174 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f6b7809-57e2-4fa8-a708-b0d72d45c5d7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/48fb5bab-c48c-400d-ad4a-fedac5e49827/action" status: 404 len: 111 microversion: 2.1 time: 0.060378 Aug 29 05:14:13.969911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:13.970198 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2425/4862] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:13 2022] POST /compute/v2.1/servers/48fb5bab-c48c-400d-ad4a-fedac5e49827/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:14:13.970881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:13.971380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:13.977803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8cc90099-9445-4912-909e-18d88f79ce29 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '.version_select at 0x7f1ab97e4790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:14.037216 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8cc90099-9445-4912-909e-18d88f79ce29 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615073839" status: 204 len: 0 microversion: 2.42 time: 0.065307 Aug 29 05:14:14.038490 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2426/4863] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Aug 29 05:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615073839 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:14:14.043914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:14.046574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:14.061942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:14.062845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:14.063395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:14.066357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:14.068488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:14.069070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:14.356220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:14.369555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:14.371347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:14.377353 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e5494ca2-7764-45f7-96e6-a5977c35e0bc tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1515 microversion: 2.21 time: 0.448743 Aug 29 05:14:14.378209 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2438/4864] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:13 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1515 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:14.404660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:14.405873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:14.438601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:14.443545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:14.445568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:14.446613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:14.449053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:14.454383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:16.034795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:16.070050 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1eaaec5e-18aa-4611-8fd2-2eaa0ec74d9c tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 2.030235 Aug 29 05:14:16.081049 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2427/4865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:14 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:16.120815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:16.128006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:16.165202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:16.165719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:16.166166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:16.180299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:16.180973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:16.182609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:16.270748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:16.271584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:16.272220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:16.272871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lazy-loading 'fault' on Instance uuid 2d3795c0-0449-4603-ba12-b2033292af1f {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:14:16.685793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:17.116288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:17.128602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:17.132223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd7256c6cd9c45c4990452de893dc12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d5831ce444852af1574dcc1dbf942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:17.134577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:17.136295 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b48ea14a-7838-478b-940c-7a7faba6e318 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 200 len: 1348 microversion: 2.21 time: 1.051867 Aug 29 05:14:17.136901 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2428/4866] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:16 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 1348 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:17.153244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:17.155089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:17.156792 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5bdcbff-a662-4bcf-8453-59bdbb65e69d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 2.762223 Aug 29 05:14:17.158378 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2439/4867] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:14 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 2764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:17.171536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:17.172588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:17.185899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6b325fb7-a9e1-4bf7-95be-8ecd274e71fa req-ec2a2d51-6f45-449e-92bc-0bf81506b80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3795c0-0449-4603-ba12-b2033292af1f", "name": "network-vif-deleted", "tag": "b6cfa9c4-f3d4-44ad-9452-ff9132f91d88"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:17.191111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:17.191943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:17.192605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:17.193522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:17.194148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:17.194761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:17.198307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6b325fb7-a9e1-4bf7-95be-8ecd274e71fa req-ec2a2d51-6f45-449e-92bc-0bf81506b80c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:17.199093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6b325fb7-a9e1-4bf7-95be-8ecd274e71fa req-ec2a2d51-6f45-449e-92bc-0bf81506b80c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:17.199751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6b325fb7-a9e1-4bf7-95be-8ecd274e71fa req-ec2a2d51-6f45-449e-92bc-0bf81506b80c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:17.215951 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6b325fb7-a9e1-4bf7-95be-8ecd274e71fa req-ec2a2d51-6f45-449e-92bc-0bf81506b80c service nova] Creating event network-vif-deleted:b6cfa9c4-f3d4-44ad-9452-ff9132f91d88 for instance 2d3795c0-0449-4603-ba12-b2033292af1f on n-h1-854119-9 Aug 29 05:14:17.223950 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6b325fb7-a9e1-4bf7-95be-8ecd274e71fa req-ec2a2d51-6f45-449e-92bc-0bf81506b80c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043738 Aug 29 05:14:17.225950 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2429/4868] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:18.161885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:18.163271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:18.171472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:18.190177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:18.192613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:18.193129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:18.193891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:18.194362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:18.197286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:18.236875 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] HTTP exception thrown: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Request method failure captured: Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f HTTP/1.1 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEsLY2ZUT0Ydql7lxsaHqoUdgjBpEb-kXEF0X11RogFbBjj6BbtCXAlP7q1kAZ6DjlovuBlDk60lyQlS2tZwTPFZHRmWTzQxQEJxmqEUdw6Y9caBInNQcLy_aieyDCzKIjCbH0eVANzxZDku7sWs5H0l8aaQx2twA-bCVdLqps5N8RM Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 3a5d5831ce444852af1574dcc1dbf942 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1069526412 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a5d5831ce444852af1574dcc1dbf942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a5d5831ce444852af1574dcc1dbf942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a5d5831ce444852af1574dcc1dbf942", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a5d5831ce444852af1574dcc1dbf942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-InstanceActionsV221TestJSON-1069526412 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 3a5d5831ce444852af1574dcc1dbf942 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1069526412 Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-InstanceActionsV221TestJSON-1069526412-project Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: cd7256c6cd9c45c4990452de893dc12d Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-InstanceActionsV221TestJSON-1069526412-project Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '2d3795c0-0449-4603-ba12-b2033292af1f'} Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:18.239281 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:18.244617 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:18.244617 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:18.244617 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:18.244617 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:18.244617 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:18.244617 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:18.244617 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:18.244617 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:18.249492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Returning 404 to user: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:18.250638 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fbb5abe8-ead4-4987-8250-08bd454ab19b tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 404 len: 111 microversion: 2.21 time: 0.095206 Aug 29 05:14:18.256532 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2430/4869] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:18 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:14:18.273349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:18.275768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:18.289630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:18.293633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:18.294673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:18.295613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:18.297168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:18.300140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:18.968712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:18.986020 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5b8c13c4-1106-4a82-a36f-2750f9d345ca tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 1.826277 Aug 29 05:14:18.986897 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2440/4870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:17 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:19.001779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b160ba32-f3c4-45dd-88fe-5541820e2b94 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '.version_select at 0x7f1ab3fd0430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:19.006384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b160ba32-f3c4-45dd-88fe-5541820e2b94 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:19.026375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b160ba32-f3c4-45dd-88fe-5541820e2b94 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.030348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b160ba32-f3c4-45dd-88fe-5541820e2b94 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.036812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b160ba32-f3c4-45dd-88fe-5541820e2b94 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.037935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b160ba32-f3c4-45dd-88fe-5541820e2b94 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.038764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b160ba32-f3c4-45dd-88fe-5541820e2b94 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.039394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b160ba32-f3c4-45dd-88fe-5541820e2b94 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.255223 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b160ba32-f3c4-45dd-88fe-5541820e2b94 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.267021 Aug 29 05:14:19.267839 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2441/4871] 10.222.0.20 () {60 vars in 1337 bytes} [Mon Aug 29 05:14:18 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f/os-instance-actions => generated 611 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:14:19.280774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:19.282010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:19.299101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.300924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.303333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.305149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.305618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.306048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.376409 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Cannot 'unpause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action HTTP/1.1 Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 15 Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: {"unpause": {}} Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot 'unpause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115', 'body': {'unpause': {}}} Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 in vm_state active. Cannot unpause while the instance is in this state. Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:19.383286 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:19.388476 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:19.388476 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:19.388476 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:19.388476 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:14:19.388476 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.392415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 409 to user: Cannot 'unpause' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:19.393549 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b66122fa-a3c4-42b4-b3cc-423cfbb82722 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 409 len: 145 microversion: 2.1 time: 0.124309 Aug 29 05:14:19.394308 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2442/4872] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:19 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 145 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:14:19.406781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:19.407566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:19.422812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.427715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:19.436928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:19.437463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.438108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.448178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.451005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.451660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.452304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:19.458322 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e9e1d7a2-ba9c-406f-b00e-ce5a78b502f3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 1.198395 Aug 29 05:14:19.470771 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2431/4873] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:18 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:19.488495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:19.488649 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] HTTP exception thrown: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Request method failure captured: Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f HTTP/1.1 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEsLY2ZUT0Ydql7lxsaHqoUdgjBpEb-kXEF0X11RogFbBjj6BbtCXAlP7q1kAZ6DjlovuBlDk60lyQlS2tZwTPFZHRmWTzQxQEJxmqEUdw6Y9caBInNQcLy_aieyDCzKIjCbH0eVANzxZDku7sWs5H0l8aaQx2twA-bCVdLqps5N8RM Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3a5d5831ce444852af1574dcc1dbf942 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1069526412 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a5d5831ce444852af1574dcc1dbf942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a5d5831ce444852af1574dcc1dbf942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a5d5831ce444852af1574dcc1dbf942", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a5d5831ce444852af1574dcc1dbf942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-InstanceActionsV221TestJSON-1069526412 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3a5d5831ce444852af1574dcc1dbf942 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1069526412 Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-InstanceActionsV221TestJSON-1069526412-project Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: cd7256c6cd9c45c4990452de893dc12d Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-InstanceActionsV221TestJSON-1069526412-project Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '2d3795c0-0449-4603-ba12-b2033292af1f'} Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:19.491041 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.496046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.497796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Returning 404 to user: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:19.498818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1dd518b0-fd42-4a28-aa12-788e23f921d7 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 404 len: 111 microversion: 2.21 time: 0.101877 Aug 29 05:14:19.499657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:19.502479 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2443/4874] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:14:19 2022] DELETE /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:14:19.516917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.525481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.526085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.526935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.527649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.528090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:19.528839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.530051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] [instance: 2d3795c0-0449-4603-ba12-b2033292af1f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:19.540459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.541216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.541818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.542722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:19.543329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:19.543914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:19.560508 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] HTTP exception thrown: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Request method failure captured: Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f HTTP/1.1 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEsLY2ZUT0Ydql7lxsaHqoUdgjBpEb-kXEF0X11RogFbBjj6BbtCXAlP7q1kAZ6DjlovuBlDk60lyQlS2tZwTPFZHRmWTzQxQEJxmqEUdw6Y9caBInNQcLy_aieyDCzKIjCbH0eVANzxZDku7sWs5H0l8aaQx2twA-bCVdLqps5N8RM Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3a5d5831ce444852af1574dcc1dbf942 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1069526412 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a5d5831ce444852af1574dcc1dbf942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a5d5831ce444852af1574dcc1dbf942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a5d5831ce444852af1574dcc1dbf942", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a5d5831ce444852af1574dcc1dbf942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-InstanceActionsV221TestJSON-1069526412 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3a5d5831ce444852af1574dcc1dbf942 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1069526412 Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-InstanceActionsV221TestJSON-1069526412-project Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: cd7256c6cd9c45c4990452de893dc12d Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-InstanceActionsV221TestJSON-1069526412-project Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '2d3795c0-0449-4603-ba12-b2033292af1f'} Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.562541 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:19.567418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.567418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:19.567418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:19.567418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:19.567418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:19.567418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:19.567418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. Aug 29 05:14:19.567418 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:19.574808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] Returning 404 to user: Instance 2d3795c0-0449-4603-ba12-b2033292af1f could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:19.576278 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-24f19b03-3dda-4427-835a-3ab18149b155 tempest-InstanceActionsV221TestJSON-1069526412 tempest-InstanceActionsV221TestJSON-1069526412-project] 10.222.0.20 "GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f" status: 404 len: 111 microversion: 2.21 time: 0.063302 Aug 29 05:14:19.577030 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2444/4875] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:19 2022] GET /compute/v2.1/servers/2d3795c0-0449-4603-ba12-b2033292af1f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:14:20.524934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:20.528043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:20.534883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:20.561512 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-baf59bfd-5d7a-40d9-8fdc-760e35a8db69 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 1.082958 Aug 29 05:14:20.565914 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2432/4876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:19 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:20.574740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:20.575349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:20.576213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:20.581093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:20.581859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:20.582557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:20.591339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:20.593509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:20.608039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:20.608933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:20.615729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:20.622060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:20.624184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:20.624847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:21.345697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:21.360641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:21.372113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:21.381765 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa0e4bce-ee88-44ff-9847-4de0ce6dc4e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 0.892395 Aug 29 05:14:21.383080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2445/4877] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:20 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:21.578149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:21.588392 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a07e867-70ba-4b28-9028-73f801954fa8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 1.001114 Aug 29 05:14:21.600490 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2433/4878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:20 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:14:21.609563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-032197fe-f0a3-4561-9e2c-a8eb997ee567 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:21.610317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-032197fe-f0a3-4561-9e2c-a8eb997ee567 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 9a75cf56-c109-42a2-9a4b-e41a0f9de132] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:21.622193 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-032197fe-f0a3-4561-9e2c-a8eb997ee567 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 9a75cf56-c109-42a2-9a4b-e41a0f9de132 could not be found. Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-032197fe-f0a3-4561-9e2c-a8eb997ee567 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/9a75cf56-c109-42a2-9a4b-e41a0f9de132/action HTTP/1.1 Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 18 Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: {"unshelve": null} Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 9a75cf56-c109-42a2-9a4b-e41a0f9de132 could not be found. Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '9a75cf56-c109-42a2-9a4b-e41a0f9de132', 'body': {'unshelve': None}} Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a75cf56-c109-42a2-9a4b-e41a0f9de132 could not be found. Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a75cf56-c109-42a2-9a4b-e41a0f9de132 could not be found. Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:21.626236 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:21.630552 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:21.630552 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:21.630552 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:21.630552 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:21.630552 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:21.630552 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:21.630552 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a75cf56-c109-42a2-9a4b-e41a0f9de132 could not be found. Aug 29 05:14:21.630552 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:21.641343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-032197fe-f0a3-4561-9e2c-a8eb997ee567 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 9a75cf56-c109-42a2-9a4b-e41a0f9de132 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:21.642631 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-032197fe-f0a3-4561-9e2c-a8eb997ee567 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/9a75cf56-c109-42a2-9a4b-e41a0f9de132/action" status: 404 len: 111 microversion: 2.1 time: 0.037341 Aug 29 05:14:21.646050 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2446/4879] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:21 2022] POST /compute/v2.1/servers/9a75cf56-c109-42a2-9a4b-e41a0f9de132/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:14:21.654207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:21.655175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:21.662717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:21.663619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:21.664353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:21.665428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:21.666141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:21.666807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:22.406250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:22.408630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:22.435855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:22.436695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:22.437399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:22.438359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:22.441698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:22.442465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:22.494836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:22.503776 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-002fd688-b701-4e3c-aa85-79907a009a34 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.853476 Aug 29 05:14:22.510305 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2434/4880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:21 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:14:22.542315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:22.543355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:22.547397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:22.558514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:22.570883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:22.572186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:22.573216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:22.573905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:22.574562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:23.528900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:23.546871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:23.548799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:23.556004 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c39d87f-e3a1-459d-b79d-79eca3b6e56c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 1.148325 Aug 29 05:14:23.557381 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2447/4881] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:22 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:14:23.580274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:23.590133 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d2b6915f-96c1-496a-a420-9ca130fe5f17 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 1.053687 Aug 29 05:14:23.596755 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2435/4882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:22 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:23.619052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:23.620004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:23.627478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:23.628074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:23.628655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:23.629465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:23.629986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:23.630488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:23.707308 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Cannot 'unshelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action HTTP/1.1 Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 18 Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: {"unshelve": null} Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot 'unshelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115', 'body': {'unshelve': None}} Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 in vm_state active. Cannot unshelve while the instance is in this state. Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:14:23.709507 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active Aug 29 05:14:23.714374 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:23.721323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 409 to user: Cannot 'unshelve' instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 while it is in vm_state active {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:23.726041 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69350c73-7816-4a42-be58-47975cb2ccc1 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action" status: 409 len: 146 microversion: 2.1 time: 0.111161 Aug 29 05:14:23.732196 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2448/4883] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:23 2022] POST /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115/action => generated 146 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:14:23.738486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:23.739107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:23.746518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:23.753056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:23.754455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:23.756419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:23.763253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:23.764176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:24.243118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:24.243616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:24.277904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:24.278437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:24.278941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:24.279680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:24.280161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:24.284835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:24.343387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:14:24.408481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:24.467182 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3f0467f3-187a-4f90-a66d-fd0935eb0d55 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 204 len: 0 microversion: 2.1 time: 0.227612 Aug 29 05:14:24.468405 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2449/4884] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:14:24 2022] DELETE /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:14:24.477912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:24.479641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:24.495922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:24.498015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:24.500027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:24.500972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:24.506673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:24.507368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:24.655829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:24.664399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:24.685791 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-48da5343-f0b4-4757-97d9-fb47cc35a46f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.950800 Aug 29 05:14:24.692620 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2436/4885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:23 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:24.710756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:24.712085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:24.740471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:24.742371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:24.744384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:24.747263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:24.749038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:24.750874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:25.243170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:25.254578 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1bba0579-7dcc-498b-be5c-cfddab8507ad tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1469 microversion: 2.1 time: 0.778871 Aug 29 05:14:25.268930 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2450/4886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:24 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1469 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:25.280835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:25.284854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:25.301247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:25.302367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:25.303068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:25.304612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:25.305737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:25.308467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:25.488095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:25.501634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:25.504293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:25.507940 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4684e8f9-82e9-48bb-b2a1-0f5a2dc999ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 0.812995 Aug 29 05:14:25.512615 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2437/4887] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:24 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:25.518512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-77684b02-0ba4-4ecd-98a6-a682b4dee91a req-3b91adfb-4875-40e5-af5d-fca4ede83e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0212b868-400b-4cd4-9278-f45805cc128f", "tag": "cd6eaae0-af11-4f54-97bf-0b3ddd31b12d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:25.551228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-77684b02-0ba4-4ecd-98a6-a682b4dee91a req-3b91adfb-4875-40e5-af5d-fca4ede83e46 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:25.551708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-77684b02-0ba4-4ecd-98a6-a682b4dee91a req-3b91adfb-4875-40e5-af5d-fca4ede83e46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:25.552150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-77684b02-0ba4-4ecd-98a6-a682b4dee91a req-3b91adfb-4875-40e5-af5d-fca4ede83e46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:25.582900 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-77684b02-0ba4-4ecd-98a6-a682b4dee91a req-3b91adfb-4875-40e5-af5d-fca4ede83e46 service nova] Creating event network-changed:cd6eaae0-af11-4f54-97bf-0b3ddd31b12d for instance 0212b868-400b-4cd4-9278-f45805cc128f on n-h1-854119-9 Aug 29 05:14:25.593317 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-77684b02-0ba4-4ecd-98a6-a682b4dee91a req-3b91adfb-4875-40e5-af5d-fca4ede83e46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078396 Aug 29 05:14:25.598121 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2438/4888] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:25.998253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:26.012069 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8eb3082a-81db-45f7-8f81-da48a5f5da24 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.737064 Aug 29 05:14:26.031008 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2451/4889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:25 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:26.035030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-364022e9-248b-4db9-8661-ba9b409de20d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-732097122_updated"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:26.037577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-364022e9-248b-4db9-8661-ba9b409de20d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: ac55c353-f988-4b9c-92b3-c3e33f59e7c0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:26.082416 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-364022e9-248b-4db9-8661-ba9b409de20d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance ac55c353-f988-4b9c-92b3-c3e33f59e7c0 could not be found. Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-364022e9-248b-4db9-8661-ba9b409de20d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: request: PUT /compute/v2.1/servers/ac55c353-f988-4b9c-92b3-c3e33f59e7c0 HTTP/1.1 Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 80 Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-732097122_updated"}} Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ac55c353-f988-4b9c-92b3-c3e33f59e7c0 could not be found. Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ac55c353-f988-4b9c-92b3-c3e33f59e7c0', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-732097122_updated'}}} Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac55c353-f988-4b9c-92b3-c3e33f59e7c0 could not be found. Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 05:14:26.084313 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac55c353-f988-4b9c-92b3-c3e33f59e7c0 could not be found. Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac55c353-f988-4b9c-92b3-c3e33f59e7c0 could not be found. Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-364022e9-248b-4db9-8661-ba9b409de20d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance ac55c353-f988-4b9c-92b3-c3e33f59e7c0 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:26.090312 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-364022e9-248b-4db9-8661-ba9b409de20d tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "PUT /compute/v2.1/servers/ac55c353-f988-4b9c-92b3-c3e33f59e7c0" status: 404 len: 111 microversion: 2.1 time: 0.056120 Aug 29 05:14:26.104489 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2439/4890] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:14:26 2022] PUT /compute/v2.1/servers/ac55c353-f988-4b9c-92b3-c3e33f59e7c0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:14:26.107662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:26.108660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:26.122758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:26.128891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:26.134898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:26.139654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:26.143382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:26.145158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:26.276231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:26.277322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:26.291520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:26.294750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:26.296720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:26.299752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:26.305309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:26.306618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:27.297501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:27.310524 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f60fb8a5-3d91-4554-be24-fdd6bd6a46a4 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1469 microversion: 2.1 time: 1.039307 Aug 29 05:14:27.312916 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2440/4891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:26 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1469 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:27.324711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:27.325250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:27.347456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:27.348104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:27.348891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:27.354111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:27.354599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:27.355035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:27.495848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:27.512412 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-111b2416-3622-4145-8d00-f483cd49134e tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 1.408789 Aug 29 05:14:27.517155 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2452/4892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:26 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:14:27.537815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:27.545349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:27.561973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:27.562725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:27.564730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:27.565717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:27.568453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:27.569160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:27.603839 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] HTTP exception thrown: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Request method failure captured: Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 HTTP/1.1 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDElypPl-cIke_gd8_ewNJZpki5_HdPakgNWRXyZBYLK5GedJyaQJniZoXZpJsXcEBlms8e35dSNhCYlJK6Oom0xveIEgSoU5vbDpzI3hVpbcKx6ZF2KmGZ_CHjVHHt4KCjJl7fjkTuh1zB3uUm_lp4gTkv-tpEIjTx2mN6FZUaA5INo Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 297d3fab7a624f05a703f620d94bad83 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-420175854 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297d3fab7a624f05a703f620d94bad83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/297d3fab7a624f05a703f620d94bad83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_297d3fab7a624f05a703f620d94bad83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297d3fab7a624f05a703f620d94bad83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TaggedBootDevicesTest_v242-420175854 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 297d3fab7a624f05a703f620d94bad83 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-420175854 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TaggedBootDevicesTest_v242-420175854-project Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 657822daf4f044319d5d6440e501cde6 Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TaggedBootDevicesTest_v242-420175854-project Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '17e8bee1-1cc6-4712-8c4a-ab079f4f1705'} Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:27.606220 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:27.610188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:27.614497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Returning 404 to user: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:27.618100 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-537f559b-aaef-4944-b78b-9c2406744221 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 404 len: 111 microversion: 2.42 time: 0.092517 Aug 29 05:14:27.619380 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2453/4893] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:14:27 2022] DELETE /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:14:27.638930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:27.641057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:27.660180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:27.660961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:27.661634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:27.662608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:27.663297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:27.664219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:28.508037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:28.518724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:28.526217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:28.527653 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd49ef98-413f-4067-89df-ae99cd4ae7f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 1.213757 Aug 29 05:14:28.528739 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2441/4894] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:27 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:28.544399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:28.545307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] [instance: 17e8bee1-1cc6-4712-8c4a-ab079f4f1705] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:28.556563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:28.557273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:28.558064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:28.558956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:28.563867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:28.564582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:28.585042 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] HTTP exception thrown: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Request method failure captured: Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 HTTP/1.1 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDElypPl-cIke_gd8_ewNJZpki5_HdPakgNWRXyZBYLK5GedJyaQJniZoXZpJsXcEBlms8e35dSNhCYlJK6Oom0xveIEgSoU5vbDpzI3hVpbcKx6ZF2KmGZ_CHjVHHt4KCjJl7fjkTuh1zB3uUm_lp4gTkv-tpEIjTx2mN6FZUaA5INo Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 297d3fab7a624f05a703f620d94bad83 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-420175854 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297d3fab7a624f05a703f620d94bad83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/297d3fab7a624f05a703f620d94bad83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_297d3fab7a624f05a703f620d94bad83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297d3fab7a624f05a703f620d94bad83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TaggedBootDevicesTest_v242-420175854 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 297d3fab7a624f05a703f620d94bad83 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-420175854 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TaggedBootDevicesTest_v242-420175854-project Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 657822daf4f044319d5d6440e501cde6 Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TaggedBootDevicesTest_v242-420175854-project Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '17e8bee1-1cc6-4712-8c4a-ab079f4f1705'} Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:28.590205 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:28.595565 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:28.595565 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:28.595565 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:28.595565 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:28.595565 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:28.595565 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:28.595565 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. Aug 29 05:14:28.595565 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:28.599806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] Returning 404 to user: Instance 17e8bee1-1cc6-4712-8c4a-ab079f4f1705 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:28.601033 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5313d91-308f-4be3-b28c-24fac71f7fb9 tempest-TaggedBootDevicesTest_v242-420175854 tempest-TaggedBootDevicesTest_v242-420175854-project] 10.222.0.20 "GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705" status: 404 len: 111 microversion: 2.42 time: 0.069383 Aug 29 05:14:28.601960 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2442/4895] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:28 2022] GET /compute/v2.1/servers/17e8bee1-1cc6-4712-8c4a-ab079f4f1705 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:14:28.640181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:28.641987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:28.673367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:28.677141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:28.678966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:28.681430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:28.684027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:28.686195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:29.430348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:29.446872 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5e38fb8-bccf-4187-97d7-93a68b9facfb tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 1.825934 Aug 29 05:14:29.447502 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2454/4896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:27 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:29.484266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad984e6e-088f-4701-aef4-2c934e6fe78b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad984e6e-088f-4701-aef4-2c934e6fe78b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 HTTP/1.1 Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 280 Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:29.501765 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 05:14:29.506072 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:29.512632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad984e6e-088f-4701-aef4-2c934e6fe78b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:29.513742 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad984e6e-088f-4701-aef4-2c934e6fe78b tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "PUT /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 400 len: 619 microversion: 2.1 time: 0.043566 Aug 29 05:14:29.519800 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2455/4897] 10.222.0.20 () {60 vars in 1257 bytes} [Mon Aug 29 05:14:29 2022] PUT /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 619 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:14:29.532863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:29.533785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:29.555087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:29.555872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:29.559789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:29.560898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:29.561667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:29.563285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:30.633575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:30.643367 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4e1e1598-bc8d-4912-a553-e51439f0bd1f tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 1.120628 Aug 29 05:14:30.644004 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2456/4898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:29 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:30.682769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:30.684609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:30.702114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:30.702611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:30.703048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:30.703771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:30.704249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:30.704681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:30.873616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:30.882336 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7dbd9854-a99b-4d13-92bc-4431f5e1288f tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1469 microversion: 2.1 time: 2.277472 Aug 29 05:14:30.892409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2443/4899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:28 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1469 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:30.901035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-213047367", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "94219cd7-03e2-4d06-8853-274ad1cac250"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1033213198", "security_groups": [{"name": "tempest-secgroup-smoke-665085705"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:31.327591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] validate_networks() for [('94219cd7-03e2-4d06-8853-274ad1cac250', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:14:31.540694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:31.552073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:31.554677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:31.556432 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-212cdb10-7102-4d14-b79c-61f408cd78b0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 0.892729 Aug 29 05:14:31.572563 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2457/4900] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:30 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:31.578872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:31.580329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:31.589253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:31.590115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:31.590789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:31.591872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:31.593068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:31.593739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:31.832535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:31.847865 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8f18913b-a457-413f-8f59-5132769a5f99 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.271144 Aug 29 05:14:31.849093 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2458/4901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:31 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:31.861352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-893c7b33-090e-4330-b8a5-b417e899bdbb req-3fecfe2a-b013-4a04-a0d8-2563cc4c9bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20361c4d-b9ef-4ec6-b95c-fb009c452212", "name": "network-vif-deleted", "tag": "3fe6e7a8-eab5-4997-b647-7a7b466f0918"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:31.883871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-893c7b33-090e-4330-b8a5-b417e899bdbb req-3fecfe2a-b013-4a04-a0d8-2563cc4c9bfe service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:31.885723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-893c7b33-090e-4330-b8a5-b417e899bdbb req-3fecfe2a-b013-4a04-a0d8-2563cc4c9bfe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:31.888510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-893c7b33-090e-4330-b8a5-b417e899bdbb req-3fecfe2a-b013-4a04-a0d8-2563cc4c9bfe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:31.922342 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-893c7b33-090e-4330-b8a5-b417e899bdbb req-3fecfe2a-b013-4a04-a0d8-2563cc4c9bfe service nova] Creating event network-vif-deleted:3fe6e7a8-eab5-4997-b647-7a7b466f0918 for instance 20361c4d-b9ef-4ec6-b95c-fb009c452212 on n-h1-854119-9 Aug 29 05:14:31.934485 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-893c7b33-090e-4330-b8a5-b417e899bdbb req-3fecfe2a-b013-4a04-a0d8-2563cc4c9bfe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082724 Aug 29 05:14:31.940359 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2459/4902] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:31.952773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:31.956085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:31.968503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:31.970017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:31.970866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:31.971824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:31.972602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:31.973267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:32.417795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:14:32.419082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:14:32.419823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:14:32.420490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:14:32.421122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:14:32.440424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:32.442892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:32.443244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:32.443954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:32.446597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:32.447322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:32.448622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:32.457772 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d82c04fe-6947-4831-987b-fcc085ab8206 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.513596 Aug 29 05:14:32.459885 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2460/4903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:31 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:32.472505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9ff00597-eae7-42d7-9dcd-83238958b1f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9ff00597-eae7-42d7-9dcd-83238958b1f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 HTTP/1.1 Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 24 Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": ""}} Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115', 'body': {'server': {'name': ''}}} Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi '' Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:14:32.485571 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9ff00597-eae7-42d7-9dcd-83238958b1f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:32.490690 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9ff00597-eae7-42d7-9dcd-83238958b1f7 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "PUT /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 400 len: 108 microversion: 2.1 time: 0.025522 Aug 29 05:14:32.501008 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2461/4904] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:14:32 2022] PUT /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:14:32.504474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:14:32.514643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:32.515992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:32.522027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for user 6bcb6393cb0a4e6a857d0d5e960eba01 and project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:14:32.546476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:32.546987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:32.548671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:32.550356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:32.550973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:32.551246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:32.558636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:14:32.561045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:14:32.666195 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b255faed-9fe0-4378-befd-01cf108a0e5e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.772251 Aug 29 05:14:32.673832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:32.676344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:32.677225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:32.679503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lazy-loading 'fault' on Instance uuid 20361c4d-b9ef-4ec6-b95c-fb009c452212 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:14:32.680528 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2444/4905] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:14:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:14:32.692248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:32.694527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:32.705635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:32.706535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:32.707221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:32.708593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:32.709290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:32.709946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:32.885419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:32.899394 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-68a07fc0-b3a2-42b2-90ea-13417222d271 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1304 microversion: 2.1 time: 0.395491 Aug 29 05:14:32.915606 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2462/4906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:32 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1304 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:32.926432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:32.927053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:32.939470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:32.939973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:32.940442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:32.941205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:32.941652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:32.942065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:33.016039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:33.028832 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-333ced77-597a-4754-b662-127c67f969f9 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1506 microversion: 2.1 time: 0.343407 Aug 29 05:14:33.029473 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2445/4907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:32 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:33.042487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aec1de16-021f-40ba-a97c-cfd0e74931f3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:33.045101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aec1de16-021f-40ba-a97c-cfd0e74931f3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:33.707807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aec1de16-021f-40ba-a97c-cfd0e74931f3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:33.720046 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aec1de16-021f-40ba-a97c-cfd0e74931f3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1266 microversion: 2.1 time: 0.689212 Aug 29 05:14:33.722763 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2446/4908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:33 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1266 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:33.740326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:33.740957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:33.759946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:33.772981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:33.773669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:33.774594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:33.775392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:33.776134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:34.019682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:34.031846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:34.033671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:34.034777 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da7d1536-4131-46f3-a932-fe55382f4587 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 1.118024 Aug 29 05:14:34.056640 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2463/4909] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:32 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:34.068024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:34.071715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:34.088743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:34.089516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:34.090210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:34.091164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:34.091894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:34.092599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:34.170896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:34.171750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:34.172647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:34.180829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lazy-loading 'fault' on Instance uuid 20361c4d-b9ef-4ec6-b95c-fb009c452212 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:14:34.359867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1b71b178a94f2ba84143ea631683c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86492c077c64249a9c6da549c33c4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:34.369522 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf170b71-2f9b-40b3-b7eb-f83826e678da tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 200 len: 1304 microversion: 2.1 time: 0.311463 Aug 29 05:14:34.370114 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2464/4910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:34 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 1304 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:34.451293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:34.465659 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-658b7971-09f0-4766-ade5-f88cc694d276 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.741215 Aug 29 05:14:34.492295 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2447/4911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:33 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:34.749307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:34.750823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:34.769115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:34.769630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:34.772718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:34.773534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:34.776442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:34.777242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:34.910507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:34.925082 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3fbb1c59-b814-43c2-992d-d215c5a47570 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1318 microversion: 2.1 time: 0.185795 Aug 29 05:14:34.925927 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2465/4912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:34 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:35.066663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:35.068854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:35.089145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:35.092734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:35.093735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:35.095122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:35.097190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:35.097883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:35.395703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:35.396376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] [instance: 20361c4d-b9ef-4ec6-b95c-fb009c452212] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:35.415226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:35.419933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:35.420642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:35.421896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:35.422555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:35.423166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:35.443358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:35.462802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:35.466038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:35.474482 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f0651da-e6a5-4b7b-ba5e-12fb5b7072e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 0.413857 Aug 29 05:14:35.479768 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2448/4913] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:35 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:35.486051 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] HTTP exception thrown: Instance 20361c4d-b9ef-4ec6-b95c-fb009c452212 could not be found. Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Request method failure captured: Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 HTTP/1.1 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEp8M6RdVReyw7QerBuBGhrRtcghRL_Y1ys1guzOH3zfwjiZdtoZL72hClCjqxNoyp8-waU6d2bHKE6JcdI3fhV4NSXYIZlysF0-qox3GHxxkEFdLhlm7S5aHfb-ak75BZz3kH9wLl9BrFRH9RAD9qCDzhP-h6vf0qSaKjpY2uyHlWg Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e86492c077c64249a9c6da549c33c4c1 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesBackupsTest-23763871 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e86492c077c64249a9c6da549c33c4c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e86492c077c64249a9c6da549c33c4c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e86492c077c64249a9c6da549c33c4c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e86492c077c64249a9c6da549c33c4c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesBackupsTest-23763871 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e86492c077c64249a9c6da549c33c4c1 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesBackupsTest-23763871 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesBackupsTest-23763871-project Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 0c1b71b178a94f2ba84143ea631683c2 Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesBackupsTest-23763871-project Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 20361c4d-b9ef-4ec6-b95c-fb009c452212 could not be found. Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '20361c4d-b9ef-4ec6-b95c-fb009c452212'} Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20361c4d-b9ef-4ec6-b95c-fb009c452212 could not be found. Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20361c4d-b9ef-4ec6-b95c-fb009c452212 could not be found. Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:35.489982 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:35.494335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:35.494335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:35.494335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:35.494335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:35.494335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:35.494335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20361c4d-b9ef-4ec6-b95c-fb009c452212 could not be found. Aug 29 05:14:35.494335 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:35.497593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] Returning 404 to user: Instance 20361c4d-b9ef-4ec6-b95c-fb009c452212 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:35.500011 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-93a6b464-6266-49d5-8e0b-2a8340163d23 tempest-VolumesBackupsTest-23763871 tempest-VolumesBackupsTest-23763871-project] 10.222.0.20 "GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212" status: 404 len: 111 microversion: 2.1 time: 0.113385 Aug 29 05:14:35.503983 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2466/4914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:35 2022] GET /compute/v2.1/servers/20361c4d-b9ef-4ec6-b95c-fb009c452212 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:14:35.515335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:35.516509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:35.526913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:35.531471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:35.532101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:35.533165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:35.533869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:35.534601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:35.952825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:35.953476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:35.974377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:35.982212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:35.983797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:35.985425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:35.986079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:35.986683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:36.250594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:36.259528 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2b07ea5e-7250-43c8-ab73-14a51d779508 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1324 microversion: 2.1 time: 0.316791 Aug 29 05:14:36.268448 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2467/4915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:35 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1324 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:36.469877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:36.478846 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd680831-594a-4dc6-8820-75c1c6f7775f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.967878 Aug 29 05:14:36.486302 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2449/4916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:35 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:36.506705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:36.507432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:36.518890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:36.519233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-27da9adf-8645-42cd-b6fc-c06fa4b945ca tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1982439551"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:36.520199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:36.520829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:36.521916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-27da9adf-8645-42cd-b6fc-c06fa4b945ca tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:36.522975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:36.526196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:36.527051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:36.539178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27da9adf-8645-42cd-b6fc-c06fa4b945ca tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:36.539849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27da9adf-8645-42cd-b6fc-c06fa4b945ca tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:36.540345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27da9adf-8645-42cd-b6fc-c06fa4b945ca tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:36.541093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27da9adf-8645-42cd-b6fc-c06fa4b945ca tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:36.541545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27da9adf-8645-42cd-b6fc-c06fa4b945ca tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:36.547373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27da9adf-8645-42cd-b6fc-c06fa4b945ca tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:37.135375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:37.202286 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-27da9adf-8645-42cd-b6fc-c06fa4b945ca tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.699215 Aug 29 05:14:37.214345 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2468/4917] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:14:36 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 05:14:37.231567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7439d688-7e21-4a23-9bbd-027973ab1d72 req-06d1204d-c7d2-4cf5-a6b5-19e962d7407d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "name": "network-vif-unplugged", "status": "completed", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:37.252739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7439d688-7e21-4a23-9bbd-027973ab1d72 req-06d1204d-c7d2-4cf5-a6b5-19e962d7407d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:37.261044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7439d688-7e21-4a23-9bbd-027973ab1d72 req-06d1204d-c7d2-4cf5-a6b5-19e962d7407d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:37.261297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7439d688-7e21-4a23-9bbd-027973ab1d72 req-06d1204d-c7d2-4cf5-a6b5-19e962d7407d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:37.312668 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7439d688-7e21-4a23-9bbd-027973ab1d72 req-06d1204d-c7d2-4cf5-a6b5-19e962d7407d service nova] Creating event network-vif-unplugged:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:14:37.325995 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7439d688-7e21-4a23-9bbd-027973ab1d72 req-06d1204d-c7d2-4cf5-a6b5-19e962d7407d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111441 Aug 29 05:14:37.330987 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2469/4918] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:37.346669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:37.347748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:37.375194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:37.379374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:37.380092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:37.381122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:37.384414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:37.385341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:37.543560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:37.554521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:37.560830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:37.566446 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9af567d0-59b7-498c-b523-4c278a17b03d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 1.065386 Aug 29 05:14:37.568897 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2450/4919] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:36 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:14:37.585769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:37.586739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:37.600587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:37.601732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:37.603975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:37.604989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:37.608322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:37.609068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:38.153645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:38.180429 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3a29c5f-bc30-421f-8c59-4102585a35cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.847733 Aug 29 05:14:38.199415 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2470/4920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:37 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:38.524402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:38.533232 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-529f7a48-e401-485d-bb99-1401fbaffec5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 0.962959 Aug 29 05:14:38.544842 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2451/4921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:37 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:38.591753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:38.592493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:38.614896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:38.621342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:38.621940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:38.627831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:38.629968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:38.632537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:39.210850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:39.212432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:39.227598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:39.230039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:39.230773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:39.231769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:39.233057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:39.234563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:40.281548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:40.303006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:40.306977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:40.313382 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5377b513-fa8a-402f-a789-68d8d5fa1764 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 1.727604 Aug 29 05:14:40.325180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2471/4922] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:38 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:40.351431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0b5f27e2-d144-4ba8-9211-59b650c5ae7c req-947fad6c-1c9a-4697-a10a-6d9d7600770a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0212b868-400b-4cd4-9278-f45805cc128f", "name": "network-vif-plugged", "status": "completed", "tag": "cd6eaae0-af11-4f54-97bf-0b3ddd31b12d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:40.411709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0b5f27e2-d144-4ba8-9211-59b650c5ae7c req-947fad6c-1c9a-4697-a10a-6d9d7600770a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:40.416519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0b5f27e2-d144-4ba8-9211-59b650c5ae7c req-947fad6c-1c9a-4697-a10a-6d9d7600770a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:40.417155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0b5f27e2-d144-4ba8-9211-59b650c5ae7c req-947fad6c-1c9a-4697-a10a-6d9d7600770a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:40.470716 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0b5f27e2-d144-4ba8-9211-59b650c5ae7c req-947fad6c-1c9a-4697-a10a-6d9d7600770a service nova] Creating event network-vif-plugged:cd6eaae0-af11-4f54-97bf-0b3ddd31b12d for instance 0212b868-400b-4cd4-9278-f45805cc128f on n-h1-854119-9 Aug 29 05:14:40.483362 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0b5f27e2-d144-4ba8-9211-59b650c5ae7c req-947fad6c-1c9a-4697-a10a-6d9d7600770a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144540 Aug 29 05:14:40.486729 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2472/4923] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:40.503524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:40.505348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:40.521072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:40.521787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:40.524141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:40.525941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:40.527789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:40.530069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:40.537310 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-14acd0ae-d91e-4e9c-b5cb-fbc7cf921ec5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 1.331680 Aug 29 05:14:40.538277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:40.559799 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2452/4924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:39 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:40.856009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7d1222c8-4c78-4bac-8e6e-844afc2cda57 req-ae27ef45-fac9-442b-8a2f-538f27b4ad47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbae68a6-80fa-4e8e-83a2-aab77977bab3", "tag": "7d89d29f-b9f0-4836-a069-9338e7900197"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:40.876593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7d1222c8-4c78-4bac-8e6e-844afc2cda57 req-ae27ef45-fac9-442b-8a2f-538f27b4ad47 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:40.876999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7d1222c8-4c78-4bac-8e6e-844afc2cda57 req-ae27ef45-fac9-442b-8a2f-538f27b4ad47 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:40.877433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7d1222c8-4c78-4bac-8e6e-844afc2cda57 req-ae27ef45-fac9-442b-8a2f-538f27b4ad47 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:40.974118 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7d1222c8-4c78-4bac-8e6e-844afc2cda57 req-ae27ef45-fac9-442b-8a2f-538f27b4ad47 service nova] Creating event network-changed:7d89d29f-b9f0-4836-a069-9338e7900197 for instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 on n-h1-854119-9 Aug 29 05:14:40.998615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7d1222c8-4c78-4bac-8e6e-844afc2cda57 req-ae27ef45-fac9-442b-8a2f-538f27b4ad47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148211 Aug 29 05:14:41.017757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2453/4925] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:41.128795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:41.138134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7a5f8269-7fe7-43b1-90ba-46d02e69bd7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 0.648017 Aug 29 05:14:41.161260 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2473/4926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:40 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:41.354332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:41.354965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:41.369873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:41.370371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:41.370807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:41.371526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:41.375609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:41.376350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:41.565764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:41.566544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:41.573378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:41.576535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:41.577150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:41.578029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:41.586690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:41.587365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:42.068274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:42.074373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:42.081510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:42.085889 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df777c05-4acb-484d-8517-f1859133e47f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1689 microversion: 2.1 time: 0.522837 Aug 29 05:14:42.086634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:42.088660 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2474/4927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:41 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1689 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:14:42.090555 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0c96b7a4-2a09-451e-89fd-afff71ef94e9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1406 microversion: 2.20 time: 0.742889 Aug 29 05:14:42.099797 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2454/4928] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:41 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1406 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:14:42.168835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:42.169470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:42.189449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:42.189951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:42.190386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:42.194378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:42.194862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:42.195297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:42.892114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:42.906498 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9e8d9b1f-0972-4187-afd7-fa1b013ce9f5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 0.741570 Aug 29 05:14:42.924648 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2475/4929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:42 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:43.109637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:43.111070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:43.114315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:43.116769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:43.117924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:43.131950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:43.134511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:43.134758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:43.135081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:43.135613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:43.142055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:43.142055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:43.143069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:43.143580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:43.145972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:43.149797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:43.151918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:43.711955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:43.902686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:43.936825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:43.940708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:43.946321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:43.947539 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40b7ac9c-7e5b-4f21-b78f-6fd69b454382 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1597 microversion: 2.20 time: 0.835792 Aug 29 05:14:43.948162 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2476/4930] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:14:43 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1597 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:14:43.960507 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-411ca5f5-515c-453b-b708-11b545b6f5c5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1689 microversion: 2.1 time: 0.854698 Aug 29 05:14:43.965294 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2455/4931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:43 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1689 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:43.968982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:43.969488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:43.977910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:43.981804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:43.995408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:43.997283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:43.997800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:43.999343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:43.999816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:44.000826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:44.001444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:44.003151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:44.016741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:44.017198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:44.017951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:44.018415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:44.018857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:44.099059 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 HTTP/1.1 Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7bb1b817-f286-4fee-bd85-ecac579e5be2'} Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:44.107216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:44.112625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7a1421db-579f-4e05-9d5d-0a19651618c5 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 404 len: 111 microversion: 2.1 time: 0.159959 Aug 29 05:14:44.113690 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2477/4932] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:14:43 2022] DELETE /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:14:44.121795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ccfc29f4-e952-4365-bebb-c47388fd6912 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:44.122285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ccfc29f4-e952-4365-bebb-c47388fd6912 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:44.151095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccfc29f4-e952-4365-bebb-c47388fd6912 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:44.151708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccfc29f4-e952-4365-bebb-c47388fd6912 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:44.152176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccfc29f4-e952-4365-bebb-c47388fd6912 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:44.152944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccfc29f4-e952-4365-bebb-c47388fd6912 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:44.153368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccfc29f4-e952-4365-bebb-c47388fd6912 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:44.153780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccfc29f4-e952-4365-bebb-c47388fd6912 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:44.402775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:44.417980 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1f1bb068-a291-431c-9369-1f6e69936460 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 0.451262 Aug 29 05:14:44.424589 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2456/4933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:43 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:44.443175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:44.444659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7bb1b817-f286-4fee-bd85-ecac579e5be2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:44.469747 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ccfc29f4-e952-4365-bebb-c47388fd6912 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.355445 Aug 29 05:14:44.470357 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2478/4934] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 29 05:14:44 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/os-interface => generated 284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:14:44.514755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:44.517671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:44.519044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:44.525928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:44.528412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:44.529125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:44.597183 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 HTTP/1.1 Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7bb1b817-f286-4fee-bd85-ecac579e5be2'} Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:44.599737 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.605010 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:44.605010 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:44.605010 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:44.605010 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:44.605010 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:44.605010 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. Aug 29 05:14:44.605010 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:44.608338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 7bb1b817-f286-4fee-bd85-ecac579e5be2 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:44.628251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-044ef3d2-0547-4f63-a198-95aae45232cc tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2" status: 404 len: 111 microversion: 2.1 time: 0.202082 Aug 29 05:14:44.631439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2457/4935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:44 2022] GET /compute/v2.1/servers/7bb1b817-f286-4fee-bd85-ecac579e5be2 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:14:44.639539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:44.640042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:44.658592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:44.670623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:44.671359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:44.672309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:44.680842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:44.681555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:44.772843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:14:44.987005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:44.988101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:45.004407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:45.006529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:45.008679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:45.014720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:45.015600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:45.018053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:45.022746 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a697f7e1-ff5b-437e-9ec4-be210533a677 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 204 len: 0 microversion: 2.1 time: 0.388045 Aug 29 05:14:45.024268 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2479/4936] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:14:44 2022] DELETE /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:14:45.033442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:45.034692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:45.045604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:45.048687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:45.049330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:45.053661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:45.054685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:45.055290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:47.110375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:47.127042 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6980ccb6-9a13-49cc-967a-b254c4cc51a8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 2.092130 Aug 29 05:14:47.132197 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2480/4937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:45 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:47.139388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:47.145949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:47.161849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:47.164896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:47.189694 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a71cb6c-a309-4c75-b776-a9be0afea024 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1689 microversion: 2.1 time: 2.206595 Aug 29 05:14:47.205133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:47.207045 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2458/4938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:44 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1689 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:14:47.207827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:47.208424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:47.219672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:47.225254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:47.225254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:47.764758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:47.779111 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9727df77-0129-499a-b0a0-44b60184c959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 0.645093 Aug 29 05:14:47.780644 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2481/4939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:47 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:48.152456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:48.153213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:48.164882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:48.175165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:48.182344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:48.186135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:48.187119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:48.189947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:48.230164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:48.231496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:48.253179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:48.255041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:48.264650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:48.265396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:48.265864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:48.266399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:49.711016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:49.749853 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6dfc3a0-b57d-4660-92b7-5367350947d8 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1512 microversion: 2.1 time: 1.600008 Aug 29 05:14:49.752157 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2459/4940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:48 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1512 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:49.784149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:49.787052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:49.811764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:49.812657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:49.817431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:49.819077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:49.820834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:49.822190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:50.482050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:50.501821 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0b7264ff-89ab-413f-bb79-68939a16e52c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1689 microversion: 2.1 time: 2.270471 Aug 29 05:14:50.503351 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2482/4941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:48 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1689 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:14:50.511027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-25859451-11cb-4506-ad9b-e197d013a10a req-a78ba46d-f965-4275-a112-f3085ff0ef56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "name": "network-vif-plugged", "status": "completed", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:50.522939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-25859451-11cb-4506-ad9b-e197d013a10a req-a78ba46d-f965-4275-a112-f3085ff0ef56 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:50.523797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-25859451-11cb-4506-ad9b-e197d013a10a req-a78ba46d-f965-4275-a112-f3085ff0ef56 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:50.524484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-25859451-11cb-4506-ad9b-e197d013a10a req-a78ba46d-f965-4275-a112-f3085ff0ef56 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:50.551940 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-25859451-11cb-4506-ad9b-e197d013a10a req-a78ba46d-f965-4275-a112-f3085ff0ef56 service nova] Creating event network-vif-plugged:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:14:50.562154 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-25859451-11cb-4506-ad9b-e197d013a10a req-a78ba46d-f965-4275-a112-f3085ff0ef56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055931 Aug 29 05:14:50.563837 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2483/4942] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:50.778127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:50.779549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:50.794803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:50.801966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:50.819571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:50.820049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:50.821915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:50.825063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:51.655037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:51.666183 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-db14c2e3-2cb0-4974-ac3b-89a2b98c4134 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1470 microversion: 2.1 time: 0.892692 Aug 29 05:14:51.682757 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2484/4943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:50 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1470 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:52.059811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:52.062932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1377918021", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "7a16decd-a78c-47be-ab13-bf9d84ce4a1f"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:52.070150 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f827ac86-6291-46fd-bff3-ab77ddad92c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 2.313035 Aug 29 05:14:52.086047 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2460/4944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:49 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 2321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:52.088960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:52.092909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:52.119585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:52.132163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:52.132720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:52.133515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:52.133999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:52.143545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:52.915969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:52.932355 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c5f0d25-0174-4732-8cf2-e12c386ea4d2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.856924 Aug 29 05:14:52.940981 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2461/4945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:52 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:52.949985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-af9eabeb-c730-4a67-ab6c-4465d9b5679b req-f5b2664d-b4aa-4893-9871-e96a54aa36f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c83cae9-ef18-4723-9742-bb5e40f1b115", "name": "network-vif-deleted", "tag": "b5b79f0a-b188-414c-99ed-082280f4ef23"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:52.955914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:14:52.972894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-af9eabeb-c730-4a67-ab6c-4465d9b5679b req-f5b2664d-b4aa-4893-9871-e96a54aa36f2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:52.978641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-af9eabeb-c730-4a67-ab6c-4465d9b5679b req-f5b2664d-b4aa-4893-9871-e96a54aa36f2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:52.981705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-af9eabeb-c730-4a67-ab6c-4465d9b5679b req-f5b2664d-b4aa-4893-9871-e96a54aa36f2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:53.036238 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-af9eabeb-c730-4a67-ab6c-4465d9b5679b req-f5b2664d-b4aa-4893-9871-e96a54aa36f2 service nova] Creating event network-vif-deleted:b5b79f0a-b188-414c-99ed-082280f4ef23 for instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 on n-h1-854119-9 Aug 29 05:14:53.052865 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-af9eabeb-c730-4a67-ab6c-4465d9b5679b req-f5b2664d-b4aa-4893-9871-e96a54aa36f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105891 Aug 29 05:14:53.063536 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2462/4946] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:53.079835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:53.089534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:53.108091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:53.108676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:53.109105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:53.109842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:53.110304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:53.110816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:53.255107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:53.255620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:53.256071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:53.256570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lazy-loading 'fault' on Instance uuid 7c83cae9-ef18-4723-9742-bb5e40f1b115 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:14:53.357823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27af7c7f74d41c8882f29888c70ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01935816574154a5c9832f4bd94886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:53.375091 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-85ef11c9-d5d4-487e-b00e-248af6507020 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 200 len: 1307 microversion: 2.1 time: 0.307053 Aug 29 05:14:53.376290 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2463/4947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:53 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 1307 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:53.382098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:53.390176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:53.401240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:53.402017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:53.402661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:53.404517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:53.409477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:53.410249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:53.753718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:53.768232 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dea19125-7e7d-46cd-a3b0-3a11cee320bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 0.390097 Aug 29 05:14:53.770714 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2464/4948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:53 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:53.967185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:53.968296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:53.988263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:53.989336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:53.990243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:53.991268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:53.992657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:53.993966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:54.298051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:54.316486 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15f9151d-0778-4e8c-9bce-328cfd2850d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.354721 Aug 29 05:14:54.317568 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2465/4949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:53 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:14:54.397919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:54.398742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] [instance: 7c83cae9-ef18-4723-9742-bb5e40f1b115] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:54.412845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:54.416092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:54.418239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:54.421764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:54.422292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:54.428334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:54.470137 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] HTTP exception thrown: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 could not be found. Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Request method failure captured: Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 HTTP/1.1 Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpENmgE6s9ZWLqjrlSbivMcPfYSG9BMohe7CBCJxTaxep__CSrbj_X_4-_Y0Jvh3fohPWor9XF6u_ejbPVZ0RY3vxRrikhR6zQhMa3oTD1QBwgz6rcioUshJ48EtWBdaSMKSOEr-DmIi-VRbepsq5PvCFDx5tMVto-c5pzkZcIxPNw Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c01935816574154a5c9832f4bd94886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c01935816574154a5c9832f4bd94886", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c01935816574154a5c9832f4bd94886"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2c01935816574154a5c9832f4bd94886 Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-358891651 Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: d27af7c7f74d41c8882f29888c70ebdd Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-358891651-project Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 could not be found. Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7c83cae9-ef18-4723-9742-bb5e40f1b115'} Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 could not be found. Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 could not be found. Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:14:54.473218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:54.478303 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:14:54.478303 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:14:54.478303 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:14:54.478303 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:14:54.478303 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:14:54.478303 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 could not be found. Aug 29 05:14:54.478303 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:14:54.481998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] Returning 404 to user: Instance 7c83cae9-ef18-4723-9742-bb5e40f1b115 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:14:54.483652 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-463cbd06-2b67-4b58-87ad-07f60d2def35 tempest-ServersNegativeTestJSON-358891651 tempest-ServersNegativeTestJSON-358891651-project] 10.222.0.20 "GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115" status: 404 len: 111 microversion: 2.1 time: 0.091079 Aug 29 05:14:54.511996 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2466/4950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:54 2022] GET /compute/v2.1/servers/7c83cae9-ef18-4723-9742-bb5e40f1b115 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:14:54.792819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:54.793803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:54.804876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:54.805778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:54.806451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:54.811185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:54.812736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:54.813403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:55.236049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:55.248879 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22b9427a-d8bb-49af-a60f-67d9b2a31558 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 0.462012 Aug 29 05:14:55.258223 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2467/4951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:54 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:55.273360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-215bb891-9914-4890-a0bb-3872137381cd req-82dd6ddc-ff8c-4ec6-a0e9-43d19c94ce14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0212b868-400b-4cd4-9278-f45805cc128f", "tag": "cd6eaae0-af11-4f54-97bf-0b3ddd31b12d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:55.310981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-215bb891-9914-4890-a0bb-3872137381cd req-82dd6ddc-ff8c-4ec6-a0e9-43d19c94ce14 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:55.320091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-215bb891-9914-4890-a0bb-3872137381cd req-82dd6ddc-ff8c-4ec6-a0e9-43d19c94ce14 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:55.320862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-215bb891-9914-4890-a0bb-3872137381cd req-82dd6ddc-ff8c-4ec6-a0e9-43d19c94ce14 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:55.358955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-215bb891-9914-4890-a0bb-3872137381cd req-82dd6ddc-ff8c-4ec6-a0e9-43d19c94ce14 service nova] Creating event network-changed:cd6eaae0-af11-4f54-97bf-0b3ddd31b12d for instance 0212b868-400b-4cd4-9278-f45805cc128f on n-h1-854119-9 Aug 29 05:14:55.377242 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-215bb891-9914-4890-a0bb-3872137381cd req-82dd6ddc-ff8c-4ec6-a0e9-43d19c94ce14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112461 Aug 29 05:14:55.379576 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2468/4952] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:55.406245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:55.407122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:55.434807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:55.440425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:55.442086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:55.447633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:55.450929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:55.453185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:56.426393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:56.435721 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f904987-d94b-4bbf-8f49-51df59015c52 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 1.041216 Aug 29 05:14:56.441411 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2469/4953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:55 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:56.448720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:56.449747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:56.488972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:56.491877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:56.493556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:56.497055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:56.498071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:56.499298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:57.449393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:57.488534 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c568ddbb-cf9a-4961-9ff9-3a63690240b1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 1.035419 Aug 29 05:14:57.489266 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2470/4954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:56 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:57.517895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-55cca229-66fc-44d0-8bad-d845c86bb67c req-b58646d6-9f58-41eb-8411-c45c0436655c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbae68a6-80fa-4e8e-83a2-aab77977bab3", "name": "network-vif-plugged", "status": "completed", "tag": "7d89d29f-b9f0-4836-a069-9338e7900197"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:14:57.539715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-55cca229-66fc-44d0-8bad-d845c86bb67c req-b58646d6-9f58-41eb-8411-c45c0436655c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:57.541872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-55cca229-66fc-44d0-8bad-d845c86bb67c req-b58646d6-9f58-41eb-8411-c45c0436655c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:57.543149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-55cca229-66fc-44d0-8bad-d845c86bb67c req-b58646d6-9f58-41eb-8411-c45c0436655c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:57.565901 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-55cca229-66fc-44d0-8bad-d845c86bb67c req-b58646d6-9f58-41eb-8411-c45c0436655c service nova] Creating event network-vif-plugged:7d89d29f-b9f0-4836-a069-9338e7900197 for instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 on n-h1-854119-9 Aug 29 05:14:57.572280 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-55cca229-66fc-44d0-8bad-d845c86bb67c req-b58646d6-9f58-41eb-8411-c45c0436655c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073987 Aug 29 05:14:57.573570 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2471/4955] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:14:57.579751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:57.581079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:57.588744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:57.589441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:57.590049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:57.591592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:57.592557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:57.593412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:58.760702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:58.772035 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4dea6cc-c74f-42e3-b7e1-7dbe5923aa78 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 1.197047 Aug 29 05:14:58.772660 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2472/4956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:57 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:58.815282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:58.816050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:58.837921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:58.838719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:58.839369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:58.840345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:58.842772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:58.843404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:59.549388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:14:59.566761 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aeab8a93-8bfe-49e8-8a3f-91a7ffac8887 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1391 microversion: 2.1 time: 0.777085 Aug 29 05:14:59.568096 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2473/4957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:58 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1391 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:14:59.799202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:14:59.799996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:14:59.808567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:59.810428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:59.811112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:14:59.812494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:14:59.822170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:14:59.823020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:00.137123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:00.151275 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c9ddfb3f-8b7a-4a47-9be4-17006e4a65cf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.357147 Aug 29 05:15:00.157649 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2474/4958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:14:59 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:00.592667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:00.593281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:00.626693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:00.630225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:00.631397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:00.633299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:00.633766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:00.634187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:01.194465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:01.204951 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-11cd3064-7616-41dc-876b-a16b73f92a45 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1562 microversion: 2.1 time: 0.616471 Aug 29 05:15:01.205584 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2475/4959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:00 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1562 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:01.231922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:01.235462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:01.259949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:01.260487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:01.260930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:01.271265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:01.272050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:01.281748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:01.659342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=88,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:01.827498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:01.840774 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87ecf27c-bcb4-4ccf-8cf7-0023e02ef296 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.626387 Aug 29 05:15:01.842322 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2476/4960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:01 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:01.848467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:01.851199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:01.866565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:01.869621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:01.873107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:01.878518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:01.879318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:01.879919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:02.120218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:02.324960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:02.337459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:02.340565 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8720397-aa73-40a5-8798-6a1ccfed34dd tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1562 microversion: 2.1 time: 0.496415 Aug 29 05:15:02.363213 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2477/4961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:01 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1562 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:02.868197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:02.869950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:02.885373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:02.901364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:02.918933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:02.920358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:02.927073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:02.928947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:04.012579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:04.035631 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4b7e584-eed2-4e45-9574-63611aa7c7f8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 1.176003 Aug 29 05:15:04.053620 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2478/4962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:02 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:05.065944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:05.066677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:05.081335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:05.081742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:05.088812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:05.090775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:05.097490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:05.098023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:05.475647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] validate_networks() for [('7a16decd-a78c-47be-ab13-bf9d84ce4a1f', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:15:06.100893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:06.109079 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2cefad84-84f2-4e67-bcd8-7e92d79014db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 1.047472 Aug 29 05:15:06.115828 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2479/4963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:05 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:07.137128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:07.137921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:07.150736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:07.152251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:07.152830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:07.154414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:07.156465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:07.157035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:07.316704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:15:07.317223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:15:07.317808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:15:07.318331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:15:07.319012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:15:07.335945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:07.338396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:07.339539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:07.343481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:07.344112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:07.344696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:07.395746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Getting quotas for project 05036c3977844696a7f27f6908fc8e32. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:07.408740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Getting quotas for user aa6bf76f35474e13aafafdba2dcad1d4 and project 05036c3977844696a7f27f6908fc8e32. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:07.441564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:15:07.444438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:15:07.561357 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7a9c6d5d-c98d-4928-b9f9-11b32e18b417 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.876667 Aug 29 05:15:07.574942 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2485/4964] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:14:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 15891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:15:07.589519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff56e8b6-bc37-4966-8929-a75c167e7af5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:07.594605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff56e8b6-bc37-4966-8929-a75c167e7af5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:07.612620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:07.622071 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97c75dd4-04ec-40f1-8fdd-66f1be8a40db tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.489756 Aug 29 05:15:07.627936 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2480/4965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:07 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:08.226961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ff56e8b6-bc37-4966-8929-a75c167e7af5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:08.235219 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff56e8b6-bc37-4966-8929-a75c167e7af5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1225 microversion: 2.1 time: 0.655420 Aug 29 05:15:08.248947 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2486/4966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:07 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1225 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:08.647331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:08.647954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:08.662297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:08.664701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:08.667676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:08.672552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:08.673492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:08.676012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:09.271536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:09.272897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:09.287152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:09.293446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:09.294380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:09.297257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:09.300314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:09.300994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:09.471599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:09.495490 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-890fb665-c2e5-4a07-8297-138f0cfbecac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1277 microversion: 2.1 time: 0.228136 Aug 29 05:15:09.504907 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2487/4967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:09 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:09.600191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:09.609641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6c2dffb5-0baa-4d2a-8539-e6a0b7608f3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.966630 Aug 29 05:15:09.631219 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2481/4968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:08 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:10.531644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:10.531644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:10.551143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:10.558824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:10.559260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:10.562801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:10.563476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:10.563924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:10.644469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:10.645873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:10.662858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:10.664035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:10.664745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:10.665863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:10.666669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:10.667399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:11.035082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:11.049095 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae7ba9e1-6ff5-462f-bcf4-484810d1cb77 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1283 microversion: 2.1 time: 0.524084 Aug 29 05:15:11.053074 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2488/4969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:10 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1283 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:11.729054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:11.730414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:11.741523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:11.745156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:11.752767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:11.754821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:11.755474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:11.756936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:12.023499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:12.034344 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-73a5365c-5edd-439e-9f88-9480053ff144 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 1.394729 Aug 29 05:15:12.036082 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2482/4970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:10 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:12.056992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-34556630-efe0-4e59-85f8-10a1d0979924 req-c78441f1-6ae0-4293-b114-cb37ff02238d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbae68a6-80fa-4e8e-83a2-aab77977bab3", "tag": "7d89d29f-b9f0-4836-a069-9338e7900197"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:12.083829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-34556630-efe0-4e59-85f8-10a1d0979924 req-c78441f1-6ae0-4293-b114-cb37ff02238d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:12.088450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-34556630-efe0-4e59-85f8-10a1d0979924 req-c78441f1-6ae0-4293-b114-cb37ff02238d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:12.089265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-34556630-efe0-4e59-85f8-10a1d0979924 req-c78441f1-6ae0-4293-b114-cb37ff02238d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:12.121121 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-34556630-efe0-4e59-85f8-10a1d0979924 req-c78441f1-6ae0-4293-b114-cb37ff02238d service nova] Creating event network-changed:7d89d29f-b9f0-4836-a069-9338e7900197 for instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 on n-h1-854119-9 Aug 29 05:15:12.135295 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-34556630-efe0-4e59-85f8-10a1d0979924 req-c78441f1-6ae0-4293-b114-cb37ff02238d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095776 Aug 29 05:15:12.137324 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2483/4971] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:12.147998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:12.154252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:12.174071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:12.176172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:12.176942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:12.178158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:12.179931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:12.181253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:12.837331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:12.849654 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ab58297-45d4-4559-9b4e-c07e265fc0ec tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1283 microversion: 2.1 time: 0.709932 Aug 29 05:15:12.853747 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2484/4972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:12 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1283 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:13.063564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:13.064341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:13.076781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:13.079636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:13.080411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:13.083332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:13.084050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:13.085491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:13.264737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:13.275079 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e924ebb8-4a8a-46a6-9526-ae68f38e989d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1562 microversion: 2.1 time: 1.551046 Aug 29 05:15:13.284965 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2489/4973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:11 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1562 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:13.876622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:13.877328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:13.916975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:13.916975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:13.916975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:13.916975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:13.916975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:13.916975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:15.014666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:15.026866 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6011f6c5-066a-4b95-8989-60703d80ad5c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 1.967244 Aug 29 05:15:15.038891 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2485/4974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:13 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:15.126035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:15.162390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0e04607f-2f05-4778-ac81-65ced88566b6 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 1.290421 Aug 29 05:15:15.163015 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2490/4975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:13 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:16.063685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:16.065252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:16.082534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:16.082759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:16.083038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:16.090905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:16.091432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:16.092237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:16.187367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:16.203877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:16.213788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:16.214284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:16.214946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:16.215890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:16.216573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:16.217000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:16.934277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:16.942360 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cb815486-6663-427e-80e5-25981bbaebf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 0.759859 Aug 29 05:15:16.943544 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2491/4976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:16 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:16.944084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:16.956382 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0459f5c4-8a6b-49e6-826f-7ecbe25d5027 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1684 microversion: 2.1 time: 0.896731 Aug 29 05:15:16.960003 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2486/4977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:16 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1684 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:17.984593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:17.985295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:17.994736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:17.995665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:18.001141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:18.008248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:18.009328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:18.011118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:18.012248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:18.015558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:18.016452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:18.022283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:18.022831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:18.031603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:18.034548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:18.038227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:18.042466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:18.239317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:18.924683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:18.934845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:18.943580 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e53d1811-221c-405c-869c-6147cf17c329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.959540 Aug 29 05:15:18.946746 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2487/4978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:17 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:18.953093 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1632600e-05f3-47d7-8a93-ac6d17a65880 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 0.973613 Aug 29 05:15:18.954920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c820a334-480d-494d-bf44-480875476a26 req-5b6652a9-b556-4a12-b749-f5b3cbaf310b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a925c5-fe78-4e3f-91c4-888e46c0ec1d", "tag": "7df238fd-51e9-49b2-89ec-4bbd41f298f1"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:18.968203 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2492/4979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:17 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:18.980400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c820a334-480d-494d-bf44-480875476a26 req-5b6652a9-b556-4a12-b749-f5b3cbaf310b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:18.981038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c820a334-480d-494d-bf44-480875476a26 req-5b6652a9-b556-4a12-b749-f5b3cbaf310b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:18.981971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c820a334-480d-494d-bf44-480875476a26 req-5b6652a9-b556-4a12-b749-f5b3cbaf310b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:19.002536 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c820a334-480d-494d-bf44-480875476a26 req-5b6652a9-b556-4a12-b749-f5b3cbaf310b service nova] Creating event network-changed:7df238fd-51e9-49b2-89ec-4bbd41f298f1 for instance 73a925c5-fe78-4e3f-91c4-888e46c0ec1d on n-h1-854119-9 Aug 29 05:15:19.021901 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c820a334-480d-494d-bf44-480875476a26 req-5b6652a9-b556-4a12-b749-f5b3cbaf310b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062670 Aug 29 05:15:19.024821 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2488/4980] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:19.047896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:19.048990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:19.059628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:19.060198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:19.060730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:19.061856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:19.062532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:19.063197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:19.581830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:19.594244 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-014e8ef8-e540-4025-85b5-060c9818d390 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.550153 Aug 29 05:15:19.611444 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2493/4981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:19 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:19.980060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:19.981842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:20.001355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:20.006175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:20.010283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:20.015705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:20.016568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:20.018408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:20.873211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:20.889200 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7747fb8c-dd26-47eb-a75f-e5f3de959e93 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 0.914474 Aug 29 05:15:20.891357 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2489/4982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:19 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:21.238532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a8ce1129-f7a1-4cdb-9301-97a10c7f8788 req-ad1deeb0-916e-432d-8f07-a250aa08dac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "name": "network-vif-unplugged", "status": "completed", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:21.274500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a8ce1129-f7a1-4cdb-9301-97a10c7f8788 req-ad1deeb0-916e-432d-8f07-a250aa08dac0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:21.274988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a8ce1129-f7a1-4cdb-9301-97a10c7f8788 req-ad1deeb0-916e-432d-8f07-a250aa08dac0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:21.275415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a8ce1129-f7a1-4cdb-9301-97a10c7f8788 req-ad1deeb0-916e-432d-8f07-a250aa08dac0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:21.314426 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a8ce1129-f7a1-4cdb-9301-97a10c7f8788 req-ad1deeb0-916e-432d-8f07-a250aa08dac0 service nova] Creating event network-vif-unplugged:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:15:21.341872 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a8ce1129-f7a1-4cdb-9301-97a10c7f8788 req-ad1deeb0-916e-432d-8f07-a250aa08dac0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102563 Aug 29 05:15:21.341872 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2494/4983] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:21.913005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:21.914663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:21.938752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:21.939678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:21.940499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:21.941706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:21.942569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:21.943279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:21.959483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:21.960532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:21.979228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:21.981799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:21.982885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:21.986010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:21.989193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:21.989679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:22.318563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:22.329784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:22.349336 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-45c1fa22-18ff-4c95-929d-6f806f1febf5 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 0.441927 Aug 29 05:15:22.365559 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-501c9419-42ce-424e-965c-1da2421dca4f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.411590 Aug 29 05:15:22.372631 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2495/4984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:21 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:22.375032 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2490/4985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:21 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:22.396900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:22.397658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:22.410498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:22.411635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:22.412093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:22.414648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:22.415123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:22.416016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:22.851178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:22.859643 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-867e4828-48ad-4195-a3df-9311ca15ac88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.467982 Aug 29 05:15:22.864528 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2491/4986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:22 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:22.889536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:22.890603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:22.902596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:22.905848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:22.906302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:22.915762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:22.916387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:22.916834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:23.370740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:23.371479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:23.380520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=62 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:23.386498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:23.387371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:23.388006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:23.398176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:23.398786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:23.399440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:23.955089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:23.968721 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3137840a-8ddc-463f-8331-550efacf66f7 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 0.602351 Aug 29 05:15:23.969630 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2492/4987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:23 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:24.360217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:24.375331 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0ef6fde-0241-4a5a-8a23-545853643b13 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 1.491066 Aug 29 05:15:24.376518 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2496/4988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:22 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:24.399723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5f00aad-4838-43b1-81dc-f18bdd731853 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:24.402050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a5f00aad-4838-43b1-81dc-f18bdd731853 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:24.420095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5f00aad-4838-43b1-81dc-f18bdd731853 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:24.420795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5f00aad-4838-43b1-81dc-f18bdd731853 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:24.421130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5f00aad-4838-43b1-81dc-f18bdd731853 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:24.422924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5f00aad-4838-43b1-81dc-f18bdd731853 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:24.424355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5f00aad-4838-43b1-81dc-f18bdd731853 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:24.427389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5f00aad-4838-43b1-81dc-f18bdd731853 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:24.635162 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a5f00aad-4838-43b1-81dc-f18bdd731853 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.239783 Aug 29 05:15:24.639542 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2493/4989] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:15:24 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:15:24.649529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:24.651512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:24.671748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:24.674834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:24.686372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:24.691717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:24.693596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:24.694125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:24.995624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:24.996696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:25.012326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:25.012832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:25.013303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:25.014026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:25.014482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:25.014909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:25.231044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:25.240730 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-03c356c3-78e5-4f0d-a4c0-738e306224c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1673 microversion: 2.1 time: 0.599862 Aug 29 05:15:25.252725 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2497/4990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:24 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1673 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:25.486067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:25.494433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:25.498151 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b4d4ef24-4182-4428-88cb-a3383c31f924 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 0.507289 Aug 29 05:15:25.516846 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2494/4991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:24 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:26.265910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:26.267440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:26.293655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:26.297249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:26.297955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:26.298976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:26.299646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:26.300385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:26.529469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:26.530088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:26.544786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:26.547891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:26.548620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:26.552343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:26.553033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:26.558307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:26.560456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:26.572809 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-818003eb-b77e-44fd-b37a-69e249f329ee tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1673 microversion: 2.1 time: 0.309933 Aug 29 05:15:26.593763 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2498/4992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:26 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1673 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:27.003912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:27.021902 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4e50701-aeab-4426-9da8-c1b238e2e141 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 0.497269 Aug 29 05:15:27.036338 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2495/4993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:26 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:27.334186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7a99f0dd-7c64-4e34-b759-e68d42c3bc64 req-32f7dfde-74c7-4003-be20-d28eaef8a54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a925c5-fe78-4e3f-91c4-888e46c0ec1d", "name": "network-vif-plugged", "status": "completed", "tag": "7df238fd-51e9-49b2-89ec-4bbd41f298f1"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:27.357318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7a99f0dd-7c64-4e34-b759-e68d42c3bc64 req-32f7dfde-74c7-4003-be20-d28eaef8a54d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:27.360240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7a99f0dd-7c64-4e34-b759-e68d42c3bc64 req-32f7dfde-74c7-4003-be20-d28eaef8a54d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:27.361271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7a99f0dd-7c64-4e34-b759-e68d42c3bc64 req-32f7dfde-74c7-4003-be20-d28eaef8a54d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:27.390535 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7a99f0dd-7c64-4e34-b759-e68d42c3bc64 req-32f7dfde-74c7-4003-be20-d28eaef8a54d service nova] Creating event network-vif-plugged:7df238fd-51e9-49b2-89ec-4bbd41f298f1 for instance 73a925c5-fe78-4e3f-91c4-888e46c0ec1d on n-h1-854119-9 Aug 29 05:15:27.412298 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7a99f0dd-7c64-4e34-b759-e68d42c3bc64 req-32f7dfde-74c7-4003-be20-d28eaef8a54d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082216 Aug 29 05:15:27.414227 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2499/4994] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:27.602356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:27.604174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:27.623750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:27.625951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:27.626709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:27.627683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:27.631917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:27.632642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:28.046370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:28.048236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:28.056863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:28.057359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:28.057787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:28.068709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:28.070458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:28.071111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:28.522515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:28.533254 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ce7d14b-6c16-48cc-9882-976451ee5e08 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.936633 Aug 29 05:15:28.545166 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2496/4995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:27 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:28.577495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fdc6df27-3575-4843-bd5b-152692ad7e96 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:28.594658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fdc6df27-3575-4843-bd5b-152692ad7e96 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:28.609533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc6df27-3575-4843-bd5b-152692ad7e96 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:28.611547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc6df27-3575-4843-bd5b-152692ad7e96 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:28.612880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc6df27-3575-4843-bd5b-152692ad7e96 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:28.614688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc6df27-3575-4843-bd5b-152692ad7e96 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:28.615850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc6df27-3575-4843-bd5b-152692ad7e96 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:28.616992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc6df27-3575-4843-bd5b-152692ad7e96 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:28.791159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:28.815128 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2593abc-1662-4340-a617-65d7790797da tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 0.775083 Aug 29 05:15:28.837407 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2500/4996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:28 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:28.923551 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fdc6df27-3575-4843-bd5b-152692ad7e96 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 200 len: 324 microversion: 2.1 time: 0.356213 Aug 29 05:15:28.929126 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2497/4997] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:15:28 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 324 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:28.935291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:28.936214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:28.946141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:28.955216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:28.955930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:28.956877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:28.957504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:28.958217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:29.520351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:29.533242 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd98909b-4ab8-40e5-9fc9-5896aa321aac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.602536 Aug 29 05:15:29.536449 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2501/4998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:28 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:29.558223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:29.558934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:29.576928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:29.577455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:29.577895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:29.578617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:29.579072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:29.579493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:29.840396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:29.842084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:29.851216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:29.852390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:29.853065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:29.854298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:29.854967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:29.855613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:30.105533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:30.126847 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-93b019a0-6ec8-41fe-a9e6-9a8c90adbd92 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.571799 Aug 29 05:15:30.128957 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2498/4999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:29 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:30.155390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:30.156224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:30.167657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:30.168167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:30.168607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:30.174166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:30.176364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:30.178166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:30.186918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:30.198803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-49e2cee4-8ec9-4989-ab90-5af23b090b8b tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1325 microversion: 2.1 time: 0.363629 Aug 29 05:15:30.203878 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2502/5000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:29 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1325 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:30.587005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:30.601144 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-55731e22-4c04-423a-8bdd-a8edb6ba29bf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.451387 Aug 29 05:15:30.616149 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2499/5001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:30 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:30.631948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:30.632691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:30.648281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:30.649016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:30.649406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:30.650875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:30.652813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:30.653284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:31.199558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:31.210307 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-46da7d17-609e-4db7-bfbe-e0e5702fd2a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.582818 Aug 29 05:15:31.215678 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2503/5002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:30 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:31.225680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:31.226282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:31.240748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:31.241516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:31.247530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:31.248959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:31.250357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:31.252679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:31.396639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-496115562", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:31.499154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] validate_networks() for [('538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:15:32.333899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:32.348822 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-56a3fa93-bfef-4868-a2c4-fa1fb47bb2f4 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1522 microversion: 2.1 time: 1.126672 Aug 29 05:15:32.360837 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2500/5003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:31 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1522 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:32.379962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:32.380827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:32.388720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:32.389482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:32.390095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:32.390980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:32.391608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:32.392329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:32.428243 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] HTTP exception thrown: Instance is not a member of specified network Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Request method failure captured: Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d/ips/invalid HTTP/1.1 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEtK3JB4T0tPz5AD98DtExNO7MpWApxxbyOZOzNJwJf5MI3uzT3Jm5f03vMl58jzVj6kY85ugJlR4gYBV95lcwMtH6s97htMixT1XGOblje9Q2dDfvCuGmNW6Z_StM1OsADBWeDYxN14CaEiexyBIJl8yRwaNMuDUMm2QW14wUJ6C-Q Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 05036c3977844696a7f27f6908fc8e32 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1910299740 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05036c3977844696a7f27f6908fc8e32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05036c3977844696a7f27f6908fc8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05036c3977844696a7f27f6908fc8e32", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05036c3977844696a7f27f6908fc8e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1910299740 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 05036c3977844696a7f27f6908fc8e32 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1910299740 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerAddressesNegativeTestJSON-1910299740-project Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: aa6bf76f35474e13aafafdba2dcad1d4 Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1910299740-project Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance is not a member of specified network Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': '73a925c5-fe78-4e3f-91c4-888e46c0ec1d', 'id': 'invalid'} Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 29 05:15:32.436268 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:15:32.445368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:15:32.445368 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-88fb5861-a103-40d3-8094-d6f745b97d20 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.063740 Aug 29 05:15:32.445368 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2501/5004] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 05:15:32 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d/ips/invalid => generated 91 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:15:32.455921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb8093f6-7628-497f-8acd-5c7f84e62dbe tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:32.456999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eb8093f6-7628-497f-8acd-5c7f84e62dbe tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Failed to fetch instance by id 999 {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 05:15:32.461560 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-eb8093f6-7628-497f-8acd-5c7f84e62dbe tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] HTTP exception thrown: Instance 999 could not be found. Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb8093f6-7628-497f-8acd-5c7f84e62dbe tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Request method failure captured: Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEtK3JB4T0tPz5AD98DtExNO7MpWApxxbyOZOzNJwJf5MI3uzT3Jm5f03vMl58jzVj6kY85ugJlR4gYBV95lcwMtH6s97htMixT1XGOblje9Q2dDfvCuGmNW6Z_StM1OsADBWeDYxN14CaEiexyBIJl8yRwaNMuDUMm2QW14wUJ6C-Q Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 05036c3977844696a7f27f6908fc8e32 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1910299740 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05036c3977844696a7f27f6908fc8e32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05036c3977844696a7f27f6908fc8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05036c3977844696a7f27f6908fc8e32", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05036c3977844696a7f27f6908fc8e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1910299740 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 05036c3977844696a7f27f6908fc8e32 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1910299740 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerAddressesNegativeTestJSON-1910299740-project Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: aa6bf76f35474e13aafafdba2dcad1d4 Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1910299740-project Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 999 could not be found. Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': '999'} Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 05:15:32.464794 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:15:32.473842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb8093f6-7628-497f-8acd-5c7f84e62dbe tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:15:32.473842 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eb8093f6-7628-497f-8acd-5c7f84e62dbe tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.021381 Aug 29 05:15:32.473842 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2502/5005] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 29 05:15:32 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:15:32.482971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:32.487441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:32.506584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:32.507091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:32.507580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:32.508262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:32.508823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:32.509381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:32.551890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:15:32.746024 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e6e4c910-7aed-4357-b18f-6400e260e830 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 204 len: 0 microversion: 2.1 time: 0.272717 Aug 29 05:15:32.748705 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2503/5006] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:15:32 2022] DELETE /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:15:32.770697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:32.771506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:32.779268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:32.779846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:32.780532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:32.781330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:32.781968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:32.782469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:33.522063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:33.533794 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e935b5d3-0c12-4ffc-af24-444893de4e72 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1528 microversion: 2.1 time: 0.773495 Aug 29 05:15:33.536396 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2504/5007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:32 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1528 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:33.793561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:15:33.793978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:15:33.794465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:15:33.794877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:15:33.795292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:15:33.803978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:33.812068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:33.813292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:33.814037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:33.814791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:33.815254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:33.815684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:33.844497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:33.882113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:33.893944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for user 6fb88aef408746868abb4053768c18c4 and project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:33.911789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:15:33.945131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:15:34.068762 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5cda9fa1-8f5d-4c0a-a72b-ec7088490b6e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.678020 Aug 29 05:15:34.079810 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2504/5008] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:15:34.088545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-635f6b05-8a8d-46dd-8214-57c8e125ce55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:34.089178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-635f6b05-8a8d-46dd-8214-57c8e125ce55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:34.091005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-910450889", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "d659eadf-b558-41ac-85f1-5c4eb1552714"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:34.177189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-635f6b05-8a8d-46dd-8214-57c8e125ce55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:34.184147 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-635f6b05-8a8d-46dd-8214-57c8e125ce55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1214 microversion: 2.1 time: 0.104743 Aug 29 05:15:34.188091 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2505/5009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:34 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:34.274452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] validate_networks() for [('d659eadf-b558-41ac-85f1-5c4eb1552714', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:15:34.558733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:34.559690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:34.592081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:34.594137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:34.595738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:34.596700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:34.599672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:34.619298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:35.546682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:35.559130 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b786f67-e651-4e2a-af17-060461536138 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1528 microversion: 2.1 time: 1.004487 Aug 29 05:15:35.561433 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2506/5010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:34 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1528 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:35.572484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:35.581525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:35.596827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:35.597448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:35.597891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:35.599100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:35.601923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:35.602766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:36.020263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:36.028401 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8d7d404a-e3db-4741-bcf5-3224ffc37437 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1266 microversion: 2.1 time: 0.465690 Aug 29 05:15:36.035898 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2507/5011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:35 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1266 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:36.582924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:36.583634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:36.593093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:36.593497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:36.594319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:36.595174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:36.599944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:36.600425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:36.751441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:36.767521 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-52232a0e-6624-4a63-9a19-c5e1d1042640 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1486 microversion: 2.1 time: 0.184081 Aug 29 05:15:36.784949 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2508/5012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:36 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1486 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:37.057450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:37.059031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:37.071500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:37.072022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:37.072509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:37.073240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:37.073696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:37.074123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:37.428816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:37.443479 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6223f3b-9016-484d-ba98-3621da9ee680 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1272 microversion: 2.1 time: 0.384240 Aug 29 05:15:37.444366 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2509/5013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:37 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:37.485188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7b3a22bc-6d7d-48f3-ba11-cd46f72e655d req-ed1883f5-c82d-4123-836a-69d19ecb35c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a925c5-fe78-4e3f-91c4-888e46c0ec1d", "name": "network-vif-deleted", "tag": "7df238fd-51e9-49b2-89ec-4bbd41f298f1"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:37.496300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:15:37.496889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:15:37.497182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:15:37.497591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:15:37.497999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:15:37.527561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:37.528067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:37.528546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:37.531249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7b3a22bc-6d7d-48f3-ba11-cd46f72e655d req-ed1883f5-c82d-4123-836a-69d19ecb35c8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:37.531412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:37.531884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:37.532361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:37.534085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7b3a22bc-6d7d-48f3-ba11-cd46f72e655d req-ed1883f5-c82d-4123-836a-69d19ecb35c8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:37.534916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7b3a22bc-6d7d-48f3-ba11-cd46f72e655d req-ed1883f5-c82d-4123-836a-69d19ecb35c8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:37.581225 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7b3a22bc-6d7d-48f3-ba11-cd46f72e655d req-ed1883f5-c82d-4123-836a-69d19ecb35c8 service nova] Creating event network-vif-deleted:7df238fd-51e9-49b2-89ec-4bbd41f298f1 for instance 73a925c5-fe78-4e3f-91c4-888e46c0ec1d on n-h1-854119-9 Aug 29 05:15:37.605087 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7b3a22bc-6d7d-48f3-ba11-cd46f72e655d req-ed1883f5-c82d-4123-836a-69d19ecb35c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126164 Aug 29 05:15:37.606871 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2510/5014] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:37.616670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Getting quotas for project c21d9460b51b4ec68bf4f1d34ae349d4. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:37.631309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Getting quotas for user 5ca9796b2465471c857daf89cfd2e529 and project c21d9460b51b4ec68bf4f1d34ae349d4. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:37.704817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:15:37.708626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:15:37.797434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:37.798160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:37.804103 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-84aedc4b-8c42-4dfc-a097-0edd060bf840 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.266309 Aug 29 05:15:37.812303 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2505/5015] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:15:37.819034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7db5d9f2-92e0-4e86-be9b-50d000edb738 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:37.820039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7db5d9f2-92e0-4e86-be9b-50d000edb738 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:37.841058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:37.858149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:37.858850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:37.864750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:37.865245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:37.868704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:38.012670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:38.013343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:38.014035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:38.018074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lazy-loading 'fault' on Instance uuid 73a925c5-fe78-4e3f-91c4-888e46c0ec1d {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:15:38.144995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7db5d9f2-92e0-4e86-be9b-50d000edb738 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:38.153523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7db5d9f2-92e0-4e86-be9b-50d000edb738 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1216 microversion: 2.1 time: 0.339931 Aug 29 05:15:38.154127 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2506/5016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:37 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1216 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:38.296016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6bf76f35474e13aafafdba2dcad1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05036c3977844696a7f27f6908fc8e32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:38.306419 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dfcd3746-129a-4122-886c-03f0360ee6ac tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 200 len: 1315 microversion: 2.1 time: 0.514371 Aug 29 05:15:38.310185 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2511/5017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:37 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:38.466846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:38.468413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:38.483758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:38.484586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:38.485488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:38.487337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:38.488714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:38.499723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:38.642177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2dc9b4bb-f176-4466-bb3c-1195dd865c21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:38.644506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2dc9b4bb-f176-4466-bb3c-1195dd865c21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:38.671040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dc9b4bb-f176-4466-bb3c-1195dd865c21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:38.671546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dc9b4bb-f176-4466-bb3c-1195dd865c21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:38.671988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dc9b4bb-f176-4466-bb3c-1195dd865c21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:38.672930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dc9b4bb-f176-4466-bb3c-1195dd865c21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:38.673443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dc9b4bb-f176-4466-bb3c-1195dd865c21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:38.673863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dc9b4bb-f176-4466-bb3c-1195dd865c21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:38.699491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:38.712779 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6e1ff334-ac88-4c4d-9158-84d68637d1e3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1272 microversion: 2.1 time: 0.249666 Aug 29 05:15:38.725272 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2507/5018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:38 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:38.785391 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2dc9b4bb-f176-4466-bb3c-1195dd865c21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action" status: 200 len: 24576 microversion: 2.1 time: 0.146254 Aug 29 05:15:38.786756 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2512/5019] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:15:38 2022] POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action => generated 24576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 05:15:39.178650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:39.179272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:39.202064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:39.202971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:39.202971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:39.212676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:39.215711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:39.218605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:39.335086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:39.336173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] [instance: 73a925c5-fe78-4e3f-91c4-888e46c0ec1d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:39.367146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:39.369928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:39.371891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:39.372731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:39.375533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:39.380807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:39.393175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:39.403037 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-35d0422d-5b6b-49ac-9545-5720dd52ee53 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1268 microversion: 2.1 time: 0.232853 Aug 29 05:15:39.414409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2508/5020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:39 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1268 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:39.442084 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] HTTP exception thrown: Instance 73a925c5-fe78-4e3f-91c4-888e46c0ec1d could not be found. Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Request method failure captured: Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d HTTP/1.1 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEtK3JB4T0tPz5AD98DtExNO7MpWApxxbyOZOzNJwJf5MI3uzT3Jm5f03vMl58jzVj6kY85ugJlR4gYBV95lcwMtH6s97htMixT1XGOblje9Q2dDfvCuGmNW6Z_StM1OsADBWeDYxN14CaEiexyBIJl8yRwaNMuDUMm2QW14wUJ6C-Q Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 05036c3977844696a7f27f6908fc8e32 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1910299740 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05036c3977844696a7f27f6908fc8e32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05036c3977844696a7f27f6908fc8e32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05036c3977844696a7f27f6908fc8e32", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05036c3977844696a7f27f6908fc8e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1910299740 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 05036c3977844696a7f27f6908fc8e32 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1910299740 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerAddressesNegativeTestJSON-1910299740-project Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: aa6bf76f35474e13aafafdba2dcad1d4 Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1910299740-project Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 73a925c5-fe78-4e3f-91c4-888e46c0ec1d could not be found. Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '73a925c5-fe78-4e3f-91c4-888e46c0ec1d'} Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a925c5-fe78-4e3f-91c4-888e46c0ec1d could not be found. Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a925c5-fe78-4e3f-91c4-888e46c0ec1d could not be found. Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:15:39.443803 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a925c5-fe78-4e3f-91c4-888e46c0ec1d could not be found. Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] Returning 404 to user: Instance 73a925c5-fe78-4e3f-91c4-888e46c0ec1d could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:15:39.449488 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d38b8b0f-ccce-4f65-b097-22657cac75f2 tempest-ServerAddressesNegativeTestJSON-1910299740 tempest-ServerAddressesNegativeTestJSON-1910299740-project] 10.222.0.20 "GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d" status: 404 len: 111 microversion: 2.1 time: 0.117789 Aug 29 05:15:39.460040 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2513/5021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:39 2022] GET /compute/v2.1/servers/73a925c5-fe78-4e3f-91c4-888e46c0ec1d => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:15:39.738347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:39.745714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:39.759974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:39.762340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:39.762903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:39.764858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:39.766392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:39.767007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:40.428844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:40.429639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:40.444532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:40.448004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:40.448719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:40.449567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:40.450453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:40.452581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:41.032493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:41.046048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-113c6367-69e2-4902-aa66-16ea0f0f161f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1274 microversion: 2.1 time: 0.621211 Aug 29 05:15:41.060758 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2514/5022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:40 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1274 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:41.093841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:41.102761 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-62a42ef0-4eec-4a06-8d09-458cdee5fd87 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1314 microversion: 2.1 time: 1.369252 Aug 29 05:15:41.128592 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2509/5023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:39 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1314 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:42.068556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:42.070372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:42.094245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:42.095156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:42.095851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:42.097295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:42.097916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:42.098501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:42.124454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:42.126178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:42.144034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:42.145063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:42.146259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:42.147882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:42.152296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:42.153147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:42.260491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:42.285592 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8c355270-b6e3-4fb9-b9ef-2e7cf8f502cd tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1274 microversion: 2.1 time: 0.221048 Aug 29 05:15:42.288647 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2515/5024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:42 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1274 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:42.308382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1f5a1db8-0f1b-4de4-9f62-5f9b02df44c7 req-22c9aaa8-2026-472e-b5f6-9fcd02f2a9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a33fef6f-0065-4378-b656-3d60f8f09baa", "tag": "637e6c2a-9041-4e01-a0ee-c2f811843d44"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:42.335866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1f5a1db8-0f1b-4de4-9f62-5f9b02df44c7 req-22c9aaa8-2026-472e-b5f6-9fcd02f2a9b8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:42.337632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1f5a1db8-0f1b-4de4-9f62-5f9b02df44c7 req-22c9aaa8-2026-472e-b5f6-9fcd02f2a9b8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:42.338765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1f5a1db8-0f1b-4de4-9f62-5f9b02df44c7 req-22c9aaa8-2026-472e-b5f6-9fcd02f2a9b8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:42.386622 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1f5a1db8-0f1b-4de4-9f62-5f9b02df44c7 req-22c9aaa8-2026-472e-b5f6-9fcd02f2a9b8 service nova] Creating event network-changed:637e6c2a-9041-4e01-a0ee-c2f811843d44 for instance a33fef6f-0065-4378-b656-3d60f8f09baa on n-h1-854119-9 Aug 29 05:15:42.406220 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-1f5a1db8-0f1b-4de4-9f62-5f9b02df44c7 req-22c9aaa8-2026-472e-b5f6-9fcd02f2a9b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113001 Aug 29 05:15:42.414334 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2516/5025] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:42.827319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:42.862295 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e1e8041-d8a1-4bd8-aa31-1673a0779dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1314 microversion: 2.1 time: 0.727013 Aug 29 05:15:42.872289 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2510/5026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:42 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:43.309459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:43.310163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:43.332387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:43.341432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:43.341983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:43.345103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:43.345950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:43.347934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:43.847501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:43.887087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:43.888253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:43.922300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:43.922985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:43.923945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:43.934635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:43.935753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:43.936471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:43.997609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:44.008961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76abdf76-9bcc-4bd0-8661-efbc3c4949df tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.704368 Aug 29 05:15:44.009820 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2517/5027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:43 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:44.271261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:44.279989 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8d873d36-65f1-45d4-92d4-8164437c33c6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1314 microversion: 2.1 time: 0.398239 Aug 29 05:15:44.293936 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2511/5028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:43 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:44.744796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-4f222cd4-2550-45a2-8c6f-4eae3010a519 req-1c2ca98f-2172-4bba-a0a1-233d155a62e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63104be6-e8da-40df-a9b4-be17a754bf67", "tag": "eef70ef0-ee27-4174-a828-4493e9392ac9"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:44.754601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:44.758616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4f222cd4-2550-45a2-8c6f-4eae3010a519 req-1c2ca98f-2172-4bba-a0a1-233d155a62e3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:44.759586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4f222cd4-2550-45a2-8c6f-4eae3010a519 req-1c2ca98f-2172-4bba-a0a1-233d155a62e3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:44.760317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4f222cd4-2550-45a2-8c6f-4eae3010a519 req-1c2ca98f-2172-4bba-a0a1-233d155a62e3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:44.774045 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-4f222cd4-2550-45a2-8c6f-4eae3010a519 req-1c2ca98f-2172-4bba-a0a1-233d155a62e3 service nova] Creating event network-changed:eef70ef0-ee27-4174-a828-4493e9392ac9 for instance 63104be6-e8da-40df-a9b4-be17a754bf67 on n-h1-854119-9 Aug 29 05:15:44.786206 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-4f222cd4-2550-45a2-8c6f-4eae3010a519 req-1c2ca98f-2172-4bba-a0a1-233d155a62e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045171 Aug 29 05:15:44.787252 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2518/5029] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:45.029767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:45.031113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:45.039887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:45.040413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:45.041245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:45.042150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:45.042606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:45.043206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:45.302711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:45.303724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:45.315433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:45.317100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:45.317553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:45.318270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:45.318724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:45.319531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:45.466540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:45.476446 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ba8c699-b246-4176-8f41-356b39c21fda tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.450386 Aug 29 05:15:45.481561 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2512/5030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:45 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:45.701005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:45.721939 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2a117bdd-6155-4c32-82f7-d0732e805808 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1314 microversion: 2.1 time: 0.420846 Aug 29 05:15:45.722560 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2519/5031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:45 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:46.501397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:46.501998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:46.508816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:46.509300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:46.509731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:46.510432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:46.511069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:46.511678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:46.514987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:46.747281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:46.748566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:46.756736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:46.757232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:46.757640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:46.758547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:46.759240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:46.760502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:47.233346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:47.255153 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3f8b236f-764a-46d7-977d-67f1d1de5db8 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.756106 Aug 29 05:15:47.259004 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2513/5032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:46 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:47.293515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:47.327968 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4aeec165-d3e5-4088-b8eb-ec11810be5fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1314 microversion: 2.1 time: 0.584424 Aug 29 05:15:47.331586 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2520/5033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:46 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:48.283020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:48.283962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:48.287272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:48.288711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:48.295931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:48.296684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:48.297403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:48.298409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:48.299367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:48.301122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:48.354488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:48.355109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:48.368087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:48.371043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:48.371620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:48.372781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:48.374287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:48.376484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:48.630456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:48.633366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:48.639997 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-68e99f7e-c522-49ad-8e51-c5c259321338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1314 microversion: 2.1 time: 0.289309 Aug 29 05:15:48.642216 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-38542b7d-c226-4884-aae5-81e6c747882f tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.368651 Aug 29 05:15:48.642823 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2514/5034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:48 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:48.644952 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2521/5035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:48 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:49.673047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:49.674194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:49.677369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:49.680756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:49.682295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:49.682718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:49.683501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:49.684365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:49.685392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:49.686591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:49.702805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:49.704676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:49.705197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:49.705995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:49.707445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:49.708028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:50.019889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:50.034905 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d11a0e3-c334-41f7-9303-1f862475e5a2 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.368088 Aug 29 05:15:50.048783 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2515/5036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:49 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:50.083988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:50.095917 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea942118-27b3-4a51-a060-652a7a79b0c7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1314 microversion: 2.1 time: 0.428633 Aug 29 05:15:50.109620 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2522/5037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:49 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:51.061001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:51.062713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:51.072334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:51.073163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:51.074544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:51.075797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:51.076883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:51.077626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:51.120833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:51.121581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:51.133485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:51.136673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:51.138525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:51.140297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:51.142509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:51.143047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:51.552624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:51.566187 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-93d8c576-6c4e-43f8-bf1b-99007f480529 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1314 microversion: 2.1 time: 0.451179 Aug 29 05:15:51.585870 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2523/5038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:51 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:51.602485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1bbca581-8d0d-45a3-a052-30cca1af537e req-87e7cb44-64c9-43f6-a23c-64a219e30d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33fef6f-0065-4378-b656-3d60f8f09baa", "name": "network-vif-plugged", "status": "completed", "tag": "637e6c2a-9041-4e01-a0ee-c2f811843d44"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:51.612193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:51.621760 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8949f8f1-dc32-4df3-8f67-53279e3e0ee1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.568304 Aug 29 05:15:51.629945 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2516/5039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:51 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:51.645290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1bbca581-8d0d-45a3-a052-30cca1af537e req-87e7cb44-64c9-43f6-a23c-64a219e30d08 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:51.647844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1bbca581-8d0d-45a3-a052-30cca1af537e req-87e7cb44-64c9-43f6-a23c-64a219e30d08 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:51.648584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1bbca581-8d0d-45a3-a052-30cca1af537e req-87e7cb44-64c9-43f6-a23c-64a219e30d08 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:51.676026 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1bbca581-8d0d-45a3-a052-30cca1af537e req-87e7cb44-64c9-43f6-a23c-64a219e30d08 service nova] Creating event network-vif-plugged:637e6c2a-9041-4e01-a0ee-c2f811843d44 for instance a33fef6f-0065-4378-b656-3d60f8f09baa on n-h1-854119-9 Aug 29 05:15:51.684320 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-1bbca581-8d0d-45a3-a052-30cca1af537e req-87e7cb44-64c9-43f6-a23c-64a219e30d08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096773 Aug 29 05:15:51.684979 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2524/5040] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:52.591078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:52.591691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:52.613020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:52.613836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:52.614838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:52.617396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:52.618037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:52.620810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:52.648920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:52.649615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:52.671967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:52.672499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:52.672995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:52.673697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:52.674141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:52.674562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:53.139460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:53.149868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:53.159383 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d6665c4a-a117-4327-8b0b-f240aaeddf12 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.512889 Aug 29 05:15:53.173426 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2525/5041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:52 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:53.194362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:53.202993 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6bfaae14-5547-4fbf-b269-295b00ed34b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1314 microversion: 2.1 time: 0.616018 Aug 29 05:15:53.203788 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2517/5042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:52 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:54.183049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:54.184464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:54.202583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:54.204666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:54.207912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:54.209537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:54.211371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:54.212738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:54.231328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:54.233075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:54.239422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:54.268690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:54.270009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:54.271866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:54.274087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:54.277007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:54.278828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:54.564103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:54.577332 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a776064f-221c-4c49-9dac-670bf5526938 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.397026 Aug 29 05:15:54.578973 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2526/5043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:54 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:54.623598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:54.634260 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7a8ce53e-51d9-4ea3-898f-890904cb191f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1501 microversion: 2.1 time: 0.408669 Aug 29 05:15:54.635335 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2518/5044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:54 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1501 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:54.657893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a9aa35b-eca9-4534-90c1-b86e07bea5b0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:54.667003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a9aa35b-eca9-4534-90c1-b86e07bea5b0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:54.668062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a9aa35b-eca9-4534-90c1-b86e07bea5b0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:54.668909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a9aa35b-eca9-4534-90c1-b86e07bea5b0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:54.699408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a9aa35b-eca9-4534-90c1-b86e07bea5b0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Going to try to stop instance {{(pid=128872) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 05:15:54.840750 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a9aa35b-eca9-4534-90c1-b86e07bea5b0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa/action" status: 202 len: 0 microversion: 2.1 time: 0.188962 Aug 29 05:15:54.844638 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2527/5045] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:15:54 2022] POST /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:15:54.854345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:54.854964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:54.874478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:54.876891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:54.877682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:54.878785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:54.880677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:54.881371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:55.344690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:55.358937 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4dc8ac24-2e0d-47a6-abc8-86f4908b9b0b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.508815 Aug 29 05:15:55.372697 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2519/5046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:54 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:55.601863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:55.602834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:55.613643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:55.615893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:55.616507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:55.638812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:55.641615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:55.643215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:55.951355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d9581fe0-3dd2-4ab2-95c0-3dcfb63d8c6e req-364be073-b298-4c74-b390-6b4141597708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63104be6-e8da-40df-a9b4-be17a754bf67", "name": "network-vif-plugged", "status": "completed", "tag": "eef70ef0-ee27-4174-a828-4493e9392ac9"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:55.964503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:55.974603 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c237dda2-4a31-440f-8dba-cf8c197dd2d0 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.379293 Aug 29 05:15:55.975204 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2528/5047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:55 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:56.005992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d9581fe0-3dd2-4ab2-95c0-3dcfb63d8c6e req-364be073-b298-4c74-b390-6b4141597708 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:56.014917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d9581fe0-3dd2-4ab2-95c0-3dcfb63d8c6e req-364be073-b298-4c74-b390-6b4141597708 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:56.015598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d9581fe0-3dd2-4ab2-95c0-3dcfb63d8c6e req-364be073-b298-4c74-b390-6b4141597708 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:56.034146 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d9581fe0-3dd2-4ab2-95c0-3dcfb63d8c6e req-364be073-b298-4c74-b390-6b4141597708 service nova] Creating event network-vif-plugged:eef70ef0-ee27-4174-a828-4493e9392ac9 for instance 63104be6-e8da-40df-a9b4-be17a754bf67 on n-h1-854119-9 Aug 29 05:15:56.045024 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d9581fe0-3dd2-4ab2-95c0-3dcfb63d8c6e req-364be073-b298-4c74-b390-6b4141597708 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.425212 Aug 29 05:15:56.046422 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2520/5048] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:56.384784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:56.385350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:56.402186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:56.402883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:56.408211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:56.409435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:56.410172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:56.410781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:57.015640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:57.018935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:57.030005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:57.030968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:57.031719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:57.034164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:57.034851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:57.035452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:57.219482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:57.232371 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-34432c6c-0232-4e72-86b0-c8692e342c58 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.850097 Aug 29 05:15:57.233959 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2529/5049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:56 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:57.381355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:57.392963 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-93c7bd42-62ef-416f-8f81-35d207fa9826 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.401342 Aug 29 05:15:57.406397 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2521/5050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:56 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:57.424368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f2389627-9cb7-493a-ace9-dc1852d9689b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Action: 'create', calling method: .version_select at 0x7f1ab9123310>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1334688955", "policies": ["affinity"]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:57.456867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-f2389627-9cb7-493a-ace9-dc1852d9689b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:57.462250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-f2389627-9cb7-493a-ace9-dc1852d9689b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:57.504948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-f2389627-9cb7-493a-ace9-dc1852d9689b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:57.511574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-f2389627-9cb7-493a-ace9-dc1852d9689b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:57.524719 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f2389627-9cb7-493a-ace9-dc1852d9689b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.289438 Aug 29 05:15:57.525324 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2530/5051] 10.222.0.20 () {60 vars in 1174 bytes} [Mon Aug 29 05:15:57 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:57.535806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-000b8fcb-701e-4a8f-a956-e602a8b3ac37 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Action: 'create', calling method: .version_select at 0x7f1ab9ba5d30>, body: {"server_group": {"name": "tempest-server-group-961526281", "policies": ["affinity"]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:57.553662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-000b8fcb-701e-4a8f-a956-e602a8b3ac37 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:57.558888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-000b8fcb-701e-4a8f-a956-e602a8b3ac37 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:57.625182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-000b8fcb-701e-4a8f-a956-e602a8b3ac37 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:57.631185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-000b8fcb-701e-4a8f-a956-e602a8b3ac37 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:57.645787 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-000b8fcb-701e-4a8f-a956-e602a8b3ac37 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.113766 Aug 29 05:15:57.646939 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2522/5052] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Aug 29 05:15:57 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:57.657535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7a8ff7f-052c-4c59-8487-77b9ebf74dec tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Action: 'create', calling method: .version_select at 0x7f1abd968310>, body: {"server_group": {"name": "tempest-server-group-961526281", "policies": ["affinity"]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:57.677191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a7a8ff7f-052c-4c59-8487-77b9ebf74dec tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:57.679583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:57.684992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a7a8ff7f-052c-4c59-8487-77b9ebf74dec tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:57.734337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a7a8ff7f-052c-4c59-8487-77b9ebf74dec tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:57.740068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a7a8ff7f-052c-4c59-8487-77b9ebf74dec tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:57.753091 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7a8ff7f-052c-4c59-8487-77b9ebf74dec tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.099532 Aug 29 05:15:57.753814 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2531/5053] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Aug 29 05:15:57 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:57.764830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ecf21b18-0d90-4003-b00d-1ee6149510cd tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:57.791426 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ecf21b18-0d90-4003-b00d-1ee6149510cd tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/c06f7765-ec79-4efb-bd67-b4dc75be3292" status: 204 len: 0 microversion: 2.1 time: 0.031054 Aug 29 05:15:57.796502 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2523/5054] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 05:15:57 2022] DELETE /compute/v2.1/os-server-groups/c06f7765-ec79-4efb-bd67-b4dc75be3292 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:15:57.803422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b7385fd-93e5-4734-b060-f0d93136fdbd tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:57.845547 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b7385fd-93e5-4734-b060-f0d93136fdbd tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.047052 Aug 29 05:15:57.852811 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2532/5055] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 05:15:57 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:15:57.863657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-53090d4f-847e-4d25-a55c-e6dc837a1518 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:57.936995 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-53090d4f-847e-4d25-a55c-e6dc837a1518 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/57a9836f-6048-4d12-80b8-98c0a70d1a17" status: 204 len: 0 microversion: 2.1 time: 0.077604 Aug 29 05:15:57.938343 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2524/5056] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 05:15:57 2022] DELETE /compute/v2.1/os-server-groups/57a9836f-6048-4d12-80b8-98c0a70d1a17 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:15:57.947901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e05a46e6-93a2-4f7f-acba-4f6d4e9b46b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:57.980542 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e05a46e6-93a2-4f7f-acba-4f6d4e9b46b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036533 Aug 29 05:15:57.981139 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2533/5057] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 05:15:57 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:57.993257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f0a24c8b-7776-4bd1-b170-7982df6a6b28 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Action: 'create', calling method: .version_select at 0x7f1ab956e280>, body: {"server_group": {"name": "tempest-server-group-193494188", "policies": ["affinity"]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:58.017922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f0a24c8b-7776-4bd1-b170-7982df6a6b28 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:58.024113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f0a24c8b-7776-4bd1-b170-7982df6a6b28 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:58.078140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f0a24c8b-7776-4bd1-b170-7982df6a6b28 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:58.088436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f0a24c8b-7776-4bd1-b170-7982df6a6b28 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:58.108373 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f0a24c8b-7776-4bd1-b170-7982df6a6b28 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.119170 Aug 29 05:15:58.109569 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2525/5058] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Aug 29 05:15:57 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:58.122604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71d1f3f6-b6a4-4c61-b91c-3823c4ebcca8 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:58.167323 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71d1f3f6-b6a4-4c61-b91c-3823c4ebcca8 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/1a470bc1-9b80-4202-88ab-49ffd91a54e7" status: 204 len: 0 microversion: 2.1 time: 0.048413 Aug 29 05:15:58.167925 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2534/5059] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 05:15:58 2022] DELETE /compute/v2.1/os-server-groups/1a470bc1-9b80-4202-88ab-49ffd91a54e7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:15:58.176793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-77dc5091-b1d8-48dd-895a-b129121874db tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:58.216701 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-77dc5091-b1d8-48dd-895a-b129121874db tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040740 Aug 29 05:15:58.221117 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2526/5060] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 05:15:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:58.229189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22eeedf9-5d1c-48aa-bd22-5292ab24c931 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Action: 'create', calling method: .version_select at 0x7f1abda25c10>, body: {"server_group": {"name": "tempest-server-group-220864665", "policies": ["anti-affinity"]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:58.254917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:58.255533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:58.263886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:58.265281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:58.267938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:58.268694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:58.270316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:58.271806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:58.282917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-22eeedf9-5d1c-48aa-bd22-5292ab24c931 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:58.299103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-22eeedf9-5d1c-48aa-bd22-5292ab24c931 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:58.427313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-22eeedf9-5d1c-48aa-bd22-5292ab24c931 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:58.440391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-22eeedf9-5d1c-48aa-bd22-5292ab24c931 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_groups'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:58.470703 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22eeedf9-5d1c-48aa-bd22-5292ab24c931 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.245250 Aug 29 05:15:58.471368 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2535/5061] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Aug 29 05:15:58 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:15:58.480944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:58.488392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:58.499787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:58.501239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:58.501857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:58.502741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:58.503413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:58.504096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:58.569636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:58.585016 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5f0fdcca-fdb4-4579-a2cd-b50dadb9f677 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.330134 Aug 29 05:15:58.586597 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2527/5062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:58 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:15:58.604796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5fa02466-c15b-4ed2-bfeb-8d560ca3e6d5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:58.678573 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5fa02466-c15b-4ed2-bfeb-8d560ca3e6d5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/60948126-3b21-468f-aaaf-5425570f74fb" status: 204 len: 0 microversion: 2.1 time: 0.090096 Aug 29 05:15:58.680077 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2528/5063] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 05:15:58 2022] DELETE /compute/v2.1/os-server-groups/60948126-3b21-468f-aaaf-5425570f74fb => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:15:58.691925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23712ee9-c626-4990-a231-f90950a8285c tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:58.720208 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23712ee9-c626-4990-a231-f90950a8285c tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032192 Aug 29 05:15:58.732712 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2529/5064] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 05:15:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:15:58.814101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:15:58.825183 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-689f257a-c89a-4b23-8d14-5f16c971b790 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1316 microversion: 2.1 time: 0.347701 Aug 29 05:15:58.840895 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2536/5065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:58 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:15:58.939739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-154657910", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "ba020468-6390-4eff-9d7a-9955fe297ee1"}]}, "os:scheduler_hints": {"group": "9c14341e-4f38-4d94-ab40-e1066ea22392"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:15:59.072550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] validate_networks() for [('ba020468-6390-4eff-9d7a-9955fe297ee1', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:15:59.603495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:15:59.612823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:15:59.615141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:15:59.618241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:15:59.619207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:15:59.619744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:15:59.620195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:15:59.633028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:59.644494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:59.645241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:59.647637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:59.648574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:59.652617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:59.661503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:59.669989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:59.670791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:59.671823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:15:59.672593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:15:59.673257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:15:59.725561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:15:59.727205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:15:59.759084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:15:59.811127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:15:59.813619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:15:59.997281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:00.005288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:16:00.020499 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-04eebaab-ecd5-4b32-963e-c408133ee556 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.415571 Aug 29 05:16:00.021434 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2537/5066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:15:59 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:00.023187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:16:00.036767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:00.038597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:00.045050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:00.051551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:00.052297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:00.054902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:00.055601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:00.057575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:00.117458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:16:00.128390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Getting quotas for user e8c0a96a89e04cdb96592ec0845aa5fa and project f4487b1b86ee4bcf9f5538b3ed4b1de4. Resources: {'server_group_members'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:16:00.218294 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b964c9ff-a079-4eb2-939f-cc449f6fc028 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.284240 Aug 29 05:16:00.227547 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2530/5067] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:16:00.239321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b06912f-ae0a-4c41-bd44-6e349b19a35a tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:00.241901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b06912f-ae0a-4c41-bd44-6e349b19a35a tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:00.427455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b06912f-ae0a-4c41-bd44-6e349b19a35a tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:00.439770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:00.457754 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b06912f-ae0a-4c41-bd44-6e349b19a35a tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1212 microversion: 2.1 time: 0.228945 Aug 29 05:16:00.472141 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2531/5068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:00 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1212 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:00.474782 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7073f8f0-8321-429d-b012-9c5d241d7eac tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1505 microversion: 2.1 time: 0.451937 Aug 29 05:16:00.475388 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2538/5069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:00 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:00.509559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:00.510361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:00.519629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:00.522198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:00.524472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:00.525354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:00.525928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:00.528652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:00.609719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:00.615340 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f19f6dd0-2dd3-46df-9adf-43715afdf33e tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67/os-instance-actions/req-84aedc4b-8c42-4dfc-a097-0edd060bf840" status: 200 len: 313 microversion: 2.1 time: 0.116179 Aug 29 05:16:00.616318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2532/5070] 10.222.0.20 () {58 vars in 1419 bytes} [Mon Aug 29 05:16:00 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67/os-instance-actions/req-84aedc4b-8c42-4dfc-a097-0edd060bf840 => generated 313 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:16:00.629281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-53af5ca4-e869-4b32-8bed-e6a47dcf4dfc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:00.631776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-53af5ca4-e869-4b32-8bed-e6a47dcf4dfc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:00.641898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53af5ca4-e869-4b32-8bed-e6a47dcf4dfc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:00.642396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53af5ca4-e869-4b32-8bed-e6a47dcf4dfc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:00.642819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53af5ca4-e869-4b32-8bed-e6a47dcf4dfc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:00.648437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53af5ca4-e869-4b32-8bed-e6a47dcf4dfc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:00.649025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53af5ca4-e869-4b32-8bed-e6a47dcf4dfc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:00.649479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53af5ca4-e869-4b32-8bed-e6a47dcf4dfc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:00.807599 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-53af5ca4-e869-4b32-8bed-e6a47dcf4dfc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "POST /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67/action" status: 202 len: 0 microversion: 2.1 time: 0.182138 Aug 29 05:16:00.808970 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2539/5071] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:16:00 2022] POST /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:16:00.820385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:00.821489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:00.839517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:00.841186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:00.842461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:00.846876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:00.847619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:00.848410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:01.047022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:01.047912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:01.067849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:01.068398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:01.068851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:01.069568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:01.070029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:01.070458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:01.354512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:01.365587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7940dfcf-ed5b-485e-8989-918e901202a3 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1507 microversion: 2.1 time: 0.550300 Aug 29 05:16:01.367917 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2533/5072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:00 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1507 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:01.487055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:01.488032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:01.499411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:01.508675 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5759f7a4-34c6-48eb-bf25-8f73e9edbef2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.465849 Aug 29 05:16:01.512002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:01.512729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:01.513746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:01.514359 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2540/5073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:01 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:01.528821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:01.529609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:01.530219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:01.642704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:01.655134 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ab70045-788e-4c0d-a3ce-eec96b0d661b tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1264 microversion: 2.1 time: 0.171957 Aug 29 05:16:01.657582 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2534/5074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:01 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:02.394149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:02.397194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:02.411837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:02.412498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:02.413037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:02.414239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:02.414951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:02.418271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:02.537156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:02.537921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:02.560461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:02.561107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:02.561639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:02.567422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:02.569695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:02.572658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:02.890604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:02.904225 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fdc800d9-6a16-4563-99be-bf72619dbe4a tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1507 microversion: 2.1 time: 0.512807 Aug 29 05:16:02.906105 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2541/5075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:02 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:02.914071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:02.933276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:02.955369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:02.959551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:02.961498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:02.963541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:02.964680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:02.966258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:03.127240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:03.137834 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0df05ece-a884-4db2-b651-1957aad808cc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1270 microversion: 2.1 time: 0.230305 Aug 29 05:16:03.142273 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2542/5076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:02 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1270 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:03.153619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-abaa84d5-cf60-4946-8386-54d16fb36f42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:03.154122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-abaa84d5-cf60-4946-8386-54d16fb36f42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:03.171447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abaa84d5-cf60-4946-8386-54d16fb36f42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:03.171937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abaa84d5-cf60-4946-8386-54d16fb36f42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:03.172459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abaa84d5-cf60-4946-8386-54d16fb36f42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:03.175999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abaa84d5-cf60-4946-8386-54d16fb36f42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:03.176640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abaa84d5-cf60-4946-8386-54d16fb36f42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:03.177079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abaa84d5-cf60-4946-8386-54d16fb36f42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:03.195406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:03.210324 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c5e6596-a821-4028-9f94-34522023cfed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.678160 Aug 29 05:16:03.211879 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2535/5077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:02 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:03.236174 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-abaa84d5-cf60-4946-8386-54d16fb36f42 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/ips" status: 200 len: 151 microversion: 2.20 time: 0.092531 Aug 29 05:16:03.237436 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2543/5078] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Aug 29 05:16:03 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:16:04.009749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:04.010995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:04.024619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.025650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.027297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:04.029595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.030225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.032572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:04.161695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:04.162912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:04.192780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.193282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.194650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:04.195391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.195849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.196299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:04.693594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:04.706628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2576e757-230f-461a-83a0-97a5f86b0ed5 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1505 microversion: 2.1 time: 0.701806 Aug 29 05:16:04.707231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2536/5079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:04 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1505 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:04.725748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:04.726661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:04.738618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.739294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.743160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:04.744086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.744759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.746018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:04.767164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:04.785157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-96eeb289-d206-4a2d-8096-efb3dea12207 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1312 microversion: 2.1 time: 0.627469 Aug 29 05:16:04.789022 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2544/5080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:04 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1312 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:04.803718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5d6eab97-2cc7-4772-a05c-754cf60f0709 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '.version_select at 0x7f1ab87064c0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:04.804559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5d6eab97-2cc7-4772-a05c-754cf60f0709 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:04.835566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6eab97-2cc7-4772-a05c-754cf60f0709 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.838741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6eab97-2cc7-4772-a05c-754cf60f0709 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.839382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6eab97-2cc7-4772-a05c-754cf60f0709 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:04.840356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6eab97-2cc7-4772-a05c-754cf60f0709 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.843332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6eab97-2cc7-4772-a05c-754cf60f0709 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.843954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d6eab97-2cc7-4772-a05c-754cf60f0709 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:04.943727 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5d6eab97-2cc7-4772-a05c-754cf60f0709 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.141483 Aug 29 05:16:04.944476 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2545/5081] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Aug 29 05:16:04 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67/os-instance-actions => generated 611 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:04.960200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:04.960683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:04.981333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.981906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.982477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:04.986772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:04.987257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:04.987701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:05.047347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:16:05.057442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:05.179524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:05.263255 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d26359da-9ac5-496e-a1c5-c670cd53cb36 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.548677 Aug 29 05:16:05.270145 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2537/5082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:04 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:05.322489 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-64edac15-577f-493c-af31-15bbc96b6373 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 204 len: 0 microversion: 2.1 time: 0.367811 Aug 29 05:16:05.324218 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2546/5083] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:16:04 2022] DELETE /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:16:05.342156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:05.342976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:05.353160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:05.353961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:05.354904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:05.355378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:05.355978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:05.356899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:05.770098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:05.778797 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-caea8512-44ac-44a7-9c92-3b2d0b86e6fc tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1511 microversion: 2.1 time: 0.447834 Aug 29 05:16:05.783688 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2538/5084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:05 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:05.812600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:05.813711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:05.826823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:05.831183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:05.831885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:05.834494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:05.835945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:05.836419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:06.145438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:06.187287 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-183f55eb-a8de-4482-becf-6c66a8e6dd91 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1312 microversion: 2.1 time: 0.379788 Aug 29 05:16:06.208109 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2547/5085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:05 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1312 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:06.287471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:06.288367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:06.317506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:06.318019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:06.318450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:06.319348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:06.319957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:06.320763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:06.328349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:06.500599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:06.501929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:06.522246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:06.523080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:06.523735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:06.524738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:06.525397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:06.526571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:06.620672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lazy-loading 'flavor' on Instance uuid 0212b868-400b-4cd4-9278-f45805cc128f {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:16:06.622364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:06.639966 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a3a017a6-264e-46af-ac68-e7e47a0d8825 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.355293 Aug 29 05:16:06.642393 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2539/5086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:06 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:06.999076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-bdd26b46-ff05-4bdd-9675-dd01d6cf5fc9 req-e499621e-b9df-4f4a-a286-a1b0754f66aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f919476-67a9-4621-b5cd-b42061261131", "tag": "c1519c86-df31-41aa-9d95-a044a18dd8a7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:07.026618 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-82aca057-9676-4ce8-8108-38768f738012 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/action" status: 202 len: 0 microversion: 2.20 time: 0.530013 Aug 29 05:16:07.027653 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2548/5087] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 05:16:06 2022] POST /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:16:07.033967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bdd26b46-ff05-4bdd-9675-dd01d6cf5fc9 req-e499621e-b9df-4f4a-a286-a1b0754f66aa service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:07.036087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:07.037157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:07.040136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bdd26b46-ff05-4bdd-9675-dd01d6cf5fc9 req-e499621e-b9df-4f4a-a286-a1b0754f66aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:07.040996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bdd26b46-ff05-4bdd-9675-dd01d6cf5fc9 req-e499621e-b9df-4f4a-a286-a1b0754f66aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:07.070902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:07.071825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:07.072547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:07.075937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:07.076747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:07.077442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:07.082679 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-bdd26b46-ff05-4bdd-9675-dd01d6cf5fc9 req-e499621e-b9df-4f4a-a286-a1b0754f66aa service nova] Creating event network-changed:c1519c86-df31-41aa-9d95-a044a18dd8a7 for instance 8f919476-67a9-4621-b5cd-b42061261131 on n-h1-854119-9 Aug 29 05:16:07.097306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-bdd26b46-ff05-4bdd-9675-dd01d6cf5fc9 req-e499621e-b9df-4f4a-a286-a1b0754f66aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.440067 Aug 29 05:16:07.106004 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2540/5088] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:07.111438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:07.112154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:07.143691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:07.150203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:07.151017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:07.157670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:07.160556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:07.164640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:07.577284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:07.602949 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0d1542ae-7537-475c-a915-aba2f9e2e452 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1511 microversion: 2.1 time: 0.569384 Aug 29 05:16:07.608282 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2549/5089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:07 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1511 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:07.631571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:07.634249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:07.662431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:07.671703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:07.672651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:07.673300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:07.673300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:07.673736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:07.733786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:07.746763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:07.748539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:07.749930 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff318951-e8a9-40ee-b587-e5b743b43f01 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 0.642742 Aug 29 05:16:07.767829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2541/5090] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:07 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:07.772866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:07.773477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:07.792466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:07.792961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:07.793477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:07.794188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:07.794639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:07.795056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:08.260547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:08.270624 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ca6f55f-22fd-4f2a-87be-daa9302a7c81 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1312 microversion: 2.1 time: 0.660956 Aug 29 05:16:08.277124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:08.277313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2550/5091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:07 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1312 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:08.286742 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3808bec8-714f-440e-bac0-635e5c99a417 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.517749 Aug 29 05:16:08.288685 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2542/5092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:07 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:08.629952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:08.633547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:08.633547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=24 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:08.648710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:08.649963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:08.649963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:08.651197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:08.651636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:08.652618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:08.775346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:08.775947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:08.789381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:08.789890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:08.790844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:08.795117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:08.795702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:08.796162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:08.831145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:08.843914 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b0323dfa-8f14-4a53-8132-ebc2021f03f1 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1469 microversion: 2.1 time: 0.219806 Aug 29 05:16:08.845122 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2551/5093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:08 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:09.084300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:09.109228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:09.122660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:09.123899 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-84c194f0-fe6d-4587-9128-f4f0e24d5024 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 0.352867 Aug 29 05:16:09.125237 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2543/5094] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:08 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:16:09.150133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7a35069a-0d65-4b4b-b965-b7ba8302c293 req-e0e4944a-651e-4fa8-8277-6da8996ef807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63104be6-e8da-40df-a9b4-be17a754bf67", "name": "network-vif-deleted", "tag": "eef70ef0-ee27-4174-a828-4493e9392ac9"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:09.164872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:09.167262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7a35069a-0d65-4b4b-b965-b7ba8302c293 req-e0e4944a-651e-4fa8-8277-6da8996ef807 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:09.168040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7a35069a-0d65-4b4b-b965-b7ba8302c293 req-e0e4944a-651e-4fa8-8277-6da8996ef807 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:09.168922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7a35069a-0d65-4b4b-b965-b7ba8302c293 req-e0e4944a-651e-4fa8-8277-6da8996ef807 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:09.201809 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7a35069a-0d65-4b4b-b965-b7ba8302c293 req-e0e4944a-651e-4fa8-8277-6da8996ef807 service nova] Creating event network-vif-deleted:eef70ef0-ee27-4174-a828-4493e9392ac9 for instance 63104be6-e8da-40df-a9b4-be17a754bf67 on n-h1-854119-9 Aug 29 05:16:09.214504 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7a35069a-0d65-4b4b-b965-b7ba8302c293 req-e0e4944a-651e-4fa8-8277-6da8996ef807 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073786 Aug 29 05:16:09.219066 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2552/5095] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:09.307292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:09.308249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:09.347104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:09.348017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:09.351466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:09.354233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:09.354940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:09.355440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:09.566242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:09.567876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:09.583254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:09.587928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:09.588745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:09.589828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:09.594664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:09.598831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:09.637717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:09.646922 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d63da79-b986-4135-a659-5aa5e8c46ecb tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1312 microversion: 2.1 time: 0.355669 Aug 29 05:16:09.660925 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2544/5096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:09 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:09.822751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:09.833443 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dcde10ad-e987-4657-b29c-3ed3513047cd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.516366 Aug 29 05:16:09.847033 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2553/5097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:09 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:09.862299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:09.867419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:09.868610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:09.879662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:09.883469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:09.883894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:09.885185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:09.889330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:09.889330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:10.048222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca9796b2465471c857daf89cfd2e529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d9460b51b4ec68bf4f1d34ae349d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:10.057290 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6642d17-66ca-4c09-9792-d4410536461b tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 200 len: 1469 microversion: 2.1 time: 0.195981 Aug 29 05:16:10.070673 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2545/5098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:09 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:10.152673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:10.154439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:10.182423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:10.183117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:10.184680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:10.187331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:10.191165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:10.194891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:10.669321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:10.669992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:10.672269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=32 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:10.700112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:10.702618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:10.703806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:10.705483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:10.707395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:10.708098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:11.515347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:11.524326 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0d67ed4d-74ad-46fc-b68f-2a79b10390b9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1312 microversion: 2.1 time: 0.859176 Aug 29 05:16:11.535866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:11.548426 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2546/5099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:10 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1312 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:11.554236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:11.555067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:11.559494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:11.561779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:11.563025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:11.563422 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-14f8cdfb-e01a-462d-a427-280f8e746823 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 1.415635 Aug 29 05:16:11.563619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:11.564068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:11.564573 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2554/5100] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:10 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:11.572257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:11.572257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:11.572257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:11.591271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:11.592364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] [instance: 63104be6-e8da-40df-a9b4-be17a754bf67] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:11.608498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:11.613508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:11.614358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:11.615876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:11.616550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:11.617177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:11.652392 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] HTTP exception thrown: Instance 63104be6-e8da-40df-a9b4-be17a754bf67 could not be found. Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Request method failure captured: Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 HTTP/1.1 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEt14oZfjE3KyIL7vfw350UBqSvaAP-Vn6HiceUAjYmuw5FSbJT-kw0zng1Itq_E9wEVsGfyjDhSaIDmpuPEOscq2mqvG5Fc2XGN3irvMWLZnqs2nxenq-PBPIMG5-AmR3F_GXc6UEwwvX5b1UvEouX-IwQckJ2a1VlBugHZQ2UoHjI Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: c21d9460b51b4ec68bf4f1d34ae349d4 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-InstanceActionsTestJSON-613117935 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c21d9460b51b4ec68bf4f1d34ae349d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c21d9460b51b4ec68bf4f1d34ae349d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c21d9460b51b4ec68bf4f1d34ae349d4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c21d9460b51b4ec68bf4f1d34ae349d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-InstanceActionsTestJSON-613117935 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: c21d9460b51b4ec68bf4f1d34ae349d4 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-InstanceActionsTestJSON-613117935 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-InstanceActionsTestJSON-613117935-project Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 5ca9796b2465471c857daf89cfd2e529 Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-InstanceActionsTestJSON-613117935-project Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 63104be6-e8da-40df-a9b4-be17a754bf67 could not be found. Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '63104be6-e8da-40df-a9b4-be17a754bf67'} Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63104be6-e8da-40df-a9b4-be17a754bf67 could not be found. Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63104be6-e8da-40df-a9b4-be17a754bf67 could not be found. Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:11.657242 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:11.663046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:11.663046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:11.663046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:11.663046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:16:11.663046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:16:11.663046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63104be6-e8da-40df-a9b4-be17a754bf67 could not be found. Aug 29 05:16:11.663046 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:11.663046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] Returning 404 to user: Instance 63104be6-e8da-40df-a9b4-be17a754bf67 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:16:11.664258 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ca225bd3-45ba-4821-bec0-8044be5daca4 tempest-InstanceActionsTestJSON-613117935 tempest-InstanceActionsTestJSON-613117935-project] 10.222.0.20 "GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67" status: 404 len: 111 microversion: 2.1 time: 0.089864 Aug 29 05:16:11.664792 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2555/5101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:11 2022] GET /compute/v2.1/servers/63104be6-e8da-40df-a9b4-be17a754bf67 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:16:12.358148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:12.378711 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-802d6483-3caa-4347-9246-f3d2deac406b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.828002 Aug 29 05:16:12.379878 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2547/5102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:11 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:12.566805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:12.567554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:12.580892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:12.581504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:12.582129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:12.583596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:12.584761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:12.586448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:12.587418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:12.588634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:12.607665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:12.608560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:12.609467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:12.610429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:12.611085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:12.611709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:13.117369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:13.126884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:13.132252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:13.133517 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f260fea3-e9c6-4e32-9091-02eaa8984394 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 0.550465 Aug 29 05:16:13.134106 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2548/5103] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:12 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:13.187664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:13.197268 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3f55b5db-a72e-4c22-98c3-000a10ffa2a5 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1312 microversion: 2.1 time: 0.635648 Aug 29 05:16:13.197846 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2556/5104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:12 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1312 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:13.403319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:13.404274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:13.416394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:13.416904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:13.417343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:13.418061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:13.418519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:13.418945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:13.546686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fb12156a-92a2-47e4-b479-7ab47d16da9a req-4f6b7384-3aff-47a6-bc2f-76491882840c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f919476-67a9-4621-b5cd-b42061261131", "name": "network-vif-plugged", "status": "completed", "tag": "c1519c86-df31-41aa-9d95-a044a18dd8a7"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:13.585400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb12156a-92a2-47e4-b479-7ab47d16da9a req-4f6b7384-3aff-47a6-bc2f-76491882840c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:13.586685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb12156a-92a2-47e4-b479-7ab47d16da9a req-4f6b7384-3aff-47a6-bc2f-76491882840c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:13.602276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb12156a-92a2-47e4-b479-7ab47d16da9a req-4f6b7384-3aff-47a6-bc2f-76491882840c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:13.641479 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fb12156a-92a2-47e4-b479-7ab47d16da9a req-4f6b7384-3aff-47a6-bc2f-76491882840c service nova] Creating event network-vif-plugged:c1519c86-df31-41aa-9d95-a044a18dd8a7 for instance 8f919476-67a9-4621-b5cd-b42061261131 on n-h1-854119-9 Aug 29 05:16:13.665508 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fb12156a-92a2-47e4-b479-7ab47d16da9a req-4f6b7384-3aff-47a6-bc2f-76491882840c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124239 Aug 29 05:16:13.670684 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2557/5105] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:13.813446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:13.822784 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c700ff2-dcd6-4dc2-a7ba-dcdd3cdf371d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.423728 Aug 29 05:16:13.858737 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2549/5106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:13 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:14.161135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:14.162267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:14.174849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:14.175625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:14.176352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:14.181186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:14.182004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:14.182675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:14.220407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:14.221462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:14.234035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:14.234566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:14.235036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:14.235747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:14.236224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:14.236641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:14.560042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:14.569671 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b6e6268-2a35-4b20-84f8-4709bb137248 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1312 microversion: 2.1 time: 0.355019 Aug 29 05:16:14.570266 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2550/5107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:14 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:14.844604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:14.846466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:14.863789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:14.870840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:14.871477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:14.872431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:14.873177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:14.873872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:15.158127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:15.178463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:15.180977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:15.183554 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a295ecde-3200-48fb-9f74-01d57bab3adf tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 1.026795 Aug 29 05:16:15.186560 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2558/5108] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:14 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:15.397368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:15.405222 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dfb9cb0d-6f04-4c55-8155-7ebc780316a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.564683 Aug 29 05:16:15.417216 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2551/5109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:14 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:15.591969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:15.592908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:15.600217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:15.605977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:15.606644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:15.607448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:15.612884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:15.613527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:15.934475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:15.946596 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3e7ee273-3d93-445b-9b4b-6b11754b1bae tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1498 microversion: 2.1 time: 0.358980 Aug 29 05:16:15.964354 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2559/5110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:15 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1498 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:15.971704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88683626-615f-48e6-9df8-a7c7f7280fa3 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:16.003420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.compute.server_groups [None req-88683626-615f-48e6-9df8-a7c7f7280fa3 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Querying cell a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) for 1 instances {{(pid=128871) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 05:16:16.007069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88683626-615f-48e6-9df8-a7c7f7280fa3 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:16.008550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88683626-615f-48e6-9df8-a7c7f7280fa3 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:16.010611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88683626-615f-48e6-9df8-a7c7f7280fa3 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:16.147131 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-88683626-615f-48e6-9df8-a7c7f7280fa3 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/9c14341e-4f38-4d94-ab40-e1066ea22392" status: 200 len: 222 microversion: 2.1 time: 0.180287 Aug 29 05:16:16.147958 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2552/5111] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:16:15 2022] GET /compute/v2.1/os-server-groups/9c14341e-4f38-4d94-ab40-e1066ea22392 => generated 222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:16.159533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:16.160617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:16.173438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:16.177662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:16.178211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:16.179154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:16.183935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:16.184583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:16.210555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:16.211189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:16.223667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:16.225375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:16.226088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:16.236825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:16.237664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:16.239345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:16.261412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:16:16.322244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:16.477236 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84066c66-3f73-45cd-adc7-58a438e0d0ab tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 204 len: 0 microversion: 2.1 time: 0.321958 Aug 29 05:16:16.478280 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2560/5112] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:16:16 2022] DELETE /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:16:16.487410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:16.491457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:16.507809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:16.507809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:16.508478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:16.509350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:16.509809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:16.510237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:16.633624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:16.645100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:16.647538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:16.652967 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2df479eb-3e5d-43a8-81ed-11a9310bdf8f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 0.446345 Aug 29 05:16:16.653579 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2553/5113] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:16 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:16:16.660356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:16.660972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:16.679901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:16.680436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:16.680873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:16.681590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:16.682050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:16.682473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:16.733533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:16.745799 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-849afc4d-df78-4349-b934-61d52b96f2b8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.264773 Aug 29 05:16:16.746729 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2561/5114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:16 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:16.960214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:16.968335 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c7120b76-1b42-4e6b-87c9-55fe37504579 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1504 microversion: 2.1 time: 0.313682 Aug 29 05:16:16.968979 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2554/5115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:16 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:17.491361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf29a745-6558-4fda-a045-a2dd4521abf9 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:17.494083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf29a745-6558-4fda-a045-a2dd4521abf9 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:17.503526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf29a745-6558-4fda-a045-a2dd4521abf9 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:17.504037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf29a745-6558-4fda-a045-a2dd4521abf9 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:17.504503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf29a745-6558-4fda-a045-a2dd4521abf9 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:17.505263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf29a745-6558-4fda-a045-a2dd4521abf9 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:17.505721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf29a745-6558-4fda-a045-a2dd4521abf9 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:17.506149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf29a745-6558-4fda-a045-a2dd4521abf9 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:17.675910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:17.676560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:17.688701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:17.689463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:17.691122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:17.692030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:17.692694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:17.694172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:18.246362 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf29a745-6558-4fda-a045-a2dd4521abf9 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1831 microversion: 2.1 time: 0.759246 Aug 29 05:16:18.258943 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2562/5116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:17 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1831 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:18.271119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:18.272587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:18.290265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:18.290784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:18.291225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:18.291947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:18.292433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:18.292862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:18.455149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:18.464454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:18.472471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:18.474074 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-060d0c83-c879-4d62-8673-41c8cf2ad9c5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 0.802455 Aug 29 05:16:18.476306 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2555/5117] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:17 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:18.493067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:18.493692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:18.501763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:18.502255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:18.502685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:18.503391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:18.503842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:18.515052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:18.716029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:18.751206 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e832f06d-1c39-4ab4-9f30-399f2d69cf01 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.490499 Aug 29 05:16:18.765323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2563/5118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:18 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:18.772493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:18.773573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:18.786119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:18.787122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:18.787774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:18.788742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:18.789420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:18.790015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:18.910679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:18.921204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:18.927488 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a18a08de-6694-4a27-b205-0b8d6389578e tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1504 microversion: 2.1 time: 0.449555 Aug 29 05:16:18.929025 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2556/5119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:18 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:19.342401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:19.356708 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2aa333fc-f14e-4ad2-a7d7-5456d8f9df69 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1680 microversion: 2.1 time: 0.589707 Aug 29 05:16:19.368768 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2564/5120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:18 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1680 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:19.499842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:19.500674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:19.518346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:19.522686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:19.522686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:19.522686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:19.522686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:19.522686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:19.524808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-544b3958-a2ae-4702-a2a6-6aff392e8a54 req-bbc6c209-0fea-4822-b2e8-7251232bf704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f919476-67a9-4621-b5cd-b42061261131", "name": "network-vif-deleted", "tag": "c1519c86-df31-41aa-9d95-a044a18dd8a7"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:19.570700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-544b3958-a2ae-4702-a2a6-6aff392e8a54 req-bbc6c209-0fea-4822-b2e8-7251232bf704 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:19.572621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-544b3958-a2ae-4702-a2a6-6aff392e8a54 req-bbc6c209-0fea-4822-b2e8-7251232bf704 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:19.573066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-544b3958-a2ae-4702-a2a6-6aff392e8a54 req-bbc6c209-0fea-4822-b2e8-7251232bf704 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:19.614444 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-544b3958-a2ae-4702-a2a6-6aff392e8a54 req-bbc6c209-0fea-4822-b2e8-7251232bf704 service nova] Creating event network-vif-deleted:c1519c86-df31-41aa-9d95-a044a18dd8a7 for instance 8f919476-67a9-4621-b5cd-b42061261131 on n-h1-854119-9 Aug 29 05:16:19.630828 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-544b3958-a2ae-4702-a2a6-6aff392e8a54 req-bbc6c209-0fea-4822-b2e8-7251232bf704 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116178 Aug 29 05:16:19.632395 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2565/5121] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:19.645414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17a07fd8-3713-4de0-8b0c-e5ce21bd640f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:19.648019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17a07fd8-3713-4de0-8b0c-e5ce21bd640f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:19.679620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17a07fd8-3713-4de0-8b0c-e5ce21bd640f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:19.681600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17a07fd8-3713-4de0-8b0c-e5ce21bd640f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:19.682161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17a07fd8-3713-4de0-8b0c-e5ce21bd640f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:19.682896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17a07fd8-3713-4de0-8b0c-e5ce21bd640f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:19.684619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17a07fd8-3713-4de0-8b0c-e5ce21bd640f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:19.686091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-17a07fd8-3713-4de0-8b0c-e5ce21bd640f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:19.785802 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17a07fd8-3713-4de0-8b0c-e5ce21bd640f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action" status: 200 len: 32645 microversion: 2.1 time: 0.151579 Aug 29 05:16:19.793594 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2566/5122] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:16:19 2022] POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action => generated 32645 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:16:19.797815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:19.799003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:19.818913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:19.820305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:19.821299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:19.822484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:19.826392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:19.828710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:19.849542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:19.861945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:19.870289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:19.871511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-28746eef-3c2d-4d6f-8fa7-a8506d3bb9f4 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1743 microversion: 2.20 time: 0.376284 Aug 29 05:16:19.872072 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2557/5123] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:19 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1743 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:19.934148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:19.934781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:19.947899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:19.948415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:19.948842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:19.949541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:19.950298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:19.950711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:20.086121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd83c40a4034e4c92bc6d742ecd92655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007ee24def48e9af3dea0b3f72de2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:20.087212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] flavor_id is None. Assuming migration. {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 05:16:20.088000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:16:20.189327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:20.201680 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dfd87d39-9cb5-4179-a717-149b9c5b3385 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.412267 Aug 29 05:16:20.202578 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2567/5124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:19 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:20.207932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:20.208738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:20.219983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:20.220584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:20.222474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:20.223300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:20.223834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:20.224390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:20.288982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:20.289464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:20.290272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:20.291031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lazy-loading 'fault' on Instance uuid 8f919476-67a9-4621-b5cd-b42061261131 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:16:20.379202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c0a96a89e04cdb96592ec0845aa5fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4487b1b86ee4bcf9f5538b3ed4b1de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:20.398200 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8e21b066-52dd-4630-905b-5b53e8bcbe4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 200 len: 1302 microversion: 2.1 time: 0.194357 Aug 29 05:16:20.410010 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2568/5125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:20 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 1302 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:20.732092 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-99de425f-6159-42b8-bd9f-92918f5b9d84 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action" status: 202 len: 0 microversion: 2.1 time: 0.804198 Aug 29 05:16:20.732884 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2558/5126] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:16:19 2022] POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:16:20.741688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:20.742396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:20.749918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:20.750476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:20.750912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:20.751611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:20.757404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:20.758861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:20.902810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:20.904444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:20.926376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:20.926848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:20.927408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:20.928559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:20.929203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:20.933838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:20.996952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:21.006356 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e99b3c2-1697-4c33-bdf6-51bf8733d568 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1689 microversion: 2.1 time: 0.268465 Aug 29 05:16:21.011539 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2569/5127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:20 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1689 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:21.170773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:21.181813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:21.183437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:21.184986 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2629aba-43a8-4055-aa88-42d0b9b6fb39 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1743 microversion: 2.20 time: 0.292195 Aug 29 05:16:21.201480 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2559/5128] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:20 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1743 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:21.223149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:21.223771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:21.230743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.231232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.231666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.236595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.237079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.237504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.438253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:21.439212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:21.449017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.451086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.453169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.456238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.456876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.457646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.504400 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] HTTP exception thrown: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Request method failure captured: Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 HTTP/1.1 Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEuMTqWACkjlbW_avWPerTereNPoNjtSfjR1U_H8EtIHjUt8Zcs1KG_ldscX8M2JnwGM7Ymzds5FHhN4xe8B6BMljYdq-_iuettNMyFk3K9kj_axiTNBtJQ4Ttlqzk1G4bJqffOvxMfIjZKrl_Bctk2j0ObK6idhyKsRY5KlY3X9Rpc Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4487b1b86ee4bcf9f5538b3ed4b1de4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e8c0a96a89e04cdb96592ec0845aa5fa Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8f919476-67a9-4621-b5cd-b42061261131'} Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.515872 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.521583 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.521583 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:21.521583 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:21.521583 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:16:21.521583 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:16:21.521583 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.521583 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.525344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Returning 404 to user: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:16:21.526409 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-687c6b33-44d8-4c25-ae7c-d3dcc5f81bb9 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 404 len: 111 microversion: 2.1 time: 0.092321 Aug 29 05:16:21.528341 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2560/5129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:21 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:16:21.545975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6c1ffd19-b7e7-431c-9cfa-73623bf170dc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:21.576623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:21.608888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.compute.server_groups [None req-6c1ffd19-b7e7-431c-9cfa-73623bf170dc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Querying cell a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) for 1 instances {{(pid=128871) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 05:16:21.611199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c1ffd19-b7e7-431c-9cfa-73623bf170dc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.612777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c1ffd19-b7e7-431c-9cfa-73623bf170dc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.613318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c1ffd19-b7e7-431c-9cfa-73623bf170dc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.638158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:21.653652 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4f781734-056f-4192-9356-f651d133af8a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.432789 Aug 29 05:16:21.655265 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6c1ffd19-b7e7-431c-9cfa-73623bf170dc tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.115676 Aug 29 05:16:21.657681 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2561/5131] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 05:16:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:21.666792 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2570/5131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:21 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:21.673094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c09cf23-7121-4b04-a665-c4dcef2c9453 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:21.738057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.compute.server_groups [None req-8c09cf23-7121-4b04-a665-c4dcef2c9453 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Querying cell a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) for 1 instances {{(pid=128871) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 05:16:21.739280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c09cf23-7121-4b04-a665-c4dcef2c9453 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.741538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c09cf23-7121-4b04-a665-c4dcef2c9453 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.742258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c09cf23-7121-4b04-a665-c4dcef2c9453 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.788568 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c09cf23-7121-4b04-a665-c4dcef2c9453 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/9c14341e-4f38-4d94-ab40-e1066ea22392" status: 200 len: 184 microversion: 2.1 time: 0.121235 Aug 29 05:16:21.790075 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2562/5132] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:16:21 2022] GET /compute/v2.1/os-server-groups/9c14341e-4f38-4d94-ab40-e1066ea22392 => generated 184 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:21.802953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:21.803775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:21.814332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.815191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.816794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.822098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.822797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.823400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.854489 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] HTTP exception thrown: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Request method failure captured: Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 HTTP/1.1 Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEuMTqWACkjlbW_avWPerTereNPoNjtSfjR1U_H8EtIHjUt8Zcs1KG_ldscX8M2JnwGM7Ymzds5FHhN4xe8B6BMljYdq-_iuettNMyFk3K9kj_axiTNBtJQ4Ttlqzk1G4bJqffOvxMfIjZKrl_Bctk2j0ObK6idhyKsRY5KlY3X9Rpc Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4487b1b86ee4bcf9f5538b3ed4b1de4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e8c0a96a89e04cdb96592ec0845aa5fa Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8f919476-67a9-4621-b5cd-b42061261131'} Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:16:21.856283 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Returning 404 to user: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:16:21.860973 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9eb22f1-185f-4e35-bccc-d909a5a8ae42 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 404 len: 111 microversion: 2.1 time: 0.058909 Aug 29 05:16:21.867651 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2571/5133] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:16:21 2022] DELETE /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:16:21.870090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:21.871057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] [instance: 8f919476-67a9-4621-b5cd-b42061261131] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:21.885505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.886125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.887417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.889294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:21.890130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:21.890941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:21.936068 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] HTTP exception thrown: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Request method failure captured: Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 HTTP/1.1 Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEuMTqWACkjlbW_avWPerTereNPoNjtSfjR1U_H8EtIHjUt8Zcs1KG_ldscX8M2JnwGM7Ymzds5FHhN4xe8B6BMljYdq-_iuettNMyFk3K9kj_axiTNBtJQ4Ttlqzk1G4bJqffOvxMfIjZKrl_Bctk2j0ObK6idhyKsRY5KlY3X9Rpc Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4487b1b86ee4bcf9f5538b3ed4b1de4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e8c0a96a89e04cdb96592ec0845aa5fa Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8f919476-67a9-4621-b5cd-b42061261131'} Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.938387 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.943585 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.943585 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:21.943585 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:21.943585 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:16:21.943585 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:16:21.943585 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. Aug 29 05:16:21.943585 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.946299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Returning 404 to user: Instance 8f919476-67a9-4621-b5cd-b42061261131 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:16:21.947422 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a9c106e-1817-4320-95e2-095ff5eea113 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131" status: 404 len: 111 microversion: 2.1 time: 0.083039 Aug 29 05:16:21.948567 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2563/5134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:21 2022] GET /compute/v2.1/servers/8f919476-67a9-4621-b5cd-b42061261131 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:16:21.957056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66942226-8841-4794-a151-70e6af777fe1 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:21.965955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-66942226-8841-4794-a151-70e6af777fe1 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] HTTP exception thrown: Instance group 60948126-3b21-468f-aaaf-5425570f74fb could not be found. Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66942226-8841-4794-a151-70e6af777fe1 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Request method failure captured: Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-server-groups/60948126-3b21-468f-aaaf-5425570f74fb HTTP/1.1 Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEuMTqWACkjlbW_avWPerTereNPoNjtSfjR1U_H8EtIHjUt8Zcs1KG_ldscX8M2JnwGM7Ymzds5FHhN4xe8B6BMljYdq-_iuettNMyFk3K9kj_axiTNBtJQ4Ttlqzk1G4bJqffOvxMfIjZKrl_Bctk2j0ObK6idhyKsRY5KlY3X9Rpc Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4487b1b86ee4bcf9f5538b3ed4b1de4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e8c0a96a89e04cdb96592ec0845aa5fa Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance group 60948126-3b21-468f-aaaf-5425570f74fb could not be found. Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '60948126-3b21-468f-aaaf-5425570f74fb'} Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 60948126-3b21-468f-aaaf-5425570f74fb could not be found. Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 60948126-3b21-468f-aaaf-5425570f74fb could not be found. Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.969892 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.975272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:21.975272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:21.975272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:16:21.975272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:16:21.975272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 60948126-3b21-468f-aaaf-5425570f74fb could not be found. Aug 29 05:16:21.975272 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.975272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66942226-8841-4794-a151-70e6af777fe1 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Returning 404 to user: Instance group 60948126-3b21-468f-aaaf-5425570f74fb could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:16:21.975272 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-66942226-8841-4794-a151-70e6af777fe1 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/60948126-3b21-468f-aaaf-5425570f74fb" status: 404 len: 117 microversion: 2.1 time: 0.019728 Aug 29 05:16:21.975272 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2572/5135] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 05:16:21 2022] DELETE /compute/v2.1/os-server-groups/60948126-3b21-468f-aaaf-5425570f74fb => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:16:21.983927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98346589-659c-4b5b-83ea-a7a67e5e9e4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:21.993714 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-98346589-659c-4b5b-83ea-a7a67e5e9e4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] HTTP exception thrown: Instance group 1a470bc1-9b80-4202-88ab-49ffd91a54e7 could not be found. Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98346589-659c-4b5b-83ea-a7a67e5e9e4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Request method failure captured: Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/os-server-groups/1a470bc1-9b80-4202-88ab-49ffd91a54e7 HTTP/1.1 Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEuMTqWACkjlbW_avWPerTereNPoNjtSfjR1U_H8EtIHjUt8Zcs1KG_ldscX8M2JnwGM7Ymzds5FHhN4xe8B6BMljYdq-_iuettNMyFk3K9kj_axiTNBtJQ4Ttlqzk1G4bJqffOvxMfIjZKrl_Bctk2j0ObK6idhyKsRY5KlY3X9Rpc Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4487b1b86ee4bcf9f5538b3ed4b1de4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e8c0a96a89e04cdb96592ec0845aa5fa Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance group 1a470bc1-9b80-4202-88ab-49ffd91a54e7 could not be found. Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '1a470bc1-9b80-4202-88ab-49ffd91a54e7'} Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1a470bc1-9b80-4202-88ab-49ffd91a54e7 could not be found. Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1a470bc1-9b80-4202-88ab-49ffd91a54e7 could not be found. Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:21.996364 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:22.001000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:22.001000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:22.001000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:16:22.001000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:16:22.001000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1a470bc1-9b80-4202-88ab-49ffd91a54e7 could not be found. Aug 29 05:16:22.001000 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.003730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98346589-659c-4b5b-83ea-a7a67e5e9e4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Returning 404 to user: Instance group 1a470bc1-9b80-4202-88ab-49ffd91a54e7 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:16:22.005127 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-98346589-659c-4b5b-83ea-a7a67e5e9e4d tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/1a470bc1-9b80-4202-88ab-49ffd91a54e7" status: 404 len: 117 microversion: 2.1 time: 0.026514 Aug 29 05:16:22.006417 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2564/5136] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 05:16:21 2022] DELETE /compute/v2.1/os-server-groups/1a470bc1-9b80-4202-88ab-49ffd91a54e7 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:16:22.014681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78d04656-0f86-4686-81c9-3d6715df2551 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:22.026897 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-78d04656-0f86-4686-81c9-3d6715df2551 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] HTTP exception thrown: Instance group 57a9836f-6048-4d12-80b8-98c0a70d1a17 could not be found. Aug 29 05:16:22.033011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:22.033619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78d04656-0f86-4686-81c9-3d6715df2551 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Request method failure captured: Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-server-groups/57a9836f-6048-4d12-80b8-98c0a70d1a17 HTTP/1.1 Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEuMTqWACkjlbW_avWPerTereNPoNjtSfjR1U_H8EtIHjUt8Zcs1KG_ldscX8M2JnwGM7Ymzds5FHhN4xe8B6BMljYdq-_iuettNMyFk3K9kj_axiTNBtJQ4Ttlqzk1G4bJqffOvxMfIjZKrl_Bctk2j0ObK6idhyKsRY5KlY3X9Rpc Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4487b1b86ee4bcf9f5538b3ed4b1de4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e8c0a96a89e04cdb96592ec0845aa5fa Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance group 57a9836f-6048-4d12-80b8-98c0a70d1a17 could not be found. Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '57a9836f-6048-4d12-80b8-98c0a70d1a17'} Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 57a9836f-6048-4d12-80b8-98c0a70d1a17 could not be found. Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 57a9836f-6048-4d12-80b8-98c0a70d1a17 could not be found. Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.037392 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:22.041888 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:22.041888 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:22.041888 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:16:22.041888 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:16:22.041888 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 57a9836f-6048-4d12-80b8-98c0a70d1a17 could not be found. Aug 29 05:16:22.041888 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.041888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78d04656-0f86-4686-81c9-3d6715df2551 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Returning 404 to user: Instance group 57a9836f-6048-4d12-80b8-98c0a70d1a17 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:16:22.041888 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78d04656-0f86-4686-81c9-3d6715df2551 tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/57a9836f-6048-4d12-80b8-98c0a70d1a17" status: 404 len: 117 microversion: 2.1 time: 0.028374 Aug 29 05:16:22.043406 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2573/5137] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 05:16:22 2022] DELETE /compute/v2.1/os-server-groups/57a9836f-6048-4d12-80b8-98c0a70d1a17 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:16:22.044963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:22.045947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:22.046392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:22.051997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:22.052515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:22.052953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:22.056854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c2147bb-4f98-485b-8afb-0a8f18570aca tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:22.067515 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-0c2147bb-4f98-485b-8afb-0a8f18570aca tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] HTTP exception thrown: Instance group c06f7765-ec79-4efb-bd67-b4dc75be3292 could not be found. Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c2147bb-4f98-485b-8afb-0a8f18570aca tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Request method failure captured: Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-server-groups/c06f7765-ec79-4efb-bd67-b4dc75be3292 HTTP/1.1 Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEuMTqWACkjlbW_avWPerTereNPoNjtSfjR1U_H8EtIHjUt8Zcs1KG_ldscX8M2JnwGM7Ymzds5FHhN4xe8B6BMljYdq-_iuettNMyFk3K9kj_axiTNBtJQ4Ttlqzk1G4bJqffOvxMfIjZKrl_Bctk2j0ObK6idhyKsRY5KlY3X9Rpc Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4487b1b86ee4bcf9f5538b3ed4b1de4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4487b1b86ee4bcf9f5538b3ed4b1de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: f4487b1b86ee4bcf9f5538b3ed4b1de4 Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerGroupTestJSON-1553268509 Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e8c0a96a89e04cdb96592ec0845aa5fa Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerGroupTestJSON-1553268509-project Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance group c06f7765-ec79-4efb-bd67-b4dc75be3292 could not be found. Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'c06f7765-ec79-4efb-bd67-b4dc75be3292'} Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c06f7765-ec79-4efb-bd67-b4dc75be3292 could not be found. Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c06f7765-ec79-4efb-bd67-b4dc75be3292 could not be found. Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.070157 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:16:22.076513 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:16:22.076513 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:16:22.076513 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:16:22.076513 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:16:22.076513 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c06f7765-ec79-4efb-bd67-b4dc75be3292 could not be found. Aug 29 05:16:22.076513 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:16:22.079325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c2147bb-4f98-485b-8afb-0a8f18570aca tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Returning 404 to user: Instance group c06f7765-ec79-4efb-bd67-b4dc75be3292 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:16:22.080876 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0c2147bb-4f98-485b-8afb-0a8f18570aca tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/c06f7765-ec79-4efb-bd67-b4dc75be3292" status: 404 len: 117 microversion: 2.1 time: 0.032657 Aug 29 05:16:22.082051 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2574/5138] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 05:16:22 2022] DELETE /compute/v2.1/os-server-groups/c06f7765-ec79-4efb-bd67-b4dc75be3292 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:16:22.092319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-820382a9-9b7c-4a05-b8d8-e9add532bb7a tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:22.144791 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-820382a9-9b7c-4a05-b8d8-e9add532bb7a tempest-ServerGroupTestJSON-1553268509 tempest-ServerGroupTestJSON-1553268509-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/9c14341e-4f38-4d94-ab40-e1066ea22392" status: 204 len: 0 microversion: 2.1 time: 0.056318 Aug 29 05:16:22.146521 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2575/5139] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 29 05:16:22 2022] DELETE /compute/v2.1/os-server-groups/9c14341e-4f38-4d94-ab40-e1066ea22392 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:16:22.209848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:22.210835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:22.224161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:22.225078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:22.226595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:22.230408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:22.231090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:22.231729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:22.433353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:22.460388 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e58e083-a97e-4067-b49c-a472c591345b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1689 microversion: 2.1 time: 0.429016 Aug 29 05:16:22.464199 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2565/5140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:22 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1689 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:22.499493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:22.515387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:22.517358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:22.523503 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23781a63-8351-4843-b659-59622f53fc5b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1743 microversion: 2.20 time: 0.318137 Aug 29 05:16:22.524831 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2576/5141] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:22 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1743 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:22.683286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:22.683929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:22.693825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:22.696780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:22.697675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:22.698519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:22.702031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:22.703820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:23.097042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:23.111605 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1c3e501-a6e6-4047-a8b9-3ebc1045d91b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.433477 Aug 29 05:16:23.124142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2566/5142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:22 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:23.481481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:23.482083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:23.498448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:23.499257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:23.503108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:23.506507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:23.507193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:23.507984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:23.551007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:23.552480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:23.562912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:23.563674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:23.565959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:23.569529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:23.570194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:23.570812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:23.931756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:23.940956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c25c19ea-dbb7-4453-9681-1348aa8aa58a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1689 microversion: 2.1 time: 0.463148 Aug 29 05:16:23.946488 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2577/5143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:23 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1689 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:23.959179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5eff22a1-823e-4091-b8aa-5247c3fb3572 req-76d6237f-b232-4275-ab25-6eaf8ba16443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0212b868-400b-4cd4-9278-f45805cc128f", "name": "network-vif-plugged", "status": "completed", "tag": "cd6eaae0-af11-4f54-97bf-0b3ddd31b12d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:23.984695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5eff22a1-823e-4091-b8aa-5247c3fb3572 req-76d6237f-b232-4275-ab25-6eaf8ba16443 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:23.985817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5eff22a1-823e-4091-b8aa-5247c3fb3572 req-76d6237f-b232-4275-ab25-6eaf8ba16443 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:23.987603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5eff22a1-823e-4091-b8aa-5247c3fb3572 req-76d6237f-b232-4275-ab25-6eaf8ba16443 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:24.015956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5eff22a1-823e-4091-b8aa-5247c3fb3572 req-76d6237f-b232-4275-ab25-6eaf8ba16443 service nova] Creating event network-vif-plugged:cd6eaae0-af11-4f54-97bf-0b3ddd31b12d for instance 0212b868-400b-4cd4-9278-f45805cc128f on n-h1-854119-9 Aug 29 05:16:24.026318 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5eff22a1-823e-4091-b8aa-5247c3fb3572 req-76d6237f-b232-4275-ab25-6eaf8ba16443 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078427 Aug 29 05:16:24.032918 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2578/5144] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:24.070300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:24.089314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:24.094679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:24.096722 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16934145-c582-4675-b44d-dbd6a639b226 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1743 microversion: 2.20 time: 0.549522 Aug 29 05:16:24.099885 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2567/5145] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:23 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1743 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:24.141266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:24.142228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:24.152609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:24.157216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:24.158181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:24.159052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:24.159642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:24.161378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:24.585257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:24.597785 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-493214f7-c3b0-4ae4-b9d6-dabb7671daf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1511 microversion: 2.1 time: 0.462014 Aug 29 05:16:24.614606 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2579/5146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:24 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:24.984018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:24.985480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:25.024261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:25.025397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:25.028138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:25.032356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:25.033299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:25.034112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:25.121305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:25.122081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:25.139056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:25.139558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:25.139996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:25.140778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:25.141256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:25.141655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:25.653663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:25.676816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:25.681504 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2eeccd85-6c88-4eed-af5c-13180591132c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1689 microversion: 2.1 time: 0.713647 Aug 29 05:16:25.685536 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2568/5147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:24 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1689 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:25.698238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:25.699464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:25.707250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:25.711134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:25.730615 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dc1ff2da-9159-41a8-b4c6-f3ce980c0567 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 0.593869 Aug 29 05:16:25.742128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:25.742890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:25.743497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:25.745807 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2580/5148] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:25 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:16:25.746674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:25.751576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:25.752363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:26.294938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:26.308090 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4ae2b1e8-afde-48ca-8657-c642a7a44bac tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1488 microversion: 2.1 time: 0.617775 Aug 29 05:16:26.323544 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2569/5149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:25 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1488 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:26.377814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0b1be1c-15b5-46a1-adfa-200adda412d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:26.395941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e0b1be1c-15b5-46a1-adfa-200adda412d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:26.408011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0b1be1c-15b5-46a1-adfa-200adda412d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:26.408763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0b1be1c-15b5-46a1-adfa-200adda412d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:26.424066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0b1be1c-15b5-46a1-adfa-200adda412d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:26.424470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0b1be1c-15b5-46a1-adfa-200adda412d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:26.427519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0b1be1c-15b5-46a1-adfa-200adda412d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:26.427955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0b1be1c-15b5-46a1-adfa-200adda412d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:26.583641 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0b1be1c-15b5-46a1-adfa-200adda412d1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 200 len: 148 microversion: 2.1 time: 0.243283 Aug 29 05:16:26.584401 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2581/5150] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:16:26 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 148 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:26.598046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:26.600383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:26.618866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:26.626928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:26.628475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:26.630640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:26.635278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:26.636852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:26.706508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:26.707203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:26.722649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:26.723445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:26.724055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:26.725044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:26.725667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:26.726294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:27.156770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:27.171409 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9feecebc-28c1-4870-8bb8-f37d4a898559 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.574341 Aug 29 05:16:27.172957 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2570/5151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:26 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:27.196450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:27.197488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:27.232423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:27.232984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:27.237591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:27.238429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:27.238906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:27.244806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:27.304392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:27.314243 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b8b7e9b1-b7e8-4b6f-9d82-10cb4880ba55 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1694 microversion: 2.1 time: 0.611894 Aug 29 05:16:27.323610 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2582/5152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:26 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1694 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:27.342277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:27.344282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:27.361846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:27.362344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:27.366500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:27.367433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:27.374242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:27.375218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:27.385549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:27.787032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:27.805858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:27.811535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:27.814328 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-81bab860-ef2f-44d2-90e3-397a114509f9 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 0.635925 Aug 29 05:16:27.816072 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2571/5153] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:27 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:27.833419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:27.844480 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba839e0a-4099-48fe-885c-181e375bd204 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.517811 Aug 29 05:16:27.865716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:27.866009 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2583/5154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:27 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:27.866485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:27.875243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:27.878481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:27.879132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:27.879915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:27.882483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:27.882998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:28.163809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:28.177312 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52a7f71f-be0a-4a69-ba20-9abcc49743ba tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.316413 Aug 29 05:16:28.178040 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2572/5155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:27 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:28.202075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:28.202816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:28.224198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:28.224708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:28.225148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:28.225871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:28.232103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:28.232751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:28.345076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:28.346038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:28.360090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:28.360998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:28.362287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:28.363267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:28.363991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:28.365107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:29.154370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:29.162543 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-882925ac-644b-435f-9eb1-03fe02edbcc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1694 microversion: 2.1 time: 0.821377 Aug 29 05:16:29.166805 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2573/5156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:28 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1694 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:29.171786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:29.172425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:29.189895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:29.196503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:29.197161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:29.197618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:29.201810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:29.202321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:29.202751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:29.251044 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-428fec0d-1695-4a75-80c9-03a8a63cbc9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 1.053910 Aug 29 05:16:29.253316 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2584/5157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:28 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:29.515247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1046623763", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:29.655727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:29.668454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:29.670760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:29.672993 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb8dc7c5-cfff-4bfd-ac50-996b741d98a3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 0.505143 Aug 29 05:16:29.674123 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2574/5158] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:29 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:29.692476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] validate_networks() for [('538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:16:30.188298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:30.188908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:30.209828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:30.210705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:30.214027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:30.214801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:30.215300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:30.221627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:30.327461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:31.456914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:31.465286 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e10ae9a9-7e4e-4ef5-9730-e7664b4312c1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1694 microversion: 2.1 time: 1.282618 Aug 29 05:16:31.465865 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2575/5159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:30 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1694 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:31.485476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:31.486110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:31.515704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:31.521518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:31.522127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:31.523421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:31.524074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:31.524722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:32.622925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:16:32.624862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:16:32.625378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:16:32.625795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:16:32.626214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:16:32.657155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:32.657656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:32.658117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:32.658837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:32.659296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:32.659725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:32.738339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:16:32.767819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for user 6fb88aef408746868abb4053768c18c4 and project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:16:32.775095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:32.804800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:32.823566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:32.828951 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ba09bc5b-12a4-453b-b164-d49ec15ddb74 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 1.361837 Aug 29 05:16:32.830116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:16:32.832548 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2576/5160] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:31 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:32.834482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:16:32.849173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:32.850107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:32.888552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:32.902674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:32.905497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:32.906691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:32.924654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:32.929563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:32.963198 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0f83aa1b-ec1d-4127-8075-b5eb749818c4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.451932 Aug 29 05:16:32.969687 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2585/5161] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:16:33.007584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c1023a02-de65-4bf4-8e42-6dacf3a6fe63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:33.008788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c1023a02-de65-4bf4-8e42-6dacf3a6fe63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:33.348656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c1023a02-de65-4bf4-8e42-6dacf3a6fe63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:33.358818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c1023a02-de65-4bf4-8e42-6dacf3a6fe63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1215 microversion: 2.1 time: 0.381712 Aug 29 05:16:33.360220 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2586/5162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:32 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1215 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:33.684607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:33.694327 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16472b01-18bb-40f2-9ffc-6d1ea769603d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1694 microversion: 2.1 time: 0.860458 Aug 29 05:16:33.709429 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2577/5163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:32 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1694 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:33.853107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:33.853642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:33.859835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:33.883068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:33.883573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:33.884027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:33.884783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:33.885236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:33.885781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:34.381066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:34.382484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:34.395608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:34.404699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:34.407966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:34.409804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:34.410282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:34.410707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:34.509383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:34.523241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:34.540377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:34.546360 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a086505-b1cc-472c-a257-15c61127c07f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 0.696918 Aug 29 05:16:34.553867 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2587/5164] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:33 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:34.718930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:34.719814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:34.737632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:34.743248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:34.744011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:34.751049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:34.752872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:34.753622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:35.067069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:35.081202 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ad26dd5-a639-4ab9-bd7f-9cb4a4d5651e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1211 microversion: 2.1 time: 0.703770 Aug 29 05:16:35.082719 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2578/5165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:34 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1211 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:35.582942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:35.585477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:35.602728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:35.603609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:35.605408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:35.612835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:35.615417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:35.616056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:35.887003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:35.927853 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-04e4e14f-884c-4570-bbb4-14235c8e033b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1694 microversion: 2.1 time: 1.209329 Aug 29 05:16:35.932767 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2588/5166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:34 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1694 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:36.109072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:36.109690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:36.126385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:36.130650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:36.135718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:36.136581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:36.137065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:36.137501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:36.532320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:36.548986 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b277f98-1c5f-4246-abeb-31d6b61bcf70 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1273 microversion: 2.1 time: 0.442422 Aug 29 05:16:36.565064 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2589/5167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:36 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1273 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:36.673201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:36.698199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:36.704300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:36.709875 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1e8825e4-ab63-402f-9f07-f9fe02b5c259 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 1.130770 Aug 29 05:16:36.715779 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2579/5168] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:35 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:16:36.956166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:36.958520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:36.976667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:36.979279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:36.981545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:36.986374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:36.988208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:36.989572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:37.577407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:37.577407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:37.604506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:37.605022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:37.605622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:37.606581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:37.608732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:37.610124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:38.010818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:38.030943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-650134e9-b518-4fb5-82cc-1568cb674325 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1273 microversion: 2.1 time: 0.461308 Aug 29 05:16:38.047005 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2580/5169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:37 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1273 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:38.054572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:38.057903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:38.074297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:38.077877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:38.078488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:38.079396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:38.079991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:38.080579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:38.230146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:38.239340 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1530b393-4cf1-402c-9c39-e6750fdee38c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1694 microversion: 2.1 time: 1.288868 Aug 29 05:16:38.239932 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2590/5170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:36 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1694 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:39.057303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:39.059515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:39.074430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:39.075487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:39.076067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:39.077143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:39.077813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:39.078378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:39.460451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:39.468683 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4811a204-5cd2-4dcd-9752-0c7c96863b1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1273 microversion: 2.1 time: 0.416533 Aug 29 05:16:39.488832 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2591/5171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:39 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1273 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:39.504441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:39.505056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:39.519541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:39.529778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:39.531560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:39.539361 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d0c88bec-a2a4-47c2-b798-0fd63c5cf027 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 1.489485 Aug 29 05:16:39.542644 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2581/5172] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:38 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:39.544507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:39.545005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:39.545433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:39.548381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:39.549007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:39.549600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:40.300899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:40.322441 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c352cd36-40cb-42e0-9259-f2b23829c600 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1693 microversion: 2.1 time: 0.827416 Aug 29 05:16:40.323434 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2592/5173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:39 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1693 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:40.494268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:40.495125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:40.513372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:40.519753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:40.522584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:40.523925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:40.527470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:40.528202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:40.568007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:40.569458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:40.599850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:40.602446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:40.604641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:40.606338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:40.610783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:40.614824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:40.830495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:40.839238 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7ce68a6f-192d-4031-ae16-10686822c51d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1273 microversion: 2.1 time: 0.349456 Aug 29 05:16:40.858777 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2582/5174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:40 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1273 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:41.355611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:41.356768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:41.373131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:41.375059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:41.380618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:41.381922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:41.382557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:41.383138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:41.685938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:41.704560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:41.706318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:41.707605 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09494fed-4cc5-4bfc-8796-ac74e63c74c2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 1.144205 Aug 29 05:16:41.708170 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2593/5175] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:40 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:16:41.865089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:41.865750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:41.876029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:41.881476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:41.882171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:41.883103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:41.883711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:41.886920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:41.946094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:41.956617 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f328d15-31fb-4347-8ea8-b5173050e948 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1693 microversion: 2.1 time: 0.609818 Aug 29 05:16:41.964245 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2583/5176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:41 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1693 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:42.102258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:42.114425 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b13b1ef1-6eb0-4a1e-b12c-e63d2d7ca67d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1273 microversion: 2.1 time: 0.255347 Aug 29 05:16:42.118565 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2594/5177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:41 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:42.730884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:42.731527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:42.750762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:42.751267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:42.751704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:42.752460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:42.752918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:42.753341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:42.765222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:43.102531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b334f032-eda0-4d42-8cb3-298eb19acfef req-515b3123-4569-4608-9e0c-bc8940155b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbae68a6-80fa-4e8e-83a2-aab77977bab3", "name": "network-vif-unplugged", "status": "completed", "tag": "7d89d29f-b9f0-4836-a069-9338e7900197"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:43.120255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b334f032-eda0-4d42-8cb3-298eb19acfef req-515b3123-4569-4608-9e0c-bc8940155b65 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:43.120759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b334f032-eda0-4d42-8cb3-298eb19acfef req-515b3123-4569-4608-9e0c-bc8940155b65 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:43.121247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b334f032-eda0-4d42-8cb3-298eb19acfef req-515b3123-4569-4608-9e0c-bc8940155b65 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:43.199053 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b334f032-eda0-4d42-8cb3-298eb19acfef req-515b3123-4569-4608-9e0c-bc8940155b65 service nova] Creating event network-vif-unplugged:7d89d29f-b9f0-4836-a069-9338e7900197 for instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 on n-h2-854119-9 Aug 29 05:16:43.220952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-b334f032-eda0-4d42-8cb3-298eb19acfef req-515b3123-4569-4608-9e0c-bc8940155b65 service nova] Instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:16:43.241573 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b334f032-eda0-4d42-8cb3-298eb19acfef req-515b3123-4569-4608-9e0c-bc8940155b65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.485839 Aug 29 05:16:43.242734 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2595/5178] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:16:43.252808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:43.258599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:43.308253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:43.312407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:43.313036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:43.314214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:43.316090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:43.321155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:43.365368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:44.551714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:44.564174 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9bd45b0a-cc37-4dd8-b754-95b3d941e66a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1693 microversion: 2.1 time: 1.319091 Aug 29 05:16:44.577118 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2596/5179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:43 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1693 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:44.585688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:44.591389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:44.607643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:44.608437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:44.609063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:44.609905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:44.610491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:44.611051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:44.707332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:44.716567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:44.721851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:44.725514 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-73edd558-6b67-482e-932a-dc33031393ed tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 1.998789 Aug 29 05:16:44.726569 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2584/5180] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:42 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:44.842506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1744148215", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "5d847d70-aba4-4069-9f98-67063c10f4df"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:44.946346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] validate_networks() for [('5d847d70-aba4-4069-9f98-67063c10f4df', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:16:45.204625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:45.260290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b108ab3-7204-40b0-8706-75bbb93873b9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1315 microversion: 2.1 time: 0.681700 Aug 29 05:16:45.260942 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2597/5181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:44 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:45.582089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-343750d4-5459-48ee-96a9-04121e2244cc req-f9cfad0e-5080-41e3-9d8d-622fb63a3e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "233460f7-757a-4860-a96e-d2882d36414e", "tag": "063fb146-cd95-4585-9cee-20f6843f7a1d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:45.616589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-343750d4-5459-48ee-96a9-04121e2244cc req-f9cfad0e-5080-41e3-9d8d-622fb63a3e73 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:45.619015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-343750d4-5459-48ee-96a9-04121e2244cc req-f9cfad0e-5080-41e3-9d8d-622fb63a3e73 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:45.626010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-343750d4-5459-48ee-96a9-04121e2244cc req-f9cfad0e-5080-41e3-9d8d-622fb63a3e73 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:45.655342 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-343750d4-5459-48ee-96a9-04121e2244cc req-f9cfad0e-5080-41e3-9d8d-622fb63a3e73 service nova] Creating event network-changed:063fb146-cd95-4585-9cee-20f6843f7a1d for instance 233460f7-757a-4860-a96e-d2882d36414e on n-h1-854119-9 Aug 29 05:16:45.690104 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-343750d4-5459-48ee-96a9-04121e2244cc req-f9cfad0e-5080-41e3-9d8d-622fb63a3e73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116155 Aug 29 05:16:45.691200 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2598/5182] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 05:16:45.696629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:45.710924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:45.718729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:45.720067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:45.720684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:45.721818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:45.722413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:45.723040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:46.387335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:46.402212 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c10f46f4-c5d6-4558-8309-14cca4755c4b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1693 microversion: 2.1 time: 0.708602 Aug 29 05:16:46.402813 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2599/5183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:45 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1693 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:46.420750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:46.421649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:46.443201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:46.446202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:46.451986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:46.453873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:46.454351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:46.454782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:47.062316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:16:47.063435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:16:47.064035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:16:47.064568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:16:47.065100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:16:47.075626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:47.084547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:47.094808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:47.096089 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e562c83e-170a-461c-9782-ba3a59c864dd tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 0.689813 Aug 29 05:16:47.097029 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2600/5184] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:46 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:47.102025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e67f2c51-28c5-4d7d-bcdd-5096407a8c61 req-e804b3e9-14d7-47f1-8f97-16adaec136c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbae68a6-80fa-4e8e-83a2-aab77977bab3", "tag": "7d89d29f-b9f0-4836-a069-9338e7900197"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:47.103823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:47.104286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:47.104720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:47.105442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:47.125745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:47.127273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:47.129394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e67f2c51-28c5-4d7d-bcdd-5096407a8c61 req-e804b3e9-14d7-47f1-8f97-16adaec136c9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:47.130061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e67f2c51-28c5-4d7d-bcdd-5096407a8c61 req-e804b3e9-14d7-47f1-8f97-16adaec136c9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:47.132308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e67f2c51-28c5-4d7d-bcdd-5096407a8c61 req-e804b3e9-14d7-47f1-8f97-16adaec136c9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:47.161516 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e67f2c51-28c5-4d7d-bcdd-5096407a8c61 req-e804b3e9-14d7-47f1-8f97-16adaec136c9 service nova] Creating event network-changed:7d89d29f-b9f0-4836-a069-9338e7900197 for instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 on n-h2-854119-9 Aug 29 05:16:47.185999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-e67f2c51-28c5-4d7d-bcdd-5096407a8c61 req-e804b3e9-14d7-47f1-8f97-16adaec136c9 service nova] Instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:16:47.190265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Getting quotas for project d0bb455c6461489ba69df4c624289a19. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:16:47.203182 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e67f2c51-28c5-4d7d-bcdd-5096407a8c61 req-e804b3e9-14d7-47f1-8f97-16adaec136c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104598 Aug 29 05:16:47.204108 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2601/5185] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:47.209242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Getting quotas for user e396d6a9acf04eed9e05d1f416a0efcf and project d0bb455c6461489ba69df4c624289a19. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:16:47.209359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:47.210047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:47.229418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:47.229914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:47.230350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:47.231057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:47.231694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:47.232315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:47.242173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:16:47.246380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:16:47.490928 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b02f15c8-5cdd-4a39-a212-3e951a0980dd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.762662 Aug 29 05:16:47.491871 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2585/5186] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 05:16:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 05:16:47.502070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:47.502926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:47.519755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:47.520462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:47.521076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:47.525290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:47.525938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:47.526539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:47.981025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:47.995681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:47.999229 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06949ad9-8dfb-4dbc-88f6-c333c4b64338 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1315 microversion: 2.1 time: 0.793914 Aug 29 05:16:48.004911 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2602/5187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:47 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1315 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:48.014835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7923e0a3-7101-410d-aff9-73fcb0f59fdf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:48.016828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7923e0a3-7101-410d-aff9-73fcb0f59fdf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:48.313203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7923e0a3-7101-410d-aff9-73fcb0f59fdf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:48.338392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7923e0a3-7101-410d-aff9-73fcb0f59fdf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:48.340324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7923e0a3-7101-410d-aff9-73fcb0f59fdf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:48.344139 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7923e0a3-7101-410d-aff9-73fcb0f59fdf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1262 microversion: 2.26 time: 0.336338 Aug 29 05:16:48.345727 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2603/5188] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:48 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1262 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:48.351682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:48.356841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:48.374990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:48.375829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:48.377885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:48.378957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:48.380198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:48.381627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:48.408786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:48.422598 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-026d7b76-e3fc-4824-89cb-1a4a43b2430a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1693 microversion: 2.1 time: 0.927467 Aug 29 05:16:48.424420 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2586/5189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:47 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1693 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:48.740825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:48.749941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:48.755801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:48.761110 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af3e43fa-7927-4e4d-b062-1d603d7c5ae5 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 0.414192 Aug 29 05:16:48.763585 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2604/5190] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:48 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:49.025269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:49.025889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:49.047930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:49.048510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:49.048959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:49.049711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:49.050168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:49.050608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:49.374126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:49.374766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:49.398781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:49.400907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:49.402760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:49.407752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:49.413338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:49.413889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:49.539410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:49.551259 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0d8d84f5-a79a-4fbc-bc9c-664c560eb0d6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1315 microversion: 2.1 time: 0.530854 Aug 29 05:16:49.556055 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2587/5191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:49 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:49.578125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:49.579153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:49.602481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:49.610097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:49.612708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:49.617046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:49.617701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:49.620648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:49.634284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:49.644518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:49.656572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:49.657897 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0151b694-bf51-4c5c-8888-176559fb3164 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1266 microversion: 2.26 time: 0.287890 Aug 29 05:16:49.658520 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2605/5192] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:49 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:16:49.786543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:49.787351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:49.813342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:49.815483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:49.818190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:49.819380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:49.819961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:49.832167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:50.244637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:50.255351 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fbb067af-bbaa-4a5e-80d9-6574751c6999 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1691 microversion: 2.1 time: 0.696905 Aug 29 05:16:50.266804 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2588/5193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:49 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1691 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:50.575458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:50.576762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:50.590154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:50.591861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:50.593945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:50.596096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:50.598959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:50.602790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:51.006317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:51.023357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:51.033446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:51.043644 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b9a639c4-6c20-4c59-b5a1-0ef6ca0b0db0 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 1.255036 Aug 29 05:16:51.045139 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2606/5194] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:49 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:51.099297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:51.113151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:51.157837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:51.160784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:51.161367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:51.165333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:51.166989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:51.171825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:51.484278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:51.503198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:51.515051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:51.520689 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-098ed324-bdf5-4c19-9326-32f151e241ba tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1314 microversion: 2.26 time: 0.458323 Aug 29 05:16:51.521725 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2607/5195] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:51 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:51.539894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:51.543488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:51.594129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:51.598372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:51.599035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:51.599912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:51.600539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:51.602606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:52.617027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:52.636395 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-38da6aea-5a4b-4b41-a306-308e378c19ef tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1315 microversion: 2.1 time: 2.062358 Aug 29 05:16:52.637775 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2589/5196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:50 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1315 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:16:52.652389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:52.653358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:52.663109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:52.665156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:52.667478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:52.671935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:52.672965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:52.673632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:52.674282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:53.989327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:54.007688 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a52452b4-0b10-4e78-a18d-896b7289f077 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1691 microversion: 2.1 time: 2.482404 Aug 29 05:16:54.009046 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2608/5197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:51 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1691 bytes in 2485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:54.015980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:54.017362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:54.030395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:54.031152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:54.031762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:54.032721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:54.039599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:54.040838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:55.174427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:55.187931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:55.194899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:55.204539 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8783bf55-9862-47e8-8708-974b9d1c1fc1 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1320 microversion: 2.26 time: 1.191496 Aug 29 05:16:55.210280 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2609/5198] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:54 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1320 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:55.263224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:55.263224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:55.263224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:55.263224 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d27fd40-90cb-4937-9af7-9e4535d2b285 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 2.603581 Aug 29 05:16:55.279171 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2590/5199] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:52 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 2625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:55.283016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:55.283631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:55.285110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:55.286074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:55.295056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:55.295827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:55.296438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:55.298846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:55.299443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:55.300833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:55.317194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:55.317685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:55.318123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:55.318837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:55.320830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:55.320830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:56.421133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:56.433596 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8b72db96-705e-45c0-906d-ee99570552f5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1315 microversion: 2.1 time: 1.221912 Aug 29 05:16:56.437311 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2610/5200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:55 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1315 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:56.444851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:56.448434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:56.481794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:56.483664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:56.490721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:56.491718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:56.492454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:56.493291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:56.615568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:56.629501 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-915bcbfd-dd66-4a6f-a89b-6b5411bf2d62 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1688 microversion: 2.1 time: 1.364507 Aug 29 05:16:56.645142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2591/5201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:55 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1688 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:56.664780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:56.665463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:56.700156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:56.709944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:56.716512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:56.724637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:56.728301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:56.735521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:57.168235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:57.232794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:57.312701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:57.325524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:57.332286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:57.333801 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e282be7c-dfc0-4dfa-89e4-7c87c0c9a7cd tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1362 microversion: 2.26 time: 0.895073 Aug 29 05:16:57.334649 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2611/5202] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:56 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1362 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:57.345726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f94e8b17-db2f-42fb-9450-04829be95102 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:57.351502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f94e8b17-db2f-42fb-9450-04829be95102 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:57.386116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f94e8b17-db2f-42fb-9450-04829be95102 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:57.386747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f94e8b17-db2f-42fb-9450-04829be95102 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:57.387264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f94e8b17-db2f-42fb-9450-04829be95102 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:57.390449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f94e8b17-db2f-42fb-9450-04829be95102 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:57.391119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f94e8b17-db2f-42fb-9450-04829be95102 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:57.392324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f94e8b17-db2f-42fb-9450-04829be95102 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:57.530488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:57.539922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:57.545514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:57.550515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:57.552615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4980e14c-08e2-4cf8-a688-fcd61ffafa2f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1738 microversion: 2.20 time: 0.906623 Aug 29 05:16:57.555212 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2592/5203] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:56 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1738 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:57.601216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-92a23c97-9a58-4ea0-9239-b9caf3909e80 req-f4304aac-573a-45c1-9103-335e4dfd975b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "233460f7-757a-4860-a96e-d2882d36414e", "name": "network-vif-plugged", "status": "completed", "tag": "063fb146-cd95-4585-9cee-20f6843f7a1d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:57.635449 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f94e8b17-db2f-42fb-9450-04829be95102 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action" status: 204 len: 0 microversion: 2.1 time: 0.293164 Aug 29 05:16:57.636648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-92a23c97-9a58-4ea0-9239-b9caf3909e80 req-f4304aac-573a-45c1-9103-335e4dfd975b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:57.638153 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2612/5204] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:16:57 2022] POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:16:57.639670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-92a23c97-9a58-4ea0-9239-b9caf3909e80 req-f4304aac-573a-45c1-9103-335e4dfd975b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:57.641145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-92a23c97-9a58-4ea0-9239-b9caf3909e80 req-f4304aac-573a-45c1-9103-335e4dfd975b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:57.692890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:57.695405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:57.696187 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-92a23c97-9a58-4ea0-9239-b9caf3909e80 req-f4304aac-573a-45c1-9103-335e4dfd975b service nova] Creating event network-vif-plugged:063fb146-cd95-4585-9cee-20f6843f7a1d for instance 233460f7-757a-4860-a96e-d2882d36414e on n-h1-854119-9 Aug 29 05:16:57.724809 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-92a23c97-9a58-4ea0-9239-b9caf3909e80 req-f4304aac-573a-45c1-9103-335e4dfd975b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157720 Aug 29 05:16:57.730935 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2593/5205] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:57.741573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:57.747542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:57.750856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:57.753896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:57.754322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:57.754766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:57.756455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:57.762844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:57.805469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:57.805976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:57.806416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:57.807150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:57.807607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:57.829698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:58.327171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:16:58.481688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:58.496655 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-90f82bfb-8706-478b-9809-d60c7e7e62b5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1315 microversion: 2.1 time: 0.842828 Aug 29 05:16:58.497273 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2613/5206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:57 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1315 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:58.524543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:58.525184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:58.542904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:58.543755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:58.544774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:58.545865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:58.547367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:58.548029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:58.834674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:58.843178 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-013191ef-3366-4e0a-bb13-ae097badbb3b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1688 microversion: 2.1 time: 1.109849 Aug 29 05:16:58.854664 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2594/5207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:57 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1688 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:16:58.859810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:58.866139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:58.892829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:58.893601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:58.894206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:58.895152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:58.896646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:58.899330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:59.165627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:59.184599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:59.188943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:59.193318 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73da8a42-f588-4a8e-807c-e6b45c34a870 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1362 microversion: 2.26 time: 0.676544 Aug 29 05:16:59.196204 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2614/5208] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:58 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1362 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:59.219800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:59.248415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:59.254456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:16:59.257436 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f66dd34c-eaa2-4dec-81e7-f729853ce653 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1720 microversion: 2.20 time: 0.401602 Aug 29 05:16:59.258047 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2595/5209] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:16:58 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1720 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:16:59.528220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:59.528851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:16:59.547410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:59.548350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:59.550522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:59.556050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:59.558146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:59.564808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:59.842052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ab59e7d5-b23c-4eab-8e98-25e201385674 req-79da71ba-c7f0-4c4e-b43a-6e93faf4e23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbae68a6-80fa-4e8e-83a2-aab77977bab3", "name": "network-vif-plugged", "status": "completed", "tag": "7d89d29f-b9f0-4836-a069-9338e7900197"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:16:59.867934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ab59e7d5-b23c-4eab-8e98-25e201385674 req-79da71ba-c7f0-4c4e-b43a-6e93faf4e23f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:16:59.876061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ab59e7d5-b23c-4eab-8e98-25e201385674 req-79da71ba-c7f0-4c4e-b43a-6e93faf4e23f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:16:59.876833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ab59e7d5-b23c-4eab-8e98-25e201385674 req-79da71ba-c7f0-4c4e-b43a-6e93faf4e23f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:16:59.928554 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ab59e7d5-b23c-4eab-8e98-25e201385674 req-79da71ba-c7f0-4c4e-b43a-6e93faf4e23f service nova] Creating event network-vif-plugged:7d89d29f-b9f0-4836-a069-9338e7900197 for instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 on n-h2-854119-9 Aug 29 05:16:59.947660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-ab59e7d5-b23c-4eab-8e98-25e201385674 req-79da71ba-c7f0-4c4e-b43a-6e93faf4e23f service nova] Instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:16:59.980036 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ab59e7d5-b23c-4eab-8e98-25e201385674 req-79da71ba-c7f0-4c4e-b43a-6e93faf4e23f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142150 Aug 29 05:16:59.983102 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2596/5210] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:16:59.998569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:16:59.999773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:00.020444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:00.025722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:00.028009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:00.029627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:00.035079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:00.035593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:00.482114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:00.494273 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e548bcf0-e6e7-4404-b4bc-7ed233d4f6d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1315 microversion: 2.1 time: 0.968091 Aug 29 05:17:00.496261 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2615/5211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:59 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:00.504870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:00.505491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:00.543114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:00.544622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:00.545706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:00.548290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:00.548932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:00.550513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:00.997250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:01.006407 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-268d8a83-ee8d-402d-9a9f-2b9af6d50390 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1688 microversion: 2.1 time: 1.021789 Aug 29 05:17:01.016863 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2597/5212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:16:59 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1688 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:01.026540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:01.036137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:01.046067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:01.046803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:01.059026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:01.063034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:01.065195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:01.068931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:01.233232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:01.246359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:01.248236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:01.249772 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-521e82af-0ace-496f-97bb-e9bce8f1cec4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1362 microversion: 2.26 time: 0.752250 Aug 29 05:17:01.250871 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2616/5213] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:00 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1362 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:01.416646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-765946680", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:01.529409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] validate_networks() for [('d1ccab09-9509-41ec-a212-c518ace49a1d', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:17:02.835609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:02.853319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:02.858286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:02.859530 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b52e709d-2666-47ac-aeb0-bc95420fbcec tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1720 microversion: 2.20 time: 1.841020 Aug 29 05:17:02.860094 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2598/5214] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:01 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1720 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:02.874202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c805b501-e91e-4769-8535-bb2d51a1fef1 req-fe67d485-fa06-4e2e-8043-7da0702344d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd41253-027b-4a17-9aca-2e9ff08c4c38", "tag": "5ae47d2b-e267-47f4-9da8-cbda0f1551e5"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:02.898386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c805b501-e91e-4769-8535-bb2d51a1fef1 req-fe67d485-fa06-4e2e-8043-7da0702344d6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:02.900175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c805b501-e91e-4769-8535-bb2d51a1fef1 req-fe67d485-fa06-4e2e-8043-7da0702344d6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:02.901345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c805b501-e91e-4769-8535-bb2d51a1fef1 req-fe67d485-fa06-4e2e-8043-7da0702344d6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:02.932614 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c805b501-e91e-4769-8535-bb2d51a1fef1 req-fe67d485-fa06-4e2e-8043-7da0702344d6 service nova] Creating event network-changed:5ae47d2b-e267-47f4-9da8-cbda0f1551e5 for instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 on n-h1-854119-9 Aug 29 05:17:02.942911 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c805b501-e91e-4769-8535-bb2d51a1fef1 req-fe67d485-fa06-4e2e-8043-7da0702344d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070186 Aug 29 05:17:02.945731 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2599/5215] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:02.959085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:02.961911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:02.975159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:02.982683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:02.983245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:02.984095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:02.984821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:02.985349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:03.728936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:03.739322 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c89e3301-a9a3-426d-92e9-801c6cde4049 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1503 microversion: 2.1 time: 0.792087 Aug 29 05:17:03.740296 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2600/5216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:02 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1503 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:03.759801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:03.761173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:03.783904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:03.784702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:03.785310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:03.786434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:03.788309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:03.789421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:03.920088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:17:03.920943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:17:03.921539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:17:03.922054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:17:03.922590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:17:03.941409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:03.942057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:03.942643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:03.944710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:03.945463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:03.947123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:04.000255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Getting quotas for project 63bbfe3da13249fa9f9fe77f7725d037. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:17:04.009141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Getting quotas for user b9574a5f99bf4401a8a2297c71d3e382 and project 63bbfe3da13249fa9f9fe77f7725d037. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:17:04.021850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=69 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:04.045796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:17:04.063241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:17:04.096235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:04.106651 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9d3ae66d-4e80-446c-82ac-b22ce93c332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1688 microversion: 2.1 time: 0.363074 Aug 29 05:17:04.107324 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2601/5217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:03 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1688 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:04.122028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4f6a5199-20c9-433c-9b6a-0408551ad2a5 req-6ba55a98-4489-423b-b125-da3d401d8641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0212b868-400b-4cd4-9278-f45805cc128f", "name": "network-vif-unplugged", "status": "completed", "tag": "cd6eaae0-af11-4f54-97bf-0b3ddd31b12d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:04.144811 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d671fe6e-e3b3-49bf-b0f9-045852632acf tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.889730 Aug 29 05:17:04.145899 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2617/5218] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:17:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:17:04.153303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:04.154016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:04.154853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4f6a5199-20c9-433c-9b6a-0408551ad2a5 req-6ba55a98-4489-423b-b125-da3d401d8641 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:04.155410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4f6a5199-20c9-433c-9b6a-0408551ad2a5 req-6ba55a98-4489-423b-b125-da3d401d8641 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:04.155863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4f6a5199-20c9-433c-9b6a-0408551ad2a5 req-6ba55a98-4489-423b-b125-da3d401d8641 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:04.163253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:04.163833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:04.164382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:04.168052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:04.182729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:04.183480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:04.193901 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4f6a5199-20c9-433c-9b6a-0408551ad2a5 req-6ba55a98-4489-423b-b125-da3d401d8641 service nova] Creating event network-vif-unplugged:cd6eaae0-af11-4f54-97bf-0b3ddd31b12d for instance 0212b868-400b-4cd4-9278-f45805cc128f on n-h1-854119-9 Aug 29 05:17:04.203174 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4f6a5199-20c9-433c-9b6a-0408551ad2a5 req-6ba55a98-4489-423b-b125-da3d401d8641 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087903 Aug 29 05:17:04.203780 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2602/5219] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:04.215236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1cb1957e-c6f3-48b6-816a-d54122354283 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:04.223276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1cb1957e-c6f3-48b6-816a-d54122354283 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:04.239035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb1957e-c6f3-48b6-816a-d54122354283 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:04.241464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb1957e-c6f3-48b6-816a-d54122354283 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:04.244713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb1957e-c6f3-48b6-816a-d54122354283 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:04.245632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb1957e-c6f3-48b6-816a-d54122354283 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:04.246252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb1957e-c6f3-48b6-816a-d54122354283 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:04.246827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb1957e-c6f3-48b6-816a-d54122354283 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:04.477306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:04.500828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:04.502344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:04.514892 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-678f3f3b-90f9-40b5-afc9-971283db6fa9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1362 microversion: 2.26 time: 0.366934 Aug 29 05:17:04.515505 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2618/5220] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:04 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:04.520948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:04.521561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:04.543222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:04.543999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:04.544476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:04.545349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:04.545864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:04.546284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:04.812991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:04.823211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:04.835128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:04.842645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:04.843949 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-809ebdcf-5e4d-4cc3-834c-1de58943309a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1720 microversion: 2.20 time: 0.327281 Aug 29 05:17:04.847050 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2619/5221] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:04 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1720 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:04.862672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de96b877-99a4-4f80-9307-c0b00f6863dc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:04.865487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de96b877-99a4-4f80-9307-c0b00f6863dc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:04.995563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de96b877-99a4-4f80-9307-c0b00f6863dc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:05.005680 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de96b877-99a4-4f80-9307-c0b00f6863dc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1221 microversion: 2.1 time: 0.157340 Aug 29 05:17:05.006600 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2620/5222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:04 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1221 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:05.130028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:05.130828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:05.152611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:05.153125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:05.153569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:05.154289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:05.154747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:05.155238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:05.517274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:05.528771 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9e1e27a9-f1b9-415a-8e7c-727500cf82c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1688 microversion: 2.1 time: 0.403848 Aug 29 05:17:05.529895 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2621/5223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:05 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1688 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:05.535263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1695506662", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:05.611277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] validate_networks() for [('d1ccab09-9509-41ec-a212-c518ace49a1d', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:17:05.735116 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1cb1957e-c6f3-48b6-816a-d54122354283 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action" status: 200 len: 14 microversion: 2.1 time: 1.523879 Aug 29 05:17:05.736102 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2603/5224] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:04 2022] POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action => generated 14 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:17:05.742132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:05.743017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:05.772537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:05.777654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:05.778272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:05.781352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:05.781957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:05.783484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:06.322243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:06.332040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:06.333547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:06.348527 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7c7e156-b133-46bf-bbfe-f9e7d0981d24 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1362 microversion: 2.26 time: 0.610750 Aug 29 05:17:06.349055 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2604/5225] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:05 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1362 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:06.390926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:06.391666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:06.416378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:06.417867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:06.420866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:06.421938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:06.423333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:06.424769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:06.613410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:17:06.614474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:17:06.615148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:17:06.615704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:17:06.616291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:17:06.660708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:06.661557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:06.663098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:06.664102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:06.666045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:06.667461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:06.735586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Getting quotas for project 63bbfe3da13249fa9f9fe77f7725d037. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:17:06.749942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Getting quotas for user b9574a5f99bf4401a8a2297c71d3e382 and project 63bbfe3da13249fa9f9fe77f7725d037. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:17:06.798946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:17:06.812902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:17:06.911741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:06.923050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:06.929505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:06.931141 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f2a884d-27f3-43b2-985b-99d728484316 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1720 microversion: 2.20 time: 0.567727 Aug 29 05:17:06.932239 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2605/5226] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:06 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1720 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:06.937814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:06.938844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:06.957879 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cde5c8c3-e860-4d51-a303-cdd65b38f04f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.426726 Aug 29 05:17:06.958552 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2622/5227] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:17:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:17:06.990151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98bcb178-3933-463a-a38e-aa229f949544 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:07.004983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98bcb178-3933-463a-a38e-aa229f949544 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:07.012534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:07.014568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:07.016530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:07.022094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:07.025634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:07.026164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:07.044695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98bcb178-3933-463a-a38e-aa229f949544 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:07.045197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98bcb178-3933-463a-a38e-aa229f949544 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:07.045728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98bcb178-3933-463a-a38e-aa229f949544 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:07.064347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98bcb178-3933-463a-a38e-aa229f949544 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:07.064990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98bcb178-3933-463a-a38e-aa229f949544 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:07.065434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98bcb178-3933-463a-a38e-aa229f949544 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:07.323201 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98bcb178-3933-463a-a38e-aa229f949544 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action" status: 200 len: 14 microversion: 2.1 time: 0.335665 Aug 29 05:17:07.326267 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2623/5228] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:06 2022] POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action => generated 14 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:17:07.354157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e818d56a-c669-4490-b2bf-ad2edb4fef87 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:07.370503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e818d56a-c669-4490-b2bf-ad2edb4fef87 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:07.941649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e818d56a-c669-4490-b2bf-ad2edb4fef87 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:07.954006 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e818d56a-c669-4490-b2bf-ad2edb4fef87 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1222 microversion: 2.1 time: 0.625897 Aug 29 05:17:07.961078 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2624/5229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:07 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1222 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:07.975000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:07.975627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:07.999453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:08.004701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:08.006917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:08.007812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:08.010538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:08.013482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:08.662311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:08.680998 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bdff133f-dd0f-4829-837f-a2fc79ddde00 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1688 microversion: 2.1 time: 1.746031 Aug 29 05:17:08.684269 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2606/5230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:06 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1688 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:08.710246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:08.719818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:08.741743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:08.746237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:08.747177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:08.750552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:08.751319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:08.753497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:08.815608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:08.829841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:08.842196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:08.853620 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dd99e0af-7bdb-4a04-8755-802682a2ca1d tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1362 microversion: 2.26 time: 0.891335 Aug 29 05:17:08.868582 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2625/5231] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:07 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1362 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:08.876969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ede4c76e-6937-4dc9-aa39-7f0ab90d51fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:08.879328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ede4c76e-6937-4dc9-aa39-7f0ab90d51fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:08.902876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede4c76e-6937-4dc9-aa39-7f0ab90d51fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:08.902876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede4c76e-6937-4dc9-aa39-7f0ab90d51fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:08.903209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede4c76e-6937-4dc9-aa39-7f0ab90d51fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:08.917604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede4c76e-6937-4dc9-aa39-7f0ab90d51fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:08.918475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede4c76e-6937-4dc9-aa39-7f0ab90d51fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:08.919098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ede4c76e-6937-4dc9-aa39-7f0ab90d51fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:09.042157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ede4c76e-6937-4dc9-aa39-7f0ab90d51fc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action" status: 200 len: 14 microversion: 2.1 time: 0.172169 Aug 29 05:17:09.042882 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2626/5232] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:08 2022] POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:17:09.085367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:09.090997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:09.122093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:09.122847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:09.123429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:09.124408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:09.124993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:09.125548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:09.652206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:09.667309 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a570c109-33f3-4eb5-8a3b-da13490e791e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1218 microversion: 2.1 time: 0.598740 Aug 29 05:17:09.669088 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2627/5233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:09 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1218 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:09.678116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:09.692646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:09.695691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:09.700600 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ae9a4cab-7296-488d-9a4f-ac958e781779 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1663 microversion: 2.20 time: 1.014483 Aug 29 05:17:09.702834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2607/5234] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:08 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1663 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:09.702973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:09.703917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:09.719117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:09.721330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:09.723561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:09.725438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:09.728165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:09.728535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:09.729721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bddf1202-9dae-4d3e-8336-d07df6bd0262 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a94e7b5c-68ea-4b21-b57d-92bf734f236d"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:09.732646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bddf1202-9dae-4d3e-8336-d07df6bd0262 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:09.744653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bddf1202-9dae-4d3e-8336-d07df6bd0262 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:09.745750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bddf1202-9dae-4d3e-8336-d07df6bd0262 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:09.746477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bddf1202-9dae-4d3e-8336-d07df6bd0262 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:09.747729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bddf1202-9dae-4d3e-8336-d07df6bd0262 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:09.748917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bddf1202-9dae-4d3e-8336-d07df6bd0262 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:09.749551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bddf1202-9dae-4d3e-8336-d07df6bd0262 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:10.360487 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bddf1202-9dae-4d3e-8336-d07df6bd0262 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.634895 Aug 29 05:17:10.361500 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2608/5235] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Aug 29 05:17:09 2022] POST /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/os-volume_attachments => generated 188 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 05:17:10.372528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:10.373358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:10.389451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:10.390121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:10.390798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:10.391619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:10.392649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:10.394799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:10.437514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:11.105320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:11.117598 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9191fdfb-7613-4e04-9b85-80ebed4f0bbe tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1680 microversion: 2.1 time: 1.417047 Aug 29 05:17:11.118661 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2628/5236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:09 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1680 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:11.134276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c6edc7e3-2fe6-41f4-bd4e-76e92f339d3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:11.136938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c6edc7e3-2fe6-41f4-bd4e-76e92f339d3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:11.155547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6edc7e3-2fe6-41f4-bd4e-76e92f339d3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.156055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6edc7e3-2fe6-41f4-bd4e-76e92f339d3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.158683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6edc7e3-2fe6-41f4-bd4e-76e92f339d3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:11.159426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6edc7e3-2fe6-41f4-bd4e-76e92f339d3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.159894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6edc7e3-2fe6-41f4-bd4e-76e92f339d3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.161023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6edc7e3-2fe6-41f4-bd4e-76e92f339d3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:11.211163 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c6edc7e3-2fe6-41f4-bd4e-76e92f339d3e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action" status: 200 len: 14 microversion: 2.1 time: 0.090915 Aug 29 05:17:11.212075 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2629/5237] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:11 2022] POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:17:11.218674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70b6b953-00ba-48ce-b351-c66c6e527147 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:11.219680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-70b6b953-00ba-48ce-b351-c66c6e527147 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:11.248983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70b6b953-00ba-48ce-b351-c66c6e527147 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.250053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70b6b953-00ba-48ce-b351-c66c6e527147 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.250702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70b6b953-00ba-48ce-b351-c66c6e527147 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:11.251596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70b6b953-00ba-48ce-b351-c66c6e527147 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.252289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70b6b953-00ba-48ce-b351-c66c6e527147 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.252894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70b6b953-00ba-48ce-b351-c66c6e527147 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:11.497035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:11.509543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:11.511543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:11.512892 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a0f4b4b-c009-480e-bc8d-86d52b3cf240 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1362 microversion: 2.26 time: 1.144582 Aug 29 05:17:11.513636 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2609/5238] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:10 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1362 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:11.540136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:11.541381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:11.550516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.551387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.552051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:11.553638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.554426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.556296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:11.632977 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70b6b953-00ba-48ce-b351-c66c6e527147 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/os-volume_attachments/a94e7b5c-68ea-4b21-b57d-92bf734f236d" status: 202 len: 0 microversion: 2.20 time: 0.418424 Aug 29 05:17:11.636952 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2630/5239] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Aug 29 05:17:11 2022] DELETE /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/os-volume_attachments/a94e7b5c-68ea-4b21-b57d-92bf734f236d => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:17:11.641333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:11.652627 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7cbcef95-949d-43ea-b185-a8732da07fde tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1280 microversion: 2.1 time: 0.124652 Aug 29 05:17:11.665748 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2610/5240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:11 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1280 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:11.732085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:11.733239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:11.757870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.759455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.760082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:11.761005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.761626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.762261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:11.798061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128872) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 05:17:11.916457 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ac0b0ec1-3302-43b4-b262-b9e62d6175ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "POST /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/action" status: 202 len: 0 microversion: 2.20 time: 0.194766 Aug 29 05:17:11.921632 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2631/5241] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 29 05:17:11 2022] POST /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:17:11.928285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:11.928988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:11.939320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.939857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.940391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:11.941216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:11.941671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:11.942173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:12.147141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9c73ca11-1d37-47c0-ac1d-6ec8ca7ad75f req-f35f5872-c467-4e70-8377-c5aecd269378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd41253-027b-4a17-9aca-2e9ff08c4c38", "name": "network-vif-plugged", "status": "completed", "tag": "5ae47d2b-e267-47f4-9da8-cbda0f1551e5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:12.164239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c73ca11-1d37-47c0-ac1d-6ec8ca7ad75f req-f35f5872-c467-4e70-8377-c5aecd269378 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:12.168992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c73ca11-1d37-47c0-ac1d-6ec8ca7ad75f req-f35f5872-c467-4e70-8377-c5aecd269378 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:12.169576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c73ca11-1d37-47c0-ac1d-6ec8ca7ad75f req-f35f5872-c467-4e70-8377-c5aecd269378 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:12.208255 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9c73ca11-1d37-47c0-ac1d-6ec8ca7ad75f req-f35f5872-c467-4e70-8377-c5aecd269378 service nova] Creating event network-vif-plugged:5ae47d2b-e267-47f4-9da8-cbda0f1551e5 for instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 on n-h1-854119-9 Aug 29 05:17:12.220667 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9c73ca11-1d37-47c0-ac1d-6ec8ca7ad75f req-f35f5872-c467-4e70-8377-c5aecd269378 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077118 Aug 29 05:17:12.221915 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2632/5242] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:12.229011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11d7a53c-91db-48b5-81ba-a824358f8b55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:12.259437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-11d7a53c-91db-48b5-81ba-a824358f8b55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:12.284468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:12.287570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11d7a53c-91db-48b5-81ba-a824358f8b55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:12.291214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11d7a53c-91db-48b5-81ba-a824358f8b55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:12.291901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11d7a53c-91db-48b5-81ba-a824358f8b55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:12.294333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11d7a53c-91db-48b5-81ba-a824358f8b55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:12.296876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11d7a53c-91db-48b5-81ba-a824358f8b55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:12.297746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:12.298420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11d7a53c-91db-48b5-81ba-a824358f8b55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:12.305777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:12.307020 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2cfeae33-7db5-4396-a57c-e82f5fc01f36 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1671 microversion: 2.20 time: 0.382659 Aug 29 05:17:12.323648 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2611/5243] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:11 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1671 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:12.390078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11d7a53c-91db-48b5-81ba-a824358f8b55 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action" status: 200 len: 14 microversion: 2.1 time: 0.166549 Aug 29 05:17:12.394231 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2633/5244] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:12 2022] POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:17:12.544715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:12.545363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:12.561049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:12.561848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:12.562494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:12.563356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:12.563952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:12.564539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:12.679060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:12.679906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:12.696583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:12.697103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:12.697542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:12.698245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:12.698696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:12.699119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:12.942464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:12.952282 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40acd142-e2dc-490c-8f91-a94b332929d7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1280 microversion: 2.1 time: 0.280833 Aug 29 05:17:12.967243 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2634/5245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:12 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1280 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:13.105427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:13.118629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:13.124449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:13.129450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1f338e0c-c4a9-4a67-a1eb-cdf516144468 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1362 microversion: 2.26 time: 0.587324 Aug 29 05:17:13.132016 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2612/5246] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:12 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:13.331226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:13.331865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:13.342570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:13.343068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:13.343493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:13.344222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:13.353777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:13.364847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:13.402010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3779c26e-3139-4538-be55-458ec1006475 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:13.404751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3779c26e-3139-4538-be55-458ec1006475 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:13.422421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3779c26e-3139-4538-be55-458ec1006475 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:13.422912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3779c26e-3139-4538-be55-458ec1006475 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:13.423344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3779c26e-3139-4538-be55-458ec1006475 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:13.424049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3779c26e-3139-4538-be55-458ec1006475 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:13.439461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3779c26e-3139-4538-be55-458ec1006475 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:13.439871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3779c26e-3139-4538-be55-458ec1006475 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:13.594904 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3779c26e-3139-4538-be55-458ec1006475 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action" status: 200 len: 8208 microversion: 2.1 time: 0.196546 Aug 29 05:17:13.596677 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2613/5247] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:13 2022] POST /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e/action => generated 8208 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:13.610454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:13.611427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:13.625817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:13.629725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:13.630705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:13.633321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:13.636154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:13.637775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:13.960704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:13.972217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:13.974108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:13.975873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43bd846c-63fb-4322-bf85-d9a72ce5d99d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1671 microversion: 2.20 time: 0.648638 Aug 29 05:17:13.977088 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2635/5248] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:13 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1671 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:13.984820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:13.986989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:14.004446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:14.005400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:14.006207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:14.007138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:14.007790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:14.008763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:14.472444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:14.490297 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44708081-7b96-4f92-b1bd-b03a4563bfaf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.881614 Aug 29 05:17:14.494077 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2614/5249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:13 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:14.508223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:14.513321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:14.527278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:14.527775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:14.528241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:14.530948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:14.531420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:14.531887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:14.835572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:14.850314 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9040b236-e1ee-4fb3-8d9f-d83b20037570 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 0.870748 Aug 29 05:17:14.851472 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2636/5250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:13 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:14.863342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:14.864436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:14.882996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:14.883728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:14.884378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:14.885273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:14.885864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:14.886444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:14.910048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:14.927869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:14.930696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:14.933311 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-389cb479-d6c4-46e5-af33-baea313c4eac tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1546 microversion: 2.26 time: 0.437889 Aug 29 05:17:14.948538 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2615/5251] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:14 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1546 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:14.966001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd81d790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:14.977341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:14.977968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:14.978559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:14.979042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:15.010113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:15.010744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:15.011189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:15.011918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:15.012409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:15.012836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:15.051549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:15.052056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:15.052508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:15.076052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:15.076716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:15.077678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:15.117832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:15.144694 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39114b49-f43a-46ed-a736-89c170056912 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-649767402" status: 201 len: 0 microversion: 2.26 time: 0.188801 Aug 29 05:17:15.152663 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2616/5252] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Aug 29 05:17:14 2022] PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-649767402 => generated 0 bytes in 197 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 29 05:17:15.161777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:15.162645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:15.169962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:15.170920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:15.171797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:15.172828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:15.173292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:15.174002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:15.413349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:15.415744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:15.422245 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1beb2227-199c-4905-bd8b-feae0d78b895 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.569503 Aug 29 05:17:15.436417 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2637/5253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:14 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:15.436417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25fa6519-0625-4b54-9a63-b8a71b99557a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd913ca0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:15.454274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25fa6519-0625-4b54-9a63-b8a71b99557a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:15.454948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25fa6519-0625-4b54-9a63-b8a71b99557a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:15.455520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25fa6519-0625-4b54-9a63-b8a71b99557a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:15.492880 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-25fa6519-0625-4b54-9a63-b8a71b99557a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-649767402" status: 204 len: 0 microversion: 2.26 time: 0.067255 Aug 29 05:17:15.493641 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2638/5254] 10.222.0.20 () {60 vars in 1358 bytes} [Mon Aug 29 05:17:15 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-649767402 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:17:15.507938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:15.508580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:15.515537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:15.516067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:15.516525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:15.517221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:15.517841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:15.518428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.055154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:16.064103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:16.065573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:16.073076 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c0467261-62f5-4465-891e-fcbdfd73a94b tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.918852 Aug 29 05:17:16.073690 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2617/5255] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:15 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:16.087371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1ab9c15310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:16.104103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:16.104629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:16.105070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.105552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:16.121319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:16.121946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:16.122383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.123091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:16.123601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:16.124018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.179856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:16.186085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:16.186538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.217335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:16.247632 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64af10f4-eced-4243-a9a0-0c105051ca76 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 204 len: 0 microversion: 2.26 time: 0.172614 Aug 29 05:17:16.251714 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2618/5256] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Aug 29 05:17:16 2022] DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:17:16.266259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:16.268243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:16.276375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:16.276890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:16.277377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.278254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:16.278701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:16.279123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.279377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:16.288098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-04955ba7-b1fd-4fc8-8f03-581e011f833b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.793247 Aug 29 05:17:16.293377 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2639/5257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:15 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:16.305601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b500e0bb-58ac-4bb3-989c-295799d1cbe4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd7f3af0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:16.322673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b500e0bb-58ac-4bb3-989c-295799d1cbe4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:16.323193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b500e0bb-58ac-4bb3-989c-295799d1cbe4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:16.323621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b500e0bb-58ac-4bb3-989c-295799d1cbe4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.351523 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b500e0bb-58ac-4bb3-989c-295799d1cbe4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 200 len: 12 microversion: 2.26 time: 0.056242 Aug 29 05:17:16.352657 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2640/5258] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 05:17:16 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:16.359707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:16.361435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:16.388024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:16.389155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:16.398205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.399642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:16.400469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:16.401048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:16.706973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:17.364488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:17.385645 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0ef50ea-b4b0-44ea-acca-59c1a3a34731 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 1.031708 Aug 29 05:17:17.391775 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2641/5259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:16 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:17.396994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1ab8a25040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:17.421330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.427550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.428247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.428909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:17.449040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.450104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.450689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.451716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.452854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.453437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.491263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.491931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.492529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.493068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:17.503378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.504080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.504679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.504791 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6223b6c9-497d-4eaf-adf3-94d13c24fe6a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 1.250670 Aug 29 05:17:17.505298 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2619/5260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:16 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:17.517899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:17.517899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:17.533826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.534563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.535425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.536475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.537113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.538180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.563053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:17.600310 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a362ca78-82b5-492e-8d9a-9cddd06f5b26 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-242503641" status: 201 len: 0 microversion: 2.26 time: 0.207034 Aug 29 05:17:17.601534 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2642/5261] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Aug 29 05:17:17 2022] PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-242503641 => generated 0 bytes in 209 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 05:17:17.606353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f8cca282-d1ab-48c0-8c2e-41745234c8eb req-2058a50e-b784-47c6-b9d9-6314782532b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad", "tag": "8dff913e-f7b3-4847-8d11-cb56b6128a5a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:17.616563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f8cca282-d1ab-48c0-8c2e-41745234c8eb req-2058a50e-b784-47c6-b9d9-6314782532b5 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.617491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f8cca282-d1ab-48c0-8c2e-41745234c8eb req-2058a50e-b784-47c6-b9d9-6314782532b5 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.618063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f8cca282-d1ab-48c0-8c2e-41745234c8eb req-2058a50e-b784-47c6-b9d9-6314782532b5 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.631253 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f8cca282-d1ab-48c0-8c2e-41745234c8eb req-2058a50e-b784-47c6-b9d9-6314782532b5 service nova] Creating event network-changed:8dff913e-f7b3-4847-8d11-cb56b6128a5a for instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad on n-h1-854119-9 Aug 29 05:17:17.638794 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f8cca282-d1ab-48c0-8c2e-41745234c8eb req-2058a50e-b784-47c6-b9d9-6314782532b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034176 Aug 29 05:17:17.639519 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2643/5262] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:17.644887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:17.645775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:17.655266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.656151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.656740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.657784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.658384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.658940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.717828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Locking {{(pid=128872) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 29 05:17:17.784853 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e2d80ef3-e33f-4a74-be2f-9a382f35ac7f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.143847 Aug 29 05:17:17.788363 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2644/5263] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:17 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:17:17.806385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41431a11-85f9-4908-a858-07f35c0020d9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd8cd0d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:17.814440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41431a11-85f9-4908-a858-07f35c0020d9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.814922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41431a11-85f9-4908-a858-07f35c0020d9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.815509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41431a11-85f9-4908-a858-07f35c0020d9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.862872 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-41431a11-85f9-4908-a858-07f35c0020d9 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 200 len: 35 microversion: 2.26 time: 0.072358 Aug 29 05:17:17.869472 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2645/5264] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 05:17:17 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 35 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:17.875453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:17.876400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:17.884496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.885087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.885643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.887416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:17.888334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:17.888908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:17.953944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=16 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:18.143809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:18.156552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:18.159979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:18.161468 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f2ba47d2-1d00-40ce-9f0a-5cf70efbad77 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.655242 Aug 29 05:17:18.162249 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2620/5265] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:17 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:18.192979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd820ee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:18.210918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.211531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.218598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.220106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:18.238211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.239122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.240701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.242602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.245059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.246698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.299211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.301922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.303310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.339513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:18.359113 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6cd6492-a5f7-4ee7-90ab-058c4a6a415b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-242503641" status: 204 len: 0 microversion: 2.26 time: 0.194827 Aug 29 05:17:18.360436 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2621/5266] 10.222.0.20 () {60 vars in 1361 bytes} [Mon Aug 29 05:17:18 2022] DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-242503641 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:17:18.369436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72648dbd-19a4-4501-a12d-41a905bd6a0a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1ab8c13a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:18.396190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72648dbd-19a4-4501-a12d-41a905bd6a0a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.397053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72648dbd-19a4-4501-a12d-41a905bd6a0a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.402108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72648dbd-19a4-4501-a12d-41a905bd6a0a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.435367 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72648dbd-19a4-4501-a12d-41a905bd6a0a tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 200 len: 12 microversion: 2.26 time: 0.070247 Aug 29 05:17:18.450789 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2622/5267] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 05:17:18 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 12 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:18.478511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1ab9653790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:18.513790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.514493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.523824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.526690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:18.548809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.550417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.551314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.553788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:18.554784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.556739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.558586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.561875 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ac70500f-5dba-43cc-9ae2-fb5cb724245a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.690681 Aug 29 05:17:18.576227 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2646/5268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:17 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:18.576227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:18.576227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:18.590336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:18.593650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.594613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.595256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.606051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.606683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.607118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.607864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.608346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.608765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.609215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:18.683809 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c4500c63-7f13-4f94-ae95-222fd3226193 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 204 len: 0 microversion: 2.26 time: 0.225036 Aug 29 05:17:18.684851 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2623/5269] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Aug 29 05:17:18 2022] DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:17:18.724776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-07ed660e-ee34-4eca-b69a-1539c0a81b61 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:18.744863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07ed660e-ee34-4eca-b69a-1539c0a81b61 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.745362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07ed660e-ee34-4eca-b69a-1539c0a81b61 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.745798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-07ed660e-ee34-4eca-b69a-1539c0a81b61 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.834961 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-07ed660e-ee34-4eca-b69a-1539c0a81b61 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] HTTP exception thrown: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 is locked Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-07ed660e-ee34-4eca-b69a-1539c0a81b61 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Request method failure captured: Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action HTTP/1.1 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 15 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpt711V-DkfxL3VEZgCWvjNAVYnvAajXI7V7o8qGH-z4dbsjGc7C8bNufcEhDFxri8E0Df4oEkwcFcVXiSGb12eNEBLTEd5ZIZkX5j2ntm_tFVlI6nnJf1YFVrEI93hrwEM28xw-aPdZZ8tXK1u-geCSUVNtPvQPBPt_bA_IAffD9I Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164260d628ac492481d9d3524036abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164260d628ac492481d9d3524036abf8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-430818047 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6fb88aef408746868abb4053768c18c4 Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: {"os-stop": {}} Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 is locked Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '5e7d9e6b-96d5-4f68-b699-77e111d26429', 'body': {'os-stop': {}}} Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 is locked Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 is locked Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 is locked Aug 29 05:17:18.836629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:18.840533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-07ed660e-ee34-4eca-b69a-1539c0a81b61 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Returning 409 to user: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 is locked {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:17:18.840533 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-07ed660e-ee34-4eca-b69a-1539c0a81b61 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 409 len: 107 microversion: 2.1 time: 0.141095 Aug 29 05:17:18.840533 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2624/5270] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:18 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 107 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:17:18.858675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd87b160>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:18.904320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.905288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.905891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.906409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:18.916988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.917495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.917939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.918662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.919118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.919543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:18.993334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:18.994911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:18.995505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.014079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.014838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.015484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.083517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:19.119395 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2bfca4a5-6ea4-4a8e-b8f6-02a2bbd74d7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-418866668" status: 201 len: 0 microversion: 2.26 time: 0.278044 Aug 29 05:17:19.122231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2625/5271] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Aug 29 05:17:18 2022] PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-418866668 => generated 0 bytes in 283 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 05:17:19.129545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:19.135595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:19.149212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.151755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.154396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.155580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.157780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.158538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.312931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Unlocking {{(pid=128871) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 05:17:19.465826 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-649c9bbb-549a-4e6d-acd3-79f75f36f74f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.340858 Aug 29 05:17:19.470037 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2626/5272] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:19 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:17:19.476538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd87b5e0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:19.508453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:19.513057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.513534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.515539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.516073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:19.519187 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1155650a-7fd1-4122-8b27-3f1249755174 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 0.952422 Aug 29 05:17:19.520331 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2647/5273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:18 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:19.525572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:19.526428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:19.533433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.534350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.535006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.535908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.536589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.538020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.540707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.541214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.541653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.542924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.542924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.543325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.628997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.630712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.632465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.663231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.664868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.667112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.726115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:19.744234 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-58f0edd1-0202-466a-9271-002ee3bd0e58 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-163877900" status: 201 len: 0 microversion: 2.26 time: 0.272998 Aug 29 05:17:19.744907 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2627/5274] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Aug 29 05:17:19 2022] PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-163877900 => generated 0 bytes in 274 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 05:17:19.756382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c244bf71-1413-43d4-98fa-d60817484427 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:19.765439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c244bf71-1413-43d4-98fa-d60817484427 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.765903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c244bf71-1413-43d4-98fa-d60817484427 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.766378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c244bf71-1413-43d4-98fa-d60817484427 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.776549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:19.790404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:19.792886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:19.797035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c244bf71-1413-43d4-98fa-d60817484427 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Going to try to stop instance {{(pid=128871) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 05:17:19.797815 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a3d6c252-d0dc-4630-9b19-8679880de2b3 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.276118 Aug 29 05:17:19.802590 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2648/5275] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:19 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:19.808020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-52130b49-7c09-4403-b6c2-c6d691c5cc1e req-f2fa4aa3-59e2-4da4-9913-62313d51b5db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbfbf67c-0d97-4987-ab70-671c27ee0e87", "tag": "24580187-5a1f-4a69-911d-d88f1019377a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:19.828064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-52130b49-7c09-4403-b6c2-c6d691c5cc1e req-f2fa4aa3-59e2-4da4-9913-62313d51b5db service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.829344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-52130b49-7c09-4403-b6c2-c6d691c5cc1e req-f2fa4aa3-59e2-4da4-9913-62313d51b5db service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.830133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-52130b49-7c09-4403-b6c2-c6d691c5cc1e req-f2fa4aa3-59e2-4da4-9913-62313d51b5db service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.847491 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-52130b49-7c09-4403-b6c2-c6d691c5cc1e req-f2fa4aa3-59e2-4da4-9913-62313d51b5db service nova] Creating event network-changed:24580187-5a1f-4a69-911d-d88f1019377a for instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 on n-h1-854119-9 Aug 29 05:17:19.853055 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c244bf71-1413-43d4-98fa-d60817484427 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.106674 Aug 29 05:17:19.853205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-52130b49-7c09-4403-b6c2-c6d691c5cc1e req-f2fa4aa3-59e2-4da4-9913-62313d51b5db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049186 Aug 29 05:17:19.854409 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2649/5276] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:19.856766 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2628/5277] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:19 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:17:19.862829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd7f3790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:19.867000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:19.867707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:19.872237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.873306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.874029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.874817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:19.880924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:19.884155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.885239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.885858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.886216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.886993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.887889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.888523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.890719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.891300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.899420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.899906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.900609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.918883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.919767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.920444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.939442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:19.961986 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-866a5358-4d10-4324-9f65-79cdca8b8eaa tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 204 len: 0 microversion: 2.26 time: 0.106033 Aug 29 05:17:19.962674 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2650/5278] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Aug 29 05:17:19 2022] DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:17:19.972377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08a89efc-b2d2-4aeb-bae6-e64cb1f1ee7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1ab93cd0d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:19.980952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08a89efc-b2d2-4aeb-bae6-e64cb1f1ee7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:19.981665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08a89efc-b2d2-4aeb-bae6-e64cb1f1ee7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:19.982243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08a89efc-b2d2-4aeb-bae6-e64cb1f1ee7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:19.992994 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08a89efc-b2d2-4aeb-bae6-e64cb1f1ee7b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 200 len: 12 microversion: 2.26 time: 0.025232 Aug 29 05:17:19.999876 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2651/5279] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 05:17:19 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:20.005189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1ab8b2d310>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:20.015458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.016415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.017101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.018131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:20.027761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.028604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.029595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.030574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.031479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.032251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.076172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.076692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.077322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.087550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=4,nova_cell1:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:20.120200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:20.130131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:20.139685 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-26b4d35d-637c-4e88-9d1d-7a2c1bd6ea9f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.278694 Aug 29 05:17:20.150545 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2629/5280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:19 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:20.154056 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-040a49bd-01a3-4345-b315-c9285b82f1ed tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 204 len: 0 microversion: 2.26 time: 0.152521 Aug 29 05:17:20.154840 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2652/5281] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Aug 29 05:17:20 2022] DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:17:20.165067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd86eee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:20.175850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.176388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.176892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.177438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:20.183107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.183666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.184187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.185067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.185592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.186255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.213546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.213958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.214553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.223933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.227519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.227993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.255853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:20.275624 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f98f930b-f074-4e7c-b4a7-f778d31b8184 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-640534838" status: 201 len: 0 microversion: 2.26 time: 0.115258 Aug 29 05:17:20.281229 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2630/5282] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Aug 29 05:17:20 2022] PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-640534838 => generated 0 bytes in 117 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 05:17:20.287152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1abd968040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:20.299424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.300279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.300920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.301600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:20.310218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.311077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.311839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.312992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.313722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.314337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.347762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.348473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.349057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.358437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.359113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.359694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.386353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:20.405574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6636e015-a68f-4681-90f8-2ee099c5e958 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-291956049" status: 201 len: 0 microversion: 2.26 time: 0.122335 Aug 29 05:17:20.408173 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2653/5283] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Aug 29 05:17:20 2022] PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags/tempest-tag-291956049 => generated 0 bytes in 124 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 05:17:20.415952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Action: 'update_all', calling method: .version_select at 0x7f1ab8d38dc0>, body: {"tags": ["tempest-tag-1267265250", "tempest-tag-1708648378"]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:20.426031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.426444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.426930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.427412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:20.433205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.434595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.434595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.438750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.439262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.439702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.445740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=82,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=6,nova_cell1:RELEASE=3,nova_cell1:UPDATE=5 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:20.466024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.466503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.466978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.494945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:20.514058 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b6c9c588-d040-4770-8f62-958cacbf6b2b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 200 len: 62 microversion: 2.26 time: 0.102141 Aug 29 05:17:20.519819 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2631/5284] 10.222.0.20 () {62 vars in 1312 bytes} [Mon Aug 29 05:17:20 2022] PUT /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 62 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:20.525135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd843863-b8eb-4f0b-94af-271e56bb916f tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1ab8a25940>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:20.534683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd843863-b8eb-4f0b-94af-271e56bb916f tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.535177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd843863-b8eb-4f0b-94af-271e56bb916f tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.535614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd843863-b8eb-4f0b-94af-271e56bb916f tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.546408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:20.547038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:20.549060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:20.563696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.564234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.564681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.565420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.567835 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd843863-b8eb-4f0b-94af-271e56bb916f tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 200 len: 62 microversion: 2.26 time: 0.046740 Aug 29 05:17:20.568516 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2654/5285] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 29 05:17:20 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 62 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:20.573064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.574192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.579637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '.version_select at 0x7f1ab8b47550>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:20.588706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.589999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.590732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.591534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:20.611927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.612504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.613273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.614221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.615259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.615699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.643016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.644372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.645304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.663277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lazy-loading 'flavor' on Instance uuid 8cd41253-027b-4a17-9aca-2e9ff08c4c38 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:20.685413 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-36ec1373-f72a-4829-bca9-dc9a10334377 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags" status: 204 len: 0 microversion: 2.26 time: 0.109831 Aug 29 05:17:20.691456 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2655/5286] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Aug 29 05:17:20 2022] DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38/tags => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:17:20.699588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:20.700106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:20.706709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.707209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.707644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.708528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.708993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.709415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.742718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:17:20.777684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:20.792289 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8fd743e-e468-4197-a5e0-863d84acc79b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 0.251797 Aug 29 05:17:20.793649 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2632/5287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:20 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:20.833990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:20.835395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:20.844057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.845449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.846034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.847175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.848113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.849005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.876111 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a91c520f-09c5-4c6e-b014-eab91466949b tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 204 len: 0 microversion: 2.26 time: 0.182867 Aug 29 05:17:20.877604 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2656/5288] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:17:20 2022] DELETE /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:17:20.892469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:20.893559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:20.904620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.905206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.905726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:20.906515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:20.907226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:20.907995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:21.122608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:21.126188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:21.132527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:21.135638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:21.136878 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf17e6f9-a722-4a11-9929-196f975878fb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.306839 Aug 29 05:17:21.138337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:21.139865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:21.141095 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-14cf5214-2244-4b2e-b5a3-3478aa576a94 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1552 microversion: 2.26 time: 0.254423 Aug 29 05:17:21.148847 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2657/5289] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:20 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1552 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:17:21.148993 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2633/5290] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:20 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:17:21.171531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:21.173384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:21.183673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:21.184422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:21.184640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:21.185348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:21.185834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:21.187320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:21.352996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:21.363680 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45fd3d5f-ce5a-4a2c-a007-ceebd74715d5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.204747 Aug 29 05:17:21.364391 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2658/5291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:21 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:21.815241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:21.816763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:21.830403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:21.833043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:21.834636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:21.838362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:21.839097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:21.840334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:22.082106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:22.103175 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1f61fda-8b94-47e0-aecc-eed589e73381 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 0.292089 Aug 29 05:17:22.106870 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2634/5292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:21 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:22.160527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:22.161098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:22.172691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:22.174671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:22.180297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:22.180800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:22.181244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:22.181974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:22.182431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:22.182854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:22.186395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:22.187348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:22.188067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:22.190142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:22.190961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:22.191854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:22.909009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:22.918360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:22.925366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:22.926911 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4990fca6-9e5d-4fba-a625-5900d85a378c tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1552 microversion: 2.26 time: 0.760397 Aug 29 05:17:22.947382 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2635/5293] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:22 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1552 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:17:22.954455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:22.955388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:22.963500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:22.964344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:22.965100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:22.966074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:22.966755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:22.968217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:22.991551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:23.006064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:23.008978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:23.010906 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dcea74b8-7f54-4588-9b0e-7ec206227220 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.854219 Aug 29 05:17:23.021720 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2659/5294] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:22 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:23.129800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:23.130432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:23.141422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:23.142608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:23.144908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:23.145668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:23.148352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:23.149139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:23.154826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:23.167522 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-964b1e39-91d0-456a-9d1d-b0ea2523250a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.217888 Aug 29 05:17:23.168419 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2636/5295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:22 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:23.376589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:23.393886 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb6b22a7-d1a8-4f77-a7bf-b94369a3fe32 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 0.268251 Aug 29 05:17:23.395221 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2660/5296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:23 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:23.950464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:23.951082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:23.963939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:23.964488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:23.964930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:23.965648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:23.986149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:23.987111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:24.035079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:24.035628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:24.045992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:24.046341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:24.046780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:24.054629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:24.055115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:24.055552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:24.510896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:24.542743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:24.550819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:24.553756 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5520c266-bdfe-40e2-84a2-fdf5769ede50 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1552 microversion: 2.26 time: 0.607575 Aug 29 05:17:24.559562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:24.560494 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2637/5297] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:23 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1552 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:24.574978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:24.585157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:24.588302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:24.594956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:24.598269 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b70cdf9-6e74-4e72-be5c-0977f9786df8 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.567248 Aug 29 05:17:24.601703 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2661/5298] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:24 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:24.607363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:24.614477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:24.616241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:24.617037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:24.619016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:24.619610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:24.620175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:24.623685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:24.637956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:24.638534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:24.639178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:24.640938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:24.646527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:24.647185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:25.650727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:25.660579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:25.661963 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-899539d3-df77-4de2-81b0-9948fc793c9f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 1.057691 Aug 29 05:17:25.664299 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2662/5299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:24 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:25.677523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ffa8bb8-409d-4378-9ee4-a088174089ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 1.113034 Aug 29 05:17:25.680279 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2638/5300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:24 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:25.684100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9c00a492-9fe6-4992-8d47-28c3204e7373 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:25.686584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9c00a492-9fe6-4992-8d47-28c3204e7373 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:25.689987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:25.690503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:25.693515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c00a492-9fe6-4992-8d47-28c3204e7373 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:25.694173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c00a492-9fe6-4992-8d47-28c3204e7373 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:25.694740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c00a492-9fe6-4992-8d47-28c3204e7373 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:25.695572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c00a492-9fe6-4992-8d47-28c3204e7373 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:25.696178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c00a492-9fe6-4992-8d47-28c3204e7373 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:25.696741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c00a492-9fe6-4992-8d47-28c3204e7373 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:25.722509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:25.723113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:25.723557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:25.730413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:25.734039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:25.734504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:25.773632 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9c00a492-9fe6-4992-8d47-28c3204e7373 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action" status: 200 len: 24571 microversion: 2.1 time: 0.095045 Aug 29 05:17:25.775029 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2663/5301] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:25 2022] POST /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3/action => generated 24571 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:17:25.783387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:25.784342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:25.799096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:25.800681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:25.803199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:25.804149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:25.804754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:25.806093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:26.367445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:26.383783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:26.385135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:26.385595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:26.387450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e37367fb-22bc-40e5-b733-40f90ba08972 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1552 microversion: 2.26 time: 0.705729 Aug 29 05:17:26.388420 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2639/5302] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:25 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1552 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:26.397143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:26.399434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:26.400802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-61c3b5ba-0557-46a5-ae7a-e3fa880bf113 req-f3d009a9-2ce4-493e-9738-c31156f1e890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad", "name": "network-vif-plugged", "status": "completed", "tag": "8dff913e-f7b3-4847-8d11-cb56b6128a5a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:26.409005 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c844799e-1270-49a4-85e0-006038bf3106 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.626432 Aug 29 05:17:26.411145 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2664/5303] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:25 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:26.423443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-61c3b5ba-0557-46a5-ae7a-e3fa880bf113 req-f3d009a9-2ce4-493e-9738-c31156f1e890 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:26.423924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-61c3b5ba-0557-46a5-ae7a-e3fa880bf113 req-f3d009a9-2ce4-493e-9738-c31156f1e890 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:26.432452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-61c3b5ba-0557-46a5-ae7a-e3fa880bf113 req-f3d009a9-2ce4-493e-9738-c31156f1e890 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:26.465201 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-61c3b5ba-0557-46a5-ae7a-e3fa880bf113 req-f3d009a9-2ce4-493e-9738-c31156f1e890 service nova] Creating event network-vif-plugged:8dff913e-f7b3-4847-8d11-cb56b6128a5a for instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad on n-h1-854119-9 Aug 29 05:17:26.479647 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-61c3b5ba-0557-46a5-ae7a-e3fa880bf113 req-f3d009a9-2ce4-493e-9738-c31156f1e890 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088641 Aug 29 05:17:26.480630 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2640/5304] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:26.688443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:26.689766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:26.701855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:26.702518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:26.703211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:26.703633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:26.704378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:26.706724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:26.707530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:26.708406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:26.711485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:26.711978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:26.712444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:26.725559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:26.726154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:26.726632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:27.376274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:27.380885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:DELETE=2,nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:27.393574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0a7a54c3-c3ee-449b-93c0-aadf6059e407 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 0.709460 Aug 29 05:17:27.394636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:27.399183 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2665/5305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:26 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:27.402925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-839b60a8-3161-466e-9b65-4629a6b2f870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.704937 Aug 29 05:17:27.403488 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2641/5306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:26 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:27.422546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:27.423156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:27.430605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:27.431095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:27.431688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:27.432502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:27.433007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:27.433819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:27.434519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:27.435019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:27.446743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:27.450498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:27.451129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:27.451991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:27.452652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:27.453213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:27.809823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:27.817745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:27.823285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:27.825308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:27.829266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:27.830083 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6ac9235f-e02c-4ee3-ba58-384aa1af1db4 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1552 microversion: 2.26 time: 0.411935 Aug 29 05:17:27.830708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:27.831907 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ece9bfcf-5e72-46a2-88ca-49b56693c9ad tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.403666 Aug 29 05:17:27.838496 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2642/5307] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:27 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:27.838998 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2666/5308] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:27 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1552 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:28.420252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:28.421133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:28.427906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:28.428551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:28.435885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:28.437670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:28.438394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:28.439619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:28.440257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:28.440478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:28.441418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:28.442489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:28.443044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:28.443487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:28.443987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:28.445357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:28.816738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:28.826707 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6396abf-9db8-4226-88ba-63f07f034d8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.402369 Aug 29 05:17:28.849463 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2667/5309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:28 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:28.854669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d922b867-ae10-4c11-a9df-61b2132bd23c req-2a4dbb80-4235-490e-8144-94a40b1ac297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd41253-027b-4a17-9aca-2e9ff08c4c38", "name": "network-vif-unplugged", "status": "completed", "tag": "5ae47d2b-e267-47f4-9da8-cbda0f1551e5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:28.880877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:28.892418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d922b867-ae10-4c11-a9df-61b2132bd23c req-2a4dbb80-4235-490e-8144-94a40b1ac297 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:28.893331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d922b867-ae10-4c11-a9df-61b2132bd23c req-2a4dbb80-4235-490e-8144-94a40b1ac297 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:28.894036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d922b867-ae10-4c11-a9df-61b2132bd23c req-2a4dbb80-4235-490e-8144-94a40b1ac297 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:28.905511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e32877bc-b3e7-4c29-b47b-3a1949df9379 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 0.493435 Aug 29 05:17:28.918490 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d922b867-ae10-4c11-a9df-61b2132bd23c req-2a4dbb80-4235-490e-8144-94a40b1ac297 service nova] Creating event network-vif-unplugged:5ae47d2b-e267-47f4-9da8-cbda0f1551e5 for instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 on n-h1-854119-9 Aug 29 05:17:28.920730 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2643/5310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:28 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:28.927776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:28.928416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:28.937481 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d922b867-ae10-4c11-a9df-61b2132bd23c req-2a4dbb80-4235-490e-8144-94a40b1ac297 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086219 Aug 29 05:17:28.941885 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2668/5311] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:28.950794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:28.952794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:28.955057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:28.956752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:28.957238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:28.959165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:28.970611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:28.971989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:28.978676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:28.979490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:28.980149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:28.981064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:28.981836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:28.982587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:29.600510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:29.610285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:29.618030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:29.619585 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7d30aab-a77c-4718-98cf-a3fea4b4c271 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.672882 Aug 29 05:17:29.620675 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2669/5312] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:28 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:29.860697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:29.864857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:29.890120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:29.891547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:29.891997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:29.892768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:29.895653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:29.898296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:30.618203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:30.627191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:30.639283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:30.640971 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-601f5efb-0363-414e-8e82-aad70bfdf2cf tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1552 microversion: 2.26 time: 1.717121 Aug 29 05:17:30.645924 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2644/5313] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:28 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1552 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:30.660092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:30.661905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:30.685404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:30.686611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:30.690357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:30.692080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:30.695954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:30.697298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:31.056552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:31.069817 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5df4dc8e-3d6d-4b4c-abdf-6632051efd22 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 1.211462 Aug 29 05:17:31.071864 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2670/5314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:29 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:31.085154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:31.101651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:31.129950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:31.134354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:31.135952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:31.149258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:31.150996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:31.157672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:32.037584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:32.063373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:32.065004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:32.073147 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4fc4ca44-e735-40b5-83da-5e320a96b3c6 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.997697 Aug 29 05:17:32.073748 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2671/5315] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:31 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:32.083005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:32.097062 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bdcea20f-9f4b-425c-baaa-2a52c2199972 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1322 microversion: 2.1 time: 1.449770 Aug 29 05:17:32.098660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:32.099084 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2645/5316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:30 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1322 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:32.099321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:32.112762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:32.126384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:32.126527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:32.135705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:32.136299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:32.141669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:32.142288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:32.143042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:32.144576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:32.145080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:32.145510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:32.149339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:32.150697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:32.152335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:32.479437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:32.495003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:32.499659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e396d6a9acf04eed9e05d1f416a0efcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bb455c6461489ba69df4c624289a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:32.517589 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d58fdab1-6a88-4898-92a0-5948139fd6c2 tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 200 len: 1510 microversion: 2.26 time: 0.426177 Aug 29 05:17:32.539885 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2672/5317] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:32 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 1510 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:32.595773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e5e1b729-987f-499c-9f71-9b718ca7b6c9 req-8df5474c-7632-4be0-97d2-516e9ba6a51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd41253-027b-4a17-9aca-2e9ff08c4c38", "name": "network-vif-deleted", "tag": "5ae47d2b-e267-47f4-9da8-cbda0f1551e5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:32.617766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e5e1b729-987f-499c-9f71-9b718ca7b6c9 req-8df5474c-7632-4be0-97d2-516e9ba6a51f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:32.647020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e5e1b729-987f-499c-9f71-9b718ca7b6c9 req-8df5474c-7632-4be0-97d2-516e9ba6a51f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:32.648633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e5e1b729-987f-499c-9f71-9b718ca7b6c9 req-8df5474c-7632-4be0-97d2-516e9ba6a51f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:32.755456 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e5e1b729-987f-499c-9f71-9b718ca7b6c9 req-8df5474c-7632-4be0-97d2-516e9ba6a51f service nova] Creating event network-vif-deleted:5ae47d2b-e267-47f4-9da8-cbda0f1551e5 for instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 on n-h1-854119-9 Aug 29 05:17:32.796405 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e5e1b729-987f-499c-9f71-9b718ca7b6c9 req-8df5474c-7632-4be0-97d2-516e9ba6a51f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204165 Aug 29 05:17:32.798705 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2673/5318] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:17:33.108941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:33.110816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:33.135198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:33.143205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:33.146158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:33.147976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:33.150932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:33.155380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:34.405160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:34.419084 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f8626aa8-74f5-45c1-9d0f-95d88231bdc7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 2.318513 Aug 29 05:17:34.437413 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2646/5319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:32 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:34.452836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:34.459651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:34.507237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:34.507745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:34.508208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:34.510586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:34.511056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:34.511489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:34.644313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:DELETE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:35.580035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:35.605372 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a16caf8f-1a87-40d7-95b7-455a59319e51 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1517 microversion: 2.1 time: 1.164561 Aug 29 05:17:35.609449 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2647/5320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:34 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1517 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:35.623767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:35.626098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] [instance: 8cd41253-027b-4a17-9aca-2e9ff08c4c38] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:35.658412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:35.661800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:35.662713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:35.675520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:35.678364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:35.679752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:35.680879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:35.681528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:35.682988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:35.684343 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a3f22dd3-aae1-44a6-9bdb-3e031dc29778 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 2.589275 Aug 29 05:17:35.684776 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2674/5321] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:33 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 2591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:17:35.701462 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] HTTP exception thrown: Instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 could not be found. Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Request method failure captured: Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 HTTP/1.1 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEu7E2d9Hm6OWLUDRffUv-2noPtw8iHQgOoEkzTtOPZgtPQ6zNu2TgFrrvLCPJCBcmPLuJ6buXofzaD__iPDeFSaPDrs1bLIUT1qJA0sliowvsqi4GD_VfHZixxzWyx3o0wVfP80DzTyF0M2Gb-Y3FzlgJ8Bj79ERoVlS5Wqf2r24GE Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.26 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: d0bb455c6461489ba69df4c624289a19 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerTagsTestJSON-1343124378 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bb455c6461489ba69df4c624289a19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0bb455c6461489ba69df4c624289a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0bb455c6461489ba69df4c624289a19", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bb455c6461489ba69df4c624289a19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerTagsTestJSON-1343124378 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: d0bb455c6461489ba69df4c624289a19 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerTagsTestJSON-1343124378 Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerTagsTestJSON-1343124378-project Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e396d6a9acf04eed9e05d1f416a0efcf Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerTagsTestJSON-1343124378-project Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 could not be found. Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8cd41253-027b-4a17-9aca-2e9ff08c4c38'} Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 could not be found. Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 could not be found. Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:17:35.704186 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:35.707910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:17:35.707910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:17:35.707910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:17:35.707910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:17:35.707910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:17:35.707910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 could not be found. Aug 29 05:17:35.707910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:35.708901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2ac7deb3-ad3a-4950-b459-c3f5821e2ab8 req-320e2dd6-e763-4d9d-be5f-9c058b1c82b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfbf67c-0d97-4987-ab70-671c27ee0e87", "name": "network-vif-plugged", "status": "completed", "tag": "24580187-5a1f-4a69-911d-d88f1019377a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:35.710254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] Returning 404 to user: Instance 8cd41253-027b-4a17-9aca-2e9ff08c4c38 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:17:35.711274 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-116fd65b-afee-4de1-a5cf-7481fd5aa05e tempest-ServerTagsTestJSON-1343124378 tempest-ServerTagsTestJSON-1343124378-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38" status: 404 len: 111 microversion: 2.26 time: 0.099704 Aug 29 05:17:35.712001 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2648/5322] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:35 2022] GET /compute/v2.1/servers/8cd41253-027b-4a17-9aca-2e9ff08c4c38 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:17:35.721270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:35.722128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:35.730306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:35.731025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:35.731599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:35.732598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:35.733197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:35.733764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:35.736038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2ac7deb3-ad3a-4950-b459-c3f5821e2ab8 req-320e2dd6-e763-4d9d-be5f-9c058b1c82b4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:35.739089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2ac7deb3-ad3a-4950-b459-c3f5821e2ab8 req-320e2dd6-e763-4d9d-be5f-9c058b1c82b4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:35.739652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2ac7deb3-ad3a-4950-b459-c3f5821e2ab8 req-320e2dd6-e763-4d9d-be5f-9c058b1c82b4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:35.762662 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2ac7deb3-ad3a-4950-b459-c3f5821e2ab8 req-320e2dd6-e763-4d9d-be5f-9c058b1c82b4 service nova] Creating event network-vif-plugged:24580187-5a1f-4a69-911d-d88f1019377a for instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 on n-h1-854119-9 Aug 29 05:17:35.780873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2ac7deb3-ad3a-4950-b459-c3f5821e2ab8 req-320e2dd6-e763-4d9d-be5f-9c058b1c82b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089535 Aug 29 05:17:35.782014 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2675/5323] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:35.787755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:35.790199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:35.797636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:35.798966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:35.799412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:35.800267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:35.801390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:35.801824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:35.845400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lazy-loading 'flavor' on Instance uuid 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:36.019944 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0da861a7-7ae7-49ef-b138-1acdda4b734d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad/action" status: 200 len: 32 microversion: 2.1 time: 0.222835 Aug 29 05:17:36.022325 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2676/5324] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:35 2022] POST /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad/action => generated 32 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:17:36.034113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:36.034817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:36.091321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:36.091854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:36.092325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:36.093042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:36.093497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:36.093950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:36.450790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:36.464778 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c9aa6b84-68b1-4bd0-83cc-c0d836ac62a2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1658 microversion: 2.1 time: 0.747882 Aug 29 05:17:36.471575 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2649/5325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:35 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1658 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:36.492771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09418a8d-a5bb-4586-8f15-1ed3063aaca9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:36.505556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09418a8d-a5bb-4586-8f15-1ed3063aaca9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:36.506268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09418a8d-a5bb-4586-8f15-1ed3063aaca9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:36.506855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09418a8d-a5bb-4586-8f15-1ed3063aaca9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:36.541826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-09418a8d-a5bb-4586-8f15-1ed3063aaca9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Going to try to start instance {{(pid=128871) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 05:17:36.600083 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09418a8d-a5bb-4586-8f15-1ed3063aaca9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.110068 Aug 29 05:17:36.601293 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2650/5326] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:36 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:17:36.614562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:36.615919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:36.623188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:36.623750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:36.624344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:36.625250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:36.625773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:36.626260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:36.943096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:36.964974 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab118e6e-0e4a-42d2-961f-89429003a795 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1667 microversion: 2.1 time: 0.358980 Aug 29 05:17:36.967296 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2651/5327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:36 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1667 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:36.980382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:36.981494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:37.004746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:37.005251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:37.005697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:37.006416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:37.006871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:37.007299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:37.050609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:37.081271 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0e9b249d-9498-43fc-a568-7909e754d90e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 1.051223 Aug 29 05:17:37.084852 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2677/5328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:36 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:37.548598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:37.586781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:37.588357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:37.589574 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8a025b16-9d61-4a9a-8a9c-5585e5dfbf1e tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.619327 Aug 29 05:17:37.610663 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2652/5329] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:36 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:37.996832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:37.997521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:38.007659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:38.020840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:38.021414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:38.022493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:38.025844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:38.026718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:38.112643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:38.113438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:38.125663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:38.128023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:38.129039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:38.133447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:38.135588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:38.136306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:38.556894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:38.565823 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b45145b2-86e6-49d0-b345-ce6899f6cb1a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.462878 Aug 29 05:17:38.566402 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2653/5330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:38 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:38.585024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:38.595888 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-48b32740-5d1d-4498-ab31-aae380dc46c3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1667 microversion: 2.1 time: 0.602747 Aug 29 05:17:38.605471 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2678/5331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:37 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1667 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:38.616888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:38.618505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:38.626624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:38.627440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:38.628326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:38.629433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:38.630166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:38.630835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:39.139413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:39.148915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:39.150261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:39.151847 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e36338a-9a4a-4d6f-80bc-3bd85e840851 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.540369 Aug 29 05:17:39.164516 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2654/5332] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:38 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:39.590030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:39.590794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:39.615618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:39.620942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:39.623796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:39.624896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:39.625625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:39.626236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:39.627946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:39.629566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:39.656816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:39.664882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:39.668577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:39.682739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:39.685943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:39.690673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:40.125538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:40.136916 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d4bbffe-97c4-4eb9-a268-bdb05b0eff34 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.548890 Aug 29 05:17:40.137562 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2679/5333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:39 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:40.175062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:40.175687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:40.182096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:40.182597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:40.183037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:40.183758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:40.184411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:40.184850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:40.214850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:40.227732 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44ab0709-6196-40f6-98b4-59e1fcf97f6d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1667 microversion: 2.1 time: 0.604089 Aug 29 05:17:40.229151 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2655/5334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:39 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1667 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:40.421705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:40.433639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:40.436663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:40.437911 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6054d364-b237-46ed-afcc-c68c4256a18d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.266884 Aug 29 05:17:40.438498 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2680/5335] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:40 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:17:41.161079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:41.164763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:41.191575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:41.192413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:41.193806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:41.194786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:41.195767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:41.196579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:41.249184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:41.249806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:41.267315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:41.267739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:41.268208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:41.268928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:41.269385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:41.269827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:41.742707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:41.752393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72564da8-92ca-4b8c-9616-29d676662ad5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.597597 Aug 29 05:17:41.754365 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2656/5336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:41 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:41.770847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:41.771655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:41.851663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:41.852184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:41.852779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:41.853833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:41.854422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:41.854980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:42.614956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:42.631174 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7898749c-1a4e-499a-86c1-915f0b4faaf8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1667 microversion: 2.1 time: 1.385818 Aug 29 05:17:42.643541 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2681/5337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:41 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1667 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:42.648479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-090a1c21-1f96-4144-80c2-bc81ce33d057 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:42.649096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-090a1c21-1f96-4144-80c2-bc81ce33d057 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:42.665612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-090a1c21-1f96-4144-80c2-bc81ce33d057 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:42.666451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-090a1c21-1f96-4144-80c2-bc81ce33d057 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:42.667064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-090a1c21-1f96-4144-80c2-bc81ce33d057 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:42.668921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-090a1c21-1f96-4144-80c2-bc81ce33d057 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:42.669737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-090a1c21-1f96-4144-80c2-bc81ce33d057 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:42.670425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-090a1c21-1f96-4144-80c2-bc81ce33d057 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:42.711111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:42.970665 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-090a1c21-1f96-4144-80c2-bc81ce33d057 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1831 microversion: 2.1 time: 0.325884 Aug 29 05:17:42.974664 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2682/5338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:42 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1831 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:42.988035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:42.989105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:43.007869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:43.025703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:43.026942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:43.027792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:43.029130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:43.031157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:43.031663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:43.047158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:43.049394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:43.051103 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7949c323-e2dd-4b26-9f8d-c03bbfe45a14 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 1.295527 Aug 29 05:17:43.055829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2657/5339] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:41 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:43.653565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:43.654839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:43.693782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:43.696066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:43.697766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:43.700712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:43.701601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:43.702237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:43.980642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:43.990366 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-52749977-d39d-493c-9096-50957d31bf44 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 1.014446 Aug 29 05:17:44.007574 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2683/5340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:42 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:44.081970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:44.082887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:44.095869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:44.096627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:44.097215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:44.098098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:44.098756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:44.104997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:44.283450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:44.294501 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3a280f2e-fefa-4aab-91b0-025144baf790 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1667 microversion: 2.1 time: 0.645110 Aug 29 05:17:44.296553 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2658/5341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:43 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1667 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:44.788042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:44.800207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:44.811219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:44.812591 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1706cec0-8787-49fd-8a87-3636e6216630 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.734668 Aug 29 05:17:44.828032 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2684/5342] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:44 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:17:45.014636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:45.015257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:45.023389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:45.023880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:45.024400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:45.025064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:45.025649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:45.025944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:45.316835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:45.318063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:45.345342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:45.346242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:45.346965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:45.347904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:45.348614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:45.349258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:45.583497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:45.611544 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cee04401-4046-4f2c-8780-ae1f46873744 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.600701 Aug 29 05:17:45.613194 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2659/5343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:45 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:45.772562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:45.789045 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f00f25c6-8d54-4387-b3a4-dd5d795cbad1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.476060 Aug 29 05:17:45.790262 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2685/5344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:45 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:45.818514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:45.819538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:45.836056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:45.839050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:45.851571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:45.852401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:45.853027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:45.855036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:45.856197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:45.856341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:45.856909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:45.857294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:45.857407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:45.858036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:45.858486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:45.858906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:46.247858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:46.258490 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b1888549-1e24-4f54-aabf-5a14dc01d87a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.449653 Aug 29 05:17:46.272148 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2660/5345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:45 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:46.302981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:46.303527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:46.315713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:46.316292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:46.316669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:46.325629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:46.326683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:46.327357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:46.349228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:46.363787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:46.370454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:46.380461 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0b9e70b-78b6-404b-b52d-553f51719e32 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.549239 Aug 29 05:17:46.382993 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2686/5346] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:45 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:17:46.400319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Unlocking {{(pid=128871) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 05:17:46.463203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:46.478713 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c460a45a-b8c5-408c-afe5-8344cc4b4dbc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.197841 Aug 29 05:17:46.490610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:46.491154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:46.492405 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2661/5347] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:46 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:17:46.501150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:46.503849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:46.504403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:46.508262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:46.508835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:46.509457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:46.642871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:46.643581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:46.663933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:46.665585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:46.666731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:46.670764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:46.679691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:46.680172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.352579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:47.362365 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75a5dc81-052f-4c76-86d3-774c4a2052e6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.875907 Aug 29 05:17:47.367515 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2687/5348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:46 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:47.372573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:47.383334 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a07ed9cf-914f-4665-ad53-01ff33a14d49 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.745136 Aug 29 05:17:47.388597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0774015b-03c1-44d8-81a6-0d2409fbc265 req-6260e3d6-8fc2-450f-a40d-ad80a7cce7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0212b868-400b-4cd4-9278-f45805cc128f", "name": "network-vif-plugged", "status": "completed", "tag": "cd6eaae0-af11-4f54-97bf-0b3ddd31b12d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:47.390604 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2662/5349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:46 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:47.400371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:47.405027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:47.419670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.420319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0774015b-03c1-44d8-81a6-0d2409fbc265 req-6260e3d6-8fc2-450f-a40d-ad80a7cce7a0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.421913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0774015b-03c1-44d8-81a6-0d2409fbc265 req-6260e3d6-8fc2-450f-a40d-ad80a7cce7a0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.422251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.422869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.423487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0774015b-03c1-44d8-81a6-0d2409fbc265 req-6260e3d6-8fc2-450f-a40d-ad80a7cce7a0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.424773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.426447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.427066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.454836 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0774015b-03c1-44d8-81a6-0d2409fbc265 req-6260e3d6-8fc2-450f-a40d-ad80a7cce7a0 service nova] Creating event network-vif-plugged:cd6eaae0-af11-4f54-97bf-0b3ddd31b12d for instance 0212b868-400b-4cd4-9278-f45805cc128f on n-h1-854119-9 Aug 29 05:17:47.466974 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0774015b-03c1-44d8-81a6-0d2409fbc265 req-6260e3d6-8fc2-450f-a40d-ad80a7cce7a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089371 Aug 29 05:17:47.468306 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2688/5350] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:47.492979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-302c19f9-5806-4317-969a-f91d528f935a req-e81ad5c0-26a7-4ab8-b83f-25be8baebf69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbae68a6-80fa-4e8e-83a2-aab77977bab3", "tag": "7d89d29f-b9f0-4836-a069-9338e7900197"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:47.493189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:17:47.514563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-302c19f9-5806-4317-969a-f91d528f935a req-e81ad5c0-26a7-4ab8-b83f-25be8baebf69 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.524428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-302c19f9-5806-4317-969a-f91d528f935a req-e81ad5c0-26a7-4ab8-b83f-25be8baebf69 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.525022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-302c19f9-5806-4317-969a-f91d528f935a req-e81ad5c0-26a7-4ab8-b83f-25be8baebf69 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.573795 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-302c19f9-5806-4317-969a-f91d528f935a req-e81ad5c0-26a7-4ab8-b83f-25be8baebf69 service nova] Creating event network-changed:7d89d29f-b9f0-4836-a069-9338e7900197 for instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 on n-h2-854119-9 Aug 29 05:17:47.580238 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-302c19f9-5806-4317-969a-f91d528f935a req-e81ad5c0-26a7-4ab8-b83f-25be8baebf69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108037 Aug 29 05:17:47.581220 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2689/5351] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:47.598858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:47.599582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:47.616101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.617119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.619946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.620932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.621594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.622254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.862699 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e149bc57-5098-4b88-9001-374e2132050a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 204 len: 0 microversion: 2.1 time: 0.470497 Aug 29 05:17:47.865531 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2663/5352] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:17:47 2022] DELETE /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:17:47.880949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:47.883461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:47.897902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.902549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.906095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.907925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.908636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.910874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.911118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:47.925443 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c1315645-6d83-49a7-80b4-7c20056cfdb7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.335805 Aug 29 05:17:47.926693 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2690/5353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:47 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:47.937216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:47.937996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:47.959146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.960162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.961861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:47.967403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:47.968179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:47.968814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:48.279226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:48.291869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:48.297102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:48.301975 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b8329e9-21f8-45f6-85f6-503cb2e2fbac tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.432278 Aug 29 05:17:48.302910 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2664/5354] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:47 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:48.310582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:48.314553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:48.329532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:48.331270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:48.333784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:48.334674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:48.336303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:48.336836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:48.369753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:48.378231 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e8163e02-70e0-4f48-ad7a-f1e3167a5632 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1686 microversion: 2.1 time: 0.450139 Aug 29 05:17:48.386082 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2691/5355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:47 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1686 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:48.423689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:48.423689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:48.431966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:48.436867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:48.437576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:48.439094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:48.439816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:48.440492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:48.593145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:48.611556 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5f58fac3-a8f8-4c61-8863-6906de2acff5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.302946 Aug 29 05:17:48.613021 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2665/5356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:48 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:48.632719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-20c95da3-d121-4ae3-a3e1-6f87fa375aa2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:48.633199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-20c95da3-d121-4ae3-a3e1-6f87fa375aa2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:48.642117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20c95da3-d121-4ae3-a3e1-6f87fa375aa2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:48.642617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20c95da3-d121-4ae3-a3e1-6f87fa375aa2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:48.643304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20c95da3-d121-4ae3-a3e1-6f87fa375aa2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:48.643745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20c95da3-d121-4ae3-a3e1-6f87fa375aa2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:48.653003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20c95da3-d121-4ae3-a3e1-6f87fa375aa2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:48.653634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20c95da3-d121-4ae3-a3e1-6f87fa375aa2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:48.663828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:48.672614 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84c826ae-591e-4527-9917-6e7a14b22326 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.265281 Aug 29 05:17:48.673746 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2692/5357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:48 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:48.782074 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-20c95da3-d121-4ae3-a3e1-6f87fa375aa2 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.153564 Aug 29 05:17:48.788421 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2666/5358] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:48 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:17:48.793353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:48.793996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:48.801833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:48.802341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:48.806198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:48.807122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:48.807733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:48.809603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:49.333167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:49.334110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:49.350481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:49.351012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:49.351806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:49.352779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:49.353392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:49.353992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:49.811252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:49.828981 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-74ecb6b7-aa69-4135-b97a-5600b45de2bd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1676 microversion: 2.1 time: 1.039455 Aug 29 05:17:49.837141 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2693/5359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:48 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1676 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:49.843142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:49.849817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:49.876849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:49.884329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:49.884835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:49.885267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:49.893399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:49.896571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:49.899753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:49.947317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:49.963217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:49.964778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:49.981366 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c34add4f-3b55-40eb-afd5-e25233ac3162 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.653931 Aug 29 05:17:49.983369 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2667/5360] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:49 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:49.995529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:49.999540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:50.015846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:50.020221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:50.021688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:50.023853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:50.024762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:50.025391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:50.578278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:50.589003 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37fdd2e6-598b-419e-9b9c-71ef84d7618f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1686 microversion: 2.1 time: 0.750747 Aug 29 05:17:50.589821 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2694/5361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:49 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1686 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:50.605377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:50.621763 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2b2e565-5797-4357-9145-beac9c11138b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.636215 Aug 29 05:17:50.622381 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2668/5362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:49 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:50.865525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:50.866409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:50.878391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:50.977639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:50.978204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:50.978650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:50.979382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:50.979833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:50.983905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.270308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:51.300111 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cdb90ac7-a57d-4efe-8707-46e97d27a420 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1656 microversion: 2.1 time: 0.443346 Aug 29 05:17:51.301754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1032640525", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": "none"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:51.302287 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2669/5363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:50 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1656 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:51.320298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c03ec3f2-2580-44de-b874-8d2261eda8db req-701b4282-e3a4-4dde-91a0-51885aab08c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbae68a6-80fa-4e8e-83a2-aab77977bab3", "name": "network-vif-deleted", "tag": "7d89d29f-b9f0-4836-a069-9338e7900197"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:51.352577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c03ec3f2-2580-44de-b874-8d2261eda8db req-701b4282-e3a4-4dde-91a0-51885aab08c7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.353138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c03ec3f2-2580-44de-b874-8d2261eda8db req-701b4282-e3a4-4dde-91a0-51885aab08c7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.353580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c03ec3f2-2580-44de-b874-8d2261eda8db req-701b4282-e3a4-4dde-91a0-51885aab08c7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.384985 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c03ec3f2-2580-44de-b874-8d2261eda8db req-701b4282-e3a4-4dde-91a0-51885aab08c7 service nova] Creating event network-vif-deleted:7d89d29f-b9f0-4836-a069-9338e7900197 for instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 on n-h2-854119-9 Aug 29 05:17:51.390905 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c03ec3f2-2580-44de-b874-8d2261eda8db req-701b4282-e3a4-4dde-91a0-51885aab08c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087861 Aug 29 05:17:51.392010 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2670/5364] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:17:51.399089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:51.400053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:51.411716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.412742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.412742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.413282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.415253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.415836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.421195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:17:51.427775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:17:51.429267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:17:51.429267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:17:51.434305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:17:51.471591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.472092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.474245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.478272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.479046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.479643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.531212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Getting quotas for project ee790a7faa624efb9fc7372ec335841e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:17:51.537866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Getting quotas for user 5c10272683d24e97af61d80fbfd04b72 and project ee790a7faa624efb9fc7372ec335841e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:17:51.556375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:17:51.558906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:17:51.619475 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08b6b3f9-1bb1-4bbc-b5d5-6ee879c3b4ce tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.813749 Aug 29 05:17:51.620811 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2695/5365] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 29 05:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 05:17:51.626185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-99f5c376-e34b-4c12-a5f4-666c07a9ce38 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:17:51.627009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-99f5c376-e34b-4c12-a5f4-666c07a9ce38 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:51.634307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5c376-e34b-4c12-a5f4-666c07a9ce38 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.634969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5c376-e34b-4c12-a5f4-666c07a9ce38 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.635553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5c376-e34b-4c12-a5f4-666c07a9ce38 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.636429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5c376-e34b-4c12-a5f4-666c07a9ce38 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.637546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5c376-e34b-4c12-a5f4-666c07a9ce38 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.638152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99f5c376-e34b-4c12-a5f4-666c07a9ce38 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.785553 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-99f5c376-e34b-4c12-a5f4-666c07a9ce38 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.162779 Aug 29 05:17:51.786776 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2696/5366] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:17:51 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:17:51.794427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:51.797554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:51.799566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:51.809862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.810473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:51.811467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.811984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:51.812675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.813218 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc380b83-8189-49b5-adcd-6fad0c5bf36d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1729 microversion: 2.20 time: 0.419943 Aug 29 05:17:51.815136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.815888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.816684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.832401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2671/5367] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:51 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1729 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:51.840188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef033039-39d7-4736-a5f3-4f9c85f1a543 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:51.840823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef033039-39d7-4736-a5f3-4f9c85f1a543 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:51.904879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.906256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.908996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.909805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lazy-loading 'fault' on Instance uuid dbae68a6-80fa-4e8e-83a2-aab77977bab3 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:17:51.919226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef033039-39d7-4736-a5f3-4f9c85f1a543 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:51.929457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef033039-39d7-4736-a5f3-4f9c85f1a543 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:51.932433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef033039-39d7-4736-a5f3-4f9c85f1a543 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:51.936923 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef033039-39d7-4736-a5f3-4f9c85f1a543 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1278 microversion: 2.54 time: 0.100326 Aug 29 05:17:51.937516 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2672/5368] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:51 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:51.960303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:51.968226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:51.981010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.981523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.986945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:51.987969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:51.988245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:51.993139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:52.168176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:52.181526 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d88ae62f-4664-422e-98e7-d2617ae9ea73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 200 len: 1356 microversion: 2.1 time: 0.392859 Aug 29 05:17:52.182118 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2697/5369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:51 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 1356 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:52.201282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:52.201894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:52.208571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:52.209275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:52.209874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:52.210741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:52.211347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:52.211925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:52.418818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:52.432628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d1f9ec2a-b042-4bb2-9573-4a77c2809f5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.487433 Aug 29 05:17:52.433254 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2673/5370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:51 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:52.514802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:52.526957 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1adfb952-9490-4910-914c-e906b0e5414b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.329964 Aug 29 05:17:52.527553 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2698/5371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:52 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:52.550305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:52.550963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:52.558694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:52.559191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:52.559899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:52.560778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:52.562331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:52.562966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:52.840643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:52.841466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:52.849507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:52.850543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:52.851367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:52.857658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:52.858420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:52.859048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:52.869116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:52.884858 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8d3dca1-9a8a-45c8-91c0-d41350873b5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.340015 Aug 29 05:17:52.885683 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2674/5372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:52 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:52.910114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:52.910732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:52.925996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:52.926529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:52.926972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:52.927689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:52.928177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:52.928585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:53.200447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:53.215313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:53.220576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:53.223936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:53.225700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d01c4427-13f6-47b6-a605-fce3156a302d tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1716 microversion: 2.20 time: 0.389462 Aug 29 05:17:53.229092 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2699/5373] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:52 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1716 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:17:53.230411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:53.236199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:53.242110 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-da4d8ca9-cdaf-4cf0-8595-5c71fc83acf3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.335463 Aug 29 05:17:53.245186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:53.247278 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2675/5374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:52 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:17:53.258346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:53.259372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:53.260027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:53.269511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:53.270286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:53.270879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:53.271000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:53.272899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: dbae68a6-80fa-4e8e-83a2-aab77977bab3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:53.288604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:53.290395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:53.291875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:53.292694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:53.293186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:53.295319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:53.335877 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] HTTP exception thrown: Instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 could not be found. Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Request method failure captured: Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 HTTP/1.1 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEsXp8EfnvUqPmqsIzL4luSArQxeepnzAbWptfIG1OpEe8LS77ZppQzW8i3IW3VRqRq0TXI0NHqdByu2osRldV9U4AXBKV1QE-ARj2EAJgT8Qh_eOA9gF95LKAhkL1je_M0xm4pD9D4xIQk90moSvRJJWOWxOEg7BDrFFCWPYYNj2d8 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e5306aaa62bb4e1f9b407bce73b397f0 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5306aaa62bb4e1f9b407bce73b397f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e5306aaa62bb4e1f9b407bce73b397f0 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestNetworkAdvancedServerOps-1974793548-project Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6bcb6393cb0a4e6a857d0d5e960eba01 Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1974793548-project Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 could not be found. Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'dbae68a6-80fa-4e8e-83a2-aab77977bab3'} Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 could not be found. Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 could not be found. Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:53.337914 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 could not be found. Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Returning 404 to user: Instance dbae68a6-80fa-4e8e-83a2-aab77977bab3 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5dab4e8c-74ec-4412-a4e1-7e5d4f9dce28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3" status: 404 len: 111 microversion: 2.1 time: 0.090335 Aug 29 05:17:53.341913 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2676/5375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:53 2022] GET /compute/v2.1/servers/dbae68a6-80fa-4e8e-83a2-aab77977bab3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:17:53.347485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:53.348360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:53.373317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:53.376923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:53.377372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:53.380778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:53.380778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:53.391106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:53.399547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:53.412375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:53.413817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:53.426650 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51e2ed4e-1b25-449e-a47a-9d628bb290e6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1330 microversion: 2.54 time: 0.196099 Aug 29 05:17:53.427589 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2700/5376] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:53 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1330 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:53.441477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:17:53.455062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:53.455751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:53.479351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:53.480101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:53.480735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:53.481704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:53.482185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:53.482724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:53.939761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:53.955207 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-046ba45e-dda1-492e-99b8-7fc421f5b95a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.611019 Aug 29 05:17:53.957397 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2677/5377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:53 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:53.986445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:53.987244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:53.997543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:53.999111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:54.002951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:54.007384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:54.011907 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85b23d85-5331-4234-ba50-dc9b1468b425 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.561969 Aug 29 05:17:54.013041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:54.013679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:54.014633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2701/5378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:53 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:54.015239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:54.349741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:54.365386 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-32706e0e-a086-41a6-8380-ccccea76beec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.391412 Aug 29 05:17:54.376335 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2678/5379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:53 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:54.391043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:54.391678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:54.414375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:54.416181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:54.416670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:54.417508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:54.417860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:54.418306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:54.454790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:54.455405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:54.465345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:54.466041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:54.466343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:54.467082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:54.467551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:54.467981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:54.817934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:54.833024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:54.839190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:54.843748 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-129f5aa4-8697-4abd-986e-6bb90ac74447 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1336 microversion: 2.54 time: 0.393427 Aug 29 05:17:54.845891 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2679/5380] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:54 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1336 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:55.042482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:55.043260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:55.058034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:55.081478 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55b635e0-38e6-4cdf-930d-b6a7b8d32d1a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.694954 Aug 29 05:17:55.095417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:55.096378 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2702/5381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:54 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:55.097181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:55.097800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:55.098887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:55.099508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:55.100107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:55.399377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:55.411059 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3c044e22-b29b-4b72-b303-9e97062500a2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.379834 Aug 29 05:17:55.425608 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2680/5382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:55 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:55.889154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:55.889943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:55.925908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:55.926552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:55.929717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:55.931238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:55.933554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:55.935011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:56.306270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:56.319868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:56.321346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:56.322529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55e1e00c-324f-43ca-8a82-ab38704a7281 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1336 microversion: 2.54 time: 0.437579 Aug 29 05:17:56.323118 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2703/5383] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:55 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1336 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:56.436223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:56.437523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:56.452150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:56.452678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:56.453129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:56.453860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:56.454320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:56.456093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:57.346643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:57.347233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:57.360941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:57.361432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:57.361866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:57.362574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:57.363025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:57.363447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:57.566632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:57.584649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:57.590844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:57.596880 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-690a507b-54b9-4378-972e-7b516ad5f79b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1336 microversion: 2.54 time: 0.254618 Aug 29 05:17:57.601042 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2704/5384] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:57 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1336 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:17:57.970443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:57.994334 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a207c1d2-1302-49af-bf4b-a126f5902554 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 1.563328 Aug 29 05:17:57.996337 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2681/5385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:56 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:58.627763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:58.629288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:58.642710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:58.644316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:58.645078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:58.648065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:58.649471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:58.652950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:58.933639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:58.944182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:58.948288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:58.951057 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee8f3c8d-b144-44e2-8c66-a633af76d75c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1336 microversion: 2.54 time: 0.331304 Aug 29 05:17:58.954996 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2705/5386] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:58 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1336 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:17:59.016152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:59.016935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:59.033346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:59.039306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:59.042506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:59.045008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:59.047095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:59.051687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:59.367636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:17:59.395504 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7902e32f-80f0-4c6e-8c31-088c0c06b06c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.383331 Aug 29 05:17:59.403084 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2682/5387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:17:59 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:17:59.979170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:17:59.979791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:17:59.989360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:59.989848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:59.990278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:17:59.995691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:17:59.996328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:17:59.996758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:00.181233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:00.196671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:00.198107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:00.199810 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a66f67c-b08c-4266-aa05-332f6961d526 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1357 microversion: 2.54 time: 0.224609 Aug 29 05:18:00.203242 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2706/5388] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:17:59 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:00.228846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fb09c98b-5dfe-4c7e-8038-b17501f13d72 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Action: 'create', calling method: .version_select at 0x7f1ab850db80>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1070241263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLGrmQmaTaX+twDxpptsCBIZTfzVd3KWoeBA0YPLaDy6qPyliPn17cJKNTNAt6yOuo1kLTWwbW0tSPI4H2mvE13P+CYBfj+lWSCT68a79/s8GA6RWKDXmpmUVxXDTvcsQ=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:00.282871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-fb09c98b-5dfe-4c7e-8038-b17501f13d72 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Getting quotas for project ee790a7faa624efb9fc7372ec335841e. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:18:00.289715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-fb09c98b-5dfe-4c7e-8038-b17501f13d72 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Getting quotas for user 5c10272683d24e97af61d80fbfd04b72 and project ee790a7faa624efb9fc7372ec335841e. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:18:00.322180 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fb09c98b-5dfe-4c7e-8038-b17501f13d72 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.097271 Aug 29 05:18:00.330686 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2683/5389] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 29 05:18:00 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 05:18:00.334690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1070241263", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:00.355422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:00.380535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:00.384625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:00.385227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:00.386352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:00.386950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:00.387532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:00.425417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:00.426569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:00.456568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:00.458311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:00.459564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:00.462801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:00.465469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:00.467186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:00.587145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:18:00.590337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:18:00.591045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:18:00.591615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:18:00.593650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:18:00.788687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:00.810474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:00.814889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:00.815404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:00.821838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:00.822741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:00.824569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:00.854064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:00.882043 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee6b5f13-aecf-4e61-8bea-f1b982d2633a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.462127 Aug 29 05:18:00.895743 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-91b52543-361d-4852-bcfe-021df822620d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "POST /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452/action" status: 202 len: 1140 microversion: 2.54 time: 0.564798 Aug 29 05:18:00.897285 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2684/5390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:00 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:00.898145 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2707/5391] 10.222.0.20 () {62 vars in 1320 bytes} [Mon Aug 29 05:18:00 2022] POST /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452/action => generated 1140 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 29 05:18:00.920073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:00.920766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:00.922765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf57fe81-7887-46fb-988e-4cde50c7276a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '.version_select at 0x7f1ab8751700>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:00.940085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:00.944817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:00.949356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:00.950763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:00.951254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:00.955428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:01.009622 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf57fe81-7887-46fb-988e-4cde50c7276a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1033213198" status: 202 len: 0 microversion: 2.1 time: 0.111088 Aug 29 05:18:01.013462 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2685/5392] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Aug 29 05:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1033213198 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:18:01.060892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-871cdc1d-8130-4fe3-a786-19dce2df2ee9 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'create', calling method: .version_select at 0x7f1ab874e4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1669575311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVFuf+Zquj+zo0HaDqC58vJvrFTqXpTDH0+uXv7K3wgAm0g0R6bdeUxuXujnfpjJdmg+sHFP7wcgMSzx7WdisrJmzWuao2IAAi324E1X/YER2mOxhI32eKNEHjZ414P2A=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:01.103342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-871cdc1d-8130-4fe3-a786-19dce2df2ee9 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:18:01.122273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-871cdc1d-8130-4fe3-a786-19dce2df2ee9 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for user 6bcb6393cb0a4e6a857d0d5e960eba01 and project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:18:01.184921 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-871cdc1d-8130-4fe3-a786-19dce2df2ee9 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.128361 Aug 29 05:18:01.186154 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2686/5393] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:18:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:18:01.202683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:01.215493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:01.231152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:01.231930 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e1fd203c-eca3-4818-be27-e1cf1bdb393e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.316214 Aug 29 05:18:01.232725 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2708/5394] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:00 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:01.903041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:01.903723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:01.923861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:01.924389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:01.924860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:01.925777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:01.926364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:01.926932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:02.277422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:02.282749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:02.300443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:02.310856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:02.383844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:02.398090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:02.403427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:02.412094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:02.415022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:02.415513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:02.415952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:02.420535 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de929b2f-b921-4b6f-ab84-d341a627342d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.516585 Aug 29 05:18:02.423761 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2687/5395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:01 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:02.694684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:02.716282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:02.719561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:02.721514 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39ae6ce8-33a4-465b-ac98-d9170d10334c tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.461210 Aug 29 05:18:02.740434 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2709/5396] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:02 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:03.447327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:03.447943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:03.461488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:03.461991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:03.462428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:03.464849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:03.465323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:03.465836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:03.746657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:03.748200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:03.755204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:03.758399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:03.762765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:03.763703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:03.767868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:03.768646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:03.999653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:04.013933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5b7ca7d5-9113-4462-bcad-d939543beb84 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.570796 Aug 29 05:18:04.016190 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2688/5397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:03 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:04.045650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:04.058880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:04.060418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:04.061632 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a8c41c34-27c1-49ea-8884-ab61542c966d tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.319398 Aug 29 05:18:04.079828 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2710/5398] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:03 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:18:05.039061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:05.041326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:05.058378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:05.059774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:05.060406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:05.062418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:05.065944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:05.068601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:05.088904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:05.089671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:05.104664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:05.109799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:05.109799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:05.110708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:05.111385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:05.111816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:05.305443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:05.319680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:05.328320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:05.329515 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cdbc1c75-a7bd-45d1-aa7b-faa4fd419628 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.248095 Aug 29 05:18:05.330651 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2711/5399] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:05 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:05.488246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:05.506926 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f17b2f99-ecd3-465c-817d-a9665e5d3893 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1523 microversion: 2.1 time: 0.469997 Aug 29 05:18:05.525252 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2689/5400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:05 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1523 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:06.357297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:06.358719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:06.369336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:06.370910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:06.371654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:06.374640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:06.377368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:06.378224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:06.529582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:06.530205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:06.554728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:06.555365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:06.555826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:06.559020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:06.559610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:06.560067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:06.615879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:06.642991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:06.654779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:06.658659 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-50fa8235-430c-4047-acdf-2ba6beca9f2e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.306113 Aug 29 05:18:06.661242 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2712/5401] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:06 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:07.225531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:07.235129 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7fec2439-f144-411c-9931-79ec4821fa35 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1503 microversion: 2.1 time: 0.710062 Aug 29 05:18:07.235634 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2690/5402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:06 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1503 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:07.257273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:07.258163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:07.265217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:07.265949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:07.266536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:07.267403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:07.268013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:07.268611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:07.627262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:07.642747 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-378d1135-43de-493b-8301-e8ab949da15e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1515 microversion: 2.1 time: 0.389256 Aug 29 05:18:07.645879 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2713/5403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:07 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1515 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:07.671763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6933ff19-aa73-4bf2-a77c-1860484d6df6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:07.675398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6933ff19-aa73-4bf2-a77c-1860484d6df6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 23a398c6-3260-4019-bd6f-6214bc7b26e6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:07.683130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:07.684022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:07.692643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:07.704943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:07.708482 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-6933ff19-aa73-4bf2-a77c-1860484d6df6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] HTTP exception thrown: Instance 23a398c6-3260-4019-bd6f-6214bc7b26e6 could not be found. Aug 29 05:18:07.709270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:07.710210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:07.710851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:07.711448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6933ff19-aa73-4bf2-a77c-1860484d6df6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Request method failure captured: Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/23a398c6-3260-4019-bd6f-6214bc7b26e6/action HTTP/1.1 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 14 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEvMW3izJD85pVtbvax1SMfCuq2_Uf3UUHBG6YwbWLNgoxV3uYJIzYl-i9v4vjXyxY9Qq6gcnhWdP6WFxclBgQAU6dml8-Y-HMFx3s3QV0g_wjEpxDyxcKn6d9J-7o-Mew1NhfWoJLNGc1dBi1srqaIaTALn7VpmZsYiGBl2GStsVDM Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63bbfe3da13249fa9f9fe77f7725d037", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: b9574a5f99bf4401a8a2297c71d3e382 Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: {"rescue": {}} Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 23a398c6-3260-4019-bd6f-6214bc7b26e6 could not be found. Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '23a398c6-3260-4019-bd6f-6214bc7b26e6', 'body': {'rescue': {}}} Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a398c6-3260-4019-bd6f-6214bc7b26e6 could not be found. Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a398c6-3260-4019-bd6f-6214bc7b26e6 could not be found. Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:07.741050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:07.745797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:18:07.745797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:18:07.745797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:18:07.745797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:18:07.745797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a398c6-3260-4019-bd6f-6214bc7b26e6 could not be found. Aug 29 05:18:07.745797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:07.745797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6933ff19-aa73-4bf2-a77c-1860484d6df6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Returning 404 to user: Instance 23a398c6-3260-4019-bd6f-6214bc7b26e6 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:18:07.746873 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6933ff19-aa73-4bf2-a77c-1860484d6df6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/23a398c6-3260-4019-bd6f-6214bc7b26e6/action" status: 404 len: 111 microversion: 2.1 time: 0.081202 Aug 29 05:18:07.752297 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2691/5404] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:18:07 2022] POST /compute/v2.1/servers/23a398c6-3260-4019-bd6f-6214bc7b26e6/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:18:07.797735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17f16ef4-7689-40f4-ba8d-7e50a31e398c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:07.799813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17f16ef4-7689-40f4-ba8d-7e50a31e398c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:07.828459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f16ef4-7689-40f4-ba8d-7e50a31e398c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:07.829120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f16ef4-7689-40f4-ba8d-7e50a31e398c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:07.830233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f16ef4-7689-40f4-ba8d-7e50a31e398c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:07.837501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:07.838764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f16ef4-7689-40f4-ba8d-7e50a31e398c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:07.840089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f16ef4-7689-40f4-ba8d-7e50a31e398c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:07.841400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f16ef4-7689-40f4-ba8d-7e50a31e398c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:08.032045 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17f16ef4-7689-40f4-ba8d-7e50a31e398c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action" status: 202 len: 0 microversion: 2.1 time: 0.278142 Aug 29 05:18:08.058941 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2692/5405] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:18:07 2022] POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:18:08.084957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:08.086284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:08.095779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:08.096688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:08.099726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:08.101488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:08.102178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:08.102793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:08.841278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:08.850047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:08.851493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:08.861803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8305fe72-34b5-4b1f-b715-1714730fba63 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 1.182679 Aug 29 05:18:08.862403 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2714/5406] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:07 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:18:08.945541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:08.960506 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8a9ef827-f4a5-48ac-baae-237b2c8df9e9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1520 microversion: 2.1 time: 0.894417 Aug 29 05:18:08.961089 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2693/5407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:08 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1520 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:09.887163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:09.887974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:09.926566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:09.927433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:09.929534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:09.930473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:09.932562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:09.933918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:09.986897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:09.987510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:09.997702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:10.003050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:10.003499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:10.004161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:10.012641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:10.013202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:10.245067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:10.262960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:10.264442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:10.268936 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55384c95-0018-4447-b01e-f985befdf94b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.386996 Aug 29 05:18:10.270108 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2715/5408] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:09 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:10.365040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:10.378487 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e4be44f-1264-4fde-8610-37419b937a4a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1500 microversion: 2.1 time: 0.395430 Aug 29 05:18:10.396757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2694/5409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:09 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1500 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:10.400597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:10.403638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:10.414834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:10.417853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:10.420166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:10.422403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:10.423651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:10.424639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:10.479843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lazy-loading 'flavor' on Instance uuid cbfbf67c-0d97-4987-ab70-671c27ee0e87 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:18:10.507572 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] HTTP exception thrown: Cannot 'rescue' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state paused Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Request method failure captured: Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action HTTP/1.1 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 14 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEvMW3izJD85pVtbvax1SMfCuq2_Uf3UUHBG6YwbWLNgoxV3uYJIzYl-i9v4vjXyxY9Qq6gcnhWdP6WFxclBgQAU6dml8-Y-HMFx3s3QV0g_wjEpxDyxcKn6d9J-7o-Mew1NhfWoJLNGc1dBi1srqaIaTALn7VpmZsYiGBl2GStsVDM Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63bbfe3da13249fa9f9fe77f7725d037", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b9574a5f99bf4401a8a2297c71d3e382 Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: {"rescue": {}} Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot 'rescue' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state paused Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'cbfbf67c-0d97-4987-ab70-671c27ee0e87', 'body': {'rescue': {}}} Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 in vm_state paused. Cannot rescue while the instance is in this state. Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state paused Aug 29 05:18:10.513353 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state paused Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Returning 409 to user: Cannot 'rescue' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state paused {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7688fbc6-fcf5-41d5-a04a-0c80735bcfc5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action" status: 409 len: 144 microversion: 2.1 time: 0.118832 Aug 29 05:18:10.517216 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2716/5410] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:18:10 2022] POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action => generated 144 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:18:10.531066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-183c25d0-ed0e-44f4-840e-381d297b24c4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:10.531861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-183c25d0-ed0e-44f4-840e-381d297b24c4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:10.538726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c25d0-ed0e-44f4-840e-381d297b24c4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:10.539936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c25d0-ed0e-44f4-840e-381d297b24c4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:10.540462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c25d0-ed0e-44f4-840e-381d297b24c4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:10.541241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c25d0-ed0e-44f4-840e-381d297b24c4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:10.541912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c25d0-ed0e-44f4-840e-381d297b24c4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:10.542408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c25d0-ed0e-44f4-840e-381d297b24c4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:10.699246 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-183c25d0-ed0e-44f4-840e-381d297b24c4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action" status: 202 len: 0 microversion: 2.1 time: 0.177127 Aug 29 05:18:10.703186 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2695/5411] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:18:10 2022] POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:18:10.709455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:10.710447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:10.722630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:10.723574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:10.725353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:10.727504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:10.729706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:10.730708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:11.151314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:11.166018 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-daf4b3a5-76df-4587-af59-d573757c9b6d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1507 microversion: 2.1 time: 0.460820 Aug 29 05:18:11.167188 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2717/5412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:10 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:11.300216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:11.303694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:11.322919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=10 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:11.326127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:11.326846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:11.327481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:11.329001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:11.329689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:11.330378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:11.337948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:11.498734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:11.516699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:11.521652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:11.524008 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff56ebf7-e877-43ca-a35e-34749285b090 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.230942 Aug 29 05:18:11.527985 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2696/5413] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:11 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:11.718297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1674224337", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "0fdeb515-3a68-45dc-9df3-ebddeea17921"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1669575311", "security_groups": [{"name": "tempest-secgroup-smoke-599226143"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:12.002713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] validate_networks() for [('0fdeb515-3a68-45dc-9df3-ebddeea17921', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:18:12.189132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:12.190070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:12.207690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:12.209119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:12.211319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:12.214311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:12.216001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:12.216587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:12.721577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:12.729705 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cc150b80-f872-4bb2-ac40-1ac16669c1f5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1515 microversion: 2.1 time: 0.544971 Aug 29 05:18:12.730298 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2697/5414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:12 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1515 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:12.765625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:12.766321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:12.781598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:12.782164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:12.783137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:12.783365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:12.783828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:12.784247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:12.925066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:12.935913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:12.942686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:12.944566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3e036d43-6b2a-4e79-a316-476e3fe4b96a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.193090 Aug 29 05:18:12.949464 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2698/5415] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:12 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:12.999888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:18:13.000495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:18:13.001301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:18:13.001775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:18:13.002198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:18:13.042234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:13.044780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:13.045513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:13.050293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:13.051248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:13.051842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:13.102997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:18:13.117072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for user 6bcb6393cb0a4e6a857d0d5e960eba01 and project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:18:13.148373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:18:13.151140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:18:13.292016 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84293356-432c-466e-8881-2e0709b06893 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.578811 Aug 29 05:18:13.305755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-21510e76-995d-47d4-8f23-64532aa0b649 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:13.306494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-21510e76-995d-47d4-8f23-64532aa0b649 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:13.310532 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2718/5416] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:18:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:18:13.437966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21510e76-995d-47d4-8f23-64532aa0b649 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:13.456055 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-21510e76-995d-47d4-8f23-64532aa0b649 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1267 microversion: 2.1 time: 0.153031 Aug 29 05:18:13.457559 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2699/5417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:13 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:13.975308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:13.975942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:13.986484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:13.998686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:14.006289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:14.007188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:14.007671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:14.008261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:14.220528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:14.228907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:14.236997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:14.238545 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f11b1432-668d-4aa7-8792-466ba6beb660 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.267603 Aug 29 05:18:14.246476 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2719/5418] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:13 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:14.482345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:14.483084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:14.491443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:14.492696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:14.493912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:14.495006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:14.495999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:14.497023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:14.619036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:14.631981 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e5f40010-a346-4ff3-b996-5baa09fc1fa6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1271 microversion: 2.1 time: 0.152793 Aug 29 05:18:14.636669 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2700/5419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:14 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:15.271856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:15.279272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:15.293050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:15.295608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:15.296196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:15.297278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:15.299765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:15.301046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:15.529076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:15.565962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:15.572699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:15.588675 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc885ecd-e2f5-4199-961e-cc88670b17da tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.321211 Aug 29 05:18:15.589333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2720/5420] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:15 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:15.666198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:15.667570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:15.681896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:15.682377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:15.682893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:15.683681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:15.684226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:15.684657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:15.839978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:15.843955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:15.858444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:15.859185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:15.859881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:15.860910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:15.861648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:15.862432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:15.923442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:15.935912 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-51e6995c-2584-4bd8-b93e-d39a3e9fc834 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1319 microversion: 2.1 time: 0.270601 Aug 29 05:18:15.937087 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2701/5421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:15 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:15.963819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lazy-loading 'flavor' on Instance uuid cbfbf67c-0d97-4987-ab70-671c27ee0e87 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:18:16.192515 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9dcd29e5-2e88-4765-a3dd-caa9a3343683 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action" status: 200 len: 32 microversion: 2.1 time: 0.360475 Aug 29 05:18:16.194664 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2721/5422] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:18:15 2022] POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:18:16.206025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:16.206711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:16.218333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:16.218898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:16.219349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:16.220165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:16.220580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:16.221010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:16.616837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:16.617997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:16.650539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:16.651170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:16.651708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:16.652729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:16.653380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:16.654202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:16.786419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:16.871131 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bb9c21f-7709-4378-ae75-263fbef2c348 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.670201 Aug 29 05:18:16.886691 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2702/5423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:16 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:16.981443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:16.987160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:16.987774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:17.010471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:17.010864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:17.011292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:17.014697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:17.015049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:17.016832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:17.017245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:17.017373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:17.018932 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8dd8d045-4c08-473b-a770-fb10d6e9e21a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.406969 Aug 29 05:18:17.020087 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2722/5424] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:16 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:17.162737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:17.176143 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ccda476-e0f2-438b-b72a-52387d9091aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1325 microversion: 2.1 time: 0.219224 Aug 29 05:18:17.195059 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2703/5425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:16 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1325 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:17.893349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:17.894105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:17.909515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:17.910317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:17.912168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:17.913224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:17.917892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:17.918796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:18.047005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:18.047684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:18.058280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:18.058778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:18.059251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:18.059946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:18.060452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:18.060876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:18.256180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:18.267939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:18.270602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:18.271890 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab684c9a-6c6b-4ec0-a9f2-a0cb4f6bdf08 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.229125 Aug 29 05:18:18.277103 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2704/5426] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:18 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:18.284414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:18.296047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:18.296828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:18.302835 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a447dd1-1976-4b69-a2da-876f79292b22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.413105 Aug 29 05:18:18.303906 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2723/5427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:17 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:18.308461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:18.309263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:18.309888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:18.310781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:18.311406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:18.312273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:18.766870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:18.781615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-55e9abec-95d9-45a3-ac3d-5812f6b5b4bc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.498696 Aug 29 05:18:18.782387 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2705/5428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:18 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:19.301468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:19.303726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:19.335156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:19.336625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:19.345798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:19.347468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:19.349489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:19.350880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:19.355877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:19.357419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:19.359971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:19.360543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:19.360987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:19.361784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:19.363695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:19.377226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:19.378961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:19.547234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:19.559564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:19.563213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:19.564475 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09b385ea-1034-45e9-92c7-ab3777231553 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.268489 Aug 29 05:18:19.573707 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2724/5429] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:19 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:19.771860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:19.781903 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8f9a6c96-4c22-4eb8-a2e7-12463c9a687f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.460621 Aug 29 05:18:19.783241 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2706/5430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:19 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:19.804097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:19.804759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:19.807969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:19.824973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:19.825640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:19.826050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:19.826775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:19.827278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:19.827651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:20.080621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:20.083958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3e65b3a6-16f8-4387-a6a5-185c03ee422f req-3a165fcd-a23b-4ad7-9dff-354a16ec59ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:20.103595 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f96df9e-8ed1-484f-817d-c09978e2189c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.303322 Aug 29 05:18:20.104228 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2725/5431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:19 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:20.124385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3e65b3a6-16f8-4387-a6a5-185c03ee422f req-3a165fcd-a23b-4ad7-9dff-354a16ec59ba service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:20.124875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3e65b3a6-16f8-4387-a6a5-185c03ee422f req-3a165fcd-a23b-4ad7-9dff-354a16ec59ba service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:20.125309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3e65b3a6-16f8-4387-a6a5-185c03ee422f req-3a165fcd-a23b-4ad7-9dff-354a16ec59ba service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:20.146452 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3e65b3a6-16f8-4387-a6a5-185c03ee422f req-3a165fcd-a23b-4ad7-9dff-354a16ec59ba service nova] Creating event network-changed:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h1-854119-9 Aug 29 05:18:20.154582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3e65b3a6-16f8-4387-a6a5-185c03ee422f req-3a165fcd-a23b-4ad7-9dff-354a16ec59ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079192 Aug 29 05:18:20.158724 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2707/5432] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:18:20.589993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:20.591429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:20.618112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:20.618723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:20.619255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:20.620069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:20.622154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:20.624414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:20.783255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:20.795724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:20.798456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:20.800890 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6648ea4f-dea7-4b2d-a082-efadfd3d2783 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.214808 Aug 29 05:18:20.801984 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2726/5433] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:20 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:20.841650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:20.842364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:20.862473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:20.863203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:20.863781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:20.864699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:20.865306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:20.865883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:21.128925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:21.130200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:21.137792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:21.138492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:21.139271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:21.140598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:21.141495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:21.142253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:21.294569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:21.305775 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eaa9d0a2-7898-4c98-a2aa-3863ec2391c3 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.506586 Aug 29 05:18:21.309992 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2708/5434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:20 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:21.404635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:21.420732 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bbc8116f-6c07-4fe6-ae12-70b379da59ba tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.295434 Aug 29 05:18:21.434267 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2727/5435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:21 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:21.827040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:21.827935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:21.845118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:21.847062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:21.847835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:21.848755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:21.849419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:21.849986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:21.952805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:21.966848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:21.969484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:21.973927 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8d85021c-4220-4b4f-b057-f02d2b0012aa tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.152154 Aug 29 05:18:21.976530 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2709/5436] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:21 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:22.333036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:22.334171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:22.342606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:22.343265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:22.344155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:22.345075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:22.345526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:22.345947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:22.444366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:22.445542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:22.461038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:22.462345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:22.464138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:22.466846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:22.469316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:22.472204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:22.715408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:22.726582 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-63f087ee-f73b-4387-bb1f-6e8783395a7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.398200 Aug 29 05:18:22.727171 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2728/5437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:22 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:22.758962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:22.772621 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bde08a52-c177-4882-ad51-0245264319d0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.329696 Aug 29 05:18:22.773725 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2710/5438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:22 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:23.004664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:23.005521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:23.013207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:23.014233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:23.015447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:23.016481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:23.017888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:23.018823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:23.042381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:23.081903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:23.124936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:23.157679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:23.173204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:23.175079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:23.176527 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-31f79779-82ec-4b7d-9ebd-ed203f3a56d9 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.176137 Aug 29 05:18:23.193400 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2729/5439] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:22 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:23.752601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:23.754014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:23.762526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:23.766572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:23.767977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:23.768454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:23.776663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:23.777357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:23.778021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:23.795053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:23.797529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:23.807606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:23.808435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:23.809206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:23.810110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:23.810751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:23.811410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:24.404266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:24.414280 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c5510e5f-fc6d-4403-9460-76d01ed1fd8c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.668216 Aug 29 05:18:24.419814 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2711/5440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:23 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:24.435768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:24.440581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:24.455998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:24.459839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:24.462867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:24.464337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:24.468207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:24.468909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:24.478033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:24.492331 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cd44aee3-33d8-4f30-a5fc-0450e4807026 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.698258 Aug 29 05:18:24.493591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2730/5441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:23 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:24.625070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:24.636620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:24.641574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:24.646537 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d8661229-b2b2-49b9-94bb-cafec62e9c51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.222736 Aug 29 05:18:24.657126 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2712/5442] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:24 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:25.438368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:25.438984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:25.447370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:25.448455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:25.448455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:25.449389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:25.449852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:25.454576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:25.514270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:25.514898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:25.522967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:25.523762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:25.524585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:25.525483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:25.526102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:25.526849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:25.818451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:25.826881 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b50a0e2c-9a97-4995-9269-7d036fb8ce56 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.392761 Aug 29 05:18:25.832958 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2731/5443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:25 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:25.844569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:25.845188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:25.862180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:25.866764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:25.867216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:25.868107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:25.868610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:25.869040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:25.901733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:25.923190 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cbd9eebb-56f9-4763-ad9a-b756e80b175a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.413135 Aug 29 05:18:25.938229 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2713/5444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:25 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:25.963689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:25.976540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:25.979143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:25.980907 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07f2af43-6838-4877-ae47-02b760ed74d4 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.142267 Aug 29 05:18:25.981839 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2732/5445] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:25 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:26.851254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:26.852585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:26.866480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:26.867149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:26.867752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:26.868655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:26.869253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:26.869811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:26.947731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:26.950366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:26.951311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:26.969474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:26.970334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:26.970988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:26.971966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:26.972692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:26.973328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:27.315157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:27.329373 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f94b8174-6b8a-4b37-9bea-c05b1d7d2dfa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.483414 Aug 29 05:18:27.331595 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2714/5446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:26 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:27.338001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:27.338709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:27.358426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:27.359914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:27.361202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:27.361695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:27.363142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:27.363777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:27.364236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:27.377177 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-445829bb-feb3-406f-b798-371ae4ff4c7b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.429953 Aug 29 05:18:27.390031 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2733/5447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:26 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:27.498035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:27.506855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:27.508414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:27.509667 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f75f4ad0-6405-4318-84c0-5aad137733e5 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.176075 Aug 29 05:18:27.510363 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2715/5448] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:27 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:28.351397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:28.352734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:28.360496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:28.361167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:28.361850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:28.362696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:28.363287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:28.363851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:28.407745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:28.408431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:28.417704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:28.418179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:28.419093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:28.420176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:28.420813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:28.421478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:28.718719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:28.732310 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bfddac16-e279-49db-bfe5-5a4850c5cbc8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.382089 Aug 29 05:18:28.732975 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2734/5449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:28 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:28.762801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:28.763446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:28.769862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:28.770890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:28.771511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:28.772414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:28.773040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:28.773624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:28.814203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:28.822718 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d6db3e7a-628b-49c8-ab30-5aed5ecd0416 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.421383 Aug 29 05:18:28.836690 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2716/5450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:28 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:28.902672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:28.925270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:28.926711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:28.928494 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-886e36d2-6a8e-4366-9a78-0f0905131a27 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.175991 Aug 29 05:18:28.931302 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2735/5451] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:28 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:29.158283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6e4655aa-fb25-4d4d-9466-d750178043fc req-439cefbb-174e-4409-ac8c-0af9a6805dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "name": "network-vif-plugged", "status": "completed", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:29.178726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6e4655aa-fb25-4d4d-9466-d750178043fc req-439cefbb-174e-4409-ac8c-0af9a6805dae service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:29.192096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6e4655aa-fb25-4d4d-9466-d750178043fc req-439cefbb-174e-4409-ac8c-0af9a6805dae service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:29.192096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6e4655aa-fb25-4d4d-9466-d750178043fc req-439cefbb-174e-4409-ac8c-0af9a6805dae service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:29.213295 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6e4655aa-fb25-4d4d-9466-d750178043fc req-439cefbb-174e-4409-ac8c-0af9a6805dae service nova] Creating event network-vif-plugged:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h1-854119-9 Aug 29 05:18:29.221013 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6e4655aa-fb25-4d4d-9466-d750178043fc req-439cefbb-174e-4409-ac8c-0af9a6805dae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068344 Aug 29 05:18:29.221761 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2717/5452] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:18:29.757118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:29.757749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:29.765012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:29.765506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:29.765941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:29.766693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:29.767147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:29.767892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:29.845547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:29.846246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:29.855755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:29.856354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:29.857005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:29.857921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:29.858520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:29.859094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:29.941768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:29.965824 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b9bdc4e0-70c0-4d6c-b810-f3d6743e0a23 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.211449 Aug 29 05:18:29.978105 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2736/5453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:29 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:29.984195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:29.984600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:30.001870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:30.004201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:30.004687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:30.005414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:30.008983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:30.009685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:30.178151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:30.189932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:30.191875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:30.193481 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4b21d4b-43ef-492e-9fa6-075a07e1b813 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.214145 Aug 29 05:18:30.209299 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2737/5454] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:29 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:30.743176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:30.756546 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-57b0f128-7e27-43ac-b3ab-d78d065539aa tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.915931 Aug 29 05:18:30.757439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2718/5455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:29 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:30.990866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:30.992060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:30.998955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:31.003539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:31.003539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:31.009391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:31.009964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:31.010303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:31.222058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:31.223082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:31.231888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:31.232931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:31.233605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:31.234607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:31.235656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:31.236360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:31.319426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:31.328569 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c8c08047-6dd9-49b0-a62e-092622da33dd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.341522 Aug 29 05:18:31.329396 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2738/5456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:30 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:31.351918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:31.363195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:31.365149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:31.366536 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-70d54380-dece-4845-b612-886eba8323a8 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.148634 Aug 29 05:18:31.367284 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2719/5457] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:31 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:18:31.780286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:31.781235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:31.804445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:31.804974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:31.805437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:31.806150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:31.806621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:31.807068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:32.029103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:32.039436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-34ed0f1b-93c6-4361-899a-c3d5b3c0343b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1392 microversion: 2.1 time: 0.264316 Aug 29 05:18:32.040642 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2739/5458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:31 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:32.351751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:32.353097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:32.361195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:32.362234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:32.363058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:32.365278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:32.376614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:32.390969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:32.400628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:32.417306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:32.436809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:32.441983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:32.449287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:32.450749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:32.454820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:32.456059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:32.560290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:32.569413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:32.575645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:32.576910 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a08d8986-d90d-45c4-8029-da80833962d7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.190551 Aug 29 05:18:32.577486 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2740/5459] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:32 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:32.719217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:32.728977 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f0b7c49-b1a5-4155-9cd3-6628abf5ce3e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1501 microversion: 2.1 time: 0.382479 Aug 29 05:18:32.729626 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2720/5460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:32 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1501 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:32.769174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37ae3c37-d937-43e7-8689-d7fd27eb7985"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:32.782771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:32.796045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:32.796707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:32.797218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:32.798002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:32.798526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:32.799041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:32.868143 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] HTTP exception thrown: Cannot 'attach_volume' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state rescued Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Request method failure captured: Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/os-volume_attachments HTTP/1.1 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 74 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEvMW3izJD85pVtbvax1SMfCuq2_Uf3UUHBG6YwbWLNgoxV3uYJIzYl-i9v4vjXyxY9Qq6gcnhWdP6WFxclBgQAU6dml8-Y-HMFx3s3QV0g_wjEpxDyxcKn6d9J-7o-Mew1NhfWoJLNGc1dBi1srqaIaTALn7VpmZsYiGBl2GStsVDM Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63bbfe3da13249fa9f9fe77f7725d037", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b9574a5f99bf4401a8a2297c71d3e382 Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: {"volumeAttachment": {"volumeId": "37ae3c37-d937-43e7-8689-d7fd27eb7985"}} Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot 'attach_volume' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state rescued Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'server_id': 'cbfbf67c-0d97-4987-ab70-671c27ee0e87', 'body': {'volumeAttachment': {'volumeId': '37ae3c37-d937-43e7-8689-d7fd27eb7985'}}} Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 05:18:32.870971 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state rescued Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state rescued Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Returning 409 to user: Cannot 'attach_volume' instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 while it is in vm_state rescued {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff3f1f49-8110-4616-b761-0114707ab887 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.126904 Aug 29 05:18:32.874691 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2741/5461] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:18:32 2022] POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/os-volume_attachments => generated 152 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:18:32.882001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5b2d46d1-7672-4b72-b82b-0d87ca027272 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:32.882550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b2d46d1-7672-4b72-b82b-0d87ca027272 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:32.892995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2d46d1-7672-4b72-b82b-0d87ca027272 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:32.893690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2d46d1-7672-4b72-b82b-0d87ca027272 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:32.912605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2d46d1-7672-4b72-b82b-0d87ca027272 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:32.913700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2d46d1-7672-4b72-b82b-0d87ca027272 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:32.918704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2d46d1-7672-4b72-b82b-0d87ca027272 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:32.919396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2d46d1-7672-4b72-b82b-0d87ca027272 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:33.062011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:33.063118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:33.078313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:33.078896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:33.080231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:33.081298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:33.086167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:33.086937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:33.091027 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5b2d46d1-7672-4b72-b82b-0d87ca027272 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action" status: 202 len: 0 microversion: 2.1 time: 0.212703 Aug 29 05:18:33.095116 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2721/5462] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:18:32 2022] POST /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:18:33.101588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:33.102428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:33.111434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:33.112010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:33.113184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:33.113979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:33.114622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:33.115203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:33.780732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:33.791150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:33.792811 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b08f18c-86d6-4ace-baeb-499691ce8f0f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1565 microversion: 2.1 time: 0.735558 Aug 29 05:18:33.809904 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2742/5463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:33 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1565 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:33.812406 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-62c44a17-a95c-45ba-8eb9-fa5020cfbb39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1509 microversion: 2.1 time: 0.715325 Aug 29 05:18:33.825036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:33.825036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:33.826858 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2722/5464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:33 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1509 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:18:33.842573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:33.844209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:33.850966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:33.851532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:33.852557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:33.854517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:33.856453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:33.857638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:33.863401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:33.864844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:33.867983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:33.868876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:33.869548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:33.870845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:34.009937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:34.020155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:34.021223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:34.021852 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-381c8b81-7172-42b6-90e8-59b7642f93af tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.208651 Aug 29 05:18:34.036143 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2743/5465] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:33 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:34.158715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:34.174641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1602b709-c789-4cdf-b221-e0464b5d0945 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1565 microversion: 2.1 time: 0.346169 Aug 29 05:18:34.179617 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2723/5466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:33 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1565 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:34.843460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:34.845632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:34.864233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:34.867024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:34.870656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:34.871596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:34.872183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:34.873093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:35.047930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:35.049819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:35.068650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:35.069339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:35.069948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:35.070828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:35.071272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:35.071840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:35.393729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:35.402032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:35.403501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:35.408939 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7642c0f2-d1d3-4df7-b768-fbd17ec15f51 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1409 microversion: 2.54 time: 0.365931 Aug 29 05:18:35.416506 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2724/5467] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:35 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1409 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:18:35.592770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:35.604851 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa51a706-d694-4e0f-9319-5ca4c534072d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1509 microversion: 2.1 time: 0.767463 Aug 29 05:18:35.608009 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2744/5468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:34 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1509 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:36.436316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:36.436914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:36.451242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:36.451768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:36.454711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:36.455518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:36.455992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:36.456454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:36.585272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:36.599324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:36.601132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:36.605056 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b3e3c0c4-48ec-4142-a5c8-38dc8aa00a0e tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1415 microversion: 2.54 time: 0.173821 Aug 29 05:18:36.607347 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2725/5469] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:36 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1415 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:36.626061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:36.626796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:36.640154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:36.642124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:36.645307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:36.646481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:36.647788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:36.648835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:37.598326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:37.610148 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df0ea990-7b12-456c-88ec-3aab9d647260 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1509 microversion: 2.1 time: 0.988018 Aug 29 05:18:37.615106 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2745/5470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:36 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1509 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:37.631037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:37.632922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:37.670661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:37.671229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:37.671681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:37.675475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:37.677802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:37.678252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:37.837695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:37.848745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:37.852959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:37.854183 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83aa0c1b-0334-407f-b284-025fd45d2342 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1415 microversion: 2.54 time: 0.227137 Aug 29 05:18:37.872436 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2726/5471] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:37 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1415 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:38.065692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-945201bd-6ead-4bb9-aedc-4c8c3d40ed8e req-bcd71cf6-f857-4bd3-9a8d-71e25889a65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:38.069701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:38.072845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:38.094563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:38.095289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:38.095904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:38.097683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:38.098291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:38.098884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:38.101672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-945201bd-6ead-4bb9-aedc-4c8c3d40ed8e req-bcd71cf6-f857-4bd3-9a8d-71e25889a65c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:38.102034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-945201bd-6ead-4bb9-aedc-4c8c3d40ed8e req-bcd71cf6-f857-4bd3-9a8d-71e25889a65c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:38.105994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-945201bd-6ead-4bb9-aedc-4c8c3d40ed8e req-bcd71cf6-f857-4bd3-9a8d-71e25889a65c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:38.134022 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-945201bd-6ead-4bb9-aedc-4c8c3d40ed8e req-bcd71cf6-f857-4bd3-9a8d-71e25889a65c service nova] Creating event network-changed:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h1-854119-9 Aug 29 05:18:38.141704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:38.148696 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-945201bd-6ead-4bb9-aedc-4c8c3d40ed8e req-bcd71cf6-f857-4bd3-9a8d-71e25889a65c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083723 Aug 29 05:18:38.156509 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2727/5472] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:18:38.609006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:38.617513 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-737e9ef0-7d38-42c5-aa4d-56b088fd5588 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1565 microversion: 2.1 time: 0.561541 Aug 29 05:18:38.618110 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2746/5473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:38 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1565 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:38.651514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:38.652920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:38.673870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:38.674682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:38.675407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:38.677278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:38.678111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:38.678880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:38.885229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:38.885773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:38.898410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:38.898931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:38.899381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:38.903739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:38.905005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:38.905647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:39.122681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:39.138312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:39.142199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:39.147090 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b44e978-13b5-4172-afa5-28805278d0c7 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1415 microversion: 2.54 time: 0.267017 Aug 29 05:18:39.162008 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2747/5474] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:38 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1415 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:39.201932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:39.214005 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12ce6805-16cd-4e10-b769-208e9ef9d4a4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1509 microversion: 2.1 time: 0.570679 Aug 29 05:18:39.216483 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2728/5475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:38 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:40.184496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:40.185841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:40.202939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:40.203725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:40.204397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:40.210863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:40.213327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:40.214183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:40.242036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:40.242771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:40.260607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:40.261256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:40.261833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:40.262685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:40.264704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:40.265261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:40.629929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:40.641252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:40.642712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:40.650578 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-beab74fb-9989-4dc2-8558-aa886416904a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1415 microversion: 2.54 time: 0.469325 Aug 29 05:18:40.651197 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2748/5476] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:40 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1415 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:40.908458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:40.924617 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e6a28726-4d20-4d90-9714-0bd5f6429363 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1509 microversion: 2.1 time: 0.691206 Aug 29 05:18:40.926944 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2729/5477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:40 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1509 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:41.676352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:41.676975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:41.691268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:41.691866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:41.692352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:41.693070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:41.693519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:41.694035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:41.830001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:41.851245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:41.859611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:41.863603 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5b2206ba-5faf-46ee-a7bd-e2c61a8560e1 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1415 microversion: 2.54 time: 0.191171 Aug 29 05:18:41.878991 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2749/5478] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:41 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1415 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:41.946975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:41.947883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:41.962725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:41.963359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:41.964071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:41.965164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:41.968294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:41.969030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:42.813573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:42.821435 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b4f21646-53f2-4137-bce4-d1abd00e42e1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1515 microversion: 2.1 time: 0.878339 Aug 29 05:18:42.822014 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2730/5479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:41 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1515 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:42.890106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:42.891869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:42.909065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:42.917409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:42.922277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:42.923280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:42.923902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:42.924510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:43.136530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:43.149736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:43.157841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:43.163646 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c7e20160-6ddd-474a-8ed1-1af44c1f400b tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1400 microversion: 2.54 time: 0.278036 Aug 29 05:18:43.184857 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2750/5480] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:42 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1400 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:43.201969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9132d86-5abe-4655-8605-a2ade6063ee6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '.version_select at 0x7f1ab847bee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:43.256959 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9132d86-5abe-4655-8605-a2ade6063ee6 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1070241263" status: 204 len: 0 microversion: 2.54 time: 0.059865 Aug 29 05:18:43.262304 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2731/5481] 10.222.0.20 () {60 vars in 1319 bytes} [Mon Aug 29 05:18:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1070241263 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:18:43.282730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:43.284057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:43.294666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:43.295983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:43.296862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:43.298243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:43.299053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:43.299976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:43.401088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:18:43.541987 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1fc7117f-2dd1-48fb-b5cb-69599e44febf tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 204 len: 0 microversion: 2.54 time: 0.268219 Aug 29 05:18:43.545074 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2751/5482] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:18:43 2022] DELETE /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:18:43.555761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:43.556295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:43.565587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:43.566205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:43.567087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:43.568224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:43.568895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:43.569492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:43.623625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:43.706796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:43.733793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:43.735347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:43.736588 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf22b2b2-3ec0-4b4a-8bc7-8a9daf42aa3a tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1406 microversion: 2.54 time: 0.186122 Aug 29 05:18:43.741312 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2732/5483] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:43 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:44.764944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:44.765665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:44.781266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:44.781795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:44.782454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:44.787537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:44.788235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:44.788592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:44.868865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:44.881073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:44.882724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:44.884103 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e2a20c13-6459-4d88-8285-3a4a2ae60993 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1406 microversion: 2.54 time: 0.126806 Aug 29 05:18:44.885181 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2752/5484] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:44 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:45.687417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64ec6211-9c32-46a3-a18c-b9950b744127 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'create', calling method: .version_select at 0x7f1ab8463c10>, body: {"keypair": {"name": "tempest-keypair-1897057736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5wbW5ocO3vB4ZZVGCVOt5Qn4nsNaWPNMWPylmJ93HUAWycd6dpBjlR0nWbjHVR2tbe1E2hO6yIOcwCWa7d8dNMbroSG4hg9WiqEFJpVVzhf5V8tmHV65uGM6vZZahJtw=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:45.707403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-64ec6211-9c32-46a3-a18c-b9950b744127 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Getting quotas for project 63bbfe3da13249fa9f9fe77f7725d037. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:18:45.715025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-64ec6211-9c32-46a3-a18c-b9950b744127 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Getting quotas for user b9574a5f99bf4401a8a2297c71d3e382 and project 63bbfe3da13249fa9f9fe77f7725d037. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:18:45.746278 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64ec6211-9c32-46a3-a18c-b9950b744127 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063769 Aug 29 05:18:45.747017 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2733/5485] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:18:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:18:45.908975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:45.909585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:45.937564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:45.938061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:45.945327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:45.946095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:45.946568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:45.946999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:46.028443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:46.029304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:46.029991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:46.030684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lazy-loading 'fault' on Instance uuid 57a75d16-89fe-4712-91e9-e733d2811452 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:18:46.075152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:46.083834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:46.086513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c10272683d24e97af61d80fbfd04b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee790a7faa624efb9fc7372ec335841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:46.087974 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aaa4e3a0-287c-4e6f-a2bf-df3f71641364 tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 200 len: 1411 microversion: 2.54 time: 0.185058 Aug 29 05:18:46.089110 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2753/5486] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:45 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 1411 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:18:47.111688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:47.112530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] [instance: 57a75d16-89fe-4712-91e9-e733d2811452] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:47.177850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:47.178478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:47.178939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:47.180252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:47.180252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:47.180626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:47.238042 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] HTTP exception thrown: Instance 57a75d16-89fe-4712-91e9-e733d2811452 could not be found. Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Request method failure captured: Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 HTTP/1.1 Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEv-xtE9SkzHfA1YxNUD0EQOrxnBKGNaNZzdz0wuQfhVtZI-JHGyTwBanWgjVK-L2cAoHgtFmLFBba7_xBcrmQohb0KI7GiZ1tXvnvyNENMR7HGIVPjVv08UKyi1J9EBSBLCNE0Fp9Y39Rd3yoXRwMAZZkK6iXLiv8l7WBI_Q2sNW5o Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.54 Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: ee790a7faa624efb9fc7372ec335841e Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerShowV254Test-532032195 Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee790a7faa624efb9fc7372ec335841e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee790a7faa624efb9fc7372ec335841e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee790a7faa624efb9fc7372ec335841e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee790a7faa624efb9fc7372ec335841e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerShowV254Test-532032195 Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: ee790a7faa624efb9fc7372ec335841e Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerShowV254Test-532032195 Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerShowV254Test-532032195-project Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5c10272683d24e97af61d80fbfd04b72 Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerShowV254Test-532032195-project Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 57a75d16-89fe-4712-91e9-e733d2811452 could not be found. Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '57a75d16-89fe-4712-91e9-e733d2811452'} Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a75d16-89fe-4712-91e9-e733d2811452 could not be found. Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a75d16-89fe-4712-91e9-e733d2811452 could not be found. Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:18:47.239766 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a75d16-89fe-4712-91e9-e733d2811452 could not be found. Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] Returning 404 to user: Instance 57a75d16-89fe-4712-91e9-e733d2811452 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-56b8be12-9b5a-4889-a1f6-292edd0f39ee tempest-ServerShowV254Test-532032195 tempest-ServerShowV254Test-532032195-project] 10.222.0.20 "GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452" status: 404 len: 111 microversion: 2.54 time: 0.134187 Aug 29 05:18:47.243955 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2734/5487] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:18:47 2022] GET /compute/v2.1/servers/57a75d16-89fe-4712-91e9-e733d2811452 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:18:48.477315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-378059659", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1ccab09-9509-41ec-a212-c518ace49a1d"}], "security_groups": [{"name": "tempest-securitygroup--1846440044"}], "key_name": "tempest-keypair-1897057736", "user_data": "}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:48.745862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] validate_networks() for [('d1ccab09-9509-41ec-a212-c518ace49a1d', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:18:49.704531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:18:49.705910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:18:49.706875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:18:49.707540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:18:49.708407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:18:49.726380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:49.730750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:49.731652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:49.732929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:49.733681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:49.734617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:49.786060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Getting quotas for project 63bbfe3da13249fa9f9fe77f7725d037. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:18:49.800637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Getting quotas for user b9574a5f99bf4401a8a2297c71d3e382 and project 63bbfe3da13249fa9f9fe77f7725d037. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:18:49.835902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:18:49.838720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:18:49.899997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:49.950752 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-60b0b708-139b-49e4-8656-20bb249a6a39 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.478689 Aug 29 05:18:49.957978 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2754/5488] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:18:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:18:49.975566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-77c3e197-3ef6-4702-b41a-716859f73e2d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:49.976273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-77c3e197-3ef6-4702-b41a-716859f73e2d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:49.983039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:50.136883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-77c3e197-3ef6-4702-b41a-716859f73e2d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:50.159449 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-77c3e197-3ef6-4702-b41a-716859f73e2d tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1245 microversion: 2.1 time: 0.181836 Aug 29 05:18:50.178764 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2735/5489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:49 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1245 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:51.186886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:51.188168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:51.202287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:51.203078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:51.206180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:51.207125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:51.207765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:51.213445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:51.333411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:51.344306 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-351fcbda-00f5-45b5-b426-cecf4d0fe5ee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1297 microversion: 2.1 time: 0.160902 Aug 29 05:18:51.345891 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2755/5490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:51 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1297 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:52.375785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:52.377666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:52.406439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:52.408777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:52.409733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:52.415829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:52.427918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:52.430416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:52.818276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:52.827132 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5456eb21-dc2d-4db3-bd59-b1e37f185386 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1303 microversion: 2.1 time: 0.463222 Aug 29 05:18:52.872400 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2736/5491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:52 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1303 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:53.889187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:53.890560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:53.928333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:53.928871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:53.929325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:53.930082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:53.930538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:53.930961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:54.077571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:54.110642 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a941f427-2f78-42c0-bd8c-0dbdeb1349b5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1303 microversion: 2.1 time: 0.225738 Aug 29 05:18:54.111122 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2756/5492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:53 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:55.147889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:55.152664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:55.166989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:55.167756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:55.168934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:55.169896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:55.170538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:55.171759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:55.584078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:55.592141 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3ffddd9-bc22-4f03-a742-37cff90a3eb5 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.461154 Aug 29 05:18:55.603299 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2737/5493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:55 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:56.618657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:56.619325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:56.631795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:56.632547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:56.632992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:56.635598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:56.637241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:56.638018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:56.879570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a336e993-aae3-472c-ae90-34545687f1b5 req-df8d43ad-faab-46ff-a37d-6b4b9b5597c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c227b05-d28b-410f-bb7d-ccba6c7c2ad3", "tag": "d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:56.920269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a336e993-aae3-472c-ae90-34545687f1b5 req-df8d43ad-faab-46ff-a37d-6b4b9b5597c3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:56.924258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a336e993-aae3-472c-ae90-34545687f1b5 req-df8d43ad-faab-46ff-a37d-6b4b9b5597c3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:56.924857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a336e993-aae3-472c-ae90-34545687f1b5 req-df8d43ad-faab-46ff-a37d-6b4b9b5597c3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:56.969803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a336e993-aae3-472c-ae90-34545687f1b5 req-df8d43ad-faab-46ff-a37d-6b4b9b5597c3 service nova] Creating event network-changed:d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7 for instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 on n-h1-854119-9 Aug 29 05:18:56.982436 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a336e993-aae3-472c-ae90-34545687f1b5 req-df8d43ad-faab-46ff-a37d-6b4b9b5597c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109889 Aug 29 05:18:56.983381 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2738/5494] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:18:57.028755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:57.039628 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d33be9a-8ca0-4687-9013-0adf2ea954f8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.425161 Aug 29 05:18:57.040655 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2757/5495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:56 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:58.066673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:58.068345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:58.082837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:58.084025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:58.085912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:58.088158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:58.088706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:58.089204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:58.378306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:18:58.393614 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-48d1db3f-6f79-4d96-bcfa-db315d8465ab tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.332194 Aug 29 05:18:58.394159 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2739/5496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:58 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:18:59.421417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:59.435311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:59.457007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:59.466888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:59.467675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:59.468676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:59.469375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:59.470078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:59.554945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54c33e1c-c683-41d5-bdd6-cae79491fe88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:18:59.557516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-54c33e1c-c683-41d5-bdd6-cae79491fe88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:59.576156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c33e1c-c683-41d5-bdd6-cae79491fe88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:59.576686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c33e1c-c683-41d5-bdd6-cae79491fe88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:59.579265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c33e1c-c683-41d5-bdd6-cae79491fe88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:59.585583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c33e1c-c683-41d5-bdd6-cae79491fe88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:59.586374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c33e1c-c683-41d5-bdd6-cae79491fe88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:59.586999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c33e1c-c683-41d5-bdd6-cae79491fe88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:59.768750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:59.799576 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54c33e1c-c683-41d5-bdd6-cae79491fe88 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.250436 Aug 29 05:18:59.801500 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2740/5497] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:18:59 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:18:59.812267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:18:59.814225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:18:59.818614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:18:59.831295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:59.831789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:59.832289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:59.833004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:18:59.833511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:18:59.833876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:18:59.993847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:00.017094 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4517996d-9170-49f3-84c3-e02fbedba032 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.598688 Aug 29 05:19:00.018778 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2758/5498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:59 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:00.145754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:00.149839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:00.158100 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8f9516c1-0b8b-49d4-b0c1-66651ba7d42c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1673 microversion: 2.1 time: 0.352063 Aug 29 05:19:00.161194 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2741/5499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:18:59 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1673 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:01.039461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:01.040752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:01.051815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:01.052745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:01.053355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:01.054244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:01.054913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:01.055505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:01.185448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:01.187066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:01.216534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:01.217747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:01.219380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:01.220392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:01.226718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:01.228170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:02.402797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:02.425403 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef84d886-f3c3-4ff9-b647-fd837902ee61 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 1.390458 Aug 29 05:19:02.432214 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2759/5500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:01 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:19:02.588725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:02.615738 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-59f0140c-2311-422c-ac3d-c93ace39c248 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1673 microversion: 2.1 time: 1.435539 Aug 29 05:19:02.620082 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2742/5501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:01 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1673 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:19:03.460136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:03.461510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:03.475861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:03.487744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:03.488534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:03.489444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:03.492488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:03.493283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:03.639172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:03.639899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:03.651754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:03.652723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:03.656829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:03.657907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:03.658731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:03.659366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:04.201769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:04.211816 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4ec5638-b11c-4f65-97ec-1922e15c21f3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1678 microversion: 2.1 time: 0.576824 Aug 29 05:19:04.218971 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2743/5502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:03 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1678 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:19:04.316074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:04.325447 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9c18473e-f4e5-408a-828e-00442a5c4585 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.869107 Aug 29 05:19:04.330843 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2760/5503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:03 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:05.239159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:05.240469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:05.262591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:05.263090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:05.263520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:05.266029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:05.266501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:05.266929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:05.355106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:05.356315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:05.392242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:05.393134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:05.393741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:05.394656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:05.395254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:05.395846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:05.818470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:05.828735 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-98a689a7-231b-4757-aac8-e966812ff0f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.593590 Aug 29 05:19:05.834829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2744/5504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:05 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:06.022620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:06.029759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:06.032299 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-86206231-3ea4-43a0-a08f-2abf8907fee4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.681150 Aug 29 05:19:06.047419 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2761/5505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:05 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:07.054523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:07.055131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:07.070349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:07.086972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:07.091467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:07.095515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:07.097779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:07.099532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:07.497186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:07.511281 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ea3b9620-91a3-4a4e-8f0f-a65224e0ec6c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.461252 Aug 29 05:19:07.530854 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2745/5506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:07 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:08.550902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:08.552352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:08.608431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:08.623117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:08.626984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:08.630135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:08.632688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:08.633515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:09.111553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:09.120734 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-948816e3-14c4-4117-9c5a-21179bc05f7e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.586131 Aug 29 05:19:09.121599 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2762/5507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:08 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:10.143517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:10.144224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:10.162577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:10.163013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:10.165306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:10.166227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:10.167092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:10.169065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:10.542768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b0481a5-77b8-496d-bcbd-90fb35c92d25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:10.545660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b0481a5-77b8-496d-bcbd-90fb35c92d25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:10.565900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b0481a5-77b8-496d-bcbd-90fb35c92d25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:10.567164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b0481a5-77b8-496d-bcbd-90fb35c92d25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:10.568051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b0481a5-77b8-496d-bcbd-90fb35c92d25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:10.569724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b0481a5-77b8-496d-bcbd-90fb35c92d25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:10.570435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b0481a5-77b8-496d-bcbd-90fb35c92d25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:10.571059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b0481a5-77b8-496d-bcbd-90fb35c92d25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:10.652348 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b0481a5-77b8-496d-bcbd-90fb35c92d25 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.113061 Aug 29 05:19:10.681064 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2763/5508] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 29 05:19:10 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:10.746771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:10.747364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:10.758695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:10.759189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:10.759619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:10.760382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:10.760863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:10.761280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:10.826086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:19:10.984354 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9ab970ca-d799-4368-b3db-6c86778a73e2 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 204 len: 0 microversion: 2.20 time: 0.241090 Aug 29 05:19:10.986096 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2764/5509] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:19:10 2022] DELETE /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 05:19:11.001057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:11.003035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:11.012868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:11.013932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:11.015232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:11.017590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:11.018300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:11.019011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:11.099695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:11.120479 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-064766f7-9e02-492b-a59c-f2fb843ebfe4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.982064 Aug 29 05:19:11.121074 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2746/5510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:10 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:11.256909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e63b2058-9ea2-4fd0-8b12-316ee4fc029d req-33b617dd-363d-4ff2-8315-d35089455478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c227b05-d28b-410f-bb7d-ccba6c7c2ad3", "name": "network-vif-plugged", "status": "completed", "tag": "d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:11.282716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e63b2058-9ea2-4fd0-8b12-316ee4fc029d req-33b617dd-363d-4ff2-8315-d35089455478 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:11.286145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e63b2058-9ea2-4fd0-8b12-316ee4fc029d req-33b617dd-363d-4ff2-8315-d35089455478 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:11.289975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e63b2058-9ea2-4fd0-8b12-316ee4fc029d req-33b617dd-363d-4ff2-8315-d35089455478 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:11.338137 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e63b2058-9ea2-4fd0-8b12-316ee4fc029d req-33b617dd-363d-4ff2-8315-d35089455478 service nova] Creating event network-vif-plugged:d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7 for instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 on n-h1-854119-9 Aug 29 05:19:11.348046 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e63b2058-9ea2-4fd0-8b12-316ee4fc029d req-33b617dd-363d-4ff2-8315-d35089455478 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096020 Aug 29 05:19:11.353127 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2747/5511] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:19:11.555928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:11.566019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:11.567477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:11.582203 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51b13748-ed12-45d1-8196-b5f47e346469 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 0.588636 Aug 29 05:19:11.583423 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2765/5512] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:19:10 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:19:12.150748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:12.151485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:12.170710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:12.171201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:12.177338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:12.178370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:12.179509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:12.180145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:12.608668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:12.609280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:12.625085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:12.635843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:12.636620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:12.638281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:12.639357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:12.647179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:13.259384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:13.281128 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30dac022-b131-42a8-9456-75cb6eec96a1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 1.139203 Aug 29 05:19:13.281720 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2748/5513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:12 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:13.494036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:13.507187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:13.517653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:13.518911 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-161f7027-d8d1-49e7-887b-d5307291143f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 0.914903 Aug 29 05:19:13.527122 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2766/5514] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:19:12 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 05:19:13.538743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-533669293", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "76bd0326-223a-41a1-b0dc-b09e31140133"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:13.633264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] validate_networks() for [('76bd0326-223a-41a1-b0dc-b09e31140133', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:19:14.305284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:14.305911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:14.319788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:14.320337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:14.320785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:14.321525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:14.326793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:14.327299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:14.953270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:14.966228 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-68ace4eb-8095-49c9-8f48-8d1a1fbabaa9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1371 microversion: 2.1 time: 0.664836 Aug 29 05:19:14.969745 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2767/5515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:14 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1371 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:19:14.985025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:14.987043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:15.012098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:15.012829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:15.013340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:15.016611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:15.022425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:15.022939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:15.512073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:19:15.512606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:19:15.512991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:19:15.513502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:19:15.513920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:19:15.530874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:15.531369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:15.531802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:15.532624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:15.533077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:15.533508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:15.553600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:15.590369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Getting quotas for project 7ea88c9cd35e455db75074430ed2b2b8. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:19:15.595969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Getting quotas for user d24186bb745b41f886ed4abbedc99613 and project 7ea88c9cd35e455db75074430ed2b2b8. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:19:15.633581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:15.643790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:19:15.645195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:15.649962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:15.651260 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7a8d5baa-3597-4475-9292-a13d3003dfe7 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1722 microversion: 2.20 time: 0.678332 Aug 29 05:19:15.651828 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2768/5516] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:19:14 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1722 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:19:15.657108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:19:15.753538 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0833f1ed-b183-4a98-8a91-f6ec81c64805 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.461843 Aug 29 05:19:15.761503 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2749/5517] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:19:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:19:15.771977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39f61676-63c5-46ae-8aa4-4eabc3f63674 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:15.773920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39f61676-63c5-46ae-8aa4-4eabc3f63674 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:15.910689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06a08b38-a0d8-407d-bb57-0822559f39a8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:15.913194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06a08b38-a0d8-407d-bb57-0822559f39a8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:15.943566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a08b38-a0d8-407d-bb57-0822559f39a8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:15.944370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a08b38-a0d8-407d-bb57-0822559f39a8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:15.945199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a08b38-a0d8-407d-bb57-0822559f39a8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:15.953278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a08b38-a0d8-407d-bb57-0822559f39a8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:15.957314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a08b38-a0d8-407d-bb57-0822559f39a8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:15.960921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06a08b38-a0d8-407d-bb57-0822559f39a8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:16.084287 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06a08b38-a0d8-407d-bb57-0822559f39a8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action" status: 200 len: 24565 microversion: 2.1 time: 0.431133 Aug 29 05:19:16.085510 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2769/5518] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:19:15 2022] POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action => generated 24565 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:19:16.098965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:16.100167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:16.131778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:16.132324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:16.134374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:16.135116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:16.136043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:16.136043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:16.197492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-39f61676-63c5-46ae-8aa4-4eabc3f63674 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:16.224712 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39f61676-63c5-46ae-8aa4-4eabc3f63674 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1227 microversion: 2.1 time: 0.458019 Aug 29 05:19:16.237172 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2750/5519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:15 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1227 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:16.679947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:16.682155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:16.696721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:16.698822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:16.699610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:16.700874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:16.701592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:16.702251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:17.223249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:17.255964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:17.257943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:17.265449 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d88e241-341d-442e-9264-6b4494f2c41a tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1655 microversion: 2.20 time: 0.590662 Aug 29 05:19:17.282932 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2751/5520] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:19:16 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1655 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:19:17.317404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:17.318075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:17.336650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:17.343099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:17.343521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:17.344475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:17.345138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:17.345793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:17.519673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:17.536955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:17.552027 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-25183544-b75d-4464-b516-96fba7ec1375 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1565 microversion: 2.1 time: 1.463458 Aug 29 05:19:17.553049 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2770/5521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:16 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1565 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:17.555181 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a08afbd-184b-46b8-8f1e-d0ed26438b62 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1279 microversion: 2.1 time: 0.263784 Aug 29 05:19:17.556575 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2752/5522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:17 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1279 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:17.576154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a997d495-d281-48e6-89de-fcc3512d3aee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:17.576154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a997d495-d281-48e6-89de-fcc3512d3aee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:17.606177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a997d495-d281-48e6-89de-fcc3512d3aee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:17.606692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a997d495-d281-48e6-89de-fcc3512d3aee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:17.607125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a997d495-d281-48e6-89de-fcc3512d3aee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:17.607859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a997d495-d281-48e6-89de-fcc3512d3aee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:17.608364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a997d495-d281-48e6-89de-fcc3512d3aee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:17.608789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a997d495-d281-48e6-89de-fcc3512d3aee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:17.845862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4e062fa1-e3b8-4629-b95c-79550b1cb1ff req-758c71fa-7ca8-4ef7-b8e3-adb8bced5b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0212b868-400b-4cd4-9278-f45805cc128f", "name": "network-vif-deleted", "tag": "cd6eaae0-af11-4f54-97bf-0b3ddd31b12d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:17.864233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a997d495-d281-48e6-89de-fcc3512d3aee tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.294470 Aug 29 05:19:17.865397 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2771/5523] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:19:17 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-interface => generated 284 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:19:17.881691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4e062fa1-e3b8-4629-b95c-79550b1cb1ff req-758c71fa-7ca8-4ef7-b8e3-adb8bced5b74 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:17.882478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4e062fa1-e3b8-4629-b95c-79550b1cb1ff req-758c71fa-7ca8-4ef7-b8e3-adb8bced5b74 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:17.883282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4e062fa1-e3b8-4629-b95c-79550b1cb1ff req-758c71fa-7ca8-4ef7-b8e3-adb8bced5b74 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:17.956443 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4e062fa1-e3b8-4629-b95c-79550b1cb1ff req-758c71fa-7ca8-4ef7-b8e3-adb8bced5b74 service nova] Creating event network-vif-deleted:cd6eaae0-af11-4f54-97bf-0b3ddd31b12d for instance 0212b868-400b-4cd4-9278-f45805cc128f on n-h1-854119-9 Aug 29 05:19:17.966610 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4e062fa1-e3b8-4629-b95c-79550b1cb1ff req-758c71fa-7ca8-4ef7-b8e3-adb8bced5b74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124558 Aug 29 05:19:17.972246 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2753/5524] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:19:18.297377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:18.298204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:18.313758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:18.317280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:18.321154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:18.323833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:18.324545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:18.326569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:18.456400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:18.456900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:18.460354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:18.460826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lazy-loading 'fault' on Instance uuid 0212b868-400b-4cd4-9278-f45805cc128f {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:19:18.601779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:18.602856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:18.616380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:18.617397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:18.618117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:18.619226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:18.620040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:18.620762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:18.629711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:18.638360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:18.639810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:18.641025 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8cb90894-a3b2-4379-bbef-90a07b29e2bb tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1371 microversion: 2.20 time: 0.349952 Aug 29 05:19:18.641617 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2772/5525] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:19:18 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:19:18.818182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:18.835450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-18938642-6e4f-4a23-8138-3647ea4f0b77 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1297 microversion: 2.1 time: 0.250737 Aug 29 05:19:18.838927 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2754/5526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:18 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1297 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:19.674505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:19.676038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:19.690924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:19.691685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:19.694650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:19.695819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:19.696709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:19.697857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:19.814496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:19.821059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:19.822868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:19.825390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lazy-loading 'fault' on Instance uuid 0212b868-400b-4cd4-9278-f45805cc128f {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:19:19.860991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:19.862187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:19.892993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:19.896372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:19.902325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:19.903300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:19.905308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:19.911689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:19.925794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:19.945169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:19.949122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e283b8db0cfc47acac0ca482a69005d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f948ec6a5b043ed8ea6bac997a4c2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:19.950635 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-412fa99f-9125-454f-8c17-0aee89e45c81 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 200 len: 1371 microversion: 2.20 time: 0.282921 Aug 29 05:19:19.953351 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2773/5527] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:19:19 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 05:19:20.083645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:20.134812 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-544b8194-cda9-4422-9c46-fdddfdca27bb tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1285 microversion: 2.1 time: 0.278919 Aug 29 05:19:20.137381 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2755/5528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:19 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1285 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:20.980428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:20.981181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:21.003500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:21.023353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:21.023862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:21.024352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:21.034972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:21.042618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:21.043236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:21.064913 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] HTTP exception thrown: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Request method failure captured: Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f HTTP/1.1 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEmfsS_sPNgL4dC_VoSatyJN5SFMDp4PzY8V5auQDwX6xit3qadtZhmeBEdwjHAvGhQ_hRa-o28pCSBeoNKcop80cKdzb7qrkhf-ORyiT0zn_FymdVjjfzpw0Nzivv3kDH2818L7EbkIR9BeJ8b4FhctqXQzOijO7pVmt7nWXGXh0wU Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f948ec6a5b043ed8ea6bac997a4c2c4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e283b8db0cfc47acac0ca482a69005d6 Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '0212b868-400b-4cd4-9278-f45805cc128f'} Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:21.066740 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:21.070521 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:21.070521 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:21.070521 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:21.070521 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:21.070521 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:19:21.070521 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:19:21.070521 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:21.070521 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:21.071031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Returning 404 to user: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:19:21.072830 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-073b9a34-cdfc-44ff-b0ec-8f617f11028c tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 404 len: 111 microversion: 2.20 time: 0.097759 Aug 29 05:19:21.078570 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2774/5529] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:19:20 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:19:21.090664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d52bb52e-0fe9-4a8b-ab4f-8b03a01efb90 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '.version_select at 0x7f1ab9d98f70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:21.125088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:21.161407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:21.162598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:21.166799 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d52bb52e-0fe9-4a8b-ab4f-8b03a01efb90 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105982994" status: 204 len: 0 microversion: 2.20 time: 0.079817 Aug 29 05:19:21.188518 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2756/5530] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 29 05:19:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105982994 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 05:19:21.193588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:21.194758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:21.198848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:21.200326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:21.203898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:21.207727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:21.785232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0fb6435a-85f2-41c4-bda3-735d9237e36d req-8be9bae9-698b-46e5-9d0d-9812a639df62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c227b05-d28b-410f-bb7d-ccba6c7c2ad3", "tag": "d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:21.838002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0fb6435a-85f2-41c4-bda3-735d9237e36d req-8be9bae9-698b-46e5-9d0d-9812a639df62 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:21.842172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0fb6435a-85f2-41c4-bda3-735d9237e36d req-8be9bae9-698b-46e5-9d0d-9812a639df62 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:21.844521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0fb6435a-85f2-41c4-bda3-735d9237e36d req-8be9bae9-698b-46e5-9d0d-9812a639df62 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:21.876983 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0fb6435a-85f2-41c4-bda3-735d9237e36d req-8be9bae9-698b-46e5-9d0d-9812a639df62 service nova] Creating event network-changed:d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7 for instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 on n-h1-854119-9 Aug 29 05:19:21.897354 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0fb6435a-85f2-41c4-bda3-735d9237e36d req-8be9bae9-698b-46e5-9d0d-9812a639df62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112138 Aug 29 05:19:21.915434 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2757/5531] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:19:22.205343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:22.216992 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-937fc4d9-a4e7-4e1f-946b-b09740128e0a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1327 microversion: 2.1 time: 1.061632 Aug 29 05:19:22.235244 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2775/5532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:21 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1327 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:23.258361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:23.259234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:23.278935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:23.279993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:23.280658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:23.281678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:23.282321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:23.284774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:23.965775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:23.985499 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-93137887-5592-4c75-a130-497738a1f55d tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1327 microversion: 2.1 time: 0.733996 Aug 29 05:19:23.986318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2758/5533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:23 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1327 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:24.150688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-320c72b3-28cc-4a87-ba31-2494e692ff1c req-9de3a77d-4054-4c08-a705-f2156b40ac5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1872c62a-6023-450e-9010-c9584ad99b57", "tag": "8468164e-fc46-4981-8a4c-de4946761b6f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:24.167913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-320c72b3-28cc-4a87-ba31-2494e692ff1c req-9de3a77d-4054-4c08-a705-f2156b40ac5f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:24.171567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-320c72b3-28cc-4a87-ba31-2494e692ff1c req-9de3a77d-4054-4c08-a705-f2156b40ac5f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:24.184826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-320c72b3-28cc-4a87-ba31-2494e692ff1c req-9de3a77d-4054-4c08-a705-f2156b40ac5f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:24.221011 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-320c72b3-28cc-4a87-ba31-2494e692ff1c req-9de3a77d-4054-4c08-a705-f2156b40ac5f service nova] Creating event network-changed:8468164e-fc46-4981-8a4c-de4946761b6f for instance 1872c62a-6023-450e-9010-c9584ad99b57 on n-h1-854119-9 Aug 29 05:19:24.236408 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-320c72b3-28cc-4a87-ba31-2494e692ff1c req-9de3a77d-4054-4c08-a705-f2156b40ac5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089446 Aug 29 05:19:24.252751 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2776/5534] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:19:25.008640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:25.009778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:25.019130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:25.023656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:25.024509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:25.025429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:25.026112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:25.026728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:25.451748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:25.459602 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6a6a1b21-a828-4488-a7d3-8cc3b659c446 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1327 microversion: 2.1 time: 0.455196 Aug 29 05:19:25.460819 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2759/5535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:25 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1327 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:26.489180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:26.490043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:26.505109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:26.505604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:26.510440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:26.511481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:26.512664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:26.516032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:26.821234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:26.831032 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-204b9017-7352-4ba1-aa0e-fc6277066a33 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1327 microversion: 2.1 time: 0.352042 Aug 29 05:19:26.832912 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2777/5536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:26 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1327 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:27.858410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:27.859030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:27.884670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:27.889219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:27.903039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:27.914557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:27.915014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:27.915777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:27.916346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:27.916796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:28.464603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:28.478916 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1cb39e1f-b06f-4284-976a-1f39518a09d8 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1327 microversion: 2.1 time: 0.628191 Aug 29 05:19:28.487101 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2760/5537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:27 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1327 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:28.508540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:28.509092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:28.536668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:28.537384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:28.537870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:28.538806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:28.539267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:28.542541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:28.556796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:28.615101 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] HTTP exception thrown: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Request method failure captured: Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f HTTP/1.1 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEmfsS_sPNgL4dC_VoSatyJN5SFMDp4PzY8V5auQDwX6xit3qadtZhmeBEdwjHAvGhQ_hRa-o28pCSBeoNKcop80cKdzb7qrkhf-ORyiT0zn_FymdVjjfzpw0Nzivv3kDH2818L7EbkIR9BeJ8b4FhctqXQzOijO7pVmt7nWXGXh0wU Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f948ec6a5b043ed8ea6bac997a4c2c4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e283b8db0cfc47acac0ca482a69005d6 Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '0212b868-400b-4cd4-9278-f45805cc128f'} Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:19:28.617511 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.621743 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.623209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Returning 404 to user: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:19:28.624571 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76c36c8b-20b8-4e9c-baae-2f7e75809033 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 404 len: 111 microversion: 2.20 time: 0.120318 Aug 29 05:19:28.625333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2778/5538] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:19:28 2022] DELETE /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:19:28.633499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:28.634118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 0212b868-400b-4cd4-9278-f45805cc128f] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:28.646701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:28.647201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:28.647639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:28.651544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:28.652087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:28.652559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:28.717354 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] HTTP exception thrown: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Request method failure captured: Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f HTTP/1.1 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEmfsS_sPNgL4dC_VoSatyJN5SFMDp4PzY8V5auQDwX6xit3qadtZhmeBEdwjHAvGhQ_hRa-o28pCSBeoNKcop80cKdzb7qrkhf-ORyiT0zn_FymdVjjfzpw0Nzivv3kDH2818L7EbkIR9BeJ8b4FhctqXQzOijO7pVmt7nWXGXh0wU Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f948ec6a5b043ed8ea6bac997a4c2c4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e283b8db0cfc47acac0ca482a69005d6 Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '0212b868-400b-4cd4-9278-f45805cc128f'} Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.719298 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Returning 404 to user: Instance 0212b868-400b-4cd4-9278-f45805cc128f could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5122703f-9431-46f7-9143-9e790912007f tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f" status: 404 len: 111 microversion: 2.20 time: 0.091183 Aug 29 05:19:28.723763 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2761/5539] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:19:28 2022] GET /compute/v2.1/servers/0212b868-400b-4cd4-9278-f45805cc128f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 05:19:29.501248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:29.501893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:29.525475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:29.526103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:29.526420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:29.532892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:29.533382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:29.533827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:29.832384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:29.840632 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e72a7c74-0474-40a2-a688-466a4643c76a tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1327 microversion: 2.1 time: 0.345231 Aug 29 05:19:29.842604 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2779/5540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:29 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1327 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:30.861108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:30.862422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:30.873276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:30.875457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:30.876777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:30.878611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:30.880661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:30.881342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:31.167048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:31.176534 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b47a45d9-b414-423a-bd98-6fb02d8abe20 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1327 microversion: 2.1 time: 0.319289 Aug 29 05:19:31.177295 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2762/5541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:30 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1327 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:32.198732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:32.199703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:32.221203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:32.226650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:32.227239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:32.229740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:32.230454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:32.232409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:32.376426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-89331d03-23ed-47f4-9709-0a4b1e3b660d req-75280f60-d2c7-4021-a45c-ae0bf96f702c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1872c62a-6023-450e-9010-c9584ad99b57", "name": "network-vif-plugged", "status": "completed", "tag": "8468164e-fc46-4981-8a4c-de4946761b6f"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:32.402556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-89331d03-23ed-47f4-9709-0a4b1e3b660d req-75280f60-d2c7-4021-a45c-ae0bf96f702c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:32.403215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-89331d03-23ed-47f4-9709-0a4b1e3b660d req-75280f60-d2c7-4021-a45c-ae0bf96f702c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:32.404301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-89331d03-23ed-47f4-9709-0a4b1e3b660d req-75280f60-d2c7-4021-a45c-ae0bf96f702c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:32.435547 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-89331d03-23ed-47f4-9709-0a4b1e3b660d req-75280f60-d2c7-4021-a45c-ae0bf96f702c service nova] Creating event network-vif-plugged:8468164e-fc46-4981-8a4c-de4946761b6f for instance 1872c62a-6023-450e-9010-c9584ad99b57 on n-h1-854119-9 Aug 29 05:19:32.445780 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-89331d03-23ed-47f4-9709-0a4b1e3b660d req-75280f60-d2c7-4021-a45c-ae0bf96f702c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072925 Aug 29 05:19:32.446399 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2763/5542] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:19:32.599598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:32.611444 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3749ce74-c75a-4aaf-b98d-0695e53ddc73 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1327 microversion: 2.1 time: 0.417920 Aug 29 05:19:32.615365 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2780/5543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:32 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1327 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:33.636295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:33.637740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:33.653126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:33.654916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:33.656201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:33.658262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:33.662105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:33.662815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:34.132197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:34.144662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ba3e0e4-be05-4317-85a4-4767e44875ea tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1327 microversion: 2.1 time: 0.513211 Aug 29 05:19:34.145750 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2764/5544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:33 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1327 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:34.390653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:34.391161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:34.399405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:34.405050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:34.406692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:34.407683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:34.413071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:34.414973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:34.446895 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] HTTP exception thrown: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Request method failure captured: Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 HTTP/1.1 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEmfsS_sPNgL4dC_VoSatyJN5SFMDp4PzY8V5auQDwX6xit3qadtZhmeBEdwjHAvGhQ_hRa-o28pCSBeoNKcop80cKdzb7qrkhf-ORyiT0zn_FymdVjjfzpw0Nzivv3kDH2818L7EbkIR9BeJ8b4FhctqXQzOijO7pVmt7nWXGXh0wU Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f948ec6a5b043ed8ea6bac997a4c2c4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e283b8db0cfc47acac0ca482a69005d6 Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '904b4106-5845-40b8-8f26-7eacf31b54b8'} Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:19:34.451027 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Returning 404 to user: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:19:34.454675 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3955840c-0c42-469e-9d41-a57a573a4174 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 404 len: 111 microversion: 2.20 time: 0.066841 Aug 29 05:19:34.456160 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2781/5545] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 29 05:19:34 2022] DELETE /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:19:34.463354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:34.464414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] [instance: 904b4106-5845-40b8-8f26-7eacf31b54b8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:34.478807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:34.480685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:34.481232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:34.486270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:34.486859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:34.487396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:34.527618 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] HTTP exception thrown: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Request method failure captured: Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 HTTP/1.1 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEmfsS_sPNgL4dC_VoSatyJN5SFMDp4PzY8V5auQDwX6xit3qadtZhmeBEdwjHAvGhQ_hRa-o28pCSBeoNKcop80cKdzb7qrkhf-ORyiT0zn_FymdVjjfzpw0Nzivv3kDH2818L7EbkIR9BeJ8b4FhctqXQzOijO7pVmt7nWXGXh0wU Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f948ec6a5b043ed8ea6bac997a4c2c4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f948ec6a5b043ed8ea6bac997a4c2c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 7f948ec6a5b043ed8ea6bac997a4c2c4 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1327926677 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e283b8db0cfc47acac0ca482a69005d6 Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1327926677-project Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '904b4106-5845-40b8-8f26-7eacf31b54b8'} Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.533358 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:34.538245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.538245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:34.538245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:34.538245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:34.538245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:19:34.538245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:19:34.538245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. Aug 29 05:19:34.538245 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:19:34.539130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] Returning 404 to user: Instance 904b4106-5845-40b8-8f26-7eacf31b54b8 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:19:34.540848 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7248620-a551-4e76-9b68-8c303ed5abd1 tempest-AttachVolumeShelveTestJSON-1327926677 tempest-AttachVolumeShelveTestJSON-1327926677-project] 10.222.0.20 "GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8" status: 404 len: 111 microversion: 2.20 time: 0.081127 Aug 29 05:19:34.542039 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2765/5546] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 29 05:19:34 2022] GET /compute/v2.1/servers/904b4106-5845-40b8-8f26-7eacf31b54b8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:19:35.168011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:35.169576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:35.179973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:35.182041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:35.185819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:35.186871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:35.187555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:35.189224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:35.856074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:35.870805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f188d103-8b88-4bf1-afb1-6a46861143e3 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1527 microversion: 2.1 time: 0.707972 Aug 29 05:19:35.871808 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2782/5547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:35 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1527 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:35.894602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:35.895928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:35.906482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:35.908727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:35.911402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:35.912609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:35.913232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:35.914717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:36.171759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:36.182707 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b0c9dea5-5813-4e8f-a84d-f2528117ae86 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1527 microversion: 2.1 time: 0.292079 Aug 29 05:19:36.183304 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2766/5548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:35 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1527 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:36.559026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:36.562102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:36.583811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:36.589997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:36.590560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:36.591335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:36.591802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:36.599424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:36.625124 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] HTTP exception thrown: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Request method failure captured: Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 HTTP/1.1 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDExQZ7TwYaTbcoK5lkG6Knl30X23CVTxZN6ZUc0CvSyDXpuexEbJ1pXlyraKWOpVUt-yhi69KzBs8U6-QQ0LYCP9euocZwmndsdO9z8esjFsjV1hh6-k7bWy131lYr7iXAQm1n9CnN-aWYNF3p1CMXp0gzWVQFNZf0L-Qi44nt4R1-0 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0f1d941041c543e88f7d9b691927df75 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-923322428 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f1d941041c543e88f7d9b691927df75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f1d941041c543e88f7d9b691927df75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f1d941041c543e88f7d9b691927df75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f1d941041c543e88f7d9b691927df75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-923322428 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0f1d941041c543e88f7d9b691927df75 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-923322428 Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestMultiTenantJSON-923322428-project Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b0ef9aa0fce54d9f8e11d026545a851b Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-923322428-project Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '1872c62a-6023-450e-9010-c9584ad99b57'} Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:19:36.626666 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:36.631055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Returning 404 to user: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:19:36.631889 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4fc2645d-aa34-4c91-9371-67915fc03e15 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 404 len: 111 microversion: 2.1 time: 0.430822 Aug 29 05:19:36.639472 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2783/5549] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:19:36 2022] DELETE /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 111 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:19:36.645041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:36.645906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:36.657668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:36.658450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:36.659088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:36.661910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:36.662668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:36.664819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:37.804268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:37.815711 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a562f38d-0072-4f1c-9170-a236bc311128 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1527 microversion: 2.1 time: 1.176260 Aug 29 05:19:37.829458 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2767/5550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:36 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1527 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:37.843055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Action: 'update', calling method: >, body: {"server": {"name": "1872c62a-6023-450e-9010-c9584ad99b57_new"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:37.847388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:37.858247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:37.859590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:37.861402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:37.862442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:37.863288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:37.864064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:37.921864 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] HTTP exception thrown: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Request method failure captured: Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: request: PUT /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 HTTP/1.1 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 64 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDExQZ7TwYaTbcoK5lkG6Knl30X23CVTxZN6ZUc0CvSyDXpuexEbJ1pXlyraKWOpVUt-yhi69KzBs8U6-QQ0LYCP9euocZwmndsdO9z8esjFsjV1hh6-k7bWy131lYr7iXAQm1n9CnN-aWYNF3p1CMXp0gzWVQFNZf0L-Qi44nt4R1-0 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0f1d941041c543e88f7d9b691927df75 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-923322428 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f1d941041c543e88f7d9b691927df75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f1d941041c543e88f7d9b691927df75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f1d941041c543e88f7d9b691927df75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f1d941041c543e88f7d9b691927df75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-923322428 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0f1d941041c543e88f7d9b691927df75 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-923322428 Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestMultiTenantJSON-923322428-project Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b0ef9aa0fce54d9f8e11d026545a851b Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-923322428-project Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: {"server": {"name": "1872c62a-6023-450e-9010-c9584ad99b57_new"}} Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '1872c62a-6023-450e-9010-c9584ad99b57', 'body': {'server': {'name': '1872c62a-6023-450e-9010-c9584ad99b57_new'}}} Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:19:37.926616 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:37.930544 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:37.934940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] Returning 404 to user: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:19:37.937701 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4331c64b-a37e-4bb0-8455-f9177962d046 tempest-ServersNegativeTestMultiTenantJSON-923322428 tempest-ServersNegativeTestMultiTenantJSON-923322428-project] 10.222.0.20 "PUT /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 404 len: 111 microversion: 2.1 time: 0.100208 Aug 29 05:19:37.941915 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2784/5551] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:19:37 2022] PUT /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:19:37.951183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:37.951689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:37.973882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:37.976754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:37.978828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:37.982259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:37.983192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:37.983643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:38.034586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:19:38.324103 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6632745-9b07-43c7-9928-beef07b69e92 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 204 len: 0 microversion: 2.1 time: 0.376614 Aug 29 05:19:38.324880 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2768/5552] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:19:37 2022] DELETE /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:19:38.334528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:38.343946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:38.365474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:38.367810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:38.369102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:38.370790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:38.375445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:38.378254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:39.506135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:39.517702 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-752b584d-9b49-4a01-bbc0-5762304d6904 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1533 microversion: 2.1 time: 1.188267 Aug 29 05:19:39.530983 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2785/5553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:38 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1533 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:19:40.548460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:40.549694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:40.562868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:40.573983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:40.582143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:40.585098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:40.585743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:40.586937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:41.168940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:41.168940 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4cb1ade7-1731-4951-8786-63b7df577292 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1533 microversion: 2.1 time: 0.616832 Aug 29 05:19:41.168940 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2769/5554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:40 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1533 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:41.624868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-86e8e022-8cbc-4aac-be2f-73331455aafe req-4711c551-9f99-49b1-b656-5753e54ffca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1872c62a-6023-450e-9010-c9584ad99b57", "name": "network-vif-deleted", "tag": "8468164e-fc46-4981-8a4c-de4946761b6f"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:41.659543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-86e8e022-8cbc-4aac-be2f-73331455aafe req-4711c551-9f99-49b1-b656-5753e54ffca8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:41.663416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-86e8e022-8cbc-4aac-be2f-73331455aafe req-4711c551-9f99-49b1-b656-5753e54ffca8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:41.666237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-86e8e022-8cbc-4aac-be2f-73331455aafe req-4711c551-9f99-49b1-b656-5753e54ffca8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:41.711118 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-86e8e022-8cbc-4aac-be2f-73331455aafe req-4711c551-9f99-49b1-b656-5753e54ffca8 service nova] Creating event network-vif-deleted:8468164e-fc46-4981-8a4c-de4946761b6f for instance 1872c62a-6023-450e-9010-c9584ad99b57 on n-h1-854119-9 Aug 29 05:19:41.724847 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-86e8e022-8cbc-4aac-be2f-73331455aafe req-4711c551-9f99-49b1-b656-5753e54ffca8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099924 Aug 29 05:19:41.727123 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2786/5555] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:19:42.177153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:42.178764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:42.192397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:42.193103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:42.201160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:42.201937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:42.202410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:42.204154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:42.214686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:42.249073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:42.249930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:42.250706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:42.251409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lazy-loading 'fault' on Instance uuid 1872c62a-6023-450e-9010-c9584ad99b57 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:19:42.317860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24186bb745b41f886ed4abbedc99613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea88c9cd35e455db75074430ed2b2b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:42.339622 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-26c7682d-c400-4970-96f8-14db6e05f439 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 200 len: 1317 microversion: 2.1 time: 0.166317 Aug 29 05:19:42.353191 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2770/5556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:42 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:43.368468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:43.369337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] [instance: 1872c62a-6023-450e-9010-c9584ad99b57] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:43.380610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:43.385368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:43.386074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:43.386809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:43.387335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:43.389073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:43.421186 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] HTTP exception thrown: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Request method failure captured: Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 HTTP/1.1 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDExForOmvfRrGGJn2qOvy-snB26n3gKcSBcuN5b4RN9WTmIAYLmFxXrRRSU8qZFUIYrj2UibczWtlgyRGTymYyPhuy_lACFb5Qx2ThZ31qP5KKpogezjOmtnvFEoSSHgOLqfXixi8B0Jd476Rt5KE2ohZrGpCKcHsYBdkYVfmHFHmo0 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 7ea88c9cd35e455db75074430ed2b2b8 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1887035298 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ea88c9cd35e455db75074430ed2b2b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ea88c9cd35e455db75074430ed2b2b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ea88c9cd35e455db75074430ed2b2b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ea88c9cd35e455db75074430ed2b2b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1887035298 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 7ea88c9cd35e455db75074430ed2b2b8 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1887035298 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1887035298-project Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: d24186bb745b41f886ed4abbedc99613 Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1887035298-project Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '1872c62a-6023-450e-9010-c9584ad99b57'} Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:43.427238 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:43.431188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:19:43.431188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:43.431188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:19:43.431188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:19:43.431188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:19:43.431188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:19:43.431188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:19:43.431188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. Aug 29 05:19:43.431188 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:19:43.433425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] Returning 404 to user: Instance 1872c62a-6023-450e-9010-c9584ad99b57 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:19:43.434421 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aeb2a9b0-a4d8-48c0-9b41-ba1302e44e22 tempest-ServersNegativeTestMultiTenantJSON-1887035298 tempest-ServersNegativeTestMultiTenantJSON-1887035298-project] 10.222.0.20 "GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57" status: 404 len: 111 microversion: 2.1 time: 0.071788 Aug 29 05:19:43.440377 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2787/5557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:43 2022] GET /compute/v2.1/servers/1872c62a-6023-450e-9010-c9584ad99b57 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:19:54.839141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:54.839547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:55.387100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-037de9d9-fcad-4a39-8df2-528d8a6ac9df tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:55.388111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-037de9d9-fcad-4a39-8df2-528d8a6ac9df tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:55.399360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-037de9d9-fcad-4a39-8df2-528d8a6ac9df tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:55.403973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-037de9d9-fcad-4a39-8df2-528d8a6ac9df tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:55.404758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-037de9d9-fcad-4a39-8df2-528d8a6ac9df tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:55.405979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-037de9d9-fcad-4a39-8df2-528d8a6ac9df tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:55.406758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-037de9d9-fcad-4a39-8df2-528d8a6ac9df tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:55.407504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-037de9d9-fcad-4a39-8df2-528d8a6ac9df tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:55.955930 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-037de9d9-fcad-4a39-8df2-528d8a6ac9df tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1834 microversion: 2.1 time: 1.131436 Aug 29 05:19:55.957769 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2771/5558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:54 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1834 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:55.978543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:55.979515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:55.986581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=27 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:55.987255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=34 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:19:55.988753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:55.989513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:55.989718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:55.990734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:55.991202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:55.991629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:57.094043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69d2aa4a-6914-4f89-9fb0-3c04694a978f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Action: 'create', calling method: .version_select at 0x7f1ab848b9d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1175177225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnmECJ7RWIB/hINdjhLecNKCLLV6ReJDZLGGQDEKslDD8g4OLU4i/ql7eifICaiBSu8/ZAb03Av8o8SAzoCDMM0PufzDCnYAkWG0YBPnPtXqErGubN5RPesPbUHb8LVyw=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:57.099184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:57.107674 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a4a295f5-5422-43d6-a179-b108297bf959 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1683 microversion: 2.1 time: 1.133569 Aug 29 05:19:57.108323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2788/5559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:55 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1683 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:57.172670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-69d2aa4a-6914-4f89-9fb0-3c04694a978f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for project 8538671f353b4984b7b18ee629e43b3d. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:19:57.187259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-69d2aa4a-6914-4f89-9fb0-3c04694a978f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for user b5b779089f7f42399c57a9771787f911 and project 8538671f353b4984b7b18ee629e43b3d. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:19:57.245296 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69d2aa4a-6914-4f89-9fb0-3c04694a978f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.156348 Aug 29 05:19:57.246254 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2772/5560] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:19:57 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:19:57.369499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d04b8c87-6abd-45b8-9913-8e23f4b0c0b8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:57.372800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d04b8c87-6abd-45b8-9913-8e23f4b0c0b8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:57.384357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d04b8c87-6abd-45b8-9913-8e23f4b0c0b8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:57.387058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d04b8c87-6abd-45b8-9913-8e23f4b0c0b8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:57.387877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d04b8c87-6abd-45b8-9913-8e23f4b0c0b8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:57.390703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d04b8c87-6abd-45b8-9913-8e23f4b0c0b8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:57.391360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d04b8c87-6abd-45b8-9913-8e23f4b0c0b8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:57.393067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d04b8c87-6abd-45b8-9913-8e23f4b0c0b8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:57.485550 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d04b8c87-6abd-45b8-9913-8e23f4b0c0b8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action" status: 200 len: 32639 microversion: 2.1 time: 0.121260 Aug 29 05:19:57.486491 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2789/5561] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:19:57 2022] POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action => generated 32639 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:19:57.663415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:57.663962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:57.671785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:57.673919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:57.673919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:57.673919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:57.674529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:57.675107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:57.715957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd83c40a4034e4c92bc6d742ecd92655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75007ee24def48e9af3dea0b3f72de2d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:57.717264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] flavor_id is None. Assuming migration. {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 05:19:57.724659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:19:57.893539 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fd4a08b4-03ce-4878-90e8-f03b567eb06b tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action" status: 202 len: 0 microversion: 2.1 time: 0.235637 Aug 29 05:19:57.897271 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2773/5562] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:19:57 2022] POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:19:57.903783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:57.904624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:57.916564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:57.917055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:57.936940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:57.938020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:57.938890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:57.940016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:58.369668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:19:58.382682 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af0f9951-7742-4dcf-b390-dbcb58a2d4c8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1692 microversion: 2.1 time: 0.483355 Aug 29 05:19:58.384029 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2790/5563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:57 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1692 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:19:59.406049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:19:59.407293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:19:59.421615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:59.425380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:59.426038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:59.428994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:19:59.433286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:19:59.434023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:19:59.688466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-31b035bb-a98f-4149-8a78-e2920fadfd3b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: .version_select at 0x7f1ab825c9d0>, body: {"keypair": {"name": "tempest-keypair-2111967681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV12IS97YwkT3ZIVd0J5CHhUZPsyjXSRQW+UkMx9a0mwRAnfM4rq3cocHgF+x+l8kpBKhHu4M5dBbqNRpkF4/B+xSfvmFYc9o/bUe3PhNkZMOp2fwdzJiDefynayiwFxg=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:19:59.713103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-31b035bb-a98f-4149-8a78-e2920fadfd3b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:19:59.740717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-31b035bb-a98f-4149-8a78-e2920fadfd3b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for user ca6430b480c54898b9ed01529f25049a and project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:19:59.759304 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [None req-31b035bb-a98f-4149-8a78-e2920fadfd3b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [5031f6d2-4dcc-4650-bfc1-4a4277592adf] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 05:20:00.137560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:00.157429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d56b2576-b03d-4b93-8131-267535ab7e22 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1692 microversion: 2.1 time: 0.753754 Aug 29 05:20:00.159627 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2774/5564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:19:59 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1692 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:00.767933 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [None req-31b035bb-a98f-4149-8a78-e2920fadfd3b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [5031f6d2-4dcc-4650-bfc1-4a4277592adf] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50646. Aug 29 05:20:00.795621 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-31b035bb-a98f-4149-8a78-e2920fadfd3b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.267624 Aug 29 05:20:00.796590 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2791/5565] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:19:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:01.181816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:01.182696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:01.195476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:01.196002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:01.199300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:01.202518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:01.203336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:01.203775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:01.701030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:01.713473 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be74cfa9-bf8b-40d3-94e0-fd4e6648834b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1692 microversion: 2.1 time: 0.536606 Aug 29 05:20:01.718888 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2775/5566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:01 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1692 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:01.912104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1929474382", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "7ec85b11-43e5-43de-8f08-a457f4ed01e7"}], "key_name": "tempest-TestNetworkBasicOps-1175177225", "security_groups": [{"name": "tempest-secgroup-smoke-1152178807"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:02.738490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:02.740178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:02.759235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:02.760464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:02.762050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:02.767296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] validate_networks() for [('7ec85b11-43e5-43de-8f08-a457f4ed01e7', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:20:02.769058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:02.769733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:02.770430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:03.933401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:03.959702 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-844223ea-ac0a-4361-ab93-0bd838a21662 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1692 microversion: 2.1 time: 1.226076 Aug 29 05:20:03.979699 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2776/5567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:02 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1692 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:04.691848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:20:04.692392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:20:04.693492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:20:04.693911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:20:04.695448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:20:04.733812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:04.734304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:04.734743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:04.735485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:04.735932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:04.749156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:04.794843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for project 8538671f353b4984b7b18ee629e43b3d. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:20:04.806317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for user b5b779089f7f42399c57a9771787f911 and project 8538671f353b4984b7b18ee629e43b3d. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:20:04.839015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:20:04.848901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:20:04.926984 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0767b6a6-5bb0-41ec-8729-81aede78148c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.018882 Aug 29 05:20:04.933785 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2792/5568] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:20:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 3021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:20:04.939275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e385fbe-3a7f-4a3b-af22-fbe15ca5de7a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:04.939887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e385fbe-3a7f-4a3b-af22-fbe15ca5de7a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:04.988549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:04.989229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:05.005533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:05.006031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:05.006468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:05.007173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:05.007621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:05.008045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:05.174959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e385fbe-3a7f-4a3b-af22-fbe15ca5de7a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:05.188771 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e385fbe-3a7f-4a3b-af22-fbe15ca5de7a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1249 microversion: 2.1 time: 0.251732 Aug 29 05:20:05.189381 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2777/5569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:04 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1249 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:05.216354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1644323850", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03e6ddac-5990-46d1-82b5-fc12cac2bd56"}], "security_groups": [{"name": "tempest-securitygroup--139225120"}], "key_name": "tempest-keypair-2111967681", "user_data": "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:05.628625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] validate_networks() for [('03e6ddac-5990-46d1-82b5-fc12cac2bd56', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:20:05.984676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:05.996190 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cbbf016d-5169-4e8b-8376-c4eb834e9227 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1697 microversion: 2.1 time: 1.012900 Aug 29 05:20:05.996785 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2793/5570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:04 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1697 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:06.220827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:06.227994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:06.248564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:06.249080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:06.249519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:06.250234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:06.250681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:06.251096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:06.595856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:06.615852 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d43934e1-8317-4b60-95e4-0eb8650b8e66 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1245 microversion: 2.1 time: 0.408701 Aug 29 05:20:06.617357 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2794/5571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:06 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1245 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:06.723380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:06.724009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:06.735923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:06.736956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:06.737588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:06.738722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:06.739362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:06.739972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:06.808991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:20:06.809980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:20:06.810670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:20:06.811266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:20:06.811957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:20:06.834288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:06.835217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:06.835895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:06.836980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:06.839525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:06.840513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:06.868106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:20:06.874134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for user ca6430b480c54898b9ed01529f25049a and project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:20:06.917420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:20:06.925586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:20:07.052294 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b5b1731c-23a9-47a9-b3d2-8a15ee87f780 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.842892 Aug 29 05:20:07.076747 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2778/5572] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:20:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:20:07.082095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:07.090823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:07.401197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:07.417518 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bcf3229f-4ac6-418d-89a7-c4ca45d5d0dd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.698572 Aug 29 05:20:07.418903 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2795/5573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:06 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:07.423954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7679833a-28a0-4311-ad4c-4c89356241f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:07.428351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7679833a-28a0-4311-ad4c-4c89356241f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:07.594151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:07.595030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:07.595714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:07.596975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:07.597707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:07.598259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:07.673080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7679833a-28a0-4311-ad4c-4c89356241f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:07.686658 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7679833a-28a0-4311-ad4c-4c89356241f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1242 microversion: 2.1 time: 0.266287 Aug 29 05:20:07.687900 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2796/5574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:07 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1242 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:07.694621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:07.696699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:07.704381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:07.705089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:07.706204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:07.707176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:07.707728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:07.708379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:08.039864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:08.052504 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15cbfbbe-f533-425e-9cad-ff10acc3455f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1697 microversion: 2.1 time: 0.974230 Aug 29 05:20:08.055147 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2779/5575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:07 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1697 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:08.061290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:08.062535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:08.089157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:08.090762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:08.091685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:08.095166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:08.097003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:08.098240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:08.126595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:08.148098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1bb4a386-fa8e-46fc-804f-99ae6b978db8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.458745 Aug 29 05:20:08.148732 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2797/5576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:07 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:08.168138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:08.168749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:08.186591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:08.187104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:08.188038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:08.188851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:08.189312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:08.189736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:08.381584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:08.397459 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-852dc410-cf87-45cd-abe1-e3702b53e492 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1307 microversion: 2.1 time: 0.338773 Aug 29 05:20:08.400269 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2780/5577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:08 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:08.645112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:08.655502 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-35c06b78-6f4e-429c-8c81-609f82eaddf7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.491210 Aug 29 05:20:08.669295 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2798/5578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:08 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:08.690665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:08.692720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:08.704955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:08.705515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:08.706339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:08.707234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:08.708366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:08.708958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:08.712944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:08.714510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:08.723034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:08.723845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:08.724568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:08.725614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:08.726322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:08.726950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:08.894529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:08.909209 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b4e9b76-0cb3-43b6-8150-3324cb7b434c tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1294 microversion: 2.1 time: 0.201101 Aug 29 05:20:08.927119 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2799/5579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:08 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1294 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:09.081544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:09.082332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:09.093567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:09.098937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:09.099699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:09.100643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:09.101348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:09.101988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:09.439536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:09.452514 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d9801d37-bb42-4582-acd2-9d837363ec8e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.765664 Aug 29 05:20:09.475444 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2781/5580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:08 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:09.509395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:09.510451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:09.528698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:09.529590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:09.530727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:09.533895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:09.534612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:09.537254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:09.784473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:09.800171 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-828f49d0-172d-4998-b682-6799bf4b8ec2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1697 microversion: 2.1 time: 0.722005 Aug 29 05:20:09.803355 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2800/5581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:09 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1697 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:09.817859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1892824651", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:09.821604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:09.843724 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2d311a32-99f1-41c4-b0c6-4cc6c16c777c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1307 microversion: 2.1 time: 0.352902 Aug 29 05:20:09.845137 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2782/5582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:09 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1307 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:09.927702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] validate_networks() for [('538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:20:09.931220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:09.931835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:09.940181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:09.944068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:09.944709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:09.953152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:09.953152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:09.953152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:10.202870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:10.220455 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-505aa29c-0420-4646-870f-3ac1a34b9614 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1300 microversion: 2.1 time: 0.293022 Aug 29 05:20:10.221348 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2783/5583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:09 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:10.824433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:10.825114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:10.857628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:10.858131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:10.858568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:10.859285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:10.860065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:10.860689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:11.467189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:11.477561 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-287b726c-0ced-4ea0-8777-a3dd50f6598d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1697 microversion: 2.1 time: 0.657388 Aug 29 05:20:11.481786 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2784/5584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:10 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1697 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:11.488408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:20:11.488943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:20:11.489291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:20:11.489748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:20:11.490103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:20:11.494781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:11.497328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:11.504898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:11.505387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:11.505817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:11.506539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:11.507230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:11.507656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:11.516713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:11.519448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:11.520192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:11.523122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:11.527237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:11.529981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:11.569531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:20:11.584530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for user 6fb88aef408746868abb4053768c18c4 and project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:20:11.607935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:20:11.616743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:20:11.680255 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-01dc180d-83ec-4c25-9ef8-8a10cb5dfb62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.874979 Aug 29 05:20:11.687731 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2801/5585] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:20:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:20:11.704538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:11.706151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:11.724765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:11.726121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:11.728033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:11.755461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:11.760690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:11.761290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:12.139807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:12.153616 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd1ba4bd-d80e-4a78-a71e-7bb88d865e06 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1300 microversion: 2.1 time: 0.456480 Aug 29 05:20:12.155310 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2802/5586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:11 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1300 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:12.161155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f09ebbc-5306-4474-963a-61b7be5fe261 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:12.162057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1f09ebbc-5306-4474-963a-61b7be5fe261 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:12.258274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:12.271615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-819b617d-8cfc-456b-a495-d818dce4edcf tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1375 microversion: 2.1 time: 0.784688 Aug 29 05:20:12.276654 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2785/5587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:11 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1375 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:12.319641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1f09ebbc-5306-4474-963a-61b7be5fe261 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:12.340155 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1f09ebbc-5306-4474-963a-61b7be5fe261 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1215 microversion: 2.1 time: 0.183310 Aug 29 05:20:12.357911 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2803/5588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:12 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:12.499343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:12.500164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:12.510874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:12.512957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:12.515341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:12.516339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:12.517161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:12.517756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:12.759055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:12.777926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7fae0942-e782-42b5-ab73-0ec6cf3d664e req-37817d44-3e49-459b-91ac-721ed9452716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6033bce-fbdd-4c3e-bb86-e964a7160e5a", "tag": "a0c578a4-6429-4ede-9c74-08a8970b8e2d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:12.792849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7fae0942-e782-42b5-ab73-0ec6cf3d664e req-37817d44-3e49-459b-91ac-721ed9452716 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:12.793666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7fae0942-e782-42b5-ab73-0ec6cf3d664e req-37817d44-3e49-459b-91ac-721ed9452716 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:12.794267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7fae0942-e782-42b5-ab73-0ec6cf3d664e req-37817d44-3e49-459b-91ac-721ed9452716 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:12.807952 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c463b77c-e752-456a-8092-c5a0e1f58b08 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1697 microversion: 2.1 time: 0.298734 Aug 29 05:20:12.810146 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2786/5589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:12 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1697 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:12.827723 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7fae0942-e782-42b5-ab73-0ec6cf3d664e req-37817d44-3e49-459b-91ac-721ed9452716 service nova] Creating event network-changed:a0c578a4-6429-4ede-9c74-08a8970b8e2d for instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a on n-h1-854119-9 Aug 29 05:20:12.833717 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7fae0942-e782-42b5-ab73-0ec6cf3d664e req-37817d44-3e49-459b-91ac-721ed9452716 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059571 Aug 29 05:20:12.834917 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2804/5590] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:13.174973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:13.178679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:13.197734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:13.200641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:13.201632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:13.204851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:13.208381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:13.209732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:13.293329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:13.294040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:13.307501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:13.307968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:13.308638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:13.309318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:13.309934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:13.310401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:13.569779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:13.580250 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b5c03ff-3cfd-4fa5-b425-716521cac1ce tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.409018 Aug 29 05:20:13.598452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:13.603054 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2787/5591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:13 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:13.611711 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37ce142e-6900-43c7-9003-8600dda2f49a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1375 microversion: 2.1 time: 0.319456 Aug 29 05:20:13.612657 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2805/5592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:13 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1375 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:13.614350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:13.615036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:13.621785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:13.622574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:13.623231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:13.624159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:13.624804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:13.625435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:13.645000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:13.730716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:13.739492 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-32f1e816-988d-4d42-92c9-6f7f30d60f2c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1267 microversion: 2.1 time: 0.132692 Aug 29 05:20:13.741755 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2788/5593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:13 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:13.831687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:13.832337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:13.856443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:13.857202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:13.857812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:13.859011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:13.859628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:13.860481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:14.036848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:14.051487 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb596d37-bfe6-4147-805b-50030e49e6ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1697 microversion: 2.1 time: 0.222941 Aug 29 05:20:14.063012 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2806/5594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:13 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1697 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:14.601811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:14.602629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:14.613194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:14.617538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:14.618355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:14.630330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:14.630998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:14.632806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:14.635354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:14.636307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:14.647395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:14.651413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:14.652107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:14.653081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:14.661827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:14.662610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:15.275059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:15.282987 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ce8feaef-25e2-4be0-89fb-2d2a2c52beb8 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1375 microversion: 2.1 time: 0.652256 Aug 29 05:20:15.283581 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2807/5595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:14 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1375 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:15.291852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:15.296967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:15.307778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:15.316105 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-176656df-883c-427c-b79c-dbe5dea6534a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.718195 Aug 29 05:20:15.316721 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2789/5596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:14 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:15.324820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0fa065b0-ea7e-4d96-bee6-4c3143513553 req-04050fbe-b847-46de-8b51-98dd15db17a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c32e9f9-9b4d-4503-9659-ca08f6ce7328", "tag": "f26698e6-bda4-45c5-8fe9-3eee7738792d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:15.331534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:15.332034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:15.332500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:15.333207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:15.333655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:15.334074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:15.355645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0fa065b0-ea7e-4d96-bee6-4c3143513553 req-04050fbe-b847-46de-8b51-98dd15db17a7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:15.358713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0fa065b0-ea7e-4d96-bee6-4c3143513553 req-04050fbe-b847-46de-8b51-98dd15db17a7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:15.359151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0fa065b0-ea7e-4d96-bee6-4c3143513553 req-04050fbe-b847-46de-8b51-98dd15db17a7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:15.379734 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0fa065b0-ea7e-4d96-bee6-4c3143513553 req-04050fbe-b847-46de-8b51-98dd15db17a7 service nova] Creating event network-changed:f26698e6-bda4-45c5-8fe9-3eee7738792d for instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 on n-h1-854119-9 Aug 29 05:20:15.391390 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0fa065b0-ea7e-4d96-bee6-4c3143513553 req-04050fbe-b847-46de-8b51-98dd15db17a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070293 Aug 29 05:20:15.399427 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2790/5597] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:15.415272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:15.416009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:15.424558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:15.425056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:15.427772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:15.429007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:15.440958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:15.441611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:15.535870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:15.563591 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-185e5e8d-ddd2-448f-a279-26ef524f5dda tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1267 microversion: 2.1 time: 0.278940 Aug 29 05:20:15.571865 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2808/5598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:15 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:15.838200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:15.849181 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30853255-4d42-4e91-bf44-4685f3687d48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1697 microversion: 2.1 time: 0.447780 Aug 29 05:20:15.850623 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2791/5599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:15 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1697 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:16.308872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:16.309655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:16.328250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:16.328750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:16.329184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:16.329892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:16.330334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:16.330752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:16.337302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:16.337919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:16.350140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:16.350633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:16.351070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:16.351775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:16.358493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:16.359227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:16.854696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:16.858432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:16.863746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:16.867075 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7572ba39-dc60-453d-a4b4-ed07f76bc985 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1375 microversion: 2.1 time: 0.563569 Aug 29 05:20:16.868948 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2809/5600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:16 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1375 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:16.875483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:16.876700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:16.886972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:16.887684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:16.888511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:16.890409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:16.903801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:16.904531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:16.905612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:16.975437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:16.986843 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-189d7c6a-d014-440f-8fd5-e7558d7217e6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.652942 Aug 29 05:20:16.988142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2792/5601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:16 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:16.994349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:16.995208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:17.004539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:17.005376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:17.006009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:17.007260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:17.008755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:17.010523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:17.076579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:17.085852 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-94cdb342-e179-4433-8a0c-42ff308c881e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1267 microversion: 2.1 time: 0.215658 Aug 29 05:20:17.097043 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2810/5602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:16 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:17.306320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:17.317791 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8970b4b3-de23-439b-9cd8-7db5a1fa6d73 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1697 microversion: 2.1 time: 0.327453 Aug 29 05:20:17.318537 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2793/5603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:16 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1697 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:17.890113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:17.891590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:17.899250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:17.900199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:17.904971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:17.905964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:17.906723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:17.907307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:18.010758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:18.011786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:18.029785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:18.030600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:18.031567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:18.032498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:18.033429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:18.034033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:18.302452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:18.319708 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-118c094a-af9d-456e-8929-49e8f4a9f08b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1375 microversion: 2.1 time: 0.434035 Aug 29 05:20:18.335362 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2811/5604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:17 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1375 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:18.340780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:18.346925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:18.359853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:18.360635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:18.365398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:18.366194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:18.366661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:18.367095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:18.548346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:18.556553 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-faf3ecc1-54a8-4ec1-8990-2caba4f919a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1273 microversion: 2.1 time: 0.219652 Aug 29 05:20:18.560010 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2812/5605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:18 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:18.570891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:18.573952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:18.591576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:18.593269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:18.593776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:18.598251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:18.600494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:18.601012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:18.899779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:18.910939 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e1471fe0-cd80-40d2-8db4-1518bfcb96dd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.904126 Aug 29 05:20:18.912507 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2794/5606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:18 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:19.154930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:19.164508 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6c574090-def8-44af-9f28-70708132c69b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1696 microversion: 2.1 time: 0.599670 Aug 29 05:20:19.165150 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2813/5607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:18 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1696 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:19.356866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:19.358587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:19.369617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:19.370470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:19.371117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:19.372056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:19.373343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:19.377865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:19.584034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:19.585083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:19.592464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:19.593175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:19.593833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:19.594746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:19.595418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:19.596408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:19.806249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:19.814619 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69c781dd-286d-4edd-9b81-494c23791399 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1273 microversion: 2.1 time: 0.234405 Aug 29 05:20:19.817556 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2814/5608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:19 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:19.842856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9c81c7cb-ea24-4a7f-82e3-9f43c0b546e5 req-03a6e090-65d5-4d01-85c8-233c1148241e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "name": "network-vif-unplugged", "status": "completed", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:19.864372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:19.866668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c81c7cb-ea24-4a7f-82e3-9f43c0b546e5 req-03a6e090-65d5-4d01-85c8-233c1148241e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:19.867191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c81c7cb-ea24-4a7f-82e3-9f43c0b546e5 req-03a6e090-65d5-4d01-85c8-233c1148241e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:19.868238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c81c7cb-ea24-4a7f-82e3-9f43c0b546e5 req-03a6e090-65d5-4d01-85c8-233c1148241e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:19.911752 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9c81c7cb-ea24-4a7f-82e3-9f43c0b546e5 req-03a6e090-65d5-4d01-85c8-233c1148241e service nova] Creating event network-vif-unplugged:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h2-854119-9 Aug 29 05:20:19.942651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-9c81c7cb-ea24-4a7f-82e3-9f43c0b546e5 req-03a6e090-65d5-4d01-85c8-233c1148241e service nova] Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:20:19.967452 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9c81c7cb-ea24-4a7f-82e3-9f43c0b546e5 req-03a6e090-65d5-4d01-85c8-233c1148241e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137392 Aug 29 05:20:19.968343 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2815/5609] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:19.975156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:19.976340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:19.987125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:19.988632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:19.993575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:19.994946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:19.995562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:19.996167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:20.440828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:20.450689 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-93805054-e3ab-48d7-816e-18bb01c46447 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.480928 Aug 29 05:20:20.451698 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2816/5610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:19 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:20.470767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:20.471641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:20.478296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:20.479010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:20.479626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:20.480653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:20.481273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:20.482035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:20.535441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:20.552893 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1375 microversion: 2.1 time: 1.208106 Aug 29 05:20:20.556892 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2795/5611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:19 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1375 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:20.558240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:20.561431 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03796f76-bc21-455f-8825-6ac64b25229d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003487 Aug 29 05:20:20.563883 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2796/5612] 10.222.0.20 () {56 vars in 886 bytes} [Mon Aug 29 05:20:20 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 05:20:20.582791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d32e3914-a91b-4bd6-b47a-00e49dcaf70a req-560e51fb-b841-4176-bf79-9b864f7519ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6033bce-fbdd-4c3e-bb86-e964a7160e5a", "name": "network-vif-plugged", "status": "completed", "tag": "a0c578a4-6429-4ede-9c74-08a8970b8e2d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:20.607290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d32e3914-a91b-4bd6-b47a-00e49dcaf70a req-560e51fb-b841-4176-bf79-9b864f7519ed service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:20.608341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d32e3914-a91b-4bd6-b47a-00e49dcaf70a req-560e51fb-b841-4176-bf79-9b864f7519ed service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:20.608980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d32e3914-a91b-4bd6-b47a-00e49dcaf70a req-560e51fb-b841-4176-bf79-9b864f7519ed service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:20.629863 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d32e3914-a91b-4bd6-b47a-00e49dcaf70a req-560e51fb-b841-4176-bf79-9b864f7519ed service nova] Creating event network-vif-plugged:a0c578a4-6429-4ede-9c74-08a8970b8e2d for instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a on n-h1-854119-9 Aug 29 05:20:20.635447 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d32e3914-a91b-4bd6-b47a-00e49dcaf70a req-560e51fb-b841-4176-bf79-9b864f7519ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070071 Aug 29 05:20:20.635969 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2797/5613] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:20.709080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:20.719516 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d7a01ed-5985-4e68-89a1-e8654602566a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1696 microversion: 2.1 time: 0.253194 Aug 29 05:20:20.721064 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2817/5614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:20 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1696 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:20.844225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:20.845036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:20.855924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:20.857962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:20.859897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:20.860892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:20.862871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:20.866362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:21.308608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:21.325044 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17c87dc7-3362-4b81-8b3e-f4bf8a34b329 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 0.485924 Aug 29 05:20:21.329240 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2798/5615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:20 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:21.482328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:21.488867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:21.507184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:21.509524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:21.510164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:21.513658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:21.514357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:21.514959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:21.553727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:21.589626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:21.592048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:21.612719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:21.613511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:21.614125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:21.623563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:21.624343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:21.624944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:21.841835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:21.854912 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-743d9bf0-091b-49ac-a934-72d4fa08b590 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.379054 Aug 29 05:20:21.871076 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2818/5616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:21 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:21.881436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:21.883904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:21.898708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:21.901374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:21.902037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:21.904598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:21.905816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:21.908610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:21.945678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:21.959154 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a782e67c-bc35-4772-9ed7-169a3d740e15 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1375 microversion: 2.1 time: 0.369980 Aug 29 05:20:21.960395 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2799/5617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:21 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1375 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:22.063849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-46b94a35-0af8-42a5-a810-7588cf3cd6a8 req-0103f607-f34a-43a0-bab6-b94894821809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:22.079999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-46b94a35-0af8-42a5-a810-7588cf3cd6a8 req-0103f607-f34a-43a0-bab6-b94894821809 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:22.082791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-46b94a35-0af8-42a5-a810-7588cf3cd6a8 req-0103f607-f34a-43a0-bab6-b94894821809 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:22.084489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-46b94a35-0af8-42a5-a810-7588cf3cd6a8 req-0103f607-f34a-43a0-bab6-b94894821809 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:22.115508 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-46b94a35-0af8-42a5-a810-7588cf3cd6a8 req-0103f607-f34a-43a0-bab6-b94894821809 service nova] Creating event network-changed:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h2-854119-9 Aug 29 05:20:22.127955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-46b94a35-0af8-42a5-a810-7588cf3cd6a8 req-0103f607-f34a-43a0-bab6-b94894821809 service nova] Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:20:22.136430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:22.146275 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-731f8fdd-4cac-4b57-bc88-411ff264bbb7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1696 microversion: 2.1 time: 0.273805 Aug 29 05:20:22.150812 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2819/5618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:21 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1696 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:22.172995 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-46b94a35-0af8-42a5-a810-7588cf3cd6a8 req-0103f607-f34a-43a0-bab6-b94894821809 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114431 Aug 29 05:20:22.173544 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2800/5619] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:20:22.348694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:22.349307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:22.381362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=20 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:22.390548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:22.391051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:22.391490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:22.392236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:22.392692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:22.393122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:22.882173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:22.883744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:22.902567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:22.905596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:22.908507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:22.910273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:22.912932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:22.915298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:23.380969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:23.393109 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-879f59af-a30a-4ee5-9db8-5174d8939dae tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 1.046271 Aug 29 05:20:23.394559 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2820/5620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:22 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:23.417894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:23.444927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:23.461680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:23.462554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:23.463150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:23.464593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:23.465250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:23.467801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:23.480896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:23.490902 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3d6c415e-0824-4cb0-8d7d-579f53a2f8fa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.618374 Aug 29 05:20:23.499506 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2801/5621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:22 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:23.504717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:23.507446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:23.530368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:23.531095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:23.531855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:23.533741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:23.534410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:23.535031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:23.845513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:23.885327 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-51ba0b49-feb1-47bf-85ab-7064bc8a7a21 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1696 microversion: 2.1 time: 0.375795 Aug 29 05:20:23.917715 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2802/5622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:23 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1696 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:24.253050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0ceccb56-5c13-4d6c-a434-1eead547504c req-84674c99-aabf-43ca-b6c6-6d92289238ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b98b6fc-b979-4a95-8377-554fcdf6b1da", "tag": "12895453-2c94-4205-99f1-fee1f19c2244"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:24.273615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:24.288951 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa5128a0-60d5-4fd1-b513-588b957d4991 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1375 microversion: 2.1 time: 0.890470 Aug 29 05:20:24.290961 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2821/5623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:23 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1375 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:24.293335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0ceccb56-5c13-4d6c-a434-1eead547504c req-84674c99-aabf-43ca-b6c6-6d92289238ff service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:24.297853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0ceccb56-5c13-4d6c-a434-1eead547504c req-84674c99-aabf-43ca-b6c6-6d92289238ff service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:24.300637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0ceccb56-5c13-4d6c-a434-1eead547504c req-84674c99-aabf-43ca-b6c6-6d92289238ff service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:24.345487 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0ceccb56-5c13-4d6c-a434-1eead547504c req-84674c99-aabf-43ca-b6c6-6d92289238ff service nova] Creating event network-changed:12895453-2c94-4205-99f1-fee1f19c2244 for instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da on n-h1-854119-9 Aug 29 05:20:24.371677 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0ceccb56-5c13-4d6c-a434-1eead547504c req-84674c99-aabf-43ca-b6c6-6d92289238ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119850 Aug 29 05:20:24.374541 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2803/5624] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:20:24.421818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:24.423083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:24.440723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:24.445332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:24.451117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:24.454979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:24.455478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:24.458441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:24.526432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:24.527143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:24.547729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:24.556899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:24.560872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:24.571158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:24.572666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:24.575065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:25.080812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:25.095956 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0801ec89-2641-4cda-9afa-72c09491c6f2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.574346 Aug 29 05:20:25.096818 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2804/5625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:24 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:25.101740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:25.110116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:25.119301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:25.124912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:25.125951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:25.126289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:25.127204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:25.132500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:25.133449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:25.223593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:25.235514 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1085cd04-169c-4de0-936c-6654b4588d35 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 0.820415 Aug 29 05:20:25.239176 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2822/5626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:24 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:25.319173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:25.320085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:25.334611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:25.335400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:25.336002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:25.338073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:25.339951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:25.340788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:26.166054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:26.174157 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6248a5c1-ea8b-45e0-9850-49f922b73ff6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1694 microversion: 2.1 time: 1.075991 Aug 29 05:20:26.174745 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2805/5627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:25 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1694 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:26.185354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:26.188908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:26.201983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:26.203944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:26.204628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:26.211786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:26.212664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:26.213415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:26.255370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:26.271412 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d5cbe983-0ed8-4e74-ad5c-d4282072f601 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1546 microversion: 2.1 time: 0.956722 Aug 29 05:20:26.272017 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2823/5628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:25 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1546 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:26.283338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:26.289799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:26.312156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:26.313309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:26.313812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:26.314838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:26.315444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:26.316027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:26.732275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:26.755396 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e31fa215-0577-42ed-a438-694260dc7600 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 0.482061 Aug 29 05:20:26.758549 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2824/5629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:26 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:26.771447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:26.772908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:26.797023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:26.797528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:26.797972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:26.798761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:26.799230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:26.799660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:26.824833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:26.837214 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-521c7393-3842-49cf-9c9e-fcadf07ef781 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.655527 Aug 29 05:20:26.839817 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2806/5630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:26 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:27.200157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:27.201698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:27.216062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:27.217016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:27.220807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:27.222154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:27.222998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:27.225962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:27.277003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:27.289749 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a82ef054-70ee-4154-b651-c94b856ddc2a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1546 microversion: 2.1 time: 0.528997 Aug 29 05:20:27.292089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2825/5631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:26 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1546 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:27.779043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:27.779967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:27.789849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:27.796998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:27.797709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:27.798610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:27.799249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:27.799839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:28.262390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:28.266081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:28.271129 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-41d6f45c-ec38-428a-bac1-824d69cf9ede tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 0.496133 Aug 29 05:20:28.276139 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2826/5632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:27 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:28.290006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:28.291432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:28.311916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:28.312700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:28.313316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:28.314203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:28.314809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:28.315386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:28.346827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:28.360905 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f3e134d9-626f-4961-9dd1-2ce5b3a0f187 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1691 microversion: 2.1 time: 1.168181 Aug 29 05:20:28.362663 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2807/5633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:27 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1691 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:28.373997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3ff3998a-7acc-42e7-855e-732583f5371f req-176918f4-ea14-486a-bf95-c248d6140f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c32e9f9-9b4d-4503-9659-ca08f6ce7328", "name": "network-vif-plugged", "status": "completed", "tag": "f26698e6-bda4-45c5-8fe9-3eee7738792d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:28.399999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ff3998a-7acc-42e7-855e-732583f5371f req-176918f4-ea14-486a-bf95-c248d6140f75 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:28.401267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ff3998a-7acc-42e7-855e-732583f5371f req-176918f4-ea14-486a-bf95-c248d6140f75 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:28.403326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ff3998a-7acc-42e7-855e-732583f5371f req-176918f4-ea14-486a-bf95-c248d6140f75 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:28.426935 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3ff3998a-7acc-42e7-855e-732583f5371f req-176918f4-ea14-486a-bf95-c248d6140f75 service nova] Creating event network-vif-plugged:f26698e6-bda4-45c5-8fe9-3eee7738792d for instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 on n-h1-854119-9 Aug 29 05:20:28.442095 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3ff3998a-7acc-42e7-855e-732583f5371f req-176918f4-ea14-486a-bf95-c248d6140f75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075283 Aug 29 05:20:28.442095 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2808/5634] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:28.463291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-85c3e9a5-d63c-4e65-9dd0-1bd165027b74 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:28.464152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-85c3e9a5-d63c-4e65-9dd0-1bd165027b74 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:28.507117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85c3e9a5-d63c-4e65-9dd0-1bd165027b74 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:28.507616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85c3e9a5-d63c-4e65-9dd0-1bd165027b74 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:28.508111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85c3e9a5-d63c-4e65-9dd0-1bd165027b74 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:28.508855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85c3e9a5-d63c-4e65-9dd0-1bd165027b74 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:28.509305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85c3e9a5-d63c-4e65-9dd0-1bd165027b74 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:28.522523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-85c3e9a5-d63c-4e65-9dd0-1bd165027b74 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:28.537922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:28.874183 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-85c3e9a5-d63c-4e65-9dd0-1bd165027b74 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action" status: 202 len: 0 microversion: 2.1 time: 0.430841 Aug 29 05:20:28.877556 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2809/5635] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:20:28 2022] POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:20:28.886801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:28.892190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:28.906211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:28.909467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:28.911257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:28.913405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:28.914343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:28.915307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:28.948691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:28.963820 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9740352-4200-468b-84d1-319ab4c1de89 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.684183 Aug 29 05:20:28.966366 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2827/5636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:28 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:29.301750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:29.303114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:29.311071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:29.311789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:29.312558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:29.315032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:29.315032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:29.316780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:29.492684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:29.501005 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-32d7756e-83f2-4ec8-bc2e-8350896b1851 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1690 microversion: 2.1 time: 0.621074 Aug 29 05:20:29.505859 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2810/5637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:28 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1690 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:29.987466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:29.988389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:29.995382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:29.996149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:29.996665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:29.997524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:29.998226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:29.999000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:30.033521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:30.059301 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9c13e5cf-1d36-4f8a-bceb-b0dae97dc228 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 0.760377 Aug 29 05:20:30.061304 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2828/5638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:29 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:30.292840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:30.302588 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-460ccb80-5b23-4ab9-b21f-619a756004b1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.319849 Aug 29 05:20:30.303383 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2811/5639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:29 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:30.531591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:30.532144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:30.545723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:30.546231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:30.546667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:30.547374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:30.547826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:30.548276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:31.083143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:31.083878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:31.097639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:31.100293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:31.101482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:31.103905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:31.104447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:31.104894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:31.449556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:31.475625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a231611e-39e5-40c5-97d5-c0a38df62357 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1690 microversion: 2.1 time: 0.945769 Aug 29 05:20:31.477422 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2829/5640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:30 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1690 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:31.500931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:31.502667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:31.516244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:31.517037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:31.517674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:31.519063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:31.519686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:31.520686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:31.788024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:31.797757 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a2823cbf-fea3-4340-8c72-f9e7beaac41e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 0.719958 Aug 29 05:20:31.798366 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2812/5641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:31 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:31.814276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-101069be-22ec-48b3-9874-2c3f791169b1 req-7fb33572-3c4d-4654-9710-69e512c0c6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "name": "network-vif-plugged", "status": "completed", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:31.833798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-101069be-22ec-48b3-9874-2c3f791169b1 req-7fb33572-3c4d-4654-9710-69e512c0c6a6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:31.834217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-101069be-22ec-48b3-9874-2c3f791169b1 req-7fb33572-3c4d-4654-9710-69e512c0c6a6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:31.837404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-101069be-22ec-48b3-9874-2c3f791169b1 req-7fb33572-3c4d-4654-9710-69e512c0c6a6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:31.866484 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-101069be-22ec-48b3-9874-2c3f791169b1 req-7fb33572-3c4d-4654-9710-69e512c0c6a6 service nova] Creating event network-vif-plugged:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h2-854119-9 Aug 29 05:20:31.875469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-101069be-22ec-48b3-9874-2c3f791169b1 req-7fb33572-3c4d-4654-9710-69e512c0c6a6 service nova] Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:20:31.906345 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-101069be-22ec-48b3-9874-2c3f791169b1 req-7fb33572-3c4d-4654-9710-69e512c0c6a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101060 Aug 29 05:20:31.908709 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2813/5642] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:32.222935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:32.234155 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ee314d3-0c3e-4f15-b05f-d010ca3e743f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1367 microversion: 2.1 time: 0.752816 Aug 29 05:20:32.238230 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2830/5643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:31 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1367 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:32.499498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:32.500405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:32.510597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:32.511581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:32.513844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:32.514541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:32.515014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:32.515430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:32.823286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:32.824417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:32.847711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:32.848257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:32.848704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:32.849435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:32.853170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:32.853661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:33.818597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:33.838075 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-76cf15ce-d41d-42ef-9a4f-eb9ad56fa931 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1690 microversion: 2.1 time: 1.340490 Aug 29 05:20:33.848946 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2814/5644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:32 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1690 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:33.858680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:33.859523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:33.866137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:33.867173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:33.867759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:33.868908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:33.869524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:33.870127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:34.245668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:34.254398 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 1.436060 Aug 29 05:20:34.254845 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2831/5645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:32 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:34.257121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:34.258029 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df9512a0-97c1-4c7a-bc4f-d0e3de773710 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002079 Aug 29 05:20:34.264966 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2832/5646] 10.222.0.20 () {56 vars in 886 bytes} [Mon Aug 29 05:20:34 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 05:20:34.867611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:34.870113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:34.896400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:34.896858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:34.898185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:34.901136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:34.903142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:34.904726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:35.007731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:35.020531 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-63d22a2c-0e83-4bf7-b4cb-54f63911130f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1557 microversion: 2.1 time: 1.170160 Aug 29 05:20:35.021637 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2815/5647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:33 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1557 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:35.042212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e25b8bb3-3a36-4f71-89f4-1d0d02431a30 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:35.042991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e25b8bb3-3a36-4f71-89f4-1d0d02431a30 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:35.052438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e25b8bb3-3a36-4f71-89f4-1d0d02431a30 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:35.056955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e25b8bb3-3a36-4f71-89f4-1d0d02431a30 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:35.058127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e25b8bb3-3a36-4f71-89f4-1d0d02431a30 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:35.060820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e25b8bb3-3a36-4f71-89f4-1d0d02431a30 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:35.063918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e25b8bb3-3a36-4f71-89f4-1d0d02431a30 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:35.064950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e25b8bb3-3a36-4f71-89f4-1d0d02431a30 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:35.382732 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e25b8bb3-3a36-4f71-89f4-1d0d02431a30 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.343608 Aug 29 05:20:35.386571 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2816/5648] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:20:35 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-interface => generated 285 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:20:35.397794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:35.398620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:35.407019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:35.407771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:35.408989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:35.411366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:35.412221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:35.412855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:36.644649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:36.654956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-20a08bcf-64b3-4506-99de-429ff5d0ea7d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1690 microversion: 2.1 time: 1.794341 Aug 29 05:20:36.655535 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2833/5649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:34 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1690 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:36.662563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-df09f5d4-33cd-4a0d-9c96-6a7971f57649 req-96dce102-55ad-442e-86a5-f2b50d880430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98b6fc-b979-4a95-8377-554fcdf6b1da", "name": "network-vif-plugged", "status": "completed", "tag": "12895453-2c94-4205-99f1-fee1f19c2244"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:36.676495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-df09f5d4-33cd-4a0d-9c96-6a7971f57649 req-96dce102-55ad-442e-86a5-f2b50d880430 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:36.677380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-df09f5d4-33cd-4a0d-9c96-6a7971f57649 req-96dce102-55ad-442e-86a5-f2b50d880430 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:36.677989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-df09f5d4-33cd-4a0d-9c96-6a7971f57649 req-96dce102-55ad-442e-86a5-f2b50d880430 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:36.694253 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-df09f5d4-33cd-4a0d-9c96-6a7971f57649 req-96dce102-55ad-442e-86a5-f2b50d880430 service nova] Creating event network-vif-plugged:12895453-2c94-4205-99f1-fee1f19c2244 for instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da on n-h1-854119-9 Aug 29 05:20:36.702645 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-df09f5d4-33cd-4a0d-9c96-6a7971f57649 req-96dce102-55ad-442e-86a5-f2b50d880430 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045406 Aug 29 05:20:36.703931 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2834/5650] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:36.710894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8db9a8ab-99e4-4fcb-9e03-771fc7c7f520 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "145ee3c8-db6c-48c1-a8dc-059410343ecc"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:36.715624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8db9a8ab-99e4-4fcb-9e03-771fc7c7f520 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:36.727451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db9a8ab-99e4-4fcb-9e03-771fc7c7f520 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:36.730332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db9a8ab-99e4-4fcb-9e03-771fc7c7f520 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:36.733045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db9a8ab-99e4-4fcb-9e03-771fc7c7f520 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:36.736076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db9a8ab-99e4-4fcb-9e03-771fc7c7f520 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:36.736963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db9a8ab-99e4-4fcb-9e03-771fc7c7f520 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:36.738569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8db9a8ab-99e4-4fcb-9e03-771fc7c7f520 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:36.852389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:36.870800 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-925a55d7-e5e5-4018-b557-37831cdcf705 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 1.480233 Aug 29 05:20:36.872832 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2817/5651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:35 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:37.117376 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8db9a8ab-99e4-4fcb-9e03-771fc7c7f520 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411480 Aug 29 05:20:37.118946 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2835/5652] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:20:36 2022] POST /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:37.517596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-93fbb1dc-0fc8-4282-9adc-f17bdeead0a1 req-6ee548c2-4148-48d8-96c2-c116e4ae36e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "name": "network-vif-unplugged", "status": "completed", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:37.586599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-93fbb1dc-0fc8-4282-9adc-f17bdeead0a1 req-6ee548c2-4148-48d8-96c2-c116e4ae36e9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:37.588734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-93fbb1dc-0fc8-4282-9adc-f17bdeead0a1 req-6ee548c2-4148-48d8-96c2-c116e4ae36e9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:37.589523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-93fbb1dc-0fc8-4282-9adc-f17bdeead0a1 req-6ee548c2-4148-48d8-96c2-c116e4ae36e9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:37.609571 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-93fbb1dc-0fc8-4282-9adc-f17bdeead0a1 req-6ee548c2-4148-48d8-96c2-c116e4ae36e9 service nova] Creating event network-vif-unplugged:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h1-854119-9 Aug 29 05:20:37.618090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-93fbb1dc-0fc8-4282-9adc-f17bdeead0a1 req-6ee548c2-4148-48d8-96c2-c116e4ae36e9 service nova] Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:20:37.641350 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-93fbb1dc-0fc8-4282-9adc-f17bdeead0a1 req-6ee548c2-4148-48d8-96c2-c116e4ae36e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144926 Aug 29 05:20:37.643338 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2818/5653] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:37.676709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:37.677986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:37.686128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:37.687012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:37.687616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:37.688537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:37.689137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:37.689731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:37.906539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:37.907306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:37.929167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:37.930021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:37.930621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:37.931518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:37.936764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:37.937455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:38.967473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:38.982098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-abca3f24-6748-439a-9dba-8261373bf33b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1690 microversion: 2.1 time: 1.309800 Aug 29 05:20:38.983551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2836/5654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:37 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1690 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:38.990163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-62e56fce-8e7d-473d-9a1e-2c0c155233a6 req-430cecab-1eaa-4ca1-af10-0728c9c41a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c32e9f9-9b4d-4503-9659-ca08f6ce7328", "tag": "f26698e6-bda4-45c5-8fe9-3eee7738792d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:39.010569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-62e56fce-8e7d-473d-9a1e-2c0c155233a6 req-430cecab-1eaa-4ca1-af10-0728c9c41a7c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:39.011664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-62e56fce-8e7d-473d-9a1e-2c0c155233a6 req-430cecab-1eaa-4ca1-af10-0728c9c41a7c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:39.013161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-62e56fce-8e7d-473d-9a1e-2c0c155233a6 req-430cecab-1eaa-4ca1-af10-0728c9c41a7c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:39.047463 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-62e56fce-8e7d-473d-9a1e-2c0c155233a6 req-430cecab-1eaa-4ca1-af10-0728c9c41a7c service nova] Creating event network-changed:f26698e6-bda4-45c5-8fe9-3eee7738792d for instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 on n-h1-854119-9 Aug 29 05:20:39.058883 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-62e56fce-8e7d-473d-9a1e-2c0c155233a6 req-430cecab-1eaa-4ca1-af10-0728c9c41a7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072662 Aug 29 05:20:39.060973 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2837/5655] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:39.627764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:39.641292 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8ad2a20f-7aaf-4bad-9484-ffeabdc71e20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1315 microversion: 2.1 time: 1.751159 Aug 29 05:20:39.641873 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2819/5656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:37 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1315 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:39.863866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-48284999-ab90-4e13-b8df-86acbe145c1b req-8583765c-cc57-45ae-9967-09718f0bbb65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6033bce-fbdd-4c3e-bb86-e964a7160e5a", "tag": "a0c578a4-6429-4ede-9c74-08a8970b8e2d"}, {"name": "network-changed", "server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:39.889611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-48284999-ab90-4e13-b8df-86acbe145c1b req-8583765c-cc57-45ae-9967-09718f0bbb65 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:39.890124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-48284999-ab90-4e13-b8df-86acbe145c1b req-8583765c-cc57-45ae-9967-09718f0bbb65 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:39.900653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-48284999-ab90-4e13-b8df-86acbe145c1b req-8583765c-cc57-45ae-9967-09718f0bbb65 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:39.952039 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-48284999-ab90-4e13-b8df-86acbe145c1b req-8583765c-cc57-45ae-9967-09718f0bbb65 service nova] Creating event network-changed:a0c578a4-6429-4ede-9c74-08a8970b8e2d for instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a on n-h1-854119-9 Aug 29 05:20:39.952339 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-48284999-ab90-4e13-b8df-86acbe145c1b req-8583765c-cc57-45ae-9967-09718f0bbb65 service nova] Creating event network-changed:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h1-854119-9 Aug 29 05:20:39.976005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-48284999-ab90-4e13-b8df-86acbe145c1b req-8583765c-cc57-45ae-9967-09718f0bbb65 service nova] Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:20:40.009002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:40.009652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:40.021789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:40.022294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:40.022732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:40.023484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:40.023937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:40.037189 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-48284999-ab90-4e13-b8df-86acbe145c1b req-8583765c-cc57-45ae-9967-09718f0bbb65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.177476 Aug 29 05:20:40.042897 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2838/5657] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:40.043354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:40.666504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:40.667245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:40.689774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:40.690461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:40.691188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:40.692078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:40.692714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:40.693283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:41.451055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:41.465018 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ebc173ac-5167-4f88-9219-80c928d9694b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1690 microversion: 2.1 time: 1.458769 Aug 29 05:20:41.468833 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2820/5658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:40 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1690 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:41.855825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:41.868990 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1f9df62c-6984-4f51-9eec-4f55d6003b8f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1502 microversion: 2.1 time: 1.204546 Aug 29 05:20:41.871025 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2839/5659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:40 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1502 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:41.890650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:41.900484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:41.925099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:41.925622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:41.926074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:41.927057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:41.927530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:41.927964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:42.502924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:42.503544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:42.533925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:42.534704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:42.536682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:42.537595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:42.538239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:42.540021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:42.704144 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.network.security_group_api [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Removing security group 7322e7df-faa7-4ae4-8860-daf5a8fe8e63 from port 12895453-2c94-4205-99f1-fee1f19c2244 Aug 29 05:20:43.248681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:43.261529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f630273a-1eb9-45bd-bcac-dfab4ee08202 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1690 microversion: 2.1 time: 0.771777 Aug 29 05:20:43.272268 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2840/5660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:42 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1690 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:43.437126 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ceccaad9-d93b-45a2-8d6a-0107192ab1ab tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da/action" status: 202 len: 0 microversion: 2.1 time: 1.551622 Aug 29 05:20:43.445128 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2821/5661] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:20:41 2022] POST /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da/action => generated 0 bytes in 1560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:20:43.448315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3a2d0f9c-e392-4a88-8dc5-31db033e3b44 req-108662c3-6c0e-47a6-8150-e17e09fd7c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b98b6fc-b979-4a95-8377-554fcdf6b1da", "tag": "12895453-2c94-4205-99f1-fee1f19c2244"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:43.467138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:43.468553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:43.473536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3a2d0f9c-e392-4a88-8dc5-31db033e3b44 req-108662c3-6c0e-47a6-8150-e17e09fd7c4a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:43.485068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3a2d0f9c-e392-4a88-8dc5-31db033e3b44 req-108662c3-6c0e-47a6-8150-e17e09fd7c4a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:43.485650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3a2d0f9c-e392-4a88-8dc5-31db033e3b44 req-108662c3-6c0e-47a6-8150-e17e09fd7c4a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:43.487385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:43.488930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:43.491165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:43.493236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:43.494750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:43.496075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:43.518236 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3a2d0f9c-e392-4a88-8dc5-31db033e3b44 req-108662c3-6c0e-47a6-8150-e17e09fd7c4a service nova] Creating event network-changed:12895453-2c94-4205-99f1-fee1f19c2244 for instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da on n-h1-854119-9 Aug 29 05:20:43.533058 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3a2d0f9c-e392-4a88-8dc5-31db033e3b44 req-108662c3-6c0e-47a6-8150-e17e09fd7c4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086980 Aug 29 05:20:43.537587 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2841/5662] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:20:43.717950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:43.729201 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7674e60-4892-4140-bf8a-c3236a13c13b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1460 microversion: 2.1 time: 0.277822 Aug 29 05:20:43.745729 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2822/5663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:43 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1460 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:43.753113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:43.754069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:43.765930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:43.768696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:43.769305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:43.771275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:43.774290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:43.777152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:44.257288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:44.272640 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4e0a431-dadf-4156-b8a9-2b0bf7512041 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.521976 Aug 29 05:20:44.274808 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2842/5664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:43 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:44.287163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:44.287917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:44.304061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:44.305329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:44.313866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:44.315039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:44.315839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:44.317044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:44.317805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:44.318818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:44.319708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:44.326062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:44.326773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:44.327419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:44.328089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:44.329837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:45.502126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:45.517253 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b43524ed-fcd9-43e7-81f5-a97e56810bd6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1690 microversion: 2.1 time: 1.234058 Aug 29 05:20:45.517879 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2823/5665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:44 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1690 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:45.543160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:45.570873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28421406-ff40-45b7-b8f1-2249dda6e061 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 1.269754 Aug 29 05:20:45.572266 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2843/5666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:44 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:45.594569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:45.595185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:45.607842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:45.611689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:45.612367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:45.613265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:45.613915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:45.614554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:46.538377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:46.539058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:46.564798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:46.565451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:46.565936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:46.568406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:46.568880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:46.577651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:47.126196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:47.168474 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-115626e4-f3f3-4f63-b6a6-4339bff3a504 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 1.577656 Aug 29 05:20:47.175706 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2824/5667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:45 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:47.203467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:47.204584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:47.205278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:47.216916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:47.221488 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9d7dedfa-ff6a-47b0-941d-92c284594259 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1683 microversion: 2.1 time: 0.686904 Aug 29 05:20:47.226385 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2844/5668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:46 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1683 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:47.243537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:47.244232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:47.245434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:47.245907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:47.247377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:47.305503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:47.860439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:47.869502 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c355ec53-7335-4e7d-a2f3-90e557b1af8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.677346 Aug 29 05:20:47.885259 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2825/5669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:47 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:20:48.108625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-63527921", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:48.194259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] validate_networks() for [('538fa1fe-ff9a-4cbf-92cf-827aeed4d8c9', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:20:49.518467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e52e46b-672c-4e2a-a8e1-1176dbedf9b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'create', calling method: .version_select at 0x7f1abd86e3a0>, body: {"keypair": {"name": "tempest-keypair-119311284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfSJEtCd8usxgfo9DWPQkMGx/t3hPPw7EPCtQe24lp24RI76NZZ7iEAGehQkKBYs8OC2ec/QXCKXspYgOeC45Hi2d2mw01p26sw80YBTUgfWOSz9Rb7fPAXzlSjpTbQ4g=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:49.571669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4e52e46b-672c-4e2a-a8e1-1176dbedf9b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Getting quotas for project fb004e20c1594762809ba319a68c50b9. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:20:49.591968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4e52e46b-672c-4e2a-a8e1-1176dbedf9b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Getting quotas for user 78bdd41026f34da095323a31c14f2606 and project fb004e20c1594762809ba319a68c50b9. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:20:49.661273 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4e52e46b-672c-4e2a-a8e1-1176dbedf9b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.412438 Aug 29 05:20:49.669221 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2826/5670] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:20:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:50.972871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:20:50.974112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:20:50.974776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:20:50.975337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:20:50.975948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:20:50.989907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=59 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:51.007689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:51.008274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:51.008727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:51.012541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:51.013080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:51.014193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:51.095317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:20:51.104691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Getting quotas for user 6fb88aef408746868abb4053768c18c4 and project 164260d628ac492481d9d3524036abf8. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:20:51.131942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:20:51.135745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:20:51.158356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-749a0a95-aa2f-49fa-947e-f85b74ff74d5 req-f7d743e9-b604-4bf5-b6f8-7c8f8d63c4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "name": "network-vif-plugged", "status": "completed", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:51.191169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-749a0a95-aa2f-49fa-947e-f85b74ff74d5 req-f7d743e9-b604-4bf5-b6f8-7c8f8d63c4c9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:51.192569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-749a0a95-aa2f-49fa-947e-f85b74ff74d5 req-f7d743e9-b604-4bf5-b6f8-7c8f8d63c4c9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:51.193320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-749a0a95-aa2f-49fa-947e-f85b74ff74d5 req-f7d743e9-b604-4bf5-b6f8-7c8f8d63c4c9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:51.210730 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-749a0a95-aa2f-49fa-947e-f85b74ff74d5 req-f7d743e9-b604-4bf5-b6f8-7c8f8d63c4c9 service nova] Creating event network-vif-plugged:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h1-854119-9 Aug 29 05:20:51.223098 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-749a0a95-aa2f-49fa-947e-f85b74ff74d5 req-f7d743e9-b604-4bf5-b6f8-7c8f8d63c4c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074990 Aug 29 05:20:51.224379 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2827/5671] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:51.242342 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c8bf3e70-3755-4165-94da-a1e8a64c82d3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.137504 Aug 29 05:20:51.243745 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2845/5672] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:20:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:20:51.256073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0bc5a4d1-8efb-4159-acd0-ce634cdd8222 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:51.257236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0bc5a4d1-8efb-4159-acd0-ce634cdd8222 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:51.448722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0bc5a4d1-8efb-4159-acd0-ce634cdd8222 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:51.457259 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0bc5a4d1-8efb-4159-acd0-ce634cdd8222 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1213 microversion: 2.1 time: 0.206503 Aug 29 05:20:51.468542 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2828/5673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:51 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1213 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:52.491069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:52.492685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:52.510564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:52.511507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:52.513544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:52.515964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:52.518053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:52.519167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:52.539489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:53.033793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:53.036113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:53.051334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:53.052792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:53.053449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:53.061987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:53.062649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:53.063246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:53.073823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:53.082399 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-29dbb83d-2ba9-4110-a3b0-1faffa94eaa7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1217 microversion: 2.1 time: 0.597324 Aug 29 05:20:53.092637 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2846/5674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:52 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1217 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:53.130103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lazy-loading 'flavor' on Instance uuid 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:20:53.437092 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc218976-a299-44d2-8f42-c5ae7c8140b9 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/action" status: 200 len: 32 microversion: 2.1 time: 0.407397 Aug 29 05:20:53.438510 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2829/5675] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:20:53 2022] POST /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/action => generated 32 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:20:53.450271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:53.451280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:53.466709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:53.467723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:53.468569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:53.470629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:53.471982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:53.473889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:53.874293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:53.887036 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71c42264-9203-41f5-8689-faad9d463a28 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.442854 Aug 29 05:20:53.892245 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2847/5676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:53 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:54.115517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:54.116975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:54.135344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:54.137616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:54.138984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:54.141269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:54.142030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:54.143613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:54.616253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:54.633968 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-46b1ca86-c6b9-41ef-9a59-d08be709ee57 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1273 microversion: 2.1 time: 0.522719 Aug 29 05:20:54.635881 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2830/5677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:54 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1273 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:54.920371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:54.921052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:54.932270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:54.932786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:54.933250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:54.937713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:54.938290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:54.938737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:55.582624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:55.588305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1405641604", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca473379-a51a-49eb-8d1b-f1c1042f536f"}], "security_groups": [{"name": "tempest-securitygroup--1708020658"}], "key_name": "tempest-keypair-119311284", "user_data": "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:55.600551 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b54c0ba-9a6d-417c-9aa2-f81524e204bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.693415 Aug 29 05:20:55.601267 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2848/5678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:54 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:55.613040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:20:55.657874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:55.670207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:55.678209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:55.679142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:55.687867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:55.689134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:55.689831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:55.690415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:56.007181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:56.022282 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2cf76413-0992-4bc0-82a1-6b211b6ba113 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1271 microversion: 2.1 time: 0.369586 Aug 29 05:20:56.038454 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2849/5679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:55 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1271 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:56.238844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] validate_networks() for [('ca473379-a51a-49eb-8d1b-f1c1042f536f', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:20:56.634096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:56.635272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:56.648472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:56.649018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:56.649666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:56.650388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:56.652438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:56.652872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:57.363840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:57.386622 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f04278b0-5cd4-4289-969e-f62442e77b98 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.764007 Aug 29 05:20:57.403318 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2850/5680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:56 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:57.416859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:57.417931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:57.431718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:57.434249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:57.436838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:57.440738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:57.441557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:57.442286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:57.970463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:20:57.971441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:20:57.975068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:20:57.975715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:20:57.976465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:20:57.993307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:57.994078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:57.994674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:57.995858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:57.997151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:57.997903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:58.023732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Getting quotas for project fb004e20c1594762809ba319a68c50b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:20:58.034925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Getting quotas for user 78bdd41026f34da095323a31c14f2606 and project fb004e20c1594762809ba319a68c50b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:20:58.055785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:20:58.059003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:20:58.148189 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23a8a0de-6268-4a09-aaf0-6f2bd5fba521 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.563884 Aug 29 05:20:58.162897 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2831/5681] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:20:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 2580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:20:58.173105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e1b3987-9088-4050-b1f7-fa349adcda75 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:58.176982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e1b3987-9088-4050-b1f7-fa349adcda75 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:59.038500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e1b3987-9088-4050-b1f7-fa349adcda75 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:59.058604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:59.080187 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e1b3987-9088-4050-b1f7-fa349adcda75 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1237 microversion: 2.1 time: 0.914535 Aug 29 05:20:59.080788 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2832/5682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:58 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1237 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:59.083214 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4e94cdd7-db68-4511-b29b-13ab45297c16 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 1.678267 Aug 29 05:20:59.089244 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2851/5683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:57 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:20:59.105133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:59.107028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:20:59.118332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:59.119075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:59.120150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:59.121061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:59.121691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:59.122327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:59.317210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c7522b4-ca0a-4f53-a5de-fcd7dbad3e0e tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1676487346", "availability_zone": "foo_zone"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:59.321834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.aggregate [None req-0c7522b4-ca0a-4f53-a5de-fcd7dbad3e0e tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Generated uuid d2d407b4-b992-44b3-a8be-09b71d7beaf3 for aggregate {{(pid=128872) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 05:20:59.363990 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0c7522b4-ca0a-4f53-a5de-fcd7dbad3e0e tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.273285 Aug 29 05:20:59.366165 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2852/5684] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Aug 29 05:20:59 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:59.380883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0d366df-40af-4626-9df9-7aa7d8bcfe3f tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:59.438892 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0d366df-40af-4626-9df9-7aa7d8bcfe3f tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.065207 Aug 29 05:20:59.456010 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2853/5685] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 05:20:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:20:59.464644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a70eaf7-9685-48d5-bfa9-1d539d39de3d tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:59.469699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a70eaf7-9685-48d5-bfa9-1d539d39de3d tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:59.470496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a70eaf7-9685-48d5-bfa9-1d539d39de3d tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:59.471151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a70eaf7-9685-48d5-bfa9-1d539d39de3d tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:59.472233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a70eaf7-9685-48d5-bfa9-1d539d39de3d tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:59.472971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a70eaf7-9685-48d5-bfa9-1d539d39de3d tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:59.473612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a70eaf7-9685-48d5-bfa9-1d539d39de3d tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:59.507603 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a70eaf7-9685-48d5-bfa9-1d539d39de3d tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.049828 Aug 29 05:20:59.509802 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2854/5686] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Aug 29 05:20:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:59.530099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da923736-5557-47e7-9657-e5b693492cda tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:20:59.546011 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da923736-5557-47e7-9657-e5b693492cda tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.025117 Aug 29 05:20:59.546949 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2855/5687] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Aug 29 05:20:59 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:20:59.559537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ebd4cd6-fcc2-4a05-8bb6-743a538feefc tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-9"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:20:59.573483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebd4cd6-fcc2-4a05-8bb6-743a538feefc tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:20:59.574038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebd4cd6-fcc2-4a05-8bb6-743a538feefc tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:20:59.574657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebd4cd6-fcc2-4a05-8bb6-743a538feefc tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:20:59.848944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:20:59.859257 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0d272d22-a46e-4cfa-919b-0d758cbfce8f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.769888 Aug 29 05:20:59.860439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2833/5688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:20:59 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:00.001625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2ebd4cd6-fcc2-4a05-8bb6-743a538feefc tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.446545 Aug 29 05:21:00.003346 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2856/5689] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 05:20:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:21:00.014256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-79d0eacd-639f-4be3-b11b-eaec3444b67c tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:00.023678 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-79d0eacd-639f-4be3-b11b-eaec3444b67c tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.013311 Aug 29 05:21:00.024294 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2834/5690] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 05:21:00 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:00.036775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d73d8474-c61d-4d90-95ad-569336e51fda tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2122944881", "availability_zone": "foo_zone"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:00.102282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:00.103918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:00.119840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:00.120828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:00.122278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:00.124651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:00.125769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:00.126805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:00.155483 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d73d8474-c61d-4d90-95ad-569336e51fda tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.123695 Aug 29 05:21:00.158873 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2857/5691] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Aug 29 05:21:00 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:00.172173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:00.174445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:00.216488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:00.216998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:00.222725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:00.223713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:00.224376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:00.225361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:00.368873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:00.382176 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64b810ea-1ecb-4684-a401-aee895d0f07a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1293 microversion: 2.1 time: 0.284094 Aug 29 05:21:00.389623 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2835/5692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:00 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1293 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:00.412480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e31601bf-4a29-4b09-a6d6-2d8402896ff8 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:00.462245 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e31601bf-4a29-4b09-a6d6-2d8402896ff8 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.071144 Aug 29 05:21:00.463836 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2836/5693] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 05:21:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:00.485051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-11f75911-a9e5-48f6-a55b-7d9eefa480e5 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:00.504607 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-11f75911-a9e5-48f6-a55b-7d9eefa480e5 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.028746 Aug 29 05:21:00.510510 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2837/5694] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Aug 29 05:21:00 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:00.523062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-93e04d5f-0221-402f-9585-70c99c11cb41 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-9"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:00.551539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93e04d5f-0221-402f-9585-70c99c11cb41 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:00.552562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93e04d5f-0221-402f-9585-70c99c11cb41 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:00.553353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-93e04d5f-0221-402f-9585-70c99c11cb41 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:00.828179 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-93e04d5f-0221-402f-9585-70c99c11cb41 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.309775 Aug 29 05:21:00.844559 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2838/5695] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Aug 29 05:21:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:00.858136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aeb8f947-d528-4263-a831-7eaf97c65ad2 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:00.972752 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aeb8f947-d528-4263-a831-7eaf97c65ad2 tempest-TestAggregatesBasicOps-993756070 tempest-TestAggregatesBasicOps-993756070-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.126593 Aug 29 05:21:00.974098 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2839/5696] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 05:21:00 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 05:21:00.984342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:00.985613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:00.996235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:00.997398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:00.998218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:00.999372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:01.000887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:01.001751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:01.089611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:01.105543 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-edb21f23-ff50-4496-b11e-9759b5e083b3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1317 microversion: 2.1 time: 0.939102 Aug 29 05:21:01.106637 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2858/5697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:00 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1317 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:01.407139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:01.408508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:01.410724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:01.424946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:01.425854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:01.426511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:01.427486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:01.428182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:01.428886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:01.687044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:01.703927 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b10a2fe-2754-447b-980f-5e058fef0fca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.727492 Aug 29 05:21:01.706668 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2840/5698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:00 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:01.725859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:01.739033 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae7a30aa-1e5f-4ccc-9fc4-0d9c774e977c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1295 microversion: 2.1 time: 0.335850 Aug 29 05:21:01.740967 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2859/5699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:01 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1295 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:01.937277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-56064d13-0c6b-4a65-a4d2-114805c0645a req-761efe43-ec79-4b39-9bbc-9c380fba1bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae85e20f-a8e6-4dcb-96ca-4e299be5c57d", "tag": "85479768-b4b0-4593-95b3-256a8907ba7a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:01.958374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-56064d13-0c6b-4a65-a4d2-114805c0645a req-761efe43-ec79-4b39-9bbc-9c380fba1bb7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:01.959250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-56064d13-0c6b-4a65-a4d2-114805c0645a req-761efe43-ec79-4b39-9bbc-9c380fba1bb7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:01.959918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-56064d13-0c6b-4a65-a4d2-114805c0645a req-761efe43-ec79-4b39-9bbc-9c380fba1bb7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:01.983919 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-56064d13-0c6b-4a65-a4d2-114805c0645a req-761efe43-ec79-4b39-9bbc-9c380fba1bb7 service nova] Creating event network-changed:85479768-b4b0-4593-95b3-256a8907ba7a for instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d on n-h1-854119-9 Aug 29 05:21:01.994497 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-56064d13-0c6b-4a65-a4d2-114805c0645a req-761efe43-ec79-4b39-9bbc-9c380fba1bb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060753 Aug 29 05:21:01.998229 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2841/5700] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:02.128345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:02.129560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:02.147415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:02.148021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:02.148485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:02.149197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:02.149651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:02.150068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:02.761209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:02.761957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:02.769849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:02.770754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:02.771360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:02.772311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:02.772997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:02.773575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:03.554843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:03.568734 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d4b5a69b-ab2d-48bf-b7d1-ecf30d63b2d8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 1.443855 Aug 29 05:21:03.571403 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2860/5701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:02 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:03.578597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:03.580244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:03.583371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:03.589675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:03.590484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:03.591557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:03.592509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:03.593171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:03.594467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:03.608053 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-723097f4-c8c9-45a6-8399-601185bd1488 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.880866 Aug 29 05:21:03.609691 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2842/5702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:02 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:03.766036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:03.777064 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1e482593-0151-440e-b560-9dc305714815 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1295 microversion: 2.1 time: 0.204203 Aug 29 05:21:03.778367 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2861/5703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:03 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:04.597340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:04.599002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:04.609994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:04.610846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:04.611658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:04.612758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:04.628113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:04.629004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:04.634252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:04.635094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:04.647664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:04.656827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:04.658361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:04.659193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:04.660618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:04.661298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:05.021737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:05.031035 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06f8eaaa-496c-4c01-a8ec-f24be2bed6a3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 0.440295 Aug 29 05:21:05.033806 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2843/5704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:04 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:05.048857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:05.059892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:05.066878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:05.067749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:05.068461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:05.071466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:05.073001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:05.076734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:05.120178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:05.132361 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9b4d442-3489-40f8-a518-b492535adef2 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.501881 Aug 29 05:21:05.141993 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2862/5705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:04 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:05.332410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:05.341418 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d1dd253a-6d8b-480b-adb5-f6f1f3ddff52 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.302543 Aug 29 05:21:05.342362 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2844/5706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:05 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:06.057724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:06.059319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:06.075580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:06.076490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:06.078372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:06.080254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:06.081599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:06.082274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:06.161771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:06.167241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:06.200532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:06.201405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:06.202183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:06.203786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:06.204743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:06.205386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:06.500781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:06.515932 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc2a227f-57d7-4051-8235-73c5f6ec342a tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.358491 Aug 29 05:21:06.516390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:06.516560 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2845/5707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:06 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:06.537889 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb3ff6c2-b783-47e3-b0a5-3f6f123cebf4 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 0.484914 Aug 29 05:21:06.538634 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2863/5708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:06 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:06.546719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d69cdda-6480-4a16-8014-64bc81d35357 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:06.552560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d69cdda-6480-4a16-8014-64bc81d35357 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:06.558399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:06.559193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:06.567721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d69cdda-6480-4a16-8014-64bc81d35357 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:06.569775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d69cdda-6480-4a16-8014-64bc81d35357 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:06.570127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d69cdda-6480-4a16-8014-64bc81d35357 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:06.572087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d69cdda-6480-4a16-8014-64bc81d35357 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:06.573305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d69cdda-6480-4a16-8014-64bc81d35357 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:06.574479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d69cdda-6480-4a16-8014-64bc81d35357 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:06.576409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:06.577010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:06.580845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:06.581739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:06.582294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:06.582818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:06.860421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:06.913198 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a110c21-302a-40bf-9b55-d6d540f076dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.373110 Aug 29 05:21:06.917892 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2864/5709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:06 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:06.972684 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d69cdda-6480-4a16-8014-64bc81d35357 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "POST /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a/action" status: 200 len: 24565 microversion: 2.1 time: 0.437449 Aug 29 05:21:06.973153 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2846/5710] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:21:06 2022] POST /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a/action => generated 24565 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:21:07.549478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:07.550708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:07.560047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:07.561483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:07.591793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:07.592448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:07.592888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:07.594374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:07.595054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:07.595329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:07.597756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:07.598655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:07.599496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:07.600341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:07.601740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:07.604095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:08.011992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:08.350350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:08.359379 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-017706fa-a740-488a-be71-e83db24f9ead tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 0.804161 Aug 29 05:21:08.361325 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2847/5711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:07 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:08.386654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:08.387561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:08.410473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:08.410988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:08.411437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:08.412181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:08.416000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:08.419884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:08.458175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:08.471876 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c879e523-1806-4a18-92db-c0265e6c27b1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.935264 Aug 29 05:21:08.475074 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2865/5712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:07 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:09.049711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=14 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:09.299337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:09.318781 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2750b94e-ca10-44c7-bcab-8d0ff1cc0ff4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.941153 Aug 29 05:21:09.336512 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2848/5713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:08 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:09.383250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:09.383857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:09.395207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:09.395970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:09.396441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:09.397174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:09.397688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:09.398252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:09.483488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:09.496763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:09.498899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:09.512437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:09.515012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:09.515469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:09.518592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:09.520162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:09.521374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:09.990455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:10.010752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:10.015959 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-57640fad-5bcb-416a-a150-fe010534d96f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.525740 Aug 29 05:21:10.017219 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2849/5714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:09 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:10.131928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f5a1d09f-cbba-45e1-8970-e29e5847c3b6 req-fd658222-6de1-4b2e-b326-e26a0fa37b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635e3272-74c9-40af-931a-531bb7658fba", "tag": "8a278e7e-0e8e-4a50-910b-741261864d38"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:10.147241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f5a1d09f-cbba-45e1-8970-e29e5847c3b6 req-fd658222-6de1-4b2e-b326-e26a0fa37b8a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:10.148044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f5a1d09f-cbba-45e1-8970-e29e5847c3b6 req-fd658222-6de1-4b2e-b326-e26a0fa37b8a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:10.148700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f5a1d09f-cbba-45e1-8970-e29e5847c3b6 req-fd658222-6de1-4b2e-b326-e26a0fa37b8a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:10.165394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f5a1d09f-cbba-45e1-8970-e29e5847c3b6 req-fd658222-6de1-4b2e-b326-e26a0fa37b8a service nova] Creating event network-changed:8a278e7e-0e8e-4a50-910b-741261864d38 for instance 635e3272-74c9-40af-931a-531bb7658fba on n-h1-854119-9 Aug 29 05:21:10.172655 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f5a1d09f-cbba-45e1-8970-e29e5847c3b6 req-fd658222-6de1-4b2e-b326-e26a0fa37b8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153458 Aug 29 05:21:10.173847 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2850/5715] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:10.283449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:10.293924 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9bd636c-a774-454e-819e-7991db488119 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 0.916167 Aug 29 05:21:10.295301 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2866/5716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:09 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:10.348442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:10.349755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:10.359914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:10.361222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:10.361877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:10.362931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:10.363742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:10.364536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:10.718907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:10.727226 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9c08193-bf82-4518-bf03-ee0afd15ad20 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.386288 Aug 29 05:21:10.727825 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2851/5717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:10 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:11.038355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:11.038915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:11.045604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:11.046086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:11.046511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:11.047388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:11.048161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:11.048583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:11.220979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-214391ba-6543-4441-b98b-eb2f4b6f1879 req-7de2c67a-09f5-4768-a5b6-b6a86aa16467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae85e20f-a8e6-4dcb-96ca-4e299be5c57d", "name": "network-vif-plugged", "status": "completed", "tag": "85479768-b4b0-4593-95b3-256a8907ba7a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:11.232696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-214391ba-6543-4441-b98b-eb2f4b6f1879 req-7de2c67a-09f5-4768-a5b6-b6a86aa16467 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:11.233180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-214391ba-6543-4441-b98b-eb2f4b6f1879 req-7de2c67a-09f5-4768-a5b6-b6a86aa16467 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:11.233612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-214391ba-6543-4441-b98b-eb2f4b6f1879 req-7de2c67a-09f5-4768-a5b6-b6a86aa16467 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:11.254085 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-214391ba-6543-4441-b98b-eb2f4b6f1879 req-7de2c67a-09f5-4768-a5b6-b6a86aa16467 service nova] Creating event network-vif-plugged:85479768-b4b0-4593-95b3-256a8907ba7a for instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d on n-h1-854119-9 Aug 29 05:21:11.259963 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-214391ba-6543-4441-b98b-eb2f4b6f1879 req-7de2c67a-09f5-4768-a5b6-b6a86aa16467 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138591 Aug 29 05:21:11.261303 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2852/5718] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:11.322108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:11.327606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:11.340044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:11.340583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:11.341023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:11.342392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:11.342853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:11.343279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:11.576534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:11.580900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:11.586802 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8d7395ba-7bfc-4807-8b64-05a9113ddcf8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.552675 Aug 29 05:21:11.587404 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2867/5719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:11 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:11.751343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:11.752056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:11.755811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:11.759385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:11.759960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:11.760528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:11.761278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:11.761804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:11.762304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:11.764175 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d0f1da9-b236-44e3-b14e-9b7370fcf185 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 0.452746 Aug 29 05:21:11.764973 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2853/5720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:11 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:12.085024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:12.093013 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73cf573c-7d2f-4842-b120-7eb0418e19da tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.346833 Aug 29 05:21:12.093591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2868/5721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:11 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:12.608774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:12.609475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:12.616892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:12.617376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:12.617812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:12.618526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:12.618978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:12.619400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:12.786092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:12.786708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:12.793499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:12.794387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:12.794836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:12.795534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:12.795999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:12.796442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:12.980460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:12.990811 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d96b6ee0-74ea-4acb-aeac-50f75b544c46 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.385932 Aug 29 05:21:12.992060 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2854/5722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:12 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:13.113678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:13.115570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:13.123966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:13.124486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:13.124914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:13.125866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:13.126110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:13.126465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:13.194345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:13.203876 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0558d525-4766-46f6-8e08-7af2b5865c9d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 0.421665 Aug 29 05:21:13.204639 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2869/5723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:12 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:13.796539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:13.804629 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-054e0c33-0a92-46bd-9565-538cf58825aa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.695244 Aug 29 05:21:13.805201 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2855/5724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:13 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:14.013763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:14.015745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:14.027814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:14.028853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:14.029584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:14.030680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:14.031369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:14.032378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:14.225274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:14.226084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:14.238240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:14.239439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:14.241327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:14.242426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:14.243464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:14.250811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:14.311773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:14.332692 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28c4c240-2cf6-461c-8177-92ae326e1921 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.323485 Aug 29 05:21:14.360404 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2870/5725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:14 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:14.562272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:14.578068 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-619e1232-22fb-43cf-af5e-3f7d1c1bb28d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 0.356828 Aug 29 05:21:14.578786 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2856/5726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:14 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:14.825889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:14.826716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:14.843581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:14.851154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:14.853523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:14.854396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:14.855349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:14.856688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:15.170915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:15.179437 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d67ea682-182e-4bd6-ae12-000f78c6d3f2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.357875 Aug 29 05:21:15.180309 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2871/5727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:14 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:15.367372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:15.368302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:15.387002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:15.387504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:15.387946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:15.388761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:15.389220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:15.389816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:15.599002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:15.600432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:15.624091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:15.624634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:15.625068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:15.625787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:15.626248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:15.626673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:15.650398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:15.666622 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d08c0c8e-eeb7-45bc-a852-58e41ee15bd4 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.301538 Aug 29 05:21:15.684042 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2857/5728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:15 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:15.836698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:15.846938 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2de033c8-6177-4a40-b6d2-2614fcd1ce3b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 0.251736 Aug 29 05:21:15.847535 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2872/5729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:15 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:16.201996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:16.202603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:16.210466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:16.211243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:16.211853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:16.213306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:16.213776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:16.214256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:16.391391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:16.399325 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1881cdb2-a20c-43f2-8269-7e6522a5f17f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.201233 Aug 29 05:21:16.399912 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2858/5730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:16 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:16.703285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:16.704528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:16.718242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:16.718242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:16.718637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:16.719420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:16.719882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:16.720819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:16.867403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:16.868299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:16.875192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:16.879493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:16.881550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:16.882940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:16.884060 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a33f9640-f6b2-48ee-b0fd-a11615ce13aa tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.184808 Aug 29 05:21:16.884591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:16.885044 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2873/5731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:16 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:16.897513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:16.900907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:17.082153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:17.102453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-94f159cc-1755-4438-9b63-824c0a522b94 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1313 microversion: 2.1 time: 0.239170 Aug 29 05:21:17.103909 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2859/5732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:16 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:17.420461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:17.420995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:17.422909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:17.434157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:17.435056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:17.436839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:17.439447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:17.440143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:17.441262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:17.716658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:17.735581 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f99b3a4b-f534-4c66-8f03-eaab92146119 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.319180 Aug 29 05:21:17.739372 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2874/5733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:17 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:17.906960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:17.908481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:17.915322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:17.916777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:17.917421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:17.919175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:17.919842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:17.920517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:18.098738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:18.108741 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed37580a-99d0-4b44-a55c-9aa1a878c777 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.206466 Aug 29 05:21:18.109160 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2860/5734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:17 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:18.123029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:18.123943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:18.130194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:18.130828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:18.131511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:18.132475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:18.132940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:18.133364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:18.388512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:18.397290 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-15beb19f-c225-43ce-829e-8a752604a120 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1501 microversion: 2.1 time: 0.278160 Aug 29 05:21:18.398053 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2875/5735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:18 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:18.421997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e96fecd7-8668-4d7a-aa31-54005108997e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:18.422551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e96fecd7-8668-4d7a-aa31-54005108997e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:18.430312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e96fecd7-8668-4d7a-aa31-54005108997e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:18.430872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e96fecd7-8668-4d7a-aa31-54005108997e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:18.431325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e96fecd7-8668-4d7a-aa31-54005108997e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:18.432086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e96fecd7-8668-4d7a-aa31-54005108997e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:18.432660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e96fecd7-8668-4d7a-aa31-54005108997e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:18.433113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e96fecd7-8668-4d7a-aa31-54005108997e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:18.540967 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e96fecd7-8668-4d7a-aa31-54005108997e tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d/action" status: 202 len: 0 microversion: 2.1 time: 0.122343 Aug 29 05:21:18.555052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:18.555698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:18.558861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2861/5736] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:21:18 2022] POST /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:21:18.566655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:18.569016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:18.569864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:18.574107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:18.578389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:18.579694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:18.760684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:18.761459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:18.768625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:18.769376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:18.769985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:18.770948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:18.771576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:18.772037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:18.976389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:18.991934 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7af64323-ba9f-43e2-b6ee-97d21ee55edf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1506 microversion: 2.1 time: 0.440515 Aug 29 05:21:18.992669 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2876/5737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:18 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:19.079143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:19.098406 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ebd8e79b-4ac0-40dd-8f5d-cbd6ad0e2712 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.343065 Aug 29 05:21:19.098931 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2862/5738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:18 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:19.132524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:19.133135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:19.139433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:19.139945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:19.140403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:19.141102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:19.142163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:19.143084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:19.357082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-59974a46-d6ce-467a-a9c3-09e95a98fe88 req-297cdd4b-1534-43e2-8805-24b858e42f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635e3272-74c9-40af-931a-531bb7658fba", "name": "network-vif-plugged", "status": "completed", "tag": "8a278e7e-0e8e-4a50-910b-741261864d38"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:19.367906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-59974a46-d6ce-467a-a9c3-09e95a98fe88 req-297cdd4b-1534-43e2-8805-24b858e42f90 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:19.368363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-59974a46-d6ce-467a-a9c3-09e95a98fe88 req-297cdd4b-1534-43e2-8805-24b858e42f90 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:19.368781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-59974a46-d6ce-467a-a9c3-09e95a98fe88 req-297cdd4b-1534-43e2-8805-24b858e42f90 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:19.383280 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-59974a46-d6ce-467a-a9c3-09e95a98fe88 req-297cdd4b-1534-43e2-8805-24b858e42f90 service nova] Creating event network-vif-plugged:8a278e7e-0e8e-4a50-910b-741261864d38 for instance 635e3272-74c9-40af-931a-531bb7658fba on n-h1-854119-9 Aug 29 05:21:19.401185 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-59974a46-d6ce-467a-a9c3-09e95a98fe88 req-297cdd4b-1534-43e2-8805-24b858e42f90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047501 Aug 29 05:21:19.402670 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2863/5739] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:19.460737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:19.470485 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d940fafe-dd33-40f3-8e31-fba33264739e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1735 microversion: 2.1 time: 0.344104 Aug 29 05:21:19.471342 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2877/5740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:19 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1735 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:20.015546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:20.016269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:20.020161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:20.023984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.024498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.024933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.025625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.026071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.026494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.120520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:20.121138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:20.135257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.136481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.137080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.139586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.140275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.140714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.227405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:20.239555 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8d71653-731f-4932-9694-7d78ffa4c0f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1486 microversion: 2.1 time: 0.228235 Aug 29 05:21:20.248543 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2864/5741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:20 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1486 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:20.263108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:20.264018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:20.271668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.272544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.273164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.274218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.274861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.276453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.304249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lazy-loading 'flavor' on Instance uuid ae85e20f-a8e6-4dcb-96ca-4e299be5c57d {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:21:20.315801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:20.324723 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7fbbaedb-8cac-4a1a-9e76-80a7fff1cb5a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.209666 Aug 29 05:21:20.337927 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2878/5742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:20 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:20.384050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:20.491245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:20.491844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:20.499251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.499743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.500199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.500903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.501358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.501779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.605987 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-abe60817-d353-4648-9e68-fad66e1d5b62 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d/action" status: 202 len: 0 microversion: 2.1 time: 0.347275 Aug 29 05:21:20.606829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2865/5743] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:21:20 2022] POST /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:21:20.621926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:20.622865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:20.630588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.631186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.632168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.632542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.633152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.633579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.738307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:20.748657 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-62306420-ad69-4723-9ab9-d77e624013bc tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1715 microversion: 2.1 time: 0.261579 Aug 29 05:21:20.753030 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2879/5744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:20 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1715 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:20.826801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:20.838850 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3e176e44-37d9-480d-955d-f960d1d30c69 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1492 microversion: 2.1 time: 0.227117 Aug 29 05:21:20.852465 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2866/5745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:20 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1492 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:20.908087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:20.908698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:20.915021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.915509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.915942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:20.916793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:20.917252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:20.917672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:21.002765 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] HTTP exception thrown: Cannot 'detach_volume' instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 while it is in vm_state rescued Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Request method failure captured: Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments/145ee3c8-db6c-48c1-a8dc-059410343ecc HTTP/1.1 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEvMW3izJD85pVtbvax1SMfCuq2_Uf3UUHBG6YwbWLNgoxV3uYJIzYl-i9v4vjXyxY9Qq6gcnhWdP6WFxclBgQAU6dml8-Y-HMFx3s3QV0g_wjEpxDyxcKn6d9J-7o-Mew1NhfWoJLNGc1dBi1srqaIaTALn7VpmZsYiGBl2GStsVDM Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63bbfe3da13249fa9f9fe77f7725d037", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b9574a5f99bf4401a8a2297c71d3e382 Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot 'detach_volume' instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 while it is in vm_state rescued Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'server_id': '4c227b05-d28b-410f-bb7d-ccba6c7c2ad3', 'id': '145ee3c8-db6c-48c1-a8dc-059410343ecc'} Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 while it is in vm_state rescued Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:21:21.004416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:21:21.008778 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:21:21.008778 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:21:21.008778 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:21:21.008778 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:21:21.008778 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 while it is in vm_state rescued Aug 29 05:21:21.008778 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:21:21.008778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Returning 409 to user: Cannot 'detach_volume' instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 while it is in vm_state rescued {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:21:21.008778 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80667265-1ba9-4bd1-9675-d59fea93a5df tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments/145ee3c8-db6c-48c1-a8dc-059410343ecc" status: 409 len: 152 microversion: 2.1 time: 0.102017 Aug 29 05:21:21.008778 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2880/5746] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:21:20 2022] DELETE /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments/145ee3c8-db6c-48c1-a8dc-059410343ecc => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:21:21.015149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-01d96ba7-f5f2-41d6-8f3f-3845c29e1157 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:21.015685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-01d96ba7-f5f2-41d6-8f3f-3845c29e1157 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:21.022436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01d96ba7-f5f2-41d6-8f3f-3845c29e1157 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:21.022990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01d96ba7-f5f2-41d6-8f3f-3845c29e1157 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:21.023421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01d96ba7-f5f2-41d6-8f3f-3845c29e1157 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:21.024166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01d96ba7-f5f2-41d6-8f3f-3845c29e1157 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:21.024774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01d96ba7-f5f2-41d6-8f3f-3845c29e1157 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:21.025199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01d96ba7-f5f2-41d6-8f3f-3845c29e1157 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:21.093886 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-01d96ba7-f5f2-41d6-8f3f-3845c29e1157 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/action" status: 202 len: 0 microversion: 2.1 time: 0.082554 Aug 29 05:21:21.097789 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2867/5747] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:21:21 2022] POST /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:21:21.103072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:21.103702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:21.109780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:21.110265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:21.110724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:21.111651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:21.111920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:21.112555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:21.264024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:21.273391 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7a4c9394-e20a-4431-9b08-51fd0d9064ba tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1723 microversion: 2.1 time: 0.174392 Aug 29 05:21:21.274080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2881/5748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:21 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:21.346709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:21.348060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:21.356670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:21.357477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:21.358263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:21.359241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:21.359978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:21.360663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:21.573184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:21.581759 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3835ae0a-d96b-4623-bb1a-582645abaad9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1363 microversion: 2.1 time: 0.239622 Aug 29 05:21:21.582350 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2868/5749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:21 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:21.862029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:21.862878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:21.869876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:21.870612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:21.871386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:21.872110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:21.872826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:21.873431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:22.115472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:22.131341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b574a77-d4d0-44a5-8948-424ff90db7d9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1492 microversion: 2.1 time: 0.275093 Aug 29 05:21:22.132377 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2882/5750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:21 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1492 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:22.294877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:22.295523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:22.302776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:22.303308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:22.303720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:22.304444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:22.304887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:22.305300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:22.458269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:22.466805 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fea07f42-baa3-48d6-9d67-7690fbd99511 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1723 microversion: 2.1 time: 0.175903 Aug 29 05:21:22.467378 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2869/5751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:22 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:22.603053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:22.604257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:22.610936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:22.611420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:22.611857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:22.612611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:22.613056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:22.613476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:22.757309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:22.769584 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0e9afa9f-c0c9-4b4c-b462-e1da284d1896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1548 microversion: 2.1 time: 0.170807 Aug 29 05:21:22.770440 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2883/5752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:22 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:22.790629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7fb0d7e4-333a-410f-8878-4e8eabeb8796 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:22.791130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7fb0d7e4-333a-410f-8878-4e8eabeb8796 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:22.797269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb0d7e4-333a-410f-8878-4e8eabeb8796 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:22.797759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb0d7e4-333a-410f-8878-4e8eabeb8796 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:22.798191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb0d7e4-333a-410f-8878-4e8eabeb8796 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:22.798893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb0d7e4-333a-410f-8878-4e8eabeb8796 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:22.799346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb0d7e4-333a-410f-8878-4e8eabeb8796 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:22.799769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb0d7e4-333a-410f-8878-4e8eabeb8796 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:22.881094 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7fb0d7e4-333a-410f-8878-4e8eabeb8796 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094619 Aug 29 05:21:22.881852 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2870/5753] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:21:22 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:23.153227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:23.153817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:23.160466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:23.161141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:23.161781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:23.162489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:23.162945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:23.163361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:23.181783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:23.422078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:23.430589 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c74a8c4-61df-4655-a535-8b140bb7a41f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1513 microversion: 2.1 time: 0.281438 Aug 29 05:21:23.431403 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2884/5754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:23 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:23.487244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:23.487929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:23.495923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:23.496687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:23.497320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:23.500919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:23.501395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:23.501883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:23.745282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:23.753973 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc08eefd-71db-4efc-abae-e02b65e562d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1723 microversion: 2.1 time: 0.270616 Aug 29 05:21:23.754683 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2871/5755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:23 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:24.028386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8b3dc7ff-d2e0-4eec-8015-ce33e7eaea78 req-76f52bd2-9443-489f-9a6a-a873dbfa85a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635e3272-74c9-40af-931a-531bb7658fba", "tag": "8a278e7e-0e8e-4a50-910b-741261864d38"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:24.038487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b3dc7ff-d2e0-4eec-8015-ce33e7eaea78 req-76f52bd2-9443-489f-9a6a-a873dbfa85a8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:24.039052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b3dc7ff-d2e0-4eec-8015-ce33e7eaea78 req-76f52bd2-9443-489f-9a6a-a873dbfa85a8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:24.039547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b3dc7ff-d2e0-4eec-8015-ce33e7eaea78 req-76f52bd2-9443-489f-9a6a-a873dbfa85a8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:24.052787 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8b3dc7ff-d2e0-4eec-8015-ce33e7eaea78 req-76f52bd2-9443-489f-9a6a-a873dbfa85a8 service nova] Creating event network-changed:8a278e7e-0e8e-4a50-910b-741261864d38 for instance 635e3272-74c9-40af-931a-531bb7658fba on n-h1-854119-9 Aug 29 05:21:24.058789 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8b3dc7ff-d2e0-4eec-8015-ce33e7eaea78 req-76f52bd2-9443-489f-9a6a-a873dbfa85a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034686 Aug 29 05:21:24.059379 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2885/5756] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:24.455034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:24.455652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:24.462077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:24.462562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:24.463227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:24.463929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:24.464413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:24.464838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:24.675763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:24.687020 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ba813cc-b7e6-4ab9-8366-2095dc7be143 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1513 microversion: 2.1 time: 0.235959 Aug 29 05:21:24.687687 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2872/5757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:24 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:24.776927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:24.778052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:24.786363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:24.787069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:24.787798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:24.788918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:24.789382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:24.789807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:24.971186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:24.980301 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd7d05d3-a3e9-4b94-9498-b48132ceb359 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1723 microversion: 2.1 time: 0.208882 Aug 29 05:21:24.995191 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2886/5758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:24 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:25.714188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:25.715912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:25.727367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:25.728250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:25.729495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:25.730668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:25.731494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:25.732700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:26.003047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:26.003637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:26.013139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:26.013872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:26.014638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:26.015516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:26.016004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:26.016453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:26.017934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:26.029026 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-149e470c-8228-4565-b35e-9cb4b6654039 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1513 microversion: 2.1 time: 0.322865 Aug 29 05:21:26.029625 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2873/5759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:25 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1513 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:26.166768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:26.177191 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff24e4ff-58ac-4d72-ac70-bd073347eb5f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1729 microversion: 2.1 time: 0.178356 Aug 29 05:21:26.177764 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2887/5760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:25 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:26.198437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-422eb5a9-644f-4374-948d-5a309826ba7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:26.198933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-422eb5a9-644f-4374-948d-5a309826ba7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:26.204945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-422eb5a9-644f-4374-948d-5a309826ba7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:26.205434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-422eb5a9-644f-4374-948d-5a309826ba7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:26.205871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-422eb5a9-644f-4374-948d-5a309826ba7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:26.206574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-422eb5a9-644f-4374-948d-5a309826ba7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:26.207028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-422eb5a9-644f-4374-948d-5a309826ba7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:26.207453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-422eb5a9-644f-4374-948d-5a309826ba7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:26.297990 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-422eb5a9-644f-4374-948d-5a309826ba7c tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103966 Aug 29 05:21:26.298617 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2874/5761] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:21:26 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:27.051468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:27.052201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:27.060011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:27.060574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:27.060984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:27.061878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:27.062477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:27.063056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:27.359379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-edd6b35f-2df0-4921-8b27-c507ec2ff722 req-6ed2fb3b-173e-445a-bb12-41b4138e4d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae85e20f-a8e6-4dcb-96ca-4e299be5c57d", "name": "network-vif-plugged", "status": "completed", "tag": "85479768-b4b0-4593-95b3-256a8907ba7a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:27.370812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-edd6b35f-2df0-4921-8b27-c507ec2ff722 req-6ed2fb3b-173e-445a-bb12-41b4138e4d13 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:27.371560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-edd6b35f-2df0-4921-8b27-c507ec2ff722 req-6ed2fb3b-173e-445a-bb12-41b4138e4d13 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:27.372294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-edd6b35f-2df0-4921-8b27-c507ec2ff722 req-6ed2fb3b-173e-445a-bb12-41b4138e4d13 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:27.384842 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-edd6b35f-2df0-4921-8b27-c507ec2ff722 req-6ed2fb3b-173e-445a-bb12-41b4138e4d13 service nova] Creating event network-vif-plugged:85479768-b4b0-4593-95b3-256a8907ba7a for instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d on n-h1-854119-9 Aug 29 05:21:27.390907 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-edd6b35f-2df0-4921-8b27-c507ec2ff722 req-6ed2fb3b-173e-445a-bb12-41b4138e4d13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036175 Aug 29 05:21:27.392149 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2875/5762] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:21:27.497610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:27.506558 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0da2be49-9f49-4cc5-8649-3f2e98988aea tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1513 microversion: 2.1 time: 0.459707 Aug 29 05:21:27.507139 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2888/5763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:27 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1513 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:27.677696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-257647d3-7a1d-48d7-b43f-85abc6b58b63 req-db5fc5a3-955c-48f1-8471-12470e2f1329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c227b05-d28b-410f-bb7d-ccba6c7c2ad3", "tag": "d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:27.688088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-257647d3-7a1d-48d7-b43f-85abc6b58b63 req-db5fc5a3-955c-48f1-8471-12470e2f1329 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:27.688958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-257647d3-7a1d-48d7-b43f-85abc6b58b63 req-db5fc5a3-955c-48f1-8471-12470e2f1329 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:27.689603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-257647d3-7a1d-48d7-b43f-85abc6b58b63 req-db5fc5a3-955c-48f1-8471-12470e2f1329 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:27.702259 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-257647d3-7a1d-48d7-b43f-85abc6b58b63 req-db5fc5a3-955c-48f1-8471-12470e2f1329 service nova] Creating event network-changed:d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7 for instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 on n-h1-854119-9 Aug 29 05:21:27.707329 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-257647d3-7a1d-48d7-b43f-85abc6b58b63 req-db5fc5a3-955c-48f1-8471-12470e2f1329 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033733 Aug 29 05:21:27.708058 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2876/5764] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:28.526865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:28.528063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:28.537645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:28.538133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:28.538617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:28.539323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:28.540475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:28.541211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:28.681623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:28.689616 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-26520d03-d716-4b03-b64d-21d0382c7368 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1513 microversion: 2.1 time: 0.166719 Aug 29 05:21:28.690232 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2889/5765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:28 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:29.713059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:29.713426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:29.736539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c4996072-b518-4da3-9694-3c6c6ff2dc97 req-df9f9f1a-00b2-4158-9f8f-12478ad3b6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c227b05-d28b-410f-bb7d-ccba6c7c2ad3", "tag": "d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:29.746422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c4996072-b518-4da3-9694-3c6c6ff2dc97 req-df9f9f1a-00b2-4158-9f8f-12478ad3b6fa service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:29.746900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c4996072-b518-4da3-9694-3c6c6ff2dc97 req-df9f9f1a-00b2-4158-9f8f-12478ad3b6fa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:29.747331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c4996072-b518-4da3-9694-3c6c6ff2dc97 req-df9f9f1a-00b2-4158-9f8f-12478ad3b6fa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:29.748985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:29.749517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:29.749978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:29.750787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:29.751245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:29.751691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:29.788981 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c4996072-b518-4da3-9694-3c6c6ff2dc97 req-df9f9f1a-00b2-4158-9f8f-12478ad3b6fa service nova] Creating event network-changed:d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7 for instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 on n-h1-854119-9 Aug 29 05:21:29.796134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c4996072-b518-4da3-9694-3c6c6ff2dc97 req-df9f9f1a-00b2-4158-9f8f-12478ad3b6fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074956 Aug 29 05:21:29.797008 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2890/5766] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:29.802216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b8e77743-9e68-4786-8497-2100553c6a28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:29.805059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b8e77743-9e68-4786-8497-2100553c6a28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:29.813724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8e77743-9e68-4786-8497-2100553c6a28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:29.814464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8e77743-9e68-4786-8497-2100553c6a28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:29.815082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8e77743-9e68-4786-8497-2100553c6a28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:29.815944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8e77743-9e68-4786-8497-2100553c6a28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:29.816593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8e77743-9e68-4786-8497-2100553c6a28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:29.817173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8e77743-9e68-4786-8497-2100553c6a28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:29.893373 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b8e77743-9e68-4786-8497-2100553c6a28 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action" status: 200 len: 63139 microversion: 2.1 time: 0.094979 Aug 29 05:21:29.894329 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2891/5767] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:21:29 2022] POST /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716/action => generated 63139 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:21:29.911025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:29.919432 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d07b619e-ca6d-409b-8ed0-345e7467dbf5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1513 microversion: 2.1 time: 0.212254 Aug 29 05:21:29.920145 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2877/5768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:29 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:30.942231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:30.942962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:30.951492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:30.952146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:30.952658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:30.953369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:30.953902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:30.954316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:31.125240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:31.134724 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2577e41e-f18c-420a-a529-251c7a1024a8 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1508 microversion: 2.1 time: 0.197603 Aug 29 05:21:31.135418 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2892/5769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:30 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:32.163201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:32.164799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:32.178427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:32.179203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:32.179856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:32.181291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:32.182114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:32.183230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:32.343462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:32.353523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-63e5f2fe-41fb-4319-80ef-b45082988490 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1508 microversion: 2.1 time: 0.199942 Aug 29 05:21:32.355229 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2878/5770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:32 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:33.377991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:33.378641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:33.389402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:33.390399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:33.391646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:33.392411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:33.392870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:33.393304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:33.554397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:33.564186 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d125f45b-c111-4ac1-a3a5-d7f635ba4e5a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1508 microversion: 2.1 time: 0.192312 Aug 29 05:21:33.565035 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2893/5771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:33 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:34.586135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:34.587612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:34.605993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:34.607192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:34.607805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:34.608858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:34.612366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:34.613180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:34.901852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:34.914621 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e907b70f-ac42-40b2-838c-d57053338707 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1508 microversion: 2.1 time: 0.332568 Aug 29 05:21:34.927968 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2879/5772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:34 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1508 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:35.936150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:35.936755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:35.944659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:35.945542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:35.946202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:35.947431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:35.948104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:35.948768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:36.135796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:36.147486 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-920c2f4b-062a-4a1b-8f97-bef55d86f103 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1508 microversion: 2.1 time: 0.216350 Aug 29 05:21:36.156251 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2894/5773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:35 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:37.168803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:37.169414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:37.183812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:37.184411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:37.185347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:37.186677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:37.189945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:37.190703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:37.415275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:37.426097 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8b88fc5a-9034-4a72-9226-af9c1b0fb6f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1508 microversion: 2.1 time: 0.261094 Aug 29 05:21:37.430693 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2880/5774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:37 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:38.450871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:38.451483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:38.469704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:38.470888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:38.471611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:38.472623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:38.473591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:38.474240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:38.652482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:38.661508 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b9dd5d98-7cef-45d8-adb5-8d3da0017428 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1508 microversion: 2.1 time: 0.214779 Aug 29 05:21:38.663285 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2895/5775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:38 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:39.685230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:39.686705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:39.697657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:39.698804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:39.699508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:39.700325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:39.700777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:39.701207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:39.876922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:39.886153 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ab5a8fb6-d7bf-4e1e-b16d-76137f720652 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1508 microversion: 2.1 time: 0.205001 Aug 29 05:21:39.887619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2881/5776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:39 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:40.907719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:40.908396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:40.915599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:40.916106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:40.916556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:40.917266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:40.917722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:40.918143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:41.052676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:41.061652 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4ce1093-29f4-4dab-b39e-9f0ff7d9f76c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1508 microversion: 2.1 time: 0.157927 Aug 29 05:21:41.062611 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2896/5777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:40 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:42.085265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:42.085990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:42.096037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:42.096757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:42.097343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:42.098405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:42.099067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:42.099831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:42.235051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:42.246682 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-45b2d8c6-8d6e-4dd5-b7c3-90fd27084461 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1505 microversion: 2.1 time: 0.167141 Aug 29 05:21:42.247484 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2882/5778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:42 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:43.268793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:43.269384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:43.276752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:43.277237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:43.277661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:43.278396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:43.279113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:43.279533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:43.426514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:43.434989 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-098d4cbf-666c-4650-9e8a-89fd5ca3988a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1505 microversion: 2.1 time: 0.170145 Aug 29 05:21:43.435584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2897/5779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:43 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:44.455939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:44.456795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:44.464851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:44.465633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:44.466940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:44.467862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:44.468380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:44.468834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:44.473640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:44.629941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:44.638387 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0dcf142-ed79-4338-bc62-365e6fb703f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 200 len: 1448 microversion: 2.1 time: 0.186374 Aug 29 05:21:44.639051 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2883/5780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:44 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:44.658552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:44.659169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:44.666300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:44.666771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:44.667405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:44.668103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:44.668793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:44.669216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:44.802903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:44.811052 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13ac5a05-c8cb-4485-8281-25a8fc18686f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.156268 Aug 29 05:21:44.811600 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2898/5781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:44 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:44.844347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:44.845253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:44.851348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:44.851830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:44.852292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:44.852978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:44.853434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:44.853851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:44.990590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:44.999149 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f5554d7e-4e6e-4475-8818-7870c4fd599a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.158805 Aug 29 05:21:44.999712 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2884/5782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:44 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:45.019569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:45.020215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:45.026594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:45.027089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:45.027528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:45.028261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:45.028715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:45.029136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:45.171958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:45.180157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea209e17-bd49-4218-9dc0-1ef3a27fc9f6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.164475 Aug 29 05:21:45.180753 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2899/5783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:45 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:45.200639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:45.201274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:45.207298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:45.207781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:45.208250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:45.208983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:45.209448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:45.209873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:45.343915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:45.352293 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6697d10b-2156-4805-9008-06d2de5231f7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.155748 Aug 29 05:21:45.353047 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2885/5784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:45 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:45.372891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-95dbc8b2-4263-4b26-830c-0e014c9f2a31 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:45.379315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95dbc8b2-4263-4b26-830c-0e014c9f2a31 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:45.380143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95dbc8b2-4263-4b26-830c-0e014c9f2a31 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:45.380688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-95dbc8b2-4263-4b26-830c-0e014c9f2a31 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:45.405793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-95dbc8b2-4263-4b26-830c-0e014c9f2a31 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Going to try to stop instance {{(pid=128872) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 05:21:45.458470 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-95dbc8b2-4263-4b26-830c-0e014c9f2a31 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.089222 Aug 29 05:21:45.459746 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2900/5785] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:21:45 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:21:45.469478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0d04cf91-1217-49d4-88d1-62d77900fe0c req-6f09b9a6-33e7-4936-a9dc-58a2f74c08e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae85e20f-a8e6-4dcb-96ca-4e299be5c57d", "name": "network-vif-unplugged", "status": "completed", "tag": "85479768-b4b0-4593-95b3-256a8907ba7a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:45.471122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:45.472309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:45.479969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:45.480768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:45.482149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:45.483136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:45.483774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:45.484338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0d04cf91-1217-49d4-88d1-62d77900fe0c req-6f09b9a6-33e7-4936-a9dc-58a2f74c08e7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:45.484854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:45.485007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0d04cf91-1217-49d4-88d1-62d77900fe0c req-6f09b9a6-33e7-4936-a9dc-58a2f74c08e7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:45.485554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0d04cf91-1217-49d4-88d1-62d77900fe0c req-6f09b9a6-33e7-4936-a9dc-58a2f74c08e7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:45.505638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.compute.server_external_events [req-0d04cf91-1217-49d4-88d1-62d77900fe0c req-6f09b9a6-33e7-4936-a9dc-58a2f74c08e7 service nova] Unable to find a host for instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d. Dropping event network-vif-unplugged {{(pid=128871) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 05:21:45.507168 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0d04cf91-1217-49d4-88d1-62d77900fe0c req-6f09b9a6-33e7-4936-a9dc-58a2f74c08e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054030 Aug 29 05:21:45.510304 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2886/5786] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 05:21:45.626824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:45.630664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:45.636100 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9af3b2ef-c56b-486f-937a-bc386bb0fbbb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.170868 Aug 29 05:21:45.636896 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2901/5787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:45 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:46.657807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:46.658411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:46.665993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:46.666495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:46.666933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:46.667650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:46.668105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:46.668557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:46.807729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:46.816061 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ebd6da6d-2615-48fc-80dc-be792729a39c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.162229 Aug 29 05:21:46.824288 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2887/5788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:46 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:47.838872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:47.839444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:47.842959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=56 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:47.849579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:47.850058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:47.850485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:47.851172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:47.851609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:47.852024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:47.983816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:47.992324 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cfdeda3e-f7a9-4d4e-9ae4-96851fa9fdec tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.157154 Aug 29 05:21:47.992895 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2902/5789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:47 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:49.015449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:49.016038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:49.023059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:49.023543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:49.023971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:49.024700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:49.025149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:49.025553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:49.156940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:49.165398 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f8a35c4-f121-43b2-8abd-62e316525f8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.154100 Aug 29 05:21:49.165963 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2888/5790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:49 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:50.187128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:50.187921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:50.195212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:50.195696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:50.196153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:50.196848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:50.197608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:50.198029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:50.335418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:50.343999 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-465c81c4-512f-4ac4-880d-4ea97a9c4875 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.160717 Aug 29 05:21:50.364541 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2903/5791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:50 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:51.371121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:51.371709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:51.374596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=49 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:21:51.379553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:51.380071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:51.380697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:51.381267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:51.381712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:51.382153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:51.521972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:51.530200 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a209c56d-2de9-4f10-9f97-3dcff1beba1c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.163151 Aug 29 05:21:51.530789 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2889/5792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:51 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:52.552913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:52.553492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:52.560946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:52.561585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:52.562035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:52.562724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:52.563232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:52.563656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:52.700233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:52.708210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-46e32ef1-56e1-4e10-8c2b-34b8fa850c8b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.159566 Aug 29 05:21:52.708817 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2904/5793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:52 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:52.752258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8ddda34-c05a-4861-94a6-beef2b2e7ed1 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:52.753498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8ddda34-c05a-4861-94a6-beef2b2e7ed1 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:52.761618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8ddda34-c05a-4861-94a6-beef2b2e7ed1 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:52.762104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8ddda34-c05a-4861-94a6-beef2b2e7ed1 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:52.762609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8ddda34-c05a-4861-94a6-beef2b2e7ed1 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:52.763392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8ddda34-c05a-4861-94a6-beef2b2e7ed1 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:52.763884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8ddda34-c05a-4861-94a6-beef2b2e7ed1 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:52.764456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8ddda34-c05a-4861-94a6-beef2b2e7ed1 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:52.916713 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8ddda34-c05a-4861-94a6-beef2b2e7ed1 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1834 microversion: 2.1 time: 0.168345 Aug 29 05:21:52.917415 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2890/5794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:52 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1834 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:53.738838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:53.742120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:53.754084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:53.754590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:53.755065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:53.755777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:53.756217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:53.756635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:54.171962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:54.174415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:54.184205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:54.185634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:54.186447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:54.187539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:54.189304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:54.190212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:54.195106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:54.203869 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-15dd0adc-6b66-45a1-8d19-c6aaef68a96a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.477757 Aug 29 05:21:54.204792 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2905/5795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:53 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:54.209527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-dfcae327-43b7-4a59-923f-4d64aec2b82a req-e8e65a59-26d0-49ac-be62-2463d30e3d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:54.218833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dfcae327-43b7-4a59-923f-4d64aec2b82a req-e8e65a59-26d0-49ac-be62-2463d30e3d9b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:54.219476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dfcae327-43b7-4a59-923f-4d64aec2b82a req-e8e65a59-26d0-49ac-be62-2463d30e3d9b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:54.219917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dfcae327-43b7-4a59-923f-4d64aec2b82a req-e8e65a59-26d0-49ac-be62-2463d30e3d9b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:54.226267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:21:54.231695 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-dfcae327-43b7-4a59-923f-4d64aec2b82a req-e8e65a59-26d0-49ac-be62-2463d30e3d9b service nova] Creating event network-changed:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h1-854119-9 Aug 29 05:21:54.237034 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-dfcae327-43b7-4a59-923f-4d64aec2b82a req-e8e65a59-26d0-49ac-be62-2463d30e3d9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031049 Aug 29 05:21:54.240870 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2906/5796] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:54.319831 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-04a22fe0-b49e-4e75-9d0a-cdc7c39bb356 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 204 len: 0 microversion: 2.1 time: 0.152372 Aug 29 05:21:54.320472 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2891/5797] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:21:54 2022] DELETE /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:21:54.330224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:54.330943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:54.338015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:54.338659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:54.339202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:54.340036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:54.340635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:54.341451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:54.488844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:54.498408 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7ebedf52-3eb6-4162-aef7-dbeb1cb56fad tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1689 microversion: 2.1 time: 0.172665 Aug 29 05:21:54.499418 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2907/5798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:54 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:21:55.229333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:55.230032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:55.237463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:55.237966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:55.238402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:55.239222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:55.239762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:55.240263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:55.377373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:55.385789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-163ec475-e795-45d0-afb7-a8dd2fd00d40 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.160750 Aug 29 05:21:55.386369 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2892/5799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:55 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:55.523602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:55.524865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:55.533951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:55.535442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:55.536139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:55.537398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:55.537960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:55.538484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:55.723903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:55.733469 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf58ffce-cca5-43c1-a6ee-f3831254004f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1689 microversion: 2.1 time: 0.213988 Aug 29 05:21:55.734462 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2908/5800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:55 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:56.414951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:56.418691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:56.432218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:56.433594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:56.433695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:56.434439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:56.435381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:56.435381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:56.715950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:56.724730 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e81e65b5-63fa-4e16-92f6-d584e4ffa95b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.320578 Aug 29 05:21:56.735241 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2893/5801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:56 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:56.755604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:56.756972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:56.764833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:56.765436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:56.765974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:56.766741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:56.767245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:56.767899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:57.011514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ad311dd2-82d2-4cf9-9f47-e03cc5b28895 req-134b39c1-cc28-4e41-bd73-dbb72a548429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4b7f4e-9161-4a8b-afa2-873b1cc99716", "name": "network-vif-deleted", "tag": "fce6bb85-c304-49c2-a8a1-159c87098898"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:57.030566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ad311dd2-82d2-4cf9-9f47-e03cc5b28895 req-134b39c1-cc28-4e41-bd73-dbb72a548429 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:57.030786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ad311dd2-82d2-4cf9-9f47-e03cc5b28895 req-134b39c1-cc28-4e41-bd73-dbb72a548429 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:57.032056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ad311dd2-82d2-4cf9-9f47-e03cc5b28895 req-134b39c1-cc28-4e41-bd73-dbb72a548429 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:57.039980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:57.049185 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ad311dd2-82d2-4cf9-9f47-e03cc5b28895 req-134b39c1-cc28-4e41-bd73-dbb72a548429 service nova] Creating event network-vif-deleted:fce6bb85-c304-49c2-a8a1-159c87098898 for instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 on n-h1-854119-9 Aug 29 05:21:57.049761 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8357bcfc-c78f-40c9-a85b-5259fc1db529 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 200 len: 1571 microversion: 2.1 time: 0.298008 Aug 29 05:21:57.050356 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2909/5802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:56 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 1571 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:57.062074 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ad311dd2-82d2-4cf9-9f47-e03cc5b28895 req-134b39c1-cc28-4e41-bd73-dbb72a548429 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054567 Aug 29 05:21:57.062723 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2894/5803] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:21:57.746997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:57.747710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:57.754742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:57.755356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:57.755843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:57.756598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:57.757049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:57.757501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:57.910491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:57.932348 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69a5a956-b8ac-4d33-89da-0402db044846 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.189621 Aug 29 05:21:57.939587 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2910/5804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:57 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:58.078439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:58.079700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: cd4b7f4e-9161-4a8b-afa2-873b1cc99716] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:58.097129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:58.097616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:58.098251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:58.098984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:58.099600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:58.100022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:58.116796 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] HTTP exception thrown: Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 could not be found. Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Request method failure captured: Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 HTTP/1.1 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEsXp8EfnvUqPmqsIzL4luSArQxeepnzAbWptfIG1OpEe8LS77ZppQzW8i3IW3VRqRq0TXI0NHqdByu2osRldV9U4AXBKV1QE-ARj2EAJgT8Qh_eOA9gF95LKAhkL1je_M0xm4pD9D4xIQk90moSvRJJWOWxOEg7BDrFFCWPYYNj2d8 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e5306aaa62bb4e1f9b407bce73b397f0 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5306aaa62bb4e1f9b407bce73b397f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e5306aaa62bb4e1f9b407bce73b397f0 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestNetworkAdvancedServerOps-1974793548-project Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6bcb6393cb0a4e6a857d0d5e960eba01 Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1974793548-project Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 could not be found. Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'cd4b7f4e-9161-4a8b-afa2-873b1cc99716'} Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 could not be found. Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 could not be found. Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:21:58.119897 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 could not be found. Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Returning 404 to user: Instance cd4b7f4e-9161-4a8b-afa2-873b1cc99716 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:21:58.126116 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03da01ed-728a-491b-831b-a6c1f9fae3f8 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716" status: 404 len: 111 microversion: 2.1 time: 0.048615 Aug 29 05:21:58.132645 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2895/5805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:58 2022] GET /compute/v2.1/servers/cd4b7f4e-9161-4a8b-afa2-873b1cc99716 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:21:58.961945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:21:58.962566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:21:58.970230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:58.970964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:58.971567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:58.972492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:21:58.972949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:21:58.973650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:21:59.233872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:21:59.242297 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b6c52065-7e25-4594-a0ce-3b78aa59be75 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.284160 Aug 29 05:21:59.242892 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2911/5806] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:21:58 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:21:59.309920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-31feb0a6-a28b-4379-a633-97d3af11df30 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Action: 'create', calling method: .version_select at 0x7f1ab95d4e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1427591114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGn3A0MU6hxypo8+PH2aEJPcShrVlnpN0X9YwESjLaVmct1gLD4Esgr+Hj87ZG9qML5q3ZO1Vc4dYFPbLnB2c/9OS7zTh0BRf134Rd79w7BQwBrG9XGS1bQRPRsquyWkQ=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:21:59.339277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-31feb0a6-a28b-4379-a633-97d3af11df30 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for project 8538671f353b4984b7b18ee629e43b3d. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:21:59.345998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-31feb0a6-a28b-4379-a633-97d3af11df30 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for user b5b779089f7f42399c57a9771787f911 and project 8538671f353b4984b7b18ee629e43b3d. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:21:59.394389 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-31feb0a6-a28b-4379-a633-97d3af11df30 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.088488 Aug 29 05:21:59.395293 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2896/5807] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:21:59 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:00.264646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:00.265470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:00.292634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:00.294722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:00.295294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:00.296953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:00.298397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:00.300987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:00.548730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:00.560163 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-54d335a7-7e73-432f-bbbc-278873cf12f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1681 microversion: 2.1 time: 0.300193 Aug 29 05:22:00.560777 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2912/5808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:00 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1681 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:01.433929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-705386075", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "f754512c-b8ef-44ee-86a7-82c9de36e67c"}], "key_name": "tempest-TestNetworkBasicOps-1427591114", "security_groups": [{"name": "tempest-secgroup-smoke-1699730696"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:01.583380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:01.585114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:01.595888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:01.596829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:01.597452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:01.598888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:01.599801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:01.600481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:01.665009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] validate_networks() for [('f754512c-b8ef-44ee-86a7-82c9de36e67c', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:22:01.963105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:01.972991 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b7323603-e19a-49be-96ff-26fd573e7ed0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1658 microversion: 2.1 time: 0.395585 Aug 29 05:22:01.974254 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2913/5809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:01 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1658 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:01.999465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-093b02df-accb-483f-908f-78d5c332d69f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:02.009368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-093b02df-accb-483f-908f-78d5c332d69f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:02.010194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-093b02df-accb-483f-908f-78d5c332d69f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:02.010793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-093b02df-accb-483f-908f-78d5c332d69f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:02.059347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-093b02df-accb-483f-908f-78d5c332d69f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Going to try to start instance {{(pid=128872) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 05:22:02.135321 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-093b02df-accb-483f-908f-78d5c332d69f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.141590 Aug 29 05:22:02.140199 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2914/5810] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:22:01 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:22:02.148070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:02.150725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:02.159161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:02.159899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:02.160715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:02.161742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:02.162389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:02.162977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:02.861866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:02.888903 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a94d77a-ebf9-48e2-8514-3b202185994b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1667 microversion: 2.1 time: 0.740489 Aug 29 05:22:02.889781 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2915/5811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:02 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1667 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:03.057725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7333901-44e9-48f5-a53e-7b27a5cb99b5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '.version_select at 0x7f1ab3fb4f70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:03.087047 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7333901-44e9-48f5-a53e-7b27a5cb99b5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1669575311" status: 202 len: 0 microversion: 2.1 time: 0.034278 Aug 29 05:22:03.096189 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2916/5812] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Aug 29 05:22:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1669575311 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:22:03.136167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9c361693-d794-43ac-b959-080dfa1ee904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'create', calling method: .version_select at 0x7f1ab3f67280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-112248482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOWZxardCB8jGvb9dWg+2WVEtvcynD57dQYRDjG5oFKXZsMyo7hyrzkoAn4guF7Y6qKhoCbCqPxD2gLWlTSN0WCo5xBbtRKd3IsvChfOR+bRwXFjshSno7pL5a9CYQF0A=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:03.174891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9c361693-d794-43ac-b959-080dfa1ee904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:22:03.187823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9c361693-d794-43ac-b959-080dfa1ee904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for user 6bcb6393cb0a4e6a857d0d5e960eba01 and project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:22:03.226413 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9c361693-d794-43ac-b959-080dfa1ee904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.101648 Aug 29 05:22:03.233422 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2917/5813] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:22:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:03.304669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:22:03.305704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:22:03.306361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:22:03.306969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:22:03.308401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:22:03.323708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:03.324483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:03.325078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:03.326002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:03.326750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:03.327348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:03.347889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for project 8538671f353b4984b7b18ee629e43b3d. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:22:03.354997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for user b5b779089f7f42399c57a9771787f911 and project 8538671f353b4984b7b18ee629e43b3d. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:22:03.372336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:22:03.374994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:22:03.459041 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0af2b13-62b7-44b6-be67-ab08ace3298e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.030535 Aug 29 05:22:03.459726 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2897/5814] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:22:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:22:03.473956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4600af84-1a37-42c0-9155-dc2ce9ce912f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:03.474575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4600af84-1a37-42c0-9155-dc2ce9ce912f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:03.642268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4600af84-1a37-42c0-9155-dc2ce9ce912f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:03.651000 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4600af84-1a37-42c0-9155-dc2ce9ce912f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1248 microversion: 2.1 time: 0.180861 Aug 29 05:22:03.669144 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2918/5815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:03 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1248 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:03.910784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:03.911766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:03.918410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:03.919204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:03.920020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:03.920972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:03.921934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:03.922573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:04.104371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:04.116499 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-00f12543-ee49-4e74-b17f-4002443ab3dc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1667 microversion: 2.1 time: 0.209786 Aug 29 05:22:04.117928 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2898/5816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:03 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1667 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:04.679742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:04.681529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:05.022480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.022992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.023443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.024195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.024657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.025094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.098220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:05.106951 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1273cf34-701d-4056-96ee-82d38603081e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1300 microversion: 2.1 time: 0.433636 Aug 29 05:22:05.107549 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2919/5817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:04 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1300 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:05.138575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:05.140156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:05.147954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.148590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.149137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.149931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.150560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.151168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.298840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:05.307416 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-35bd846a-2f0a-4967-b1c7-c66739e3749c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.172869 Aug 29 05:22:05.321043 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2899/5818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:05 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:05.330334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:05.332826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:05.343650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.348805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.349494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.355710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.356446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.357046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.589342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-38e5a340-f296-478e-8704-e88d0c69e8f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:05.590561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-38e5a340-f296-478e-8704-e88d0c69e8f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:05.599131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38e5a340-f296-478e-8704-e88d0c69e8f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.600423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38e5a340-f296-478e-8704-e88d0c69e8f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.601071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38e5a340-f296-478e-8704-e88d0c69e8f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.602427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38e5a340-f296-478e-8704-e88d0c69e8f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.603148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38e5a340-f296-478e-8704-e88d0c69e8f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.604427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-38e5a340-f296-478e-8704-e88d0c69e8f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.619728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:05.627764 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cee49fb2-c7a2-463b-9b73-731e53800403 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.301901 Aug 29 05:22:05.628375 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2920/5819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:05 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:05.634888 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-38e5a340-f296-478e-8704-e88d0c69e8f9 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/ips" status: 200 len: 149 microversion: 2.1 time: 0.051132 Aug 29 05:22:05.636104 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2900/5820] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:22:05 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:05.649550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:05.650151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:05.660158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.660691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.661157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.664365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.664849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.665282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.674138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:05.923681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:05.932316 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13d35eec-1877-4ef7-ade1-b1f784141881 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.286759 Aug 29 05:22:05.932917 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2921/5821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:05 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:05.966681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:05.968854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:05.983197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.988879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.989535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:05.991412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:05.994618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:05.995197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:06.130250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:06.131147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:06.139750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:06.153369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:06.153369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:06.153369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:06.153369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:06.153369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:06.298679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:06.307706 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c1e0d2b-a288-4225-8df8-a88789efff13 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1306 microversion: 2.1 time: 0.182982 Aug 29 05:22:06.321039 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2922/5822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:06 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:06.348111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:06.361990 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-88a2980f-55ec-47f1-a971-b0a35c629b20 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.408480 Aug 29 05:22:06.362850 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2901/5823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:05 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:06.390621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:06.393974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:06.409507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:06.410164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:06.411893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:06.412701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:06.413173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:06.413601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:06.617827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:06.625955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7f9a001-66ca-41b7-9a4b-d98eb71f850d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.246060 Aug 29 05:22:06.627120 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2923/5824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:06 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:06.646838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:06.647651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:06.654429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:06.655134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:06.655746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:06.656638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:06.657247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:06.657858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:06.663018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:06.685662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lazy-loading 'flavor' on Instance uuid 5e7d9e6b-96d5-4f68-b699-77e111d26429 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:22:06.789421 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7400bfc9-5eb8-46c4-90e4-c0767b90bc15 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.146287 Aug 29 05:22:06.801144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:06.802160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:06.809096 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2902/5825] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:22:06 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:22:06.813409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:06.814159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:06.814869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:06.816578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:06.817634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:06.818371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:07.075389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:07.108157 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-31452d68-db5d-4aca-a672-d25407bb438d tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1679 microversion: 2.1 time: 0.308959 Aug 29 05:22:07.109063 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2924/5826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:06 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1679 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:07.331504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:07.332269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:07.339915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:07.340792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:07.341289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:07.342228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:07.342897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:07.352852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:07.666046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:07.680300 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f112fa2a-b347-4777-97cb-11e3e2ed7179 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1374 microversion: 2.1 time: 0.352975 Aug 29 05:22:07.681197 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2903/5827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:07 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1374 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:07.879591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-710cdf5d-bffa-422f-b593-58c40b6c5fee req-f9a5839b-c909-4aa4-a73a-1b02564e2a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd58089-460d-48c9-80aa-f3979261f31b", "tag": "51d8b560-1b67-47b8-b8da-4a564a55d974"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:07.917888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-710cdf5d-bffa-422f-b593-58c40b6c5fee req-f9a5839b-c909-4aa4-a73a-1b02564e2a7b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:07.918372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-710cdf5d-bffa-422f-b593-58c40b6c5fee req-f9a5839b-c909-4aa4-a73a-1b02564e2a7b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:07.918815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-710cdf5d-bffa-422f-b593-58c40b6c5fee req-f9a5839b-c909-4aa4-a73a-1b02564e2a7b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:07.939649 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-710cdf5d-bffa-422f-b593-58c40b6c5fee req-f9a5839b-c909-4aa4-a73a-1b02564e2a7b service nova] Creating event network-changed:51d8b560-1b67-47b8-b8da-4a564a55d974 for instance 8cd58089-460d-48c9-80aa-f3979261f31b on n-h1-854119-9 Aug 29 05:22:07.953246 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-710cdf5d-bffa-422f-b593-58c40b6c5fee req-f9a5839b-c909-4aa4-a73a-1b02564e2a7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075629 Aug 29 05:22:07.955635 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2925/5828] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:08.133462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:08.135775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:08.148566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.150505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.156739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:08.158048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.161411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.162089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:08.331551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02126d38-1491-4eef-970a-46247c7c3e99 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4244d9c4-e06f-4d5a-aab5-439b9f30a477"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:08.334316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-02126d38-1491-4eef-970a-46247c7c3e99 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:08.346969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02126d38-1491-4eef-970a-46247c7c3e99 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.349888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02126d38-1491-4eef-970a-46247c7c3e99 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.354166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02126d38-1491-4eef-970a-46247c7c3e99 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:08.355809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02126d38-1491-4eef-970a-46247c7c3e99 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.356515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02126d38-1491-4eef-970a-46247c7c3e99 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.357887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02126d38-1491-4eef-970a-46247c7c3e99 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:08.473975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:08.485151 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4ad7aabf-08db-439f-b564-99693d1032f1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1662 microversion: 2.1 time: 0.358719 Aug 29 05:22:08.486941 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2904/5829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:08 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1662 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:08.511833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a4c860f0-b239-48d9-9537-83b2879f3c0f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:08.513870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a4c860f0-b239-48d9-9537-83b2879f3c0f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:08.528770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c860f0-b239-48d9-9537-83b2879f3c0f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.529559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c860f0-b239-48d9-9537-83b2879f3c0f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.530183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c860f0-b239-48d9-9537-83b2879f3c0f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:08.531092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c860f0-b239-48d9-9537-83b2879f3c0f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.531731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c860f0-b239-48d9-9537-83b2879f3c0f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.532390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c860f0-b239-48d9-9537-83b2879f3c0f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:08.651387 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a4c860f0-b239-48d9-9537-83b2879f3c0f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action" status: 202 len: 0 microversion: 2.1 time: 0.144223 Aug 29 05:22:08.655461 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2905/5830] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:22:08 2022] POST /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:22:08.660988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:08.661929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:08.669422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.670162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.670751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:08.671634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.672315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.672896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:08.841444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:08.856587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83a75044-fee5-4238-9a7f-c9afafecdb8c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1668 microversion: 2.1 time: 0.199723 Aug 29 05:22:08.857555 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2906/5831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:08 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1668 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:08.865765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:08.866750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:08.874884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.875617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.876263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:08.878094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:08.878761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:08.879493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:09.045917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:09.054446 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0c1ffa73-91bd-4050-945f-54aa77f607f5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1374 microversion: 2.1 time: 0.193155 Aug 29 05:22:09.055271 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2907/5832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:08 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:09.880838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:09.883408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:09.891814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:09.892609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:09.893238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:09.894129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:09.894747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:09.895330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:10.111540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:10.120086 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fd1d6bf3-9cea-4ab6-9d61-9f8e15c06e73 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1668 microversion: 2.1 time: 0.245321 Aug 29 05:22:10.133706 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2908/5833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:09 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1668 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:10.138910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:10.144865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:10.151530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:10.156310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:10.156986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:10.157919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:10.158545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:10.159137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:10.381253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:10.389130 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c36f2efa-c7f8-49d7-99f3-fef219f1563d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1374 microversion: 2.1 time: 0.254027 Aug 29 05:22:10.390045 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2909/5834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:10 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1374 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:10.887315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1885590945", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "510bcb27-29bf-40cb-a943-b9951a1f1e55"}], "key_name": "tempest-TestNetworkAdvancedServerOps-112248482", "security_groups": [{"name": "tempest-secgroup-smoke-1059652558"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:11.010803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] validate_networks() for [('510bcb27-29bf-40cb-a943-b9951a1f1e55', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:22:11.596590 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-02126d38-1491-4eef-970a-46247c7c3e99 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.266824 Aug 29 05:22:11.600603 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2926/5835] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:22:08 2022] POST /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments => generated 194 bytes in 3274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:11.620672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:11.621682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:11.639450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:11.642243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:11.644804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:11.646917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:11.647578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:11.648638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:11.955153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:22:11.955639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:22:11.956159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:22:11.956644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:22:11.957123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:22:11.982693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:11.984776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:11.985290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:11.986114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:11.990595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:11.993483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:12.056472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:22:12.070925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for user 6bcb6393cb0a4e6a857d0d5e960eba01 and project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:22:12.139114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:22:12.142001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:22:12.221778 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-621e625b-9f0c-463c-b723-471f15072f48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.338237 Aug 29 05:22:12.223016 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2910/5836] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:22:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:22:12.228112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:12.229077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:12.236001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:12.236838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:12.237772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:12.242958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:12.243680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:12.244349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:12.247126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:12.285721 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fbae5255-bcec-44dd-9f58-6a385b603299 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1668 microversion: 2.1 time: 0.682863 Aug 29 05:22:12.291633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2927/5837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:11 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1668 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:12.298867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-299eb11b-7f23-464a-826e-a1b2b4665d79 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:12.299805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-299eb11b-7f23-464a-826e-a1b2b4665d79 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:12.510358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-299eb11b-7f23-464a-826e-a1b2b4665d79 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:12.518948 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-299eb11b-7f23-464a-826e-a1b2b4665d79 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1266 microversion: 2.1 time: 0.224828 Aug 29 05:22:12.519150 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2928/5838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:12 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:13.156725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:13.183729 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fd8bdf51-9576-40cc-8927-2ddb015e8a73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1374 microversion: 2.1 time: 0.959282 Aug 29 05:22:13.184380 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2911/5839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:12 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1374 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:13.314270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:13.315287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:13.327815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:13.328350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:13.328795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:13.329509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:13.329965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:13.330388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:13.539667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:13.540311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:13.547518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:13.551115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:13.552708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:13.553616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:13.555006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:13.556410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:13.716187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:13.727706 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b5124b3-f128-49a5-8df2-73b9ffc78c1c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1318 microversion: 2.1 time: 0.191972 Aug 29 05:22:13.728229 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2912/5840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:13 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:13.962517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:13.971966 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3206382f-6c21-4eb6-8177-c786f9d7c729 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1668 microversion: 2.1 time: 0.661485 Aug 29 05:22:13.973162 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2929/5841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:13 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1668 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:14.207078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:14.207695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:14.215486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:14.216491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:14.217095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:14.217986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:14.218760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:14.219366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:14.452150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:14.473088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6fd7522-b128-4bff-9672-70c15aacab57 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1374 microversion: 2.1 time: 0.268915 Aug 29 05:22:14.474050 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2913/5842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:14 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1374 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:14.760295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:14.761233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:14.777716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:14.779808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:14.786518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:14.787607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:14.788375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:14.789045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:14.990283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:14.997967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:14.999147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:15.001669 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-533ed46f-0295-489d-aa51-cff6f6a74a99 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1324 microversion: 2.1 time: 0.250395 Aug 29 05:22:15.014434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:15.015273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:15.016268 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2930/5843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:14 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1324 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:15.016718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:15.021422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:15.022043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:15.022582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:15.494854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:15.495471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:15.502583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:15.503074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:15.503509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:15.513174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:15.513672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:15.514114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:15.639191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:15.650664 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fdda572a-1270-449e-8cc6-f7630d8efe90 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1668 microversion: 2.1 time: 0.656935 Aug 29 05:22:15.652611 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2914/5844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:14 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1668 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:15.880813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:15.889961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9d0f0571-ae83-42f8-9891-582be370c15a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1374 microversion: 2.1 time: 0.398959 Aug 29 05:22:15.903571 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2931/5845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:15 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1374 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:16.023832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:16.024658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:16.027253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:16.042101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:16.042842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:16.050643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:16.051948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:16.052597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:16.053217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:16.362863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:16.380973 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff7072f4-620d-4812-92a9-1325f13d8904 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.361829 Aug 29 05:22:16.386085 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2915/5846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:16 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:16.537691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-629255f5-4f7a-427d-bcdb-19747707f427 req-b6fe5993-749a-4cc0-934a-7e1d865447b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd58089-460d-48c9-80aa-f3979261f31b", "name": "network-vif-plugged", "status": "completed", "tag": "51d8b560-1b67-47b8-b8da-4a564a55d974"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:16.559113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-629255f5-4f7a-427d-bcdb-19747707f427 req-b6fe5993-749a-4cc0-934a-7e1d865447b3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:16.561765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-629255f5-4f7a-427d-bcdb-19747707f427 req-b6fe5993-749a-4cc0-934a-7e1d865447b3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:16.563834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-629255f5-4f7a-427d-bcdb-19747707f427 req-b6fe5993-749a-4cc0-934a-7e1d865447b3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:16.591178 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-629255f5-4f7a-427d-bcdb-19747707f427 req-b6fe5993-749a-4cc0-934a-7e1d865447b3 service nova] Creating event network-vif-plugged:51d8b560-1b67-47b8-b8da-4a564a55d974 for instance 8cd58089-460d-48c9-80aa-f3979261f31b on n-h1-854119-9 Aug 29 05:22:16.597741 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-629255f5-4f7a-427d-bcdb-19747707f427 req-b6fe5993-749a-4cc0-934a-7e1d865447b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066578 Aug 29 05:22:16.599135 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2932/5847] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:16.674005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:16.682003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:16.693136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:16.693637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:16.694089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:16.694796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:16.697399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:16.698017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:16.922058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:16.922848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:16.929753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:16.930385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:16.931027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:16.931969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:16.932671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:16.933192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:16.976985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:16.980098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:16.988482 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-02ea30ae-2aa3-4a7c-ba1c-d262a941c952 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.318541 Aug 29 05:22:16.989699 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2916/5848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:16 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:17.009666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:17.010819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:17.036871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:17.039541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:17.040177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:17.049700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:17.050405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:17.051016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:17.238006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:17.248584 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de274574-2c6a-4479-8024-df8862fd3ba0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1374 microversion: 2.1 time: 0.331429 Aug 29 05:22:17.249821 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2933/5849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:16 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1374 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:17.356748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:17.370173 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e19d9ec-765e-4c9d-8f5d-a9ef0f4cd42f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1671 microversion: 2.1 time: 0.362602 Aug 29 05:22:17.371377 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2917/5850] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:17 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1671 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:17.396424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:17.400280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:17.407865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:17.408396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:17.409363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:17.410153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:17.410613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:17.411885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:17.413204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:17.414022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:17.427272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:17.428078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:17.428704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:17.431549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:17.432323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:17.433070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:17.469746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:22:17.501214 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.compute.api [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Working on deleting snapshot e926c4b3-c475-431f-bbec-69771e46e2b4 from shelved instance... Aug 29 05:22:17.640803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:17.652773 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-66e18fd9-319a-4bda-bfba-a2bb5a93e60f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.249910 Aug 29 05:22:17.653757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2918/5851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:17 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:17.677180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1fb9bb5d-9af6-4951-a2cb-2e9655bd84ca req-dcfd0968-367b-4bd2-836f-5bab45bcd3bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9", "tag": "acf10729-be07-494e-bce8-ba9aea0c9a63"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:17.687320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1fb9bb5d-9af6-4951-a2cb-2e9655bd84ca req-dcfd0968-367b-4bd2-836f-5bab45bcd3bf service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:17.687805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1fb9bb5d-9af6-4951-a2cb-2e9655bd84ca req-dcfd0968-367b-4bd2-836f-5bab45bcd3bf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:17.688277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1fb9bb5d-9af6-4951-a2cb-2e9655bd84ca req-dcfd0968-367b-4bd2-836f-5bab45bcd3bf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:17.708820 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1fb9bb5d-9af6-4951-a2cb-2e9655bd84ca req-dcfd0968-367b-4bd2-836f-5bab45bcd3bf service nova] Creating event network-changed:acf10729-be07-494e-bce8-ba9aea0c9a63 for instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 on n-h1-854119-9 Aug 29 05:22:17.718035 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1fb9bb5d-9af6-4951-a2cb-2e9655bd84ca req-dcfd0968-367b-4bd2-836f-5bab45bcd3bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045604 Aug 29 05:22:17.718662 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2919/5852] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:18.206790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:18.220633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Doing local delete in cell a8d62b60-367a-461c-bbae-c4c805cb73c3(cell1) {{(pid=128872) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 05:22:18.222606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:18.223555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:18.224474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:18.228562 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.compute.api [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 05:22:18.236623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] deallocate_for_instance() {{(pid=128872) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 29 05:22:18.270777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:18.271469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:18.278480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:18.279171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:18.279752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:18.280835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:18.281446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:18.282152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:18.632527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:18.643381 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4bc320cf-aa9d-4c7a-9a97-4bb77ec2fb2b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1374 microversion: 2.1 time: 0.376565 Aug 29 05:22:18.652997 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2920/5853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:18 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1374 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:18.675593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:18.676603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:18.684530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:18.685988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:18.686427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:18.687132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:18.687740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:18.688519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.036440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:19.049420 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68632569-d4b9-4862-9b47-b712d30691a4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.378682 Aug 29 05:22:19.050846 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2921/5854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:18 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:19.371793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Updating instance_info_cache with network_info: [] {{(pid=128872) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 29 05:22:19.526557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:19.586506 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef303e2b-e239-4dfc-b36f-505ebdf6576c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 204 len: 0 microversion: 2.1 time: 2.195602 Aug 29 05:22:19.587100 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2934/5855] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:22:17 2022] DELETE /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 0 bytes in 2197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:22:19.595162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:19.595778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: ae85e20f-a8e6-4dcb-96ca-4e299be5c57d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:19.602734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.603220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.603657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.604399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.604857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.605285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.619664 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] HTTP exception thrown: Instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d could not be found. Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Request method failure captured: Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d HTTP/1.1 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpt711V-DkfxL3VEZgCWvjNAVYnvAajXI7V7o8qGH-z4dbsjGc7C8bNufcEhDFxri8E0Df4oEkwcFcVXiSGb12eNEBLTEd5ZIZkX5j2ntm_tFVlI6nnJf1YFVrEI93hrwEM28xw-aPdZZ8tXK1u-geCSUVNtPvQPBPt_bA_IAffD9I Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164260d628ac492481d9d3524036abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164260d628ac492481d9d3524036abf8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6fb88aef408746868abb4053768c18c4 Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d could not be found. Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ae85e20f-a8e6-4dcb-96ca-4e299be5c57d'} Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d could not be found. Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d could not be found. Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:19.621397 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d could not be found. Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Returning 404 to user: Instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-63aaa969-7d16-4c09-a57f-d65e48ddb3fb tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d" status: 404 len: 111 microversion: 2.1 time: 0.031628 Aug 29 05:22:19.625910 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2922/5856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:19 2022] GET /compute/v2.1/servers/ae85e20f-a8e6-4dcb-96ca-4e299be5c57d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:22:19.631939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:19.632459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:19.638874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.639367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.639809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.640549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.641008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.641463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.667137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:19.668437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:19.672160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:22:19.675912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.676456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.676893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.677907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.678505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.679084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.762492 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-94bc2bcf-8ead-4285-9c28-56d3abba6bd3 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 204 len: 0 microversion: 2.1 time: 0.134334 Aug 29 05:22:19.763185 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2935/5857] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:22:19 2022] DELETE /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:22:19.775092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:19.775861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:19.783433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.784101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.784538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.785257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.785836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.786312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.823765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:19.831889 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c842e342-f6bb-4110-8b50-4d18835f5735 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1545 microversion: 2.1 time: 0.170268 Aug 29 05:22:19.832504 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2923/5858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:19 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1545 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:19.839914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d8c71b04-d519-4002-afcc-348f29246440 req-18d66391-8b7c-4d2b-b12c-f42a66020166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae85e20f-a8e6-4dcb-96ca-4e299be5c57d", "name": "network-vif-deleted", "tag": "85479768-b4b0-4593-95b3-256a8907ba7a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:19.854828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d8c71b04-d519-4002-afcc-348f29246440 req-18d66391-8b7c-4d2b-b12c-f42a66020166 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.855850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d8c71b04-d519-4002-afcc-348f29246440 req-18d66391-8b7c-4d2b-b12c-f42a66020166 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.856410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d8c71b04-d519-4002-afcc-348f29246440 req-18d66391-8b7c-4d2b-b12c-f42a66020166 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.870531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.compute.server_external_events [req-d8c71b04-d519-4002-afcc-348f29246440 req-18d66391-8b7c-4d2b-b12c-f42a66020166 service nova] Unable to find a host for instance ae85e20f-a8e6-4dcb-96ca-4e299be5c57d. Dropping event network-vif-deleted {{(pid=128871) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 05:22:19.872228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d8c71b04-d519-4002-afcc-348f29246440 req-18d66391-8b7c-4d2b-b12c-f42a66020166 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.035481 Aug 29 05:22:19.873125 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2924/5859] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 05:22:19.878525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:19.879948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:19.885938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.886419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.887030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.887724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:19.888503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:19.889080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:19.899050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:19.907662 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9973e135-fdc0-44c8-b405-71b9968fa0fd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1466 microversion: 2.1 time: 0.138161 Aug 29 05:22:19.912901 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2936/5860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:19 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:20.036681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:20.045463 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-240525b8-300d-438b-b098-0e4233bab300 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1545 microversion: 2.1 time: 0.170958 Aug 29 05:22:20.045704 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2925/5861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:19 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1545 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:20.070977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:20.072065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:20.079307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:20.079794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:20.080272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:20.080965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:20.081417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:20.081882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:20.234120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:20.242292 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e90877d7-7454-468f-82f1-3c6a1e86c901 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.175240 Aug 29 05:22:20.242886 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2937/5862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:20 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:20.929267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:20.929887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:20.936880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:20.937371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:20.937813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:20.938610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:20.939069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:20.939494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:21.045041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:21.054240 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be25375b-8d5b-4483-a5a1-bb5a93d6f58c tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1466 microversion: 2.1 time: 0.128921 Aug 29 05:22:21.055080 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2926/5863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:20 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1466 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:21.263183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:21.263821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:21.270967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:21.271474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:21.271906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:21.272626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:21.273053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:21.273468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:21.405545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:21.413864 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f2d5c52c-afa4-47bd-8ff1-271ec2bfc43b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.154651 Aug 29 05:22:21.414471 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2938/5864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:21 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:22.075322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:22.076007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:22.080163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:22.085444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:22.085940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:22.086496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:22.087233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:22.087694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:22.088151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:22.106696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=16 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:22.303779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:22.313235 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b5b094eb-acc2-4b6c-97d8-7444ae382dfd tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1466 microversion: 2.1 time: 0.242138 Aug 29 05:22:22.313833 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2927/5865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:22 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1466 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:22.434799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:22.435427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:22.443163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:22.443795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:22.444244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:22.445919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:22.446602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:22.447329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:22.519742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:22.679027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:22.686788 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4057f513-f64d-454e-8126-56a0937dee63 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.256576 Aug 29 05:22:22.687367 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2939/5866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:22 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:23.334504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:23.335721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:23.346262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:23.346998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:23.347758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:23.348427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:23.348963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:23.349201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:23.484329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:23.492400 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bff6e0f2-8b03-4896-b19b-3f019d710b05 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1466 microversion: 2.1 time: 0.161833 Aug 29 05:22:23.493094 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2928/5867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:23 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:23.710158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:23.711456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:23.718625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:23.719484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:23.721065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:23.722046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:23.722787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:23.723425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:24.075523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:24.083858 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6821db5d-fc74-47d2-811e-023bf75c9f65 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.379051 Aug 29 05:22:24.084882 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2940/5868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:23 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:24.504180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-2ae3c747-d074-4dc6-ae6c-d040816efe07 req-e054befc-9e8e-495c-84d4-2436b976154f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98b6fc-b979-4a95-8377-554fcdf6b1da", "name": "network-vif-deleted", "tag": "12895453-2c94-4205-99f1-fee1f19c2244"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:24.524664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2ae3c747-d074-4dc6-ae6c-d040816efe07 req-e054befc-9e8e-495c-84d4-2436b976154f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:24.525488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2ae3c747-d074-4dc6-ae6c-d040816efe07 req-e054befc-9e8e-495c-84d4-2436b976154f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:24.526127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2ae3c747-d074-4dc6-ae6c-d040816efe07 req-e054befc-9e8e-495c-84d4-2436b976154f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:24.541256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:24.543661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:24.545917 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2ae3c747-d074-4dc6-ae6c-d040816efe07 req-e054befc-9e8e-495c-84d4-2436b976154f service nova] Creating event network-vif-deleted:12895453-2c94-4205-99f1-fee1f19c2244 for instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da on n-h1-854119-9 Aug 29 05:22:24.551716 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-2ae3c747-d074-4dc6-ae6c-d040816efe07 req-e054befc-9e8e-495c-84d4-2436b976154f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054286 Aug 29 05:22:24.553118 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2929/5869] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:24.559872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:24.562287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:24.564730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:24.565554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:24.566082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:24.568693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:24.650565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:24.659056 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4fd58ae-d506-4ab8-b0f6-65dcab39d9e9 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1466 microversion: 2.1 time: 0.141440 Aug 29 05:22:24.668814 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2941/5870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:24 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:25.105558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:25.106966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:25.113739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:25.114525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:25.115179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:25.116233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:25.117022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:25.117446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:25.338876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:25.349238 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b66dc6e4-c43e-4d33-bf9e-03f27370332d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.247939 Aug 29 05:22:25.350431 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2930/5871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:25 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:25.682859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:25.683512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:25.690963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:25.691698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:25.692397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:25.693625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:25.694227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:25.694796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:25.739817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:25.745904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:25.746433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:25.746971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lazy-loading 'fault' on Instance uuid 3b98b6fc-b979-4a95-8377-554fcdf6b1da {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:22:25.797219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:25.806603 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-32e7b547-dbb6-4be7-adb3-f5401a0301a7 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 200 len: 1305 microversion: 2.1 time: 0.127741 Aug 29 05:22:25.807858 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2942/5872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:25 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:25.965601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-343860d7-9937-4837-bcd4-56f59b3f4a96 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: .version_select at 0x7f1ab99da5e0>, body: {"keypair": {"name": "tempest-keypair-620050749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl0eemF+6HThfwfPUXFvjBYDIrXhXGYGsZWCEOCryqy06kK8P5rnIEqiMcn9s2TXap9vrKkWpqoyrD+/gv3KPhnmzSqIqBlgoARE3x6wldGNq0TaERabEPD6rmTno1FkQ=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:25.985471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-343860d7-9937-4837-bcd4-56f59b3f4a96 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:22:25.992913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-343860d7-9937-4837-bcd4-56f59b3f4a96 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for user ca6430b480c54898b9ed01529f25049a and project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:22:26.021097 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-343860d7-9937-4837-bcd4-56f59b3f4a96 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059837 Aug 29 05:22:26.021720 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2931/5873] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:22:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:26.374122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:26.374744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:26.382162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:26.383168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:26.383815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:26.384862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:26.385761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:26.387193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:26.602323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:26.613056 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6bf2f52a-ffac-4092-9f1c-9e00b3e2c9e3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.242944 Aug 29 05:22:26.626221 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2943/5874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:26 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:26.827965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:26.828623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 3b98b6fc-b979-4a95-8377-554fcdf6b1da] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:26.836446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:26.837311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:26.837757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:26.838490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:26.838939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:26.839368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:26.860924 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] HTTP exception thrown: Instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da could not be found. Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Request method failure captured: Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da HTTP/1.1 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpt711V-DkfxL3VEZgCWvjNAVYnvAajXI7V7o8qGH-z4dbsjGc7C8bNufcEhDFxri8E0Df4oEkwcFcVXiSGb12eNEBLTEd5ZIZkX5j2ntm_tFVlI6nnJf1YFVrEI93hrwEM28xw-aPdZZ8tXK1u-geCSUVNtPvQPBPt_bA_IAffD9I Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164260d628ac492481d9d3524036abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164260d628ac492481d9d3524036abf8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6fb88aef408746868abb4053768c18c4 Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da could not be found. Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '3b98b6fc-b979-4a95-8377-554fcdf6b1da'} Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da could not be found. Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da could not be found. Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:26.862640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da could not be found. Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Returning 404 to user: Instance 3b98b6fc-b979-4a95-8377-554fcdf6b1da could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dd694f64-d872-43ce-a234-e331459ea377 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da" status: 404 len: 111 microversion: 2.1 time: 0.040881 Aug 29 05:22:26.870462 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2932/5875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:26 2022] GET /compute/v2.1/servers/3b98b6fc-b979-4a95-8377-554fcdf6b1da => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:22:26.873074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:26.873582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:26.881162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:26.881775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:26.882087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:26.883452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:26.883905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:26.884348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:26.914267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:22:27.007740 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5ad4ee0-1281-469f-b13d-b45acf824e63 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "DELETE /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 204 len: 0 microversion: 2.1 time: 0.138273 Aug 29 05:22:27.008824 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2944/5876] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:22:26 2022] DELETE /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:22:27.017494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:27.019212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:27.026838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:27.027546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:27.028184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:27.029071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:27.029688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:27.030272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:27.234671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-098e43d5-c9e1-451b-82f7-14b33cec10ca req-fb474e56-4247-4e37-a72d-ae48a0c9ac2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9", "name": "network-vif-plugged", "status": "completed", "tag": "acf10729-be07-494e-bce8-ba9aea0c9a63"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:27.241294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:27.254635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-098e43d5-c9e1-451b-82f7-14b33cec10ca req-fb474e56-4247-4e37-a72d-ae48a0c9ac2b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:27.255557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-098e43d5-c9e1-451b-82f7-14b33cec10ca req-fb474e56-4247-4e37-a72d-ae48a0c9ac2b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:27.256009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-098e43d5-c9e1-451b-82f7-14b33cec10ca req-fb474e56-4247-4e37-a72d-ae48a0c9ac2b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:27.298286 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cff926b4-44c4-4435-ad68-c28c9d6c9870 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1509 microversion: 2.1 time: 0.285216 Aug 29 05:22:27.299723 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-098e43d5-c9e1-451b-82f7-14b33cec10ca req-fb474e56-4247-4e37-a72d-ae48a0c9ac2b service nova] Creating event network-vif-plugged:acf10729-be07-494e-bce8-ba9aea0c9a63 for instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 on n-h1-854119-9 Aug 29 05:22:27.308110 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2933/5877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:27 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:27.320487 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-098e43d5-c9e1-451b-82f7-14b33cec10ca req-fb474e56-4247-4e37-a72d-ae48a0c9ac2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089822 Aug 29 05:22:27.321496 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2945/5878] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:22:27.634911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:27.636223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:27.651404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:27.651914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:27.652386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:27.653263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:27.653729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:27.654246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:28.037284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:28.049343 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54be926a-c360-4579-8fc6-2ef8df5e14ef tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.419554 Aug 29 05:22:28.061235 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2934/5879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:27 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:28.089062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1066357741", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03e6ddac-5990-46d1-82b5-fc12cac2bd56"}], "security_groups": [{"name": "tempest-securitygroup--576911418"}], "key_name": "tempest-keypair-620050749", "user_data": "}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:28.249610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] validate_networks() for [('03e6ddac-5990-46d1-82b5-fc12cac2bd56', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:22:28.330980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:28.331663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:28.338002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:28.338557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:28.339021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:28.339962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:28.340487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:28.340910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:28.646860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:28.656077 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bce99e16-ae13-4a6f-82d6-24ef81c57fbf tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1509 microversion: 2.1 time: 0.328953 Aug 29 05:22:28.656992 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2935/5880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:28 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:28.673906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-26379d7e-e775-42c1-a479-16f5a8fb73cf req-3ceea7f1-4d43-476d-acd0-13eeaca6b1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "233460f7-757a-4860-a96e-d2882d36414e", "name": "network-vif-deleted", "tag": "063fb146-cd95-4585-9cee-20f6843f7a1d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:28.688148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-26379d7e-e775-42c1-a479-16f5a8fb73cf req-3ceea7f1-4d43-476d-acd0-13eeaca6b1de service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:28.688148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-26379d7e-e775-42c1-a479-16f5a8fb73cf req-3ceea7f1-4d43-476d-acd0-13eeaca6b1de service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:28.688148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-26379d7e-e775-42c1-a479-16f5a8fb73cf req-3ceea7f1-4d43-476d-acd0-13eeaca6b1de service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:28.698510 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-26379d7e-e775-42c1-a479-16f5a8fb73cf req-3ceea7f1-4d43-476d-acd0-13eeaca6b1de service nova] Creating event network-vif-deleted:063fb146-cd95-4585-9cee-20f6843f7a1d for instance 233460f7-757a-4860-a96e-d2882d36414e on n-h1-854119-9 Aug 29 05:22:28.703736 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-26379d7e-e775-42c1-a479-16f5a8fb73cf req-3ceea7f1-4d43-476d-acd0-13eeaca6b1de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045330 Aug 29 05:22:28.704376 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2936/5881] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:28.887302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:22:28.887729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:22:28.888362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:22:28.888620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:22:28.889329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:22:28.902171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:28.902659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:28.903087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:28.903805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:28.904280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:28.904697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:28.913925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:28.925419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:22:28.931416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for user ca6430b480c54898b9ed01529f25049a and project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:22:28.954314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:22:28.957056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:22:29.013056 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-747f1fd3-28dc-4e7f-9077-2a4026986b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.929415 Aug 29 05:22:29.013820 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2946/5882] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:22:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:22:29.025389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-081e4fe7-30cf-41e5-9202-69a4450c9e47 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:29.026079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-081e4fe7-30cf-41e5-9202-69a4450c9e47 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:29.071463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:29.072669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:29.079734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:29.080523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:29.081129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:29.082003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:29.082852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:29.083440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:29.125078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-081e4fe7-30cf-41e5-9202-69a4450c9e47 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:29.133413 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-081e4fe7-30cf-41e5-9202-69a4450c9e47 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1241 microversion: 2.1 time: 0.112159 Aug 29 05:22:29.137599 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2937/5883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:29 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:29.302744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:29.314848 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11b02db7-9505-4588-8549-ef26452603a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1392 microversion: 2.1 time: 0.247470 Aug 29 05:22:29.316418 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2947/5884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:29 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1392 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:29.677375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:29.678184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:29.685642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:29.686219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:29.686909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:29.687750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:29.688465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:29.689122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:29.727958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:29.728598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:29.729208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:29.729887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lazy-loading 'fault' on Instance uuid 233460f7-757a-4860-a96e-d2882d36414e {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:22:29.781232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:29.789914 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-20d19c92-3733-489d-80a3-d6d46c3293ce tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 200 len: 1305 microversion: 2.1 time: 0.116538 Aug 29 05:22:29.790491 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2938/5885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:29 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:30.158135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:30.158836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:30.166867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.167373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.167817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.168564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.169011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.169431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.234269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:30.242175 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e07ea2e-518f-487e-ab9e-8b6d3891d15a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1293 microversion: 2.1 time: 0.088201 Aug 29 05:22:30.242786 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2948/5886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:30 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:30.338009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:30.338712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:30.346459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.346995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.347392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.348216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.348675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.349105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.352036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:30.527498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:30.535905 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-18f022ae-e28a-496e-8dda-a69493900fb0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1565 microversion: 2.1 time: 0.201854 Aug 29 05:22:30.536738 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2939/5887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:30 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1565 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:30.556429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:30.557055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:30.564097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.564720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.565470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.566254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.566818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.567287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.710051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:30.718458 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3996d93-d6d4-4f35-aba6-5fb29fa0ec7a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1565 microversion: 2.1 time: 0.165977 Aug 29 05:22:30.719056 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2949/5888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:30 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:30.811851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:30.812756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 233460f7-757a-4860-a96e-d2882d36414e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:30.819650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.820746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.821489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.822976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.823769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.824322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.839026 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] HTTP exception thrown: Instance 233460f7-757a-4860-a96e-d2882d36414e could not be found. Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Request method failure captured: Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e HTTP/1.1 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEpt711V-DkfxL3VEZgCWvjNAVYnvAajXI7V7o8qGH-z4dbsjGc7C8bNufcEhDFxri8E0Df4oEkwcFcVXiSGb12eNEBLTEd5ZIZkX5j2ntm_tFVlI6nnJf1YFVrEI93hrwEM28xw-aPdZZ8tXK1u-geCSUVNtPvQPBPt_bA_IAffD9I Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164260d628ac492481d9d3524036abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164260d628ac492481d9d3524036abf8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6fb88aef408746868abb4053768c18c4 Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 233460f7-757a-4860-a96e-d2882d36414e could not be found. Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '233460f7-757a-4860-a96e-d2882d36414e'} Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 233460f7-757a-4860-a96e-d2882d36414e could not be found. Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 233460f7-757a-4860-a96e-d2882d36414e could not be found. Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:30.841005 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:30.846004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:30.846004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:30.846004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:30.846004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:22:30.846004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:22:30.846004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 233460f7-757a-4860-a96e-d2882d36414e could not be found. Aug 29 05:22:30.846004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:30.846004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Returning 404 to user: Instance 233460f7-757a-4860-a96e-d2882d36414e could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:22:30.847173 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ce58f2a8-15f8-4385-84d4-189192301708 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e" status: 404 len: 111 microversion: 2.1 time: 0.039524 Aug 29 05:22:30.848373 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2940/5889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:30 2022] GET /compute/v2.1/servers/233460f7-757a-4860-a96e-d2882d36414e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:22:30.856428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:30.857059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:30.863745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.864430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.864967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.865768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:30.866325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:30.866848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:30.904113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:22:31.029390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-388f5fd5-f924-4883-a6eb-df6360cd8ae5 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 204 len: 0 microversion: 2.1 time: 0.176554 Aug 29 05:22:31.031084 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2950/5890] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:22:30 2022] DELETE /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:22:31.039921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:31.040594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:31.048361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:31.049085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:31.051676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:31.053186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:31.054047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:31.055352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:31.265096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:31.265840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:31.285258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:31.286677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:31.287362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:31.288351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:31.289219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:31.291789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:31.412587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:31.420935 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e2c1ddf5-1f19-4bb2-9172-e954e4af00a5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1311 microversion: 2.1 time: 0.161144 Aug 29 05:22:31.421830 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2951/5891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:31 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1311 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:31.496956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:31.506092 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3eb49a40-f7a6-49f5-8310-539f90dc2f3a tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1494 microversion: 2.1 time: 0.470828 Aug 29 05:22:31.507089 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2941/5892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:31 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1494 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:32.455407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:32.461223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:32.473075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:32.473588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:32.474028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:32.475665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:32.476339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:32.476778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:32.527794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:32.532720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:32.540421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:32.540919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:32.541355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:32.545624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:32.546320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:32.548377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:32.610711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:32.619937 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1352ea9e-181e-454f-9e78-36e4bc24eb45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1299 microversion: 2.1 time: 0.173877 Aug 29 05:22:32.620849 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2952/5893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:32 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:32.720293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-55487d83-1e33-4ee2-b174-504bea5afb9a req-7556662f-1a95-4fe1-be22-7fc7e782f6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33fef6f-0065-4378-b656-3d60f8f09baa", "name": "network-vif-deleted", "tag": "637e6c2a-9041-4e01-a0ee-c2f811843d44"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:32.748150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-55487d83-1e33-4ee2-b174-504bea5afb9a req-7556662f-1a95-4fe1-be22-7fc7e782f6f0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:32.749454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-55487d83-1e33-4ee2-b174-504bea5afb9a req-7556662f-1a95-4fe1-be22-7fc7e782f6f0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:32.750037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-55487d83-1e33-4ee2-b174-504bea5afb9a req-7556662f-1a95-4fe1-be22-7fc7e782f6f0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:32.751433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:32.780977 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9abe7f8d-d517-4e28-aa73-e31e230a5e56 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1452 microversion: 2.1 time: 0.257492 Aug 29 05:22:32.783382 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-55487d83-1e33-4ee2-b174-504bea5afb9a req-7556662f-1a95-4fe1-be22-7fc7e782f6f0 service nova] Creating event network-vif-deleted:637e6c2a-9041-4e01-a0ee-c2f811843d44 for instance a33fef6f-0065-4378-b656-3d60f8f09baa on n-h1-854119-9 Aug 29 05:22:32.797976 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2942/5894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:32 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1452 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:32.798555 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-55487d83-1e33-4ee2-b174-504bea5afb9a req-7556662f-1a95-4fe1-be22-7fc7e782f6f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077006 Aug 29 05:22:32.798555 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2953/5895] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:33.640773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:33.641611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:33.648721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:33.649212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:33.649647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:33.650355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:33.650808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:33.651481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:33.811618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:33.812444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:33.832245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:33.835223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:33.835793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:33.836777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:33.837385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:33.838050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:33.893091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:33.893979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:33.894620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:33.895082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lazy-loading 'fault' on Instance uuid a33fef6f-0065-4378-b656-3d60f8f09baa {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:22:34.047376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:34.055151 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-54744ed0-9c3f-46e0-a2ac-481d14b1a153 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 200 len: 1304 microversion: 2.1 time: 0.248217 Aug 29 05:22:34.055749 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2954/5896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:33 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 1304 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:34.145413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:34.154573 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e4230ee8-226b-409e-81b2-daf1d1232165 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.517205 Aug 29 05:22:34.155683 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2943/5897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:33 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:34.209274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:34.209754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:34.216888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:34.217396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:34.217839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:34.218557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:34.219013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:34.219445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:34.321397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lazy-loading 'services' on Instance uuid 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:22:34.414235 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-24926c16-7ae7-462f-8fb2-5bee358f4257 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments/145ee3c8-db6c-48c1-a8dc-059410343ecc" status: 202 len: 0 microversion: 2.1 time: 0.209098 Aug 29 05:22:34.418144 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2955/5898] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:22:34 2022] DELETE /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments/145ee3c8-db6c-48c1-a8dc-059410343ecc => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:22:34.431903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a804ef0-9e80-4094-8a63-5523f70c4da8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:34.440637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3a804ef0-9e80-4094-8a63-5523f70c4da8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:34.453811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a804ef0-9e80-4094-8a63-5523f70c4da8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:34.454311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a804ef0-9e80-4094-8a63-5523f70c4da8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:34.454749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a804ef0-9e80-4094-8a63-5523f70c4da8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:34.456141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a804ef0-9e80-4094-8a63-5523f70c4da8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:34.456600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a804ef0-9e80-4094-8a63-5523f70c4da8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:34.457027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a804ef0-9e80-4094-8a63-5523f70c4da8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:34.490746 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3a804ef0-9e80-4094-8a63-5523f70c4da8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071024 Aug 29 05:22:34.491927 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2944/5899] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:22:34 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:35.090045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:35.090877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: a33fef6f-0065-4378-b656-3d60f8f09baa] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:35.098216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.098945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.099575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.100479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.101088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.101667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.116146 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] HTTP exception thrown: Instance a33fef6f-0065-4378-b656-3d60f8f09baa could not be found. Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Request method failure captured: Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa HTTP/1.1 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpt711V-DkfxL3VEZgCWvjNAVYnvAajXI7V7o8qGH-z4dbsjGc7C8bNufcEhDFxri8E0Df4oEkwcFcVXiSGb12eNEBLTEd5ZIZkX5j2ntm_tFVlI6nnJf1YFVrEI93hrwEM28xw-aPdZZ8tXK1u-geCSUVNtPvQPBPt_bA_IAffD9I Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164260d628ac492481d9d3524036abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164260d628ac492481d9d3524036abf8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 6fb88aef408746868abb4053768c18c4 Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance a33fef6f-0065-4378-b656-3d60f8f09baa could not be found. Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a33fef6f-0065-4378-b656-3d60f8f09baa'} Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33fef6f-0065-4378-b656-3d60f8f09baa could not be found. Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33fef6f-0065-4378-b656-3d60f8f09baa could not be found. Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:35.118155 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:35.122927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:35.122927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:35.122927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:35.122927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:22:35.122927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:22:35.122927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33fef6f-0065-4378-b656-3d60f8f09baa could not be found. Aug 29 05:22:35.122927 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:35.124331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Returning 404 to user: Instance a33fef6f-0065-4378-b656-3d60f8f09baa could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:22:35.125557 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3e7d44dc-501c-4d1c-bfd6-9d28520aaa1b tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa" status: 404 len: 111 microversion: 2.1 time: 0.039985 Aug 29 05:22:35.126601 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2956/5900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:35 2022] GET /compute/v2.1/servers/a33fef6f-0065-4378-b656-3d60f8f09baa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:22:35.134886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:35.136664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:35.150044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:35.152390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.153114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.153984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.155301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:35.156284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.157914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.158449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.172814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.174477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.176003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.177878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.178892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.179837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.218566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:22:35.344938 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b7568102-76d9-428f-a108-cf07a57f89f0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 204 len: 0 microversion: 2.1 time: 0.214082 Aug 29 05:22:35.345565 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2945/5901] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:22:35 2022] DELETE /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:22:35.362371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-97731ed5-724d-4b17-b328-caf8ef0f3c02 req-459c34de-db51-4dac-817a-1ab3d3e14b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9", "tag": "acf10729-be07-494e-bce8-ba9aea0c9a63"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:35.389492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-97731ed5-724d-4b17-b328-caf8ef0f3c02 req-459c34de-db51-4dac-817a-1ab3d3e14b0f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.390117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-97731ed5-724d-4b17-b328-caf8ef0f3c02 req-459c34de-db51-4dac-817a-1ab3d3e14b0f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.390552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-97731ed5-724d-4b17-b328-caf8ef0f3c02 req-459c34de-db51-4dac-817a-1ab3d3e14b0f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.407202 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-97731ed5-724d-4b17-b328-caf8ef0f3c02 req-459c34de-db51-4dac-817a-1ab3d3e14b0f service nova] Creating event network-changed:acf10729-be07-494e-bce8-ba9aea0c9a63 for instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 on n-h1-854119-9 Aug 29 05:22:35.414014 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-97731ed5-724d-4b17-b328-caf8ef0f3c02 req-459c34de-db51-4dac-817a-1ab3d3e14b0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061858 Aug 29 05:22:35.414982 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2946/5902] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:35.421423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:35.423020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:35.430498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.430992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.431426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.432151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.432636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.433367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.563624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:35.575176 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b24e2db6-cda3-4a75-997a-1431804658a2 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1565 microversion: 2.1 time: 0.432690 Aug 29 05:22:35.576082 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2957/5903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:35 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1565 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:35.592113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:35.592756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:35.608164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.619213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.620541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.623664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:35.629226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.629720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.630327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.643603 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a01ec7cd-d111-4ddb-ae09-11a06f14737e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.226536 Aug 29 05:22:35.644578 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2947/5904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:35 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:35.661133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ea0543e-faec-4e2c-b895-1a76aee31a68 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:35.665055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ea0543e-faec-4e2c-b895-1a76aee31a68 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:35.702507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea0543e-faec-4e2c-b895-1a76aee31a68 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.706809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea0543e-faec-4e2c-b895-1a76aee31a68 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.707569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea0543e-faec-4e2c-b895-1a76aee31a68 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.708641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea0543e-faec-4e2c-b895-1a76aee31a68 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:35.709312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea0543e-faec-4e2c-b895-1a76aee31a68 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:35.712397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea0543e-faec-4e2c-b895-1a76aee31a68 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:35.778545 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ea0543e-faec-4e2c-b895-1a76aee31a68 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132103 Aug 29 05:22:35.779544 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2948/5905] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:22:35 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:35.829642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:35.838657 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d7f6c457-05f9-4198-a367-354ff4fb9ed1 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1677 microversion: 2.1 time: 0.261518 Aug 29 05:22:35.843561 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2958/5906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:35 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1677 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:36.665016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:36.666233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:36.675480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:36.676254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:36.676854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:36.681100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:36.681756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:36.682352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:36.791830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-99cf91db-c5dc-41df-b82b-7395467f522e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:36.795266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-99cf91db-c5dc-41df-b82b-7395467f522e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:36.817491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99cf91db-c5dc-41df-b82b-7395467f522e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:36.818213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99cf91db-c5dc-41df-b82b-7395467f522e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:36.818765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99cf91db-c5dc-41df-b82b-7395467f522e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:36.819609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99cf91db-c5dc-41df-b82b-7395467f522e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:36.822002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99cf91db-c5dc-41df-b82b-7395467f522e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:36.822002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-99cf91db-c5dc-41df-b82b-7395467f522e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:36.889506 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-99cf91db-c5dc-41df-b82b-7395467f522e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102239 Aug 29 05:22:36.895566 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2959/5907] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:22:36 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:22:36.895566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:36.898304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:36.915680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:36.916473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:36.919969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:36.920992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:36.921613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:36.922257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:37.215208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:37.225550 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fb34f930-98cd-4d8d-a05e-07df50a49254 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.564861 Aug 29 05:22:37.226148 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2949/5908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:36 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:37.435628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-559c47ce-f065-4c1d-9382-a2afd624e4e0 req-37632b9b-c7df-4687-822d-b50e88b0f0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca7086a3-4bf4-4069-92a4-dc6185fafe8d", "tag": "e539dde5-da4f-4deb-8f38-cf9450f0fea7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:37.453518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-559c47ce-f065-4c1d-9382-a2afd624e4e0 req-37632b9b-c7df-4687-822d-b50e88b0f0c6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:37.454001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-559c47ce-f065-4c1d-9382-a2afd624e4e0 req-37632b9b-c7df-4687-822d-b50e88b0f0c6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:37.454428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-559c47ce-f065-4c1d-9382-a2afd624e4e0 req-37632b9b-c7df-4687-822d-b50e88b0f0c6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:37.477392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:37.478460 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-559c47ce-f065-4c1d-9382-a2afd624e4e0 req-37632b9b-c7df-4687-822d-b50e88b0f0c6 service nova] Creating event network-changed:e539dde5-da4f-4deb-8f38-cf9450f0fea7 for instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d on n-h1-854119-9 Aug 29 05:22:37.487204 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22e23c88-ac09-4a40-a356-80cacf35216f tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1677 microversion: 2.1 time: 0.595396 Aug 29 05:22:37.492536 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2960/5909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:36 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1677 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:37.496733 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-559c47ce-f065-4c1d-9382-a2afd624e4e0 req-37632b9b-c7df-4687-822d-b50e88b0f0c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064817 Aug 29 05:22:37.497494 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2950/5910] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:22:37.907854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90593553-4b07-4eba-b867-6416bd361bbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:37.911239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-90593553-4b07-4eba-b867-6416bd361bbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:37.926718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90593553-4b07-4eba-b867-6416bd361bbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:37.929627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90593553-4b07-4eba-b867-6416bd361bbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:37.933514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90593553-4b07-4eba-b867-6416bd361bbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:37.934568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90593553-4b07-4eba-b867-6416bd361bbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:37.936054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90593553-4b07-4eba-b867-6416bd361bbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:37.940229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90593553-4b07-4eba-b867-6416bd361bbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:37.994502 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-90593553-4b07-4eba-b867-6416bd361bbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095962 Aug 29 05:22:37.996245 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2961/5911] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:22:37 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:38.252259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:38.253736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:38.261145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:38.261724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:38.262204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:38.262974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:38.263519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:38.264014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:38.513238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:38.514193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:38.522440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:38.525732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:38.530018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:38.533174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:38.536213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:38.536768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:38.537238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:38.555704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:38.673512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:38.677461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:38.685646 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-809dacb7-19e0-4249-a47d-bda74b7b70cc tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1609 microversion: 2.1 time: 0.176707 Aug 29 05:22:38.687026 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e46608f7-eab4-45d2-be51-029d35d07eee tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.442209 Aug 29 05:22:38.689317 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2962/5912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:38 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1609 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:38.692251 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2951/5913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:38 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:39.007822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e682b663-62ab-42d7-97a1-26b8896d640e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:39.010235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e682b663-62ab-42d7-97a1-26b8896d640e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:39.020587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:39.022113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:39.023575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e682b663-62ab-42d7-97a1-26b8896d640e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:39.024157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e682b663-62ab-42d7-97a1-26b8896d640e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:39.024803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e682b663-62ab-42d7-97a1-26b8896d640e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:39.025728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e682b663-62ab-42d7-97a1-26b8896d640e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:39.026337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e682b663-62ab-42d7-97a1-26b8896d640e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:39.026767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e682b663-62ab-42d7-97a1-26b8896d640e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:39.090189 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e682b663-62ab-42d7-97a1-26b8896d640e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085140 Aug 29 05:22:39.099240 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2963/5914] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:22:39 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:39.565238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b2bb513f-e770-4ebd-b24b-c1295b7b0161 req-d41f0fe2-d7b0-4eaf-8b13-114aff5436a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7d9e6b-96d5-4f68-b699-77e111d26429", "name": "network-vif-deleted", "tag": "457b9c14-8efe-42be-9e29-838ef78e2dde"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:39.574364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:39.577970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b2bb513f-e770-4ebd-b24b-c1295b7b0161 req-d41f0fe2-d7b0-4eaf-8b13-114aff5436a4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:39.578742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b2bb513f-e770-4ebd-b24b-c1295b7b0161 req-d41f0fe2-d7b0-4eaf-8b13-114aff5436a4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:39.579329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b2bb513f-e770-4ebd-b24b-c1295b7b0161 req-d41f0fe2-d7b0-4eaf-8b13-114aff5436a4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:39.592525 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b2bb513f-e770-4ebd-b24b-c1295b7b0161 req-d41f0fe2-d7b0-4eaf-8b13-114aff5436a4 service nova] Creating event network-vif-deleted:457b9c14-8efe-42be-9e29-838ef78e2dde for instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 on n-h1-854119-9 Aug 29 05:22:39.597983 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b2bb513f-e770-4ebd-b24b-c1295b7b0161 req-d41f0fe2-d7b0-4eaf-8b13-114aff5436a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036407 Aug 29 05:22:39.599611 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2952/5915] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:39.712724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:39.713080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:39.713804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:39.714491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:39.720301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:39.720662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:39.721094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:39.722005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:39.722683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:39.723269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:39.727728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:39.728398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:39.728944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:39.729765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:39.730326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:39.730855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:39.821322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:39.830100 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9602f9e-46d4-4325-9aea-72b74f5661c0 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1609 microversion: 2.1 time: 0.121489 Aug 29 05:22:39.835993 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2953/5916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:39 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1609 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:39.974599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:39.994349 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9428677c-77c2-4029-af0b-e532b6e43684 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.284617 Aug 29 05:22:39.996187 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2964/5917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:39 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:40.103811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e04f6aac-2066-40fd-b46b-7c5b06ccb0e8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:40.106068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e04f6aac-2066-40fd-b46b-7c5b06ccb0e8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:40.113167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e04f6aac-2066-40fd-b46b-7c5b06ccb0e8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:40.115423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e04f6aac-2066-40fd-b46b-7c5b06ccb0e8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:40.115864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e04f6aac-2066-40fd-b46b-7c5b06ccb0e8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:40.117884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e04f6aac-2066-40fd-b46b-7c5b06ccb0e8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:40.118529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e04f6aac-2066-40fd-b46b-7c5b06ccb0e8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:40.118956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e04f6aac-2066-40fd-b46b-7c5b06ccb0e8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:40.170352 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e04f6aac-2066-40fd-b46b-7c5b06ccb0e8 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060148 Aug 29 05:22:40.176588 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2954/5918] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:22:40 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:40.859321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:40.859954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:40.867877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:40.868402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:40.868835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:40.869545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:40.870002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:40.870428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:40.915403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:40.920520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:40.921235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:40.921893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lazy-loading 'fault' on Instance uuid 5e7d9e6b-96d5-4f68-b699-77e111d26429 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:22:41.021645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:41.022276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:41.026076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:41.034112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.034840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.035460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.036453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.037076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.037718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.336462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb88aef408746868abb4053768c18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164260d628ac492481d9d3524036abf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:41.347632 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8cdb1cd6-2db4-4cb6-a3c6-f218ce3bfe12 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 200 len: 1329 microversion: 2.1 time: 0.492378 Aug 29 05:22:41.348894 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2965/5919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:40 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 1329 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:41.353788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c10f2f2-81b7-4139-8f32-a6de75337a29 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:41.356354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0c10f2f2-81b7-4139-8f32-a6de75337a29 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:41.363213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c10f2f2-81b7-4139-8f32-a6de75337a29 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.364059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c10f2f2-81b7-4139-8f32-a6de75337a29 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.364700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c10f2f2-81b7-4139-8f32-a6de75337a29 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.365599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c10f2f2-81b7-4139-8f32-a6de75337a29 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.366204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c10f2f2-81b7-4139-8f32-a6de75337a29 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.366783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c10f2f2-81b7-4139-8f32-a6de75337a29 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.404057 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0c10f2f2-81b7-4139-8f32-a6de75337a29 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053985 Aug 29 05:22:41.404968 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2966/5920] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:22:41 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:22:41.456214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:41.467008 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86f4605e-b3e0-4077-bfa6-dccd9e78f918 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.454936 Aug 29 05:22:41.468056 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2955/5921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:41 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:41.499337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:41.501662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:41.507737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.508254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.508775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.509470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.509920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.510448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.537873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] HTTP exception thrown: Cannot 'reboot' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Request method failure captured: Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad/action HTTP/1.1 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 28 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEvMW3izJD85pVtbvax1SMfCuq2_Uf3UUHBG6YwbWLNgoxV3uYJIzYl-i9v4vjXyxY9Qq6gcnhWdP6WFxclBgQAU6dml8-Y-HMFx3s3QV0g_wjEpxDyxcKn6d9J-7o-Mew1NhfWoJLNGc1dBi1srqaIaTALn7VpmZsYiGBl2GStsVDM Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63bbfe3da13249fa9f9fe77f7725d037", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b9574a5f99bf4401a8a2297c71d3e382 Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: {"reboot": {"type": "HARD"}} Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: exception: Cannot 'reboot' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad', 'body': {'reboot': {'type': 'HARD'}}} Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:22:41.539761 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Returning 409 to user: Cannot 'reboot' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc945f6e-4db0-42b1-8580-4b0a29f96ab6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad/action" status: 409 len: 145 microversion: 2.1 time: 0.046051 Aug 29 05:22:41.547226 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2967/5922] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:22:41 2022] POST /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad/action => generated 145 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:22:41.553720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:41.556587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:41.562987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.563600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.564142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.565048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.565616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.566134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.595227 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] HTTP exception thrown: Cannot 'rebuild' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Request method failure captured: Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad/action HTTP/1.1 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 65 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEvMW3izJD85pVtbvax1SMfCuq2_Uf3UUHBG6YwbWLNgoxV3uYJIzYl-i9v4vjXyxY9Qq6gcnhWdP6WFxclBgQAU6dml8-Y-HMFx3s3QV0g_wjEpxDyxcKn6d9J-7o-Mew1NhfWoJLNGc1dBi1srqaIaTALn7VpmZsYiGBl2GStsVDM Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63bbfe3da13249fa9f9fe77f7725d037", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: b9574a5f99bf4401a8a2297c71d3e382 Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: exception: Cannot 'rebuild' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad', 'body': {'rebuild': {'imageRef': '6e3fd38c-90a0-4677-991e-152affedd0a1'}}} Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:22:41.597222 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Returning 409 to user: Cannot 'rebuild' instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad while it is in vm_state rescued {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-342842f8-f41e-4e7f-8147-e5c327462563 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "POST /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad/action" status: 409 len: 146 microversion: 2.1 time: 0.050449 Aug 29 05:22:41.602116 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2956/5923] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:22:41 2022] POST /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad/action => generated 146 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:22:41.611666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:41.612190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:41.619097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.619591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.620026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.620777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.621224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.621643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.649688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:22:41.730504 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-93adb81f-98a9-45a6-ad88-7b2cafe75fbd tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 204 len: 0 microversion: 2.1 time: 0.122433 Aug 29 05:22:41.734815 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2968/5924] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:22:41 2022] DELETE /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:22:41.740949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:41.741709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:41.749086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.749610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.750194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.750918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:41.751371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:41.751800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:41.754714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:41.896379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:41.905371 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-412f93ad-1f28-425b-9465-9c6cc07debe6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1689 microversion: 2.1 time: 0.169089 Aug 29 05:22:41.906279 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2957/5925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:41 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:42.368656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:42.369231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] [instance: 5e7d9e6b-96d5-4f68-b699-77e111d26429] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:42.376719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:42.377218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:42.377691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:42.378503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:42.379241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:42.379838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:42.400032 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] HTTP exception thrown: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 could not be found. Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Request method failure captured: Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 HTTP/1.1 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEpt711V-DkfxL3VEZgCWvjNAVYnvAajXI7V7o8qGH-z4dbsjGc7C8bNufcEhDFxri8E0Df4oEkwcFcVXiSGb12eNEBLTEd5ZIZkX5j2ntm_tFVlI6nnJf1YFVrEI93hrwEM28xw-aPdZZ8tXK1u-geCSUVNtPvQPBPt_bA_IAffD9I Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/164260d628ac492481d9d3524036abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_164260d628ac492481d9d3524036abf8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/164260d628ac492481d9d3524036abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 164260d628ac492481d9d3524036abf8 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-430818047 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 6fb88aef408746868abb4053768c18c4 Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-430818047-project Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 could not be found. Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '5e7d9e6b-96d5-4f68-b699-77e111d26429'} Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 could not be found. Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 could not be found. Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:42.401829 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 could not be found. Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Returning 404 to user: Instance 5e7d9e6b-96d5-4f68-b699-77e111d26429 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b9e3a60-6102-47d7-a081-ac117eaec7b6 tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429" status: 404 len: 111 microversion: 2.1 time: 0.039172 Aug 29 05:22:42.406316 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2969/5926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:42 2022] GET /compute/v2.1/servers/5e7d9e6b-96d5-4f68-b699-77e111d26429 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:22:42.412543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-908ce432-ff0a-475e-b7a6-98b68b686eed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] Calling method '.version_select at 0x7f1ab9dd6940>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:42.433942 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-908ce432-ff0a-475e-b7a6-98b68b686eed tempest-ServerActionsTestJSON-430818047 tempest-ServerActionsTestJSON-430818047-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109037849" status: 202 len: 0 microversion: 2.1 time: 0.025319 Aug 29 05:22:42.434632 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2958/5927] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 05:22:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109037849 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:22:42.492796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:42.493439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:42.500206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:42.500701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:42.501340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:42.502267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:42.502853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:42.503145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:42.670703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:42.679958 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d9fa5d63-e66b-4711-b82c-d5b2f15414a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.191301 Aug 29 05:22:42.680733 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2970/5928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:42 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:42.927857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:42.928979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:42.938995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:42.939822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:42.940568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:42.941491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:42.942052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:42.942583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:43.137225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:43.147362 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-21742172-2f2e-4d30-b58d-7dcf3d6736ca tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1689 microversion: 2.1 time: 0.223148 Aug 29 05:22:43.148359 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2959/5929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:42 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:43.255356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3fea7694-c287-40e1-ad0a-96007e592cd4 req-5150ded2-dc59-449d-9ee5-400689a685e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7086a3-4bf4-4069-92a4-dc6185fafe8d", "name": "network-vif-plugged", "status": "completed", "tag": "e539dde5-da4f-4deb-8f38-cf9450f0fea7"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:43.270511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3fea7694-c287-40e1-ad0a-96007e592cd4 req-5150ded2-dc59-449d-9ee5-400689a685e6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:43.271418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3fea7694-c287-40e1-ad0a-96007e592cd4 req-5150ded2-dc59-449d-9ee5-400689a685e6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:43.272609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3fea7694-c287-40e1-ad0a-96007e592cd4 req-5150ded2-dc59-449d-9ee5-400689a685e6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:43.288150 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3fea7694-c287-40e1-ad0a-96007e592cd4 req-5150ded2-dc59-449d-9ee5-400689a685e6 service nova] Creating event network-vif-plugged:e539dde5-da4f-4deb-8f38-cf9450f0fea7 for instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d on n-h1-854119-9 Aug 29 05:22:43.293610 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3fea7694-c287-40e1-ad0a-96007e592cd4 req-5150ded2-dc59-449d-9ee5-400689a685e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049778 Aug 29 05:22:43.296304 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2971/5930] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:43.701860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:43.702674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:43.709912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:43.710475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:43.710852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:43.711545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:43.711993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:43.712470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:43.930974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:43.939610 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dca9d9b7-8f68-40d0-88a3-d8b3d7805eef tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.241686 Aug 29 05:22:43.940190 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2960/5931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:43 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:44.170882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:44.172380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:44.179459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:44.180084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:44.180786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:44.181504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:44.181962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:44.182370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:44.443404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:44.455390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51283f21-467e-471b-a6a1-a5462f35de2f tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1689 microversion: 2.1 time: 0.289481 Aug 29 05:22:44.469735 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2972/5932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:44 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1689 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:44.960948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:44.962398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:44.971725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:44.972725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:44.973374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:44.974307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:44.974964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:44.975717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:45.185030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:45.195959 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ae8708ce-0bb2-4c66-88f7-d324bee3283b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.238795 Aug 29 05:22:45.211991 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2961/5933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:44 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:45.479692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:45.481078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:45.496195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:45.497052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:45.497728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:45.499029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:45.499793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:45.500438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:45.765935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:45.774506 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d7ed6976-878d-48a2-8c76-439f27f5831b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1689 microversion: 2.1 time: 0.299197 Aug 29 05:22:45.775519 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2973/5934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:45 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1689 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:46.217688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:46.218600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:46.225712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:46.226309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:46.226810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:46.227572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:46.228091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:46.228644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:46.388204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:46.396402 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6c9e8301-bad9-49b2-96ce-f7237a516225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.182746 Aug 29 05:22:46.397291 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2962/5935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:46 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:46.794939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:46.795554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:46.802456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:46.802942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:46.803371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:46.804063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:46.804532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:46.804950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:47.020717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:47.028784 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-104693f3-6784-4d1e-8514-9a25d5c1c68b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1689 microversion: 2.1 time: 0.237559 Aug 29 05:22:47.029350 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2974/5936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:46 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1689 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:47.418380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:47.419123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:47.433959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:47.434644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:47.435188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:47.448603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:47.448982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:47.449655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:47.703005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:47.712547 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06489772-9e3b-4adf-9cd0-1d62e4fd4088 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1366 microversion: 2.1 time: 0.298628 Aug 29 05:22:47.719530 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2963/5937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:47 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:48.050859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:48.051747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:48.059092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:48.059691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:48.060110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:48.060984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:48.061449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:48.061912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:48.202645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:48.234967 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2411d35e-56ff-47a0-93ac-3be6292ec89b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1621 microversion: 2.1 time: 0.186002 Aug 29 05:22:48.250230 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2975/5938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:48 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1621 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:48.444268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-277b6f7a-b044-43dd-a23d-2dc5c363b80b req-0194c88b-63c5-4257-b9f3-fa277285a43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c227b05-d28b-410f-bb7d-ccba6c7c2ad3", "name": "network-vif-deleted", "tag": "d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:48.465436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-277b6f7a-b044-43dd-a23d-2dc5c363b80b req-0194c88b-63c5-4257-b9f3-fa277285a43f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:48.466235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-277b6f7a-b044-43dd-a23d-2dc5c363b80b req-0194c88b-63c5-4257-b9f3-fa277285a43f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:48.466908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-277b6f7a-b044-43dd-a23d-2dc5c363b80b req-0194c88b-63c5-4257-b9f3-fa277285a43f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:48.481618 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-277b6f7a-b044-43dd-a23d-2dc5c363b80b req-0194c88b-63c5-4257-b9f3-fa277285a43f service nova] Creating event network-vif-deleted:d02ab38e-67ea-4b2c-8c1a-ea8c47b254f7 for instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 on n-h1-854119-9 Aug 29 05:22:48.489381 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-277b6f7a-b044-43dd-a23d-2dc5c363b80b req-0194c88b-63c5-4257-b9f3-fa277285a43f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053106 Aug 29 05:22:48.490627 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2964/5939] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:48.734820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:48.735504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:48.757486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:48.757977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:48.765996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:48.766962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:48.767732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:48.768355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:49.021119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:49.034183 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9ce7777-a0ac-449e-8215-be56d44925ff tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1556 microversion: 2.1 time: 0.303294 Aug 29 05:22:49.035152 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2976/5940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:48 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1556 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:49.061555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3bfac1f1-1e0c-4070-b764-b1446764289a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:49.062197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3bfac1f1-1e0c-4070-b764-b1446764289a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:49.069999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bfac1f1-1e0c-4070-b764-b1446764289a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:49.071766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bfac1f1-1e0c-4070-b764-b1446764289a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:49.072275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bfac1f1-1e0c-4070-b764-b1446764289a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:49.073069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bfac1f1-1e0c-4070-b764-b1446764289a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:49.073776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bfac1f1-1e0c-4070-b764-b1446764289a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:49.074253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bfac1f1-1e0c-4070-b764-b1446764289a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:49.215523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3bfac1f1-1e0c-4070-b764-b1446764289a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158181 Aug 29 05:22:49.216894 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2965/5941] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:22:49 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:49.259358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:49.260063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:49.278248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:49.279506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:49.282384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:49.283639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:49.288574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:49.289062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:49.361990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:49.362523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:49.368391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:49.368966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lazy-loading 'fault' on Instance uuid 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:22:49.452708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:49.462976 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af773b4b-7a6e-4d0c-b375-24ce264a7406 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 200 len: 1335 microversion: 2.1 time: 0.205602 Aug 29 05:22:49.465810 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2977/5942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:49 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 1335 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:50.490739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:50.492099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:50.499180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:50.499738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:50.500266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:50.502376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:50.502912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:50.503983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:50.548311 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] HTTP exception thrown: Instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 could not be found. Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Request method failure captured: Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 HTTP/1.1 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEvMW3izJD85pVtbvax1SMfCuq2_Uf3UUHBG6YwbWLNgoxV3uYJIzYl-i9v4vjXyxY9Qq6gcnhWdP6WFxclBgQAU6dml8-Y-HMFx3s3QV0g_wjEpxDyxcKn6d9J-7o-Mew1NhfWoJLNGc1dBi1srqaIaTALn7VpmZsYiGBl2GStsVDM Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63bbfe3da13249fa9f9fe77f7725d037", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: b9574a5f99bf4401a8a2297c71d3e382 Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 could not be found. Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '4c227b05-d28b-410f-bb7d-ccba6c7c2ad3'} Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 could not be found. Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 could not be found. Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:50.550004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 could not be found. Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Returning 404 to user: Instance 4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:22:50.554806 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eb4bdce0-e39c-4978-8cf0-db3f4c4cca85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3" status: 404 len: 111 microversion: 2.1 time: 0.066182 Aug 29 05:22:50.568315 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2966/5943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:50 2022] GET /compute/v2.1/servers/4c227b05-d28b-410f-bb7d-ccba6c7c2ad3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:22:50.568973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3c5c34c6-31d2-412e-92a6-df877f947d5e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '.version_select at 0x7f1ab86f01f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:50.606686 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3c5c34c6-31d2-412e-92a6-df877f947d5e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897057736" status: 202 len: 0 microversion: 2.1 time: 0.041486 Aug 29 05:22:50.608064 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2978/5944] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 05:22:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897057736 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:22:50.946132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5320e3fd-73ea-43c7-9161-004dadc29aa3 req-7cc028b6-e4da-4a92-95ad-4d5b45019757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca7086a3-4bf4-4069-92a4-dc6185fafe8d", "tag": "e539dde5-da4f-4deb-8f38-cf9450f0fea7"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:50.962393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5320e3fd-73ea-43c7-9161-004dadc29aa3 req-7cc028b6-e4da-4a92-95ad-4d5b45019757 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:50.962946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5320e3fd-73ea-43c7-9161-004dadc29aa3 req-7cc028b6-e4da-4a92-95ad-4d5b45019757 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:50.963306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5320e3fd-73ea-43c7-9161-004dadc29aa3 req-7cc028b6-e4da-4a92-95ad-4d5b45019757 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:50.978519 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5320e3fd-73ea-43c7-9161-004dadc29aa3 req-7cc028b6-e4da-4a92-95ad-4d5b45019757 service nova] Creating event network-changed:e539dde5-da4f-4deb-8f38-cf9450f0fea7 for instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d on n-h1-854119-9 Aug 29 05:22:50.984052 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5320e3fd-73ea-43c7-9161-004dadc29aa3 req-7cc028b6-e4da-4a92-95ad-4d5b45019757 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041492 Aug 29 05:22:50.984932 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2967/5945] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:53.173051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e94e8c03-49a7-4352-bb52-71dbfbbe882e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:53.175643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e94e8c03-49a7-4352-bb52-71dbfbbe882e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:53.186991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e94e8c03-49a7-4352-bb52-71dbfbbe882e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:53.187559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e94e8c03-49a7-4352-bb52-71dbfbbe882e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:53.188915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e94e8c03-49a7-4352-bb52-71dbfbbe882e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:53.194021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e94e8c03-49a7-4352-bb52-71dbfbbe882e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:53.194733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e94e8c03-49a7-4352-bb52-71dbfbbe882e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:53.195290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e94e8c03-49a7-4352-bb52-71dbfbbe882e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:53.203881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:22:53.257455 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e94e8c03-49a7-4352-bb52-71dbfbbe882e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/ips" status: 200 len: 144 microversion: 2.1 time: 0.097968 Aug 29 05:22:53.258070 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2979/5946] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:22:53 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/ips => generated 144 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:54.952420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-339059917", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "8741d5cf-41df-4e83-8c96-bb20519598e2"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:55.042122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] validate_networks() for [('8741d5cf-41df-4e83-8c96-bb20519598e2', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:22:55.986995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:22:55.987628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:22:55.988300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:22:55.988908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:22:55.989637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:22:56.011428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:56.011913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:56.012575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:56.013308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:56.013996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:56.014422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:56.034549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:22:56.041189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for user 87aef4a0e8af4640b7f1dd06e446eb0d and project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:22:56.057962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:22:56.061807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:22:56.120840 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16bc1f21-b54a-4748-a04b-2c0a33a80bfc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.388216 Aug 29 05:22:56.122249 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2968/5947] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:22:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:22:56.136686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea174522-67ca-436e-909b-45d653c60e35 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:56.137462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea174522-67ca-436e-909b-45d653c60e35 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:56.205064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea174522-67ca-436e-909b-45d653c60e35 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:56.213427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea174522-67ca-436e-909b-45d653c60e35 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1192 microversion: 2.1 time: 0.084773 Aug 29 05:22:56.220740 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2980/5948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:56 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:56.712897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5101c46e-c976-4c0c-a9e2-08e75b908d33 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "916913e8-b645-41cd-8060-d31f47523941"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:22:56.715351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5101c46e-c976-4c0c-a9e2-08e75b908d33 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:56.722064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5101c46e-c976-4c0c-a9e2-08e75b908d33 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:56.723015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5101c46e-c976-4c0c-a9e2-08e75b908d33 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:56.723615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5101c46e-c976-4c0c-a9e2-08e75b908d33 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:56.724629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5101c46e-c976-4c0c-a9e2-08e75b908d33 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:56.725241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5101c46e-c976-4c0c-a9e2-08e75b908d33 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:56.725819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5101c46e-c976-4c0c-a9e2-08e75b908d33 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:57.219459 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5101c46e-c976-4c0c-a9e2-08e75b908d33 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510378 Aug 29 05:22:57.220650 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2969/5949] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:22:56 2022] POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:22:57.239007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:57.239635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:57.255970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:57.256521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:57.256985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:57.273964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:57.275252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:57.276815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:57.502018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:57.510681 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0436105b-261a-40cf-9718-31fbeeb64f32 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1244 microversion: 2.1 time: 0.276137 Aug 29 05:22:57.520209 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2981/5950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:57 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1244 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:22:58.548896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:58.550256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:58.566334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:58.567024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:58.567774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:58.568997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:58.569961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:58.570877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:58.813428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:22:58.826756 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd781c05-64dc-468c-afda-e7849490e420 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1250 microversion: 2.1 time: 0.286322 Aug 29 05:22:58.827365 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2970/5951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:58 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1250 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:22:59.848717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:22:59.850260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:22:59.870981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:59.875142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:59.875821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:22:59.877022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:22:59.878534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:22:59.879501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:00.595538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:00.607581 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-264119de-2b04-457a-8e72-877ec745c238 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.763618 Aug 29 05:23:00.609232 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2982/5952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:22:59 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:00.909315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6f866423-2af3-488a-9e57-28941d0824cd req-8a3b8bf8-c655-4952-a3e3-cd177fe5cff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316f8d51-a11d-4fac-9c61-46830a04cc97", "tag": "64288f2d-9c6a-47b5-9f59-b74d8d50e177"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:00.938583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6f866423-2af3-488a-9e57-28941d0824cd req-8a3b8bf8-c655-4952-a3e3-cd177fe5cff4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:00.939465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6f866423-2af3-488a-9e57-28941d0824cd req-8a3b8bf8-c655-4952-a3e3-cd177fe5cff4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:00.940530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6f866423-2af3-488a-9e57-28941d0824cd req-8a3b8bf8-c655-4952-a3e3-cd177fe5cff4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:00.955253 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6f866423-2af3-488a-9e57-28941d0824cd req-8a3b8bf8-c655-4952-a3e3-cd177fe5cff4 service nova] Creating event network-changed:64288f2d-9c6a-47b5-9f59-b74d8d50e177 for instance 316f8d51-a11d-4fac-9c61-46830a04cc97 on n-h1-854119-9 Aug 29 05:23:00.961700 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6f866423-2af3-488a-9e57-28941d0824cd req-8a3b8bf8-c655-4952-a3e3-cd177fe5cff4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057344 Aug 29 05:23:00.962925 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2971/5953] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:01.573288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:01.573797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:01.584797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:01.585299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:01.585806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:01.586534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:01.586995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:01.587573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:01.630189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:23:01.630420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:01.631008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:01.645681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:01.646120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:01.646558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:01.653657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:01.654229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:01.654673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:01.782879 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d16899cd-3edd-45b1-8df0-e8f15e352461 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 204 len: 0 microversion: 2.1 time: 0.214384 Aug 29 05:23:01.786852 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2983/5954] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:23:01 2022] DELETE /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:23:01.792407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:01.793116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:01.808831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:01.812673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:01.813366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:01.816066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:01.816596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:01.817039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:01.960702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:01.972635 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aed18bed-740a-4922-96a3-ab46e1ee4290 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.346608 Aug 29 05:23:01.973225 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2972/5955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:01 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:02.004346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:02.015062 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf1af6fb-619d-40aa-a189-6d42b2185f22 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1509 microversion: 2.1 time: 0.226643 Aug 29 05:23:02.015908 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2984/5956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:01 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:02.995459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:02.996886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:03.005056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:03.005546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:03.006184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:03.007100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:03.007558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:03.007985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:03.038370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:03.039807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:03.048959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:03.049540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:03.050153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:03.051185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:03.051761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:03.052489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:03.241943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:03.252246 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-085813b0-0659-4b07-b97e-be333125ff1d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.262224 Aug 29 05:23:03.253323 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2973/5957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:02 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:03.258745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:03.267655 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d70730c2-2221-4086-964a-b7c0bdc4452e tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1509 microversion: 2.1 time: 0.233988 Aug 29 05:23:03.268617 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2985/5958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:03 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:04.272256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:04.272923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:04.280197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:04.280959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:04.281658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:04.282592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:04.283261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:04.289067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:04.289750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:04.290292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:04.297105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:04.297897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:04.298616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:04.299573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:04.300349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:04.301004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:04.489798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:04.502667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:04.511962 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e00dc863-a691-4142-b61e-708e2a9eb780 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1509 microversion: 2.1 time: 0.226810 Aug 29 05:23:04.514844 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3832f45-448e-4620-84e2-4af0ef5c8976 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.246768 Aug 29 05:23:04.515426 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2974/5959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:04 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:04.515867 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2986/5960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:04 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:05.150027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:05.150796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:05.164349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:05.165104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:05.170942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:05.171918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:05.172576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:05.173166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:05.212376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:23:05.306339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:05.383918 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf107647-08ae-4ec4-9411-d961edeba3af tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 204 len: 0 microversion: 2.1 time: 0.245388 Aug 29 05:23:05.385025 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2975/5961] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:23:05 2022] DELETE /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:23:05.393542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:05.394206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:05.408705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:05.409652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:05.411484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:05.412526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:05.413139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:05.414516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:05.535921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:05.537058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:05.546816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:05.547590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:05.548388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:05.549545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:05.550358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:05.551879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:05.706939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:05.717622 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-468f1312-7508-4072-abac-41d6bbe45b46 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1551 microversion: 2.1 time: 0.328304 Aug 29 05:23:05.719137 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2987/5962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:05 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1551 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:05.724835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:05.725669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:05.733807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:05.734484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:05.735078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:05.736110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:05.736765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:05.737414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:05.899511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:05.907805 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b4098c1b-07e3-4b3d-8a09-8c1aa3824b7b tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1509 microversion: 2.1 time: 0.377037 Aug 29 05:23:05.910770 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2976/5963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:05 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:05.998290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:06.009216 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-410fae07-42bd-49c0-afde-cb058b6f7ace tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.288345 Aug 29 05:23:06.015473 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2988/5964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:05 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:06.232547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-27d32f73-be80-40e2-a3db-a74748d5ddc9 req-d58bfb59-f5ad-4fde-a6e6-03304d06434e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad", "name": "network-vif-deleted", "tag": "8dff913e-f7b3-4847-8d11-cb56b6128a5a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:06.239886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:06.240935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:06.247271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-27d32f73-be80-40e2-a3db-a74748d5ddc9 req-d58bfb59-f5ad-4fde-a6e6-03304d06434e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:06.247907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-27d32f73-be80-40e2-a3db-a74748d5ddc9 req-d58bfb59-f5ad-4fde-a6e6-03304d06434e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:06.248376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-27d32f73-be80-40e2-a3db-a74748d5ddc9 req-d58bfb59-f5ad-4fde-a6e6-03304d06434e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:06.261752 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-27d32f73-be80-40e2-a3db-a74748d5ddc9 req-d58bfb59-f5ad-4fde-a6e6-03304d06434e service nova] Creating event network-vif-deleted:8dff913e-f7b3-4847-8d11-cb56b6128a5a for instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad on n-h1-854119-9 Aug 29 05:23:06.267012 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-27d32f73-be80-40e2-a3db-a74748d5ddc9 req-d58bfb59-f5ad-4fde-a6e6-03304d06434e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038418 Aug 29 05:23:06.270747 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2977/5965] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:23:06.739096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:06.739809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:06.741949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:06.752895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:06.753507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:06.754683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:06.755282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:06.757003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:06.758032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:06.930527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:06.933220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:06.933991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:06.939067 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e14bed0e-90d5-40b6-bdd0-3203e4c23141 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1551 microversion: 2.1 time: 0.203984 Aug 29 05:23:06.941543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:06.942154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:06.942675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:06.943454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:06.944007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:06.944697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:06.953903 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2989/5966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:06 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1551 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:06.982876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:06.983369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:06.983810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:06.984311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lazy-loading 'fault' on Instance uuid 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:23:07.039461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:07.044547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:07.045787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:07.048268 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30b6215b-e7ff-4b41-8d3b-abaaed085d85 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 200 len: 1312 microversion: 2.1 time: 0.120486 Aug 29 05:23:07.052574 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2978/5967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:06 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:07.056179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:07.056756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:07.057206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:07.057921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:07.058380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:07.058808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:07.207135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:07.215297 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-119fce8d-b689-483b-beae-a47740d3b527 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.177577 Aug 29 05:23:07.215973 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2990/5968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:07 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:07.962313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:07.963499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:07.970698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:07.971403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:07.972409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:07.973387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:07.973901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:07.974335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.050431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:08.058382 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0c921cf9-144a-40f1-85be-028245885d5c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1333 microversion: 2.1 time: 0.100410 Aug 29 05:23:08.059226 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2979/5969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:07 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:08.070674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:08.072143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:08.079240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.080092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.080717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.081859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.082797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.083383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.104002 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] HTTP exception thrown: Instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad could not be found. Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Request method failure captured: Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad HTTP/1.1 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEvMW3izJD85pVtbvax1SMfCuq2_Uf3UUHBG6YwbWLNgoxV3uYJIzYl-i9v4vjXyxY9Qq6gcnhWdP6WFxclBgQAU6dml8-Y-HMFx3s3QV0g_wjEpxDyxcKn6d9J-7o-Mew1NhfWoJLNGc1dBi1srqaIaTALn7VpmZsYiGBl2GStsVDM Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63bbfe3da13249fa9f9fe77f7725d037", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: b9574a5f99bf4401a8a2297c71d3e382 Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad could not be found. Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad'} Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad could not be found. Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad could not be found. Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:08.106101 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:08.110832 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:08.110832 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:08.110832 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:08.110832 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:08.110832 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:23:08.110832 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:23:08.110832 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad could not be found. Aug 29 05:23:08.110832 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:08.113764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Returning 404 to user: Instance 6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:23:08.115524 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2c0c2206-f5bb-4702-a9fb-8b25a9080acb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad" status: 404 len: 111 microversion: 2.1 time: 0.048949 Aug 29 05:23:08.116602 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2991/5970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:08 2022] GET /compute/v2.1/servers/6d88f95f-2a3c-4bd8-bc1b-3795dbede1ad => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:23:08.126155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:08.126829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:08.134787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.136064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.136862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.138148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.138998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.139618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.144247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9c179935-fd80-44fd-9da1-adeb235eda45 req-e181c569-3124-49aa-b465-9115a4313b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316f8d51-a11d-4fac-9c61-46830a04cc97", "name": "network-vif-plugged", "status": "completed", "tag": "64288f2d-9c6a-47b5-9f59-b74d8d50e177"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:08.162079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c179935-fd80-44fd-9da1-adeb235eda45 req-e181c569-3124-49aa-b465-9115a4313b6f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.162804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c179935-fd80-44fd-9da1-adeb235eda45 req-e181c569-3124-49aa-b465-9115a4313b6f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.163581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9c179935-fd80-44fd-9da1-adeb235eda45 req-e181c569-3124-49aa-b465-9115a4313b6f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.181008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:23:08.210507 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9c179935-fd80-44fd-9da1-adeb235eda45 req-e181c569-3124-49aa-b465-9115a4313b6f service nova] Creating event network-vif-plugged:64288f2d-9c6a-47b5-9f59-b74d8d50e177 for instance 316f8d51-a11d-4fac-9c61-46830a04cc97 on n-h1-854119-9 Aug 29 05:23:08.227490 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9c179935-fd80-44fd-9da1-adeb235eda45 req-e181c569-3124-49aa-b465-9115a4313b6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094751 Aug 29 05:23:08.233044 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2992/5971] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:08.241207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:08.242203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:08.251684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.252601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.253447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.255435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.256193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.257069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.425310 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0e023a5-84d2-4c8d-926a-ef7fb0f118b6 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 204 len: 0 microversion: 2.1 time: 0.303532 Aug 29 05:23:08.425912 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2980/5972] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:23:08 2022] DELETE /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:23:08.435992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a0879f3f-7297-44d3-bea6-a6e06cdbcce0 req-80fa0b51-0acf-44c9-b728-bb47ede9170a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd58089-460d-48c9-80aa-f3979261f31b", "name": "network-vif-deleted", "tag": "51d8b560-1b67-47b8-b8da-4a564a55d974"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:08.447468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a0879f3f-7297-44d3-bea6-a6e06cdbcce0 req-80fa0b51-0acf-44c9-b728-bb47ede9170a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.448414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a0879f3f-7297-44d3-bea6-a6e06cdbcce0 req-80fa0b51-0acf-44c9-b728-bb47ede9170a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.449035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a0879f3f-7297-44d3-bea6-a6e06cdbcce0 req-80fa0b51-0acf-44c9-b728-bb47ede9170a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.467433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:08.470271 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a0879f3f-7297-44d3-bea6-a6e06cdbcce0 req-80fa0b51-0acf-44c9-b728-bb47ede9170a service nova] Creating event network-vif-deleted:51d8b560-1b67-47b8-b8da-4a564a55d974 for instance 8cd58089-460d-48c9-80aa-f3979261f31b on n-h1-854119-9 Aug 29 05:23:08.477578 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a0879f3f-7297-44d3-bea6-a6e06cdbcce0 req-80fa0b51-0acf-44c9-b728-bb47ede9170a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046136 Aug 29 05:23:08.478773 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2981/5973] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:08.483811 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f6423a2-965e-4367-a30b-f9ab94085833 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.247775 Aug 29 05:23:08.484641 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2993/5974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:08 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:08.488286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:08.489027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:08.499639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.502186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.502650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.504976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:08.505562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:08.506046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:08.673004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:08.692229 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f749f08-31e5-4c54-9857-926d2a184743 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.201680 Aug 29 05:23:08.692229 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2982/5975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:08 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:09.081354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:09.081889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:09.084995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:09.090606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:09.091211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:09.091632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:09.092369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:09.092821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:09.093235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:09.126343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:09.126854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:09.127288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:09.127730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lazy-loading 'fault' on Instance uuid 8cd58089-460d-48c9-80aa-f3979261f31b {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:23:09.169181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:09.177480 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57448471-260e-4b06-9384-0097c84c0335 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1338 microversion: 2.1 time: 0.100108 Aug 29 05:23:09.177988 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2994/5976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:09 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:09.505818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:09.506725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:09.514139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:09.514607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:09.515328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:09.516027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:09.516505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:09.516910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:09.652946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:09.660947 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-276e7cd2-f875-4ad2-b8d2-b5ac2f000fd2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.159343 Aug 29 05:23:09.661529 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2983/5977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:09 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:09.705450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:09.706218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:09.713130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:09.713712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:09.714248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:09.715048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:09.715575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:09.716075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:09.847327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:09.855575 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fdea038e-6e8b-4de1-b2c8-0d401ebf44cb tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.154399 Aug 29 05:23:09.856149 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2995/5978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:09 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:10.199365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:10.200004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:10.206698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:10.207177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:10.207604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:10.208341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:10.208797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:10.209217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:10.241565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:10.242035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:10.242463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:10.242915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lazy-loading 'fault' on Instance uuid 8cd58089-460d-48c9-80aa-f3979261f31b {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:23:10.284523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:10.292734 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39533465-5ff7-4c30-b21a-459761cf36ca tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1338 microversion: 2.1 time: 0.097795 Aug 29 05:23:10.293423 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2984/5979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:10 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:10.685314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:10.686333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:10.695005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:10.695524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:10.695954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:10.696998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:10.697502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:10.697926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:10.716566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:10.835421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:10.847342 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2c8702e6-a949-4bd1-8556-a47402864fc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.168293 Aug 29 05:23:10.848190 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2996/5980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:10 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:10.877027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:10.877658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:10.884939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:10.885595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:10.885822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:10.886509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:10.886955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:10.887371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:11.022005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:11.030229 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8dc92e07-7010-45ae-8991-f4e433f69f70 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.157121 Aug 29 05:23:11.030811 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2985/5981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:10 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:11.314050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:11.314666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:11.321658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:11.322153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:11.322569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:11.323269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:11.323722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:11.324224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:11.356236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:11.356735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:11.357158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:11.357618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lazy-loading 'fault' on Instance uuid 8cd58089-460d-48c9-80aa-f3979261f31b {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:23:11.397804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:11.405849 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cde0ed7d-e9e8-4b5e-a350-f8faf7b5edeb tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 200 len: 1338 microversion: 2.1 time: 0.095762 Aug 29 05:23:11.406359 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2997/5982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:11 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:11.874108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:11.874727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:11.876777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:11.883260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:11.883898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:11.884247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:11.884956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:11.885421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:11.885849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:12.026313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:12.034170 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-118da6fa-15c2-4a76-a50c-0f39db0ab803 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1292 microversion: 2.1 time: 0.164070 Aug 29 05:23:12.034747 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2986/5983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:11 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1292 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:12.051953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:12.052603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:12.060265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:12.060908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:12.061394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:12.062096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:12.062550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:12.063001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:12.202445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:12.211803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8529fcdc-0c89-41e4-83c4-48fb431382d1 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1521 microversion: 2.1 time: 0.163877 Aug 29 05:23:12.213080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2998/5984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:12 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:12.427277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:12.427853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 8cd58089-460d-48c9-80aa-f3979261f31b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:12.471288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:12.472231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:12.473686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:12.474622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:12.476636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:12.477379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:12.520664 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] HTTP exception thrown: Instance 8cd58089-460d-48c9-80aa-f3979261f31b could not be found. Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Request method failure captured: Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b HTTP/1.1 Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDExtF9qv4Kk3wBsz236s8ECO6UmwwijtjMoy1JAsdoIxXi59XM6xMnuoN8-V7yS6wDJX4wHsdQFMsywj-tPninW0_Nef5jkSib533O9EF0L6s_ztozhgonn7qqhCvMWxNS5SOFfMx-aybP9E8SIx-GzXkDkbgddq5M0MbR4UzfqHn04 Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 8538671f353b4984b7b18ee629e43b3d Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestNetworkBasicOps-543367892 Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8538671f353b4984b7b18ee629e43b3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8538671f353b4984b7b18ee629e43b3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8538671f353b4984b7b18ee629e43b3d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8538671f353b4984b7b18ee629e43b3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestNetworkBasicOps-543367892 Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 8538671f353b4984b7b18ee629e43b3d Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestNetworkBasicOps-543367892 Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestNetworkBasicOps-543367892-project Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: b5b779089f7f42399c57a9771787f911 Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestNetworkBasicOps-543367892-project Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 8cd58089-460d-48c9-80aa-f3979261f31b could not be found. Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8cd58089-460d-48c9-80aa-f3979261f31b'} Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd58089-460d-48c9-80aa-f3979261f31b could not be found. Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd58089-460d-48c9-80aa-f3979261f31b could not be found. Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:12.523008 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd58089-460d-48c9-80aa-f3979261f31b could not be found. Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Returning 404 to user: Instance 8cd58089-460d-48c9-80aa-f3979261f31b could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3a7081d7-4aee-4563-a424-c954d3a56f42 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b" status: 404 len: 111 microversion: 2.1 time: 0.102325 Aug 29 05:23:12.532055 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2987/5985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:12 2022] GET /compute/v2.1/servers/8cd58089-460d-48c9-80aa-f3979261f31b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:23:12.736029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1caee842-7c4b-41df-abc5-d6896d8b9635 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:12.747483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2842094-0b4b-4e72-8260-e7133626ae24 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '.version_select at 0x7f1ab9c17430>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:12.757034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1caee842-7c4b-41df-abc5-d6896d8b9635 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:12.757537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1caee842-7c4b-41df-abc5-d6896d8b9635 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:12.757978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1caee842-7c4b-41df-abc5-d6896d8b9635 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:12.778415 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2842094-0b4b-4e72-8260-e7133626ae24 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1427591114" status: 202 len: 0 microversion: 2.1 time: 0.035143 Aug 29 05:23:12.779645 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2988/5986] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Aug 29 05:23:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1427591114 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:23:12.796543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1caee842-7c4b-41df-abc5-d6896d8b9635 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Going to try to stop instance {{(pid=128872) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 05:23:12.849736 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1caee842-7c4b-41df-abc5-d6896d8b9635 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/action" status: 202 len: 0 microversion: 2.1 time: 0.117255 Aug 29 05:23:12.850395 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 2999/5987] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:23:12 2022] POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:23:12.860843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:12.861996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:12.872721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:12.873507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:12.876528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:12.877448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:12.878207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:12.879220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:13.015485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-96651aec-2505-47aa-861b-c11a31a3d8e1 req-fcd3e27e-0829-4f71-95bd-3d6783903d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfbf67c-0d97-4987-ab70-671c27ee0e87", "name": "network-vif-deleted", "tag": "24580187-5a1f-4a69-911d-d88f1019377a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:13.040500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-96651aec-2505-47aa-861b-c11a31a3d8e1 req-fcd3e27e-0829-4f71-95bd-3d6783903d21 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:13.041333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-96651aec-2505-47aa-861b-c11a31a3d8e1 req-fcd3e27e-0829-4f71-95bd-3d6783903d21 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:13.042539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-96651aec-2505-47aa-861b-c11a31a3d8e1 req-fcd3e27e-0829-4f71-95bd-3d6783903d21 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:13.060070 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-96651aec-2505-47aa-861b-c11a31a3d8e1 req-fcd3e27e-0829-4f71-95bd-3d6783903d21 service nova] Creating event network-vif-deleted:24580187-5a1f-4a69-911d-d88f1019377a for instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 on n-h1-854119-9 Aug 29 05:23:13.075659 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-96651aec-2505-47aa-861b-c11a31a3d8e1 req-fcd3e27e-0829-4f71-95bd-3d6783903d21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059312 Aug 29 05:23:13.078009 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3000/5988] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:23:13.080142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:13.086303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:13.087396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:13.095200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:13.095769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:13.096445 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-74d8f102-88b1-418b-afe6-e223b21c53d1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.241323 Aug 29 05:23:13.097083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:13.097752 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2989/5989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:12 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:13.111144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:13.111729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:13.112453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:13.189054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52e23708-5934-437f-8e99-35330fd4336c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:13.204706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52e23708-5934-437f-8e99-35330fd4336c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:13.218736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52e23708-5934-437f-8e99-35330fd4336c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:13.222710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52e23708-5934-437f-8e99-35330fd4336c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:13.223425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52e23708-5934-437f-8e99-35330fd4336c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:13.226230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52e23708-5934-437f-8e99-35330fd4336c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:13.226230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52e23708-5934-437f-8e99-35330fd4336c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:13.226731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52e23708-5934-437f-8e99-35330fd4336c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:13.335394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52e23708-5934-437f-8e99-35330fd4336c tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9/action" status: 200 len: 24554 microversion: 2.1 time: 0.150738 Aug 29 05:23:13.337243 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2990/5990] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:23:13 2022] POST /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9/action => generated 24554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 05:23:13.344345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:13.345600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:13.354650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:13.359913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:13.360855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:13.361671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:13.362298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:13.362806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:13.379311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:13.395462 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-520880bb-e770-481d-9b07-64377445f531 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1473 microversion: 2.1 time: 0.314967 Aug 29 05:23:13.396341 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3001/5991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:13 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1473 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:13.450671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:13.453511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:13.457030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:13.457383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lazy-loading 'fault' on Instance uuid cbfbf67c-0d97-4987-ab70-671c27ee0e87 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:23:13.592547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9574a5f99bf4401a8a2297c71d3e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bbfe3da13249fa9f9fe77f7725d037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:13.597873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1522209558", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:13.610076 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f7dc6eda-cf18-456a-bf97-fdc097170da7 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 200 len: 1311 microversion: 2.1 time: 0.271295 Aug 29 05:23:13.616280 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2991/5992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:13 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 1311 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:13.676165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] validate_networks() for [('8741d5cf-41df-4e83-8c96-bb20519598e2', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:23:14.118414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:14.119033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:14.127321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:14.127860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:14.128339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:14.129053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:14.129540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:14.129970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:14.682221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:14.684577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:14.699302 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1409d025-d23d-4767-8e7b-aa898582a822 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.584724 Aug 29 05:23:14.700786 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2992/5993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:14 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:14.706222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:14.707173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] [instance: cbfbf67c-0d97-4987-ab70-671c27ee0e87] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:14.719556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:14.720785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:14.721223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:14.721986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:14.722452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:14.722876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:14.734935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:23:14.737586 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] HTTP exception thrown: Instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 could not be found. Aug 29 05:23:14.737992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:23:14.738704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:23:14.739322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Request method failure captured: Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 HTTP/1.1 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEvMW3izJD85pVtbvax1SMfCuq2_Uf3UUHBG6YwbWLNgoxV3uYJIzYl-i9v4vjXyxY9Qq6gcnhWdP6WFxclBgQAU6dml8-Y-HMFx3s3QV0g_wjEpxDyxcKn6d9J-7o-Mew1NhfWoJLNGc1dBi1srqaIaTALn7VpmZsYiGBl2GStsVDM Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63bbfe3da13249fa9f9fe77f7725d037", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63bbfe3da13249fa9f9fe77f7725d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 63bbfe3da13249fa9f9fe77f7725d037 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-312491119 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: b9574a5f99bf4401a8a2297c71d3e382 Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-312491119-project Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 could not be found. Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'cbfbf67c-0d97-4987-ab70-671c27ee0e87'} Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 could not be found. Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 could not be found. Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:14.739623 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:14.744525 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:14.744525 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:14.744525 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:14.744525 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:14.744525 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:23:14.744525 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:23:14.744525 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 could not be found. Aug 29 05:23:14.744525 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:14.745154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:23:14.745250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] Returning 404 to user: Instance cbfbf67c-0d97-4987-ab70-671c27ee0e87 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:23:14.745250 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68f3ce95-ee12-4f27-a025-a2f2e2129e81 tempest-ServerRescueNegativeTestJSON-312491119 tempest-ServerRescueNegativeTestJSON-312491119-project] 10.222.0.20 "GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87" status: 404 len: 111 microversion: 2.1 time: 0.041650 Aug 29 05:23:14.745250 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2993/5994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:14 2022] GET /compute/v2.1/servers/cbfbf67c-0d97-4987-ab70-671c27ee0e87 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:23:14.757244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:14.757512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:14.757897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:14.758627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:14.759089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:14.759513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:14.780003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:23:14.789367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for user 87aef4a0e8af4640b7f1dd06e446eb0d and project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:23:14.804041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:23:14.806434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 49da7f12-883a-4c40-9b37-9a730f572da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:23:14.867106 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b970411d-2c41-48d7-a4cf-81b20230ab41 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.272675 Aug 29 05:23:14.874311 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3002/5995] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:23:14.880417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-41f46b43-5725-4983-a353-e49aa233d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:14.881190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-41f46b43-5725-4983-a353-e49aa233d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 49da7f12-883a-4c40-9b37-9a730f572da5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:14.983016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-41f46b43-5725-4983-a353-e49aa233d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 49da7f12-883a-4c40-9b37-9a730f572da5] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:23:15.373115 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.scheduler.client.report [None req-41f46b43-5725-4983-a353-e49aa233d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Deleted allocations for instance 49da7f12-883a-4c40-9b37-9a730f572da5 Aug 29 05:23:15.379756 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-41f46b43-5725-4983-a353-e49aa233d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 49da7f12-883a-4c40-9b37-9a730f572da5] Instance Mapping does not exist while attempting local delete cleanup. Aug 29 05:23:15.380750 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-41f46b43-5725-4983-a353-e49aa233d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5" status: 204 len: 0 microversion: 2.1 time: 0.505569 Aug 29 05:23:15.381647 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2994/5996] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:23:14 2022] DELETE /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:23:15.392473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d866c9b-7832-440b-81fd-437613713f6c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:15.393120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7d866c9b-7832-440b-81fd-437613713f6c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 49da7f12-883a-4c40-9b37-9a730f572da5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:15.401136 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-7d866c9b-7832-440b-81fd-437613713f6c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d866c9b-7832-440b-81fd-437613713f6c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5 HTTP/1.1 Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '49da7f12-883a-4c40-9b37-9a730f572da5'} Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:15.403007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:15.407985 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:15.407985 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:23:15.407985 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:23:15.407985 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:23:15.407985 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:23:15.407985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d866c9b-7832-440b-81fd-437613713f6c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:23:15.407985 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7d866c9b-7832-440b-81fd-437613713f6c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5" status: 404 len: 111 microversion: 2.1 time: 0.018328 Aug 29 05:23:15.415024 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3003/5997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:15 2022] GET /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:23:15.467155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1705146781", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "8741d5cf-41df-4e83-8c96-bb20519598e2"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:15.523863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] validate_networks() for [('8741d5cf-41df-4e83-8c96-bb20519598e2', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:23:15.723941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:15.725114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:15.734170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:15.734690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:15.735128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:15.737359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:15.737828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:15.738260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:16.001227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:16.013414 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df77b70b-52eb-4b56-83ce-f7e22b35d133 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.295605 Aug 29 05:23:16.024735 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3004/5998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:15 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:16.052363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:23:16.052812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:23:16.053316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:23:16.053726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:23:16.054148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:23:16.065634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:16.066677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:16.067362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:16.068287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:16.069034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:16.069800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:16.094122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:23:16.099723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for user 87aef4a0e8af4640b7f1dd06e446eb0d and project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:23:16.116967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:23:16.119657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:23:16.171054 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b1b738d3-8746-4118-8180-bc2a996e1983 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708812 Aug 29 05:23:16.172460 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2995/5999] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:23:16.182727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17a7f2f7-2d04-4cee-9780-d0445aa74bc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:16.183634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-17a7f2f7-2d04-4cee-9780-d0445aa74bc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:16.247046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-17a7f2f7-2d04-4cee-9780-d0445aa74bc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:16.258582 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17a7f2f7-2d04-4cee-9780-d0445aa74bc3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1221 microversion: 2.1 time: 0.079062 Aug 29 05:23:16.259620 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3005/6000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:16 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:16.450967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:16.452309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:16.472055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:16.476007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:16.476988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:16.479902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:16.480823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:16.482299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:16.557855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:23:16.730839 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2235e5f7-c068-4eb1-bae6-f68cbfc7e021 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 204 len: 0 microversion: 2.1 time: 0.286077 Aug 29 05:23:16.735680 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2996/6001] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:23:16 2022] DELETE /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:23:16.746442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:16.747158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:16.751716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-bc669ec8-57e1-4c95-83aa-3f04fa857dc5 req-08721d59-8593-4aec-a52c-51c6ab55bf5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6033bce-fbdd-4c3e-bb86-e964a7160e5a", "tag": "a0c578a4-6429-4ede-9c74-08a8970b8e2d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:16.754972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:16.755543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:16.756727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:16.757693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:16.758336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:16.758994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:16.773076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bc669ec8-57e1-4c95-83aa-3f04fa857dc5 req-08721d59-8593-4aec-a52c-51c6ab55bf5c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:16.773773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bc669ec8-57e1-4c95-83aa-3f04fa857dc5 req-08721d59-8593-4aec-a52c-51c6ab55bf5c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:16.776496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bc669ec8-57e1-4c95-83aa-3f04fa857dc5 req-08721d59-8593-4aec-a52c-51c6ab55bf5c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:16.806878 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-bc669ec8-57e1-4c95-83aa-3f04fa857dc5 req-08721d59-8593-4aec-a52c-51c6ab55bf5c service nova] Creating event network-changed:a0c578a4-6429-4ede-9c74-08a8970b8e2d for instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a on n-h1-854119-9 Aug 29 05:23:16.815809 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-bc669ec8-57e1-4c95-83aa-3f04fa857dc5 req-08721d59-8593-4aec-a52c-51c6ab55bf5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.365762 Aug 29 05:23:16.817255 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3006/6002] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:16.933119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:16.941828 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12f87aec-506c-45e0-bed1-d4517515a720 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1671 microversion: 2.1 time: 0.203526 Aug 29 05:23:16.958122 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2997/6003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:16 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1671 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:17.041582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:17.042624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:17.049433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:17.050196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:17.050797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:17.051671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:17.052358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:17.052946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:17.283026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:17.289410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:17.291375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:17.301914 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a3e94d93-b906-47a4-950e-15098d010040 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.264536 Aug 29 05:23:17.306536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:17.307457 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3007/6004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:17 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:17.308379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:17.309183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:17.310266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:17.310942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:17.311558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:17.393013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:17.401967 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fef3fe19-53e5-4a6e-b1f9-b1f934123ee8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1225 microversion: 2.1 time: 0.126722 Aug 29 05:23:17.403998 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2998/6005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:17 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:17.969224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:17.970118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:17.987616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:17.988221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:17.989222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:17.989976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:17.990433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:17.993743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:18.327995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:18.328735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:18.336034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:18.336714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:18.338701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:18.339572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:18.340285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:18.340811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:18.517967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:18.541827 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d111cda8-cbb4-4390-8f66-9f2c79fbd863 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1671 microversion: 2.1 time: 0.579631 Aug 29 05:23:18.542729 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3008/6006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:17 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1671 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:18.563118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:18.563739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:18.572966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:18.573529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:18.573987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:18.574726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:18.575176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:18.575739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:18.738647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:18.754136 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-89aef785-f272-41ad-ae42-5d518658d3e5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1273 microversion: 2.1 time: 0.209724 Aug 29 05:23:18.755075 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3009/6007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:18 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:18.783145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:18.798249 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-950ed3ac-bdf6-482a-8a82-4cbd53f4b848 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.474083 Aug 29 05:23:18.799063 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 2999/6008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:18 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:19.572332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:19.573715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:19.590477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:19.591765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:19.592469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:19.609777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:19.610655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:19.611526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:19.781528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:19.784520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:19.797684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:19.798168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:19.799259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:19.800620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:19.801248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:19.801846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:20.160958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:20.169489 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-beb1882f-d730-4d9e-b0d0-bef103b375f2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1279 microversion: 2.1 time: 0.393044 Aug 29 05:23:20.170262 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3000/6009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:19 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1279 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:20.175382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:20.176285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:20.189975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:20.190607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:20.191081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:20.191936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:20.192405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:20.192817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:20.500132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:20.508735 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0725c0e-93c5-46cc-ba8c-817a1bd2059b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1671 microversion: 2.1 time: 0.948535 Aug 29 05:23:20.509396 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3010/6010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:19 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1671 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:20.666957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:20.678795 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5b8408fe-007d-41c5-9d17-8cbb3595398f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.507256 Aug 29 05:23:20.679475 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3001/6011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:20 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:20.823994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6ee53acf-86d7-43d8-be7e-29acc57cd87f req-c009302c-b0df-44d6-8e9e-3438b21219bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6033bce-fbdd-4c3e-bb86-e964a7160e5a", "name": "network-vif-deleted", "tag": "a0c578a4-6429-4ede-9c74-08a8970b8e2d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:20.835515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6ee53acf-86d7-43d8-be7e-29acc57cd87f req-c009302c-b0df-44d6-8e9e-3438b21219bd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:20.836000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6ee53acf-86d7-43d8-be7e-29acc57cd87f req-c009302c-b0df-44d6-8e9e-3438b21219bd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:20.836871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6ee53acf-86d7-43d8-be7e-29acc57cd87f req-c009302c-b0df-44d6-8e9e-3438b21219bd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:20.851574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6ee53acf-86d7-43d8-be7e-29acc57cd87f req-c009302c-b0df-44d6-8e9e-3438b21219bd service nova] Creating event network-vif-deleted:a0c578a4-6429-4ede-9c74-08a8970b8e2d for instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a on n-h1-854119-9 Aug 29 05:23:20.871143 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6ee53acf-86d7-43d8-be7e-29acc57cd87f req-c009302c-b0df-44d6-8e9e-3438b21219bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051185 Aug 29 05:23:20.875848 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3011/6012] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:21.192287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:21.192889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:21.209136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:21.232982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:21.233431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:21.234192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:21.239435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:21.240331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:21.531453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:21.532900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:21.559994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:21.560740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:21.562764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:21.563755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:21.566146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:21.568927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:21.635789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:21.636579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:21.637202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:21.637842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lazy-loading 'fault' on Instance uuid a6033bce-fbdd-4c3e-bb86-e964a7160e5a {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:23:21.726920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:21.739851 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2e4fd4cd-9435-42de-9472-e94bd72d8f73 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 200 len: 1339 microversion: 2.1 time: 0.212071 Aug 29 05:23:21.740502 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3012/6013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:21 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 1339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:21.752872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:21.764301 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d51c66b8-44d0-49c1-8d85-3226a9349f85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1321 microversion: 2.1 time: 0.576508 Aug 29 05:23:21.765459 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3002/6014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:21 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:21.780660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:21.782224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:21.796889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:21.798090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:21.799810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:21.801469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:21.802159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:21.802812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:22.080414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:22.090015 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59efa015-6abc-4a54-8ceb-9af83135d879 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.332595 Aug 29 05:23:22.091089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3013/6015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:21 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:22.762883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:22.770765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: a6033bce-fbdd-4c3e-bb86-e964a7160e5a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:22.782804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:22.784247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:22.784910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:22.785725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:22.786341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:22.786548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:22.787497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:22.788735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:22.802183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:22.802608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:22.803047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:22.803769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:22.804259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:22.804696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:22.811007 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] HTTP exception thrown: Instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a could not be found. Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Request method failure captured: Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a HTTP/1.1 Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDExtF9qv4Kk3wBsz236s8ECO6UmwwijtjMoy1JAsdoIxXi59XM6xMnuoN8-V7yS6wDJX4wHsdQFMsywj-tPninW0_Nef5jkSib533O9EF0L6s_ztozhgonn7qqhCvMWxNS5SOFfMx-aybP9E8SIx-GzXkDkbgddq5M0MbR4UzfqHn04 Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 8538671f353b4984b7b18ee629e43b3d Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestNetworkBasicOps-543367892 Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8538671f353b4984b7b18ee629e43b3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8538671f353b4984b7b18ee629e43b3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8538671f353b4984b7b18ee629e43b3d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8538671f353b4984b7b18ee629e43b3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestNetworkBasicOps-543367892 Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 8538671f353b4984b7b18ee629e43b3d Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestNetworkBasicOps-543367892 Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestNetworkBasicOps-543367892-project Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: b5b779089f7f42399c57a9771787f911 Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestNetworkBasicOps-543367892-project Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a could not be found. Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'a6033bce-fbdd-4c3e-bb86-e964a7160e5a'} Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a could not be found. Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a could not be found. Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:22.813960 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:22.818306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:22.818306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:22.818306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:22.818306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:23:22.818306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:23:22.818306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a could not be found. Aug 29 05:23:22.818306 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:22.821440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Returning 404 to user: Instance a6033bce-fbdd-4c3e-bb86-e964a7160e5a could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:23:22.823838 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-88f4f738-682b-4241-b2c6-1dc0726cdaf1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a" status: 404 len: 111 microversion: 2.1 time: 0.064856 Aug 29 05:23:22.824884 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3003/6016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:22 2022] GET /compute/v2.1/servers/a6033bce-fbdd-4c3e-bb86-e964a7160e5a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:23:22.924181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-76b9a447-c96a-4c7d-a9af-17bfcba1f0ff req-8a267bca-86b8-44b8-a989-8647333334ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43", "tag": "ef665ab1-f6b3-4262-aacc-bc369714ada4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:22.935155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-76b9a447-c96a-4c7d-a9af-17bfcba1f0ff req-8a267bca-86b8-44b8-a989-8647333334ca service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:22.936061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-76b9a447-c96a-4c7d-a9af-17bfcba1f0ff req-8a267bca-86b8-44b8-a989-8647333334ca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:22.936571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-76b9a447-c96a-4c7d-a9af-17bfcba1f0ff req-8a267bca-86b8-44b8-a989-8647333334ca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:22.951697 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-76b9a447-c96a-4c7d-a9af-17bfcba1f0ff req-8a267bca-86b8-44b8-a989-8647333334ca service nova] Creating event network-changed:ef665ab1-f6b3-4262-aacc-bc369714ada4 for instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 on n-h1-854119-9 Aug 29 05:23:22.960254 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-76b9a447-c96a-4c7d-a9af-17bfcba1f0ff req-8a267bca-86b8-44b8-a989-8647333334ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039487 Aug 29 05:23:22.962103 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3004/6017] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:23:23.058671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:23.068422 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed2adf23-6355-49e1-856f-1afdaaf740d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1321 microversion: 2.1 time: 0.286416 Aug 29 05:23:23.070500 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3014/6018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:22 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:23.113617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:23.114619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:23.124999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:23.125889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:23.126526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:23.128240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:23.129071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:23.129213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f24a8197-4fd3-4055-8fae-2e118dce1711 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '.version_select at 0x7f1ab895eee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:23.130578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:23.188013 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f24a8197-4fd3-4055-8fae-2e118dce1711 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1175177225" status: 202 len: 0 microversion: 2.1 time: 0.063715 Aug 29 05:23:23.188649 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3015/6019] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Aug 29 05:23:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1175177225 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:23:23.350168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:23.359765 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-55220ebd-213d-4c3a-ab0f-7a54bf5ae324 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.251182 Aug 29 05:23:23.369500 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3005/6020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:23 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:24.106843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:24.107472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:24.115633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:24.116259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:24.116931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:24.117649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:24.118234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:24.118666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:24.299794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39d9e79b-95b6-4bbe-99aa-200d7ad66d48 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab97e4550>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:24.356541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:24.366486 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-584ed81e-f31e-40ad-a57e-d0dae6b41c6e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1321 microversion: 2.1 time: 0.265418 Aug 29 05:23:24.368412 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3016/6021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:24 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:24.381340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:24.383883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:24.392049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:24.392602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:24.393101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:24.393822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:24.394430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:24.394874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:24.402702 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39d9e79b-95b6-4bbe-99aa-200d7ad66d48 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/61d0e31b-c1aa-456c-b5fa-b87ca5e29865" status: 200 len: 351 microversion: 2.1 time: 0.107747 Aug 29 05:23:24.403291 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3006/6022] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:23:24 2022] GET /compute/v2.1/os-volumes/61d0e31b-c1aa-456c-b5fa-b87ca5e29865 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:24.403791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:24.590902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:24.601557 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e50000f1-304e-4a1c-bf37-5f7ac70c2f43 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.224195 Aug 29 05:23:24.603001 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3017/6023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:24 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:25.390699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:25.391696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:25.406238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:25.407206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:25.408241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:25.413197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:25.414026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:25.414662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:25.625094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:25.625735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:25.635175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:25.644477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:25.645233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:25.646399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:25.649708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:25.651366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:25.652928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:25.962497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:25.984158 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3f99e2de-d0d0-4702-b2c5-4674c0cb473c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1321 microversion: 2.1 time: 0.598087 Aug 29 05:23:25.999767 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3007/6024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:25 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:26.101079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:26.112065 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d66d667d-e0e8-4e16-bc60-fad318525cd3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.492800 Aug 29 05:23:26.112694 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3018/6025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:25 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:26.985417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-50999be3-1171-41ba-a00d-05351964b489 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab9dd6940>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:26.997081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:26.998757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:27.012976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:27.014662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:27.019011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:27.040450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:27.040967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:27.043510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:27.046086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:27.046592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:27.047161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:27.094941 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-50999be3-1171-41ba-a00d-05351964b489 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/14331338-b920-4da1-88d0-cc090a15c569" status: 200 len: 350 microversion: 2.1 time: 0.115035 Aug 29 05:23:27.104619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3008/6026] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:23:26 2022] GET /compute/v2.1/os-volumes/14331338-b920-4da1-88d0-cc090a15c569 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:27.134210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:27.135070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:27.143853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:27.144613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:27.145204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:27.146064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:27.146964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:27.148728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:27.377223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:27.387365 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-579fe131-34e3-44ab-9ee3-6907aade8e2f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1321 microversion: 2.1 time: 0.381756 Aug 29 05:23:27.399902 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3019/6027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:27 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:27.458325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:27.473954 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1e5c30e-64fa-4c70-a43c-610843c9573d tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1722 microversion: 2.1 time: 0.345168 Aug 29 05:23:27.476373 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3009/6028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:27 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:28.419789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:28.420573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:28.429728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:28.430312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:28.430838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:28.432020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:28.432609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:28.433298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:28.499888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:28.503997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:28.525409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:28.526050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:28.527068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:28.527879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:28.528479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:28.528996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:28.647942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:28.658063 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-22eae1c3-0544-4212-bd9f-e5fdf175a4aa tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1321 microversion: 2.1 time: 0.242099 Aug 29 05:23:28.666952 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3020/6029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:28 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:28.778079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:28.788977 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a87f677c-0d6c-4b78-b61e-0ed4a5788075 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1699 microversion: 2.1 time: 0.294862 Aug 29 05:23:28.790183 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3010/6030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:28 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1699 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:28.810047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b0657f7-0fa0-4b14-8f50-f58f339f7108 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:28.818892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b0657f7-0fa0-4b14-8f50-f58f339f7108 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:28.819521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b0657f7-0fa0-4b14-8f50-f58f339f7108 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:28.820074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b0657f7-0fa0-4b14-8f50-f58f339f7108 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:28.849520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7b0657f7-0fa0-4b14-8f50-f58f339f7108 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Going to try to start instance {{(pid=128872) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 05:23:28.925453 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b0657f7-0fa0-4b14-8f50-f58f339f7108 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/action" status: 202 len: 0 microversion: 2.1 time: 0.119132 Aug 29 05:23:28.926597 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3021/6031] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:23:28 2022] POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:23:28.935175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:28.935795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:28.942081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:28.942897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:28.943342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:28.944136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:28.944621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:28.945055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:29.151929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:29.160817 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c6809900-45f6-45c7-8b7d-c199f2444bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1708 microversion: 2.1 time: 0.229523 Aug 29 05:23:29.161650 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3011/6032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:28 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1708 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:29.682192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:29.685225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:29.693931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:29.694517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:29.695015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:29.695783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:29.696674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:29.697164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:29.851083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a6e9b6ca-d8f8-4a6d-9f7a-c17d2683e067 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab9d68790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:29.867972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:29.877211 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-efd8d517-f4df-4e84-beea-f4214acf524c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1321 microversion: 2.1 time: 0.201483 Aug 29 05:23:29.880359 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3022/6033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:29 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:29.947801 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a6e9b6ca-d8f8-4a6d-9f7a-c17d2683e067 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4e216ca2-16c5-480b-8734-39632dfc3d44" status: 200 len: 350 microversion: 2.1 time: 0.101765 Aug 29 05:23:29.948695 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3012/6034] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:23:29 2022] GET /compute/v2.1/os-volumes/4e216ca2-16c5-480b-8734-39632dfc3d44 => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:23:29.961416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-338e3e6f-8084-42ef-9c96-0b07bf955e97 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1abd7fb670>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:30.087739 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-338e3e6f-8084-42ef-9c96-0b07bf955e97 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.130251 Aug 29 05:23:30.098457 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3023/6035] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 29 05:23:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:30.103882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e5a4ee7d-dcad-4e6d-ab4f-ae3b1c1ccfef tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab9f08670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:30.184699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:30.185748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:30.197877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:30.198368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:30.199122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:30.205357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:30.206182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:30.207063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:30.244627 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e5a4ee7d-dcad-4e6d-ab4f-ae3b1c1ccfef tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.144615 Aug 29 05:23:30.245696 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3013/6036] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 29 05:23:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:30.263593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43554194-4b5d-4208-8043-ff8ffe509a2f tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab97ea670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:30.455202 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-43554194-4b5d-4208-8043-ff8ffe509a2f tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.196168 Aug 29 05:23:30.456083 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3014/6037] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 29 05:23:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:30.460904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-fce41c80-10f3-4b63-8b5c-72e956b2254e req-8d7307fb-3b6a-48e4-a64b-5cbb6baba11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43", "name": "network-vif-plugged", "status": "completed", "tag": "ef665ab1-f6b3-4262-aacc-bc369714ada4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:30.483193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fce41c80-10f3-4b63-8b5c-72e956b2254e req-8d7307fb-3b6a-48e4-a64b-5cbb6baba11b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:30.483670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fce41c80-10f3-4b63-8b5c-72e956b2254e req-8d7307fb-3b6a-48e4-a64b-5cbb6baba11b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:30.484094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fce41c80-10f3-4b63-8b5c-72e956b2254e req-8d7307fb-3b6a-48e4-a64b-5cbb6baba11b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:30.496716 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-fce41c80-10f3-4b63-8b5c-72e956b2254e req-8d7307fb-3b6a-48e4-a64b-5cbb6baba11b service nova] Creating event network-vif-plugged:ef665ab1-f6b3-4262-aacc-bc369714ada4 for instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 on n-h1-854119-9 Aug 29 05:23:30.502520 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-fce41c80-10f3-4b63-8b5c-72e956b2254e req-8d7307fb-3b6a-48e4-a64b-5cbb6baba11b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044846 Aug 29 05:23:30.504677 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3015/6038] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:30.512401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7335089-00dd-4aff-a936-2264eba98d52 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab9c7d790>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:30.607250 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c7335089-00dd-4aff-a936-2264eba98d52 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.101153 Aug 29 05:23:30.607840 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3016/6039] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 29 05:23:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:30.623210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97599487-c1dd-4a63-a210-34d23aa40314 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab96531f0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:30.730277 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97599487-c1dd-4a63-a210-34d23aa40314 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.111252 Aug 29 05:23:30.731543 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3017/6040] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 29 05:23:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:23:30.749038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5e094404-efa5-47cd-800d-4585a88c45e2 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab95c7ee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:30.849105 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5e094404-efa5-47cd-800d-4585a88c45e2 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.108317 Aug 29 05:23:30.849984 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3018/6041] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 05:23:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:30.863076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-05e8d376-7f3e-4344-bc17-b79d50728383 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab97ea670>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:30.958238 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-05e8d376-7f3e-4344-bc17-b79d50728383 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.099301 Aug 29 05:23:30.968004 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3019/6042] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Aug 29 05:23:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:30.975553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:30.976600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:30.986146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:30.986883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:30.987562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:30.988622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:30.989339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:30.989991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:30.993810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:31.007268 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d7ee896b-48ed-4610-92ea-5f128915a837 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1708 microversion: 2.1 time: 0.827934 Aug 29 05:23:31.007873 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3024/6043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:30 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1708 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:31.022063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76fdd7d5-b778-4e12-a2ed-61d319d69ad7 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] Calling method '.version_select at 0x7f1ab8b2d040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:31.175025 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76fdd7d5-b778-4e12-a2ed-61d319d69ad7 tempest-VolumesTestJSON-249306927 tempest-VolumesTestJSON-249306927-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.164884 Aug 29 05:23:31.176114 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3025/6044] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 05:23:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:31.368406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:31.385129 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68d30cb3-cb46-4dfb-8957-7a983f0ceae7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1321 microversion: 2.1 time: 0.415200 Aug 29 05:23:31.385797 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3020/6045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:30 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:32.048094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:32.050788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:32.058668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:32.059356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:32.060675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:32.061983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:32.062619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:32.063208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:32.407304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:32.407914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:32.417426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:32.424368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:32.424949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:32.425707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:32.426172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:32.426596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:32.429927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:32.654473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:32.665723 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f90f7f7-f7f9-4f3b-b5e3-4773658b3bef tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1712 microversion: 2.1 time: 0.638506 Aug 29 05:23:32.680641 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3026/6046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:32 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1712 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:32.836718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:32.845154 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f611551a-88bf-4dd0-a704-c998ee8ac932 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1321 microversion: 2.1 time: 0.442559 Aug 29 05:23:32.861734 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3021/6047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:32 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:33.869530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:33.870700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:33.886593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:33.887497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:33.889079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:33.890817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:33.891776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:33.892712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:34.363023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:34.382994 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09ff66f4-5c60-4ccf-8599-ce947cd32bb6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1502 microversion: 2.1 time: 0.512376 Aug 29 05:23:34.396153 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3027/6048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:33 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1502 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:34.409200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:34.410442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:34.424451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:34.425382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:34.425981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:34.428409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:34.429649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:34.432656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:34.862747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:34.875831 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ceb942eb-ac8d-43ec-8e97-01645b15d42f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1502 microversion: 2.1 time: 0.471207 Aug 29 05:23:34.881235 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3022/6049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:34 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1502 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:34.900502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:34.902222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:34.915302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:34.919275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:34.922668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:34.923447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:34.923952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:34.939075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:35.008300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:23:35.038805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5839465-2d60-44b0-8811-65e4135c47e3 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Action: 'create', calling method: .version_select at 0x7f1ab836e670>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1118577476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGyMqQ4Q+sGwQw7J6TBcStCc+lWjM1mPnxODzfcALvRPfA9rNzjmHPaQa85X1juDUY7RTK4NTK1kbbaY3MV26ERKbJjJlIqY+D6+vIUC7ISyiw1PWHSKugo244GB2AO0g=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:35.081218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a5839465-2d60-44b0-8811-65e4135c47e3 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Getting quotas for project 63d4ae6502cb4ab494ee503890ae6ed2. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:23:35.097597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-a5839465-2d60-44b0-8811-65e4135c47e3 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Getting quotas for user a66bf154277346b0bce1cc24dec18519 and project 63d4ae6502cb4ab494ee503890ae6ed2. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:23:35.159889 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5839465-2d60-44b0-8811-65e4135c47e3 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.393554 Aug 29 05:23:35.161447 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3028/6050] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:23:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:23:35.193996 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-27109400-5135-471e-b5f8-239451a062b1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 204 len: 0 microversion: 2.1 time: 0.301351 Aug 29 05:23:35.204589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:35.205754 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3023/6051] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:23:34 2022] DELETE /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:23:35.208291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:35.230272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:35.238653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:35.240693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:35.242042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:35.248540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:35.251132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:35.251823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:36.049367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:36.058979 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b15deb20-ffa0-4cb8-a075-6e0338008ccc tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1508 microversion: 2.1 time: 0.858566 Aug 29 05:23:36.080269 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3029/6052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:35 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1508 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:36.507625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-224c44ff-68b7-442e-a929-2a2716f2d695 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Action: 'create', calling method: .version_select at 0x7f1ab8bcedc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1525034814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhHx1GBaua+W0/wnNpNqkPtqgiMLc+Y4ISFMZPLW7l+Ssk5iO/6Ou9t2z3CVmYmOI06Dym2vktxFbc+xzRQDU8sHpBfwpNbyajBfuoFhUNl6bKw72dIzkeo3kPo0KP7OA=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:36.530022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:36.544136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-224c44ff-68b7-442e-a929-2a2716f2d695 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for project 8538671f353b4984b7b18ee629e43b3d. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:23:36.554984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-224c44ff-68b7-442e-a929-2a2716f2d695 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for user b5b779089f7f42399c57a9771787f911 and project 8538671f353b4984b7b18ee629e43b3d. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:23:36.592702 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-224c44ff-68b7-442e-a929-2a2716f2d695 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.089911 Aug 29 05:23:36.617558 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3024/6053] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:23:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:37.088346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:37.090074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:37.107705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:37.109293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:37.111014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:37.112934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:37.113952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:37.120186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:37.736797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:37.748529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a088bcd-7601-422e-bb48-8935d91abbe1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1508 microversion: 2.1 time: 0.664892 Aug 29 05:23:37.749273 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3030/6054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:37 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1508 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:38.496997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-917670829", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "1326179a-f1b9-4aa0-805d-e9f2317f82d8"}], "key_name": "tempest-TestNetworkBasicOps-1525034814", "security_groups": [{"name": "tempest-secgroup-smoke-1426175901"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:38.770037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:38.771457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:38.779687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:38.780430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:38.781137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:38.782018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:38.782634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:38.783278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:38.899129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] validate_networks() for [('1326179a-f1b9-4aa0-805d-e9f2317f82d8', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:23:38.972873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:38.984080 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a0dcc66-825f-47b6-ad9a-a5b6e41d7373 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1466 microversion: 2.1 time: 0.217953 Aug 29 05:23:38.984715 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3031/6055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:38 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1466 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:39.013360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7aac3d35-b4ad-41f7-8c34-617b61c658da req-6ad87453-e309-40f7-9150-39221b742d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43", "name": "network-vif-deleted", "tag": "ef665ab1-f6b3-4262-aacc-bc369714ada4"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:39.038352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7aac3d35-b4ad-41f7-8c34-617b61c658da req-6ad87453-e309-40f7-9150-39221b742d5d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:39.039788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7aac3d35-b4ad-41f7-8c34-617b61c658da req-6ad87453-e309-40f7-9150-39221b742d5d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:39.040461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7aac3d35-b4ad-41f7-8c34-617b61c658da req-6ad87453-e309-40f7-9150-39221b742d5d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:39.062587 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7aac3d35-b4ad-41f7-8c34-617b61c658da req-6ad87453-e309-40f7-9150-39221b742d5d service nova] Creating event network-vif-deleted:ef665ab1-f6b3-4262-aacc-bc369714ada4 for instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 on n-h1-854119-9 Aug 29 05:23:39.072069 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7aac3d35-b4ad-41f7-8c34-617b61c658da req-6ad87453-e309-40f7-9150-39221b742d5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064806 Aug 29 05:23:39.073502 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3032/6056] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:23:40.015941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:40.020992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:40.048434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:40.051882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:40.052709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:40.053936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:40.054621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:40.055210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:40.108365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:40.109437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:40.110126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:40.111120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lazy-loading 'fault' on Instance uuid be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:23:40.123408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:23:40.124068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:23:40.124942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:23:40.125381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:23:40.125769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:23:40.136917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:40.137512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:40.138017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:40.139216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:40.139753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:40.140302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:40.159189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for project 8538671f353b4984b7b18ee629e43b3d. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:23:40.165779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Getting quotas for user b5b779089f7f42399c57a9771787f911 and project 8538671f353b4984b7b18ee629e43b3d. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:23:40.179475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:23:40.182278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:23:40.219623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:40.236632 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-66eff09d-0416-4500-9509-91ea5d4f39f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 200 len: 1311 microversion: 2.1 time: 0.229019 Aug 29 05:23:40.238043 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3033/6057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:40 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:40.289202 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86070c26-f68e-4eb2-9767-881124342760 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.796786 Aug 29 05:23:40.290251 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3025/6058] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:23:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:23:40.302131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bffb4ef5-c90a-4168-b660-da40d9ddc3cc tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:40.303108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bffb4ef5-c90a-4168-b660-da40d9ddc3cc tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:40.390835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bffb4ef5-c90a-4168-b660-da40d9ddc3cc tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:40.413083 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bffb4ef5-c90a-4168-b660-da40d9ddc3cc tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1248 microversion: 2.1 time: 0.115819 Aug 29 05:23:40.446848 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3034/6059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:40 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1248 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:41.258762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:41.268255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:41.296252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:41.296758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:41.297197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:41.297915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:41.298400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:41.318511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:41.361631 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 HTTP/1.1 Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43'} Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:23:41.364178 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:41.370509 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:23:41.370509 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:23:41.370509 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:23:41.370509 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:23:41.370509 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:23:41.370509 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:23:41.370509 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:23:41.370509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:23:41.373318 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fedbedbd-1099-42e4-a0fd-e34a1550c88d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 404 len: 111 microversion: 2.1 time: 0.118648 Aug 29 05:23:41.374971 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3026/6060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:41 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:23:41.390023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f11cfaa7-ab7a-4f7b-a2a0-bcbcde3844be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'create', calling method: .version_select at 0x7f1abd7f3dc0>, body: {"keypair": {"name": "tempest-key-1308964806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhX6c361tEtzGN1O9Mqu98i/pIOKVnDcEQdeaapjep5V/HneKT6pAPKVCypHWT5v5IGWKYcv3JhxcF8ihXhaMzXzYrb+tM+NaSumexlfBFzBCnRAoLc5els8oIpiet83g=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:41.419525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-f11cfaa7-ab7a-4f7b-a2a0-bcbcde3844be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:23:41.425780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-f11cfaa7-ab7a-4f7b-a2a0-bcbcde3844be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for user 87aef4a0e8af4640b7f1dd06e446eb0d and project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:23:41.473516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:41.474453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:41.481370 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f11cfaa7-ab7a-4f7b-a2a0-bcbcde3844be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.095499 Aug 29 05:23:41.482304 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3035/6061] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:23:41 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:23:41.503753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:41.504423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:41.504884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:41.505631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:41.510974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2c2cbb3-645d-42da-bddc-54ca0e74e94c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '.version_select at 0x7f1abd7f30d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:41.516609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:41.520525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:41.532172 n-d-854119-9 devstack@n-api.service[128872]: WARNING oslo_db.sqlalchemy.utils [None req-c2c2cbb3-645d-42da-bddc-54ca0e74e94c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 05:23:41.557920 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c2c2cbb3-645d-42da-bddc-54ca0e74e94c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.069016 Aug 29 05:23:41.579572 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3036/6062] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 05:23:41 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:41.685729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:41.695205 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8f614cda-090c-47ba-8615-90077336029d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1300 microversion: 2.1 time: 0.225892 Aug 29 05:23:41.696452 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3027/6063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:41 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1300 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:41.725253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1717963207", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "key_name": "tempest-key-1308964806", "networks": [{"uuid": "8741d5cf-41df-4e83-8c96-bb20519598e2"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:41.798381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] validate_networks() for [('8741d5cf-41df-4e83-8c96-bb20519598e2', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:23:42.725548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:42.726790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:42.741378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:42.742244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:42.745724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:42.746740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:42.747373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:42.747970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:43.598130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:43.616884 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7d856fb5-c266-4578-935b-b87105054fb5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1306 microversion: 2.1 time: 0.895855 Aug 29 05:23:43.621029 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3028/6064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:42 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1306 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:43.699151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:23:43.699720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:23:43.700038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:23:43.700497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:23:43.700909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:23:43.718056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:43.718565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:43.718990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:43.722729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:43.723249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:43.723682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:43.770707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:23:43.785089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for user 87aef4a0e8af4640b7f1dd06e446eb0d and project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:23:43.819427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:23:43.825353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:23:43.915079 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9ec84178-6b46-477b-bee5-5813a197cd2c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.189291 Aug 29 05:23:43.920723 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3037/6065] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:23:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:23:43.929377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4da4871b-0e0f-4b45-aaac-98a2e6588fb8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:43.930674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4da4871b-0e0f-4b45-aaac-98a2e6588fb8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:44.027177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4da4871b-0e0f-4b45-aaac-98a2e6588fb8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:44.035627 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4da4871b-0e0f-4b45-aaac-98a2e6588fb8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1229 microversion: 2.1 time: 0.113423 Aug 29 05:23:44.039095 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3029/6066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:43 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:44.643357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:44.644201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:44.661642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:44.664848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:44.665812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:44.668871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:44.671282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:44.672606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:45.059424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:45.060410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:45.082012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:45.082513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:45.082944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:45.083660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:45.084112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:45.084557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:45.114136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:45.129758 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18bb6ce0-4561-4810-b4e5-f4c908c9dd8d tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1374 microversion: 2.1 time: 0.490670 Aug 29 05:23:45.141842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3038/6067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:44 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1374 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:45.321760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:45.336792 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb831da7-8e93-47fb-bee0-70788142a576 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1225 microversion: 2.1 time: 0.279434 Aug 29 05:23:45.352100 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3030/6068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:45 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1225 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:46.157705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:46.158465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:46.174072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:46.174802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:46.175421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:46.176344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:46.176965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:46.177557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:46.358570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:46.359795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:46.369922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:46.370429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:46.370892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:46.371580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:46.375768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:46.376418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:46.547355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:46.566557 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12b5316b-d51d-44ad-9a7e-2958140ddf99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1299 microversion: 2.1 time: 0.212642 Aug 29 05:23:46.567169 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3031/6069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:46 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:46.583993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b34d9ce3-1acb-4931-b00d-930383e43438 req-18b4b1c0-9d32-4cec-9751-08af22f72627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5250316b-4fe9-43ed-809e-e96f58ed22eb", "tag": "d6e0b3d4-0076-4db3-99d1-91ba6f22059e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:46.598040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b34d9ce3-1acb-4931-b00d-930383e43438 req-18b4b1c0-9d32-4cec-9751-08af22f72627 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:46.600442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b34d9ce3-1acb-4931-b00d-930383e43438 req-18b4b1c0-9d32-4cec-9751-08af22f72627 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:46.601289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b34d9ce3-1acb-4931-b00d-930383e43438 req-18b4b1c0-9d32-4cec-9751-08af22f72627 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:46.615904 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b34d9ce3-1acb-4931-b00d-930383e43438 req-18b4b1c0-9d32-4cec-9751-08af22f72627 service nova] Creating event network-changed:d6e0b3d4-0076-4db3-99d1-91ba6f22059e for instance 5250316b-4fe9-43ed-809e-e96f58ed22eb on n-h1-854119-9 Aug 29 05:23:46.628582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b34d9ce3-1acb-4931-b00d-930383e43438 req-18b4b1c0-9d32-4cec-9751-08af22f72627 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060127 Aug 29 05:23:46.631641 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3032/6070] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:46.640243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1810972830-access_point-645302736", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "bf54c3c1-7abb-4878-b90a-aea7c43ff382"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1118577476", "security_groups": [{"name": "tempest-secgroup_access--1623297120"}, {"name": "tempest-secgroup_general--269765539"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:46.711967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:46.715466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:46.720179 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2c28588f-d427-40cd-a90d-524e20a3865c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1374 microversion: 2.1 time: 0.566298 Aug 29 05:23:46.730721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3039/6071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:46 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1374 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:47.051936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] validate_networks() for [('bf54c3c1-7abb-4878-b90a-aea7c43ff382', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:23:47.593586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:47.595467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:47.618502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:47.619216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:47.620080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:47.620870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:47.621323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:47.626400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:48.035442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:48.047816 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e2b508b-8678-4e94-bf29-db7e46da4204 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.462150 Aug 29 05:23:48.049205 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3040/6072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:47 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:48.055877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:48.056773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:48.066972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:48.067858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:48.068528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:48.069745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:48.070375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:48.071284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:48.074705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:23:48.075965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:23:48.076807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:23:48.077481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:23:48.078102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:23:48.092101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:48.092904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:48.093496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:48.095075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:48.096020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:48.096805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:48.117880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Getting quotas for project 63d4ae6502cb4ab494ee503890ae6ed2. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:23:48.123941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Getting quotas for user a66bf154277346b0bce1cc24dec18519 and project 63d4ae6502cb4ab494ee503890ae6ed2. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:23:48.139344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:23:48.141387 n-d-854119-9 devstack@n-api.service[128871]: WARNING nova.utils [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1810972830-access_point-645302736 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1810972830-ac Aug 29 05:23:48.142258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:23:48.199456 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ad0a4e2d-2081-4891-b767-7e8ff482462e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.564858 Aug 29 05:23:48.200526 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3033/6073] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:23:46 2022] POST /compute/v2.1/servers => generated 457 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:23:48.212957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bce93d0-934e-4753-88e5-31054b482867 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:48.213575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5bce93d0-934e-4753-88e5-31054b482867 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:48.299834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bce93d0-934e-4753-88e5-31054b482867 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:48.307882 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bce93d0-934e-4753-88e5-31054b482867 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1294 microversion: 2.1 time: 0.100565 Aug 29 05:23:48.308503 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3034/6074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:48 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:48.361700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:48.373221 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5951c202-233a-47ab-a334-514d8cb7ebd5 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1374 microversion: 2.1 time: 0.322392 Aug 29 05:23:48.375966 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3041/6075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:48 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1374 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:49.072694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:49.073424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:49.080834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:49.081395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:49.081737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:49.082433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:49.082888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:49.083311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:49.251085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:49.261972 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-befca96b-7c53-426b-8265-913c220cd225 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.193602 Aug 29 05:23:49.262747 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3035/6076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:49 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:49.332809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:49.333430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:49.342010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:49.342785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:49.343389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:49.344334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:49.345824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:49.346436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:49.397750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:49.398920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:49.410911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:49.411405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:49.416430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:49.417341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:49.418170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:49.418657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:49.449941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:49.461541 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c799b4f9-cde0-4804-99ae-d53ef6023e5d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1298 microversion: 2.1 time: 0.135658 Aug 29 05:23:49.475368 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3042/6077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:49 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:49.586108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:49.594085 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b0315fe-fbb2-4d50-820b-3681f491efb0 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1374 microversion: 2.1 time: 0.202093 Aug 29 05:23:49.608303 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3036/6078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:49 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1374 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:50.286128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:50.287087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:50.297060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:50.297680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:50.298306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:50.299721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:50.299851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:50.300417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:50.481632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:50.482239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:50.490935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:50.491681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:50.492268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:50.492845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:50.493466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:50.494055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:50.911755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:50.924827 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d6f01ba-e693-4bfc-bbe1-f2905065d3c8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1346 microversion: 2.1 time: 0.446945 Aug 29 05:23:50.925868 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3037/6079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:50 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1346 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:50.930905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:50.931503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:50.937944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:50.938669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:50.939421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:50.940387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:50.941092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:50.941698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:51.048809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:51.055006 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-42330cd1-9bda-4708-8ca2-1a7e5cfc4840 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.774808 Aug 29 05:23:51.056142 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3043/6080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:50 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:51.399279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:51.410074 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-487b6e0a-9b03-4ee2-a746-6811b81e9413 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1374 microversion: 2.1 time: 0.482440 Aug 29 05:23:51.411203 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3038/6081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:50 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1374 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:51.906773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7528b910-f03c-45e7-917b-f62ad1e0d0da req-c64c87b5-9f28-41ee-bbf3-a04377a66f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5afd1ca-2b42-4377-a9b0-16d7328e5462", "tag": "0e46cba2-aadc-4c05-85f1-d8c16b27075e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:51.928304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7528b910-f03c-45e7-917b-f62ad1e0d0da req-c64c87b5-9f28-41ee-bbf3-a04377a66f68 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:51.928895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7528b910-f03c-45e7-917b-f62ad1e0d0da req-c64c87b5-9f28-41ee-bbf3-a04377a66f68 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:51.929436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7528b910-f03c-45e7-917b-f62ad1e0d0da req-c64c87b5-9f28-41ee-bbf3-a04377a66f68 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:51.946540 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7528b910-f03c-45e7-917b-f62ad1e0d0da req-c64c87b5-9f28-41ee-bbf3-a04377a66f68 service nova] Creating event network-changed:0e46cba2-aadc-4c05-85f1-d8c16b27075e for instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 on n-h1-854119-9 Aug 29 05:23:51.946952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:51.948156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:51.952294 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7528b910-f03c-45e7-917b-f62ad1e0d0da req-c64c87b5-9f28-41ee-bbf3-a04377a66f68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050560 Aug 29 05:23:51.953314 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3044/6082] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:51.960532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:51.961037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:51.961624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:51.962483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:51.962945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:51.963491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:52.075098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:52.082882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:52.083889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:52.087694 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3666c5fe-62d9-45da-ad31-42eae8534e98 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1352 microversion: 2.1 time: 0.144532 Aug 29 05:23:52.089257 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3039/6083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:51 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:52.094357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:52.095551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:52.111617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:52.113059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:52.114082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:52.115595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:52.116811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:52.117324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:52.117766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:52.118491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:52.118946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:52.119060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:52.119369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:52.120195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:52.502648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:52.511744 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72027f38-62ed-4513-9a37-b39fc2222490 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.421413 Aug 29 05:23:52.522332 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3040/6084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:52 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:52.529728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:52.531070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:52.540748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:52.541479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:52.541977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:52.543005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:52.544057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:52.544857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:52.557651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:52.565639 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1d063066-f902-487d-a138-ede7da3986af tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1684 microversion: 2.1 time: 0.488678 Aug 29 05:23:52.566817 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3045/6085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:52 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1684 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:52.869283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:52.875113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:52.883831 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf05dc18-17a9-4830-a5cb-16ba82ff0db1 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1374 microversion: 2.1 time: 0.359438 Aug 29 05:23:52.885438 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3041/6086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:52 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1374 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:52.988675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c80ac76c-4d26-4d98-9f5d-510c4d834549 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:52.991362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c80ac76c-4d26-4d98-9f5d-510c4d834549 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:53.000086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c80ac76c-4d26-4d98-9f5d-510c4d834549 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:53.000847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c80ac76c-4d26-4d98-9f5d-510c4d834549 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:53.001533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c80ac76c-4d26-4d98-9f5d-510c4d834549 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:53.002246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c80ac76c-4d26-4d98-9f5d-510c4d834549 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:53.002966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c80ac76c-4d26-4d98-9f5d-510c4d834549 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:53.003602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c80ac76c-4d26-4d98-9f5d-510c4d834549 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:53.110118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:53.110882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:53.119017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:53.119348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:53.120004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:53.120733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:53.121193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:53.121618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:53.264963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:53.274439 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cfc928bd-7269-4290-8724-c5bd611b1c2e tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.168562 Aug 29 05:23:53.281990 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3042/6087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:53 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:53.532145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:53.532945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:53.540134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:53.540655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:53.541082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:53.541771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:53.542220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:53.542668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:53.680910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:53.688997 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f3b00c4c-21c9-4c8e-9dd5-542b69d1ed60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.160755 Aug 29 05:23:53.689622 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3043/6088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:53 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:53.749385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:53.807785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=16 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:53.905716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:53.906336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:53.912534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:53.912901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:53.913356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:53.914059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:53.914547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:53.914973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:54.051424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:54.059237 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-47219f81-8ec6-41b8-8625-5881c68f9c55 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1374 microversion: 2.1 time: 0.157379 Aug 29 05:23:54.059786 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3044/6089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:53 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:54.295308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:54.296030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:54.302327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:54.302763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:54.303196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:54.303895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:54.304370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:54.304788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:54.458162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:54.465997 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-91bd287a-756b-4ec9-9d26-0a0d4e502952 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.174582 Aug 29 05:23:54.466576 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3045/6090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:54 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:54.471043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f4b21a10-cb08-431b-8350-47ff0ccc0225 req-8edb870c-ab93-4808-8e83-331d63c86631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5250316b-4fe9-43ed-809e-e96f58ed22eb", "name": "network-vif-plugged", "status": "completed", "tag": "d6e0b3d4-0076-4db3-99d1-91ba6f22059e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:54.480663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f4b21a10-cb08-431b-8350-47ff0ccc0225 req-8edb870c-ab93-4808-8e83-331d63c86631 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:54.481139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f4b21a10-cb08-431b-8350-47ff0ccc0225 req-8edb870c-ab93-4808-8e83-331d63c86631 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:54.481760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f4b21a10-cb08-431b-8350-47ff0ccc0225 req-8edb870c-ab93-4808-8e83-331d63c86631 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:54.492890 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f4b21a10-cb08-431b-8350-47ff0ccc0225 req-8edb870c-ab93-4808-8e83-331d63c86631 service nova] Creating event network-vif-plugged:d6e0b3d4-0076-4db3-99d1-91ba6f22059e for instance 5250316b-4fe9-43ed-809e-e96f58ed22eb on n-h1-854119-9 Aug 29 05:23:54.497740 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f4b21a10-cb08-431b-8350-47ff0ccc0225 req-8edb870c-ab93-4808-8e83-331d63c86631 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030079 Aug 29 05:23:54.498323 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3046/6091] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:54.710058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:54.710761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:54.717341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:54.717957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:54.718484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:54.719239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:54.719785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:54.720267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:54.852078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:54.860876 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22cda448-4356-43c8-81b7-d863b5af7c1b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.155161 Aug 29 05:23:54.861449 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3047/6092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:54 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:55.080932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:55.081554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:55.087698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:55.088249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:55.088691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:55.089395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:55.089853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:55.090603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:55.227811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:55.235454 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-55a2ebc8-4ed7-4baf-a725-784e3e7ea401 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1374 microversion: 2.1 time: 0.158641 Aug 29 05:23:55.236178 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3048/6093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:55 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:55.486862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:55.487526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:55.494546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:55.495029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:55.495462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:55.496179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:55.496805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:55.497227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:55.637334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:55.645380 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f3d99585-4b10-4eee-863b-9fc7381ea252 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.162486 Aug 29 05:23:55.646149 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3049/6094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:55 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:55.689473 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c80ac76c-4d26-4d98-9f5d-510c4d834549 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9/action" status: 200 len: 32625 microversion: 2.1 time: 2.704604 Aug 29 05:23:55.690635 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3046/6095] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:23:52 2022] POST /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9/action => generated 32625 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:23:55.837442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7df0098d-35f7-4d53-88c2-055c85a9e32f tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:55.838863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7df0098d-35f7-4d53-88c2-055c85a9e32f tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:55.845297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7df0098d-35f7-4d53-88c2-055c85a9e32f tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:55.846051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7df0098d-35f7-4d53-88c2-055c85a9e32f tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:55.846490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7df0098d-35f7-4d53-88c2-055c85a9e32f tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:55.847396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7df0098d-35f7-4d53-88c2-055c85a9e32f tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:55.847858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7df0098d-35f7-4d53-88c2-055c85a9e32f tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:55.848317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7df0098d-35f7-4d53-88c2-055c85a9e32f tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:55.882478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:55.883212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:55.891175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:55.898241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:55.899252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:55.900249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:55.901533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:55.905409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:56.670303 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7df0098d-35f7-4d53-88c2-055c85a9e32f tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1835 microversion: 2.1 time: 0.837380 Aug 29 05:23:56.671516 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3050/6096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:55 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1835 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:56.677848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:56.678800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:56.690305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:56.691553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:56.692267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:56.693995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:56.694911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:56.695730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:56.730958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:56.740049 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba209298-8423-4965-982f-da3a03650e90 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.861810 Aug 29 05:23:56.752849 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3047/6097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:55 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:56.758890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:56.759439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:56.766629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:56.767553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:56.767993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:56.768734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:56.769637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:56.769637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:56.966802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:56.975183 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd45868e-472d-4105-90d4-f41909672c4b tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1374 microversion: 2.1 time: 0.302203 Aug 29 05:23:56.975894 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3051/6098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:56 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1374 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:56.980513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:56.983730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:56.988515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:56.992870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:56.993438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:56.994095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:56.995045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:56.995573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:56.996076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:57.027720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lazy-loading 'flavor' on Instance uuid a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:23:57.042461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Going to try to live migrate instance to another host {{(pid=128871) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 05:23:57.067919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:57.081505 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f9485b6-0b9f-406c-93cc-de53645a8f45 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.326115 Aug 29 05:23:57.083071 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3048/6099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:56 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:57.235809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-aed1303e-1108-40a7-87d3-42fd4bcc24bc req-b71e914b-6519-4c67-9fbb-fe319288c00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7", "tag": "822bbc8b-6e31-4d94-9a52-8177bd0844bc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:57.247959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-aed1303e-1108-40a7-87d3-42fd4bcc24bc req-b71e914b-6519-4c67-9fbb-fe319288c00e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:57.248486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-aed1303e-1108-40a7-87d3-42fd4bcc24bc req-b71e914b-6519-4c67-9fbb-fe319288c00e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:57.248922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-aed1303e-1108-40a7-87d3-42fd4bcc24bc req-b71e914b-6519-4c67-9fbb-fe319288c00e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:57.268684 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-aed1303e-1108-40a7-87d3-42fd4bcc24bc req-b71e914b-6519-4c67-9fbb-fe319288c00e service nova] Creating event network-changed:822bbc8b-6e31-4d94-9a52-8177bd0844bc for instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 on n-h1-854119-9 Aug 29 05:23:57.273968 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-aed1303e-1108-40a7-87d3-42fd4bcc24bc req-b71e914b-6519-4c67-9fbb-fe319288c00e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042832 Aug 29 05:23:57.276150 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3049/6100] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:23:57.766501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:57.767744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:57.775847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:57.776370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:57.777152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:57.778375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:57.779255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:57.779923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:57.946337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:57.957003 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6070cb0-c50f-4bea-af29-81056bae6ddb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.195951 Aug 29 05:23:57.957717 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3050/6101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:57 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:58.001939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:58.002554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:58.018457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.026224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.026692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.027612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.029102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.029744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.108465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:58.296672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:58.305751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=20 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:23:58.306217 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e8e4a4f-eb92-4cf1-bda6-2e66218228b4 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1546 microversion: 2.1 time: 0.311136 Aug 29 05:23:58.308490 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3051/6102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:57 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1546 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:58.315005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:58.317547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:58.324671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.325464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.326004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.326803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.327574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.328184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.626956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:58.635756 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d70f8e5-4f59-4ea1-8139-a95a25e0eb62 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.325715 Aug 29 05:23:58.636616 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3052/6103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:58 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:58.641694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:58.642557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:58.650046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.650946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.656264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.658195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.658776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.659301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.813029 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e4c7e6d7-3516-4b67-beda-4ddb1304f1f0 tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9/action" status: 202 len: 0 microversion: 2.1 time: 1.836037 Aug 29 05:23:58.813603 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3052/6104] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:23:56 2022] POST /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9/action => generated 0 bytes in 1837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:23:58.819058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-2e1cbd57-eb8c-43e7-8ad0-6b80e43394ce req-6380eb7a-3518-47b3-905f-9138a2a80062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5afd1ca-2b42-4377-a9b0-16d7328e5462", "name": "network-vif-plugged", "status": "completed", "tag": "0e46cba2-aadc-4c05-85f1-d8c16b27075e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:23:58.829712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:58.831716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2e1cbd57-eb8c-43e7-8ad0-6b80e43394ce req-6380eb7a-3518-47b3-905f-9138a2a80062 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.832187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2e1cbd57-eb8c-43e7-8ad0-6b80e43394ce req-6380eb7a-3518-47b3-905f-9138a2a80062 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.832674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2e1cbd57-eb8c-43e7-8ad0-6b80e43394ce req-6380eb7a-3518-47b3-905f-9138a2a80062 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.838971 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8b83c2d0-a5df-4daa-bc7c-53ab8a0a737c tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1546 microversion: 2.1 time: 0.201020 Aug 29 05:23:58.839649 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3053/6105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:58 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1546 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:58.843993 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2e1cbd57-eb8c-43e7-8ad0-6b80e43394ce req-6380eb7a-3518-47b3-905f-9138a2a80062 service nova] Creating event network-vif-plugged:0e46cba2-aadc-4c05-85f1-d8c16b27075e for instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 on n-h1-854119-9 Aug 29 05:23:58.844541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:58.845441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:58.849637 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-2e1cbd57-eb8c-43e7-8ad0-6b80e43394ce req-6380eb7a-3518-47b3-905f-9138a2a80062 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034242 Aug 29 05:23:58.850304 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3053/6106] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:23:58.851694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.852927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.853421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.854197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.854757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.855295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.982690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:58.984290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:58.992605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.993224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.993782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:58.994777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:58.995409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:58.995921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:59.016571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:59.028448 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed339e82-b760-49fb-9c1b-1225e83e002b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.187453 Aug 29 05:23:59.029579 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3054/6107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:58 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:23:59.196361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:59.205535 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c1d82224-db8e-4507-8e33-f325f9d1ef60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.229102 Aug 29 05:23:59.206518 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3054/6108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:58 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:23:59.662579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:23:59.663198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:23:59.670549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:59.671085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:59.671528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:59.672238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:23:59.672933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:23:59.673406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:23:59.822404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:23:59.833465 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8fc11403-6e44-4fee-8485-26381a462016 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.174499 Aug 29 05:23:59.834503 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3055/6109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:23:59 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:00.053123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:00.053836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:00.061543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:00.062344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:00.062741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:00.063650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:00.064185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:00.064636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:00.227042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:00.228580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:00.235889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:00.236575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:00.237223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:00.238446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:00.239237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:00.239672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:00.271345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:00.291406 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc9c15f8-bfd3-4a3e-ab65-32ddedda0a9b tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.239681 Aug 29 05:24:00.295046 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3055/6110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:00 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:00.408938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:00.419610 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59f3a4d8-c554-49cb-a2be-6aa08b017a99 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.196432 Aug 29 05:24:00.420241 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3056/6111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:00 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:00.664832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ae2ecc0e-d0bb-490e-b606-9d025654823f req-109763e5-95c6-4929-a62e-f9f14b04c1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5250316b-4fe9-43ed-809e-e96f58ed22eb", "tag": "d6e0b3d4-0076-4db3-99d1-91ba6f22059e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:00.676163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ae2ecc0e-d0bb-490e-b606-9d025654823f req-109763e5-95c6-4929-a62e-f9f14b04c1d0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:00.676902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ae2ecc0e-d0bb-490e-b606-9d025654823f req-109763e5-95c6-4929-a62e-f9f14b04c1d0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:00.677645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ae2ecc0e-d0bb-490e-b606-9d025654823f req-109763e5-95c6-4929-a62e-f9f14b04c1d0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:00.692515 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ae2ecc0e-d0bb-490e-b606-9d025654823f req-109763e5-95c6-4929-a62e-f9f14b04c1d0 service nova] Creating event network-changed:d6e0b3d4-0076-4db3-99d1-91ba6f22059e for instance 5250316b-4fe9-43ed-809e-e96f58ed22eb on n-h1-854119-9 Aug 29 05:24:00.699699 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ae2ecc0e-d0bb-490e-b606-9d025654823f req-109763e5-95c6-4929-a62e-f9f14b04c1d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038073 Aug 29 05:24:00.701010 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3056/6112] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:00.854678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:00.855254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:00.861523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:00.862228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:00.862860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:00.863534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:00.864167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:00.864800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:01.039819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:01.048781 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2987b32-7876-49c4-92f9-f894f10e28b2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.197911 Aug 29 05:24:01.049473 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3057/6113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:00 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:01.320625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:01.322496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:01.331785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:01.332701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:01.333342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:01.334566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:01.335275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:01.335852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:01.443352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:01.444264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:01.464983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:01.465485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:01.465928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:01.466634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:01.468855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:01.469716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:01.476064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:01.824499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:01.835594 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9fc35869-fe7a-48ea-9d87-da9ffb13d583 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.521518 Aug 29 05:24:01.857313 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3057/6114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:01 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:01.948333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:01.961190 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c3fbf1ed-14d2-450a-a2d3-65a1ddb65099 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.521567 Aug 29 05:24:01.961815 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3058/6115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:01 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:02.069817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:02.070671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:02.077061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:02.077664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:02.078190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:02.079156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:02.079782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:02.080427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:02.343357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:02.345985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:02.354672 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b7bdf997-f023-4e27-a9bf-0b7d0e22e1e0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.288546 Aug 29 05:24:02.357583 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3058/6116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:02 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:02.831129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5365d6e7-663a-47b9-b28a-4cd47794e006 req-5856ab0e-73c3-4de1-ad32-a8718907561f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9", "name": "network-vif-unplugged", "status": "completed", "tag": "acf10729-be07-494e-bce8-ba9aea0c9a63"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:02.845991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5365d6e7-663a-47b9-b28a-4cd47794e006 req-5856ab0e-73c3-4de1-ad32-a8718907561f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:02.846893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5365d6e7-663a-47b9-b28a-4cd47794e006 req-5856ab0e-73c3-4de1-ad32-a8718907561f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:02.847483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5365d6e7-663a-47b9-b28a-4cd47794e006 req-5856ab0e-73c3-4de1-ad32-a8718907561f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:02.864643 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5365d6e7-663a-47b9-b28a-4cd47794e006 req-5856ab0e-73c3-4de1-ad32-a8718907561f service nova] Creating event network-vif-unplugged:acf10729-be07-494e-bce8-ba9aea0c9a63 for instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 on n-h1-854119-9 Aug 29 05:24:02.865917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:02.866822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:02.872442 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5365d6e7-663a-47b9-b28a-4cd47794e006 req-5856ab0e-73c3-4de1-ad32-a8718907561f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045620 Aug 29 05:24:02.874549 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3059/6117] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:02.880092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:02.881501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:02.882109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:02.883158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:02.884260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:02.884855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:02.983897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:02.985052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:02.995059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:02.997286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:02.997743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:02.998579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:02.998911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:02.999345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:03.182291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:03.195509 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4c5c8541-ff52-446c-a1e6-28b8edd5e741 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.334098 Aug 29 05:24:03.197477 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3059/6118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:02 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:03.267024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:03.275644 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-42713432-42e9-40ed-aad0-c57643e7235a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1329 microversion: 2.1 time: 0.296443 Aug 29 05:24:03.276561 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3060/6119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:02 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1329 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:03.375737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:03.376454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:03.383880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:03.384597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:03.385498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:03.386531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:03.387122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:03.387594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:03.534184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:03.541850 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a20f078f-a31a-4584-9d55-0aaaf4dc5306 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.170022 Aug 29 05:24:03.542483 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3060/6120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:03 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:04.218199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:04.219729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:04.231030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.233137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.235468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.237236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.238764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.239207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.296927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:04.297533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:04.310206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.310948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.312649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.314827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.318187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.318827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.469120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:04.479598 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-606c0efe-4bc1-487a-853e-02594d8fdf2f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.266148 Aug 29 05:24:04.480775 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3061/6121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:04 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:04.489707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-93630a4f-a514-4b53-ac71-32c180c55865 req-f8ae324b-ada1-45a7-9ba3-788ff8d611ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7", "name": "network-vif-plugged", "status": "completed", "tag": "822bbc8b-6e31-4d94-9a52-8177bd0844bc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:04.505163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-93630a4f-a514-4b53-ac71-32c180c55865 req-f8ae324b-ada1-45a7-9ba3-788ff8d611ab service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.508261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-93630a4f-a514-4b53-ac71-32c180c55865 req-f8ae324b-ada1-45a7-9ba3-788ff8d611ab service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.511556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-93630a4f-a514-4b53-ac71-32c180c55865 req-f8ae324b-ada1-45a7-9ba3-788ff8d611ab service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.526780 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-93630a4f-a514-4b53-ac71-32c180c55865 req-f8ae324b-ada1-45a7-9ba3-788ff8d611ab service nova] Creating event network-vif-plugged:822bbc8b-6e31-4d94-9a52-8177bd0844bc for instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 on n-h1-854119-9 Aug 29 05:24:04.532448 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-93630a4f-a514-4b53-ac71-32c180c55865 req-f8ae324b-ada1-45a7-9ba3-788ff8d611ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049611 Aug 29 05:24:04.533403 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3062/6122] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:04.540374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:04.549163 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-faa87a9e-5d74-42da-a779-fb15b646b642 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1511 microversion: 2.1 time: 0.256207 Aug 29 05:24:04.550218 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3061/6123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:04 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:04.566024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:04.567122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:04.574787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.575565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.576304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.577992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.578831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.579570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.592589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:04.593433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:04.604608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.605107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.605742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.606448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.606894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.607318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.896726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:04.906625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b912e617-476f-4548-8443-f02eb65fdf6a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.347182 Aug 29 05:24:04.907288 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3063/6124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:04 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:04.907933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:04.922724 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c8b09e9a-d664-49a0-a96f-fb8736139163 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1511 microversion: 2.1 time: 0.341819 Aug 29 05:24:04.923565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8aa85b56-527b-497b-8265-5158d63f30b3 req-028ae0b1-70f8-4a94-b728-11828f24d8ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9", "tag": "acf10729-be07-494e-bce8-ba9aea0c9a63"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:04.923709 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3062/6125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:04 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1511 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:04.928549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:04.935252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8aa85b56-527b-497b-8265-5158d63f30b3 req-028ae0b1-70f8-4a94-b728-11828f24d8ef service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.935731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8aa85b56-527b-497b-8265-5158d63f30b3 req-028ae0b1-70f8-4a94-b728-11828f24d8ef service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.940152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8aa85b56-527b-497b-8265-5158d63f30b3 req-028ae0b1-70f8-4a94-b728-11828f24d8ef service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.943495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:04.944356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:04.950917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.951656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.952357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.953320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:04.953979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:04.954689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:04.977055 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8aa85b56-527b-497b-8265-5158d63f30b3 req-028ae0b1-70f8-4a94-b728-11828f24d8ef service nova] Creating event network-changed:acf10729-be07-494e-bce8-ba9aea0c9a63 for instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 on n-h1-854119-9 Aug 29 05:24:04.982571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:24:04.983587 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8aa85b56-527b-497b-8265-5158d63f30b3 req-028ae0b1-70f8-4a94-b728-11828f24d8ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075131 Aug 29 05:24:04.984846 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3064/6126] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:05.059974 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a43c249-938e-4c8f-8620-06f16db9c7f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 204 len: 0 microversion: 2.1 time: 0.120759 Aug 29 05:24:05.060599 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3063/6127] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:24:04 2022] DELETE /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:24:05.070444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:05.071464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:05.077950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:05.078681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:05.079098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:05.079922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:05.080378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:05.080796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:05.217278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:05.226331 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-318a8259-0cbb-4ac9-80d1-f0b41fb535bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1517 microversion: 2.1 time: 0.161098 Aug 29 05:24:05.227358 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3065/6128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:05 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:05.505069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:05.505773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:05.513016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:05.513496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:05.513963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:05.514650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:05.515079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:05.515528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:05.647589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:05.656306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44b2b5b6-45e5-475e-af04-e20b07a3e016 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.156014 Aug 29 05:24:05.656865 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3064/6129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:05 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:05.927254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:05.927862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:05.935056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:05.935559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:05.936007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:05.936728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:05.937167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:05.937584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.094056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:06.102638 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c3e29eb8-e6d0-4a63-8ad2-e273f256ed2f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.179410 Aug 29 05:24:06.103414 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3066/6130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:05 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:06.187454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Calling method '.version_select at 0x7f1ab9a21af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:06.189389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.189899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.190356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.205038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.205511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.205980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.215851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.216368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.216803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.222819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-53c906b1-0bc5-4a2c-8466-94eec5178e9d tempest-PortsAdminExtendedAttrsTestJSON-2005244509 tempest-PortsAdminExtendedAttrsTestJSON-2005244509-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.182250 Aug 29 05:24:06.223388 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3065/6131] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 05:24:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:06.247051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:06.247691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:06.254033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.254526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.254962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.255663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.256113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.256572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.394600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:06.402583 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-502e35e6-119d-42cc-9d8c-cb3fbbb6fc60 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1517 microversion: 2.1 time: 0.159535 Aug 29 05:24:06.403247 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3067/6132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:06 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:06.678117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:06.678754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:06.687273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.687797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.688262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.689045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.689441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.689861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.842658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:06.850784 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4d4d51f7-8ef2-44f2-b48a-a36a29d5d8e7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.176569 Aug 29 05:24:06.852084 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3066/6133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:06 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:06.934486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57421b5c-d508-460a-922b-5f8cf0f4bd5d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:06.934986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-57421b5c-d508-460a-922b-5f8cf0f4bd5d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:06.942290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57421b5c-d508-460a-922b-5f8cf0f4bd5d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.942817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57421b5c-d508-460a-922b-5f8cf0f4bd5d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.943274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57421b5c-d508-460a-922b-5f8cf0f4bd5d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.944023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57421b5c-d508-460a-922b-5f8cf0f4bd5d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.944494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57421b5c-d508-460a-922b-5f8cf0f4bd5d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.944933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57421b5c-d508-460a-922b-5f8cf0f4bd5d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.973704 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57421b5c-d508-460a-922b-5f8cf0f4bd5d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d/ips" status: 200 len: 148 microversion: 2.1 time: 0.043119 Aug 29 05:24:06.974347 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3068/6134] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:24:06 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:06.986292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4244d9c4-e06f-4d5a-aab5-439b9f30a477"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:06.988871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:06.995397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.995860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.996361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:06.997071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:06.997525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:06.997968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.089697 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Invalid volume: volume 4244d9c4-e06f-4d5a-aab5-439b9f30a477 is already attached to instances: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d/os-volume_attachments HTTP/1.1 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 74 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: {"volumeAttachment": {"volumeId": "4244d9c4-e06f-4d5a-aab5-439b9f30a477"}} Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid volume: volume 4244d9c4-e06f-4d5a-aab5-439b9f30a477 is already attached to instances: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': 'ca7086a3-4bf4-4069-92a4-dc6185fafe8d', 'body': {'volumeAttachment': {'volumeId': '4244d9c4-e06f-4d5a-aab5-439b9f30a477'}}} Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4244d9c4-e06f-4d5a-aab5-439b9f30a477 is already attached to instances: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:24:07.091480 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4244d9c4-e06f-4d5a-aab5-439b9f30a477 is already attached to instances: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4244d9c4-e06f-4d5a-aab5-439b9f30a477 is already attached to instances: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 400 to user: Invalid volume: volume 4244d9c4-e06f-4d5a-aab5-439b9f30a477 is already attached to instances: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-361ad31c-4d98-4bb8-891a-15312a6f04dc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110913 Aug 29 05:24:07.096807 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3067/6135] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:24:06 2022] POST /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:24:07.102231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:07.102734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:07.109101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.109592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.110032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.110793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.111250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.111682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.124038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:07.124601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:07.131370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.131888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.132356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.133059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.133509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.133927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.139963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:24:07.228829 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-437d47c3-9ded-4289-993d-fb16f488fc85 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 204 len: 0 microversion: 2.1 time: 0.130024 Aug 29 05:24:07.229630 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3069/6136] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:24:07 2022] DELETE /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:24:07.239038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:07.239825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:07.248312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.249188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.250462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.251547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.252015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.252476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.801312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:07.809453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1be19d61-c168-408f-a64d-bc73817eafc8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1471 microversion: 2.1 time: 0.689409 Aug 29 05:24:07.810026 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3068/6137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:07 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1471 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:07.814750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:07.815490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:07.821755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.822219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.822825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.823743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.824220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.824641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.841114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:07.849436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-656231e1-4a88-4357-a3ff-f5c2404f7199 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1679 microversion: 2.1 time: 0.614753 Aug 29 05:24:07.864155 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3070/6138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:07 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1679 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:07.876306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:07.876652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:07.886056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.886648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.887195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:07.888171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:07.888643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:07.889072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:08.074659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:08.083089 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c85fdd84-a3bf-4573-acaf-8ce323af8005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1517 microversion: 2.1 time: 0.272063 Aug 29 05:24:08.083671 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3069/6139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:07 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1517 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:08.100213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:08.109819 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d4487d44-993c-43fe-8b12-55d3745e2b78 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.240842 Aug 29 05:24:08.110474 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3071/6140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:07 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:08.831155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:08.832099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:08.839445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:08.840007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:08.840528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:08.841302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:08.841922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:08.842404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:08.878753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:08.879460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:08.886434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:08.887047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:08.887712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:08.888462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:08.889294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:08.889881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:09.391057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:09.405722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:09.407007 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3f516f86-ea4c-4ce9-a9cf-b505e3656432 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1643 microversion: 2.1 time: 0.578071 Aug 29 05:24:09.420083 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-791fdc29-e61b-4eb3-82a9-f91995bf4936 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1679 microversion: 2.1 time: 0.544551 Aug 29 05:24:09.420699 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3072/6141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:08 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1679 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:09.422151 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3070/6142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:08 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1643 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:09.426545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:09.427411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:09.433575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:09.434404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:09.435174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:09.436046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:09.436684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:09.437292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:09.446901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:09.447716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:09.455470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:09.456094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:09.456658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:09.457663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:09.458209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:09.458720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:09.931352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:09.946427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7f6aaa7f-48ab-4520-a950-b250fd869255 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1517 microversion: 2.1 time: 0.523769 Aug 29 05:24:09.964966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:09.974075 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-222799f5-19a6-449a-af13-0fdf69f00388 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.550657 Aug 29 05:24:09.974699 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3073/6143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:09 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1517 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:09.976772 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3071/6144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:09 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:09.982865 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:09.983752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:09.993031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:09.993895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:09.994552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:09.995606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:09.996357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:09.997046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:10.386381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8cd60b1f-ee38-4cbd-b51a-75d258f804f2 req-4fdff856-77ac-4ea5-b31f-fd4a698383be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5afd1ca-2b42-4377-a9b0-16d7328e5462", "name": "network-vif-deleted", "tag": "0e46cba2-aadc-4c05-85f1-d8c16b27075e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:10.407523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:10.409557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8cd60b1f-ee38-4cbd-b51a-75d258f804f2 req-4fdff856-77ac-4ea5-b31f-fd4a698383be service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:10.410257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8cd60b1f-ee38-4cbd-b51a-75d258f804f2 req-4fdff856-77ac-4ea5-b31f-fd4a698383be service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:10.410864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8cd60b1f-ee38-4cbd-b51a-75d258f804f2 req-4fdff856-77ac-4ea5-b31f-fd4a698383be service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:10.430354 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8cd60b1f-ee38-4cbd-b51a-75d258f804f2 req-4fdff856-77ac-4ea5-b31f-fd4a698383be service nova] Creating event network-vif-deleted:0e46cba2-aadc-4c05-85f1-d8c16b27075e for instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 on n-h1-854119-9 Aug 29 05:24:10.435954 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a552b76-9045-4fa0-a5fd-50aeab9e0edb tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1643 microversion: 2.1 time: 0.459229 Aug 29 05:24:10.439221 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3074/6145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:09 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1643 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:10.450977 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8cd60b1f-ee38-4cbd-b51a-75d258f804f2 req-4fdff856-77ac-4ea5-b31f-fd4a698383be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068168 Aug 29 05:24:10.452027 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3072/6146] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:10.459559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:10.460464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:10.463375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ea6e342-75df-4d08-8348-1b245dc8b041 tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:10.464318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ea6e342-75df-4d08-8348-1b245dc8b041 tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:10.475560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea6e342-75df-4d08-8348-1b245dc8b041 tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:10.477218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:10.477532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea6e342-75df-4d08-8348-1b245dc8b041 tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:10.478130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:10.478961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea6e342-75df-4d08-8348-1b245dc8b041 tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:10.479909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:10.480884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea6e342-75df-4d08-8348-1b245dc8b041 tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:10.481580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea6e342-75df-4d08-8348-1b245dc8b041 tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:10.482946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ea6e342-75df-4d08-8348-1b245dc8b041 tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:10.483413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:10.484562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:10.489470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:10.546428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:10.918636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:10.927755 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-03faf1f8-7eb4-4727-a535-3e4ae5d290fc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1679 microversion: 2.1 time: 0.473780 Aug 29 05:24:10.928591 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3075/6147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:10 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1679 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:10.933045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fb152193-65c5-47c4-917a-c0551770730c req-3f37f133-13d5-485e-9102-f107b5e1fabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7086a3-4bf4-4069-92a4-dc6185fafe8d", "name": "network-vif-unplugged", "status": "completed", "tag": "e539dde5-da4f-4deb-8f38-cf9450f0fea7"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:10.943423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb152193-65c5-47c4-917a-c0551770730c req-3f37f133-13d5-485e-9102-f107b5e1fabe service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:10.944200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb152193-65c5-47c4-917a-c0551770730c req-3f37f133-13d5-485e-9102-f107b5e1fabe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:10.944956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fb152193-65c5-47c4-917a-c0551770730c req-3f37f133-13d5-485e-9102-f107b5e1fabe service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:10.958319 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fb152193-65c5-47c4-917a-c0551770730c req-3f37f133-13d5-485e-9102-f107b5e1fabe service nova] Creating event network-vif-unplugged:e539dde5-da4f-4deb-8f38-cf9450f0fea7 for instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d on n-h1-854119-9 Aug 29 05:24:10.964390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fb152193-65c5-47c4-917a-c0551770730c req-3f37f133-13d5-485e-9102-f107b5e1fabe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034600 Aug 29 05:24:10.965264 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3076/6148] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:10.978032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:10.978942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:10.987774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:10.988324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:10.988763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:10.989474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:10.989929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:10.990777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:11.028090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:11.029086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:11.029687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:11.030320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lazy-loading 'fault' on Instance uuid f5afd1ca-2b42-4377-a9b0-16d7328e5462 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:24:11.138952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:11.151585 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8d55f8d6-ea08-48eb-94cb-51ec325a9fc8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 200 len: 1319 microversion: 2.1 time: 0.179808 Aug 29 05:24:11.168300 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3077/6149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:10 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:11.175720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:11.177090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:11.181929 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ea6e342-75df-4d08-8348-1b245dc8b041 tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1794 microversion: 2.1 time: 0.722388 Aug 29 05:24:11.182558 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3073/6150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:10 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1794 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:11.186200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:11.186980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:11.187646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:11.188709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:11.191494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:11.193648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:11.551434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:11.561030 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e710d035-2dcd-4003-9f02-a053800adcdc tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.391005 Aug 29 05:24:11.562290 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3078/6151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:11 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:11.950131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:11.950756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:11.967789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:11.968318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:11.968757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:11.969481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:11.970013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:11.970441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:12.016937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:12.044462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:12.044956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:12.045393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:12.045853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lazy-loading 'fault' on Instance uuid ca7086a3-4bf4-4069-92a4-dc6185fafe8d {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:24:12.177875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:12.179880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:12.192429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:12.194521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:12.195200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:12.196682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:12.197411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:12.198060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:12.227609 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 HTTP/1.1 Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'f5afd1ca-2b42-4377-a9b0-16d7328e5462'} Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:12.238412 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:12.242994 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:12.242994 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:12.242994 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:12.242994 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:24:12.242994 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:24:12.242994 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:24:12.242994 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:12.243512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:12.247094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:24:12.248807 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1772968f-7931-4045-add1-f7f3ddc07dc6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 404 len: 111 microversion: 2.1 time: 0.078579 Aug 29 05:24:12.249525 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3079/6152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:12 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:24:12.253553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-764977b6-d604-493f-aa25-c1659007ebe5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 200 len: 1331 microversion: 2.1 time: 0.307904 Aug 29 05:24:12.254174 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3074/6153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:11 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 1331 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:12.261978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75996b19-80a1-45c6-aabb-f7dd8dd88188 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '.version_select at 0x7f1abd87a940>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:12.291273 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75996b19-80a1-45c6-aabb-f7dd8dd88188 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-1308964806" status: 202 len: 0 microversion: 2.1 time: 0.036614 Aug 29 05:24:12.295242 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3080/6154] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Aug 29 05:24:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1308964806 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:24:12.450201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2037828033", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "8741d5cf-41df-4e83-8c96-bb20519598e2"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:12.495592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7d26ec8b-be68-4421-8b98-5d99bf7a88d4 req-6580aa9d-01b9-4544-98c1-5635854cc411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7086a3-4bf4-4069-92a4-dc6185fafe8d", "name": "network-vif-deleted", "tag": "e539dde5-da4f-4deb-8f38-cf9450f0fea7"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:12.513498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] validate_networks() for [('8741d5cf-41df-4e83-8c96-bb20519598e2', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:24:12.514797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7d26ec8b-be68-4421-8b98-5d99bf7a88d4 req-6580aa9d-01b9-4544-98c1-5635854cc411 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:12.515531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7d26ec8b-be68-4421-8b98-5d99bf7a88d4 req-6580aa9d-01b9-4544-98c1-5635854cc411 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:12.516661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7d26ec8b-be68-4421-8b98-5d99bf7a88d4 req-6580aa9d-01b9-4544-98c1-5635854cc411 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:12.536351 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7d26ec8b-be68-4421-8b98-5d99bf7a88d4 req-6580aa9d-01b9-4544-98c1-5635854cc411 service nova] Creating event network-vif-deleted:e539dde5-da4f-4deb-8f38-cf9450f0fea7 for instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d on n-h1-854119-9 Aug 29 05:24:12.541739 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7d26ec8b-be68-4421-8b98-5d99bf7a88d4 req-6580aa9d-01b9-4544-98c1-5635854cc411 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054129 Aug 29 05:24:12.543103 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3081/6155] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:12.585619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:12.586412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:12.593058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:12.593548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:12.593999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:12.594744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:12.595200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:12.595625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:13.100361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:13.109855 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-602e7d92-6e32-4f72-bcc4-00cfd55b511f tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 0.530427 Aug 29 05:24:13.124530 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3082/6156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:12 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:13.276811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:13.278880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:13.286030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:13.286781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:13.287413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:13.288676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:13.289630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:13.290233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:13.305210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d HTTP/1.1 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'ca7086a3-4bf4-4069-92a4-dc6185fafe8d'} Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:13.307221 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:13.312358 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:13.312358 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:13.312358 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:13.312358 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:24:13.312358 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:24:13.312358 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:24:13.312358 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:13.314057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:24:13.315145 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69a301cc-8290-4780-a491-bfc560ed0818 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 404 len: 111 microversion: 2.1 time: 0.043443 Aug 29 05:24:13.315957 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3083/6157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:13 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:24:13.324665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2b2c220f-7db4-423b-bc7e-89b704af1682 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '.version_select at 0x7f1abd87b790>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:13.348563 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2b2c220f-7db4-423b-bc7e-89b704af1682 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-620050749" status: 202 len: 0 microversion: 2.1 time: 0.027679 Aug 29 05:24:13.354026 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3084/6158] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:24:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-620050749 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:24:13.845629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:24:13.846569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:24:13.847687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:24:13.848618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:24:13.849359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:24:13.860780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:13.861688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:13.862134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:13.862930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:13.863361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:13.863995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:13.883566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:24:13.889518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for user 87aef4a0e8af4640b7f1dd06e446eb0d and project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:24:13.916780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:24:13.919914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:24:13.986952 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f182f21a-51d0-44ff-b835-0171a1a6a7e4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.546734 Aug 29 05:24:13.987834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3075/6159] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:24:13.999415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-99f30c97-5c21-48d8-a6dc-c6dc007be6a8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:14.000425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-99f30c97-5c21-48d8-a6dc-c6dc007be6a8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:14.080938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-99f30c97-5c21-48d8-a6dc-c6dc007be6a8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:14.090064 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-99f30c97-5c21-48d8-a6dc-c6dc007be6a8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1209 microversion: 2.1 time: 0.094945 Aug 29 05:24:14.092336 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3085/6160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:13 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:14.136079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:14.137832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:14.168266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:14.169731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:14.170459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:14.172237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:14.177368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:14.178070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:14.559708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:14.561015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:14.574755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:14.575648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:14.576343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:14.577336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:14.579546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:14.580240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:14.714709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lazy-loading 'services' on Instance uuid 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:24:14.865220 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6fbd74d3-82d3-4a86-b366-e6b26a140e79 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments/4244d9c4-e06f-4d5a-aab5-439b9f30a477" status: 202 len: 0 microversion: 2.1 time: 0.308972 Aug 29 05:24:14.866709 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3086/6161] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:24:14 2022] DELETE /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments/4244d9c4-e06f-4d5a-aab5-439b9f30a477 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:24:14.881730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb9c6170-bdb5-468c-b74a-bbdd23ef0854 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:14.885098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fb9c6170-bdb5-468c-b74a-bbdd23ef0854 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:14.893758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb9c6170-bdb5-468c-b74a-bbdd23ef0854 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:14.894671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb9c6170-bdb5-468c-b74a-bbdd23ef0854 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:14.895466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb9c6170-bdb5-468c-b74a-bbdd23ef0854 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:14.896561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb9c6170-bdb5-468c-b74a-bbdd23ef0854 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:14.897248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb9c6170-bdb5-468c-b74a-bbdd23ef0854 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:14.897916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb9c6170-bdb5-468c-b74a-bbdd23ef0854 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:15.004359 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb9c6170-bdb5-468c-b74a-bbdd23ef0854 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128067 Aug 29 05:24:15.006817 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3087/6162] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:24:14 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:15.115304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:15.116006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:15.124806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:15.125299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:15.127283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:15.128042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:15.129082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:15.129518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:15.348298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:15.391569 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57215b76-c060-40fa-8dfd-76fd0f245947 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1261 microversion: 2.1 time: 0.280310 Aug 29 05:24:15.395594 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3088/6163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:15 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1261 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:15.409508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:15.418453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1bfd0405-5ade-4128-b4a1-375d1f8a66d3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1694 microversion: 2.1 time: 1.288593 Aug 29 05:24:15.419414 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3076/6164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:14 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1694 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:15.458606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6fe0463a-5900-4dc9-9cb7-418dbdda9939 req-6d36ae58-f370-4915-9da8-954958a44d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7", "tag": "822bbc8b-6e31-4d94-9a52-8177bd0844bc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:15.478279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6fe0463a-5900-4dc9-9cb7-418dbdda9939 req-6d36ae58-f370-4915-9da8-954958a44d27 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:15.479023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6fe0463a-5900-4dc9-9cb7-418dbdda9939 req-6d36ae58-f370-4915-9da8-954958a44d27 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:15.479671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6fe0463a-5900-4dc9-9cb7-418dbdda9939 req-6d36ae58-f370-4915-9da8-954958a44d27 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:15.505805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6fe0463a-5900-4dc9-9cb7-418dbdda9939 req-6d36ae58-f370-4915-9da8-954958a44d27 service nova] Creating event network-changed:822bbc8b-6e31-4d94-9a52-8177bd0844bc for instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 on n-h1-854119-9 Aug 29 05:24:15.511950 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6fe0463a-5900-4dc9-9cb7-418dbdda9939 req-6d36ae58-f370-4915-9da8-954958a44d27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057492 Aug 29 05:24:15.513428 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3089/6165] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:16.019023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-984d01c9-53ba-4e85-8b6b-daac5b3a83d2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:16.021897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-984d01c9-53ba-4e85-8b6b-daac5b3a83d2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:16.034812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-984d01c9-53ba-4e85-8b6b-daac5b3a83d2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:16.038802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-984d01c9-53ba-4e85-8b6b-daac5b3a83d2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:16.039539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-984d01c9-53ba-4e85-8b6b-daac5b3a83d2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:16.041111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-984d01c9-53ba-4e85-8b6b-daac5b3a83d2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:16.043247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-984d01c9-53ba-4e85-8b6b-daac5b3a83d2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:16.043957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-984d01c9-53ba-4e85-8b6b-daac5b3a83d2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:16.120230 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-984d01c9-53ba-4e85-8b6b-daac5b3a83d2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100940 Aug 29 05:24:16.120892 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3077/6166] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:24:16 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:16.416226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:16.416936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:16.426443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:16.428551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:16.429017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:16.430255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:16.430722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:16.431149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:16.440137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:16.441390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:16.466032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:16.474316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:16.475608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:16.479149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:16.480746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:16.487017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:16.599555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:16.608712 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40244f11-e6d9-4352-affd-98050fbc7a23 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1261 microversion: 2.1 time: 0.197820 Aug 29 05:24:16.613925 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3090/6167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:16 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:16.940460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:16.953652 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-060a80c3-8d4e-4a7a-ab4a-7ab41d24fe32 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1684 microversion: 2.1 time: 0.514138 Aug 29 05:24:16.957055 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3078/6168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:16 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1684 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:16.980187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98258146-9fcf-41ea-9478-77d933a66abf tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:16.980844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98258146-9fcf-41ea-9478-77d933a66abf tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:16.994593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98258146-9fcf-41ea-9478-77d933a66abf tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:16.995099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98258146-9fcf-41ea-9478-77d933a66abf tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:16.995542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98258146-9fcf-41ea-9478-77d933a66abf tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:16.996393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98258146-9fcf-41ea-9478-77d933a66abf tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:17.000542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98258146-9fcf-41ea-9478-77d933a66abf tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:17.002431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98258146-9fcf-41ea-9478-77d933a66abf tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:17.134164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f578dbe8-b72e-4170-964e-e2925ac7baad tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:17.137370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f578dbe8-b72e-4170-964e-e2925ac7baad tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:17.154002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f578dbe8-b72e-4170-964e-e2925ac7baad tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:17.156606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f578dbe8-b72e-4170-964e-e2925ac7baad tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:17.157449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f578dbe8-b72e-4170-964e-e2925ac7baad tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:17.159789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f578dbe8-b72e-4170-964e-e2925ac7baad tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:17.161579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f578dbe8-b72e-4170-964e-e2925ac7baad tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:17.162841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f578dbe8-b72e-4170-964e-e2925ac7baad tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:17.228352 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f578dbe8-b72e-4170-964e-e2925ac7baad tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099395 Aug 29 05:24:17.233460 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3079/6169] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:24:17 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:24:17.385778 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98258146-9fcf-41ea-9478-77d933a66abf tempest-TestNetworkAdvancedServerOps-1549395422 tempest-TestNetworkAdvancedServerOps-1549395422-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1835 microversion: 2.1 time: 0.412817 Aug 29 05:24:17.401118 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3091/6170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:16 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1835 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:17.407266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:17.407894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:17.416315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:17.416811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:17.417250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:17.417956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:17.420282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:17.420938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:17.636306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:17.638065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:17.647988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:17.648907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:17.649574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:17.650558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:17.651243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:17.651929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:17.791588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:17.795428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:17.806161 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b011b751-2771-462a-9e2f-fdafde68a0fe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1267 microversion: 2.1 time: 0.175294 Aug 29 05:24:17.806818 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4ef34997-779e-4cd9-ae64-d8dfc7475ca3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1684 microversion: 2.1 time: 0.403636 Aug 29 05:24:17.808964 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3092/6171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:17 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:17.820474 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3080/6172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:17 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1684 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:18.241612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87227ef1-bb3d-4845-9836-87c7c2bfb359 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:18.245254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-87227ef1-bb3d-4845-9836-87c7c2bfb359 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:18.257248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87227ef1-bb3d-4845-9836-87c7c2bfb359 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:18.260266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87227ef1-bb3d-4845-9836-87c7c2bfb359 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:18.261123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87227ef1-bb3d-4845-9836-87c7c2bfb359 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:18.262347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87227ef1-bb3d-4845-9836-87c7c2bfb359 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:18.262981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87227ef1-bb3d-4845-9836-87c7c2bfb359 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:18.263567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87227ef1-bb3d-4845-9836-87c7c2bfb359 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:18.318171 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-87227ef1-bb3d-4845-9836-87c7c2bfb359 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081028 Aug 29 05:24:18.318773 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3093/6173] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:24:18 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:18.824391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-bbd788e9-2591-4bf9-9224-e3f68c2b1977 req-c1167b73-8ee0-45f1-add1-2ab0876541b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d44a5a-4523-41b9-b363-2ec892884f22", "tag": "bc69f67a-23a8-410f-9e25-6fce0a1f2e38"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:18.829669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:18.830319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:18.842392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:18.844072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:18.844801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:18.846089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:18.846903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:18.848039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:18.865294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bbd788e9-2591-4bf9-9224-e3f68c2b1977 req-c1167b73-8ee0-45f1-add1-2ab0876541b2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:18.866340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bbd788e9-2591-4bf9-9224-e3f68c2b1977 req-c1167b73-8ee0-45f1-add1-2ab0876541b2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:18.866802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bbd788e9-2591-4bf9-9224-e3f68c2b1977 req-c1167b73-8ee0-45f1-add1-2ab0876541b2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:18.900529 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-bbd788e9-2591-4bf9-9224-e3f68c2b1977 req-c1167b73-8ee0-45f1-add1-2ab0876541b2 service nova] Creating event network-changed:bc69f67a-23a8-410f-9e25-6fce0a1f2e38 for instance 52d44a5a-4523-41b9-b363-2ec892884f22 on n-h1-854119-9 Aug 29 05:24:18.907076 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-bbd788e9-2591-4bf9-9224-e3f68c2b1977 req-c1167b73-8ee0-45f1-add1-2ab0876541b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086715 Aug 29 05:24:18.908650 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3081/6174] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:19.109625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:19.138464 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-00ba7e4c-8336-407a-bf72-5eea8e7c1896 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1309 microversion: 2.1 time: 0.309571 Aug 29 05:24:19.139543 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3094/6175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:18 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:19.331526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-00c7ec7e-af09-45aa-9a6e-8ccb3a1638e1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:19.333875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-00c7ec7e-af09-45aa-9a6e-8ccb3a1638e1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:19.341007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c7ec7e-af09-45aa-9a6e-8ccb3a1638e1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:19.341728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c7ec7e-af09-45aa-9a6e-8ccb3a1638e1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:19.342338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c7ec7e-af09-45aa-9a6e-8ccb3a1638e1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:19.343212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c7ec7e-af09-45aa-9a6e-8ccb3a1638e1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:19.343834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c7ec7e-af09-45aa-9a6e-8ccb3a1638e1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:19.344679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c7ec7e-af09-45aa-9a6e-8ccb3a1638e1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:19.378332 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-00c7ec7e-af09-45aa-9a6e-8ccb3a1638e1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051142 Aug 29 05:24:19.379232 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3082/6176] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:24:19 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:19.969046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5d9f70f6-cde1-4cf9-a6ea-94bca4e78c03 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:19.972285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5d9f70f6-cde1-4cf9-a6ea-94bca4e78c03 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:19.978927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d9f70f6-cde1-4cf9-a6ea-94bca4e78c03 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:19.979676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d9f70f6-cde1-4cf9-a6ea-94bca4e78c03 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:19.980351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d9f70f6-cde1-4cf9-a6ea-94bca4e78c03 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:19.981222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d9f70f6-cde1-4cf9-a6ea-94bca4e78c03 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:19.981882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d9f70f6-cde1-4cf9-a6ea-94bca4e78c03 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:19.982495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d9f70f6-cde1-4cf9-a6ea-94bca4e78c03 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:20.041120 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5d9f70f6-cde1-4cf9-a6ea-94bca4e78c03 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9/action" status: 200 len: 38537 microversion: 2.1 time: 0.076800 Aug 29 05:24:20.049431 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3095/6177] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:24:19 2022] POST /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9/action => generated 38537 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:24:20.159470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:20.160874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:20.168355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:20.169318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:20.170005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:20.170845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:20.171309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:20.171814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:20.394443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-04462faf-4a17-4816-a9f5-5905353a8561 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:20.398471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-04462faf-4a17-4816-a9f5-5905353a8561 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:20.410468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04462faf-4a17-4816-a9f5-5905353a8561 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:20.411192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04462faf-4a17-4816-a9f5-5905353a8561 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:20.412347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04462faf-4a17-4816-a9f5-5905353a8561 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:20.413149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04462faf-4a17-4816-a9f5-5905353a8561 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:20.414056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04462faf-4a17-4816-a9f5-5905353a8561 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:20.414909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04462faf-4a17-4816-a9f5-5905353a8561 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:20.436203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:20.450893 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4dc87886-b913-4d33-9260-5b4ce6f56785 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1309 microversion: 2.1 time: 0.291132 Aug 29 05:24:20.455300 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3083/6178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:20 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:20.477024 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-04462faf-4a17-4816-a9f5-5905353a8561 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089601 Aug 29 05:24:20.483052 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3096/6179] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:24:20 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:21.279843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-61cf2259-5638-4b70-94a9-e46bb41e480b req-74912952-e9a8-4059-82dc-a39f8696cf35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9", "tag": "acf10729-be07-494e-bce8-ba9aea0c9a63"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:21.287460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:21.288051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:21.295889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-61cf2259-5638-4b70-94a9-e46bb41e480b req-74912952-e9a8-4059-82dc-a39f8696cf35 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:21.296408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-61cf2259-5638-4b70-94a9-e46bb41e480b req-74912952-e9a8-4059-82dc-a39f8696cf35 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:21.296874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-61cf2259-5638-4b70-94a9-e46bb41e480b req-74912952-e9a8-4059-82dc-a39f8696cf35 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:21.303717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:21.304241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:21.304672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:21.305633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:21.306052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:21.306467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:21.333197 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-61cf2259-5638-4b70-94a9-e46bb41e480b req-74912952-e9a8-4059-82dc-a39f8696cf35 service nova] Creating event network-changed:acf10729-be07-494e-bce8-ba9aea0c9a63 for instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 on n-h2-854119-9 Aug 29 05:24:21.341085 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-61cf2259-5638-4b70-94a9-e46bb41e480b req-74912952-e9a8-4059-82dc-a39f8696cf35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064931 Aug 29 05:24:21.342178 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3097/6180] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:21.350536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:24:21.462209 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f3952463-e958-4d79-aec5-206fbba96ce1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 204 len: 0 microversion: 2.1 time: 0.191133 Aug 29 05:24:21.462887 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3084/6181] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:24:21 2022] DELETE /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:24:21.473390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:21.474393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:21.481904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:21.482318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:21.482981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:21.483301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:21.484012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:21.484207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:21.484798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:21.485442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:21.492451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:21.493258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:21.493705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:21.494786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:21.495741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:21.496211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:21.509826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:21.795507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:21.811238 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b495b076-3768-4714-8966-f641d22ed8cf tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1690 microversion: 2.1 time: 0.343497 Aug 29 05:24:21.817363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:21.818403 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3098/6182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:21 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1690 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:21.829005 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69dfbd33-04d8-4b14-8df2-ab1372148f76 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1309 microversion: 2.1 time: 0.351300 Aug 29 05:24:21.831861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3085/6183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:21 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1309 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:21.835123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-963335a3-5f68-4caf-b78d-9fab997fae39 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:21.837456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-963335a3-5f68-4caf-b78d-9fab997fae39 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:21.866033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963335a3-5f68-4caf-b78d-9fab997fae39 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:21.866548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963335a3-5f68-4caf-b78d-9fab997fae39 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:21.866995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963335a3-5f68-4caf-b78d-9fab997fae39 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:21.867724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963335a3-5f68-4caf-b78d-9fab997fae39 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:21.872972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963335a3-5f68-4caf-b78d-9fab997fae39 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:21.878550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963335a3-5f68-4caf-b78d-9fab997fae39 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:21.944392 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-963335a3-5f68-4caf-b78d-9fab997fae39 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124683 Aug 29 05:24:21.946785 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3099/6184] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:24:21 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:22.840782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:22.849680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:22.855850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:22.856795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:22.857508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:22.867666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:22.868302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:22.869066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:22.870681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:22.871255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:22.871583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:22.871936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:22.872424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:22.872616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:22.873542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:22.874112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:22.874620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:23.151376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:23.162599 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c203027b-a788-4ad2-a571-431a1bfb4b4d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1309 microversion: 2.1 time: 0.311578 Aug 29 05:24:23.163806 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3100/6185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:22 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1309 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:23.178724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51f6280d-d5e9-4bde-8606-5746edad1532 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:23.181359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51f6280d-d5e9-4bde-8606-5746edad1532 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:23.189876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51f6280d-d5e9-4bde-8606-5746edad1532 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:23.190938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51f6280d-d5e9-4bde-8606-5746edad1532 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:23.192086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51f6280d-d5e9-4bde-8606-5746edad1532 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:23.193049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51f6280d-d5e9-4bde-8606-5746edad1532 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:23.194641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51f6280d-d5e9-4bde-8606-5746edad1532 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:23.195091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51f6280d-d5e9-4bde-8606-5746edad1532 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:23.254926 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51f6280d-d5e9-4bde-8606-5746edad1532 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089704 Aug 29 05:24:23.255700 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3101/6186] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:24:23 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:24:23.260065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3062ec9d-322b-4670-aca7-a475704e2c58 req-2daa0b9a-838c-4ec2-9c0f-89ce6cc89699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9", "name": "network-vif-deleted", "tag": "acf10729-be07-494e-bce8-ba9aea0c9a63"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:23.279170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3062ec9d-322b-4670-aca7-a475704e2c58 req-2daa0b9a-838c-4ec2-9c0f-89ce6cc89699 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:23.279664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3062ec9d-322b-4670-aca7-a475704e2c58 req-2daa0b9a-838c-4ec2-9c0f-89ce6cc89699 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:23.280164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3062ec9d-322b-4670-aca7-a475704e2c58 req-2daa0b9a-838c-4ec2-9c0f-89ce6cc89699 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:23.300165 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3062ec9d-322b-4670-aca7-a475704e2c58 req-2daa0b9a-838c-4ec2-9c0f-89ce6cc89699 service nova] Creating event network-vif-deleted:acf10729-be07-494e-bce8-ba9aea0c9a63 for instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 on n-h2-854119-9 Aug 29 05:24:23.309696 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3062ec9d-322b-4670-aca7-a475704e2c58 req-2daa0b9a-838c-4ec2-9c0f-89ce6cc89699 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051985 Aug 29 05:24:23.314574 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3102/6187] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:23.341682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:23.342192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:23.347372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:23.349485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:23.349976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:23.350424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:23.351831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:23.352657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:23.353193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:23.361955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0074a81-983d-428d-8469-5a7afb0ed124 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 200 len: 1571 microversion: 2.1 time: 0.524797 Aug 29 05:24:23.365064 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3086/6188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:22 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 1571 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:23.386385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:24:23.513810 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3db2cbc3-2c99-4889-86f4-8919026a6253 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 204 len: 0 microversion: 2.1 time: 0.176423 Aug 29 05:24:23.515173 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3103/6189] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:24:23 2022] DELETE /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:24:23.529215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:23.529842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:23.537158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:23.538046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:23.538671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:23.539645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:23.540413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:23.541023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:23.687081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:23.695161 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8bd09bef-3235-4733-80dd-f60b1884a19b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1681 microversion: 2.1 time: 0.173338 Aug 29 05:24:23.696047 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3087/6190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:23 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:24.185801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:24.186592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:24.189570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:24.190245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:24.197629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:24.198118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:24.198550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:24.199255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:24.199705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:24.200167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:24.340606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:24.349056 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-106fbef7-4e64-4629-9c8f-899b9b2fe047 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1309 microversion: 2.1 time: 0.167665 Aug 29 05:24:24.356310 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3104/6191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:24 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:24.389012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:24.389575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:24.392294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:24.393100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:24.399268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:24.399904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:24.400608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:24.401405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:24.401952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:24.402472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:24.413920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f4c77bf1-bb32-4ab1-8004-18900829a298 req-5d8a64bb-9e95-42d1-88ab-5ca018484477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d44a5a-4523-41b9-b363-2ec892884f22", "name": "network-vif-plugged", "status": "completed", "tag": "bc69f67a-23a8-410f-9e25-6fce0a1f2e38"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:24.432464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f4c77bf1-bb32-4ab1-8004-18900829a298 req-5d8a64bb-9e95-42d1-88ab-5ca018484477 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:24.433070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f4c77bf1-bb32-4ab1-8004-18900829a298 req-5d8a64bb-9e95-42d1-88ab-5ca018484477 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:24.433599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f4c77bf1-bb32-4ab1-8004-18900829a298 req-5d8a64bb-9e95-42d1-88ab-5ca018484477 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:24.439433 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] HTTP exception thrown: Instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 could not be found. Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Request method failure captured: Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 HTTP/1.1 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEsXp8EfnvUqPmqsIzL4luSArQxeepnzAbWptfIG1OpEe8LS77ZppQzW8i3IW3VRqRq0TXI0NHqdByu2osRldV9U4AXBKV1QE-ARj2EAJgT8Qh_eOA9gF95LKAhkL1je_M0xm4pD9D4xIQk90moSvRJJWOWxOEg7BDrFFCWPYYNj2d8 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: e5306aaa62bb4e1f9b407bce73b397f0 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5306aaa62bb4e1f9b407bce73b397f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: e5306aaa62bb4e1f9b407bce73b397f0 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestNetworkAdvancedServerOps-1974793548-project Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6bcb6393cb0a4e6a857d0d5e960eba01 Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1974793548-project Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 could not be found. Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9'} Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 could not be found. Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 could not be found. Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:24.441218 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:24.447410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:24.447410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:24.447410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:24.447410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:24.447410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:24:24.447410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:24:24.447410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 could not be found. Aug 29 05:24:24.447410 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:24.447410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Returning 404 to user: Instance a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:24:24.448792 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4a009213-868d-4d42-b301-3629e8538692 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9" status: 404 len: 111 microversion: 2.1 time: 0.064654 Aug 29 05:24:24.452653 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3088/6192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:24 2022] GET /compute/v2.1/servers/a9b5e1ba-9ec3-4d47-88f3-b35d4edba6d9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:24:24.461764 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f4c77bf1-bb32-4ab1-8004-18900829a298 req-5d8a64bb-9e95-42d1-88ab-5ca018484477 service nova] Creating event network-vif-plugged:bc69f67a-23a8-410f-9e25-6fce0a1f2e38 for instance 52d44a5a-4523-41b9-b363-2ec892884f22 on n-h1-854119-9 Aug 29 05:24:24.466850 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f4c77bf1-bb32-4ab1-8004-18900829a298 req-5d8a64bb-9e95-42d1-88ab-5ca018484477 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056604 Aug 29 05:24:24.467910 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3105/6193] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:24:24.717783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:24.718445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:24.724785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:24.725601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:24.726033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:24.726722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:24.727169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:24.727585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:24.869821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:24.878523 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-08027cab-b737-4538-b621-2314e33cc93a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1681 microversion: 2.1 time: 0.164770 Aug 29 05:24:24.879239 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3089/6194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:24 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:25.373656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:25.374654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:25.382902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:25.383525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:25.384389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:25.385298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:25.385740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:25.386344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:25.583535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:25.593638 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7cadaf4-0d26-4b0e-9c0b-fd05158dea39 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1309 microversion: 2.1 time: 0.226015 Aug 29 05:24:25.594413 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3106/6195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:25 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:25.910306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:25.911790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:25.924386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:25.925626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:25.926219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:25.927630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:25.928712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:25.929531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:26.490755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:26.502681 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d2f98288-f3c3-47b9-af01-1bd1be153a8f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1681 microversion: 2.1 time: 0.597247 Aug 29 05:24:26.506231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3090/6196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:25 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1681 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:26.621918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:26.622891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:26.635326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:26.646128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:26.647062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:26.674607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:26.675441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:26.676261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:27.148088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:27.161109 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc08b0f2-cdb2-4234-8041-8529fc9ca3a6 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1309 microversion: 2.1 time: 0.548355 Aug 29 05:24:27.162951 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3107/6197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:26 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1309 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:27.525716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:27.526334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:27.541933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:27.542442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:27.542883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:27.543624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:27.544073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:27.544531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:27.586379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:27.693760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:27.703102 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7566bd20-88b5-4d2c-8b46-3fa9eb52584b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1614 microversion: 2.1 time: 0.181324 Aug 29 05:24:27.708726 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3091/6198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:27 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1614 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:28.182970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:28.184203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:28.195902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:28.197471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:28.198126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:28.199229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:28.199843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:28.200473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:28.253367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-afa9f821-9a98-48c6-aad6-ccf8993129d3 req-0ade138b-14fb-4e40-9ffa-41b9563b6f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c32e9f9-9b4d-4503-9659-ca08f6ce7328", "name": "network-vif-deleted", "tag": "f26698e6-bda4-45c5-8fe9-3eee7738792d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:28.270991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-afa9f821-9a98-48c6-aad6-ccf8993129d3 req-0ade138b-14fb-4e40-9ffa-41b9563b6f68 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:28.271790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-afa9f821-9a98-48c6-aad6-ccf8993129d3 req-0ade138b-14fb-4e40-9ffa-41b9563b6f68 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:28.273202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-afa9f821-9a98-48c6-aad6-ccf8993129d3 req-0ade138b-14fb-4e40-9ffa-41b9563b6f68 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:28.291348 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-afa9f821-9a98-48c6-aad6-ccf8993129d3 req-0ade138b-14fb-4e40-9ffa-41b9563b6f68 service nova] Creating event network-vif-deleted:f26698e6-bda4-45c5-8fe9-3eee7738792d for instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 on n-h1-854119-9 Aug 29 05:24:28.297143 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-afa9f821-9a98-48c6-aad6-ccf8993129d3 req-0ade138b-14fb-4e40-9ffa-41b9563b6f68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048740 Aug 29 05:24:28.298260 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3092/6199] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:24:28.730176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:28.731126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:28.738709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:28.739314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:28.739837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:28.740750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:28.741438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:28.741942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:28.781093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:28.782139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:28.782509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:28.783059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lazy-loading 'fault' on Instance uuid 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:24:28.876170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:28.887520 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9f644741-dcb4-4d92-8810-6acc7bd5ef53 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 200 len: 1332 microversion: 2.1 time: 0.161517 Aug 29 05:24:28.900224 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3093/6200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:28 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 1332 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:28.977430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:28.989392 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-250095a6-fcee-49b5-a0b6-7832662251a1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1491 microversion: 2.1 time: 0.810302 Aug 29 05:24:28.992686 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3108/6201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:28 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1491 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:29.153371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2037828033", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "8741d5cf-41df-4e83-8c96-bb20519598e2"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:29.223646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] validate_networks() for [('8741d5cf-41df-4e83-8c96-bb20519598e2', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:24:29.505359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd2ddb44-03d6-4a4c-991b-43890f8189f1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '.version_select at 0x7f1abd8cd9d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:29.534646 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cd2ddb44-03d6-4a4c-991b-43890f8189f1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-112248482" status: 202 len: 0 microversion: 2.1 time: 0.033630 Aug 29 05:24:29.537128 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3109/6202] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Aug 29 05:24:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-112248482 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:24:29.566693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e74afce5-b948-473b-9db9-a0cd3f2b0135 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'create', calling method: .version_select at 0x7f1abda258b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1414645956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/0BSIi3xh2tZagUSthKbcr/0ARbwX4QlQPyFegkYqgMBAxXLGserZLWURkF4qs0XQ58mYF6mpWCB4gR+2Qi6Ldxri5/01lHt6cd4vG70MvXLLixr5LyxqceGTHDNh41Q=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:29.593174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e74afce5-b948-473b-9db9-a0cd3f2b0135 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:24:29.604054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e74afce5-b948-473b-9db9-a0cd3f2b0135 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for user 6bcb6393cb0a4e6a857d0d5e960eba01 and project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:24:29.634387 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e74afce5-b948-473b-9db9-a0cd3f2b0135 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.071827 Aug 29 05:24:29.635225 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3110/6203] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:24:29 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:29.773128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:24:29.773607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:24:29.774174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:24:29.774589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:24:29.775002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:24:29.785127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:29.785956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:29.786581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:29.787373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:29.787865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:29.788315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:29.807747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:24:29.813625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for user 87aef4a0e8af4640b7f1dd06e446eb0d and project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:24:29.827664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:24:29.830097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:24:29.909413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:29.910381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:29.919932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:29.922235 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b6b3739-77b6-41e8-aa76-5abe9c3baa74 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772771 Aug 29 05:24:29.922977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:29.923614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:29.924370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:29.924827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:29.925253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:29.935430 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3094/6204] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:24:29.944457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97b08f93-c576-4af6-91f8-1afee9efcc93 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:29.945149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97b08f93-c576-4af6-91f8-1afee9efcc93 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:29.967107 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 HTTP/1.1 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '9c32e9f9-9b4d-4503-9659-ca08f6ce7328'} Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:29.970103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:29.974645 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:29.974645 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:29.974645 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:29.974645 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:24:29.974645 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:24:29.974645 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:24:29.974645 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:24:29.987761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:24:29.989084 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cd8583b6-bf32-4a4c-ade2-9624224bc793 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 404 len: 111 microversion: 2.1 time: 0.083923 Aug 29 05:24:29.990246 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3111/6205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:29 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:24:29.998792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5242722c-5b2e-44e5-aa12-3779778c3a55 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '.version_select at 0x7f1ab8b3c3a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:30.038845 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5242722c-5b2e-44e5-aa12-3779778c3a55 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111967681" status: 202 len: 0 microversion: 2.1 time: 0.044237 Aug 29 05:24:30.039679 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3112/6206] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 05:24:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111967681 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:24:30.073860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97b08f93-c576-4af6-91f8-1afee9efcc93 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:30.082065 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97b08f93-c576-4af6-91f8-1afee9efcc93 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1209 microversion: 2.1 time: 0.141670 Aug 29 05:24:30.082661 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3095/6207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:29 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1209 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:31.089248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ec6fd1e-dde3-4bc7-9d2f-c56942b421a0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: .version_select at 0x7f1abd90ad30>, body: {"keypair": {"name": "tempest-keypair-1827143793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4GBQBacMmG7OBL8JYJx+3NklgXE5r2i//ff6FAp82uCTQx5NQ+uP1sFq9TGsd/wPUP0cySin6mwUN7NEryCa7OMAkwHTBg1ms8IVSmYG7mdHQzh48yFVCCgRtyA4ajSA=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:31.104166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:31.105507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:31.115633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:31.116332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:31.116878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:31.118688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:31.119677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:31.120729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:31.133235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-1ec6fd1e-dde3-4bc7-9d2f-c56942b421a0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:24:31.139983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-1ec6fd1e-dde3-4bc7-9d2f-c56942b421a0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for user ca6430b480c54898b9ed01529f25049a and project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:24:31.173149 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ec6fd1e-dde3-4bc7-9d2f-c56942b421a0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088299 Aug 29 05:24:31.180322 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3113/6208] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:24:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:31.209142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:31.218859 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f321ef3e-57e5-4c28-a842-9f39b7b6c190 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1261 microversion: 2.1 time: 0.119279 Aug 29 05:24:31.219629 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3096/6209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:31 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1261 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:32.243840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:32.245244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:32.251852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:32.252627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:32.253311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:32.254257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:32.254905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:32.255571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:32.354369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:32.371497 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d65c18bd-347f-4da0-aab1-3a9bd302a92a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1267 microversion: 2.1 time: 0.134944 Aug 29 05:24:32.374801 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3114/6210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:32 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:33.395505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:33.396791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:33.407846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:33.413160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:33.413807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:33.414815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:33.415435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:33.416019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:33.749359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:33.761723 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cc7cefef-0f1c-44d2-8a63-756ed2170508 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1309 microversion: 2.1 time: 0.369908 Aug 29 05:24:33.765638 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3097/6211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:33 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1309 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:33.834714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-e96adbe5-4690-42e3-8b00-7f03bcdb717f req-7a8f5833-e926-4214-9f7e-b6be597b636f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76bc3747-d8a9-4259-87b4-aa9f6e8493e7", "tag": "4764ce01-02cb-43bc-8c80-4e32650a6e89"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:33.846806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e96adbe5-4690-42e3-8b00-7f03bcdb717f req-7a8f5833-e926-4214-9f7e-b6be597b636f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:33.847570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e96adbe5-4690-42e3-8b00-7f03bcdb717f req-7a8f5833-e926-4214-9f7e-b6be597b636f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:33.848206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-e96adbe5-4690-42e3-8b00-7f03bcdb717f req-7a8f5833-e926-4214-9f7e-b6be597b636f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:33.860905 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-e96adbe5-4690-42e3-8b00-7f03bcdb717f req-7a8f5833-e926-4214-9f7e-b6be597b636f service nova] Creating event network-changed:4764ce01-02cb-43bc-8c80-4e32650a6e89 for instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 on n-h1-854119-9 Aug 29 05:24:33.867945 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-e96adbe5-4690-42e3-8b00-7f03bcdb717f req-7a8f5833-e926-4214-9f7e-b6be597b636f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036911 Aug 29 05:24:33.868826 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3115/6212] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:34.046331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2035148528", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03e6ddac-5990-46d1-82b5-fc12cac2bd56"}], "security_groups": [{"name": "tempest-securitygroup--485566970"}], "key_name": "tempest-keypair-1827143793", "user_data": "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:34.290703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] validate_networks() for [('03e6ddac-5990-46d1-82b5-fc12cac2bd56', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:24:34.786106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:34.786801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:34.796736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:34.797473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:34.798257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:34.799219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:34.799891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:34.800600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:35.560979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:35.569056 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08bce3cd-b354-4e38-989a-47df0a7a933b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1309 microversion: 2.1 time: 0.788272 Aug 29 05:24:35.590104 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3116/6213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:34 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1309 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:35.595989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:35.596744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:35.604872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:35.606075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:35.609204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:35.611347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:35.612048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:35.612963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:35.712342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:24:35.712816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:24:35.713242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:24:35.713714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:24:35.714134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:24:35.723324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:35.724063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:35.724694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:35.725596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:35.726248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:35.726841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:35.737614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lazy-loading 'services' on Instance uuid 635e3272-74c9-40af-931a-531bb7658fba {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:24:35.748474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:24:35.754681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for user ca6430b480c54898b9ed01529f25049a and project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:24:35.772211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:24:35.774716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:24:35.894942 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f7e7899e-170c-4d06-9830-a14f1a94436f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "DELETE /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/os-volume_attachments/916913e8-b645-41cd-8060-d31f47523941" status: 202 len: 0 microversion: 2.1 time: 0.302684 Aug 29 05:24:35.898728 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3117/6214] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:24:35 2022] DELETE /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/os-volume_attachments/916913e8-b645-41cd-8060-d31f47523941 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:24:35.906994 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2d8c360e-1344-4274-bcc1-ecc3fbd8f160 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.867246 Aug 29 05:24:35.907806 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3098/6215] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:24:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:24:35.925114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d82d3510-1b69-4aca-ba3f-2c4bdcd91cc1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:35.926974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d82d3510-1b69-4aca-ba3f-2c4bdcd91cc1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:36.040735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d82d3510-1b69-4aca-ba3f-2c4bdcd91cc1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:36.054505 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d82d3510-1b69-4aca-ba3f-2c4bdcd91cc1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1242 microversion: 2.1 time: 0.136934 Aug 29 05:24:36.055474 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3118/6216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:35 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:36.590733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:36.591687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:36.598825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:36.599637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:36.600327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:36.601255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:36.601925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:36.602608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:36.940432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:36.953828 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e7f905f-80fd-4370-8cf7-f10946db1d68 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1309 microversion: 2.1 time: 0.366713 Aug 29 05:24:36.955244 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3099/6217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:36 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1309 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:37.075133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:37.075743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:37.093091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:37.093869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:37.094493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:37.097699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:37.108974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:37.109788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:37.310820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:37.319904 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-82b098d9-9a6e-476b-9da2-118bc1e6bead tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1246 microversion: 2.1 time: 0.248509 Aug 29 05:24:37.321246 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3119/6218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:37 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1246 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:37.979110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:37.980782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:37.999040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:37.999647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:38.000445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:38.001406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:38.002066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:38.002872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:38.344750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:38.346088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:38.363859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:38.372529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:38.373572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:38.376702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:38.377401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:38.378037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:38.442478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:38.814596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:38.833487 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-334b14ea-b24f-497c-8fa3-621cd5a1e4b2 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1246 microversion: 2.1 time: 0.495271 Aug 29 05:24:38.834158 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3120/6219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:38 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1246 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:38.881225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:38.891511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8d1d650-c5af-424f-88f8-14c6047954de tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1309 microversion: 2.1 time: 0.918195 Aug 29 05:24:38.899901 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3100/6220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:37 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1309 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:39.863346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:39.864173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:39.888205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:39.888712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:39.889159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:39.892277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:39.894628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:39.895653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:39.917396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:39.918892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:39.926272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:39.927643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:39.929075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:39.930015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:39.930650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:39.933634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:40.700232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:40.710032 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e3c01678-5a7b-4aad-95f4-6000116a148d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1312 microversion: 2.1 time: 0.859413 Aug 29 05:24:40.711232 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3121/6221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:39 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1312 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:41.127213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e179053-ab00-41ba-908d-cec325656450 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:41.129552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6e179053-ab00-41ba-908d-cec325656450 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:41.140725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e179053-ab00-41ba-908d-cec325656450 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:41.141559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e179053-ab00-41ba-908d-cec325656450 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:41.142023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e179053-ab00-41ba-908d-cec325656450 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:41.142812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e179053-ab00-41ba-908d-cec325656450 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:41.143137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e179053-ab00-41ba-908d-cec325656450 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:41.143589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e179053-ab00-41ba-908d-cec325656450 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:41.147966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:41.176789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b29a808e-6069-4666-8ca2-10832a146f06 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1309 microversion: 2.1 time: 1.258477 Aug 29 05:24:41.189264 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3101/6222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:39 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1309 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:41.225027 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e179053-ab00-41ba-908d-cec325656450 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "POST /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb/action" status: 200 len: 24516 microversion: 2.1 time: 0.101569 Aug 29 05:24:41.226055 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3122/6223] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:24:41 2022] POST /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb/action => generated 24516 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 05:24:41.732227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:41.733435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:41.741403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:41.742176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:41.742988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:41.743996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:41.744635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:41.745257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:41.934321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:41.980374 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-81f00a01-2f7c-4040-b818-76365faf16aa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1300 microversion: 2.1 time: 0.247402 Aug 29 05:24:41.998129 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3102/6224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:41 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:42.124186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-516179844", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "6bbaedae-dfee-4258-9639-8fa492002c7a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1414645956", "security_groups": [{"name": "tempest-secgroup-smoke-509949450"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:42.208153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:42.208813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:42.216616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:42.217112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:42.217545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:42.233234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:42.233720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:42.234409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:42.357328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] validate_networks() for [('6bbaedae-dfee-4258-9639-8fa492002c7a', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:24:42.692401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:42.704782 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c6c146a4-fce3-48d7-9869-412c34d2f147 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1309 microversion: 2.1 time: 0.508307 Aug 29 05:24:42.714471 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3103/6225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:42 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1309 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:43.003439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:43.004294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:43.018357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:43.019178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:43.020411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:43.022553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:43.024578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:43.025209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:43.557623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:43.567139 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b6756ebb-ac32-41c2-8129-ff9d71d6f935 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.568891 Aug 29 05:24:43.576017 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3104/6226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:42 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:43.607471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ca830695-a14c-4746-92f1-16dd46f88a64 req-f764b1a2-9d68-42dc-ae7f-641fdd894023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76bc3747-d8a9-4259-87b4-aa9f6e8493e7", "name": "network-vif-plugged", "status": "completed", "tag": "4764ce01-02cb-43bc-8c80-4e32650a6e89"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:43.638740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ca830695-a14c-4746-92f1-16dd46f88a64 req-f764b1a2-9d68-42dc-ae7f-641fdd894023 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:43.639511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ca830695-a14c-4746-92f1-16dd46f88a64 req-f764b1a2-9d68-42dc-ae7f-641fdd894023 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:43.640161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ca830695-a14c-4746-92f1-16dd46f88a64 req-f764b1a2-9d68-42dc-ae7f-641fdd894023 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:43.670286 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ca830695-a14c-4746-92f1-16dd46f88a64 req-f764b1a2-9d68-42dc-ae7f-641fdd894023 service nova] Creating event network-vif-plugged:4764ce01-02cb-43bc-8c80-4e32650a6e89 for instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 on n-h1-854119-9 Aug 29 05:24:43.677255 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ca830695-a14c-4746-92f1-16dd46f88a64 req-f764b1a2-9d68-42dc-ae7f-641fdd894023 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099166 Aug 29 05:24:43.678322 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3105/6227] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:43.747029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:43.747822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:43.762163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:43.763978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:43.764676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:43.765773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:43.766418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:43.767016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:43.901468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:24:43.901970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:24:43.902369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:24:43.902782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:24:43.903206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:24:43.921395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:43.922021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:43.922468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:43.923307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:43.923773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:43.924225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:43.961301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:24:43.977799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Getting quotas for user 6bcb6393cb0a4e6a857d0d5e960eba01 and project e5306aaa62bb4e1f9b407bce73b397f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:24:44.018355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:24:44.026498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:24:44.126772 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b9f12300-eb5e-4e7b-bb58-808fefe889ae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.009413 Aug 29 05:24:44.127436 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3123/6228] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:24:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:24:44.144227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47e0f20a-201d-4f0b-9ed3-00fc54df3991 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:44.145079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47e0f20a-201d-4f0b-9ed3-00fc54df3991 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:44.669332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47e0f20a-201d-4f0b-9ed3-00fc54df3991 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:44.689471 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47e0f20a-201d-4f0b-9ed3-00fc54df3991 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1266 microversion: 2.1 time: 0.543492 Aug 29 05:24:44.697812 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3124/6229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:44 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1266 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:44.727772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:44.731088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:44.754401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:44.754911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:44.761357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:44.764933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:44.765889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:44.766380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:44.772454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:44.786822 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef223277-2b64-425f-acc9-b1cf85f86678 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1309 microversion: 2.1 time: 1.054730 Aug 29 05:24:44.804553 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3106/6230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:43 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1309 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:45.216108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:45.231543 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78f4120f-5e19-439c-aae6-73fd79251b48 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.531981 Aug 29 05:24:45.248426 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3125/6231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:44 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:45.647425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-17169071-9a3c-49f2-9aff-8fb4522ccfdb req-daca861d-6c01-43f2-85c5-80408c15965b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daaf5180-0cbc-4564-807b-563d307e99d7", "tag": "104c6839-eca7-49c4-8542-1e54b0d5bfcd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:45.674579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-17169071-9a3c-49f2-9aff-8fb4522ccfdb req-daca861d-6c01-43f2-85c5-80408c15965b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:45.675660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-17169071-9a3c-49f2-9aff-8fb4522ccfdb req-daca861d-6c01-43f2-85c5-80408c15965b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:45.676652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-17169071-9a3c-49f2-9aff-8fb4522ccfdb req-daca861d-6c01-43f2-85c5-80408c15965b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:45.699382 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-17169071-9a3c-49f2-9aff-8fb4522ccfdb req-daca861d-6c01-43f2-85c5-80408c15965b service nova] Creating event network-changed:104c6839-eca7-49c4-8542-1e54b0d5bfcd for instance daaf5180-0cbc-4564-807b-563d307e99d7 on n-h1-854119-9 Aug 29 05:24:45.721050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:45.722196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:45.732925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-17169071-9a3c-49f2-9aff-8fb4522ccfdb req-daca861d-6c01-43f2-85c5-80408c15965b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089964 Aug 29 05:24:45.735806 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3107/6232] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:45.749406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:45.750299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:45.750786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:45.751489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:45.751941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:45.762654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:45.811664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:45.812622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:45.814864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:45.817166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=14 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:45.835696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:45.837040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:45.838321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:45.839332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:45.840016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:45.840925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:45.932142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:45.998938 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-91567bbd-3da6-469a-8654-f7c2f31a8cc7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1318 microversion: 2.1 time: 0.285558 Aug 29 05:24:45.999599 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3126/6233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:45 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:46.262660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:46.264163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:46.274390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:46.274948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:46.275472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:46.276356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:46.277049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:46.277553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:46.295225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:46.308643 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a41f75a2-559e-4ce1-888e-f2c3b27dba8c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1309 microversion: 2.1 time: 0.501238 Aug 29 05:24:46.326504 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3108/6234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:45 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1309 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:46.767793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:46.787018 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b8b06b9b-a2ee-4f21-a231-e4c7655338c0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.530119 Aug 29 05:24:46.788023 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3127/6235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:46 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:47.021711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:47.023185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:47.043517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:47.044479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:47.045665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:47.047002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:47.047709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:47.048876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:47.189614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8a970495-fea9-492c-bfcb-2a91f87e4bfc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:47.199536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a970495-fea9-492c-bfcb-2a91f87e4bfc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:47.201146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a970495-fea9-492c-bfcb-2a91f87e4bfc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:47.207504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a970495-fea9-492c-bfcb-2a91f87e4bfc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:47.254816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8a970495-fea9-492c-bfcb-2a91f87e4bfc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Going to try to stop instance {{(pid=128872) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 05:24:47.301791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:47.321175 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2519017-8231-4a9c-b0e9-fc1c881ae591 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1318 microversion: 2.1 time: 0.297178 Aug 29 05:24:47.336863 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3109/6236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:47 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:47.354393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:47.356350 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8a970495-fea9-492c-bfcb-2a91f87e4bfc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/action" status: 202 len: 0 microversion: 2.1 time: 0.171607 Aug 29 05:24:47.357352 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3128/6237] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:24:47 2022] POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:24:47.358269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:47.371010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:47.372020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:47.377032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:47.379214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:47.379955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:47.381975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:47.382728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:47.385300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:47.391462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:47.393793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:47.394508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:47.398621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:47.399286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:47.402508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:47.913424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:47.924437 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2e1cfed-6634-4847-b8c5-5c414e64ba51 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1490 microversion: 2.1 time: 0.586215 Aug 29 05:24:47.925081 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3110/6238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:47 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1490 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:47.934491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:47.936495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:47.946436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:47.947345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:47.947784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:47.948648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:47.949376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:47.950192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:47.986934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:47.995726 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7bfa96d7-e2d6-43f7-8392-e54ea95a3795 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.634100 Aug 29 05:24:47.996346 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3129/6239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:47 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:48.001301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:48.002130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:48.008467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.009239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.009873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:48.010802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.011253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.011673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:48.309489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:48.312541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:48.316722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:48.322895 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ff5e903-1157-48f6-bb6e-9a1fd14f1ba4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.396738 Aug 29 05:24:48.324450 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3111/6240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:47 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:48.331256 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-879f2256-0851-4524-9709-e057501c5280 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1491 microversion: 2.1 time: 0.333281 Aug 29 05:24:48.344441 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3130/6241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:47 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1491 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:48.352904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:48.353107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:48.353538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:48.354869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:48.360608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.361594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.361594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:48.362333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.362792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.363241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:48.368297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.369392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.370170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:48.371225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.371986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.372659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:48.612942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:48.626960 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb8edb09-ddc5-4797-bcb1-b218e0116996 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1324 microversion: 2.1 time: 0.279985 Aug 29 05:24:48.628851 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3112/6242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:48 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:48.782335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:48.798972 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-327adcc2-4ce7-49e6-affc-0f81e7742dea tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1490 microversion: 2.1 time: 0.449888 Aug 29 05:24:48.804740 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3131/6243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:48 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1490 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:48.824855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:48.825479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:48.832416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.832893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.833393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:48.834159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.834697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.835181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:48.862044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:24:48.960529 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b1a8f57-74d6-4b26-ba21-62997e35b82c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 204 len: 0 microversion: 2.1 time: 0.140508 Aug 29 05:24:48.961130 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3113/6244] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:24:48 2022] DELETE /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:24:48.969615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:48.970313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:48.973516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:48.977538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.978320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.978815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:48.979516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:48.979957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:48.980403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:49.018227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:49.019589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:49.026460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:49.026959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:49.027399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:49.028363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:49.029048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:49.029484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:49.186561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:49.196414 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51b6a78b-e027-43c4-a01a-a54d5a227275 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1496 microversion: 2.1 time: 0.230525 Aug 29 05:24:49.197687 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3132/6245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:48 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1496 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:49.223663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:49.232647 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1796c64a-9af8-4d47-b9e6-ed3b3c5ca09b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.219043 Aug 29 05:24:49.233622 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3114/6246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:49 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:49.345261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:49.345880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:49.354803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:49.355306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:49.355800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:49.356548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:49.357193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:49.357792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:49.538196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:49.550930 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b4b709f3-c211-4db8-8b7e-a170a21b5a2f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.208758 Aug 29 05:24:49.551581 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3133/6247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:49 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:49.650044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:49.651875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:49.659483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:49.659983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:49.660445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:49.661296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:49.661937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:49.662544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:49.846559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:49.857489 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-26fc6f06-5399-4c89-8d67-ae817bb3fb48 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1391 microversion: 2.1 time: 0.211150 Aug 29 05:24:49.858492 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3115/6248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:49 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:50.219239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:50.220099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:50.227454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:50.228114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:50.228852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:50.229670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:50.230226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:50.230747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:50.255246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:50.256087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:50.259158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:50.275015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:50.275623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:50.276160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:50.281489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:50.282126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:50.282818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:50.495279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:50.498683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:50.503666 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e6d937fe-c64d-4e2b-b791-c80796f53054 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.252664 Aug 29 05:24:50.504901 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3116/6249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:50 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:50.511386 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2c9345cf-1bc2-41a8-849f-e5ac1f1917f8 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1496 microversion: 2.1 time: 0.296612 Aug 29 05:24:50.512701 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3134/6250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:50 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1496 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:50.571283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:50.572099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:50.579101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:50.579691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:50.580427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:50.581293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:50.581841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:50.582483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:50.801476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:50.815339 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f3a5ee4d-23c6-4761-8b79-270543447c8a tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.248190 Aug 29 05:24:50.815936 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3117/6251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:50 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:50.878948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:50.879760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:50.886129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:50.886682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:50.887183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:50.887945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:50.888495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:50.888989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:51.150750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:51.159098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70a46aa2-1c8e-454a-a7b4-8e9fa1808f61 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1391 microversion: 2.1 time: 0.283993 Aug 29 05:24:51.159693 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3135/6252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:50 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1391 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:51.533000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:51.534142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:51.535045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:51.535926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:51.547272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:51.547969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:51.548541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:51.548672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:51.549265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:51.549817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:51.550699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:51.551003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:51.551674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:51.551868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:51.552547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:51.552693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:51.855967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:51.864452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:51.865587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0fee1902-997e-4412-bbdb-e7e6bcba4432 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.340850 Aug 29 05:24:51.866672 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3118/6253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:51 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:51.872617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:51.873731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:51.875870 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f372290-758e-432c-8907-d2f96454ab89 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1496 microversion: 2.1 time: 0.346797 Aug 29 05:24:51.877420 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3136/6254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:51 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1496 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:51.885139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:51.886145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:51.886806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:51.888321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:51.889553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:51.890730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:52.044828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-389ca19e-711f-41f3-9d98-4377e3e978ec req-d13c3c74-cb13-46b1-a99b-6d4bb9bef7dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca", "tag": "a0f9a947-6e74-4580-a86c-4888faa4e145"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:52.059922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-389ca19e-711f-41f3-9d98-4377e3e978ec req-d13c3c74-cb13-46b1-a99b-6d4bb9bef7dc service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:52.060720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-389ca19e-711f-41f3-9d98-4377e3e978ec req-d13c3c74-cb13-46b1-a99b-6d4bb9bef7dc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:52.061266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-389ca19e-711f-41f3-9d98-4377e3e978ec req-d13c3c74-cb13-46b1-a99b-6d4bb9bef7dc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:52.076387 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-389ca19e-711f-41f3-9d98-4377e3e978ec req-d13c3c74-cb13-46b1-a99b-6d4bb9bef7dc service nova] Creating event network-changed:a0f9a947-6e74-4580-a86c-4888faa4e145 for instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca on n-h1-854119-9 Aug 29 05:24:52.081732 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-389ca19e-711f-41f3-9d98-4377e3e978ec req-d13c3c74-cb13-46b1-a99b-6d4bb9bef7dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042055 Aug 29 05:24:52.082699 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3137/6255] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:52.181210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:52.181921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:52.189433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:52.189928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:52.190368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:52.191224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:52.191883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:52.192361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:52.558699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:52.571420 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3d586e29-ff76-42ae-98ed-c442b537d783 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.703380 Aug 29 05:24:52.574224 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3119/6256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:51 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:52.618265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:52.621841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:52.628221 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b18669ed-809d-41a4-bfbe-bf81f30e4b34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1391 microversion: 2.1 time: 0.451349 Aug 29 05:24:52.629116 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3138/6257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:52 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1391 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:52.887868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:52.888503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:52.895898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:52.896829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:52.897712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:52.897936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:52.898650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:52.899071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:52.899680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:52.900901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:52.908839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:52.910626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:52.913705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:52.914578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:52.915169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:52.918722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:53.325176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:53.344693 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cccdcccb-7773-4266-95fc-2bac9b3f48a4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.458515 Aug 29 05:24:53.345991 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3120/6258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:52 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:53.361553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:53.372476 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f2d4cd3-abdf-480c-98db-f92ee59fab81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1496 microversion: 2.1 time: 0.478726 Aug 29 05:24:53.373330 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3139/6259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:52 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1496 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:53.596000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:53.597049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:53.610261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:53.610759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:53.611191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:53.613334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:53.614971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:53.615676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:53.652415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:53.653828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:53.667408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:53.668344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:53.670246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:53.673467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:53.674014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:53.681052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:53.936651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:54.010553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:54.022855 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4f2eb52-95a4-4da9-8d50-a1b67d338969 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.431726 Aug 29 05:24:54.024267 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3121/6260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:53 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:54.056170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:54.072168 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-31638df4-85f1-4cf3-99b3-06ec36415384 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1391 microversion: 2.1 time: 0.426523 Aug 29 05:24:54.073081 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3140/6261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:53 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1391 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:54.367242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:54.367987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:54.375526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:54.376578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:54.377227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:54.378153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:54.378810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:54.379433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:54.398159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:54.398862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:54.411230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:54.411726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:54.412255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:54.412879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:54.413328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:54.413746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:54.477588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:54.478273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:54.478866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:54.479501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lazy-loading 'fault' on Instance uuid 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:24:54.543742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:54.554538 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cff78fba-5ea8-4fb0-8b2e-262a05971fbd tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1299 microversion: 2.1 time: 0.160694 Aug 29 05:24:54.555134 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3141/6262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:54 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:54.565263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-032de95c-6f22-4fa4-8cc6-19ebfe6665de req-b0914579-195c-4791-ab80-33ad0065a86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76bc3747-d8a9-4259-87b4-aa9f6e8493e7", "name": "network-vif-deleted", "tag": "4764ce01-02cb-43bc-8c80-4e32650a6e89"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:54.579735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:54.590281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-032de95c-6f22-4fa4-8cc6-19ebfe6665de req-b0914579-195c-4791-ab80-33ad0065a86a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:54.591117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-032de95c-6f22-4fa4-8cc6-19ebfe6665de req-b0914579-195c-4791-ab80-33ad0065a86a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:54.591707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-032de95c-6f22-4fa4-8cc6-19ebfe6665de req-b0914579-195c-4791-ab80-33ad0065a86a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:54.595198 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e43cceb-c24f-4770-9d52-f335a9e267bf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.232714 Aug 29 05:24:54.606085 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-032de95c-6f22-4fa4-8cc6-19ebfe6665de req-b0914579-195c-4791-ab80-33ad0065a86a service nova] Creating event network-vif-deleted:4764ce01-02cb-43bc-8c80-4e32650a6e89 for instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 on n-h1-854119-9 Aug 29 05:24:54.608931 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3122/6263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:54 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:54.612445 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-032de95c-6f22-4fa4-8cc6-19ebfe6665de req-b0914579-195c-4791-ab80-33ad0065a86a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056056 Aug 29 05:24:54.613774 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3142/6264] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:54.923510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4aed5f4a-4bbf-4428-a525-32dc1ad37067 req-07d0d18b-cd14-4c62-be70-a574e43a0654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daaf5180-0cbc-4564-807b-563d307e99d7", "name": "network-vif-plugged", "status": "completed", "tag": "104c6839-eca7-49c4-8542-1e54b0d5bfcd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:54.941575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4aed5f4a-4bbf-4428-a525-32dc1ad37067 req-07d0d18b-cd14-4c62-be70-a574e43a0654 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:54.942064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4aed5f4a-4bbf-4428-a525-32dc1ad37067 req-07d0d18b-cd14-4c62-be70-a574e43a0654 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:54.947481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4aed5f4a-4bbf-4428-a525-32dc1ad37067 req-07d0d18b-cd14-4c62-be70-a574e43a0654 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:54.965975 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4aed5f4a-4bbf-4428-a525-32dc1ad37067 req-07d0d18b-cd14-4c62-be70-a574e43a0654 service nova] Creating event network-vif-plugged:104c6839-eca7-49c4-8542-1e54b0d5bfcd for instance daaf5180-0cbc-4564-807b-563d307e99d7 on n-h1-854119-9 Aug 29 05:24:54.973054 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4aed5f4a-4bbf-4428-a525-32dc1ad37067 req-07d0d18b-cd14-4c62-be70-a574e43a0654 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053357 Aug 29 05:24:54.974958 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3123/6265] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:55.044961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:55.045705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:55.048659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=18 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:55.054154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:55.054638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:55.055075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:55.055771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:55.056247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:55.056671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:55.094943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:55.095756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:55.102131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:55.102623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:55.103215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:55.103911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:55.104385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:55.104811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:55.342675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:55.350919 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fcf446de-10f7-4d9c-8701-d186c4169d62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.310338 Aug 29 05:24:55.351497 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3143/6266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:55 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:55.390349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:55.398403 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0cfb0566-4b4e-406e-a130-8da7d289389e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1391 microversion: 2.1 time: 0.308066 Aug 29 05:24:55.398949 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3124/6267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:55 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:55.577436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:55.578077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:55.584571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:55.585087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:55.585525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:55.586246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:55.586674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:55.587209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:55.617481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:55.618479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:55.618697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:55.619158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:55.619592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:55.620040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lazy-loading 'fault' on Instance uuid 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:24:55.624351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:55.625063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:55.625725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:55.626410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:55.626865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:55.627262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:55.694814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:55.703319 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7dd5b6db-96cd-4dae-9439-9b39c9013ee9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1299 microversion: 2.1 time: 0.129879 Aug 29 05:24:55.703924 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3144/6268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:55 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:55.859970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:55.870103 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4a53a62-d95a-45db-9d16-d9ddfe446fff tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.256302 Aug 29 05:24:55.870865 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3125/6269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:55 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:56.371509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:56.372502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:56.380161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:56.380774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:56.381469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:56.382423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:56.382979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:56.383501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:56.418705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:56.419804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:56.442083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:56.448577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:56.449124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:56.450133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:56.450545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:56.452089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:56.688965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:56.703652 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-88768a57-a809-46c3-89a6-b7c876a3f90d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.335528 Aug 29 05:24:56.704136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:56.705411 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3145/6270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:56 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:56.712989 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8dc8226-802a-4316-86f4-baa67f281676 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1391 microversion: 2.1 time: 0.297993 Aug 29 05:24:56.714249 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3126/6271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:56 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1391 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:56.723710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:56.724348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:56.730700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:56.731285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:56.731720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:56.732438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:56.733046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:56.733687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:56.791330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:56.792550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:56.793229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:56.793889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lazy-loading 'fault' on Instance uuid 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:24:56.851257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:56.862347 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76cf9bb0-de8f-41bf-936f-8c264c444005 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 200 len: 1299 microversion: 2.1 time: 0.140711 Aug 29 05:24:56.865176 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3146/6272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:56 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:56.897208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:56.898030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:56.904230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:56.904718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:56.905146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:56.906237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:56.906336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:56.906720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:56.923067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:24:57.064900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:57.072991 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a3fde4e1-a474-46ec-8806-c68dedfb1eaa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.186176 Aug 29 05:24:57.073765 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3127/6273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:56 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:57.725147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:57.725748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:57.734060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:57.735328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:57.737804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:57.738310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:57.738745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:57.739495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:57.739949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:57.743371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:57.744103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:57.744816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:57.745768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:57.746029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:57.746686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:57.747332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.085858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:58.093058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:58.094245 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1f13f5a0-b3cb-49ab-ab70-7b0c53ffce4d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1391 microversion: 2.1 time: 0.364018 Aug 29 05:24:58.095131 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3128/6274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:57 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1391 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:58.099884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:58.100514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:58.100971 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-53d1a5d0-021a-4faa-9d38-2e2b95bbdee1 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.379730 Aug 29 05:24:58.101546 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3147/6275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:57 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:58.106104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:58.106502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:58.106995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:58.107357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:58.107726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.108557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:58.109267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:58.110269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.115685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:58.115685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:58.115685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.116310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:58.116728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:58.117213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 HTTP/1.1 Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '76bc3747-d8a9-4259-87b4-aa9f6e8493e7'} Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:24:58.129090 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5baf267-3f4f-485d-8139-1a3721597f26 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 404 len: 111 microversion: 2.1 time: 0.034037 Aug 29 05:24:58.134668 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3129/6276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:58 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:24:58.142316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:58.142316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:58.148881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:58.149454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:58.149940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.150838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:58.151875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:58.152308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.179660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:24:58.265875 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9ebaf2d3-9be9-4e46-a8ee-8096f1bdf353 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 204 len: 0 microversion: 2.1 time: 0.128367 Aug 29 05:24:58.266475 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3130/6277] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:24:58 2022] DELETE /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:24:58.278808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:58.279514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:58.286260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:58.286776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:58.287175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.287863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:58.288410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:58.288825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.336767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:58.347225 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b33c328c-2483-4383-93b7-edd33be8de67 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.244424 Aug 29 05:24:58.347958 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3148/6278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:58 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:58.438861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:58.450094 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a2ab9255-e1df-4636-a30c-f138726116ab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1497 microversion: 2.1 time: 0.178873 Aug 29 05:24:58.450759 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3131/6279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:58 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:24:58.598851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-90c40a79-2dde-467d-a76a-8b6ff075e343 req-734c8aa3-533f-4e25-9057-348576e48f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca", "name": "network-vif-plugged", "status": "completed", "tag": "a0f9a947-6e74-4580-a86c-4888faa4e145"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:24:58.611318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-90c40a79-2dde-467d-a76a-8b6ff075e343 req-734c8aa3-533f-4e25-9057-348576e48f1e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:58.611808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-90c40a79-2dde-467d-a76a-8b6ff075e343 req-734c8aa3-533f-4e25-9057-348576e48f1e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:58.612270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-90c40a79-2dde-467d-a76a-8b6ff075e343 req-734c8aa3-533f-4e25-9057-348576e48f1e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:58.625168 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-90c40a79-2dde-467d-a76a-8b6ff075e343 req-734c8aa3-533f-4e25-9057-348576e48f1e service nova] Creating event network-vif-plugged:a0f9a947-6e74-4580-a86c-4888faa4e145 for instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca on n-h1-854119-9 Aug 29 05:24:58.630118 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-90c40a79-2dde-467d-a76a-8b6ff075e343 req-734c8aa3-533f-4e25-9057-348576e48f1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036216 Aug 29 05:24:58.630730 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3149/6280] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:24:59.115067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:59.115882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:59.124050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:59.124615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:59.125051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:59.125649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:59.126102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:59.126379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:59.126801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:59.127638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:59.137966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:59.138565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:59.139103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:59.139852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:59.140658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:59.141331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:59.345105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:59.354345 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-538bd262-f6b7-4eed-b050-273bfb8a1a6a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1391 microversion: 2.1 time: 0.243166 Aug 29 05:24:59.355173 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3132/6281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:59 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:59.364937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:59.373902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:59.374848 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ae772fe-ead9-4292-bd2a-252cd1892125 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1367 microversion: 2.1 time: 0.256243 Aug 29 05:24:59.374981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:59.384148 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3150/6282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:59 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:59.396746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:59.397239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:59.397660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:59.398574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:59.399016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:59.399434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:59.471035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:24:59.471750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:24:59.477864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:59.478416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:59.478912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:59.479670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:24:59.480374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:24:59.480792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:24:59.588512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:59.596713 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86196aeb-cbe3-4138-bec9-ba76be0f4deb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.226750 Aug 29 05:24:59.597493 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3133/6283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:59 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:24:59.659528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:24:59.669176 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a4695c75-44d5-4fc5-a5ca-8aa974090f56 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1497 microversion: 2.1 time: 0.202077 Aug 29 05:24:59.670464 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3151/6284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:24:59 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:00.375193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:00.375903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:00.383157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:00.383639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:00.384061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:00.385003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:00.385452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:00.385868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:00.664343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:00.672550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:00.678270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:00.684829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:00.685902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:00.686524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:00.687497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:00.688180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:00.688777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:00.691937 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-64beeeb4-49aa-4708-b53d-a5da549b4ef5 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1391 microversion: 2.1 time: 0.320564 Aug 29 05:25:00.706104 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3134/6285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:00 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1391 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:00.711706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:00.712668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:00.720470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:00.721130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:00.722150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:00.722960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:00.723513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:00.724057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.232561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:01.245981 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57025493-1aa7-4d05-93cf-f2ec760f5bf8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1556 microversion: 2.1 time: 0.850806 Aug 29 05:25:01.246842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3152/6286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:00 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1556 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:01.251847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-47c0708e-f5da-4ba4-bcfe-a832a3a0050b req-2b382810-76d5-403b-9a61-29d0614000b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d44a5a-4523-41b9-b363-2ec892884f22", "name": "network-vif-deleted", "tag": "bc69f67a-23a8-410f-9e25-6fce0a1f2e38"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:01.259189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:01.264509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-47c0708e-f5da-4ba4-bcfe-a832a3a0050b req-2b382810-76d5-403b-9a61-29d0614000b6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.265084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-47c0708e-f5da-4ba4-bcfe-a832a3a0050b req-2b382810-76d5-403b-9a61-29d0614000b6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.265534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-47c0708e-f5da-4ba4-bcfe-a832a3a0050b req-2b382810-76d5-403b-9a61-29d0614000b6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.268345 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3371f8a5-e80c-43d3-a2ce-044ec3aa6fe6 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.560761 Aug 29 05:25:01.269439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3135/6287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:00 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:01.275920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:01.276546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:01.283373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.284089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.285517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.286529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.287138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.287711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.303726 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-47c0708e-f5da-4ba4-bcfe-a832a3a0050b req-2b382810-76d5-403b-9a61-29d0614000b6 service nova] Creating event network-vif-deleted:bc69f67a-23a8-410f-9e25-6fce0a1f2e38 for instance 52d44a5a-4523-41b9-b363-2ec892884f22 on n-h1-854119-9 Aug 29 05:25:01.316725 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-47c0708e-f5da-4ba4-bcfe-a832a3a0050b req-2b382810-76d5-403b-9a61-29d0614000b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068623 Aug 29 05:25:01.317922 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3153/6288] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:01.324917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d6aa064-e53e-4c52-94e5-bf99c2ca2519 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:01.325723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d6aa064-e53e-4c52-94e5-bf99c2ca2519 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:01.327766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.328363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.328911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.329364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lazy-loading 'fault' on Instance uuid 52d44a5a-4523-41b9-b363-2ec892884f22 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:25:01.332935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6aa064-e53e-4c52-94e5-bf99c2ca2519 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.333406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6aa064-e53e-4c52-94e5-bf99c2ca2519 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.333841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6aa064-e53e-4c52-94e5-bf99c2ca2519 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.334531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6aa064-e53e-4c52-94e5-bf99c2ca2519 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.335056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6aa064-e53e-4c52-94e5-bf99c2ca2519 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.335668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d6aa064-e53e-4c52-94e5-bf99c2ca2519 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.371036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:01.384436 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-79c458cc-45ab-4b9c-8ef4-e2224a9a7d2b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 200 len: 1299 microversion: 2.1 time: 0.113592 Aug 29 05:25:01.385196 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3136/6289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:01 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:01.444140 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d6aa064-e53e-4c52-94e5-bf99c2ca2519 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123901 Aug 29 05:25:01.444978 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3154/6290] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:25:01 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:01.714129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:01.715498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:01.724471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.725415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.725989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.726762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.727237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.727653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.938075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:01.953936 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed762345-37a0-4c83-a15b-0133ad7359a7 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1562 microversion: 2.1 time: 0.244417 Aug 29 05:25:01.954533 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3137/6291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:01 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1562 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:01.975617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:01.976615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:01.983560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.984568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.985525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:01.986458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:01.987159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:01.987805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:02.184069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:02.192663 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78f157cc-90ec-4cad-b956-d29fab19202d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1562 microversion: 2.1 time: 0.221428 Aug 29 05:25:02.193259 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3155/6292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:01 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:02.289485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:02.290641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:02.299766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:02.300290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:02.302877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:02.303615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:02.304073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:02.304523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:02.405884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:02.406493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:02.413968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:02.414739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:02.415353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:02.416065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:02.416961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:02.417388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:02.435089 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 HTTP/1.1 Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '52d44a5a-4523-41b9-b363-2ec892884f22'} Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:25:02.436920 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:02.443203 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:25:02.443203 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:25:02.443203 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:25:02.443203 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:25:02.443203 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:25:02.443203 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:25:02.443203 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:02.443203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:25:02.443203 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fbabfde4-be8c-42ee-84d2-651107bad89c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 404 len: 111 microversion: 2.1 time: 0.036561 Aug 29 05:25:02.444095 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3156/6293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:02 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:25:02.547630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:02.560177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-190728315", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "8741d5cf-41df-4e83-8c96-bb20519598e2"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:02.561949 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7459648f-598d-40e4-acb6-3027c0836896 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1676 microversion: 2.1 time: 0.276044 Aug 29 05:25:02.563202 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3138/6294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:02 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1676 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:02.625484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] validate_networks() for [('8741d5cf-41df-4e83-8c96-bb20519598e2', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:25:03.285778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:25:03.286373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:25:03.286845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:25:03.287348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:25:03.288203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:25:03.303876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:03.305242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:03.305817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:03.306676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:03.307230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:03.307871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:03.310724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f2023d0f-a629-4fe3-a1aa-6962c538d8e3 req-d49dd8dc-967b-4efd-a82e-dbb0d5616107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daaf5180-0cbc-4564-807b-563d307e99d7", "tag": "104c6839-eca7-49c4-8542-1e54b0d5bfcd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:03.326635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f2023d0f-a629-4fe3-a1aa-6962c538d8e3 req-d49dd8dc-967b-4efd-a82e-dbb0d5616107 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:03.327110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f2023d0f-a629-4fe3-a1aa-6962c538d8e3 req-d49dd8dc-967b-4efd-a82e-dbb0d5616107 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:03.327585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:25:03.327775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f2023d0f-a629-4fe3-a1aa-6962c538d8e3 req-d49dd8dc-967b-4efd-a82e-dbb0d5616107 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:03.335461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for user 87aef4a0e8af4640b7f1dd06e446eb0d and project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:25:03.347944 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f2023d0f-a629-4fe3-a1aa-6962c538d8e3 req-d49dd8dc-967b-4efd-a82e-dbb0d5616107 service nova] Creating event network-changed:104c6839-eca7-49c4-8542-1e54b0d5bfcd for instance daaf5180-0cbc-4564-807b-563d307e99d7 on n-h1-854119-9 Aug 29 05:25:03.352503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:25:03.354417 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f2023d0f-a629-4fe3-a1aa-6962c538d8e3 req-d49dd8dc-967b-4efd-a82e-dbb0d5616107 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047749 Aug 29 05:25:03.355051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:25:03.355845 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3139/6295] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:25:03.412164 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59968da1-b5f3-480c-9a4b-a836f3ef3134 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857181 Aug 29 05:25:03.419418 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3157/6296] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:25:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:25:03.434355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d6dadd8f-e4dc-4def-8afc-019a1ddcd349 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:03.435361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d6dadd8f-e4dc-4def-8afc-019a1ddcd349 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:03.585203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:03.585951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:03.593913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:03.594705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:03.595379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:03.596455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:03.597171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:03.597441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d6dadd8f-e4dc-4def-8afc-019a1ddcd349 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:03.598451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:03.621833 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d6dadd8f-e4dc-4def-8afc-019a1ddcd349 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1208 microversion: 2.1 time: 0.198618 Aug 29 05:25:03.625338 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3140/6297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:03 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1208 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:03.628036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:03.979266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:03.991701 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37768fa1-d578-4960-9ab2-6a659a1cc4c0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1653 microversion: 2.1 time: 0.411334 Aug 29 05:25:03.992488 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3158/6298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:03 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1653 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:04.014670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-79ef76ee-13e0-4318-b64d-0702ba06cea9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:04.022324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79ef76ee-13e0-4318-b64d-0702ba06cea9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:04.023180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79ef76ee-13e0-4318-b64d-0702ba06cea9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:04.023799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79ef76ee-13e0-4318-b64d-0702ba06cea9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:04.050337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-79ef76ee-13e0-4318-b64d-0702ba06cea9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Going to try to start instance {{(pid=128871) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 05:25:04.095594 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-79ef76ee-13e0-4318-b64d-0702ba06cea9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/action" status: 202 len: 0 microversion: 2.1 time: 0.086660 Aug 29 05:25:04.096409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3141/6299] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:25:04 2022] POST /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:25:04.106440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:04.107343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:04.114088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:04.114719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:04.115259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:04.116078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:04.116650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:04.117337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:04.646953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:04.647651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:04.654390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:04.665756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:04.666256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:04.666882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:04.667652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:04.668547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:04.669415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:04.701571 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-726a9450-e99e-4372-8b1f-b1b808b29d2b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1662 microversion: 2.1 time: 0.589128 Aug 29 05:25:04.702298 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3159/6300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:04 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1662 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:04.776765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:04.791114 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3a942887-996a-4f32-8946-53f02cced8ae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1260 microversion: 2.1 time: 0.144007 Aug 29 05:25:04.791921 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3142/6301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:04 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:05.723752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:05.724501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:05.732829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:05.733691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:05.734244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:05.735311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:05.735964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:05.736416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:05.815155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:05.816107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:05.824878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:05.824878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:05.825229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:05.826063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:05.826303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:05.826633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:05.842648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:06.022542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:06.030662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-11105d46-0d4c-42fb-b257-f04d3074dc30 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1266 microversion: 2.1 time: 0.220167 Aug 29 05:25:06.031320 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3143/6302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:05 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:06.303973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:06.313137 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f639bf4d-b619-4eb1-967f-f6ef08c1b68c tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1662 microversion: 2.1 time: 0.594218 Aug 29 05:25:06.313862 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3160/6303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:05 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1662 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:07.015488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:07.016853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:07.025668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:07.028408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5d6a44cd-c5a7-4fb4-9591-bca3cf06f4fd req-7b7816fa-451f-4998-9389-52a1a6556b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca", "tag": "a0f9a947-6e74-4580-a86c-4888faa4e145"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:07.029035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:07.029168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:07.029855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:07.030282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:07.030749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:07.059614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5d6a44cd-c5a7-4fb4-9591-bca3cf06f4fd req-7b7816fa-451f-4998-9389-52a1a6556b46 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:07.060224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5d6a44cd-c5a7-4fb4-9591-bca3cf06f4fd req-7b7816fa-451f-4998-9389-52a1a6556b46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:07.060758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5d6a44cd-c5a7-4fb4-9591-bca3cf06f4fd req-7b7816fa-451f-4998-9389-52a1a6556b46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:07.096791 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5d6a44cd-c5a7-4fb4-9591-bca3cf06f4fd req-7b7816fa-451f-4998-9389-52a1a6556b46 service nova] Creating event network-changed:a0f9a947-6e74-4580-a86c-4888faa4e145 for instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca on n-h1-854119-9 Aug 29 05:25:07.107855 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5d6a44cd-c5a7-4fb4-9591-bca3cf06f4fd req-7b7816fa-451f-4998-9389-52a1a6556b46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092840 Aug 29 05:25:07.111563 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3161/6304] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:07.121362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:07.122599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:07.131273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:07.132015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:07.132750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:07.134088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:07.134817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:07.135734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:07.387577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:07.401583 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-485bc399-b568-467d-9b6e-88b563c3b201 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1562 microversion: 2.1 time: 0.390867 Aug 29 05:25:07.402468 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3144/6305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:07 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1562 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:07.411328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:07.411968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:07.423690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:07.424876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:07.425569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:07.427276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:07.427922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:07.428577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:07.714088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:07.724205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-397bbc1d-4706-4c55-bb76-f0e82f4e262a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1308 microversion: 2.1 time: 0.611098 Aug 29 05:25:07.725945 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3162/6306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:07 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1308 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:07.820814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:07.837644 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5e64b6e-f0f7-48f6-baa8-4db9a251eab4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1666 microversion: 2.1 time: 0.433851 Aug 29 05:25:07.839036 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3145/6307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:07 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1666 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:08.746075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:08.746873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:08.755844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:08.756489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:08.757028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:08.757821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:08.758516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:08.759110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:09.015784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:09.024722 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6cb6d556-5223-4811-ac7a-9de319ca4c44 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1308 microversion: 2.1 time: 0.282907 Aug 29 05:25:09.025442 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3163/6308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:08 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:09.182028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-9a9732f9-9a8d-4d77-83b4-4ea092096367 req-3a3b4bc7-27da-45fb-90a1-1de1e20f7e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d726f78-07e8-4f1b-9168-8d279c611eb8", "tag": "639ff0ad-994d-4dca-97d8-7519ad4840f4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:09.193780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9a9732f9-9a8d-4d77-83b4-4ea092096367 req-3a3b4bc7-27da-45fb-90a1-1de1e20f7e5e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:09.194270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9a9732f9-9a8d-4d77-83b4-4ea092096367 req-3a3b4bc7-27da-45fb-90a1-1de1e20f7e5e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:09.194706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9a9732f9-9a8d-4d77-83b4-4ea092096367 req-3a3b4bc7-27da-45fb-90a1-1de1e20f7e5e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:09.207849 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-9a9732f9-9a8d-4d77-83b4-4ea092096367 req-3a3b4bc7-27da-45fb-90a1-1de1e20f7e5e service nova] Creating event network-changed:639ff0ad-994d-4dca-97d8-7519ad4840f4 for instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 on n-h1-854119-9 Aug 29 05:25:09.212993 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-9a9732f9-9a8d-4d77-83b4-4ea092096367 req-3a3b4bc7-27da-45fb-90a1-1de1e20f7e5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035014 Aug 29 05:25:09.213811 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3146/6309] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:10.045704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:10.046456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:10.053471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:10.053973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:10.054385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:10.055083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:10.055519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:10.055934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:10.231552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:10.239868 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-779def2e-481b-4b81-8df3-c47a116460d4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1308 microversion: 2.1 time: 0.198015 Aug 29 05:25:10.240529 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3164/6310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:10 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1308 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:11.266586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:11.267481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:11.275209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:11.275696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:11.276184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:11.276921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:11.277370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:11.277792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:11.409498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:11.417326 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb22feac-a430-4796-9315-d62ccf628501 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1308 microversion: 2.1 time: 0.159870 Aug 29 05:25:11.417944 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3147/6311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:11 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:12.438275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:12.438960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:12.446667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:12.447157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:12.447580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:12.448519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:12.448963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:12.449379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:12.691893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:12.701849 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2f2a8e82-0230-469e-b9cb-1d4db025641b tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1308 microversion: 2.1 time: 0.267510 Aug 29 05:25:12.702945 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3165/6312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:12 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:13.722985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:13.723598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:13.732593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:13.736781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:13.737529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:13.737980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:13.738717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:13.739172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:13.739605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:13.943124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:13.951586 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec521a15-b45d-4c47-b9de-8885a0e5e489 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1308 microversion: 2.1 time: 0.232493 Aug 29 05:25:13.952239 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3148/6313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:13 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:14.971577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:14.972938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:14.981134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:14.981884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:14.993569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:14.994659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:14.995196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:14.996031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:14.996591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:14.997089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:15.059822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e265beee-1df0-4fe1-aede-d05fa90c9b6f req-ef5be528-af3a-4d16-8bec-738ff45691dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d726f78-07e8-4f1b-9168-8d279c611eb8", "name": "network-vif-plugged", "status": "completed", "tag": "639ff0ad-994d-4dca-97d8-7519ad4840f4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:15.072751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e265beee-1df0-4fe1-aede-d05fa90c9b6f req-ef5be528-af3a-4d16-8bec-738ff45691dc service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:15.073264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e265beee-1df0-4fe1-aede-d05fa90c9b6f req-ef5be528-af3a-4d16-8bec-738ff45691dc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:15.073736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e265beee-1df0-4fe1-aede-d05fa90c9b6f req-ef5be528-af3a-4d16-8bec-738ff45691dc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:15.086118 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e265beee-1df0-4fe1-aede-d05fa90c9b6f req-ef5be528-af3a-4d16-8bec-738ff45691dc service nova] Creating event network-vif-plugged:639ff0ad-994d-4dca-97d8-7519ad4840f4 for instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 on n-h1-854119-9 Aug 29 05:25:15.091933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e265beee-1df0-4fe1-aede-d05fa90c9b6f req-ef5be528-af3a-4d16-8bec-738ff45691dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036268 Aug 29 05:25:15.093334 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3149/6314] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:25:15.309795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:15.338173 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1947ccaf-31dc-484a-b852-3022c1e1f39f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1308 microversion: 2.1 time: 0.367628 Aug 29 05:25:15.338793 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3166/6315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:14 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:16.360670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:16.361360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:16.367649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:16.368111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:16.368563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:16.369237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:16.369690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:16.370224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:16.500630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:16.508724 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-57c0dbae-54e7-467b-8dbf-b6c77a1f11e2 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1308 microversion: 2.1 time: 0.153434 Aug 29 05:25:16.509626 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3150/6316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:16 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:17.530812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:17.531647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:17.539885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:17.540626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:17.541010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:17.541762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:17.542334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:17.542837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:17.684822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:17.693156 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d8f028ac-e79f-4190-ab22-5ac741b8aa4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1489 microversion: 2.1 time: 0.167767 Aug 29 05:25:17.693739 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3167/6317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:17 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1489 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:17.713835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc0db25b-e5b7-49e3-9b70-78a25162ef66 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:17.716588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc0db25b-e5b7-49e3-9b70-78a25162ef66 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:17.724193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc0db25b-e5b7-49e3-9b70-78a25162ef66 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:17.724658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc0db25b-e5b7-49e3-9b70-78a25162ef66 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:17.725092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc0db25b-e5b7-49e3-9b70-78a25162ef66 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:17.725851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc0db25b-e5b7-49e3-9b70-78a25162ef66 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:17.726333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc0db25b-e5b7-49e3-9b70-78a25162ef66 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:17.726756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc0db25b-e5b7-49e3-9b70-78a25162ef66 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:17.795946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc0db25b-e5b7-49e3-9b70-78a25162ef66 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "PUT /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1084 microversion: 2.1 time: 0.085904 Aug 29 05:25:17.796817 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3151/6318] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:25:17 2022] PUT /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1084 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:17.814280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:17.814990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:17.821515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:17.822071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:17.822573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:17.823336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:17.823851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:17.824386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:17.957187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:17.967379 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-00d1f346-30ec-40ca-a296-10fea9db5e57 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1510 microversion: 2.1 time: 0.157498 Aug 29 05:25:17.968349 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3168/6319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:17 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:17.987721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:17.988461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:17.995203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:17.995792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:17.996370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:17.997078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:17.997530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:17.997955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:18.237920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:18.245864 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e46733d-0ac0-4043-894b-42b2e22f1c1f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1510 microversion: 2.1 time: 0.262229 Aug 29 05:25:18.246417 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3152/6320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:17 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:18.265993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:18.266487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:18.272871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:18.273355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:18.273786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:18.274476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:18.274923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:18.275343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:18.301473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:25:18.374674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:18.384509 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff978051-3b50-424b-a88d-37268baf7768 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 204 len: 0 microversion: 2.1 time: 0.122288 Aug 29 05:25:18.385112 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3169/6321] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:25:18 2022] DELETE /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:25:18.393661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:18.394267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:18.400519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:18.400900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:18.401305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:18.401995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:18.402443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:18.402897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:18.553658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:18.562051 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-521ddeee-5708-4794-b850-946533652c6f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1516 microversion: 2.1 time: 0.172312 Aug 29 05:25:18.562712 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3153/6322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:18 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:19.587213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:19.588261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:19.596540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:19.597243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:19.598075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:19.598801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:19.599252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:19.599873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:19.747227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:19.755145 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5474f2f6-140d-4ebc-8769-d86f6e05d54c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1516 microversion: 2.1 time: 0.174907 Aug 29 05:25:19.755706 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3170/6323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:19 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:20.592859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e684b2b7-c41c-47e8-b3e4-4bdc87b1986a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:20.596061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e684b2b7-c41c-47e8-b3e4-4bdc87b1986a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:20.603555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:20.606249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e684b2b7-c41c-47e8-b3e4-4bdc87b1986a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:20.607102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e684b2b7-c41c-47e8-b3e4-4bdc87b1986a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:20.607726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e684b2b7-c41c-47e8-b3e4-4bdc87b1986a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:20.608930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e684b2b7-c41c-47e8-b3e4-4bdc87b1986a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:20.609679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e684b2b7-c41c-47e8-b3e4-4bdc87b1986a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:20.610091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e684b2b7-c41c-47e8-b3e4-4bdc87b1986a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:20.673889 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e684b2b7-c41c-47e8-b3e4-4bdc87b1986a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "POST /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb/action" status: 200 len: 32589 microversion: 2.1 time: 0.085102 Aug 29 05:25:20.681978 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3154/6324] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:25:20 2022] POST /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb/action => generated 32589 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 05:25:20.776272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:20.777068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:20.784551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:20.785217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:20.785756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:20.786555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:20.787096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:20.787628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:21.109138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:21.118172 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ccc6b09-d1a8-4bdb-a951-38bc7804b6d9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 200 len: 1516 microversion: 2.1 time: 0.345616 Aug 29 05:25:21.118788 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3171/6325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:20 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:21.253125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-44218849-0f37-49c4-8d9b-faf1599f9669 req-e139d49a-a39b-4579-97ba-ce039f2fbc6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d726f78-07e8-4f1b-9168-8d279c611eb8", "name": "network-vif-deleted", "tag": "639ff0ad-994d-4dca-97d8-7519ad4840f4"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:21.264442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-44218849-0f37-49c4-8d9b-faf1599f9669 req-e139d49a-a39b-4579-97ba-ce039f2fbc6f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:21.265216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-44218849-0f37-49c4-8d9b-faf1599f9669 req-e139d49a-a39b-4579-97ba-ce039f2fbc6f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:21.265832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-44218849-0f37-49c4-8d9b-faf1599f9669 req-e139d49a-a39b-4579-97ba-ce039f2fbc6f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:21.281372 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-44218849-0f37-49c4-8d9b-faf1599f9669 req-e139d49a-a39b-4579-97ba-ce039f2fbc6f service nova] Creating event network-vif-deleted:639ff0ad-994d-4dca-97d8-7519ad4840f4 for instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 on n-h1-854119-9 Aug 29 05:25:21.287975 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-44218849-0f37-49c4-8d9b-faf1599f9669 req-e139d49a-a39b-4579-97ba-ce039f2fbc6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038798 Aug 29 05:25:21.289001 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3155/6326] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:22.139110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:22.140841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:22.160494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:22.161081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:22.161548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:22.162281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:22.165056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:22.165528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:22.201807 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 HTTP/1.1 Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8d726f78-07e8-4f1b-9168-8d279c611eb8'} Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:25:22.204648 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b5517c5f-5150-4fd4-ac02-b766dcd0ecb9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 404 len: 111 microversion: 2.1 time: 0.071720 Aug 29 05:25:22.210232 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3172/6327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:22 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:25:22.241374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:22.242581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:22.255078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a45c620a-559e-4ec3-bd1d-5b1d1c666f29 req-9616aff5-c825-4900-98c7-a17d8b49ec0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5250316b-4fe9-43ed-809e-e96f58ed22eb", "tag": "d6e0b3d4-0076-4db3-99d1-91ba6f22059e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:22.259945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:22.261641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:22.262884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:22.264820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:22.265621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:22.266635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:22.280716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a45c620a-559e-4ec3-bd1d-5b1d1c666f29 req-9616aff5-c825-4900-98c7-a17d8b49ec0d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:22.282640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a45c620a-559e-4ec3-bd1d-5b1d1c666f29 req-9616aff5-c825-4900-98c7-a17d8b49ec0d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:22.284358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a45c620a-559e-4ec3-bd1d-5b1d1c666f29 req-9616aff5-c825-4900-98c7-a17d8b49ec0d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:22.304415 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a45c620a-559e-4ec3-bd1d-5b1d1c666f29 req-9616aff5-c825-4900-98c7-a17d8b49ec0d service nova] Creating event network-changed:d6e0b3d4-0076-4db3-99d1-91ba6f22059e for instance 5250316b-4fe9-43ed-809e-e96f58ed22eb on n-h1-854119-9 Aug 29 05:25:22.311338 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a45c620a-559e-4ec3-bd1d-5b1d1c666f29 req-9616aff5-c825-4900-98c7-a17d8b49ec0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068228 Aug 29 05:25:22.318451 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3173/6328] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:22.341620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:25:22.459024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1708856742", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "8741d5cf-41df-4e83-8c96-bb20519598e2"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:22.483532 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7f5bdd71-9986-40bd-bb23-0575f59e983a tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 204 len: 0 microversion: 2.1 time: 0.249157 Aug 29 05:25:22.484633 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3156/6329] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:25:22 2022] DELETE /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:25:22.503723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:22.506115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:22.517305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:22.517796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:22.518227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:22.520207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:22.520680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:22.521106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:22.590191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] validate_networks() for [('8741d5cf-41df-4e83-8c96-bb20519598e2', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:25:23.079438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:23.088218 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0c55d282-8770-4d40-8e22-ea7bd2ba398e tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1671 microversion: 2.1 time: 0.599170 Aug 29 05:25:23.089018 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3157/6330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:22 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1671 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:23.124969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:25:23.125750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:25:23.126230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:25:23.126640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:25:23.127072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:25:23.143937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:23.145094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:23.145604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:23.146346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:23.146802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:23.147227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:23.177386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:25:23.184564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Getting quotas for user 87aef4a0e8af4640b7f1dd06e446eb0d and project eeeb8f1f938542e5b1649c44afb93b98. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:25:23.198406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:25:23.200971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:25:23.255205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2ef88894-7766-48a7-8835-cbe9411c44ed tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815381 Aug 29 05:25:23.256275 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3174/6331] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:25:23.272213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97508753-1ac8-475b-9162-6870d6937907 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:23.277501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97508753-1ac8-475b-9162-6870d6937907 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:23.348291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97508753-1ac8-475b-9162-6870d6937907 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:23.357074 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97508753-1ac8-475b-9162-6870d6937907 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1209 microversion: 2.1 time: 0.094170 Aug 29 05:25:23.357666 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3158/6332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:23 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:24.112169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:24.113272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:24.123922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:24.124448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:24.124877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:24.125573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:24.126020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:24.126432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:24.379206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:24.379813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:24.387491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:24.387977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:24.388625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:24.389726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:24.389877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:24.390207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:24.447133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:24.450759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:24.456225 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed8ae9af-d609-4c40-9856-b3b1d4ddaca2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1671 microversion: 2.1 time: 0.349338 Aug 29 05:25:24.456799 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3175/6333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:24 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1671 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:24.464102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:24.471826 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b8588f8-ccbd-48b5-92d9-340446654923 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1261 microversion: 2.1 time: 0.096845 Aug 29 05:25:24.472397 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3159/6334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:24 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1261 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:25.480212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:25.481664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:25.495070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:25.495665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:25.502747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:25.503663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:25.503663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:25.504360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:25.504807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:25.505215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:25.508092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:25.508999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:25.509597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:25.510988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:25.511102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:25.511448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:25.656656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b779089f7f42399c57a9771787f911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8538671f353b4984b7b18ee629e43b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:25.659127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:25.672310 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54c99b73-cc33-4b66-93f1-444f132a65be tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1267 microversion: 2.1 time: 0.180753 Aug 29 05:25:25.686911 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3160/6335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:25 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:25.687140 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8f59a2c6-ddcf-4a47-abdd-b4c041a6a065 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 200 len: 1484 microversion: 2.1 time: 0.209025 Aug 29 05:25:25.687140 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3176/6336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:25 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 1484 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:25.700222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6fdd25a1-bd39-4392-8a4f-3e6791138afc req-24278764-c76a-4fff-93a2-b86a0699ee47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5250316b-4fe9-43ed-809e-e96f58ed22eb", "name": "network-vif-deleted", "tag": "d6e0b3d4-0076-4db3-99d1-91ba6f22059e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:25.708094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6fdd25a1-bd39-4392-8a4f-3e6791138afc req-24278764-c76a-4fff-93a2-b86a0699ee47 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:25.708791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6fdd25a1-bd39-4392-8a4f-3e6791138afc req-24278764-c76a-4fff-93a2-b86a0699ee47 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:25.709310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6fdd25a1-bd39-4392-8a4f-3e6791138afc req-24278764-c76a-4fff-93a2-b86a0699ee47 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:25.713674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:25.723213 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6fdd25a1-bd39-4392-8a4f-3e6791138afc req-24278764-c76a-4fff-93a2-b86a0699ee47 service nova] Creating event network-vif-deleted:d6e0b3d4-0076-4db3-99d1-91ba6f22059e for instance 5250316b-4fe9-43ed-809e-e96f58ed22eb on n-h1-854119-9 Aug 29 05:25:25.728819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6fdd25a1-bd39-4392-8a4f-3e6791138afc req-24278764-c76a-4fff-93a2-b86a0699ee47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045784 Aug 29 05:25:25.729854 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3161/6337] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:26.695405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:26.696005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:26.703127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:26.703776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:26.704548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:26.705487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:26.706144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:26.706772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:26.712868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:26.714704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] [instance: 5250316b-4fe9-43ed-809e-e96f58ed22eb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:26.723993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:26.725034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:26.725699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:26.726865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:26.728021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:26.731809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:26.754016 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] HTTP exception thrown: Instance 5250316b-4fe9-43ed-809e-e96f58ed22eb could not be found. Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Request method failure captured: Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb HTTP/1.1 Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDExtF9qv4Kk3wBsz236s8ECO6UmwwijtjMoy1JAsdoIxXi59XM6xMnuoN8-V7yS6wDJX4wHsdQFMsywj-tPninW0_Nef5jkSib533O9EF0L6s_ztozhgonn7qqhCvMWxNS5SOFfMx-aybP9E8SIx-GzXkDkbgddq5M0MbR4UzfqHn04 Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 8538671f353b4984b7b18ee629e43b3d Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestNetworkBasicOps-543367892 Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8538671f353b4984b7b18ee629e43b3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8538671f353b4984b7b18ee629e43b3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8538671f353b4984b7b18ee629e43b3d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8538671f353b4984b7b18ee629e43b3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestNetworkBasicOps-543367892 Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 8538671f353b4984b7b18ee629e43b3d Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestNetworkBasicOps-543367892 Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestNetworkBasicOps-543367892-project Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: b5b779089f7f42399c57a9771787f911 Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestNetworkBasicOps-543367892-project Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 5250316b-4fe9-43ed-809e-e96f58ed22eb could not be found. Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '5250316b-4fe9-43ed-809e-e96f58ed22eb'} Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5250316b-4fe9-43ed-809e-e96f58ed22eb could not be found. Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5250316b-4fe9-43ed-809e-e96f58ed22eb could not be found. Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:25:26.756465 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:25:26.762052 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:25:26.762052 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:25:26.762052 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:25:26.762052 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:25:26.762052 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:25:26.762052 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5250316b-4fe9-43ed-809e-e96f58ed22eb could not be found. Aug 29 05:25:26.762052 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:25:26.763936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Returning 404 to user: Instance 5250316b-4fe9-43ed-809e-e96f58ed22eb could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:25:26.765090 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-48e2399b-f203-447f-a28d-7ee91786e72f tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb" status: 404 len: 111 microversion: 2.1 time: 0.059491 Aug 29 05:25:26.765810 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3162/6338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:26 2022] GET /compute/v2.1/servers/5250316b-4fe9-43ed-809e-e96f58ed22eb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:25:26.957668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aaf52c8b-52d7-42ed-9f90-8a949a4038d2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] Calling method '.version_select at 0x7f1ab86254c0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:26.966085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:26.975301 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b923dde-32ff-43e9-946e-06410367aefe tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1309 microversion: 2.1 time: 0.284218 Aug 29 05:25:26.976510 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3177/6339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:26 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:27.006454 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aaf52c8b-52d7-42ed-9f90-8a949a4038d2 tempest-TestNetworkBasicOps-543367892 tempest-TestNetworkBasicOps-543367892-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1525034814" status: 202 len: 0 microversion: 2.1 time: 0.054016 Aug 29 05:25:27.008203 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3163/6340] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Aug 29 05:25:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1525034814 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:25:27.749644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5e7c3d3d-6200-44ad-8bd4-ff3fab265a7a req-4337e94f-8752-49a0-beeb-037d1cbaa3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df12c1d8-4520-4d86-a95c-167066a48870", "tag": "1d1e8efd-fc61-4236-ae6a-fea59448a0bd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:27.760905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5e7c3d3d-6200-44ad-8bd4-ff3fab265a7a req-4337e94f-8752-49a0-beeb-037d1cbaa3a5 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:27.761388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5e7c3d3d-6200-44ad-8bd4-ff3fab265a7a req-4337e94f-8752-49a0-beeb-037d1cbaa3a5 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:27.761821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5e7c3d3d-6200-44ad-8bd4-ff3fab265a7a req-4337e94f-8752-49a0-beeb-037d1cbaa3a5 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:27.774045 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5e7c3d3d-6200-44ad-8bd4-ff3fab265a7a req-4337e94f-8752-49a0-beeb-037d1cbaa3a5 service nova] Creating event network-changed:1d1e8efd-fc61-4236-ae6a-fea59448a0bd for instance df12c1d8-4520-4d86-a95c-167066a48870 on n-h1-854119-9 Aug 29 05:25:27.779136 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5e7c3d3d-6200-44ad-8bd4-ff3fab265a7a req-4337e94f-8752-49a0-beeb-037d1cbaa3a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033395 Aug 29 05:25:27.779971 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3178/6341] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:27.996452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:27.997151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:28.005536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:28.006114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:28.006621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:28.007330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:28.007820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:28.008252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:28.161340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:28.169652 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-602960c0-96f8-44ac-88fb-8088e66e0c8e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1309 microversion: 2.1 time: 0.177243 Aug 29 05:25:28.170439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3164/6342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:27 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:29.192287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:29.193610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:29.201080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:29.201785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:29.202370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:29.203227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:29.203968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:29.204567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:29.442892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:29.457302 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ae3ba42-47f3-449f-b077-b7e304f7b7c3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1309 microversion: 2.1 time: 0.270023 Aug 29 05:25:29.458656 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3179/6343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:29 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:30.480986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:30.482550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:30.498181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:30.498711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:30.499245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:30.500254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:30.500732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:30.501158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:31.058713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:31.068861 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b3b65f47-8664-42bc-a1e1-4ddd93534ae5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1309 microversion: 2.1 time: 0.592557 Aug 29 05:25:31.070618 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3165/6344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:30 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1309 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:32.093886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:32.094501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:32.102239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:32.102669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:32.103369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:32.104103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:32.104623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:32.105051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:32.246280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:32.256584 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cb82197d-187c-4659-a41b-8ab35ccbe3e7 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1309 microversion: 2.1 time: 0.169739 Aug 29 05:25:32.257654 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3180/6345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:32 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:33.279320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:33.280722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:33.290147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:33.291756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:33.292537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:33.293631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:33.294469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:33.295311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:33.356470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:33.686376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:33.695906 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68e5be6c-7cf2-4cd4-a5d0-36b5d5146278 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1309 microversion: 2.1 time: 0.421402 Aug 29 05:25:33.713540 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3166/6346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:33 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1309 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:34.719769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:34.720430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:34.723385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:34.726633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:34.738617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:34.739255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:34.739525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:34.740284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:34.740743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:34.741159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:35.077473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a0ef939f-d17f-4467-920f-a47afdac937a req-ffd1eab6-0b89-4121-b4cf-8a96242e8849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12c1d8-4520-4d86-a95c-167066a48870", "name": "network-vif-plugged", "status": "completed", "tag": "1d1e8efd-fc61-4236-ae6a-fea59448a0bd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:35.087289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:35.094611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a0ef939f-d17f-4467-920f-a47afdac937a req-ffd1eab6-0b89-4121-b4cf-8a96242e8849 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:35.096255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a0ef939f-d17f-4467-920f-a47afdac937a req-ffd1eab6-0b89-4121-b4cf-8a96242e8849 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:35.096870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a0ef939f-d17f-4467-920f-a47afdac937a req-ffd1eab6-0b89-4121-b4cf-8a96242e8849 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:35.105143 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84b6ce1c-1efe-4f42-9817-77f7d3fb3632 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1309 microversion: 2.1 time: 0.389619 Aug 29 05:25:35.111287 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3181/6347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:34 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1309 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:35.127832 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a0ef939f-d17f-4467-920f-a47afdac937a req-ffd1eab6-0b89-4121-b4cf-8a96242e8849 service nova] Creating event network-vif-plugged:1d1e8efd-fc61-4236-ae6a-fea59448a0bd for instance df12c1d8-4520-4d86-a95c-167066a48870 on n-h1-854119-9 Aug 29 05:25:35.134460 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a0ef939f-d17f-4467-920f-a47afdac937a req-ffd1eab6-0b89-4121-b4cf-8a96242e8849 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065484 Aug 29 05:25:35.136133 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3167/6348] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:36.126160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:36.126752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:36.135266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:36.136055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:36.136715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:36.137594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:36.138213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:36.139703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:36.406843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:36.440971 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3f6818c2-b7b8-45c7-856e-f9182602de5e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1309 microversion: 2.1 time: 0.317413 Aug 29 05:25:36.441873 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3182/6349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:36 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:37.464549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:37.466065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:37.508458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:37.509508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:37.510132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:37.522651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:37.528688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:37.530501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:37.980175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:38.000308 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc10e0c1-7e58-448d-80a1-07413749743a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1490 microversion: 2.1 time: 0.534897 Aug 29 05:25:38.002220 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3168/6350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:37 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1490 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:38.025793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae93990a-b9b1-43af-a51f-16c5ba9025bb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1709234509"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:38.028633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae93990a-b9b1-43af-a51f-16c5ba9025bb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:38.043647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae93990a-b9b1-43af-a51f-16c5ba9025bb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:38.047174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae93990a-b9b1-43af-a51f-16c5ba9025bb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:38.047729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae93990a-b9b1-43af-a51f-16c5ba9025bb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:38.049778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae93990a-b9b1-43af-a51f-16c5ba9025bb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:38.051848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae93990a-b9b1-43af-a51f-16c5ba9025bb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:38.052587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae93990a-b9b1-43af-a51f-16c5ba9025bb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:38.279949 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae93990a-b9b1-43af-a51f-16c5ba9025bb tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "PUT /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1075 microversion: 2.1 time: 0.258553 Aug 29 05:25:38.281550 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3183/6351] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:25:38 2022] PUT /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1075 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:38.301900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:38.303252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:38.316847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:38.320399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:38.322045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:38.323057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:38.326089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:38.326849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:38.865972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:38.881878 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-47408ad3-37ac-4e91-bacf-45ca5e6f9182 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1501 microversion: 2.1 time: 0.583960 Aug 29 05:25:38.884404 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3169/6352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:38 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1501 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:38.904783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:38.905730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:38.918393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:38.919109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:38.920102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:38.924094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:38.925781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:38.927953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:39.861750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:39.872612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2973c26b-dfce-4a42-be07-ae56dae0f3f0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1501 microversion: 2.1 time: 0.972508 Aug 29 05:25:39.873599 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3184/6353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:38 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1501 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:39.892920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c64f3ba5-f564-4a6c-aef5-13af9c9adb81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:39.903639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c64f3ba5-f564-4a6c-aef5-13af9c9adb81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:39.904167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c64f3ba5-f564-4a6c-aef5-13af9c9adb81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:39.904664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c64f3ba5-f564-4a6c-aef5-13af9c9adb81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:39.956726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c64f3ba5-f564-4a6c-aef5-13af9c9adb81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Going to try to stop instance {{(pid=128871) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 05:25:40.039439 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c64f3ba5-f564-4a6c-aef5-13af9c9adb81 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "POST /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870/action" status: 202 len: 0 microversion: 2.1 time: 0.150250 Aug 29 05:25:40.041151 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3170/6354] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:25:39 2022] POST /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:25:40.049804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:40.050697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:40.058686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:40.059437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:40.060051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:40.060988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:40.061883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:40.062530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:40.498586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:40.520012 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b7f388c6-5def-454a-bd00-a3523b133535 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.473694 Aug 29 05:25:40.558747 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3185/6355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:40 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:41.582305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:41.583020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:41.611598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:41.612644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:41.617392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:41.620531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:41.621214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:41.622705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:42.119494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:42.146010 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a15d853-21e3-4bf0-9e50-03977b6592d0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.567816 Aug 29 05:25:42.152905 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3171/6356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:41 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:43.181608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:43.183164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:43.208791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:43.210493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:43.211932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:43.214662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:43.216518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:43.217749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:43.623430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:43.636647 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dea2a5a2-8c45-414f-b509-ce10c9551767 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.469007 Aug 29 05:25:43.652836 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3186/6357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:43 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:43.685870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1003995604", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "99b2da64-8a7e-409f-9228-f3271fbc01f4"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1118577476", "security_groups": []}, "os:scheduler_hints": {"different_host": ["741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7"]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:43.817437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] validate_networks() for [('99b2da64-8a7e-409f-9228-f3271fbc01f4', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:25:44.669406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:44.670804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:44.724860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:25:44.725397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:25:44.725909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:25:44.728583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:25:44.729106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:25:44.753821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:44.754343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:44.757071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:44.757871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:44.764809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:44.766386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:44.774414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:44.776837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:44.777970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:44.780309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:44.782140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:44.783810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:44.852081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Getting quotas for project 63d4ae6502cb4ab494ee503890ae6ed2. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:25:44.878750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Getting quotas for user a66bf154277346b0bce1cc24dec18519 and project 63d4ae6502cb4ab494ee503890ae6ed2. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:25:44.913200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:25:44.916153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:25:45.008367 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9aef9f22-cb7e-48c0-89f8-0296255325ee tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.326362 Aug 29 05:25:45.010984 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3172/6358] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:25:43 2022] POST /compute/v2.1/servers => generated 361 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:25:45.017052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-82a23f1e-5a7e-432a-9063-b85ab4958db1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:45.020343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-82a23f1e-5a7e-432a-9063-b85ab4958db1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:45.031232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82a23f1e-5a7e-432a-9063-b85ab4958db1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:45.032660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82a23f1e-5a7e-432a-9063-b85ab4958db1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:45.037034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82a23f1e-5a7e-432a-9063-b85ab4958db1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:45.038378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82a23f1e-5a7e-432a-9063-b85ab4958db1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:45.039585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82a23f1e-5a7e-432a-9063-b85ab4958db1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:45.040833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82a23f1e-5a7e-432a-9063-b85ab4958db1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:45.121418 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-82a23f1e-5a7e-432a-9063-b85ab4958db1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca/action" status: 200 len: 24555 microversion: 2.1 time: 0.108722 Aug 29 05:25:45.122202 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3173/6359] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:25:45 2022] POST /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca/action => generated 24555 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:25:45.148664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-efed9cda-4d50-4e93-82a0-e6ff9d7290c0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:45.149620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-efed9cda-4d50-4e93-82a0-e6ff9d7290c0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:45.301941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-efed9cda-4d50-4e93-82a0-e6ff9d7290c0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:45.309431 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-efed9cda-4d50-4e93-82a0-e6ff9d7290c0 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1242 microversion: 2.1 time: 0.185791 Aug 29 05:25:45.310034 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3174/6360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:45 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1242 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:45.373553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:45.385926 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2b319df9-2e76-48fa-ad27-0c4e946f2299 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.728279 Aug 29 05:25:45.388307 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3187/6361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:44 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:46.335946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:46.337230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:46.355066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:46.355615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:46.356033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:46.357123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:46.357801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:46.359333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:46.409233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:46.410381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:46.430326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:46.430863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:46.431305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:46.432101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:46.436649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:46.437112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:46.611549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:46.624409 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60eea834-2764-4192-8f00-ea418f74fe9c tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1294 microversion: 2.1 time: 0.294158 Aug 29 05:25:46.642010 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3175/6362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:46 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1294 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:46.992110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:47.004390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-82ed58a0-5390-4f3e-88f4-1351da507040 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.598968 Aug 29 05:25:47.005534 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3188/6363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:46 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:47.645414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:47.646021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:47.662696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:47.663431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:47.664224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:47.666694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:47.667623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:47.668261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:47.765320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:47.780998 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9ce97382-6adc-412a-9dcb-aa2a6bf3d694 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1300 microversion: 2.1 time: 0.139320 Aug 29 05:25:47.781598 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3176/6364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:47 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:48.028743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:48.029407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:48.036363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:48.042248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:48.044708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:48.045807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:48.046455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:48.048180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:48.388489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:48.398630 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9add8ff3-e69e-4759-abf8-f27356ac7728 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.373811 Aug 29 05:25:48.399226 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3189/6365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:48 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:48.802549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:48.804143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:48.821256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:48.842276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:48.845324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:48.851658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:48.854495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:48.855107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:49.124017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:49.134228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ac325bf3-4ed5-42f6-b1cf-d81ca69f9149 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1300 microversion: 2.1 time: 0.335782 Aug 29 05:25:49.138601 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3177/6366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:48 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1300 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:49.423827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:49.425496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:49.433011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:49.433719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:49.434297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:49.435245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:49.435885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:49.437136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:49.618338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:49.633762 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75958386-cde2-4199-b45d-7fa45adec950 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.218498 Aug 29 05:25:49.635185 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3190/6367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:49 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:50.160719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:50.161307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:50.169158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:50.169709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:50.170157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:50.170892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:50.171347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:50.171775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:50.270578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:50.278930 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5af662e2-edb7-4907-81a9-8f85bdd75b33 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1300 microversion: 2.1 time: 0.122073 Aug 29 05:25:50.279925 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3178/6368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:50 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1300 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:50.663350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:50.663978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:50.677274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:50.681702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:50.682209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:50.682652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:50.683372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:50.683823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:50.684276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:50.687482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-63bf5f16-10f0-4647-a652-ea49fab886b7 req-d5948273-75fe-4d36-b6f1-8bb6b58ecfbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff6e36f-3f51-4a58-9f40-c8db1a276170", "tag": "e9a9bdb5-1e89-48c3-aacb-67f3b79e2418"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:50.700823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:50.704925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-63bf5f16-10f0-4647-a652-ea49fab886b7 req-d5948273-75fe-4d36-b6f1-8bb6b58ecfbc service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:50.706437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-63bf5f16-10f0-4647-a652-ea49fab886b7 req-d5948273-75fe-4d36-b6f1-8bb6b58ecfbc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:50.707285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-63bf5f16-10f0-4647-a652-ea49fab886b7 req-d5948273-75fe-4d36-b6f1-8bb6b58ecfbc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:50.726207 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-63bf5f16-10f0-4647-a652-ea49fab886b7 req-d5948273-75fe-4d36-b6f1-8bb6b58ecfbc service nova] Creating event network-changed:e9a9bdb5-1e89-48c3-aacb-67f3b79e2418 for instance dff6e36f-3f51-4a58-9f40-c8db1a276170 on n-h2-854119-9 Aug 29 05:25:50.734729 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-63bf5f16-10f0-4647-a652-ea49fab886b7 req-d5948273-75fe-4d36-b6f1-8bb6b58ecfbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054555 Aug 29 05:25:50.735794 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3179/6369] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:50.860728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:50.869294 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-24987f0b-6b68-461c-9d22-1f2c68de94c0 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.216399 Aug 29 05:25:50.885520 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3191/6370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:50 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:51.302163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:51.302809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:51.310476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:51.310978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:51.311416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:51.312153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:51.312608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:51.313033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:51.411352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:51.419456 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b5515543-795c-4bd2-9225-9ca419fb1e2d tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1300 microversion: 2.1 time: 0.122623 Aug 29 05:25:51.424204 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3180/6371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:51 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1300 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:51.890648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:51.892769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:51.909065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:51.909760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:51.910353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:51.911341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:51.911961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:51.912792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:51.942560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:52.440794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:52.441984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:52.460536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:52.461046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:52.461482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:52.462192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:52.462750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:52.463043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:52.469034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:52.479356 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8a378fbc-cbd1-48cb-bc3a-d80bfa93cb40 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.592951 Aug 29 05:25:52.480874 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3192/6372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:51 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:52.578173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:52.586827 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8d5d5c17-baed-4fe0-8f09-0e54443c9198 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1300 microversion: 2.1 time: 0.149815 Aug 29 05:25:52.587602 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3181/6373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:52 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:53.505793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:53.507096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:53.514792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:53.516282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:53.517622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:53.526362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:53.528336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:53.528867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:53.607164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:53.607756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:53.624925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:53.626434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:53.629965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:53.633101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:53.633776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:53.634358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:53.693949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:53.863978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:53.880242 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ffff04b8-af22-420c-b4e7-799f37c039b1 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1300 microversion: 2.1 time: 0.277122 Aug 29 05:25:53.881926 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3182/6374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:53 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:53.922393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:53.934306 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b1028428-f77c-4aaf-bdcd-4ac5d5b75fc4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.433478 Aug 29 05:25:53.943195 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3193/6375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:53 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:54.904417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:54.905608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:54.916446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:54.920709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:54.921459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:54.922038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:54.922915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:54.923365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:54.923961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:54.963407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:54.964017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:54.977618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:54.978718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:54.979624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:54.980571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:54.981231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:54.982088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:55.093955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:55.107842 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a620d1db-fa96-4e1b-951e-014421afb123 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1300 microversion: 2.1 time: 0.206098 Aug 29 05:25:55.122316 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3183/6376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:54 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1300 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:55.214497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:55.228473 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f379c329-56c4-4d9e-84dc-718c5e7835a3 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.269195 Aug 29 05:25:55.234872 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3194/6377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:54 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:56.111064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e6661985-ea3f-4a1e-ade3-8e90b0070e58 req-a30ded99-4f5e-4c8d-9b01-692f71a41950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff6e36f-3f51-4a58-9f40-c8db1a276170", "name": "network-vif-plugged", "status": "completed", "tag": "e9a9bdb5-1e89-48c3-aacb-67f3b79e2418"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:25:56.125637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:25:56.132157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:56.132940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:56.133166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e6661985-ea3f-4a1e-ade3-8e90b0070e58 req-a30ded99-4f5e-4c8d-9b01-692f71a41950 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:56.133754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e6661985-ea3f-4a1e-ade3-8e90b0070e58 req-a30ded99-4f5e-4c8d-9b01-692f71a41950 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:56.134629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e6661985-ea3f-4a1e-ade3-8e90b0070e58 req-a30ded99-4f5e-4c8d-9b01-692f71a41950 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:56.142950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:56.143400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:56.144061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:56.148617 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e6661985-ea3f-4a1e-ade3-8e90b0070e58 req-a30ded99-4f5e-4c8d-9b01-692f71a41950 service nova] Creating event network-vif-plugged:e9a9bdb5-1e89-48c3-aacb-67f3b79e2418 for instance dff6e36f-3f51-4a58-9f40-c8db1a276170 on n-h2-854119-9 Aug 29 05:25:56.150140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:56.152929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:56.153406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:56.156055 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e6661985-ea3f-4a1e-ade3-8e90b0070e58 req-a30ded99-4f5e-4c8d-9b01-692f71a41950 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049185 Aug 29 05:25:56.157422 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3184/6378] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:25:56.253029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:56.255901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:56.256946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:56.262305 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-acc03d50-5d8f-4ace-affb-229f891744e9 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1300 microversion: 2.1 time: 0.135615 Aug 29 05:25:56.263600 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3195/6379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:56 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1300 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:56.275808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:56.276572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:56.277654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:56.278811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:56.279332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:56.279824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:56.458213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:56.474614 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0c6f9ac2-01be-4a26-aaf1-62b92a51e41a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.223040 Aug 29 05:25:56.475498 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3185/6380] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:56 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:25:57.285058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:57.285687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:57.293380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:57.293843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:57.294542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:57.295209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:57.295642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:57.296268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:57.389158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:57.398229 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b0c9a3fe-3418-4744-8c4a-d355eefab1a8 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1300 microversion: 2.1 time: 0.117241 Aug 29 05:25:57.398901 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3196/6381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:57 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:57.500636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:57.501986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:57.508715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:57.509821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:57.510673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:57.511541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:57.512236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:57.512826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:57.696990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:57.705176 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef22d0da-c595-4417-bdac-72475fd7c36c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.210533 Aug 29 05:25:57.705755 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3186/6382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:57 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:58.421338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:58.423710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:58.433189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.434199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.434855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.435897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.436381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.436796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.529794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:58.539155 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-544d7555-ba61-48d5-9493-2068b4747a28 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1473 microversion: 2.1 time: 0.124199 Aug 29 05:25:58.539818 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3197/6383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:58 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1473 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:58.560180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:58.561297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:58.569086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.569564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.570490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.571181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.571587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.572010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.671904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:58.680446 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4fb9e99e-e33d-43e1-b401-6f4308ead522 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1473 microversion: 2.1 time: 0.124577 Aug 29 05:25:58.684182 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3187/6384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:58 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1473 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:58.700767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-291f9139-7729-430d-a723-d0848b62060a tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:58.701508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-291f9139-7729-430d-a723-d0848b62060a tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:58.708434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-291f9139-7729-430d-a723-d0848b62060a tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.708968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-291f9139-7729-430d-a723-d0848b62060a tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.709546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-291f9139-7729-430d-a723-d0848b62060a tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.710315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-291f9139-7729-430d-a723-d0848b62060a tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.710841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-291f9139-7729-430d-a723-d0848b62060a tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.711275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-291f9139-7729-430d-a723-d0848b62060a tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.727536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:58.728187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:58.734775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.735275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.735703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.736590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.737186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.738300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.847725 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-291f9139-7729-430d-a723-d0848b62060a tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1624 microversion: 2.1 time: 0.150764 Aug 29 05:25:58.848700 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3198/6385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:58 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1624 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:58.869115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-72ddbd5e-ed78-4dee-8425-ec2733c5295e tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:58.870053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-72ddbd5e-ed78-4dee-8425-ec2733c5295e tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:58.876870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72ddbd5e-ed78-4dee-8425-ec2733c5295e tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.878127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72ddbd5e-ed78-4dee-8425-ec2733c5295e tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.878716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72ddbd5e-ed78-4dee-8425-ec2733c5295e tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.880220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72ddbd5e-ed78-4dee-8425-ec2733c5295e tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:58.880835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72ddbd5e-ed78-4dee-8425-ec2733c5295e tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:58.881266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-72ddbd5e-ed78-4dee-8425-ec2733c5295e tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:58.938140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:58.946811 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8374de73-8508-4060-93e0-02faaa4f98bf tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.223821 Aug 29 05:25:58.948070 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3188/6386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:58 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:59.056440 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-72ddbd5e-ed78-4dee-8425-ec2733c5295e tempest-TestSecurityGroupsBasicOps-99545087 tempest-TestSecurityGroupsBasicOps-99545087-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1913 microversion: 2.1 time: 0.184267 Aug 29 05:25:59.057356 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3199/6387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:58 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1913 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:59.138644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:59.139451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:59.147179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:59.147985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:59.148569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:59.149682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:59.150132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:59.150552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:59.178164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:25:59.259730 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-01a2dcac-9c94-4745-84aa-c392330c7812 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 204 len: 0 microversion: 2.1 time: 0.125507 Aug 29 05:25:59.260416 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3189/6388] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:25:59 2022] DELETE /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:25:59.269198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:59.269889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:59.276424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:59.276960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:59.277458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:59.278226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:59.278788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:59.279283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:59.373186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:25:59.381640 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c2807185-9ae5-482e-87c7-f44eb0ba1a4f tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1479 microversion: 2.1 time: 0.116790 Aug 29 05:25:59.382349 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3200/6389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:59 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1479 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:25:59.967765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:25:59.968543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:25:59.975431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:59.975914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:59.976393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:25:59.977086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:25:59.977526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:25:59.977951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:00.113476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:00.121705 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95cbb37c-40aa-4ef0-bd01-3beb3014ea4f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.158332 Aug 29 05:26:00.122565 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3190/6390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:25:59 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:00.402962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:00.403598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:00.409967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:00.410516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:00.411087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:00.411825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:00.412436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:00.412849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:00.529460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:00.539605 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-212c6f0e-47e6-46cc-b671-530816cae2c2 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1479 microversion: 2.1 time: 0.140946 Aug 29 05:26:00.544271 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3201/6391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:00 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1479 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:01.143080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:01.144545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:01.152027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:01.152536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:01.153145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:01.153905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:01.154593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:01.155020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:01.284620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6c0175db-ce30-4034-9707-88f64a84ff6d req-62d09c67-eab6-41ce-9b75-a3c9e6a3d927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff6e36f-3f51-4a58-9f40-c8db1a276170", "name": "network-vif-deleted", "tag": "e9a9bdb5-1e89-48c3-aacb-67f3b79e2418"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:01.303356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6c0175db-ce30-4034-9707-88f64a84ff6d req-62d09c67-eab6-41ce-9b75-a3c9e6a3d927 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:01.304038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6c0175db-ce30-4034-9707-88f64a84ff6d req-62d09c67-eab6-41ce-9b75-a3c9e6a3d927 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:01.304666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6c0175db-ce30-4034-9707-88f64a84ff6d req-62d09c67-eab6-41ce-9b75-a3c9e6a3d927 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:01.324595 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6c0175db-ce30-4034-9707-88f64a84ff6d req-62d09c67-eab6-41ce-9b75-a3c9e6a3d927 service nova] Creating event network-vif-deleted:e9a9bdb5-1e89-48c3-aacb-67f3b79e2418 for instance dff6e36f-3f51-4a58-9f40-c8db1a276170 on n-h2-854119-9 Aug 29 05:26:01.340815 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6c0175db-ce30-4034-9707-88f64a84ff6d req-62d09c67-eab6-41ce-9b75-a3c9e6a3d927 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055073 Aug 29 05:26:01.343249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:01.344487 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3202/6392] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:01.362589 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5730de55-5d70-4591-9769-883df6ba779f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.223450 Aug 29 05:26:01.365540 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3191/6393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:01 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:01.563690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:01.565070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:01.575476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:01.576023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:01.576761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:01.577483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:01.577942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:01.578640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:01.618959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:01.619737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:01.620461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:01.622668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lazy-loading 'fault' on Instance uuid dff6e36f-3f51-4a58-9f40-c8db1a276170 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:26:01.680489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:01.691449 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84908894-fafa-4477-b67b-01fb8bd15b59 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 200 len: 1332 microversion: 2.1 time: 0.133730 Aug 29 05:26:01.696169 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3203/6394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:01 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:02.386527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:02.387255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:02.394552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:02.395061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:02.395489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:02.396336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:02.396787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:02.397289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:02.547359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:02.555852 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03cf8992-e28d-474e-8983-68fc6dfacf13 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.173317 Aug 29 05:26:02.564496 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3192/6395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:02 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:02.713963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:02.714813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: dff6e36f-3f51-4a58-9f40-c8db1a276170] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:02.722556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:02.723174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:02.723607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:02.724341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:02.725057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:02.725512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:02.740839 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] HTTP exception thrown: Instance dff6e36f-3f51-4a58-9f40-c8db1a276170 could not be found. Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Request method failure captured: Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 HTTP/1.1 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE1UfmqBrEcAapbVX7Mr_RMg3J_SfivoL3TVPW_PsrJkWea4YgqBQnxalLWnOFpJkTIOiXtzlrMFJzUFOm-CF8kRG2D2rQXdCDfyA1oHkcAorzZ-c0cFr7OJrEfDWW8DpX4Rv9t4MReT7RVEe1bOE7q8j0qaSDgLLx2WZ3zhzyqRhkE Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 63d4ae6502cb4ab494ee503890ae6ed2 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1810972830 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d4ae6502cb4ab494ee503890ae6ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63d4ae6502cb4ab494ee503890ae6ed2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63d4ae6502cb4ab494ee503890ae6ed2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d4ae6502cb4ab494ee503890ae6ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1810972830 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 63d4ae6502cb4ab494ee503890ae6ed2 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1810972830 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestSecurityGroupsBasicOps-1810972830-project Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: a66bf154277346b0bce1cc24dec18519 Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1810972830-project Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance dff6e36f-3f51-4a58-9f40-c8db1a276170 could not be found. Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'dff6e36f-3f51-4a58-9f40-c8db1a276170'} Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff6e36f-3f51-4a58-9f40-c8db1a276170 could not be found. Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff6e36f-3f51-4a58-9f40-c8db1a276170 could not be found. Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:02.742636 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff6e36f-3f51-4a58-9f40-c8db1a276170 could not be found. Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Returning 404 to user: Instance dff6e36f-3f51-4a58-9f40-c8db1a276170 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:02.746863 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-771b49d1-6efa-4551-ac29-0fef7571d761 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170" status: 404 len: 111 microversion: 2.1 time: 0.034304 Aug 29 05:26:02.747998 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3204/6396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:02 2022] GET /compute/v2.1/servers/dff6e36f-3f51-4a58-9f40-c8db1a276170 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:03.576676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:03.577895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:03.585265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:03.585997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:03.586583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:03.587723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:03.588359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:03.588862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:03.793169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:03.818447 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-13fa80f6-6d8a-4ee7-bb09-626182c5e2f9 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.241907 Aug 29 05:26:03.821811 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3193/6397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:03 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:04.846780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:04.848555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:04.859380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:04.863190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:04.863944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:04.865658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:04.866470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:04.867601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:05.219805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:05.231261 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4e45f774-d616-4720-8bdb-840d5ad0475f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1511 microversion: 2.1 time: 0.389173 Aug 29 05:26:05.247584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3205/6398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:04 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:06.254176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:06.255807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:06.270768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:06.271442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:06.272302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:06.276760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:06.277432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:06.279404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:06.551996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:06.581875 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-302c7bc9-e6e2-4537-b3b5-df3bf904d067 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1488 microversion: 2.1 time: 0.332937 Aug 29 05:26:06.583022 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3194/6399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:06 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1488 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:06.602889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6298545-4ea5-4c48-923c-73bd1a385187 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-232503311"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:06.609773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f6298545-4ea5-4c48-923c-73bd1a385187 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:06.623697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6298545-4ea5-4c48-923c-73bd1a385187 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:06.626549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6298545-4ea5-4c48-923c-73bd1a385187 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:06.627303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6298545-4ea5-4c48-923c-73bd1a385187 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:06.628630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6298545-4ea5-4c48-923c-73bd1a385187 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:06.631410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6298545-4ea5-4c48-923c-73bd1a385187 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:06.632031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6298545-4ea5-4c48-923c-73bd1a385187 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:06.734953 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f6298545-4ea5-4c48-923c-73bd1a385187 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "PUT /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1060 microversion: 2.1 time: 0.136234 Aug 29 05:26:06.740332 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3206/6400] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:26:06 2022] PUT /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1060 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:06.753248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:06.753983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:06.761654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:06.762242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:06.762726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:06.763712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:06.764206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:06.764668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:07.091835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:07.099889 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5212cd4e-761b-469b-a178-3b90e6ff0aae tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1487 microversion: 2.1 time: 0.350991 Aug 29 05:26:07.113204 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3195/6401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:06 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1487 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:07.123598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:07.124100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:07.131371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:07.131871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:07.132339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:07.133100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:07.133558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:07.133990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:07.397341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:07.413816 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee38b5ec-7c49-4941-8210-0e99c4b3af4c tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1487 microversion: 2.1 time: 0.287118 Aug 29 05:26:07.413816 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3207/6402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:07 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1487 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:07.431646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:07.432932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:07.441694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:07.442447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:07.443078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:07.444054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:07.445645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:07.446251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:07.477627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:26:07.566460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:07.636212 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-940f06cb-09cb-4d2a-b1ea-5d6a7e54ae85 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 204 len: 0 microversion: 2.1 time: 0.208158 Aug 29 05:26:07.637834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3196/6403] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:07 2022] DELETE /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:26:07.645820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:07.648655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:07.657001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:07.657670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:07.658308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:07.659352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:07.660000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:07.660748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:07.859702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:07.868609 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-681fa6c1-d566-4613-96f6-1d20caeee257 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1493 microversion: 2.1 time: 0.226470 Aug 29 05:26:07.880948 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3208/6404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:07 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1493 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:08.441403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:08.442047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:08.444060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b8bc3686-dfaa-408e-bb4a-226aaa27001d req-49a1d615-0181-4f20-b037-55ce41c36966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7", "tag": "822bbc8b-6e31-4d94-9a52-8177bd0844bc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:08.456545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:08.457045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:08.458321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:08.458911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b8bc3686-dfaa-408e-bb4a-226aaa27001d req-49a1d615-0181-4f20-b037-55ce41c36966 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:08.459907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b8bc3686-dfaa-408e-bb4a-226aaa27001d req-49a1d615-0181-4f20-b037-55ce41c36966 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:08.460399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:08.460866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:08.461493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b8bc3686-dfaa-408e-bb4a-226aaa27001d req-49a1d615-0181-4f20-b037-55ce41c36966 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:08.480092 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b8bc3686-dfaa-408e-bb4a-226aaa27001d req-49a1d615-0181-4f20-b037-55ce41c36966 service nova] Creating event network-changed:822bbc8b-6e31-4d94-9a52-8177bd0844bc for instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 on n-h1-854119-9 Aug 29 05:26:08.481563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:08.487212 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b8bc3686-dfaa-408e-bb4a-226aaa27001d req-49a1d615-0181-4f20-b037-55ce41c36966 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046732 Aug 29 05:26:08.492442 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3209/6405] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:08.563966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:26:08.678837 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dcf53996-0549-405b-8646-c17a5038c3ac tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "DELETE /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 204 len: 0 microversion: 2.1 time: 0.242306 Aug 29 05:26:08.681393 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3197/6406] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:08 2022] DELETE /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:26:08.690787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:08.692307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:08.700880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:08.701821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:08.702663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:08.703679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:08.708174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:08.708880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:08.714870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:08.892611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:08.893663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:08.906468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:08.907467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:08.910268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:08.911104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:08.916368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:08.917218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:08.968862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:08.978316 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-653a53b7-4a56-4148-b70f-0001275a8b36 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1768 microversion: 2.1 time: 0.292696 Aug 29 05:26:08.979083 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3210/6407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:08 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1768 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:09.133989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:09.157215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-928c848f-d998-4d21-b309-6574f1076af5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1493 microversion: 2.1 time: 0.269278 Aug 29 05:26:09.159935 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3198/6408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:08 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1493 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:10.001241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:10.001862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:10.009274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:10.010147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:10.010666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:10.011599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:10.012303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:10.012740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:10.187673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:10.188879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:10.219923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:10.224673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:10.225167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:10.225926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:10.235509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:10.236419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:10.501239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:10.517605 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b2ecb5af-45e4-4810-a863-25550f8f2a85 tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1768 microversion: 2.1 time: 0.521881 Aug 29 05:26:10.532351 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3211/6409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:09 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1768 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:10.632537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:10.643780 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af897984-b2c6-4c73-9978-31b343e53799 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1493 microversion: 2.1 time: 0.466290 Aug 29 05:26:10.659201 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3199/6410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:10 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1493 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:11.539175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:11.539791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:11.550464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:11.550960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:11.552637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:11.553517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:11.560892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:11.561540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:11.694062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f6d0f35f-e4f9-4b64-be2d-9502f449840d req-f3cddd6c-4d06-46aa-8d35-cd65296ebda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12c1d8-4520-4d86-a95c-167066a48870", "name": "network-vif-deleted", "tag": "1d1e8efd-fc61-4236-ae6a-fea59448a0bd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:11.721422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f6d0f35f-e4f9-4b64-be2d-9502f449840d req-f3cddd6c-4d06-46aa-8d35-cd65296ebda6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:11.721906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f6d0f35f-e4f9-4b64-be2d-9502f449840d req-f3cddd6c-4d06-46aa-8d35-cd65296ebda6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:11.722465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f6d0f35f-e4f9-4b64-be2d-9502f449840d req-f3cddd6c-4d06-46aa-8d35-cd65296ebda6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:11.734632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66bf154277346b0bce1cc24dec18519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d4ae6502cb4ab494ee503890ae6ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:11.747538 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f6d0f35f-e4f9-4b64-be2d-9502f449840d req-f3cddd6c-4d06-46aa-8d35-cd65296ebda6 service nova] Creating event network-vif-deleted:1d1e8efd-fc61-4236-ae6a-fea59448a0bd for instance df12c1d8-4520-4d86-a95c-167066a48870 on n-h1-854119-9 Aug 29 05:26:11.761064 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ffd0ceb-240b-411e-9ae9-f6e17fe875ea tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 200 len: 1530 microversion: 2.1 time: 0.225724 Aug 29 05:26:11.762117 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3200/6411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:11 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 1530 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:11.773436 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f6d0f35f-e4f9-4b64-be2d-9502f449840d req-f3cddd6c-4d06-46aa-8d35-cd65296ebda6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293719 Aug 29 05:26:11.777721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:11.778248 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3212/6412] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:11.778503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:11.790948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:11.792034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:11.792899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:11.793804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:11.794534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:11.795183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:11.843646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:11.844424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:11.845173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:11.845775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lazy-loading 'fault' on Instance uuid df12c1d8-4520-4d86-a95c-167066a48870 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:26:11.900535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:11.913884 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d4b0943-f59d-4394-8da8-5ff7420dd54f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 200 len: 1309 microversion: 2.1 time: 0.150005 Aug 29 05:26:11.926716 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3201/6413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:11 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 1309 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:12.787694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:12.788370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] [instance: 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:12.796637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:12.797117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:12.797710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:12.798403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:12.798848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:12.799260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:12.813846 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] HTTP exception thrown: Instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 could not be found. Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Request method failure captured: Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 HTTP/1.1 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE1UfmqBrEcAapbVX7Mr_RMg3J_SfivoL3TVPW_PsrJkWea4YgqBQnxalLWnOFpJkTIOiXtzlrMFJzUFOm-CF8kRG2D2rQXdCDfyA1oHkcAorzZ-c0cFr7OJrEfDWW8DpX4Rv9t4MReT7RVEe1bOE7q8j0qaSDgLLx2WZ3zhzyqRhkE Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 63d4ae6502cb4ab494ee503890ae6ed2 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1810972830 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d4ae6502cb4ab494ee503890ae6ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63d4ae6502cb4ab494ee503890ae6ed2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63d4ae6502cb4ab494ee503890ae6ed2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d4ae6502cb4ab494ee503890ae6ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1810972830 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 63d4ae6502cb4ab494ee503890ae6ed2 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1810972830 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestSecurityGroupsBasicOps-1810972830-project Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: a66bf154277346b0bce1cc24dec18519 Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1810972830-project Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 could not be found. Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7'} Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 could not be found. Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 could not be found. Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.815768 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 could not be found. Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Returning 404 to user: Instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:12.819146 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4c078e9c-d5ad-41c9-b051-65c00b46e34b tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7" status: 404 len: 111 microversion: 2.1 time: 0.033910 Aug 29 05:26:12.827782 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3213/6414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:12 2022] GET /compute/v2.1/servers/741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:12.937857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:12.939239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:12.949584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:12.950426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:12.951088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:12.951783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:12.952883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:12.953306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:12.987837 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 HTTP/1.1 Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'df12c1d8-4520-4d86-a95c-167066a48870'} Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:12.989624 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.992988 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:12.992988 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:12.992988 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:12.992988 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:12.992988 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:12.992988 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:12.992988 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:12.992988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:12.992988 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a5c1902c-dffb-4d6b-8978-ee242561fc3a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 404 len: 111 microversion: 2.1 time: 0.057401 Aug 29 05:26:12.998546 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3202/6415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:12 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.007090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.008434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.016296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.016998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.018175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.019239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.020000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.021151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.061179 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 HTTP/1.1 Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'df12c1d8-4520-4d86-a95c-167066a48870'} Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.065164 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.069347 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.071817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.073077 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0d9ed6d1-6a6f-437c-a161-cfc103835a9e tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 404 len: 111 microversion: 2.1 time: 0.070894 Aug 29 05:26:13.074195 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3214/6416] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:13 2022] DELETE /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:26:13.083287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.083904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: df12c1d8-4520-4d86-a95c-167066a48870] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.091117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.092462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.093038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.093881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.094451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.095263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.125594 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 HTTP/1.1 Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'df12c1d8-4520-4d86-a95c-167066a48870'} Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.127315 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.130808 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.130808 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.130808 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.130808 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.130808 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.130808 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. Aug 29 05:26:13.130808 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.130808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance df12c1d8-4520-4d86-a95c-167066a48870 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.130808 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3858b268-8b94-44f9-be49-b4cd39d29fab tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870" status: 404 len: 111 microversion: 2.1 time: 0.052096 Aug 29 05:26:13.132758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3203/6417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:13 2022] GET /compute/v2.1/servers/df12c1d8-4520-4d86-a95c-167066a48870 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.140446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.141119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.148987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.149654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.150195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.150967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.151497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.151927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.168912 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 HTTP/1.1 Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '8d726f78-07e8-4f1b-9168-8d279c611eb8'} Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.170548 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae611786-fb43-413f-a473-d5f013d21a33 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 404 len: 111 microversion: 2.1 time: 0.036772 Aug 29 05:26:13.174235 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3215/6418] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:13 2022] DELETE /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:26:13.181716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.182467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 8d726f78-07e8-4f1b-9168-8d279c611eb8] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.189231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.190038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.190688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.191918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.192593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.193205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.211372 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 HTTP/1.1 Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '8d726f78-07e8-4f1b-9168-8d279c611eb8'} Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.213622 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.217361 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.217361 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.217361 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.217361 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.217361 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.217361 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. Aug 29 05:26:13.217361 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.217361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 8d726f78-07e8-4f1b-9168-8d279c611eb8 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.217866 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a7aad63-a36d-40f6-995a-e6d78609a46d tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8" status: 404 len: 111 microversion: 2.1 time: 0.039897 Aug 29 05:26:13.218371 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3204/6419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:13 2022] GET /compute/v2.1/servers/8d726f78-07e8-4f1b-9168-8d279c611eb8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.230744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.230744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.237801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.243924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.244362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.245128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.245706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.246223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.289363 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 HTTP/1.1 Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '76bc3747-d8a9-4259-87b4-aa9f6e8493e7'} Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.291223 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9412a77b-b8d8-45ad-afc4-7f861ea34b8a tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 404 len: 111 microversion: 2.1 time: 0.069573 Aug 29 05:26:13.297225 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3216/6420] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:13 2022] DELETE /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.301783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.302403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 76bc3747-d8a9-4259-87b4-aa9f6e8493e7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.309046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.309582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.310173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.311111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.311575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.311993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.326700 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 HTTP/1.1 Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '76bc3747-d8a9-4259-87b4-aa9f6e8493e7'} Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.328271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.331485 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.331485 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.331485 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.331485 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.331485 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.331485 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. Aug 29 05:26:13.331485 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.331485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 76bc3747-d8a9-4259-87b4-aa9f6e8493e7 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.331485 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-23ee1270-b362-46fa-bf04-eada1e914017 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7" status: 404 len: 111 microversion: 2.1 time: 0.032047 Aug 29 05:26:13.333406 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3205/6421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:13 2022] GET /compute/v2.1/servers/76bc3747-d8a9-4259-87b4-aa9f6e8493e7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.338468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.339096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.346119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.346746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.347262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.348032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.348575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.349065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.369287 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 HTTP/1.1 Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '52d44a5a-4523-41b9-b363-2ec892884f22'} Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.370966 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e25ca4da-96b8-4607-9b76-c204e47c4e94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 404 len: 111 microversion: 2.1 time: 0.038049 Aug 29 05:26:13.377694 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3217/6422] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:13 2022] DELETE /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:26:13.385048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.385857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 52d44a5a-4523-41b9-b363-2ec892884f22] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.392151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.392638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.393630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.394693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.395328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.396505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.411927 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 HTTP/1.1 Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '52d44a5a-4523-41b9-b363-2ec892884f22'} Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.414204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.417753 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.417753 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.417753 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.417753 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.417753 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.417753 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. Aug 29 05:26:13.417753 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.419601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 52d44a5a-4523-41b9-b363-2ec892884f22 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.420492 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a6934cf-055c-448f-b822-128fa5630104 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22" status: 404 len: 111 microversion: 2.1 time: 0.039480 Aug 29 05:26:13.424230 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3206/6423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:13 2022] GET /compute/v2.1/servers/52d44a5a-4523-41b9-b363-2ec892884f22 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.429086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.429774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.436113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.436868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.437448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.438343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.438970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.439388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.459076 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 HTTP/1.1 Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'f5afd1ca-2b42-4377-a9b0-16d7328e5462'} Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.460939 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e11b54cd-087f-4ec6-bbdd-ecc1af3dc127 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 404 len: 111 microversion: 2.1 time: 0.037134 Aug 29 05:26:13.467722 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3218/6424] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:13 2022] DELETE /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.473810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.474824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: f5afd1ca-2b42-4377-a9b0-16d7328e5462] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.481434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.482190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.482823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.483728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.484603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.485263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.500754 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 HTTP/1.1 Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'f5afd1ca-2b42-4377-a9b0-16d7328e5462'} Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.502637 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.505797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.505797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.505797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.505797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.505797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.505797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. Aug 29 05:26:13.505797 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.507638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance f5afd1ca-2b42-4377-a9b0-16d7328e5462 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.509130 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-849407c8-e045-4884-bea4-9bb002395118 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462" status: 404 len: 111 microversion: 2.1 time: 0.038896 Aug 29 05:26:13.509918 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3207/6425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:13 2022] GET /compute/v2.1/servers/f5afd1ca-2b42-4377-a9b0-16d7328e5462 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.518521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.519040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.525492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.525973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.526401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.527091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.527702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.528363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.543758 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 HTTP/1.1 Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43'} Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.545715 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.549474 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.551023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.552025 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0ca462d-2ee0-479e-9d15-bd892e347ed5 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 404 len: 111 microversion: 2.1 time: 0.037469 Aug 29 05:26:13.553042 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3219/6426] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:13 2022] DELETE /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.562097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.562930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.569446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.570443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.571154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.572006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.572643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.573198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.588048 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 HTTP/1.1 Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43'} Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.589840 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.593660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.593660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.593660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.593660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.593660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.593660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. Aug 29 05:26:13.593660 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.595260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.596320 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e1ae2d33-ac63-4790-ada0-db7e1fddfc94 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43" status: 404 len: 111 microversion: 2.1 time: 0.039331 Aug 29 05:26:13.597054 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3208/6427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:13 2022] GET /compute/v2.1/servers/be35c99d-1ea1-4d2c-ba94-00d3f5e2ed43 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:26:13.605462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b8b7122-2001-4f26-81d0-8564405ab5a4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.606272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b8b7122-2001-4f26-81d0-8564405ab5a4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 49da7f12-883a-4c40-9b37-9a730f572da5] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.612422 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3b8b7122-2001-4f26-81d0-8564405ab5a4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b8b7122-2001-4f26-81d0-8564405ab5a4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5 HTTP/1.1 Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '49da7f12-883a-4c40-9b37-9a730f572da5'} Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.614212 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b8b7122-2001-4f26-81d0-8564405ab5a4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b8b7122-2001-4f26-81d0-8564405ab5a4 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5" status: 404 len: 111 microversion: 2.1 time: 0.014303 Aug 29 05:26:13.617406 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3220/6428] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:13 2022] DELETE /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.627031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e58c176-efca-4e98-9844-0f9250ff08f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.627644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4e58c176-efca-4e98-9844-0f9250ff08f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 49da7f12-883a-4c40-9b37-9a730f572da5] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.633421 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-4e58c176-efca-4e98-9844-0f9250ff08f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e58c176-efca-4e98-9844-0f9250ff08f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5 HTTP/1.1 Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '49da7f12-883a-4c40-9b37-9a730f572da5'} Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:13.634908 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:13.638105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:13.638105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:13.638105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:13.638105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. Aug 29 05:26:13.638105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:13.638105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e58c176-efca-4e98-9844-0f9250ff08f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 49da7f12-883a-4c40-9b37-9a730f572da5 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:13.638105 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4e58c176-efca-4e98-9844-0f9250ff08f1 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5" status: 404 len: 111 microversion: 2.1 time: 0.013863 Aug 29 05:26:13.641359 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3209/6429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:13 2022] GET /compute/v2.1/servers/49da7f12-883a-4c40-9b37-9a730f572da5 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:13.645928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.646586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.655223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.655909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.657276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.658318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.658908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.659748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.688955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:26:13.779365 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ade913d-38d3-4f27-84e5-93bf0a354627 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "DELETE /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 204 len: 0 microversion: 2.1 time: 0.137200 Aug 29 05:26:13.780514 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3221/6430] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:13 2022] DELETE /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:26:13.789573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:13.790526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:13.805292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.806523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.807667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1d3e7dd9-27a9-4333-99cc-7b312dee70c1 req-ea41b739-a3d4-4296-bc07-0b3c5582de50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7", "name": "network-vif-deleted", "tag": "822bbc8b-6e31-4d94-9a52-8177bd0844bc"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:13.808715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.821082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.821513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1d3e7dd9-27a9-4333-99cc-7b312dee70c1 req-ea41b739-a3d4-4296-bc07-0b3c5582de50 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:13.821758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.822270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.822518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1d3e7dd9-27a9-4333-99cc-7b312dee70c1 req-ea41b739-a3d4-4296-bc07-0b3c5582de50 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:13.823218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1d3e7dd9-27a9-4333-99cc-7b312dee70c1 req-ea41b739-a3d4-4296-bc07-0b3c5582de50 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:13.837391 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1d3e7dd9-27a9-4333-99cc-7b312dee70c1 req-ea41b739-a3d4-4296-bc07-0b3c5582de50 service nova] Creating event network-vif-deleted:822bbc8b-6e31-4d94-9a52-8177bd0844bc for instance 741b0fe9-1e1f-4b2b-8c2f-d587f8deadd7 on n-h1-854119-9 Aug 29 05:26:13.852891 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-1d3e7dd9-27a9-4333-99cc-7b312dee70c1 req-ea41b739-a3d4-4296-bc07-0b3c5582de50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049732 Aug 29 05:26:13.853885 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3222/6431] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:13.967724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:13.975957 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-410b531e-933a-4fa2-bbf7-64c6fe129107 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1479 microversion: 2.1 time: 0.190995 Aug 29 05:26:13.976634 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3210/6432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:13 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1479 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:14.997368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:14.998352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:15.011368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:15.011954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:15.012553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:15.016928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:15.017532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:15.018055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:15.250248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f989fcf-f48f-4c6f-9901-af3c11eb1587 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:15.252961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0f989fcf-f48f-4c6f-9901-af3c11eb1587 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:15.266629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f989fcf-f48f-4c6f-9901-af3c11eb1587 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:15.276495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f989fcf-f48f-4c6f-9901-af3c11eb1587 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:15.277505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f989fcf-f48f-4c6f-9901-af3c11eb1587 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:15.278546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f989fcf-f48f-4c6f-9901-af3c11eb1587 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:15.279324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f989fcf-f48f-4c6f-9901-af3c11eb1587 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:15.280344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f989fcf-f48f-4c6f-9901-af3c11eb1587 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:15.351292 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f989fcf-f48f-4c6f-9901-af3c11eb1587 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104598 Aug 29 05:26:15.352853 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3211/6433] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:26:15 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:26:15.478753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:15.479250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:15.490455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:15.491988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:15.492629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:15.493620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:15.494253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:15.494845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:15.537967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:26:15.662214 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-097c11f3-8fe1-46d8-981a-20f4d5458b70 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "DELETE /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 204 len: 0 microversion: 2.1 time: 0.189699 Aug 29 05:26:15.663588 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3212/6434] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:15 2022] DELETE /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:26:15.674969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:15.675749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:15.683447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:15.684244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:15.684889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:15.685857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:15.686399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:15.686908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:15.746324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:15.758758 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad108546-e7c8-4986-ad24-9adbbf336f05 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1479 microversion: 2.1 time: 0.764392 Aug 29 05:26:15.758758 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3223/6435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:14 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1479 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:16.029107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:16.041746 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3f3f01a2-2987-440f-9325-a95f0ac2fae1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1672 microversion: 2.1 time: 0.369630 Aug 29 05:26:16.042457 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3213/6436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:15 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1672 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:16.781137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:16.782033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:16.789056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:16.789858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:16.790488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:16.792109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:16.793000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:16.793659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:17.063408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:17.063929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:17.079024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:17.082485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:17.084040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:17.087127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:17.087566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:17.088028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:17.654952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:17.665067 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5de69cae-8166-444a-b37d-4a0bde1ec871 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1479 microversion: 2.1 time: 0.889761 Aug 29 05:26:17.678156 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3224/6437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:16 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1479 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:17.755112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:17.772599 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e391edef-bc30-4b90-8f19-9abd937e9b00 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1672 microversion: 2.1 time: 0.712287 Aug 29 05:26:17.775334 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3214/6438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:17 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1672 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:18.089312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-279eae7c-fe3d-4b66-9140-f48a1924a57a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] Calling method '.version_select at 0x7f1ab8b470d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:18.130471 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-279eae7c-fe3d-4b66-9140-f48a1924a57a tempest-TestSecurityGroupsBasicOps-1810972830 tempest-TestSecurityGroupsBasicOps-1810972830-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1118577476" status: 202 len: 0 microversion: 2.1 time: 0.045774 Aug 29 05:26:18.141051 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3225/6439] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Aug 29 05:26:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1118577476 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:26:18.427562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-70bba976-6e05-4ff4-8cca-e1415e9efa87 req-ee959596-33ce-4db8-9e1e-03fc2a8a3993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316f8d51-a11d-4fac-9c61-46830a04cc97", "name": "network-vif-deleted", "tag": "64288f2d-9c6a-47b5-9f59-b74d8d50e177"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:18.446074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-70bba976-6e05-4ff4-8cca-e1415e9efa87 req-ee959596-33ce-4db8-9e1e-03fc2a8a3993 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:18.446517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-70bba976-6e05-4ff4-8cca-e1415e9efa87 req-ee959596-33ce-4db8-9e1e-03fc2a8a3993 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:18.446945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-70bba976-6e05-4ff4-8cca-e1415e9efa87 req-ee959596-33ce-4db8-9e1e-03fc2a8a3993 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:18.459462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:18.479541 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-70bba976-6e05-4ff4-8cca-e1415e9efa87 req-ee959596-33ce-4db8-9e1e-03fc2a8a3993 service nova] Creating event network-vif-deleted:64288f2d-9c6a-47b5-9f59-b74d8d50e177 for instance 316f8d51-a11d-4fac-9c61-46830a04cc97 on n-h1-854119-9 Aug 29 05:26:18.486655 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-70bba976-6e05-4ff4-8cca-e1415e9efa87 req-ee959596-33ce-4db8-9e1e-03fc2a8a3993 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062718 Aug 29 05:26:18.496662 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3215/6440] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:18.692874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:18.693524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:18.703646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:18.705360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:18.705937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:18.708096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:18.708677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:18.710363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:18.797710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:18.798420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:18.800522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:18.811331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:18.811823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:18.812287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:18.812747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lazy-loading 'fault' on Instance uuid 316f8d51-a11d-4fac-9c61-46830a04cc97 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:26:18.831701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:18.832836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:18.833463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:18.850079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:18.860400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:18.862985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:18.992515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87aef4a0e8af4640b7f1dd06e446eb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeeb8f1f938542e5b1649c44afb93b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:19.009229 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3aa42ef4-2f48-4cc0-86d0-9be559d8505f tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 200 len: 1282 microversion: 2.1 time: 0.322208 Aug 29 05:26:19.009229 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3226/6441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:18 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 1282 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:19.058222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:19.094579 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e5ea71d7-dafc-4b1d-89f9-0feb9cccc350 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 200 len: 1604 microversion: 2.1 time: 0.302332 Aug 29 05:26:19.095224 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3216/6442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:18 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 1604 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:20.026831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:20.028797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] [instance: 316f8d51-a11d-4fac-9c61-46830a04cc97] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:20.044890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:20.045730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:20.047390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:20.049958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:20.050732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:20.052416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:20.088579 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] HTTP exception thrown: Instance 316f8d51-a11d-4fac-9c61-46830a04cc97 could not be found. Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Request method failure captured: Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 HTTP/1.1 Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE0upEYZuHN_vHHIk4vU1bKCiHkpeEChl6HiNIWrb7EsHX2pY8O1bsQjKCc9xOjYQZbpleL1nWwRPU1pKKDn4G-27qF1v0u-MAEVL19aSsJa0wLV2Q-XCL1C__coR3zgtkLkteI4IGJ0JFGtMPuCMyecEFsdtCha2Uu65wTCFnRemeE Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eeeb8f1f938542e5b1649c44afb93b98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eeeb8f1f938542e5b1649c44afb93b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersTestJSON-2000461829 Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: eeeb8f1f938542e5b1649c44afb93b98 Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersTestJSON-2000461829 Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 87aef4a0e8af4640b7f1dd06e446eb0d Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersTestJSON-2000461829-project Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 316f8d51-a11d-4fac-9c61-46830a04cc97 could not be found. Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '316f8d51-a11d-4fac-9c61-46830a04cc97'} Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316f8d51-a11d-4fac-9c61-46830a04cc97 could not be found. Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316f8d51-a11d-4fac-9c61-46830a04cc97 could not be found. Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:20.091738 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.095519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:20.095519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:20.095519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:20.095519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:20.095519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:20.095519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316f8d51-a11d-4fac-9c61-46830a04cc97 could not be found. Aug 29 05:26:20.095519 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.095519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] Returning 404 to user: Instance 316f8d51-a11d-4fac-9c61-46830a04cc97 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:20.097700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3dcab428-4f7c-4a53-9258-286fe26cdb19 tempest-ServersTestJSON-2000461829 tempest-ServersTestJSON-2000461829-project] 10.222.0.20 "GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97" status: 404 len: 111 microversion: 2.1 time: 0.073781 Aug 29 05:26:20.098883 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3227/6443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:20 2022] GET /compute/v2.1/servers/316f8d51-a11d-4fac-9c61-46830a04cc97 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:20.115061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:20.115706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:20.135654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:20.136082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:20.170828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:20.182780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:20.183299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:20.183741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:20.230479 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] HTTP exception thrown: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Request method failure captured: Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba HTTP/1.1 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEyx4gTPkmmeipeKem59YTyW3XgB_hVHiK4YvZ-HMrD_RVfxUWIvGJIAJ1_GXjt94zavkoiTAB4F3wbwR5ZI5fH8TstPob5EEHbemffcl40crjZLGShtdw5Pr8MwNOWo3UQD9MiRei90E8thqW_u81OGw150LvqngwogFF7yUseGKYs Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb004e20c1594762809ba319a68c50b9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 78bdd41026f34da095323a31c14f2606 Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '635e3272-74c9-40af-931a-531bb7658fba'} Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:20.232473 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.235959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:20.235959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:20.235959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:20.235959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:20.235959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:20.235959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:26:20.235959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:20.237742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Returning 404 to user: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:20.238786 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b74bc56f-f10f-4c9e-86cc-b0223812f5eb tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 404 len: 111 microversion: 2.1 time: 0.127737 Aug 29 05:26:20.239551 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3217/6444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:20 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:20.248666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7a567701-d33c-4066-8eb8-ce8da738c5ee tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '.version_select at 0x7f1abd96c310>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:20.271610 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7a567701-d33c-4066-8eb8-ce8da738c5ee tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-119311284" status: 202 len: 0 microversion: 2.1 time: 0.027317 Aug 29 05:26:20.274206 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3228/6445] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:26:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-119311284 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:26:20.512523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-63245042-5518-45fd-9002-b781f5cd6cbb req-a8e641a0-35b6-4f4d-af7e-323212e2e377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635e3272-74c9-40af-931a-531bb7658fba", "name": "network-vif-deleted", "tag": "8a278e7e-0e8e-4a50-910b-741261864d38"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:20.535031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-63245042-5518-45fd-9002-b781f5cd6cbb req-a8e641a0-35b6-4f4d-af7e-323212e2e377 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:20.535930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-63245042-5518-45fd-9002-b781f5cd6cbb req-a8e641a0-35b6-4f4d-af7e-323212e2e377 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:20.536891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-63245042-5518-45fd-9002-b781f5cd6cbb req-a8e641a0-35b6-4f4d-af7e-323212e2e377 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:20.553283 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-63245042-5518-45fd-9002-b781f5cd6cbb req-a8e641a0-35b6-4f4d-af7e-323212e2e377 service nova] Creating event network-vif-deleted:8a278e7e-0e8e-4a50-910b-741261864d38 for instance 635e3272-74c9-40af-931a-531bb7658fba on n-h1-854119-9 Aug 29 05:26:20.564349 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-63245042-5518-45fd-9002-b781f5cd6cbb req-a8e641a0-35b6-4f4d-af7e-323212e2e377 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059767 Aug 29 05:26:20.565700 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3218/6446] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:21.712004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c511b341-7060-436b-93d6-fc19d8078746 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'create', calling method: .version_select at 0x7f1ab8716940>, body: {"keypair": {"name": "tempest-keypair-15496103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJqRoQRYf5CkT1mxoahfo0lG6QvWrnracpafialJPV1iMbD8ghibkJmNc3fZUmVufx8DlU84A5hJul45QybUS9Ta/8kpb5oSejMENzKc1mioXTcU8Fw12RaAoDAK89lGA=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:21.719002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:21.753471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c511b341-7060-436b-93d6-fc19d8078746 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Getting quotas for project fb004e20c1594762809ba319a68c50b9. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:26:21.759697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c511b341-7060-436b-93d6-fc19d8078746 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Getting quotas for user 78bdd41026f34da095323a31c14f2606 and project fb004e20c1594762809ba319a68c50b9. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:26:21.841786 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c511b341-7060-436b-93d6-fc19d8078746 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.137154 Aug 29 05:26:21.842405 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3229/6447] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:26:21 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:24.083347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:24.088739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:24.098291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:24.099761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:24.100474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:24.101789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:24.102476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:24.103113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:24.269474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:26:24.269938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:26:24.270410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:26:24.270985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:26:24.271557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:26:24.365653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:24.374499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:24.375641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:24.377073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:24.378085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:24.378946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:24.379737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:24.433773 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-304bac9e-04e8-414b-831c-9799dd3b845e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca/action" status: 202 len: 1135 microversion: 2.1 time: 0.365881 Aug 29 05:26:24.435064 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3219/6448] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:26:24 2022] POST /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca/action => generated 1135 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 05:26:24.452947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:24.453733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:24.478194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:24.479200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:24.479666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:24.483138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:24.483572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:24.484225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:24.956103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:24.982791 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d7414d2c-bfde-46d9-9128-c4d4b42ceae3 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1689 microversion: 2.1 time: 0.534211 Aug 29 05:26:24.986246 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3230/6449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:24 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1689 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:25.251152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1957016437", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca473379-a51a-49eb-8d1b-f1c1042f536f"}], "security_groups": [{"name": "tempest-securitygroup--120963518"}], "key_name": "tempest-keypair-15496103", "user_data": "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:25.500753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] validate_networks() for [('ca473379-a51a-49eb-8d1b-f1c1042f536f', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:26:26.011012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:26.011633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:26.033225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:26.042200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:26.042200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:26.042200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:26.042200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:26.042200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:26.163443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:26:26.164624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:26:26.165304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:26:26.165915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:26:26.166536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:26:26.199732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:26.201507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:26.202800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:26.205086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:26.208508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:26.209436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:26.263228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Getting quotas for project fb004e20c1594762809ba319a68c50b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:26:26.277894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Getting quotas for user 78bdd41026f34da095323a31c14f2606 and project fb004e20c1594762809ba319a68c50b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:26:26.311018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:26:26.314621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:26:26.399752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:26.419870 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0560500b-958a-41be-8012-b0292250f362 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1689 microversion: 2.1 time: 0.412586 Aug 29 05:26:26.421437 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3231/6450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:26 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1689 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:26.436307 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d1a56fc0-100d-4026-add1-5726df5bffb2 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.195101 Aug 29 05:26:26.437657 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3220/6451] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:26:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:26:26.451624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45561087-4169-4837-b883-e50e0f225229 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:26.452893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45561087-4169-4837-b883-e50e0f225229 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:26.609660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45561087-4169-4837-b883-e50e0f225229 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:26.619596 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45561087-4169-4837-b883-e50e0f225229 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1236 microversion: 2.1 time: 0.175133 Aug 29 05:26:26.632151 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3232/6452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:26 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1236 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:27.447806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:27.448508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:27.462866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:27.465046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:27.465971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:27.467245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:27.484628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:27.487179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:27.645499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:27.646858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:27.675322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:27.685041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:27.685650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:27.686430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:27.694301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:27.695442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:27.938160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:27.947380 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-215c67e9-ec4d-4097-b710-ecf46ae16d34 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1689 microversion: 2.1 time: 0.505235 Aug 29 05:26:27.952665 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3221/6453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:27 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1689 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:27.966827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:27.980859 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-49936e31-3468-44ab-ac3c-9cb5372bc4c9 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1288 microversion: 2.1 time: 0.339582 Aug 29 05:26:27.982348 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3233/6454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:27 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1288 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:28.956996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2070025253", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "d1c729c0-1bc7-48bc-9732-ba5ad17457ee"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:28.969829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:28.971300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:28.984483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:28.985165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:28.985802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:28.998079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:28.999198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:29.001460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:29.043679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] validate_networks() for [('d1c729c0-1bc7-48bc-9732-ba5ad17457ee', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:26:29.556603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:29.570913 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7c28a5eb-954f-4245-ae5d-ef1f6a3bf9a1 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1689 microversion: 2.1 time: 0.605521 Aug 29 05:26:29.578425 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3234/6455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:28 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1689 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:29.595273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:29.600284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:29.615644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:29.616305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:29.618066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:29.618914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:29.623721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:29.623721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:29.852416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:26:29.855646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:26:29.856334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:26:29.856840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:26:29.857475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:26:29.877865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:29.878415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:29.878931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:29.885198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:29.886602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:29.887287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:29.961981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:29.965075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Getting quotas for project c0fbe404e5b647f18629a8b745c37bef. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:26:29.972297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Getting quotas for user f27dd4a7d4ca4eb0b54dc75ea38ac729 and project c0fbe404e5b647f18629a8b745c37bef. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:26:29.984865 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-def7e8a0-9301-4693-be7d-55154b4ef0b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1361 microversion: 2.1 time: 0.400163 Aug 29 05:26:29.989110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:26:30.000993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:26:30.002232 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3235/6456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:29 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1361 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:30.060634 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bf7c36d8-24d5-4d79-ab7e-72d9c9d89ce7 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.475183 Aug 29 05:26:30.067402 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3222/6457] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:26:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:26:30.074062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a5c0aab1-b293-40ba-89f2-923316f08b71 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:30.075123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a5c0aab1-b293-40ba-89f2-923316f08b71 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:30.153425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a5c0aab1-b293-40ba-89f2-923316f08b71 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:30.164812 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a5c0aab1-b293-40ba-89f2-923316f08b71 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1215 microversion: 2.1 time: 0.094583 Aug 29 05:26:30.173235 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3236/6458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:30 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:30.606112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:30.606742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:30.620172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:30.620696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:30.621137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:30.621955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:30.625339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:30.626889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:30.842528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9e673a22-0086-48f0-9a02-0f1e508a33d6 tempest-ComputeTenantNetworksTest-1885192383 tempest-ComputeTenantNetworksTest-1885192383-project] Calling method '.version_select at 0x7f1abd96ca60>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:31.097385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:31.111955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-080a8b04-b2d4-4eb5-89d9-cae85850d52a tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1689 microversion: 2.1 time: 0.515250 Aug 29 05:26:31.112616 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3223/6459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:30 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1689 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:31.117054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8bc0f20d-b898-46d1-9a00-2aa035c7be8d req-7ff0da29-a61e-4297-aa8a-4e814f18840f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d5a238e-39c9-4b26-b927-17d5be2ee3bf", "tag": "7f4e61ba-85d6-40ca-9092-9fb1be39d2c6"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:31.145942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8bc0f20d-b898-46d1-9a00-2aa035c7be8d req-7ff0da29-a61e-4297-aa8a-4e814f18840f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:31.146606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8bc0f20d-b898-46d1-9a00-2aa035c7be8d req-7ff0da29-a61e-4297-aa8a-4e814f18840f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:31.147202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8bc0f20d-b898-46d1-9a00-2aa035c7be8d req-7ff0da29-a61e-4297-aa8a-4e814f18840f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:31.160405 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8bc0f20d-b898-46d1-9a00-2aa035c7be8d req-7ff0da29-a61e-4297-aa8a-4e814f18840f service nova] Creating event network-changed:7f4e61ba-85d6-40ca-9092-9fb1be39d2c6 for instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf on n-h2-854119-9 Aug 29 05:26:31.168578 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8bc0f20d-b898-46d1-9a00-2aa035c7be8d req-7ff0da29-a61e-4297-aa8a-4e814f18840f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054761 Aug 29 05:26:31.169656 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3224/6460] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:31.174994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:31.175851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:31.184146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:31.184885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:31.185467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:31.186320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:31.186917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:31.187964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:31.271186 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9e673a22-0086-48f0-9a02-0f1e508a33d6 tempest-ComputeTenantNetworksTest-1885192383 tempest-ComputeTenantNetworksTest-1885192383-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 306 microversion: 2.1 time: 0.670840 Aug 29 05:26:31.272077 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3237/6461] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 05:26:30 2022] GET /compute/v2.1/os-tenant-networks => generated 306 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:31.280256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:31.282502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:31.306647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:31.307325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:31.310625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:31.314303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:31.315000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:31.315640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:31.363899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:31.514929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:31.528792 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-56655456-c3c3-46bc-b91d-5061a29ad3ab tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1267 microversion: 2.1 time: 0.255596 Aug 29 05:26:31.529574 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3238/6462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:31 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:31.534278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c525a195-89de-48e0-9244-5ea9743c31d2 tempest-ComputeTenantNetworksTest-1885192383 tempest-ComputeTenantNetworksTest-1885192383-project] Calling method '.version_select at 0x7f1ab814fb80>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:31.551612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:31.561665 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ab92a43-bc68-4bb3-b559-1e3587d9c280 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1361 microversion: 2.1 time: 0.390697 Aug 29 05:26:31.565447 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3225/6463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:31 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1361 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:31.713067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f11aa100-6c8e-41c5-8b20-60112c15ea73 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:31.714184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f11aa100-6c8e-41c5-8b20-60112c15ea73 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:31.715646 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c525a195-89de-48e0-9244-5ea9743c31d2 tempest-ComputeTenantNetworksTest-1885192383 tempest-ComputeTenantNetworksTest-1885192383-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/38fad2b2-2366-4ee3-9290-2b00275f920d" status: 200 len: 137 microversion: 2.1 time: 0.184822 Aug 29 05:26:31.722711 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3239/6464] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:26:31 2022] GET /compute/v2.1/os-tenant-networks/38fad2b2-2366-4ee3-9290-2b00275f920d => generated 137 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:31.722829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f11aa100-6c8e-41c5-8b20-60112c15ea73 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:31.723435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f11aa100-6c8e-41c5-8b20-60112c15ea73 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:31.723927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f11aa100-6c8e-41c5-8b20-60112c15ea73 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:31.724763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f11aa100-6c8e-41c5-8b20-60112c15ea73 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:31.725323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f11aa100-6c8e-41c5-8b20-60112c15ea73 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:31.725954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f11aa100-6c8e-41c5-8b20-60112c15ea73 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:31.773862 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f11aa100-6c8e-41c5-8b20-60112c15ea73 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/ips" status: 200 len: 149 microversion: 2.1 time: 0.066442 Aug 29 05:26:31.779664 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3226/6465] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:26:31 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/ips => generated 149 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:32.134783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:32.135895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:32.151157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:32.153963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:32.154378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:32.155138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:32.155605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:32.156036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:32.496575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:32.508366 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7d0cca44-cc38-4098-9312-637c79bd57ca tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1689 microversion: 2.1 time: 0.377129 Aug 29 05:26:32.510585 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3240/6466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:32 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1689 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:32.557001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:32.559342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:32.587156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:32.588081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:32.606555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:32.609063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:32.610700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:32.611926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:32.612627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:32.614849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:32.615902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:32.616703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:32.616970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:32.617975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:32.619212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:32.632485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:32.799211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:32.810193 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b7def139-c424-4698-baa4-9dd7c997e2a6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1273 microversion: 2.1 time: 0.258304 Aug 29 05:26:32.812047 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3227/6467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:32 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:32.958844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:32.982300 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0b236222-7e37-4d0b-b4f1-a5841b45f233 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1361 microversion: 2.1 time: 0.399708 Aug 29 05:26:32.983587 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3241/6468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:32 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1361 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:33.531428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:33.532166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:33.540605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:33.541478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:33.542066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:33.542965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:33.543643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:33.544952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:33.839656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:33.839656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:33.843649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:33.847877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:33.852514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:33.853018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:33.854318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:33.854318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:33.854660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:33.892084 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87febf1a-e44c-4c12-9c3f-88ccb40a305d tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1689 microversion: 2.1 time: 0.364736 Aug 29 05:26:33.913078 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3228/6469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:33 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1689 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:34.002895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:34.003514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:34.013524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:34.013929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:34.014365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:34.020174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:34.020843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:34.021577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:34.334002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:34.350107 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0b7e1b5c-dc7c-44e7-a1b5-2dd5c9183283 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1315 microversion: 2.1 time: 0.517835 Aug 29 05:26:34.363225 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3242/6470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:33 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:34.373389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:34.417844 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb81ff5b-b462-4367-b8fb-c38ab065fd80 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1361 microversion: 2.1 time: 0.418643 Aug 29 05:26:34.422700 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3229/6471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:33 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1361 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:34.505842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9dd3204-8e91-4e78-9d59-7d5b20bffa8e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2cbbee3-ece0-4b66-9697-6221749e4494"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:34.512951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9dd3204-8e91-4e78-9d59-7d5b20bffa8e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:34.527338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9dd3204-8e91-4e78-9d59-7d5b20bffa8e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:34.545425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9dd3204-8e91-4e78-9d59-7d5b20bffa8e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:34.547032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9dd3204-8e91-4e78-9d59-7d5b20bffa8e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:34.553495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9dd3204-8e91-4e78-9d59-7d5b20bffa8e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:34.554386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9dd3204-8e91-4e78-9d59-7d5b20bffa8e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:34.556847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9dd3204-8e91-4e78-9d59-7d5b20bffa8e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:35.072453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9dd3204-8e91-4e78-9d59-7d5b20bffa8e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572924 Aug 29 05:26:35.075105 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3230/6472] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:26:34 2022] POST /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:35.087233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:35.088424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:35.105085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:35.108745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:35.109269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:35.110336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:35.110977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:35.112111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:35.123792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2e6fe5e3-301a-493e-bad9-07b79fe76513 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Action: 'create', calling method: .version_select at 0x7f1ab86c7ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-601376309"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:35.311346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:35.320612 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f8c7f991-0d64-40f8-8063-c0739e1ddc97 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1689 microversion: 2.1 time: 0.242866 Aug 29 05:26:35.334757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3231/6473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:35 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:35.340714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-834f1412-204d-4ebc-a958-20facfbc8320 req-88b374c8-db8a-483c-be74-175ac5df3504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d5077f-492b-4ca9-a9e4-221b57535e1e", "tag": "8a3d07b4-a7f1-4ea6-8111-7fd733d41669"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:35.359313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-834f1412-204d-4ebc-a958-20facfbc8320 req-88b374c8-db8a-483c-be74-175ac5df3504 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:35.360243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-834f1412-204d-4ebc-a958-20facfbc8320 req-88b374c8-db8a-483c-be74-175ac5df3504 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:35.360827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-834f1412-204d-4ebc-a958-20facfbc8320 req-88b374c8-db8a-483c-be74-175ac5df3504 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:35.380029 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-834f1412-204d-4ebc-a958-20facfbc8320 req-88b374c8-db8a-483c-be74-175ac5df3504 service nova] Creating event network-changed:8a3d07b4-a7f1-4ea6-8111-7fd733d41669 for instance 50d5077f-492b-4ca9-a9e4-221b57535e1e on n-h1-854119-9 Aug 29 05:26:35.392891 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-834f1412-204d-4ebc-a958-20facfbc8320 req-88b374c8-db8a-483c-be74-175ac5df3504 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048575 Aug 29 05:26:35.394312 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3232/6474] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:35.404097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:35.406086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:35.412692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:35.413169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:35.413597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:35.414282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:35.414883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:35.415423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:35.433736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:35.600790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:35.610408 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb115345-926a-4ae4-871e-0d1cc70a85e9 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1315 microversion: 2.1 time: 0.213920 Aug 29 05:26:35.616163 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3233/6475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:35 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:35.617287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:35.618261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:35.624869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:35.625513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:35.626154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:35.627006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:35.627621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:35.628202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:35.639419 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2e6fe5e3-301a-493e-bad9-07b79fe76513 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.287167 Aug 29 05:26:35.640068 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3243/6476] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Aug 29 05:26:34 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1288 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 05:26:35.654809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11ab5d52-7004-4385-a406-ab89f9ce9466 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab87163a0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:35.725533 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11ab5d52-7004-4385-a406-ab89f9ce9466 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527" status: 200 len: 344 microversion: 2.1 time: 0.076901 Aug 29 05:26:35.726117 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3244/6477] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:26:35 2022] GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:35.787776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:35.796725 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e9c8db83-b074-461b-8a53-c87725c49e22 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1361 microversion: 2.1 time: 0.184277 Aug 29 05:26:35.807186 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3234/6478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:35 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:36.342808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:36.344257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:36.367546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:36.368432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:36.369738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:36.371493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:36.372230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:36.372916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:36.646261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6fca4c20-1f9c-4eee-b12c-2f4e670d8258 req-2fa0befa-7081-42d0-801f-5acb6e95ab98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d5a238e-39c9-4b26-b927-17d5be2ee3bf", "name": "network-vif-plugged", "status": "completed", "tag": "7f4e61ba-85d6-40ca-9092-9fb1be39d2c6"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:36.664814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6fca4c20-1f9c-4eee-b12c-2f4e670d8258 req-2fa0befa-7081-42d0-801f-5acb6e95ab98 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:36.666088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6fca4c20-1f9c-4eee-b12c-2f4e670d8258 req-2fa0befa-7081-42d0-801f-5acb6e95ab98 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:36.667354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6fca4c20-1f9c-4eee-b12c-2f4e670d8258 req-2fa0befa-7081-42d0-801f-5acb6e95ab98 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:36.692817 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6fca4c20-1f9c-4eee-b12c-2f4e670d8258 req-2fa0befa-7081-42d0-801f-5acb6e95ab98 service nova] Creating event network-vif-plugged:7f4e61ba-85d6-40ca-9092-9fb1be39d2c6 for instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf on n-h2-854119-9 Aug 29 05:26:36.718730 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6fca4c20-1f9c-4eee-b12c-2f4e670d8258 req-2fa0befa-7081-42d0-801f-5acb6e95ab98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.407037 Aug 29 05:26:36.726512 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3245/6479] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:36.740106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:36.742497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:36.780638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:36.784060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:36.785107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:36.785903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:36.786536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:36.787033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:36.976687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:36.988931 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-25512a6e-9ced-4d88-b130-542a2d4c782e tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1689 microversion: 2.1 time: 0.650681 Aug 29 05:26:36.992633 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3235/6480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:36 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1689 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:37.007434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6322d2ba-017e-4739-874c-573985b4fe9b tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab8dc1f70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:37.095012 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6322d2ba-017e-4739-874c-573985b4fe9b tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527" status: 200 len: 345 microversion: 2.1 time: 0.100853 Aug 29 05:26:37.095897 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3236/6481] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:26:36 2022] GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:37.102810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:37.103978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:37.111445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:37.115156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:37.115852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:37.116855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:37.117584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:37.118451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:37.437437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:37.446228 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-839e5622-0efe-48f4-bbc5-2b6e6b9fb74e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1315 microversion: 2.1 time: 0.717021 Aug 29 05:26:37.449101 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3246/6482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:36 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:37.455034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-387acecd-11aa-496f-9138-78b7cecc21d4 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Action: 'create', calling method: .version_select at 0x7f1ab92ea040>, body: {"snapshot": {"volume_id": "a7b51d0c-35bf-4ef9-93b7-bb807085a527", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-580450708"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:37.512768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:37.522310 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-88531cb1-8a45-4f23-9156-a54831c125f7 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1361 microversion: 2.1 time: 0.425124 Aug 29 05:26:37.523767 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3237/6483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:37 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1361 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:37.714194 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-387acecd-11aa-496f-9138-78b7cecc21d4 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.262931 Aug 29 05:26:37.721894 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3247/6484] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Aug 29 05:26:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:37.726756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5973e04-391e-4949-8c37-e96348bc8021 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab84da550>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:37.773312 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f5973e04-391e-4949-8c37-e96348bc8021 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770" status: 200 len: 286 microversion: 2.1 time: 0.051052 Aug 29 05:26:37.774165 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3238/6485] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 05:26:37 2022] GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:37.786414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-230d2bbd-b4d6-4605-b36f-4be545aa5977 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab8706310>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:37.878048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-230d2bbd-b4d6-4605-b36f-4be545aa5977 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.096096 Aug 29 05:26:37.891600 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3248/6486] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 29 05:26:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:37.893795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-142860bf-9be0-4556-b84b-d3cc847ad75e tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab8440160>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:38.013840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:38.014842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:38.028597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:38.029377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:38.029993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:38.031868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:38.032990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:38.033952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:38.035961 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-142860bf-9be0-4556-b84b-d3cc847ad75e tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770" status: 200 len: 286 microversion: 2.1 time: 0.148601 Aug 29 05:26:38.041295 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3239/6487] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 05:26:37 2022] GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:38.474683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:38.475835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:38.503216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:38.503794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:38.511232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:38.512773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:38.515360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:38.518725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:38.790043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:38.799310 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5151c951-5f20-48b1-91d1-96c3d484f598 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1695 microversion: 2.1 time: 0.789952 Aug 29 05:26:38.820731 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3249/6488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:38 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1695 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:38.834527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:38.835167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:38.854678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:38.856233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:38.857113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:38.858020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:38.858642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:38.859235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:38.919443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:38.939973 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6effcd4-f566-4b29-bcbf-b75b568b325a tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1315 microversion: 2.1 time: 0.470586 Aug 29 05:26:38.940712 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3240/6489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:38 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:39.050469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a34d119-d1c0-4bc5-a727-47dbe9a93dbe tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab84405e0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:39.072074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:39.084631 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f19e8493-91f5-4d3a-82a5-2c3a1c4ba4a1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1545 microversion: 2.1 time: 0.259924 Aug 29 05:26:39.086042 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3250/6490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:38 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1545 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:39.099490 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a34d119-d1c0-4bc5-a727-47dbe9a93dbe tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770" status: 200 len: 286 microversion: 2.1 time: 0.053436 Aug 29 05:26:39.104951 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3241/6491] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 05:26:39 2022] GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:39.115924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bcbb5da5-8788-4c25-a8ba-fc1be359279f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:39.116741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bcbb5da5-8788-4c25-a8ba-fc1be359279f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:39.126453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcbb5da5-8788-4c25-a8ba-fc1be359279f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:39.128436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcbb5da5-8788-4c25-a8ba-fc1be359279f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:39.133771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcbb5da5-8788-4c25-a8ba-fc1be359279f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:39.135029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcbb5da5-8788-4c25-a8ba-fc1be359279f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:39.137814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcbb5da5-8788-4c25-a8ba-fc1be359279f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:39.138934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bcbb5da5-8788-4c25-a8ba-fc1be359279f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:39.311904 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bcbb5da5-8788-4c25-a8ba-fc1be359279f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201753 Aug 29 05:26:39.312768 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3251/6492] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:26:39 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:39.824737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:39.825346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:39.840341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:39.841090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:39.841680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:39.842543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:39.843143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:39.843730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:39.940463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:39.970971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:39.972174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:39.980834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:39.982955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:40.000558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:40.001373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:40.002636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:40.003890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:40.004578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:40.167011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:40.238048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:40.256013 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-25883df9-de28-4523-9423-0da21c49e7c0 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1695 microversion: 2.1 time: 0.435028 Aug 29 05:26:40.276763 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3242/6493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:39 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1695 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:40.283155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5d71587-cb2f-4601-acdd-c8bed359db48 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab84dc1f0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:40.336393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5d71587-cb2f-4601-acdd-c8bed359db48 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770" status: 200 len: 286 microversion: 2.1 time: 0.058008 Aug 29 05:26:40.337350 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3243/6494] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 05:26:40 2022] GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:40.530676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:40.540138 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-67d0d602-eb24-46a9-8964-65e88fa355d3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1315 microversion: 2.1 time: 0.573107 Aug 29 05:26:40.541327 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3252/6495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:39 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:41.059543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5eeb29df-af2f-4d4d-a0ee-60cb7d713f05 req-d9ae9370-9962-43e5-be42-88d8801144cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d5a238e-39c9-4b26-b927-17d5be2ee3bf", "tag": "7f4e61ba-85d6-40ca-9092-9fb1be39d2c6"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:41.080259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5eeb29df-af2f-4d4d-a0ee-60cb7d713f05 req-d9ae9370-9962-43e5-be42-88d8801144cf service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:41.081490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5eeb29df-af2f-4d4d-a0ee-60cb7d713f05 req-d9ae9370-9962-43e5-be42-88d8801144cf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:41.082071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5eeb29df-af2f-4d4d-a0ee-60cb7d713f05 req-d9ae9370-9962-43e5-be42-88d8801144cf service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:41.093607 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5eeb29df-af2f-4d4d-a0ee-60cb7d713f05 req-d9ae9370-9962-43e5-be42-88d8801144cf service nova] Creating event network-changed:7f4e61ba-85d6-40ca-9092-9fb1be39d2c6 for instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf on n-h2-854119-9 Aug 29 05:26:41.099271 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5eeb29df-af2f-4d4d-a0ee-60cb7d713f05 req-d9ae9370-9962-43e5-be42-88d8801144cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044356 Aug 29 05:26:41.100313 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3244/6496] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:41.293033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:41.295826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:41.304365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:41.307364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:41.307978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:41.309091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:41.310193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:41.310776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:41.351815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-015f6852-5740-42c4-9da7-0e30632e155d tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab85905e0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:41.394750 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-015f6852-5740-42c4-9da7-0e30632e155d tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770" status: 200 len: 287 microversion: 2.1 time: 0.048692 Aug 29 05:26:41.396574 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3245/6497] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 05:26:41 2022] GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:41.406708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-29805382-8984-49c6-863b-7116cc2d4f7c tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab8440d30>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:41.638023 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-29805382-8984-49c6-863b-7116cc2d4f7c tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770" status: 202 len: 0 microversion: 2.1 time: 0.235105 Aug 29 05:26:41.642389 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3246/6498] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Aug 29 05:26:41 2022] DELETE /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:26:41.647638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:41.648553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:41.670677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:41.671304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:41.671840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:41.672700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:41.678276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:41.678869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:42.103762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:42.113523 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b0383fc6-d9aa-497b-9223-a63e26f09133 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1695 microversion: 2.1 time: 0.826400 Aug 29 05:26:42.118882 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3253/6499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:41 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1695 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:42.130377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8cde4054-8e91-4923-8885-4135f1a97876 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab8706ee0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:42.185668 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8cde4054-8e91-4923-8885-4135f1a97876 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770" status: 200 len: 286 microversion: 2.1 time: 0.065485 Aug 29 05:26:42.186810 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3254/6500] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 05:26:42 2022] GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:42.195046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b439726e-38bf-4a70-98b0-5651908d2974 req-2796ccbd-3356-4065-b05a-1c2975eaaec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca", "name": "network-vif-unplugged", "status": "completed", "tag": "a0f9a947-6e74-4580-a86c-4888faa4e145"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:42.205994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b439726e-38bf-4a70-98b0-5651908d2974 req-2796ccbd-3356-4065-b05a-1c2975eaaec4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:42.206702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b439726e-38bf-4a70-98b0-5651908d2974 req-2796ccbd-3356-4065-b05a-1c2975eaaec4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:42.207190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b439726e-38bf-4a70-98b0-5651908d2974 req-2796ccbd-3356-4065-b05a-1c2975eaaec4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:42.222172 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b439726e-38bf-4a70-98b0-5651908d2974 req-2796ccbd-3356-4065-b05a-1c2975eaaec4 service nova] Creating event network-vif-unplugged:a0f9a947-6e74-4580-a86c-4888faa4e145 for instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca on n-h1-854119-9 Aug 29 05:26:42.228761 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b439726e-38bf-4a70-98b0-5651908d2974 req-2796ccbd-3356-4065-b05a-1c2975eaaec4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040380 Aug 29 05:26:42.229721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3255/6501] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:42.280917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:42.289889 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee718cca-86ca-4ebd-b533-6cada6fecbe4 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1315 microversion: 2.1 time: 0.646278 Aug 29 05:26:42.290469 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3247/6502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:41 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:43.141516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:43.143129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:43.155578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:43.169803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:43.171332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:43.174313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:43.174940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:43.175526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:43.198623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b5c7a79-a80a-46fc-bb59-677d139dc40f tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab8440dc0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:43.254197 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8b5c7a79-a80a-46fc-bb59-677d139dc40f tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770" status: 200 len: 286 microversion: 2.1 time: 0.059556 Aug 29 05:26:43.256108 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3248/6503] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 05:26:43 2022] GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:43.317711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:43.318985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:43.347503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:43.351115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:43.353775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:43.355391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:43.356180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:43.359406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:43.902997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:43.918325 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9029492d-5143-4f23-a6a5-2ac118198fae tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1695 microversion: 2.1 time: 0.782847 Aug 29 05:26:43.918927 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3256/6504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:43 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1695 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:43.999852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:44.008249 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-61c8e491-4a3e-4ace-962b-9fd1c9eca328 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1315 microversion: 2.1 time: 0.701171 Aug 29 05:26:44.021308 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3249/6505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:43 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:44.268498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5d61c76a-cac3-4d17-8774-5bbacc915956 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1abd87b820>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:44.305024 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-5d61c76a-cac3-4d17-8774-5bbacc915956 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] HTTP exception thrown: Snapshot 109ba188-24f0-4d15-b388-06db13e7f770 could not be found. Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5d61c76a-cac3-4d17-8774-5bbacc915956 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Request method failure captured: Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 HTTP/1.1 Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE4KZYAcTJTeXwJrZ7HLeT8cRxkfxR6tO3mZJrBi7cgbayNrN2RWjN2OrRoBSfSc_gZCie-GZhfmqDm9SZY_W7dHBY4ILziJnKg3leVwopTY_XTvwxBV32YQ1sl1tOPr6gxXyz_CAk7XwBjlpPtBEDlCy5XyENHHkW9jBIwVOLoCHeU Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: cf2166a96a954eacb59bfeab4f4ca49b Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf2166a96a954eacb59bfeab4f4ca49b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: cf2166a96a954eacb59bfeab4f4ca49b Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesSnapshotsTestJSON-1652469595-project Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 39b01f04fb1144aab34fde3b0abda3b2 Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1652469595-project Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: exception: Snapshot 109ba188-24f0-4d15-b388-06db13e7f770 could not be found. Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '109ba188-24f0-4d15-b388-06db13e7f770'} Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 109ba188-24f0-4d15-b388-06db13e7f770 could not be found. (HTTP 404) (Request-ID: req-7d6d929b-0b41-49b8-88fa-84187ddee78b) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 05:26:44.324742 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 109ba188-24f0-4d15-b388-06db13e7f770 could not be found. Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 109ba188-24f0-4d15-b388-06db13e7f770 could not be found. Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 109ba188-24f0-4d15-b388-06db13e7f770 could not be found. Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5d61c76a-cac3-4d17-8774-5bbacc915956 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Returning 404 to user: Snapshot 109ba188-24f0-4d15-b388-06db13e7f770 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:44.328230 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5d61c76a-cac3-4d17-8774-5bbacc915956 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770" status: 404 len: 111 microversion: 2.1 time: 0.063112 Aug 29 05:26:44.331250 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3257/6506] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 05:26:44 2022] GET /compute/v2.1/os-snapshots/109ba188-24f0-4d15-b388-06db13e7f770 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:44.336725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-018bbcca-c965-4e83-8f13-7ef6b71fc73d tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab8590af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:44.413174 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-018bbcca-c965-4e83-8f13-7ef6b71fc73d tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527" status: 202 len: 0 microversion: 2.1 time: 0.079800 Aug 29 05:26:44.413584 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3250/6507] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:26:44 2022] DELETE /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:26:44.423042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5f6cef8-5683-43d8-b7c8-4d6d373dd9cb tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab9270430>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:44.474994 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5f6cef8-5683-43d8-b7c8-4d6d373dd9cb tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527" status: 200 len: 344 microversion: 2.1 time: 0.056897 Aug 29 05:26:44.475954 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3258/6508] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:26:44 2022] GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:44.938905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:44.939508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:44.950011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:44.952431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:44.953758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:44.955241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:44.956664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:44.957627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:45.030909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:45.031703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:45.049058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:45.051738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:45.052762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:45.055484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:45.056159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:45.056984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:45.203944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:45.217611 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9fa6f777-bee3-4df4-80bd-9c14b5b57bf4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1680 microversion: 2.1 time: 0.282450 Aug 29 05:26:45.219135 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3251/6509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:44 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1680 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:45.326557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:45.336305 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa2535b6-0fe7-4e3d-88eb-22b953eadefa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1315 microversion: 2.1 time: 0.309396 Aug 29 05:26:45.337437 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3259/6510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:45 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:45.491700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-469cb810-2602-4b5b-bcd8-e8df1a54a792 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab850ce50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:45.551876 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-469cb810-2602-4b5b-bcd8-e8df1a54a792 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527" status: 200 len: 344 microversion: 2.1 time: 0.064646 Aug 29 05:26:45.552822 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3252/6511] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:26:45 2022] GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:45.832543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-019677c7-6c34-439b-ab18-faf409c4d62c req-d1c556b4-6359-4f6e-b57d-7ce4a9afe516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d5077f-492b-4ca9-a9e4-221b57535e1e", "name": "network-vif-plugged", "status": "completed", "tag": "8a3d07b4-a7f1-4ea6-8111-7fd733d41669"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:45.845311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-019677c7-6c34-439b-ab18-faf409c4d62c req-d1c556b4-6359-4f6e-b57d-7ce4a9afe516 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:45.846260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-019677c7-6c34-439b-ab18-faf409c4d62c req-d1c556b4-6359-4f6e-b57d-7ce4a9afe516 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:45.846897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-019677c7-6c34-439b-ab18-faf409c4d62c req-d1c556b4-6359-4f6e-b57d-7ce4a9afe516 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:45.861509 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-019677c7-6c34-439b-ab18-faf409c4d62c req-d1c556b4-6359-4f6e-b57d-7ce4a9afe516 service nova] Creating event network-vif-plugged:8a3d07b4-a7f1-4ea6-8111-7fd733d41669 for instance 50d5077f-492b-4ca9-a9e4-221b57535e1e on n-h1-854119-9 Aug 29 05:26:45.866977 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-019677c7-6c34-439b-ab18-faf409c4d62c req-d1c556b4-6359-4f6e-b57d-7ce4a9afe516 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038489 Aug 29 05:26:45.868952 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3260/6512] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:46.362398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:46.363305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:46.372526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:46.373272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:46.373923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:46.374859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:46.375463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:46.376032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:46.549715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:46.557607 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17f97692-fc6d-491e-a47c-59774f2dd25c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1315 microversion: 2.1 time: 0.199569 Aug 29 05:26:46.558180 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3253/6513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:46 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:46.570384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-17cb53a6-e744-4d48-acf6-e8aa506771be tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab93cddc0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:46.630075 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-17cb53a6-e744-4d48-acf6-e8aa506771be tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527" status: 200 len: 344 microversion: 2.1 time: 0.064163 Aug 29 05:26:46.639402 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3261/6514] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:26:46 2022] GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:47.581835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:47.583368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:47.592072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:47.592855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:47.593713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:47.594732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:47.595638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:47.596386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:47.649800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-499f5a88-b0bb-41ad-b171-13d223bf5c85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab814faf0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:47.705956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-499f5a88-b0bb-41ad-b171-13d223bf5c85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] HTTP exception thrown: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-499f5a88-b0bb-41ad-b171-13d223bf5c85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Request method failure captured: Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 HTTP/1.1 Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE4KZYAcTJTeXwJrZ7HLeT8cRxkfxR6tO3mZJrBi7cgbayNrN2RWjN2OrRoBSfSc_gZCie-GZhfmqDm9SZY_W7dHBY4ILziJnKg3leVwopTY_XTvwxBV32YQ1sl1tOPr6gxXyz_CAk7XwBjlpPtBEDlCy5XyENHHkW9jBIwVOLoCHeU Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: cf2166a96a954eacb59bfeab4f4ca49b Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf2166a96a954eacb59bfeab4f4ca49b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: cf2166a96a954eacb59bfeab4f4ca49b Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesSnapshotsTestJSON-1652469595-project Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 39b01f04fb1144aab34fde3b0abda3b2 Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1652469595-project Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: exception: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a7b51d0c-35bf-4ef9-93b7-bb807085a527'} Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. (HTTP 404) (Request-ID: req-c549a157-1f4a-4144-80f1-9ad120071d2c) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 05:26:47.713399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.716891 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.723666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-499f5a88-b0bb-41ad-b171-13d223bf5c85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Returning 404 to user: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:47.724851 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-499f5a88-b0bb-41ad-b171-13d223bf5c85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527" status: 404 len: 109 microversion: 2.1 time: 0.083854 Aug 29 05:26:47.725621 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3262/6515] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:26:47 2022] GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:26:47.737882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9605b73-3153-40df-bc72-769e3dab1d85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab81d5040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:47.787297 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d9605b73-3153-40df-bc72-769e3dab1d85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] HTTP exception thrown: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9605b73-3153-40df-bc72-769e3dab1d85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Request method failure captured: Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 HTTP/1.1 Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE4KZYAcTJTeXwJrZ7HLeT8cRxkfxR6tO3mZJrBi7cgbayNrN2RWjN2OrRoBSfSc_gZCie-GZhfmqDm9SZY_W7dHBY4ILziJnKg3leVwopTY_XTvwxBV32YQ1sl1tOPr6gxXyz_CAk7XwBjlpPtBEDlCy5XyENHHkW9jBIwVOLoCHeU Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: cf2166a96a954eacb59bfeab4f4ca49b Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf2166a96a954eacb59bfeab4f4ca49b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: cf2166a96a954eacb59bfeab4f4ca49b Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesSnapshotsTestJSON-1652469595-project Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 39b01f04fb1144aab34fde3b0abda3b2 Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1652469595-project Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: exception: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a7b51d0c-35bf-4ef9-93b7-bb807085a527'} Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. (HTTP 404) (Request-ID: req-04bbe422-add6-4877-8d63-f1daeb0fe1ec) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 05:26:47.789352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9605b73-3153-40df-bc72-769e3dab1d85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Returning 404 to user: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d9605b73-3153-40df-bc72-769e3dab1d85 tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527" status: 404 len: 109 microversion: 2.1 time: 0.058301 Aug 29 05:26:47.794280 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3263/6516] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:26:47 2022] DELETE /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:47.798482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:47.802554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-91a8956d-a835-4cf9-99cc-6cc1deb303cc tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Calling method '.version_select at 0x7f1ab81d51f0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:47.806986 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-889af4a6-00c7-4e5c-9cb8-b6a5a480f275 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1502 microversion: 2.1 time: 0.229548 Aug 29 05:26:47.807861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3254/6517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:47 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:47.827292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:47.828111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:47.836544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:47.837211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:47.837810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:47.838663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:47.839260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:47.839862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:47.859780 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-91a8956d-a835-4cf9-99cc-6cc1deb303cc tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] HTTP exception thrown: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-91a8956d-a835-4cf9-99cc-6cc1deb303cc tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Request method failure captured: Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 HTTP/1.1 Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE4KZYAcTJTeXwJrZ7HLeT8cRxkfxR6tO3mZJrBi7cgbayNrN2RWjN2OrRoBSfSc_gZCie-GZhfmqDm9SZY_W7dHBY4ILziJnKg3leVwopTY_XTvwxBV32YQ1sl1tOPr6gxXyz_CAk7XwBjlpPtBEDlCy5XyENHHkW9jBIwVOLoCHeU Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: cf2166a96a954eacb59bfeab4f4ca49b Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf2166a96a954eacb59bfeab4f4ca49b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf2166a96a954eacb59bfeab4f4ca49b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: cf2166a96a954eacb59bfeab4f4ca49b Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1652469595 Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesSnapshotsTestJSON-1652469595-project Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 39b01f04fb1144aab34fde3b0abda3b2 Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1652469595-project Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: exception: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a7b51d0c-35bf-4ef9-93b7-bb807085a527'} Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. (HTTP 404) (Request-ID: req-e9c73185-18d9-4daf-9d7e-030dcd5de7f2) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 05:26:47.861941 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. Aug 29 05:26:47.866025 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:26:47.868409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-91a8956d-a835-4cf9-99cc-6cc1deb303cc tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] Returning 404 to user: Volume a7b51d0c-35bf-4ef9-93b7-bb807085a527 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:47.869242 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-91a8956d-a835-4cf9-99cc-6cc1deb303cc tempest-VolumesSnapshotsTestJSON-1652469595 tempest-VolumesSnapshotsTestJSON-1652469595-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527" status: 404 len: 109 microversion: 2.1 time: 0.071247 Aug 29 05:26:47.869916 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3264/6518] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:26:47 2022] GET /compute/v2.1/os-volumes/a7b51d0c-35bf-4ef9-93b7-bb807085a527 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:26:47.889931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2e8d2566-e0b1-4e53-8148-3d7cc2231bfd req-0bfde18d-b897-4698-a2d2-dd5b1e907a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca", "name": "network-vif-plugged", "status": "completed", "tag": "a0f9a947-6e74-4580-a86c-4888faa4e145"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:47.909365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2e8d2566-e0b1-4e53-8148-3d7cc2231bfd req-0bfde18d-b897-4698-a2d2-dd5b1e907a8d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:47.912794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2e8d2566-e0b1-4e53-8148-3d7cc2231bfd req-0bfde18d-b897-4698-a2d2-dd5b1e907a8d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:47.913365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2e8d2566-e0b1-4e53-8148-3d7cc2231bfd req-0bfde18d-b897-4698-a2d2-dd5b1e907a8d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:47.951946 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2e8d2566-e0b1-4e53-8148-3d7cc2231bfd req-0bfde18d-b897-4698-a2d2-dd5b1e907a8d service nova] Creating event network-vif-plugged:a0f9a947-6e74-4580-a86c-4888faa4e145 for instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca on n-h1-854119-9 Aug 29 05:26:47.958002 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2e8d2566-e0b1-4e53-8148-3d7cc2231bfd req-0bfde18d-b897-4698-a2d2-dd5b1e907a8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071787 Aug 29 05:26:47.962032 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3265/6519] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:48.076732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:48.087416 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c732bca3-bcf4-468e-bb05-3dcf52bf8f23 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1502 microversion: 2.1 time: 0.263776 Aug 29 05:26:48.101523 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3255/6520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:47 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:48.109810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:48.110863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:48.122889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:48.124598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:48.125935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:48.127140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:48.129049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:48.131832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:48.178008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lazy-loading 'flavor' on Instance uuid 50d5077f-492b-4ca9-a9e4-221b57535e1e {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:26:48.302686 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b0736f2-a6b1-4957-9227-a8de961bb2c6 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "POST /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.197114 Aug 29 05:26:48.303993 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3266/6521] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:26:48 2022] POST /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:26:48.311645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:48.312430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:48.324172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:48.324671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:48.325115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:48.325823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:48.326272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:48.326692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:48.476991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:48.485449 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d31004a7-c5cc-4b54-9c71-1d591d5d40b3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1510 microversion: 2.1 time: 0.177638 Aug 29 05:26:48.486505 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3256/6522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:48 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:49.507606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:49.508381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:49.515806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:49.516335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:49.516757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:49.517609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:49.518210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:49.518783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:49.666101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:49.674367 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-652573df-f8fe-4eba-93e2-8d51cf412d7e tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1493 microversion: 2.1 time: 0.171883 Aug 29 05:26:49.674938 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3267/6523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:49 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1493 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:49.694904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60c6c906-9758-487a-86c2-37c5daf8e938 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:49.696015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-60c6c906-9758-487a-86c2-37c5daf8e938 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:49.700185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:49.704813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60c6c906-9758-487a-86c2-37c5daf8e938 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:49.705478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60c6c906-9758-487a-86c2-37c5daf8e938 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:49.706060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60c6c906-9758-487a-86c2-37c5daf8e938 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:49.706906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60c6c906-9758-487a-86c2-37c5daf8e938 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:49.707519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60c6c906-9758-487a-86c2-37c5daf8e938 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:49.707977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60c6c906-9758-487a-86c2-37c5daf8e938 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:49.779246 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60c6c906-9758-487a-86c2-37c5daf8e938 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "POST /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.088363 Aug 29 05:26:49.780160 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3257/6524] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:26:49 2022] POST /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:26:49.788797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:49.789611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:49.797412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:49.797963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:49.798458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:49.799256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:49.799762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:49.800346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:49.824320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:50.074596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:50.085285 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a7d8775a-1cb9-401c-a222-4c17817d43fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1499 microversion: 2.1 time: 0.300261 Aug 29 05:26:50.086418 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3268/6525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:49 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1499 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:51.108788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:51.110288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:51.117530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:51.118308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:51.118943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:51.119850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:51.120437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:51.121242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:51.296371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:51.306463 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b763f357-6bc8-4e6c-b13f-676cd7b38c4b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1499 microversion: 2.1 time: 0.203112 Aug 29 05:26:51.307834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3258/6526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:51 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1499 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:52.330007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:52.331393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:52.335292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:52.343660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:52.344355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:52.345040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:52.345855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:52.346487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:52.347086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:52.520046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:52.529468 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae05528f-8a4e-41f1-8ae9-321430985618 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1502 microversion: 2.1 time: 0.203429 Aug 29 05:26:52.530061 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3269/6527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:52 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:52.551811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:52.552494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:52.560471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:52.561315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:52.562081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:52.562949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:52.563648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:52.564809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:52.594269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lazy-loading 'flavor' on Instance uuid 50d5077f-492b-4ca9-a9e4-221b57535e1e {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:26:52.599491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:26:52.714293 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1fdd7cbf-49d9-4cec-a908-f0458205aa02 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "POST /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.166181 Aug 29 05:26:52.725173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:52.726382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:52.730994 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3259/6528] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:26:52 2022] POST /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:26:52.734852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:52.735602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:52.736140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:52.737854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:52.738587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:52.739234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:52.914189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:52.926291 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d3c981a-5a37-41eb-b5a0-6b75d26eb226 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1510 microversion: 2.1 time: 0.204884 Aug 29 05:26:52.936956 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3270/6529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:52 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:26:53.868605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2cbbee3-ece0-4b66-9697-6221749e4494"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:53.871076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:53.878192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:53.878894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:53.879475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:53.880367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:53.880996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:53.881682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:53.951412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:53.953163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:53.963522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:53.971302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:53.971931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:53.972843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:53.973440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:53.974034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:54.036298 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Invalid volume: volume c2cbbee3-ece0-4b66-9697-6221749e4494 is already attached to instances: daaf5180-0cbc-4564-807b-563d307e99d7 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments HTTP/1.1 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 74 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: {"volumeAttachment": {"volumeId": "c2cbbee3-ece0-4b66-9697-6221749e4494"}} Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid volume: volume c2cbbee3-ece0-4b66-9697-6221749e4494 is already attached to instances: daaf5180-0cbc-4564-807b-563d307e99d7 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': 'daaf5180-0cbc-4564-807b-563d307e99d7', 'body': {'volumeAttachment': {'volumeId': 'c2cbbee3-ece0-4b66-9697-6221749e4494'}}} Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c2cbbee3-ece0-4b66-9697-6221749e4494 is already attached to instances: daaf5180-0cbc-4564-807b-563d307e99d7 Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:26:54.038273 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c2cbbee3-ece0-4b66-9697-6221749e4494 is already attached to instances: daaf5180-0cbc-4564-807b-563d307e99d7 Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c2cbbee3-ece0-4b66-9697-6221749e4494 is already attached to instances: daaf5180-0cbc-4564-807b-563d307e99d7 Aug 29 05:26:54.042463 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:26:54.044382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 400 to user: Invalid volume: volume c2cbbee3-ece0-4b66-9697-6221749e4494 is already attached to instances: daaf5180-0cbc-4564-807b-563d307e99d7 {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:26:54.045552 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f1103a7b-e9aa-4515-947c-b656975d9ad5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.182567 Aug 29 05:26:54.046631 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3260/6530] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:26:53 2022] POST /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments => generated 174 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:26:54.165269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:54.165759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:54.177889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:54.179477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:54.180027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:54.180647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:54.181529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:54.182167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:54.182768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:54.188323 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9646b959-52ac-4f89-853e-8077efa9532c tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1493 microversion: 2.1 time: 0.241813 Aug 29 05:26:54.188918 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3271/6531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:53 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1493 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:54.216973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eaa7f1cd-00b2-4a9d-997d-a0206d836455 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:26:54.217985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eaa7f1cd-00b2-4a9d-997d-a0206d836455 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:54.224888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa7f1cd-00b2-4a9d-997d-a0206d836455 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:54.225698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa7f1cd-00b2-4a9d-997d-a0206d836455 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:54.226306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa7f1cd-00b2-4a9d-997d-a0206d836455 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:54.227196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa7f1cd-00b2-4a9d-997d-a0206d836455 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:54.227819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa7f1cd-00b2-4a9d-997d-a0206d836455 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:54.228771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa7f1cd-00b2-4a9d-997d-a0206d836455 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:54.285818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lazy-loading 'services' on Instance uuid daaf5180-0cbc-4564-807b-563d307e99d7 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:26:54.334598 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eaa7f1cd-00b2-4a9d-997d-a0206d836455 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "POST /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.121433 Aug 29 05:26:54.338551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3272/6532] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:26:54 2022] POST /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:26:54.360409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:54.361413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:54.368575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:54.369067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:54.369498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:54.370521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:54.371244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:54.371676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:54.384909 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a4c14aba-fa11-4c95-b15e-89bd0356ce62 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments/c2cbbee3-ece0-4b66-9697-6221749e4494" status: 202 len: 0 microversion: 2.1 time: 0.223178 Aug 29 05:26:54.386833 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3261/6533] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:26:54 2022] DELETE /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments/c2cbbee3-ece0-4b66-9697-6221749e4494 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:26:54.412619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aca60173-2991-440f-bb33-e946ba0ffddc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:54.416440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aca60173-2991-440f-bb33-e946ba0ffddc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:54.441731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aca60173-2991-440f-bb33-e946ba0ffddc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:54.444510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aca60173-2991-440f-bb33-e946ba0ffddc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:54.453465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aca60173-2991-440f-bb33-e946ba0ffddc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:54.456595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aca60173-2991-440f-bb33-e946ba0ffddc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:54.457169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aca60173-2991-440f-bb33-e946ba0ffddc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:54.457706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aca60173-2991-440f-bb33-e946ba0ffddc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:54.492792 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aca60173-2991-440f-bb33-e946ba0ffddc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088887 Aug 29 05:26:54.493797 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3262/6534] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:26:54 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:26:54.635296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:54.643370 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-33cac89e-c9b5-4d1d-9c3f-13f85435b540 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1499 microversion: 2.1 time: 0.287833 Aug 29 05:26:54.644495 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3273/6535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:54 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1499 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:55.509051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-80c52b72-b35f-44fd-9dd8-6992d33c4a14 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:55.512721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-80c52b72-b35f-44fd-9dd8-6992d33c4a14 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:55.533802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80c52b72-b35f-44fd-9dd8-6992d33c4a14 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:55.534293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80c52b72-b35f-44fd-9dd8-6992d33c4a14 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:55.534727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80c52b72-b35f-44fd-9dd8-6992d33c4a14 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:55.540945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80c52b72-b35f-44fd-9dd8-6992d33c4a14 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:55.541456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80c52b72-b35f-44fd-9dd8-6992d33c4a14 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:55.541888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-80c52b72-b35f-44fd-9dd8-6992d33c4a14 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:55.610799 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-80c52b72-b35f-44fd-9dd8-6992d33c4a14 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109216 Aug 29 05:26:55.622418 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3263/6536] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:26:55 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:55.665515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:55.667064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:55.674613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:55.675386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:55.676012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:55.676912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:55.677853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:55.678460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:55.881287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:55.902658 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-24d8c97e-b771-456f-b3b5-47ce90cc3dd3 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1499 microversion: 2.1 time: 0.242125 Aug 29 05:26:55.903347 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3274/6537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:55 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1499 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:56.632931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5e07f88-2793-47bf-9f87-eb5d04406a9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:56.634325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a5e07f88-2793-47bf-9f87-eb5d04406a9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:56.649017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5e07f88-2793-47bf-9f87-eb5d04406a9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:56.649510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5e07f88-2793-47bf-9f87-eb5d04406a9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:56.649941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5e07f88-2793-47bf-9f87-eb5d04406a9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:56.650646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5e07f88-2793-47bf-9f87-eb5d04406a9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:56.651094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5e07f88-2793-47bf-9f87-eb5d04406a9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:56.651517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5e07f88-2793-47bf-9f87-eb5d04406a9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:56.739748 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a5e07f88-2793-47bf-9f87-eb5d04406a9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113471 Aug 29 05:26:56.757114 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3264/6538] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:26:56 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:56.923849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:56.924490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:56.934305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:56.934789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:56.935228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:56.938714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:56.939187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:56.939621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:57.185496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:57.194699 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28b386bd-4204-476c-9402-59b060b1aa20 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1502 microversion: 2.1 time: 0.274532 Aug 29 05:26:57.195889 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3275/6539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:56 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1502 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:57.215991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:57.217090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:57.225077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:57.225700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:57.226314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:57.227197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:57.227664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:57.228287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:57.258446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:26:57.424054 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e6bc3e0e-12ec-47f5-be40-f8e97ec158e8 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "DELETE /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 204 len: 0 microversion: 2.1 time: 0.211818 Aug 29 05:26:57.424693 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3265/6540] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:26:57 2022] DELETE /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:26:57.442036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:57.443458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:57.461981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:57.464484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:57.465123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:57.465863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:57.466328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:57.466761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:57.687010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:57.696559 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9fbceb4-b31e-4fa1-ae51-64fd6ea20347 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1508 microversion: 2.1 time: 0.263919 Aug 29 05:26:57.697969 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3276/6541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:57 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:57.754250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-062aa246-7e17-46e2-8a48-66abbaec16cd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:57.757370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-062aa246-7e17-46e2-8a48-66abbaec16cd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:57.779999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-062aa246-7e17-46e2-8a48-66abbaec16cd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:57.780868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-062aa246-7e17-46e2-8a48-66abbaec16cd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:57.782073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-062aa246-7e17-46e2-8a48-66abbaec16cd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:57.783153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-062aa246-7e17-46e2-8a48-66abbaec16cd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:57.783702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-062aa246-7e17-46e2-8a48-66abbaec16cd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:57.784249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-062aa246-7e17-46e2-8a48-66abbaec16cd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:57.836599 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-062aa246-7e17-46e2-8a48-66abbaec16cd tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086876 Aug 29 05:26:57.841907 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3266/6542] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:26:57 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:58.717969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:58.719261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:58.733053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:58.733769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:58.736074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:58.737176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:58.737894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:58.738829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:58.851565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-99c070bd-62b6-47f0-a73d-f975a79c2bba tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:58.854051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-99c070bd-62b6-47f0-a73d-f975a79c2bba tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:58.873868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99c070bd-62b6-47f0-a73d-f975a79c2bba tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:58.874642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99c070bd-62b6-47f0-a73d-f975a79c2bba tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:58.875087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99c070bd-62b6-47f0-a73d-f975a79c2bba tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:58.875818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99c070bd-62b6-47f0-a73d-f975a79c2bba tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:58.876295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99c070bd-62b6-47f0-a73d-f975a79c2bba tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:26:58.877116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-99c070bd-62b6-47f0-a73d-f975a79c2bba tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:26:58.962228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-99c070bd-62b6-47f0-a73d-f975a79c2bba tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116403 Aug 29 05:26:58.964070 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3267/6543] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:26:58 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:26:59.003302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:26:59.011818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-922a5ae0-dc78-461e-be9c-bbfd9cd4a34b tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1508 microversion: 2.1 time: 0.297944 Aug 29 05:26:59.025835 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3277/6544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:26:58 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:26:59.975750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8ca5147-2fa0-40c6-8ec9-7036933af7ec tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:26:59.978737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d8ca5147-2fa0-40c6-8ec9-7036933af7ec tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:26:59.998565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8ca5147-2fa0-40c6-8ec9-7036933af7ec tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:26:59.999415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8ca5147-2fa0-40c6-8ec9-7036933af7ec tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:00.000105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8ca5147-2fa0-40c6-8ec9-7036933af7ec tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:00.003078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8ca5147-2fa0-40c6-8ec9-7036933af7ec tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:00.004259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8ca5147-2fa0-40c6-8ec9-7036933af7ec tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:00.005193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8ca5147-2fa0-40c6-8ec9-7036933af7ec tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:00.034696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:00.035302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:00.052082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:00.052881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:00.053459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:00.054492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:00.055076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:00.055622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:00.083948 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d8ca5147-2fa0-40c6-8ec9-7036933af7ec tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112748 Aug 29 05:27:00.087011 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3268/6545] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:26:59 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:00.183739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27dd4a7d4ca4eb0b54dc75ea38ac729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fbe404e5b647f18629a8b745c37bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:00.196614 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b740999-d413-4bd0-a44a-10e8d34c1bf1 tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 200 len: 1466 microversion: 2.1 time: 0.166680 Aug 29 05:27:00.197852 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3278/6546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:00 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 1466 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:00.285691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c91b9a1a-d1e6-42ec-9a84-a634df10784f req-4d390eaa-c0c0-49af-9c61-ed5646a1d449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d5077f-492b-4ca9-a9e4-221b57535e1e", "name": "network-vif-deleted", "tag": "8a3d07b4-a7f1-4ea6-8111-7fd733d41669"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:00.296902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c91b9a1a-d1e6-42ec-9a84-a634df10784f req-4d390eaa-c0c0-49af-9c61-ed5646a1d449 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:00.297621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c91b9a1a-d1e6-42ec-9a84-a634df10784f req-4d390eaa-c0c0-49af-9c61-ed5646a1d449 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:00.298318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c91b9a1a-d1e6-42ec-9a84-a634df10784f req-4d390eaa-c0c0-49af-9c61-ed5646a1d449 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:00.328725 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c91b9a1a-d1e6-42ec-9a84-a634df10784f req-4d390eaa-c0c0-49af-9c61-ed5646a1d449 service nova] Creating event network-vif-deleted:8a3d07b4-a7f1-4ea6-8111-7fd733d41669 for instance 50d5077f-492b-4ca9-a9e4-221b57535e1e on n-h1-854119-9 Aug 29 05:27:00.335839 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c91b9a1a-d1e6-42ec-9a84-a634df10784f req-4d390eaa-c0c0-49af-9c61-ed5646a1d449 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053957 Aug 29 05:27:00.337298 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3269/6547] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:01.101029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-144bbe12-d42f-4bd5-8e1e-e422aacaf903 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:01.103217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-144bbe12-d42f-4bd5-8e1e-e422aacaf903 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:01.117572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144bbe12-d42f-4bd5-8e1e-e422aacaf903 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:01.118307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144bbe12-d42f-4bd5-8e1e-e422aacaf903 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:01.119004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144bbe12-d42f-4bd5-8e1e-e422aacaf903 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:01.121752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144bbe12-d42f-4bd5-8e1e-e422aacaf903 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:01.122778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144bbe12-d42f-4bd5-8e1e-e422aacaf903 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:01.123340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144bbe12-d42f-4bd5-8e1e-e422aacaf903 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:01.158776 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-144bbe12-d42f-4bd5-8e1e-e422aacaf903 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064260 Aug 29 05:27:01.164708 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3279/6548] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:27:01 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:27:01.235676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:01.237421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] [instance: 50d5077f-492b-4ca9-a9e4-221b57535e1e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:01.241321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:01.242917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:01.249961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:01.250512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:01.251010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:01.251767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:01.252307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:01.252815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:01.253130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:01.254515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:01.255935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:01.259019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:01.261352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:01.261868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:01.281740 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] HTTP exception thrown: Instance 50d5077f-492b-4ca9-a9e4-221b57535e1e could not be found. Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Request method failure captured: Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e HTTP/1.1 Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE4Byt5R5kJ1OAe3nBnwreiYc5n8CE14sg3K1K_ExJh3XPLLFEFcWOTE3Tbq0V3kE4axVmNn0cBswelHQ4-Ceoz3GiC4HogV7xTVunnoB3szgoq3KfdqoG8ACBR9zWK6LHjZaHstVTd103A7ZuxqxvIcK0wdbFasfmyn6rwnhteUkBo Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: c0fbe404e5b647f18629a8b745c37bef Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestServerAdvancedOps-1663580063 Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0fbe404e5b647f18629a8b745c37bef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c0fbe404e5b647f18629a8b745c37bef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c0fbe404e5b647f18629a8b745c37bef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0fbe404e5b647f18629a8b745c37bef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestServerAdvancedOps-1663580063 Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: c0fbe404e5b647f18629a8b745c37bef Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestServerAdvancedOps-1663580063 Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestServerAdvancedOps-1663580063-project Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: f27dd4a7d4ca4eb0b54dc75ea38ac729 Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestServerAdvancedOps-1663580063-project Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 50d5077f-492b-4ca9-a9e4-221b57535e1e could not be found. Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '50d5077f-492b-4ca9-a9e4-221b57535e1e'} Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d5077f-492b-4ca9-a9e4-221b57535e1e could not be found. Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d5077f-492b-4ca9-a9e4-221b57535e1e could not be found. Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:27:01.284384 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:27:01.287875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:27:01.287875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:27:01.287875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:27:01.287875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:27:01.287875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:27:01.287875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d5077f-492b-4ca9-a9e4-221b57535e1e could not be found. Aug 29 05:27:01.287875 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:27:01.289034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:27:01.291844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] Returning 404 to user: Instance 50d5077f-492b-4ca9-a9e4-221b57535e1e could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:27:01.296399 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-af1b8f71-7992-467a-87f8-435a5a4a59fa tempest-TestServerAdvancedOps-1663580063 tempest-TestServerAdvancedOps-1663580063-project] 10.222.0.20 "GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e" status: 404 len: 111 microversion: 2.1 time: 0.075474 Aug 29 05:27:01.297087 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3270/6549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:01 2022] GET /compute/v2.1/servers/50d5077f-492b-4ca9-a9e4-221b57535e1e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:27:01.389766 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-604e8727-e08a-461c-bac1-2ddea391bbfe tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 204 len: 0 microversion: 2.1 time: 0.153044 Aug 29 05:27:01.394071 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3280/6550] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:27:01 2022] DELETE /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:27:01.400511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:01.401436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:01.412393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:01.413809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:01.414496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:01.415975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:01.416870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:01.417590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:01.711934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:01.732555 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60e0393c-185d-4fd4-a2d1-a8afcc95e31f tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1681 microversion: 2.1 time: 0.336560 Aug 29 05:27:01.733145 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3271/6551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:01 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1681 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:27:02.756869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:02.757559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:02.769634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:02.770125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:02.770561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:02.771267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:02.771721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:02.772209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:03.044218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:03.056022 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-278b09e9-d210-4e07-95e9-da8f51f78b4e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1681 microversion: 2.1 time: 0.303159 Aug 29 05:27:03.058527 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3281/6552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:02 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1681 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:04.079170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:04.079768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:04.094583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:04.095117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:04.095626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:04.096382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:04.096839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:04.097261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:04.220517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:04.230391 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-da19d470-3e44-4a7c-b4c0-250c44277225 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1614 microversion: 2.1 time: 0.155004 Aug 29 05:27:04.233298 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3272/6553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:04 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1614 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:04.517008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1bf29482-a5d1-4a92-8edf-e89463a3800c req-75538b72-28a7-4e95-a38c-b52e9d67e528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daaf5180-0cbc-4564-807b-563d307e99d7", "name": "network-vif-deleted", "tag": "104c6839-eca7-49c4-8542-1e54b0d5bfcd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:04.540351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1bf29482-a5d1-4a92-8edf-e89463a3800c req-75538b72-28a7-4e95-a38c-b52e9d67e528 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:04.541713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1bf29482-a5d1-4a92-8edf-e89463a3800c req-75538b72-28a7-4e95-a38c-b52e9d67e528 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:04.542525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1bf29482-a5d1-4a92-8edf-e89463a3800c req-75538b72-28a7-4e95-a38c-b52e9d67e528 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:04.607306 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1bf29482-a5d1-4a92-8edf-e89463a3800c req-75538b72-28a7-4e95-a38c-b52e9d67e528 service nova] Creating event network-vif-deleted:104c6839-eca7-49c4-8542-1e54b0d5bfcd for instance daaf5180-0cbc-4564-807b-563d307e99d7 on n-h1-854119-9 Aug 29 05:27:04.627087 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-1bf29482-a5d1-4a92-8edf-e89463a3800c req-75538b72-28a7-4e95-a38c-b52e9d67e528 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115141 Aug 29 05:27:04.627779 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3282/6554] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:05.254504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:05.256260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:05.268717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:05.271049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:05.272801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:05.273874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:05.275220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:05.277288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:05.345724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:05.348189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:05.348819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:05.349437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lazy-loading 'fault' on Instance uuid daaf5180-0cbc-4564-807b-563d307e99d7 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:27:05.357114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:05.425922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:05.437155 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bce746b9-8016-428c-91df-494cf65cfffa tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 200 len: 1332 microversion: 2.1 time: 0.186925 Aug 29 05:27:05.438738 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3273/6555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:05 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 1332 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:06.466951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:06.474909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:06.494336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:06.494839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:06.495307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:06.498833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:06.499450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:06.499968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:06.513575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:06.530693 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 HTTP/1.1 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'daaf5180-0cbc-4564-807b-563d307e99d7'} Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:27:06.532601 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:06.536951 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:27:06.536951 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:27:06.536951 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:27:06.536951 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:27:06.536951 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:27:06.536951 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:27:06.536951 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:06.538141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:27:06.539448 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a10c257-5888-46dd-a4e1-037ccc6604c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 404 len: 111 microversion: 2.1 time: 0.079168 Aug 29 05:27:06.541232 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3283/6556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:06 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:27:06.552441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7a3095e-403a-4553-a21d-5cca33719b01 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '.version_select at 0x7f1ab8446ee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:06.598848 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7a3095e-403a-4553-a21d-5cca33719b01 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827143793" status: 202 len: 0 microversion: 2.1 time: 0.052823 Aug 29 05:27:06.600292 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3274/6557] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 05:27:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827143793 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:27:08.377489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11fb392e-cc3d-4582-a154-84e87f7b1109 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: .version_select at 0x7f1abd98b8b0>, body: {"keypair": {"name": "tempest-keypair-2024541327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynUWmCS4PckaZXA5TUJ3FllMJtnTSMKvhHAJXkiqPhEn3VM07qagh7VtuvcoEwQdO25sx7mnpo/jczlATp/ojUfPu+I728fItn10Y3Ir57eyERm65gW6hhmHe3pSmmXw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:08.407060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-11fb392e-cc3d-4582-a154-84e87f7b1109 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:27:08.415350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-11fb392e-cc3d-4582-a154-84e87f7b1109 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for user ca6430b480c54898b9ed01529f25049a and project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:27:08.464782 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11fb392e-cc3d-4582-a154-84e87f7b1109 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092478 Aug 29 05:27:08.465410 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3284/6558] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:27:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:27:11.309218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1539498409", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03e6ddac-5990-46d1-82b5-fc12cac2bd56"}], "security_groups": [{"name": "tempest-securitygroup--1013353040"}], "key_name": "tempest-keypair-2024541327", "user_data": "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:11.516929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] validate_networks() for [('03e6ddac-5990-46d1-82b5-fc12cac2bd56', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:27:12.173060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:27:12.173482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:27:12.174006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:27:12.174413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:27:12.174822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:27:12.187092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:12.188277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:12.188916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:12.190272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:12.190883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:12.191465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:12.216164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:27:12.222714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Getting quotas for user ca6430b480c54898b9ed01529f25049a and project 5039ad3dc0f947d68d7ff5b0724f5926. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:27:12.238355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:27:12.241133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:27:12.342741 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22751999-bb55-4aaf-9128-a745af0ac8b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.028461 Aug 29 05:27:12.342741 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3275/6559] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:27:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:27:12.348217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ddd5857a-e715-4856-901d-f29cdcefb59b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:12.349267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ddd5857a-e715-4856-901d-f29cdcefb59b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:12.520649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ddd5857a-e715-4856-901d-f29cdcefb59b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:12.550962 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ddd5857a-e715-4856-901d-f29cdcefb59b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1242 microversion: 2.1 time: 0.209211 Aug 29 05:27:12.557109 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3285/6560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:12 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:13.573152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-864115de-dce2-42b0-a03c-4de6c2658991 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:13.575890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-864115de-dce2-42b0-a03c-4de6c2658991 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:13.673038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-864115de-dce2-42b0-a03c-4de6c2658991 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:13.681935 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-864115de-dce2-42b0-a03c-4de6c2658991 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1242 microversion: 2.1 time: 0.114226 Aug 29 05:27:13.692319 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3276/6561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:13 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:14.706216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:14.713588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:14.746041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:14.748212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:14.748655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:14.749418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:14.749868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:14.754096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:14.988720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:14.999378 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-18187522-0e5f-45f5-84d0-47d5e993a97b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1302 microversion: 2.1 time: 0.297909 Aug 29 05:27:15.013557 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3286/6562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:14 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1302 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:16.029327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:16.029986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:16.062744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:16.063455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:16.064168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:16.090155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:16.092848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:16.093551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:16.254875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:16.267444 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-acfadcac-0a52-4ce0-8cfb-43672845d0c8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1300 microversion: 2.1 time: 0.250714 Aug 29 05:27:16.268697 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3277/6563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:16 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1300 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:17.289859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:17.291615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:17.319908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:17.321030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:17.324805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:17.329596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:17.330172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:17.330812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:17.649419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:17.679024 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a462a32a-d7ac-45ea-a2d1-3793ccd3ff09 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1368 microversion: 2.1 time: 0.393448 Aug 29 05:27:17.680595 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3287/6564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:17 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1368 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:18.703324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:18.703933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:18.714784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:18.716762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:18.717523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:18.724962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:18.725839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:18.726291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:19.088443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:19.098422 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2444679a-58b3-4cd4-8d99-709dddbeb4a4 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1368 microversion: 2.1 time: 0.398908 Aug 29 05:27:19.104233 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3278/6565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:18 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1368 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:20.120487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:20.122046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:20.131872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f822f684-f517-4876-adb6-c87de2df4133 req-42b8c0cd-8927-4f44-8f66-e3f2a6596fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5ca19b-3af5-4450-8826-7b31d6e8a098", "tag": "67810816-2417-4cb8-8d2b-96dd9fa06a7c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:20.146399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:20.156309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:20.157002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:20.157675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:20.162230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:20.163209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:20.163849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:20.168976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f822f684-f517-4876-adb6-c87de2df4133 req-42b8c0cd-8927-4f44-8f66-e3f2a6596fd1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:20.169544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f822f684-f517-4876-adb6-c87de2df4133 req-42b8c0cd-8927-4f44-8f66-e3f2a6596fd1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:20.170047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f822f684-f517-4876-adb6-c87de2df4133 req-42b8c0cd-8927-4f44-8f66-e3f2a6596fd1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:20.224163 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f822f684-f517-4876-adb6-c87de2df4133 req-42b8c0cd-8927-4f44-8f66-e3f2a6596fd1 service nova] Creating event network-changed:67810816-2417-4cb8-8d2b-96dd9fa06a7c for instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 on n-h2-854119-9 Aug 29 05:27:20.232306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f822f684-f517-4876-adb6-c87de2df4133 req-42b8c0cd-8927-4f44-8f66-e3f2a6596fd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111000 Aug 29 05:27:20.249611 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3279/6566] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:27:20.457590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:20.472749 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a7af962-a2b1-4111-ad3e-0bc58c2c94ed tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1368 microversion: 2.1 time: 0.357538 Aug 29 05:27:20.490288 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3288/6567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:20 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1368 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:21.514067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:21.514693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:21.518825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e07dd39-618a-47f4-a13b-af5cf0051a87 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:21.522633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e07dd39-618a-47f4-a13b-af5cf0051a87 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:21.532254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:21.534187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:21.534951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:21.538084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:21.539725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:21.540917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e07dd39-618a-47f4-a13b-af5cf0051a87 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:21.541498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:21.543176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e07dd39-618a-47f4-a13b-af5cf0051a87 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:21.544085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e07dd39-618a-47f4-a13b-af5cf0051a87 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:21.546174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e07dd39-618a-47f4-a13b-af5cf0051a87 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:21.549849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e07dd39-618a-47f4-a13b-af5cf0051a87 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:21.549849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e07dd39-618a-47f4-a13b-af5cf0051a87 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:21.659576 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e07dd39-618a-47f4-a13b-af5cf0051a87 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "POST /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca/action" status: 200 len: 24569 microversion: 2.1 time: 0.152265 Aug 29 05:27:21.667946 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3280/6568] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:27:21 2022] POST /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca/action => generated 24569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 05:27:21.901797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:21.919378 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f864300c-a0b9-43da-87c3-01c0d2a61ba7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1368 microversion: 2.1 time: 0.412355 Aug 29 05:27:21.919984 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3289/6569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:21 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1368 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:22.947168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:22.947938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:22.955307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:22.961460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:22.961991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:22.964497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:22.965272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:22.969801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:22.970251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:23.677826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:23.890740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:23.905671 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-73afb6a7-7a4e-44a2-8732-acd38f895f5b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1368 microversion: 2.1 time: 0.969723 Aug 29 05:27:23.907861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3281/6570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:22 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1368 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:24.934886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:24.936730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:24.963613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:24.964851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:24.967407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:24.967407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:24.967866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:24.968987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:24.969648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:24.970063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:25.477015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:25.492689 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-875b3cee-d8a3-42b5-ac96-072a75f40add tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1368 microversion: 2.1 time: 0.562991 Aug 29 05:27:25.497668 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3290/6571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:24 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1368 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:25.853009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-157c4f5a-4d0a-4388-a660-2746ccac3aff tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:25.855305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-157c4f5a-4d0a-4388-a660-2746ccac3aff tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:25.856051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-157c4f5a-4d0a-4388-a660-2746ccac3aff tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:25.857090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-157c4f5a-4d0a-4388-a660-2746ccac3aff tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:25.858045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-157c4f5a-4d0a-4388-a660-2746ccac3aff tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:25.858615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-157c4f5a-4d0a-4388-a660-2746ccac3aff tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:25.859100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-157c4f5a-4d0a-4388-a660-2746ccac3aff tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:25.891110 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-157c4f5a-4d0a-4388-a660-2746ccac3aff tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.317372 Aug 29 05:27:25.913900 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3282/6572] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Aug 29 05:27:25 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:26.062208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1744966197", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "availability_zone": "nova:n-h2-854119-9", "networks": [{"uuid": "ef576773-79c6-4399-b41f-00123cc36945"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:26.135966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] validate_networks() for [('ef576773-79c6-4399-b41f-00123cc36945', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:27:26.523953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:26.524777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:26.532284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:26.533279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:26.534029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:26.535998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:26.537402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:26.538473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:27.378153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:27:27.379171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:27:27.379801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:27:27.380393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:27:27.381060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:27:27.396084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:27.398097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:27.398695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:27.403410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:27.404037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:27.404648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:27.438083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:27.443066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Getting quotas for project c9677cdd23e5409f9143d7e9ff5708ca. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:27:27.446882 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-094691f5-46fb-413d-b27d-c0dd708afcc0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1368 microversion: 2.1 time: 0.929999 Aug 29 05:27:27.450878 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3283/6573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:26 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1368 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:27.464524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Getting quotas for user dabfbb3f9b7b4d57b2e03de53752f014 and project c9677cdd23e5409f9143d7e9ff5708ca. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:27:27.472064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1d8e30ef-22a1-481f-88e6-74ff9f3a0ccf req-cf0cc3ed-4911-421c-80a8-70d76540258b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5ca19b-3af5-4450-8826-7b31d6e8a098", "name": "network-vif-plugged", "status": "completed", "tag": "67810816-2417-4cb8-8d2b-96dd9fa06a7c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:27.495143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1d8e30ef-22a1-481f-88e6-74ff9f3a0ccf req-cf0cc3ed-4911-421c-80a8-70d76540258b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:27.495632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1d8e30ef-22a1-481f-88e6-74ff9f3a0ccf req-cf0cc3ed-4911-421c-80a8-70d76540258b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:27.496059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1d8e30ef-22a1-481f-88e6-74ff9f3a0ccf req-cf0cc3ed-4911-421c-80a8-70d76540258b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:27.506796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:27:27.509828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:27:27.623475 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70852d72-b667-4210-be02-66724dafd2d8 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565521 Aug 29 05:27:27.624966 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3291/6574] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:27:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:27:27.639117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b888c29c-378a-488e-b5ef-d32e6e030066 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:27.640351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b888c29c-378a-488e-b5ef-d32e6e030066 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:27.849693 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b888c29c-378a-488e-b5ef-d32e6e030066 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1329 microversion: 2.1 time: 0.217217 Aug 29 05:27:27.853401 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3292/6575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:27 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1329 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:28.083417 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1d8e30ef-22a1-481f-88e6-74ff9f3a0ccf req-cf0cc3ed-4911-421c-80a8-70d76540258b service nova] Creating event network-vif-plugged:67810816-2417-4cb8-8d2b-96dd9fa06a7c for instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 on n-h2-854119-9 Aug 29 05:27:28.090863 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1d8e30ef-22a1-481f-88e6-74ff9f3a0ccf req-cf0cc3ed-4911-421c-80a8-70d76540258b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.638772 Aug 29 05:27:28.091551 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3284/6576] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:28.467107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:28.467720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:28.477285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:28.481476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:28.482619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:28.483960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:28.486005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:28.487436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:28.841103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:28.853475 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55158212-5d39-4dce-bdfe-143f91f58879 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1368 microversion: 2.1 time: 0.390315 Aug 29 05:27:28.866373 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3293/6577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:28 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1368 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:28.871722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e4b21723-28ca-4bea-888d-5608081c4cf6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:28.872282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e4b21723-28ca-4bea-888d-5608081c4cf6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:28.881511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4b21723-28ca-4bea-888d-5608081c4cf6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:28.884306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4b21723-28ca-4bea-888d-5608081c4cf6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:28.884973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4b21723-28ca-4bea-888d-5608081c4cf6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:28.885978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4b21723-28ca-4bea-888d-5608081c4cf6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:28.896900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4b21723-28ca-4bea-888d-5608081c4cf6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:28.897652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e4b21723-28ca-4bea-888d-5608081c4cf6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:28.999338 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e4b21723-28ca-4bea-888d-5608081c4cf6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1346 microversion: 2.1 time: 0.131994 Aug 29 05:27:29.001244 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3285/6578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:28 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:29.874781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:29.875503 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:29.892313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:29.893227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:29.893973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:29.895051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:29.895736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:29.896482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:30.023002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-529162b7-bc08-448e-b1c2-38fac535f86f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:30.024202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-529162b7-bc08-448e-b1c2-38fac535f86f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:30.047203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529162b7-bc08-448e-b1c2-38fac535f86f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:30.051025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529162b7-bc08-448e-b1c2-38fac535f86f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:30.051679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529162b7-bc08-448e-b1c2-38fac535f86f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:30.053154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529162b7-bc08-448e-b1c2-38fac535f86f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:30.053785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529162b7-bc08-448e-b1c2-38fac535f86f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:30.057391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-529162b7-bc08-448e-b1c2-38fac535f86f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:30.097314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:30.107914 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4089e9a-98c0-4ebf-b280-7712b2477e97 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1558 microversion: 2.1 time: 0.237613 Aug 29 05:27:30.109285 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3294/6579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:29 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:30.136234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-62dd2a41-ee71-4dda-b2d7-7959a3d632bb tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:30.136746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-62dd2a41-ee71-4dda-b2d7-7959a3d632bb tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:30.153086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62dd2a41-ee71-4dda-b2d7-7959a3d632bb tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:30.161035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62dd2a41-ee71-4dda-b2d7-7959a3d632bb tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:30.161553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62dd2a41-ee71-4dda-b2d7-7959a3d632bb tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:30.169952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62dd2a41-ee71-4dda-b2d7-7959a3d632bb tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:30.170463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62dd2a41-ee71-4dda-b2d7-7959a3d632bb tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:30.170893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62dd2a41-ee71-4dda-b2d7-7959a3d632bb tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:30.308217 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-529162b7-bc08-448e-b1c2-38fac535f86f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1416 microversion: 2.1 time: 0.290452 Aug 29 05:27:30.311625 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3286/6580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:30 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1416 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:27:30.350954 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-62dd2a41-ee71-4dda-b2d7-7959a3d632bb tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.224648 Aug 29 05:27:30.352172 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3295/6581] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:27:30 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:31.341289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8089019-b512-4272-83e3-fb0062cab4b4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:31.341776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d8089019-b512-4272-83e3-fb0062cab4b4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:31.356843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8089019-b512-4272-83e3-fb0062cab4b4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:31.357356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8089019-b512-4272-83e3-fb0062cab4b4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:31.359715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8089019-b512-4272-83e3-fb0062cab4b4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:31.360512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8089019-b512-4272-83e3-fb0062cab4b4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:31.360981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8089019-b512-4272-83e3-fb0062cab4b4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:31.367963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8089019-b512-4272-83e3-fb0062cab4b4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:31.535271 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d8089019-b512-4272-83e3-fb0062cab4b4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1422 microversion: 2.1 time: 0.199607 Aug 29 05:27:31.555614 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3287/6582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:31 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1422 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:32.151160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-22f4e297-c7af-493b-ba1a-306ca2c7b689 req-bc768856-7837-4eb5-a4df-fa938616461e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5ca19b-3af5-4450-8826-7b31d6e8a098", "tag": "67810816-2417-4cb8-8d2b-96dd9fa06a7c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:32.170923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-22f4e297-c7af-493b-ba1a-306ca2c7b689 req-bc768856-7837-4eb5-a4df-fa938616461e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:32.173766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-22f4e297-c7af-493b-ba1a-306ca2c7b689 req-bc768856-7837-4eb5-a4df-fa938616461e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:32.174383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-22f4e297-c7af-493b-ba1a-306ca2c7b689 req-bc768856-7837-4eb5-a4df-fa938616461e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:32.204432 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-22f4e297-c7af-493b-ba1a-306ca2c7b689 req-bc768856-7837-4eb5-a4df-fa938616461e service nova] Creating event network-changed:67810816-2417-4cb8-8d2b-96dd9fa06a7c for instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 on n-h2-854119-9 Aug 29 05:27:32.213359 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-22f4e297-c7af-493b-ba1a-306ca2c7b689 req-bc768856-7837-4eb5-a4df-fa938616461e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068843 Aug 29 05:27:32.214411 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3296/6583] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:32.577472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-513c364f-c425-487f-95d8-97602490b676 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:32.578692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-513c364f-c425-487f-95d8-97602490b676 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:32.586092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-513c364f-c425-487f-95d8-97602490b676 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:32.586910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-513c364f-c425-487f-95d8-97602490b676 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:32.587560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-513c364f-c425-487f-95d8-97602490b676 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:32.588537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-513c364f-c425-487f-95d8-97602490b676 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:32.589303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-513c364f-c425-487f-95d8-97602490b676 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:32.590092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-513c364f-c425-487f-95d8-97602490b676 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:32.898606 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-513c364f-c425-487f-95d8-97602490b676 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1464 microversion: 2.1 time: 0.326589 Aug 29 05:27:32.902598 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3288/6584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:32 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1464 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:27:33.929467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dc91de01-ec7d-4b41-98fc-bae2d685ec24 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:33.930251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dc91de01-ec7d-4b41-98fc-bae2d685ec24 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:33.944082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc91de01-ec7d-4b41-98fc-bae2d685ec24 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:33.944628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc91de01-ec7d-4b41-98fc-bae2d685ec24 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:33.948669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc91de01-ec7d-4b41-98fc-bae2d685ec24 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:33.949523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc91de01-ec7d-4b41-98fc-bae2d685ec24 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:33.950000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc91de01-ec7d-4b41-98fc-bae2d685ec24 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:33.950923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dc91de01-ec7d-4b41-98fc-bae2d685ec24 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:34.160210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dc91de01-ec7d-4b41-98fc-bae2d685ec24 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1464 microversion: 2.1 time: 0.239345 Aug 29 05:27:34.171157 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3297/6585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:33 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1464 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:34.502483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f1b695dd-438a-4257-a2bd-87935fc4d3f4 req-d29b0561-afd3-4d58-82cf-308f0808fc99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5020a18a-c5e5-4037-961b-8640fea1e9b6", "tag": "52864bcb-3295-44a8-8792-23cf258c5393"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:34.558368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f1b695dd-438a-4257-a2bd-87935fc4d3f4 req-d29b0561-afd3-4d58-82cf-308f0808fc99 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:34.565364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f1b695dd-438a-4257-a2bd-87935fc4d3f4 req-d29b0561-afd3-4d58-82cf-308f0808fc99 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:34.573086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f1b695dd-438a-4257-a2bd-87935fc4d3f4 req-d29b0561-afd3-4d58-82cf-308f0808fc99 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:34.607454 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f1b695dd-438a-4257-a2bd-87935fc4d3f4 req-d29b0561-afd3-4d58-82cf-308f0808fc99 service nova] Creating event network-changed:52864bcb-3295-44a8-8792-23cf258c5393 for instance 5020a18a-c5e5-4037-961b-8640fea1e9b6 on n-h2-854119-9 Aug 29 05:27:34.627573 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f1b695dd-438a-4257-a2bd-87935fc4d3f4 req-d29b0561-afd3-4d58-82cf-308f0808fc99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133171 Aug 29 05:27:34.628377 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3289/6586] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:35.186383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d69c7e76-7e5b-4025-a821-a1119197c4c5 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:35.187323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d69c7e76-7e5b-4025-a821-a1119197c4c5 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:35.209261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d69c7e76-7e5b-4025-a821-a1119197c4c5 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:35.209261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d69c7e76-7e5b-4025-a821-a1119197c4c5 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:35.209261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d69c7e76-7e5b-4025-a821-a1119197c4c5 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:35.209261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d69c7e76-7e5b-4025-a821-a1119197c4c5 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:35.209261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d69c7e76-7e5b-4025-a821-a1119197c4c5 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:35.209261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d69c7e76-7e5b-4025-a821-a1119197c4c5 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:35.439527 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d69c7e76-7e5b-4025-a821-a1119197c4c5 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1464 microversion: 2.1 time: 0.251770 Aug 29 05:27:35.442369 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3298/6587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:35 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:36.462696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8dc32b50-8d4c-4e49-8027-3431d34f5efb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:36.463913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8dc32b50-8d4c-4e49-8027-3431d34f5efb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:36.476768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:36.478571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc32b50-8d4c-4e49-8027-3431d34f5efb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:36.479118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc32b50-8d4c-4e49-8027-3431d34f5efb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:36.479557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc32b50-8d4c-4e49-8027-3431d34f5efb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:36.480344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc32b50-8d4c-4e49-8027-3431d34f5efb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:36.480890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc32b50-8d4c-4e49-8027-3431d34f5efb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:36.481275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dc32b50-8d4c-4e49-8027-3431d34f5efb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:36.498190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=66 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:36.719996 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8dc32b50-8d4c-4e49-8027-3431d34f5efb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1464 microversion: 2.1 time: 0.261992 Aug 29 05:27:36.725855 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3290/6588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:36 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1464 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:37.746317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-071a3ab3-15f7-4733-9324-32c53e8c187d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:37.747015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-071a3ab3-15f7-4733-9324-32c53e8c187d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:37.750068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:37.765483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-071a3ab3-15f7-4733-9324-32c53e8c187d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:37.774757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-071a3ab3-15f7-4733-9324-32c53e8c187d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:37.775519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-071a3ab3-15f7-4733-9324-32c53e8c187d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:37.777162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-071a3ab3-15f7-4733-9324-32c53e8c187d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:37.780639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-071a3ab3-15f7-4733-9324-32c53e8c187d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:37.784875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-071a3ab3-15f7-4733-9324-32c53e8c187d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:37.863493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:38.258929 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-071a3ab3-15f7-4733-9324-32c53e8c187d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1464 microversion: 2.1 time: 0.517030 Aug 29 05:27:38.259665 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3299/6589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:37 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1464 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:39.285367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-869403b4-a6b0-4314-969d-be69f36df327 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:39.286181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-869403b4-a6b0-4314-969d-be69f36df327 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:39.298526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-869403b4-a6b0-4314-969d-be69f36df327 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:39.299222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-869403b4-a6b0-4314-969d-be69f36df327 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:39.301043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-869403b4-a6b0-4314-969d-be69f36df327 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:39.302571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-869403b4-a6b0-4314-969d-be69f36df327 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:39.304450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-869403b4-a6b0-4314-969d-be69f36df327 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:39.304943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-869403b4-a6b0-4314-969d-be69f36df327 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:39.610900 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-869403b4-a6b0-4314-969d-be69f36df327 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1464 microversion: 2.1 time: 0.331677 Aug 29 05:27:39.619256 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3291/6590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:39 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:40.645856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5aa8f915-221c-42d6-b453-027e574807a3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:40.646486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5aa8f915-221c-42d6-b453-027e574807a3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:40.655183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5aa8f915-221c-42d6-b453-027e574807a3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:40.655674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5aa8f915-221c-42d6-b453-027e574807a3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:40.665933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5aa8f915-221c-42d6-b453-027e574807a3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:40.666952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5aa8f915-221c-42d6-b453-027e574807a3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:40.667572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5aa8f915-221c-42d6-b453-027e574807a3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:40.668300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5aa8f915-221c-42d6-b453-027e574807a3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:40.685099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=69 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:40.734258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d59dc1c2-c9a6-4d21-a1b5-39c70fbb8792 req-0907795a-3f31-4f4d-a9e0-a896e9ea5907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5020a18a-c5e5-4037-961b-8640fea1e9b6", "name": "network-vif-plugged", "status": "completed", "tag": "52864bcb-3295-44a8-8792-23cf258c5393"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:40.752577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d59dc1c2-c9a6-4d21-a1b5-39c70fbb8792 req-0907795a-3f31-4f4d-a9e0-a896e9ea5907 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:40.761261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d59dc1c2-c9a6-4d21-a1b5-39c70fbb8792 req-0907795a-3f31-4f4d-a9e0-a896e9ea5907 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:40.761957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d59dc1c2-c9a6-4d21-a1b5-39c70fbb8792 req-0907795a-3f31-4f4d-a9e0-a896e9ea5907 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:40.788340 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d59dc1c2-c9a6-4d21-a1b5-39c70fbb8792 req-0907795a-3f31-4f4d-a9e0-a896e9ea5907 service nova] Creating event network-vif-plugged:52864bcb-3295-44a8-8792-23cf258c5393 for instance 5020a18a-c5e5-4037-961b-8640fea1e9b6 on n-h2-854119-9 Aug 29 05:27:40.795864 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d59dc1c2-c9a6-4d21-a1b5-39c70fbb8792 req-0907795a-3f31-4f4d-a9e0-a896e9ea5907 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065595 Aug 29 05:27:40.797443 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3292/6591] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:41.023656 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5aa8f915-221c-42d6-b453-027e574807a3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1464 microversion: 2.1 time: 0.385046 Aug 29 05:27:41.024289 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3300/6592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:40 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1464 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:42.048047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-96280adf-ac8f-440a-af11-e0123cd642d3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:42.048938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-96280adf-ac8f-440a-af11-e0123cd642d3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:42.055889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96280adf-ac8f-440a-af11-e0123cd642d3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:42.056490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96280adf-ac8f-440a-af11-e0123cd642d3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:42.057050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96280adf-ac8f-440a-af11-e0123cd642d3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:42.057754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96280adf-ac8f-440a-af11-e0123cd642d3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:42.058189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96280adf-ac8f-440a-af11-e0123cd642d3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:42.058826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96280adf-ac8f-440a-af11-e0123cd642d3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:42.208081 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-96280adf-ac8f-440a-af11-e0123cd642d3 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1464 microversion: 2.1 time: 0.164954 Aug 29 05:27:42.208916 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3293/6593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:42 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:43.231224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d76fe64c-f2a7-4be3-9d9b-f9c29e85d50f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:43.232425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d76fe64c-f2a7-4be3-9d9b-f9c29e85d50f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:43.239642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d76fe64c-f2a7-4be3-9d9b-f9c29e85d50f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:43.240396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d76fe64c-f2a7-4be3-9d9b-f9c29e85d50f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:43.240981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d76fe64c-f2a7-4be3-9d9b-f9c29e85d50f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:43.241832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d76fe64c-f2a7-4be3-9d9b-f9c29e85d50f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:43.242524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d76fe64c-f2a7-4be3-9d9b-f9c29e85d50f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:43.243116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d76fe64c-f2a7-4be3-9d9b-f9c29e85d50f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:43.512724 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d76fe64c-f2a7-4be3-9d9b-f9c29e85d50f tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1649 microversion: 2.1 time: 0.287080 Aug 29 05:27:43.513554 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3301/6594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:43 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1649 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:43.535297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-01f56e35-7eb2-4c42-9cee-a4edc307c412 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:43.536577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-01f56e35-7eb2-4c42-9cee-a4edc307c412 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:43.544688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01f56e35-7eb2-4c42-9cee-a4edc307c412 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:43.545553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01f56e35-7eb2-4c42-9cee-a4edc307c412 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:43.546225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01f56e35-7eb2-4c42-9cee-a4edc307c412 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:43.547181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01f56e35-7eb2-4c42-9cee-a4edc307c412 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:43.547828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01f56e35-7eb2-4c42-9cee-a4edc307c412 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:43.548510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-01f56e35-7eb2-4c42-9cee-a4edc307c412 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:43.857948 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-01f56e35-7eb2-4c42-9cee-a4edc307c412 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1649 microversion: 2.1 time: 0.328259 Aug 29 05:27:43.859019 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3294/6595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:43 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1649 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:43.877654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4f5a88e6-c5ff-4fa1-9745-16f1653a6193 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:43.878262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4f5a88e6-c5ff-4fa1-9745-16f1653a6193 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:43.894606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f5a88e6-c5ff-4fa1-9745-16f1653a6193 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:43.895364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f5a88e6-c5ff-4fa1-9745-16f1653a6193 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:43.895940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f5a88e6-c5ff-4fa1-9745-16f1653a6193 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:43.896819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f5a88e6-c5ff-4fa1-9745-16f1653a6193 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:43.897544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f5a88e6-c5ff-4fa1-9745-16f1653a6193 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:43.898108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f5a88e6-c5ff-4fa1-9745-16f1653a6193 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:44.446473 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4f5a88e6-c5ff-4fa1-9745-16f1653a6193 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1649 microversion: 2.1 time: 0.572416 Aug 29 05:27:44.447169 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3302/6596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:43 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1649 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:44.589387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-818787283", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "availability_zone": "nova:n-h1-854119-9", "networks": [{"uuid": "ef576773-79c6-4399-b41f-00123cc36945"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:44.681069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] validate_networks() for [('ef576773-79c6-4399-b41f-00123cc36945', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:27:45.117930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:27:45.118360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:27:45.118839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:27:45.119354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:27:45.119769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:27:45.130404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:45.130898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:45.131339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:45.132069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:45.132766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:45.133354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:45.152927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Getting quotas for project c9677cdd23e5409f9143d7e9ff5708ca. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:27:45.158342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Getting quotas for user dabfbb3f9b7b4d57b2e03de53752f014 and project c9677cdd23e5409f9143d7e9ff5708ca. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:27:45.171401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:27:45.174059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:27:45.238401 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-831a80a7-00f6-465f-b476-107e3c25ca1c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650893 Aug 29 05:27:45.245002 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3295/6597] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:27:45.249880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70385476-da36-41ea-a185-3dd5dfdcd624 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:45.262382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-70385476-da36-41ea-a185-3dd5dfdcd624 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:45.383711 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70385476-da36-41ea-a185-3dd5dfdcd624 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1328 microversion: 2.1 time: 0.137508 Aug 29 05:27:45.384830 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3303/6598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:45 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1328 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:27:46.406585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb89dfb7-1df0-464f-9ddb-0f7b38cce170 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:46.407214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bb89dfb7-1df0-464f-9ddb-0f7b38cce170 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:46.423464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb89dfb7-1df0-464f-9ddb-0f7b38cce170 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:46.424887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb89dfb7-1df0-464f-9ddb-0f7b38cce170 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:46.426950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb89dfb7-1df0-464f-9ddb-0f7b38cce170 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:46.428044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb89dfb7-1df0-464f-9ddb-0f7b38cce170 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:46.428845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb89dfb7-1df0-464f-9ddb-0f7b38cce170 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:46.429477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb89dfb7-1df0-464f-9ddb-0f7b38cce170 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:46.509821 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bb89dfb7-1df0-464f-9ddb-0f7b38cce170 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1415 microversion: 2.1 time: 0.107677 Aug 29 05:27:46.514041 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3296/6599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:46 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1415 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:47.532777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b99a4c41-5193-4934-9f0b-bcc7ba5778ac tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:47.533554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b99a4c41-5193-4934-9f0b-bcc7ba5778ac tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:47.545788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99a4c41-5193-4934-9f0b-bcc7ba5778ac tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:47.547024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99a4c41-5193-4934-9f0b-bcc7ba5778ac tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:47.547529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99a4c41-5193-4934-9f0b-bcc7ba5778ac tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:47.548450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99a4c41-5193-4934-9f0b-bcc7ba5778ac tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:47.549038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99a4c41-5193-4934-9f0b-bcc7ba5778ac tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:47.549505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99a4c41-5193-4934-9f0b-bcc7ba5778ac tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:47.666025 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b99a4c41-5193-4934-9f0b-bcc7ba5778ac tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1421 microversion: 2.1 time: 0.138580 Aug 29 05:27:47.666781 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3304/6600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:47 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1421 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:48.688853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12439415-5095-4a7b-a129-99525ebd9640 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:48.690150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12439415-5095-4a7b-a129-99525ebd9640 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:48.702901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12439415-5095-4a7b-a129-99525ebd9640 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:48.705104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12439415-5095-4a7b-a129-99525ebd9640 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:48.705768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12439415-5095-4a7b-a129-99525ebd9640 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:48.706709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12439415-5095-4a7b-a129-99525ebd9640 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:48.707441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12439415-5095-4a7b-a129-99525ebd9640 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:48.709063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12439415-5095-4a7b-a129-99525ebd9640 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:48.839994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-22bc14f5-101a-4250-8eb4-676dc7b711e6 req-ae7b546f-268d-4d0f-b475-db82e701bc15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38863238-7763-4721-88a3-805aa6e39ffd", "tag": "00513f67-9bce-4dd1-8dd4-cf202e74395a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:48.862539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-22bc14f5-101a-4250-8eb4-676dc7b711e6 req-ae7b546f-268d-4d0f-b475-db82e701bc15 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:48.863216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-22bc14f5-101a-4250-8eb4-676dc7b711e6 req-ae7b546f-268d-4d0f-b475-db82e701bc15 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:48.863801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-22bc14f5-101a-4250-8eb4-676dc7b711e6 req-ae7b546f-268d-4d0f-b475-db82e701bc15 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:48.875879 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-22bc14f5-101a-4250-8eb4-676dc7b711e6 req-ae7b546f-268d-4d0f-b475-db82e701bc15 service nova] Creating event network-changed:00513f67-9bce-4dd1-8dd4-cf202e74395a for instance 38863238-7763-4721-88a3-805aa6e39ffd on n-h1-854119-9 Aug 29 05:27:48.881655 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-22bc14f5-101a-4250-8eb4-676dc7b711e6 req-ae7b546f-268d-4d0f-b475-db82e701bc15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045477 Aug 29 05:27:48.882532 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3305/6601] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:27:49.003429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12439415-5095-4a7b-a129-99525ebd9640 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1463 microversion: 2.1 time: 0.318801 Aug 29 05:27:49.006632 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3297/6602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:48 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1463 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:50.029812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de19157a-6ac8-4e8c-8c1b-57aa82829863 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:50.030649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de19157a-6ac8-4e8c-8c1b-57aa82829863 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:50.045043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de19157a-6ac8-4e8c-8c1b-57aa82829863 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:50.045903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de19157a-6ac8-4e8c-8c1b-57aa82829863 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:50.046705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de19157a-6ac8-4e8c-8c1b-57aa82829863 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:50.047678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de19157a-6ac8-4e8c-8c1b-57aa82829863 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:50.048254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de19157a-6ac8-4e8c-8c1b-57aa82829863 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:50.048796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de19157a-6ac8-4e8c-8c1b-57aa82829863 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:50.191295 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de19157a-6ac8-4e8c-8c1b-57aa82829863 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1463 microversion: 2.1 time: 0.166843 Aug 29 05:27:50.192552 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3306/6603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:50 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:51.212713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d0d458a1-6ed1-4c8e-b3d0-ef2d5a51adb4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:51.213321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d0d458a1-6ed1-4c8e-b3d0-ef2d5a51adb4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:51.219895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0d458a1-6ed1-4c8e-b3d0-ef2d5a51adb4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:51.220410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0d458a1-6ed1-4c8e-b3d0-ef2d5a51adb4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:51.220839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0d458a1-6ed1-4c8e-b3d0-ef2d5a51adb4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:51.221688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0d458a1-6ed1-4c8e-b3d0-ef2d5a51adb4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:51.222168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0d458a1-6ed1-4c8e-b3d0-ef2d5a51adb4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:51.222666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0d458a1-6ed1-4c8e-b3d0-ef2d5a51adb4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:51.371102 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d0d458a1-6ed1-4c8e-b3d0-ef2d5a51adb4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1463 microversion: 2.1 time: 0.161876 Aug 29 05:27:51.371706 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3298/6604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:51 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:52.391511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-92602dc8-6ef6-4572-bfcd-5c01bff38577 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:52.392793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-92602dc8-6ef6-4572-bfcd-5c01bff38577 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:52.415341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92602dc8-6ef6-4572-bfcd-5c01bff38577 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:52.415909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92602dc8-6ef6-4572-bfcd-5c01bff38577 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:52.416374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92602dc8-6ef6-4572-bfcd-5c01bff38577 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:52.417091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92602dc8-6ef6-4572-bfcd-5c01bff38577 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:52.417545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92602dc8-6ef6-4572-bfcd-5c01bff38577 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:52.417964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92602dc8-6ef6-4572-bfcd-5c01bff38577 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:52.784659 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-92602dc8-6ef6-4572-bfcd-5c01bff38577 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1463 microversion: 2.1 time: 0.396112 Aug 29 05:27:52.786371 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3307/6605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:52 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1463 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:27:53.806514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-397e3795-416e-4267-bbac-933603205601 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:53.807130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-397e3795-416e-4267-bbac-933603205601 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:53.810022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:53.821781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-397e3795-416e-4267-bbac-933603205601 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:53.822343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-397e3795-416e-4267-bbac-933603205601 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:53.825587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-397e3795-416e-4267-bbac-933603205601 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:53.826342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-397e3795-416e-4267-bbac-933603205601 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:53.827425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-397e3795-416e-4267-bbac-933603205601 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:53.827881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-397e3795-416e-4267-bbac-933603205601 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:53.944733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:53.945362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:53.963967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:53.965017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:53.968040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:53.969070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:53.970373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:53.971129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:54.000638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:27:54.051642 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-397e3795-416e-4267-bbac-933603205601 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1463 microversion: 2.1 time: 0.248802 Aug 29 05:27:54.052556 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3299/6606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:53 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1463 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:54.062094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-44b5ed2d-4661-4b8d-97b8-6e84be26a39e req-ab681540-77c0-472b-bd56-688dadd7cc91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca", "tag": "a0f9a947-6e74-4580-a86c-4888faa4e145"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:54.094302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-44b5ed2d-4661-4b8d-97b8-6e84be26a39e req-ab681540-77c0-472b-bd56-688dadd7cc91 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:54.096835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-44b5ed2d-4661-4b8d-97b8-6e84be26a39e req-ab681540-77c0-472b-bd56-688dadd7cc91 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:54.099441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-44b5ed2d-4661-4b8d-97b8-6e84be26a39e req-ab681540-77c0-472b-bd56-688dadd7cc91 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:54.120300 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-44b5ed2d-4661-4b8d-97b8-6e84be26a39e req-ab681540-77c0-472b-bd56-688dadd7cc91 service nova] Creating event network-changed:a0f9a947-6e74-4580-a86c-4888faa4e145 for instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca on n-h1-854119-9 Aug 29 05:27:54.150639 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-44b5ed2d-4661-4b8d-97b8-6e84be26a39e req-ab681540-77c0-472b-bd56-688dadd7cc91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094067 Aug 29 05:27:54.152858 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3afe3d2-7e8b-4cf6-b3af-9458168fef86 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 204 len: 0 microversion: 2.1 time: 0.226654 Aug 29 05:27:54.154029 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3308/6607] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:27:53 2022] DELETE /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:27:54.163982 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3300/6608] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:54.170756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:54.171457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:54.186654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:54.187383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:54.188257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:54.189897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:54.192458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:54.193471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:54.370801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:54.382121 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08f79e95-167c-469a-8b2f-8f32d30c7314 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1686 microversion: 2.1 time: 0.223313 Aug 29 05:27:54.382759 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3309/6609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:54 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1686 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:54.647214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5dddfae-83e8-41d8-a41a-bb3fbb1ae7fa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:54.647868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d5dddfae-83e8-41d8-a41a-bb3fbb1ae7fa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:54.660909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5dddfae-83e8-41d8-a41a-bb3fbb1ae7fa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:54.661446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5dddfae-83e8-41d8-a41a-bb3fbb1ae7fa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:54.662112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5dddfae-83e8-41d8-a41a-bb3fbb1ae7fa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:54.663031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5dddfae-83e8-41d8-a41a-bb3fbb1ae7fa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:54.663702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5dddfae-83e8-41d8-a41a-bb3fbb1ae7fa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:54.664364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5dddfae-83e8-41d8-a41a-bb3fbb1ae7fa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:54.698078 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5dddfae-83e8-41d8-a41a-bb3fbb1ae7fa tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/ips" status: 200 len: 144 microversion: 2.1 time: 0.055707 Aug 29 05:27:54.699367 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3301/6610] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:27:54 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/ips => generated 144 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:55.075361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-20838dd5-edec-43a5-8834-ac02085bc400 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:55.075812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-20838dd5-edec-43a5-8834-ac02085bc400 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:55.079987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:55.093694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20838dd5-edec-43a5-8834-ac02085bc400 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:55.094199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20838dd5-edec-43a5-8834-ac02085bc400 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:55.098509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20838dd5-edec-43a5-8834-ac02085bc400 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:55.099273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20838dd5-edec-43a5-8834-ac02085bc400 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:55.099756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20838dd5-edec-43a5-8834-ac02085bc400 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:55.100213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20838dd5-edec-43a5-8834-ac02085bc400 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:55.380868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:55.407669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:55.412630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:55.428239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:55.429292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:27:55.431147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:55.431848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:55.432881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:55.433798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:55.434414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:55.435598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:55.475939 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-20838dd5-edec-43a5-8834-ac02085bc400 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1463 microversion: 2.1 time: 0.405742 Aug 29 05:27:55.478748 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3310/6611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:55 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1463 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:55.782441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:55.800995 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8018f33-c756-420e-bc9b-b13d71f8b641 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1686 microversion: 2.1 time: 0.401254 Aug 29 05:27:55.815136 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3302/6612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:55 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1686 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:27:56.370894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-dfe167dc-ab10-4762-9065-318f8bf9aa12 req-1421586d-48a2-4113-aac2-bd485e133f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38863238-7763-4721-88a3-805aa6e39ffd", "name": "network-vif-plugged", "status": "completed", "tag": "00513f67-9bce-4dd1-8dd4-cf202e74395a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:56.370894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dfe167dc-ab10-4762-9065-318f8bf9aa12 req-1421586d-48a2-4113-aac2-bd485e133f36 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:56.370894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dfe167dc-ab10-4762-9065-318f8bf9aa12 req-1421586d-48a2-4113-aac2-bd485e133f36 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:56.370894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dfe167dc-ab10-4762-9065-318f8bf9aa12 req-1421586d-48a2-4113-aac2-bd485e133f36 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:56.370894 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-dfe167dc-ab10-4762-9065-318f8bf9aa12 req-1421586d-48a2-4113-aac2-bd485e133f36 service nova] Creating event network-vif-plugged:00513f67-9bce-4dd1-8dd4-cf202e74395a for instance 38863238-7763-4721-88a3-805aa6e39ffd on n-h1-854119-9 Aug 29 05:27:56.370894 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-dfe167dc-ab10-4762-9065-318f8bf9aa12 req-1421586d-48a2-4113-aac2-bd485e133f36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114415 Aug 29 05:27:56.370894 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3311/6613] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:56.505485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d392b0bf-5116-4dcc-ac55-798cd4b77f50 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:56.512262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d392b0bf-5116-4dcc-ac55-798cd4b77f50 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:56.539966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d392b0bf-5116-4dcc-ac55-798cd4b77f50 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:56.540923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d392b0bf-5116-4dcc-ac55-798cd4b77f50 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:56.541597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d392b0bf-5116-4dcc-ac55-798cd4b77f50 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:56.542517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d392b0bf-5116-4dcc-ac55-798cd4b77f50 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:56.543179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d392b0bf-5116-4dcc-ac55-798cd4b77f50 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:56.543827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d392b0bf-5116-4dcc-ac55-798cd4b77f50 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:56.823837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:56.824575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:56.834580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:56.835064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:56.835492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:56.836217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:56.836659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:56.842082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:57.097424 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d392b0bf-5116-4dcc-ac55-798cd4b77f50 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1463 microversion: 2.1 time: 0.599088 Aug 29 05:27:57.098767 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3303/6614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:56 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1463 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:57.119480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:57.131152 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e2d3c0c8-f3ae-4fc3-a47a-9b366a444062 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1686 microversion: 2.1 time: 0.311999 Aug 29 05:27:57.133286 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3312/6615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:56 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1686 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:57.343282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1a18eadc-8f87-4b75-8ed4-3c1f4395c7b8 req-4fab5d81-bd13-4071-9d41-852a7e949a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca", "name": "network-vif-deleted", "tag": "a0f9a947-6e74-4580-a86c-4888faa4e145"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:57.381735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfae4e51-17e1-4589-9182-69bd47885e30 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08ec18de-dbf0-4e17-9833-92ba45c9d8fb"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:27:57.385920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dfae4e51-17e1-4589-9182-69bd47885e30 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:57.393769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1a18eadc-8f87-4b75-8ed4-3c1f4395c7b8 req-4fab5d81-bd13-4071-9d41-852a7e949a6c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:57.394223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1a18eadc-8f87-4b75-8ed4-3c1f4395c7b8 req-4fab5d81-bd13-4071-9d41-852a7e949a6c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:57.394656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1a18eadc-8f87-4b75-8ed4-3c1f4395c7b8 req-4fab5d81-bd13-4071-9d41-852a7e949a6c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:57.395670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfae4e51-17e1-4589-9182-69bd47885e30 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:57.396183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfae4e51-17e1-4589-9182-69bd47885e30 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:57.396917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfae4e51-17e1-4589-9182-69bd47885e30 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:57.397851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfae4e51-17e1-4589-9182-69bd47885e30 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:57.398497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfae4e51-17e1-4589-9182-69bd47885e30 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:57.400224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfae4e51-17e1-4589-9182-69bd47885e30 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:57.410615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1a18eadc-8f87-4b75-8ed4-3c1f4395c7b8 req-4fab5d81-bd13-4071-9d41-852a7e949a6c service nova] Creating event network-vif-deleted:a0f9a947-6e74-4580-a86c-4888faa4e145 for instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca on n-h1-854119-9 Aug 29 05:27:57.423501 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1a18eadc-8f87-4b75-8ed4-3c1f4395c7b8 req-4fab5d81-bd13-4071-9d41-852a7e949a6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083808 Aug 29 05:27:57.425768 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3304/6616] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:57.833162 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dfae4e51-17e1-4589-9182-69bd47885e30 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466103 Aug 29 05:27:57.835463 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3313/6617] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:27:57 2022] POST /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:27:58.120917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc439c1f-e7e6-40b5-a530-3a718a379c05 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:58.121787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc439c1f-e7e6-40b5-a530-3a718a379c05 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:58.139409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc439c1f-e7e6-40b5-a530-3a718a379c05 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:58.139920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc439c1f-e7e6-40b5-a530-3a718a379c05 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:58.143146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc439c1f-e7e6-40b5-a530-3a718a379c05 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:58.143917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc439c1f-e7e6-40b5-a530-3a718a379c05 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:58.144450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc439c1f-e7e6-40b5-a530-3a718a379c05 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:58.144894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc439c1f-e7e6-40b5-a530-3a718a379c05 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:58.154791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:58.156069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:58.170933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:58.174034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:58.174570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:58.175388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:58.177889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:58.178414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:58.243848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:58.244614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:58.245237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:58.246494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lazy-loading 'fault' on Instance uuid 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:27:58.333813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcb6393cb0a4e6a857d0d5e960eba01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5306aaa62bb4e1f9b407bce73b397f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:27:58.344610 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-422ed9d6-5312-4ffd-9cb8-998c89b9ef76 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 200 len: 1356 microversion: 2.1 time: 0.193212 Aug 29 05:27:58.346896 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3314/6618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:58 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 1356 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:58.401872 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc439c1f-e7e6-40b5-a530-3a718a379c05 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1463 microversion: 2.1 time: 0.285698 Aug 29 05:27:58.402752 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3305/6619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:58 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1463 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:27:59.367510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:59.370125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] [instance: 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:59.377805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:59.378858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:59.379539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:59.381227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:59.381965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:59.382588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:59.416286 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] HTTP exception thrown: Instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca could not be found. Aug 29 05:27:59.426326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a3dc4db2-67aa-4d82-b98a-0c3a800a6272 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:59.427169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a3dc4db2-67aa-4d82-b98a-0c3a800a6272 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:59.434386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3dc4db2-67aa-4d82-b98a-0c3a800a6272 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:59.435150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3dc4db2-67aa-4d82-b98a-0c3a800a6272 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:59.435755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3dc4db2-67aa-4d82-b98a-0c3a800a6272 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:59.436661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3dc4db2-67aa-4d82-b98a-0c3a800a6272 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Request method failure captured: Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca HTTP/1.1 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEsXp8EfnvUqPmqsIzL4luSArQxeepnzAbWptfIG1OpEe8LS77ZppQzW8i3IW3VRqRq0TXI0NHqdByu2osRldV9U4AXBKV1QE-ARj2EAJgT8Qh_eOA9gF95LKAhkL1je_M0xm4pD9D4xIQk90moSvRJJWOWxOEg7BDrFFCWPYYNj2d8 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: e5306aaa62bb4e1f9b407bce73b397f0 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5306aaa62bb4e1f9b407bce73b397f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5306aaa62bb4e1f9b407bce73b397f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: e5306aaa62bb4e1f9b407bce73b397f0 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1974793548 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestNetworkAdvancedServerOps-1974793548-project Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 6bcb6393cb0a4e6a857d0d5e960eba01 Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1974793548-project Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca could not be found. Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca'} Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca could not be found. Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca could not be found. Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:59.438493 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:27:59.442352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:59.442352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:27:59.442352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:27:59.442352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:27:59.442352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:27:59.442352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:27:59.442352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca could not be found. Aug 29 05:27:59.442352 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:27:59.444925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Returning 404 to user: Instance 0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:27:59.447528 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-caf0876d-8ae8-42d4-b8e7-017d64cfa1c4 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca" status: 404 len: 111 microversion: 2.1 time: 0.084451 Aug 29 05:27:59.448525 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3315/6620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:59 2022] GET /compute/v2.1/servers/0ce3db2b-f5d6-4d0b-81f7-fa9ff82c43ca => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:27:59.449065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3dc4db2-67aa-4d82-b98a-0c3a800a6272 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:59.449857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3dc4db2-67aa-4d82-b98a-0c3a800a6272 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:59.799858 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a3dc4db2-67aa-4d82-b98a-0c3a800a6272 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1648 microversion: 2.1 time: 0.378347 Aug 29 05:27:59.804608 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3306/6621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:59 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1648 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:27:59.836430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa043fe6-445f-40be-a850-373bec5364a4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:27:59.837204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa043fe6-445f-40be-a850-373bec5364a4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:27:59.879563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa043fe6-445f-40be-a850-373bec5364a4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:59.880071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa043fe6-445f-40be-a850-373bec5364a4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:59.880874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa043fe6-445f-40be-a850-373bec5364a4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:59.881750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa043fe6-445f-40be-a850-373bec5364a4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:27:59.882203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa043fe6-445f-40be-a850-373bec5364a4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:27:59.882981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa043fe6-445f-40be-a850-373bec5364a4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:27:59.929618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:28:00.206228 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa043fe6-445f-40be-a850-373bec5364a4 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1648 microversion: 2.1 time: 0.379890 Aug 29 05:28:00.206804 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3316/6622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:27:59 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1648 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:00.231386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f165b84-0fb1-4d92-b2ed-de67b1207c90 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:00.232301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f165b84-0fb1-4d92-b2ed-de67b1207c90 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:00.242652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f165b84-0fb1-4d92-b2ed-de67b1207c90 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:00.243666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f165b84-0fb1-4d92-b2ed-de67b1207c90 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:00.244497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f165b84-0fb1-4d92-b2ed-de67b1207c90 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:00.246175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f165b84-0fb1-4d92-b2ed-de67b1207c90 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:00.247103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f165b84-0fb1-4d92-b2ed-de67b1207c90 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:00.247886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f165b84-0fb1-4d92-b2ed-de67b1207c90 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:00.513106 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f165b84-0fb1-4d92-b2ed-de67b1207c90 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1648 microversion: 2.1 time: 0.286162 Aug 29 05:28:00.529894 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3307/6623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:00 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1648 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:00.553967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:00.554479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:00.563521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:00.563889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:00.564356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:00.565076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:00.565534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:00.565963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:00.604188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:28:00.766805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8be04f18-1059-4b63-9412-516b73121e32 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 204 len: 0 microversion: 2.1 time: 0.220239 Aug 29 05:28:00.771166 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3317/6624] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:28:00 2022] DELETE /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:28:00.780875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16b05a83-71e1-4044-a9fa-a66c4c76e0a7 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:00.781673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16b05a83-71e1-4044-a9fa-a66c4c76e0a7 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:00.793234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16b05a83-71e1-4044-a9fa-a66c4c76e0a7 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:00.794278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16b05a83-71e1-4044-a9fa-a66c4c76e0a7 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:00.794278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16b05a83-71e1-4044-a9fa-a66c4c76e0a7 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:00.794664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16b05a83-71e1-4044-a9fa-a66c4c76e0a7 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:00.795165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16b05a83-71e1-4044-a9fa-a66c4c76e0a7 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:00.795588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16b05a83-71e1-4044-a9fa-a66c4c76e0a7 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:00.966728 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16b05a83-71e1-4044-a9fa-a66c4c76e0a7 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1654 microversion: 2.1 time: 0.194348 Aug 29 05:28:00.967312 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3308/6625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:00 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1654 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:28:01.990844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-246e74ff-b410-434c-81e1-0051a9b81c82 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:01.992652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-246e74ff-b410-434c-81e1-0051a9b81c82 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:02.002020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-246e74ff-b410-434c-81e1-0051a9b81c82 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:02.002920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-246e74ff-b410-434c-81e1-0051a9b81c82 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:02.004557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-246e74ff-b410-434c-81e1-0051a9b81c82 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:02.006939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-246e74ff-b410-434c-81e1-0051a9b81c82 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:02.007716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-246e74ff-b410-434c-81e1-0051a9b81c82 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:02.009034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-246e74ff-b410-434c-81e1-0051a9b81c82 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:02.349499 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-246e74ff-b410-434c-81e1-0051a9b81c82 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1654 microversion: 2.1 time: 0.362218 Aug 29 05:28:02.350242 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3318/6626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:01 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1654 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:02.997514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8d7f5c57-b0f0-49a1-ae90-78fca78669f2 req-546baec4-cf4a-453f-986d-aa223baf4733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38863238-7763-4721-88a3-805aa6e39ffd", "name": "network-vif-deleted", "tag": "00513f67-9bce-4dd1-8dd4-cf202e74395a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:28:03.019466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8d7f5c57-b0f0-49a1-ae90-78fca78669f2 req-546baec4-cf4a-453f-986d-aa223baf4733 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:03.025562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8d7f5c57-b0f0-49a1-ae90-78fca78669f2 req-546baec4-cf4a-453f-986d-aa223baf4733 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:03.026331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8d7f5c57-b0f0-49a1-ae90-78fca78669f2 req-546baec4-cf4a-453f-986d-aa223baf4733 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:03.059250 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8d7f5c57-b0f0-49a1-ae90-78fca78669f2 req-546baec4-cf4a-453f-986d-aa223baf4733 service nova] Creating event network-vif-deleted:00513f67-9bce-4dd1-8dd4-cf202e74395a for instance 38863238-7763-4721-88a3-805aa6e39ffd on n-h1-854119-9 Aug 29 05:28:03.082062 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8d7f5c57-b0f0-49a1-ae90-78fca78669f2 req-546baec4-cf4a-453f-986d-aa223baf4733 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094331 Aug 29 05:28:03.086742 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3309/6627] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:03.385021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:03.395767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:03.420876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:03.421396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:03.421832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:03.430157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:03.432734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:03.433353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:03.594987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:03.596426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:03.597104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:03.599501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lazy-loading 'fault' on Instance uuid 38863238-7763-4721-88a3-805aa6e39ffd {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:28:03.740401 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-87b19ab6-090f-4190-b8fe-00c6b07ffb2d tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 200 len: 1453 microversion: 2.1 time: 0.372059 Aug 29 05:28:03.740998 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3319/6628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:03 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 1453 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:04.763864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:04.764616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 38863238-7763-4721-88a3-805aa6e39ffd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:04.784098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:04.784613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:04.785072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:04.786173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:04.786277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:04.786634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:04.814295 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] HTTP exception thrown: Instance 38863238-7763-4721-88a3-805aa6e39ffd could not be found. Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Request method failure captured: Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd HTTP/1.1 Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE49VrEhVcELLjOeiSk8xjTSQ5UPx0-nh8j01UzaeMBpXmqS8x0IEcuZqxJMzW_5mqXrinT6-D1_c-fypO3Oa8z_8wQUwzQEOIrvBxu0dVHv6WISm1z-RCHdVfjLTTwNM80JR-hMPJGkwXYeDvpvIW_fyNKdp1ID3_0bxDPSgQ1dau0 Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: c9677cdd23e5409f9143d7e9ff5708ca Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestServerMultinode-276149602 Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9677cdd23e5409f9143d7e9ff5708ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c9677cdd23e5409f9143d7e9ff5708ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c9677cdd23e5409f9143d7e9ff5708ca", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9677cdd23e5409f9143d7e9ff5708ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestServerMultinode-276149602 Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: c9677cdd23e5409f9143d7e9ff5708ca Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestServerMultinode-276149602 Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestServerMultinode-276149602-project-admin Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: dabfbb3f9b7b4d57b2e03de53752f014 Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestServerMultinode-276149602-project-admin Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 38863238-7763-4721-88a3-805aa6e39ffd could not be found. Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '38863238-7763-4721-88a3-805aa6e39ffd'} Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38863238-7763-4721-88a3-805aa6e39ffd could not be found. Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38863238-7763-4721-88a3-805aa6e39ffd could not be found. Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:28:04.823067 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:28:04.826864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:28:04.826864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:28:04.826864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:28:04.826864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:28:04.826864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:28:04.826864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38863238-7763-4721-88a3-805aa6e39ffd could not be found. Aug 29 05:28:04.826864 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:28:04.826864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Returning 404 to user: Instance 38863238-7763-4721-88a3-805aa6e39ffd could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:28:04.826864 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-534b0b60-4e04-4a5b-b4ed-662da1bfc045 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd" status: 404 len: 111 microversion: 2.1 time: 0.066957 Aug 29 05:28:04.827517 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3310/6629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:04 2022] GET /compute/v2.1/servers/38863238-7763-4721-88a3-805aa6e39ffd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:28:04.836177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:04.836742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:04.852248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:04.852793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:04.853264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:04.853983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:04.854440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:04.854864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:04.933069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:28:05.099983 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f3ab6381-f96c-42fd-80a3-8704f757611c tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 204 len: 0 microversion: 2.1 time: 0.268078 Aug 29 05:28:05.100698 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3320/6630] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:28:04 2022] DELETE /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:28:05.113283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8a8eed7-a8f3-44c0-8760-8f839da53246 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:05.114162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8a8eed7-a8f3-44c0-8760-8f839da53246 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:05.126079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8a8eed7-a8f3-44c0-8760-8f839da53246 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:05.126751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8a8eed7-a8f3-44c0-8760-8f839da53246 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:05.127981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8a8eed7-a8f3-44c0-8760-8f839da53246 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:05.129988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8a8eed7-a8f3-44c0-8760-8f839da53246 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:05.131729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8a8eed7-a8f3-44c0-8760-8f839da53246 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:05.132380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8a8eed7-a8f3-44c0-8760-8f839da53246 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:05.143284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:28:05.521330 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8a8eed7-a8f3-44c0-8760-8f839da53246 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1655 microversion: 2.1 time: 0.415819 Aug 29 05:28:05.525734 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3311/6631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:05 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1655 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:05.848882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c955e70-6f82-4933-b861-408d6c32f4f6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] Calling method '.version_select at 0x7f1ab93cd700>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:05.881393 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c955e70-6f82-4933-b861-408d6c32f4f6 tempest-TestNetworkAdvancedServerOps-1974793548 tempest-TestNetworkAdvancedServerOps-1974793548-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1414645956" status: 202 len: 0 microversion: 2.1 time: 0.036690 Aug 29 05:28:05.886110 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3321/6632] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Aug 29 05:28:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1414645956 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:28:06.543401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d4d9ac6-6c5d-4e0a-9d64-7eb037b878fb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:06.544019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d4d9ac6-6c5d-4e0a-9d64-7eb037b878fb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:06.553148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d9ac6-6c5d-4e0a-9d64-7eb037b878fb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:06.553646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d9ac6-6c5d-4e0a-9d64-7eb037b878fb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:06.554096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d9ac6-6c5d-4e0a-9d64-7eb037b878fb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:06.556790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d9ac6-6c5d-4e0a-9d64-7eb037b878fb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:06.557264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d9ac6-6c5d-4e0a-9d64-7eb037b878fb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:06.557705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4d9ac6-6c5d-4e0a-9d64-7eb037b878fb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:07.008739 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d4d9ac6-6c5d-4e0a-9d64-7eb037b878fb tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1655 microversion: 2.1 time: 0.469375 Aug 29 05:28:07.009677 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3312/6633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:06 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1655 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:08.033175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-082aacee-b14a-45e1-94a8-623a4f902ed6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:08.033998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-082aacee-b14a-45e1-94a8-623a4f902ed6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:08.060916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082aacee-b14a-45e1-94a8-623a4f902ed6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:08.061427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082aacee-b14a-45e1-94a8-623a4f902ed6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:08.061866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082aacee-b14a-45e1-94a8-623a4f902ed6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:08.065292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082aacee-b14a-45e1-94a8-623a4f902ed6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:08.066890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082aacee-b14a-45e1-94a8-623a4f902ed6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:08.067626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-082aacee-b14a-45e1-94a8-623a4f902ed6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:08.402301 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-082aacee-b14a-45e1-94a8-623a4f902ed6 tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 200 len: 1613 microversion: 2.1 time: 0.296858 Aug 29 05:28:08.402301 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3322/6634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:08 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 1613 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:08.402988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3ebda766-d5fe-4a28-8a2f-2e2723471883 req-03cf77e0-a43b-4d0d-af7a-ea5635d101f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5020a18a-c5e5-4037-961b-8640fea1e9b6", "name": "network-vif-deleted", "tag": "52864bcb-3295-44a8-8792-23cf258c5393"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:28:08.422929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ebda766-d5fe-4a28-8a2f-2e2723471883 req-03cf77e0-a43b-4d0d-af7a-ea5635d101f9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:08.423410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ebda766-d5fe-4a28-8a2f-2e2723471883 req-03cf77e0-a43b-4d0d-af7a-ea5635d101f9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:08.423836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ebda766-d5fe-4a28-8a2f-2e2723471883 req-03cf77e0-a43b-4d0d-af7a-ea5635d101f9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:08.511613 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3ebda766-d5fe-4a28-8a2f-2e2723471883 req-03cf77e0-a43b-4d0d-af7a-ea5635d101f9 service nova] Creating event network-vif-deleted:52864bcb-3295-44a8-8792-23cf258c5393 for instance 5020a18a-c5e5-4037-961b-8640fea1e9b6 on n-h2-854119-9 Aug 29 05:28:08.529683 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3ebda766-d5fe-4a28-8a2f-2e2723471883 req-03cf77e0-a43b-4d0d-af7a-ea5635d101f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259375 Aug 29 05:28:08.530910 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3313/6635] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:09.344910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:09.346987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] [instance: 5020a18a-c5e5-4037-961b-8640fea1e9b6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:09.356711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:09.357528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:09.358208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:09.359185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:09.359840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:09.361134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:09.378830 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] HTTP exception thrown: Instance 5020a18a-c5e5-4037-961b-8640fea1e9b6 could not be found. Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Request method failure captured: Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 HTTP/1.1 Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE49VrEhVcELLjOeiSk8xjTSQ5UPx0-nh8j01UzaeMBpXmqS8x0IEcuZqxJMzW_5mqXrinT6-D1_c-fypO3Oa8z_8wQUwzQEOIrvBxu0dVHv6WISm1z-RCHdVfjLTTwNM80JR-hMPJGkwXYeDvpvIW_fyNKdp1ID3_0bxDPSgQ1dau0 Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: c9677cdd23e5409f9143d7e9ff5708ca Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestServerMultinode-276149602 Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9677cdd23e5409f9143d7e9ff5708ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c9677cdd23e5409f9143d7e9ff5708ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c9677cdd23e5409f9143d7e9ff5708ca", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9677cdd23e5409f9143d7e9ff5708ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestServerMultinode-276149602 Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: c9677cdd23e5409f9143d7e9ff5708ca Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestServerMultinode-276149602 Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestServerMultinode-276149602-project-admin Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: dabfbb3f9b7b4d57b2e03de53752f014 Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestServerMultinode-276149602-project-admin Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 5020a18a-c5e5-4037-961b-8640fea1e9b6 could not be found. Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '5020a18a-c5e5-4037-961b-8640fea1e9b6'} Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5020a18a-c5e5-4037-961b-8640fea1e9b6 could not be found. Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5020a18a-c5e5-4037-961b-8640fea1e9b6 could not be found. Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:28:09.382059 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:28:09.386007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:28:09.386007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:28:09.386007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:28:09.386007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:28:09.386007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:28:09.386007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5020a18a-c5e5-4037-961b-8640fea1e9b6 could not be found. Aug 29 05:28:09.386007 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:28:09.388743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] Returning 404 to user: Instance 5020a18a-c5e5-4037-961b-8640fea1e9b6 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:28:09.389860 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b22b8687-faf8-4dc6-aa8a-9e2a6f5b1d0e tempest-TestServerMultinode-276149602 tempest-TestServerMultinode-276149602-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6" status: 404 len: 111 microversion: 2.1 time: 0.048748 Aug 29 05:28:09.395951 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3323/6636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:09 2022] GET /compute/v2.1/servers/5020a18a-c5e5-4037-961b-8640fea1e9b6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:28:15.873208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd12b7fd-d2f1-4c44-9f4a-7867360c8044 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:15.883937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd12b7fd-d2f1-4c44-9f4a-7867360c8044 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:15.916376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd12b7fd-d2f1-4c44-9f4a-7867360c8044 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:15.916893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd12b7fd-d2f1-4c44-9f4a-7867360c8044 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:15.917340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd12b7fd-d2f1-4c44-9f4a-7867360c8044 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:15.918070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd12b7fd-d2f1-4c44-9f4a-7867360c8044 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:15.918529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd12b7fd-d2f1-4c44-9f4a-7867360c8044 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:15.918954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd12b7fd-d2f1-4c44-9f4a-7867360c8044 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:15.988849 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd12b7fd-d2f1-4c44-9f4a-7867360c8044 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126022 Aug 29 05:28:16.001032 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3314/6637] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:28:15 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:16.012535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf7781d6-6421-4adb-9f73-b9ea0e02140b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:16.014221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf7781d6-6421-4adb-9f73-b9ea0e02140b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:16.026491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf7781d6-6421-4adb-9f73-b9ea0e02140b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:16.027232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf7781d6-6421-4adb-9f73-b9ea0e02140b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:16.027822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf7781d6-6421-4adb-9f73-b9ea0e02140b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:16.028715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf7781d6-6421-4adb-9f73-b9ea0e02140b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:16.029326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf7781d6-6421-4adb-9f73-b9ea0e02140b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:16.029928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bf7781d6-6421-4adb-9f73-b9ea0e02140b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:16.123118 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf7781d6-6421-4adb-9f73-b9ea0e02140b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/08ec18de-dbf0-4e17-9833-92ba45c9d8fb" status: 200 len: 194 microversion: 2.1 time: 0.113314 Aug 29 05:28:16.124362 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3324/6638] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 29 05:28:16 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/08ec18de-dbf0-4e17-9833-92ba45c9d8fb => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:18.965674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ed2f781-c95b-4545-9eb0-5935f2c1ad55 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d5618f6-578a-4f4a-a8e0-09e23795d385"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:28:18.968361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ed2f781-c95b-4545-9eb0-5935f2c1ad55 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:19.000853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed2f781-c95b-4545-9eb0-5935f2c1ad55 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:19.001611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed2f781-c95b-4545-9eb0-5935f2c1ad55 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:19.001726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed2f781-c95b-4545-9eb0-5935f2c1ad55 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:19.002553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed2f781-c95b-4545-9eb0-5935f2c1ad55 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:19.003019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed2f781-c95b-4545-9eb0-5935f2c1ad55 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:19.003449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ed2f781-c95b-4545-9eb0-5935f2c1ad55 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:19.543898 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ed2f781-c95b-4545-9eb0-5935f2c1ad55 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "POST /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.583183 Aug 29 05:28:19.544567 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3315/6639] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:28:18 2022] POST /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:37.967209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee5e2542-876b-476e-826d-60a676bc8b61 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:37.969988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee5e2542-876b-476e-826d-60a676bc8b61 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:37.983714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:28:38.009194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:28:38.045000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee5e2542-876b-476e-826d-60a676bc8b61 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:38.045763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee5e2542-876b-476e-826d-60a676bc8b61 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:38.049930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee5e2542-876b-476e-826d-60a676bc8b61 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:38.050948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee5e2542-876b-476e-826d-60a676bc8b61 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:38.052790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee5e2542-876b-476e-826d-60a676bc8b61 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:38.053388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee5e2542-876b-476e-826d-60a676bc8b61 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:38.149260 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee5e2542-876b-476e-826d-60a676bc8b61 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.186786 Aug 29 05:28:38.153673 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3325/6640] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:28:37 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments => generated 371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:38.298792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=33 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:28:38.300387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:28:38.307490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-14a6cd83-c642-4118-8222-5ace1ffd21e4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:38.308097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-14a6cd83-c642-4118-8222-5ace1ffd21e4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:38.327394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14a6cd83-c642-4118-8222-5ace1ffd21e4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:38.328238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14a6cd83-c642-4118-8222-5ace1ffd21e4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:38.328898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14a6cd83-c642-4118-8222-5ace1ffd21e4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:38.329782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14a6cd83-c642-4118-8222-5ace1ffd21e4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:38.330743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14a6cd83-c642-4118-8222-5ace1ffd21e4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:38.331470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14a6cd83-c642-4118-8222-5ace1ffd21e4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:38.374243 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-14a6cd83-c642-4118-8222-5ace1ffd21e4 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/08ec18de-dbf0-4e17-9833-92ba45c9d8fb" status: 200 len: 194 microversion: 2.1 time: 0.077424 Aug 29 05:28:38.375470 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3316/6641] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 29 05:28:38 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/08ec18de-dbf0-4e17-9833-92ba45c9d8fb => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:38.387774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:38.389052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:38.398717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:38.399739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:38.400366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:38.401292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:38.401893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:38.402611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:38.548939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lazy-loading 'services' on Instance uuid 6d5a238e-39c9-4b26-b927-17d5be2ee3bf {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:28:38.691915 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9e5685e8-45d5-4854-90d4-4e8988d67200 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/08ec18de-dbf0-4e17-9833-92ba45c9d8fb" status: 202 len: 0 microversion: 2.1 time: 0.308585 Aug 29 05:28:38.693657 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3326/6642] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:28:38 2022] DELETE /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/08ec18de-dbf0-4e17-9833-92ba45c9d8fb => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:28:43.933730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0c84afb-1ae5-4791-9165-78459134d0ed tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Action: 'create', calling method: .version_select at 0x7f1abd8203a0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1689084540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiIChC8HAkTisTwTLdn0wuKyKWK3hkZIiOupF8tFRbdqymLJMImmiLfWTRMVRlfCviDDcqHQ5Ysno5r0WkWVn9Pp7gNI93GEc6rOsFj7cSJgrqKeX4/rDMR/USPvU7eYQ=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:28:43.956112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b0c84afb-1ae5-4791-9165-78459134d0ed tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Getting quotas for project b6f61eb236ba40caaec504709faf1e0b. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:28:43.964629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b0c84afb-1ae5-4791-9165-78459134d0ed tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Getting quotas for user 71f134c218cc476088d2317121588d3d and project b6f61eb236ba40caaec504709faf1e0b. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:28:43.997716 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b0c84afb-1ae5-4791-9165-78459134d0ed tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.068664 Aug 29 05:28:43.999317 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3317/6643] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:28:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:47.558208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1748322787", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cecf901e-6c83-48ef-b2b5-175e044a580f", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1689084540", "security_groups": [{"name": "tempest-secgroup-smoke-593641204"}], "networks": [{"uuid": "e478a7fa-d158-4b91-882b-2574d6d3cc08"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:28:47.872439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] validate_networks() for [('e478a7fa-d158-4b91-882b-2574d6d3cc08', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:28:48.159896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-262a2d48-35e1-420f-917f-1f3a1fe6f702 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:48.160664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-262a2d48-35e1-420f-917f-1f3a1fe6f702 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:48.178022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-262a2d48-35e1-420f-917f-1f3a1fe6f702 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:48.178535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-262a2d48-35e1-420f-917f-1f3a1fe6f702 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:48.183257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-262a2d48-35e1-420f-917f-1f3a1fe6f702 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:48.184268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-262a2d48-35e1-420f-917f-1f3a1fe6f702 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:48.184772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-262a2d48-35e1-420f-917f-1f3a1fe6f702 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:48.185219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-262a2d48-35e1-420f-917f-1f3a1fe6f702 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:48.278253 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-262a2d48-35e1-420f-917f-1f3a1fe6f702 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/ips" status: 200 len: 149 microversion: 2.1 time: 0.126492 Aug 29 05:28:48.285337 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3318/6644] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:28:48 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/ips => generated 149 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:48.676024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:28:50.217337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:28:50.218663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:28:50.219307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:28:50.220097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:28:50.221058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:28:50.245744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:50.246542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:50.248775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:50.249751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:50.255188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:50.255928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:50.326335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Getting quotas for project b6f61eb236ba40caaec504709faf1e0b. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:28:50.343484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Getting quotas for user 71f134c218cc476088d2317121588d3d and project b6f61eb236ba40caaec504709faf1e0b. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:28:50.454922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:28:50.457645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cecf901e-6c83-48ef-b2b5-175e044a580f',volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:28:50.892629 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5eac8b6-076e-40fb-885d-4474357be41c tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.337346 Aug 29 05:28:50.909118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09e3af58-d262-462c-b409-44b5440fd093 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:50.910401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-09e3af58-d262-462c-b409-44b5440fd093 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:50.917038 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3327/6645] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:28:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 3358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:28:51.169820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-09e3af58-d262-462c-b409-44b5440fd093 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:28:51.178458 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09e3af58-d262-462c-b409-44b5440fd093 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1099 microversion: 2.1 time: 0.277862 Aug 29 05:28:51.179049 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3319/6646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:50 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1099 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:28:51.730122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f917788d-516b-4e64-9154-e5a600b9ca28 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:51.733435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f917788d-516b-4e64-9154-e5a600b9ca28 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:51.758556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f917788d-516b-4e64-9154-e5a600b9ca28 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:51.764505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f917788d-516b-4e64-9154-e5a600b9ca28 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:51.765056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f917788d-516b-4e64-9154-e5a600b9ca28 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:51.765864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f917788d-516b-4e64-9154-e5a600b9ca28 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:51.766558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f917788d-516b-4e64-9154-e5a600b9ca28 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:51.767188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f917788d-516b-4e64-9154-e5a600b9ca28 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:51.868353 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f917788d-516b-4e64-9154-e5a600b9ca28 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/4d5618f6-578a-4f4a-a8e0-09e23795d385" status: 200 len: 194 microversion: 2.1 time: 0.149934 Aug 29 05:28:51.875182 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3328/6647] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 29 05:28:51 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/4d5618f6-578a-4f4a-a8e0-09e23795d385 => generated 194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:51.882289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:51.882831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:51.951464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:51.956081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:51.956574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:51.957335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:51.957795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:51.963897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:52.053872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2663307-a8b2-40e5-8403-438cfb54bfd7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee377ac9-7596-4fb8-9393-a41ab7239652"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:28:52.056931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c2663307-a8b2-40e5-8403-438cfb54bfd7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:52.074477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2663307-a8b2-40e5-8403-438cfb54bfd7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:52.079026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2663307-a8b2-40e5-8403-438cfb54bfd7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:52.080034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2663307-a8b2-40e5-8403-438cfb54bfd7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:52.081745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2663307-a8b2-40e5-8403-438cfb54bfd7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:52.082207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2663307-a8b2-40e5-8403-438cfb54bfd7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:52.082689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2663307-a8b2-40e5-8403-438cfb54bfd7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:52.213514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lazy-loading 'services' on Instance uuid 6d5a238e-39c9-4b26-b927-17d5be2ee3bf {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:28:52.386469 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aa318875-f5ce-4f22-8f8c-5e3ef90a3919 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/4d5618f6-578a-4f4a-a8e0-09e23795d385" status: 202 len: 0 microversion: 2.1 time: 0.509315 Aug 29 05:28:52.389013 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3320/6648] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:28:51 2022] DELETE /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments/4d5618f6-578a-4f4a-a8e0-09e23795d385 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:28:52.397587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:52.398585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:52.406331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:52.407464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:52.408778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:52.409771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:52.410529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:52.411199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:52.689766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:28:52.701176 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3a29577-201c-4e80-a25e-41d5811872cd tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1141 microversion: 2.1 time: 0.310559 Aug 29 05:28:52.701771 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3321/6649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:52 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1141 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:52.787126 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c2663307-a8b2-40e5-8403-438cfb54bfd7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "POST /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744558 Aug 29 05:28:52.787717 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3329/6650] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:28:52 2022] POST /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:28:53.725799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:53.726607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:53.754169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:53.754703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:53.755160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:53.758735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:53.759290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:53.762439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:53.940994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:28:53.954462 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12acc059-d6d6-4d1d-9f81-28b36227f6f1 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1215 microversion: 2.1 time: 0.234199 Aug 29 05:28:53.958836 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3322/6651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:53 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:54.993275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:54.994562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:55.028108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:55.028987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:55.029607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:55.030500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:55.031238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:55.031809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:55.394866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:28:55.403161 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-913c1201-ff35-44bf-910d-36cd50497136 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.427492 Aug 29 05:28:55.407587 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3330/6652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:54 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:56.087862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a9fe52bc-8033-42dd-870d-7c380e5763ad req-633be97a-3d75-4369-89b7-b33f19091028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a8d8441-1027-49af-924e-d954c35d0dab", "tag": "faf36ed5-589f-4e1c-b005-6d2f33f14902"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:28:56.122750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9fe52bc-8033-42dd-870d-7c380e5763ad req-633be97a-3d75-4369-89b7-b33f19091028 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:56.123151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9fe52bc-8033-42dd-870d-7c380e5763ad req-633be97a-3d75-4369-89b7-b33f19091028 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:56.133411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9fe52bc-8033-42dd-870d-7c380e5763ad req-633be97a-3d75-4369-89b7-b33f19091028 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:56.146538 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a9fe52bc-8033-42dd-870d-7c380e5763ad req-633be97a-3d75-4369-89b7-b33f19091028 service nova] Creating event network-changed:faf36ed5-589f-4e1c-b005-6d2f33f14902 for instance 0a8d8441-1027-49af-924e-d954c35d0dab on n-h1-854119-9 Aug 29 05:28:56.152393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a9fe52bc-8033-42dd-870d-7c380e5763ad req-633be97a-3d75-4369-89b7-b33f19091028 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069156 Aug 29 05:28:56.153270 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3323/6653] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:28:56.427150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:56.429592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:56.444723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:56.445558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:56.446169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:56.447062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:56.450172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:56.450943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:56.759583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:28:56.763636 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f7be4b01-f402-4a9b-b6b5-5bb3c4bd1407 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.340142 Aug 29 05:28:56.764436 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3331/6654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:56 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:57.796165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:57.799379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:57.816416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:57.816764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:57.817198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:57.828369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:57.830016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:57.831755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:58.188944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:28:58.204486 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cc028924-22db-4e85-a7af-be7cc19cf12b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.421516 Aug 29 05:28:58.205568 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3324/6655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:57 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:28:59.228894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:28:59.231555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:28:59.250104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:59.251006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:59.251983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:59.253594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:28:59.254652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:28:59.255398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:28:59.483886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:28:59.499070 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eddb5cca-60df-4d2c-a71a-2fe4744f16cf tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.275917 Aug 29 05:28:59.499693 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3332/6656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:28:59 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:00.532240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:00.535667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:00.552208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:00.553040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:00.553994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:00.555424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:00.556289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:00.556872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:00.844238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:00.860726 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8dabdecc-f898-4e46-840b-464980ec39da tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.341402 Aug 29 05:29:00.861591 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3325/6657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:00 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:01.884008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:01.884717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:01.898852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:01.901723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:01.903648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:01.904332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:01.905124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:01.906051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:01.906832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:01.911794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:02.110779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:02.123309 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f00455fb-abb7-4742-88b7-4d39c08aa340 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.244540 Aug 29 05:29:02.129342 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3333/6658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:01 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:03.149708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:03.151815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:03.160459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:03.165630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:03.167298 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:03.167919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:03.169619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:03.170405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:03.171058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:03.403972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:03.414877 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a84cf9f-2b49-4da4-b02a-561873695589 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.272200 Aug 29 05:29:03.416351 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3326/6659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:03 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:04.436336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:04.437023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:04.444430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:04.445122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:04.445747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:04.446626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:04.447079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:04.447497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:04.655953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:04.666393 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-44b0e483-3e7e-4ed0-8ea9-7698fa318bce tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.233940 Aug 29 05:29:04.679659 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3334/6660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:04 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:05.691168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:05.692565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:05.701410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:05.702209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:05.702808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:05.703741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:05.704553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:05.705139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:05.925874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:05.936910 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be301f12-f576-4b10-b3c4-51e1e9a93fd0 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.249743 Aug 29 05:29:05.939083 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3327/6661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:05 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:06.959286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:06.960771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:06.971137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:06.972058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:06.973473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:07.012991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:07.014905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:07.015432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:07.257858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:07.276289 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d0f23666-5402-4212-a8b0-0a041419ff56 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.319363 Aug 29 05:29:07.277625 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3335/6662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:06 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:07.785454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-767c6517-d52b-421b-af37-f52ab3167d87 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:07.789704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-767c6517-d52b-421b-af37-f52ab3167d87 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:07.798709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-767c6517-d52b-421b-af37-f52ab3167d87 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:07.799517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-767c6517-d52b-421b-af37-f52ab3167d87 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:07.800184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-767c6517-d52b-421b-af37-f52ab3167d87 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:07.801737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-767c6517-d52b-421b-af37-f52ab3167d87 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:07.802390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-767c6517-d52b-421b-af37-f52ab3167d87 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:07.802999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-767c6517-d52b-421b-af37-f52ab3167d87 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:07.907606 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-767c6517-d52b-421b-af37-f52ab3167d87 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127050 Aug 29 05:29:07.918834 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3328/6663] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:07 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:29:07.944824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1983763524", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3527f720-7cc3-4a5b-94ed-2379d832b9ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77c879e8-8923-4ae0-9869-fe659563295c"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:08.075222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] validate_networks() for [('77c879e8-8923-4ae0-9869-fe659563295c', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:29:08.150971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b3e6846-6572-40ee-8327-de647cb636b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:08.153282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8b3e6846-6572-40ee-8327-de647cb636b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:08.167412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3e6846-6572-40ee-8327-de647cb636b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.168033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3e6846-6572-40ee-8327-de647cb636b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.170557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3e6846-6572-40ee-8327-de647cb636b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:08.171453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3e6846-6572-40ee-8327-de647cb636b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.172008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3e6846-6572-40ee-8327-de647cb636b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.175530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3e6846-6572-40ee-8327-de647cb636b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:08.213308 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8b3e6846-6572-40ee-8327-de647cb636b3 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066473 Aug 29 05:29:08.214542 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3329/6664] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:08 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 05:29:08.328036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:08.328859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:08.335699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:08.341435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.342009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.348923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:08.350021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.350739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.351462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:08.363954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:08.684907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:29:08.685553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:29:08.686187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:29:08.686740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:29:08.687310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:29:08.689348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:08.692610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:08.698793 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f606dcc1-f6ca-4be7-b8e3-c5739ad1c3d5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.397027 Aug 29 05:29:08.699378 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3330/6665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:08 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:08.706183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:08.706847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:08.714441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.715308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.715785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:08.716829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.717531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.718205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:08.724516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.725034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.725528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:08.726565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.727211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.728992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:08.774075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:29:08.789444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:29:08.808012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for user 83565ba99afd41f4b0d5de74365c3b2f and project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:29:08.904178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:29:08.906624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3527f720-7cc3-4a5b-94ed-2379d832b9ab',volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:29:08.950951 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ce28ed7d-6e85-460a-9c68-53b6972610dc tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 204 len: 0 microversion: 2.1 time: 0.248601 Aug 29 05:29:08.952988 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3331/6666] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:29:08 2022] DELETE /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:29:08.975465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:08.976661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:08.983100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.984253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.984913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:08.985960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:08.986740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:08.987380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:09.167650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:09.171212 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fe9ceb9f-3065-4fb4-8cfe-47a4c46e89b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230555 Aug 29 05:29:09.172998 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3336/6667] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:29:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:29:09.176030 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9361b28-f501-45be-a936-fbc5f76e7805 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1670 microversion: 2.1 time: 0.205294 Aug 29 05:29:09.176650 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3332/6668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:08 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:09.185838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49dda758-6787-409f-9e49-9ba4838d2a33 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:09.186722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-49dda758-6787-409f-9e49-9ba4838d2a33 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:09.277631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-49dda758-6787-409f-9e49-9ba4838d2a33 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:09.286477 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-49dda758-6787-409f-9e49-9ba4838d2a33 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1057 microversion: 2.1 time: 0.104895 Aug 29 05:29:09.287799 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3337/6669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:09 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1057 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:09.724542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:09.725350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:09.747283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:09.748019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:09.748727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:09.749742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:09.751088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:09.751812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:09.976237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:09.993411 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-286f9472-557d-468d-b454-3183d6feb8a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1282 microversion: 2.1 time: 0.278128 Aug 29 05:29:09.994000 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3333/6670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:09 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1282 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:10.198644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:10.199178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:10.206615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:10.207748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:10.208492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:10.209209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:10.209660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:10.210121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:10.308831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:10.309454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:10.327637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:10.328160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:10.328605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:10.329319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:10.329799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:10.330206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:10.393360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:10.403084 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-53e83bb1-0ed3-478d-bd03-1747b7456e18 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1670 microversion: 2.1 time: 0.209322 Aug 29 05:29:10.406616 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3338/6671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:10 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:10.420789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:10.429273 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-727a07e5-ac66-47f7-a3bd-eff49f7e9b42 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1107 microversion: 2.1 time: 0.124242 Aug 29 05:29:10.429855 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3334/6672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:10 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1107 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:11.018735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:11.019582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:11.028861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:11.029439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:11.029880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:11.030616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:11.031076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:11.031504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:11.211613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:11.221328 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b688c230-eb5c-43f4-b7f8-c81de5e9125d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.208348 Aug 29 05:29:11.233305 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3339/6673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:11 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:11.429860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:11.431480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:11.442302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:11.443560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:11.444389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:11.445822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:11.447295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:11.447942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:11.449884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:11.450489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:11.459059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:11.463420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:11.464048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:11.464973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:11.465589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:11.466157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:11.632538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:11.640869 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9c104e0-bf55-4e01-8ca8-c9b8c55d42dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1163 microversion: 2.1 time: 0.194752 Aug 29 05:29:11.641877 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3340/6674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:11 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1163 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:11.754913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:11.764625 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c59a104-fc25-4393-a896-f6a3c6f86bb1 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1670 microversion: 2.1 time: 0.342273 Aug 29 05:29:11.765217 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3335/6675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:11 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1670 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:12.252639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:12.254146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:12.265837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:12.266930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:12.267606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:12.268680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:12.270316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:12.270948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:12.456666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:12.472070 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-20f88ff8-65a7-4f5a-b7c8-fcb9c7bc3e86 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.221612 Aug 29 05:29:12.490268 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3341/6676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:12 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:12.670229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:12.671448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:12.682514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:12.683334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:12.685045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:12.686006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:12.686698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:12.687278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:12.775670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:12.785913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:12.786536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:12.788708 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-36095489-c348-4a52-816a-39b4e6639be9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1173 microversion: 2.1 time: 0.123534 Aug 29 05:29:12.790074 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3336/6677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:12 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1173 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:12.793459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:12.793946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:12.794385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:12.795081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:12.795552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:12.795967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:12.934056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bdd41026f34da095323a31c14f2606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb004e20c1594762809ba319a68c50b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:12.943125 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b1a20bcb-e174-4268-afcd-77c8e18c898b tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 200 len: 1603 microversion: 2.1 time: 0.161002 Aug 29 05:29:12.944059 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3342/6678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:12 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 1603 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:13.503271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:13.504151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:13.516304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:13.517113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:13.517853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:13.518739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:13.520459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:13.522798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:13.980202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a1b0161a-6ffb-457b-a224-886977924a6a req-753cce9e-a0b1-494e-b3ff-79d7c5dd0b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d5a238e-39c9-4b26-b927-17d5be2ee3bf", "name": "network-vif-deleted", "tag": "7f4e61ba-85d6-40ca-9092-9fb1be39d2c6"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:13.996315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a1b0161a-6ffb-457b-a224-886977924a6a req-753cce9e-a0b1-494e-b3ff-79d7c5dd0b8a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:13.996806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a1b0161a-6ffb-457b-a224-886977924a6a req-753cce9e-a0b1-494e-b3ff-79d7c5dd0b8a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:14.004344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a1b0161a-6ffb-457b-a224-886977924a6a req-753cce9e-a0b1-494e-b3ff-79d7c5dd0b8a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:14.042297 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a1b0161a-6ffb-457b-a224-886977924a6a req-753cce9e-a0b1-494e-b3ff-79d7c5dd0b8a service nova] Creating event network-vif-deleted:7f4e61ba-85d6-40ca-9092-9fb1be39d2c6 for instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf on n-h2-854119-9 Aug 29 05:29:14.064847 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a1b0161a-6ffb-457b-a224-886977924a6a req-753cce9e-a0b1-494e-b3ff-79d7c5dd0b8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.508426 Aug 29 05:29:14.065867 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3343/6679] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:14.093075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:14.093709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:14.130264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:14.130774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:14.131219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:14.132051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:14.132575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:14.132997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:14.180592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:14.211531 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3568c9c0-8b5a-473e-ac75-f4572749a1a9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.688824 Aug 29 05:29:14.214110 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3337/6680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:13 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:14.236505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:14.249350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:14.273452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:14.276066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:14.279519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:14.280423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:14.280912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:14.287711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:14.387368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lazy-loading 'services' on Instance uuid 7e5ca19b-3af5-4450-8826-7b31d6e8a098 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:29:14.417637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:14.589484 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1bc21efc-627e-4326-b37b-4ad06cad57e0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments/ee377ac9-7596-4fb8-9393-a41ab7239652" status: 202 len: 0 microversion: 2.1 time: 0.521582 Aug 29 05:29:14.592294 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3344/6681] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:29:14 2022] DELETE /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments/ee377ac9-7596-4fb8-9393-a41ab7239652 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:29:14.628064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:14.628890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:14.655449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:14.655966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:14.656445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:14.657206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:14.663251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:14.664144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:14.697905 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] HTTP exception thrown: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Request method failure captured: Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf HTTP/1.1 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEyx4gTPkmmeipeKem59YTyW3XgB_hVHiK4YvZ-HMrD_RVfxUWIvGJIAJ1_GXjt94zavkoiTAB4F3wbwR5ZI5fH8TstPob5EEHbemffcl40crjZLGShtdw5Pr8MwNOWo3UQD9MiRei90E8thqW_u81OGw150LvqngwogFF7yUseGKYs Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb004e20c1594762809ba319a68c50b9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 78bdd41026f34da095323a31c14f2606 Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6d5a238e-39c9-4b26-b927-17d5be2ee3bf'} Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:14.700414 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:14.705047 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:14.705047 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:14.705047 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:14.705047 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:14.705047 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:14.705047 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:14.705047 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:14.706608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Returning 404 to user: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:14.711019 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd9907fc-25e1-49f9-9807-fd7bcc68b0a0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 404 len: 111 microversion: 2.1 time: 0.115875 Aug 29 05:29:14.712032 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3345/6682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:14 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:14.714945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:14.723444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-63f4a12b-57ca-441f-bbb0-2aed7c769403 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:14.728834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-63f4a12b-57ca-441f-bbb0-2aed7c769403 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:14.730764 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3d48bb06-3092-4eb8-8d73-6b505feb5dab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1215 microversion: 2.1 time: 0.512702 Aug 29 05:29:14.740101 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3338/6683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:14 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1215 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:14.750082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4565872d-0e90-445f-b874-ca444196361f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '.version_select at 0x7f1ab8591700>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:14.757431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f4a12b-57ca-441f-bbb0-2aed7c769403 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:14.759248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f4a12b-57ca-441f-bbb0-2aed7c769403 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:14.759940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f4a12b-57ca-441f-bbb0-2aed7c769403 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:14.763094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f4a12b-57ca-441f-bbb0-2aed7c769403 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:14.763672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f4a12b-57ca-441f-bbb0-2aed7c769403 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:14.764178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-63f4a12b-57ca-441f-bbb0-2aed7c769403 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:14.808448 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4565872d-0e90-445f-b874-ca444196361f tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-15496103" status: 202 len: 0 microversion: 2.1 time: 0.066500 Aug 29 05:29:14.809356 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3339/6684] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Aug 29 05:29:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-15496103 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:29:14.834847 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-63f4a12b-57ca-441f-bbb0-2aed7c769403 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120172 Aug 29 05:29:14.841371 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3346/6685] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:14 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:15.235767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:15.236979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:15.252494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:15.254967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:15.255609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:15.258720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:15.259387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:15.260635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:15.751506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:15.752158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:15.768570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:15.769327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:15.769994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:15.771589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:15.772515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:15.773261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:16.058017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:16.081319 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68be3f21-27ac-4087-80a5-505f7d49e07a tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.848020 Aug 29 05:29:16.084515 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3340/6686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:15 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:16.127770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-70a07f91-f4d9-4137-91ed-37967423669b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:16.139677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-70a07f91-f4d9-4137-91ed-37967423669b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:16.156078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70a07f91-f4d9-4137-91ed-37967423669b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:16.156864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70a07f91-f4d9-4137-91ed-37967423669b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:16.160433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70a07f91-f4d9-4137-91ed-37967423669b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:16.161438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70a07f91-f4d9-4137-91ed-37967423669b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:16.162075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70a07f91-f4d9-4137-91ed-37967423669b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:16.165125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-70a07f91-f4d9-4137-91ed-37967423669b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:16.244000 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-70a07f91-f4d9-4137-91ed-37967423669b tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157258 Aug 29 05:29:16.252143 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3341/6687] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:16 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:16.263879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-1cdd3d0f-91e8-4dcf-9edc-706acbb5aadc req-e421a8a9-8c94-4c17-b853-7f8381021705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06b1e19-7385-437f-86ae-2e63ca39d0ff", "tag": "125eb6a2-e08b-4ea8-8815-5d549a0b3532"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:16.287418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1cdd3d0f-91e8-4dcf-9edc-706acbb5aadc req-e421a8a9-8c94-4c17-b853-7f8381021705 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:16.290224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1cdd3d0f-91e8-4dcf-9edc-706acbb5aadc req-e421a8a9-8c94-4c17-b853-7f8381021705 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:16.291015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-1cdd3d0f-91e8-4dcf-9edc-706acbb5aadc req-e421a8a9-8c94-4c17-b853-7f8381021705 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:16.344538 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-1cdd3d0f-91e8-4dcf-9edc-706acbb5aadc req-e421a8a9-8c94-4c17-b853-7f8381021705 service nova] Creating event network-changed:125eb6a2-e08b-4ea8-8815-5d549a0b3532 for instance b06b1e19-7385-437f-86ae-2e63ca39d0ff on n-h2-854119-9 Aug 29 05:29:16.359727 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-1cdd3d0f-91e8-4dcf-9edc-706acbb5aadc req-e421a8a9-8c94-4c17-b853-7f8381021705 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108425 Aug 29 05:29:16.360892 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3342/6688] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:16.476501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:16.487558 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-097124a8-c0e9-4fdc-b593-eb0e1c6f2a1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1215 microversion: 2.1 time: 0.740480 Aug 29 05:29:16.496193 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3347/6689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:15 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1215 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:17.107485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:17.108229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:17.125617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:17.126184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:17.126638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:17.127377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:17.127840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:17.132904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:17.260265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55d7ccae-d1c8-4953-8eb2-fc2b72e44675 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:17.264444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55d7ccae-d1c8-4953-8eb2-fc2b72e44675 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:17.281266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d7ccae-d1c8-4953-8eb2-fc2b72e44675 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:17.282029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d7ccae-d1c8-4953-8eb2-fc2b72e44675 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:17.283463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d7ccae-d1c8-4953-8eb2-fc2b72e44675 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:17.285049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d7ccae-d1c8-4953-8eb2-fc2b72e44675 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:17.285733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d7ccae-d1c8-4953-8eb2-fc2b72e44675 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:17.286319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55d7ccae-d1c8-4953-8eb2-fc2b72e44675 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:17.343175 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55d7ccae-d1c8-4953-8eb2-fc2b72e44675 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084912 Aug 29 05:29:17.348692 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3348/6690] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:17 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:29:17.444734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:17.455507 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b80d9eef-f6f5-4e4d-aedc-78fb06ea0d35 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.352163 Aug 29 05:29:17.456769 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3343/6691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:17 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:17.511464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:17.512099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:17.534579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:17.535711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:17.537207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:17.538995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:17.547257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:17.548348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:18.358427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b68b8a08-c755-4eb4-9758-a209214c2fcc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:18.361425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b68b8a08-c755-4eb4-9758-a209214c2fcc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:18.384806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b68b8a08-c755-4eb4-9758-a209214c2fcc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:18.386521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b68b8a08-c755-4eb4-9758-a209214c2fcc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:18.387141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b68b8a08-c755-4eb4-9758-a209214c2fcc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:18.389494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b68b8a08-c755-4eb4-9758-a209214c2fcc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:18.390774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b68b8a08-c755-4eb4-9758-a209214c2fcc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:18.392327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b68b8a08-c755-4eb4-9758-a209214c2fcc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:18.474465 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b68b8a08-c755-4eb4-9758-a209214c2fcc tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120036 Aug 29 05:29:18.478305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:18.482427 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3344/6692] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:18 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:18.493093 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1702fc90-74cd-40fd-990a-62f7a2f24f85 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1215 microversion: 2.1 time: 0.985814 Aug 29 05:29:18.494097 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3349/6693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:17 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1215 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:18.494994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:18.497183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:18.510586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:18.511088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:18.511519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:18.512259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:18.512711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:18.513132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:19.231078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:19.242318 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2333868c-c8db-43a3-ac7d-92d4c62bbba7 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.758481 Aug 29 05:29:19.247390 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3345/6694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:18 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:19.487582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f4d60ac6-6cb4-4989-b19f-5008102f03c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:19.500406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f4d60ac6-6cb4-4989-b19f-5008102f03c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:19.500406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:19.500406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:19.503339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4d60ac6-6cb4-4989-b19f-5008102f03c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:19.503339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4d60ac6-6cb4-4989-b19f-5008102f03c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:19.503339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4d60ac6-6cb4-4989-b19f-5008102f03c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:19.506438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4d60ac6-6cb4-4989-b19f-5008102f03c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:19.506438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4d60ac6-6cb4-4989-b19f-5008102f03c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:19.506728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f4d60ac6-6cb4-4989-b19f-5008102f03c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:19.520320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:19.521140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:19.535708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:19.536231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:19.536665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:19.545363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:19.545851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:19.546289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:19.593384 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f4d60ac6-6cb4-4989-b19f-5008102f03c5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110234 Aug 29 05:29:19.598174 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3350/6695] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:19 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:19.878377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:19.883059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:19.905417 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5fe76c87-0fa2-45cf-837b-f3099f59385c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1215 microversion: 2.1 time: 0.389153 Aug 29 05:29:19.907356 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3346/6696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:19 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1215 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:20.271393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:20.272404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:20.281691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:20.285439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:20.287185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:20.288264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:20.291031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:20.291742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:20.483462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:20.503151 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dd9c5787-864c-429f-bf8f-d4ae24d93f15 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.237535 Aug 29 05:29:20.503806 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3351/6697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:20 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:20.608366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b0406d29-e8f9-4841-b4a6-788ddfb5c394 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:20.612404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b0406d29-e8f9-4841-b4a6-788ddfb5c394 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:20.625530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0406d29-e8f9-4841-b4a6-788ddfb5c394 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:20.626265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0406d29-e8f9-4841-b4a6-788ddfb5c394 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:20.626955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0406d29-e8f9-4841-b4a6-788ddfb5c394 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:20.628579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0406d29-e8f9-4841-b4a6-788ddfb5c394 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:20.629364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0406d29-e8f9-4841-b4a6-788ddfb5c394 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:20.630329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b0406d29-e8f9-4841-b4a6-788ddfb5c394 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:20.665606 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b0406d29-e8f9-4841-b4a6-788ddfb5c394 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063678 Aug 29 05:29:20.666940 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3347/6698] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:20 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:29:20.926108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:20.926714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:20.933747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:20.934234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:20.934663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:20.935368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:20.935814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:20.936269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:21.205125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:21.218188 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0b9128b6-503d-40d6-ae8b-b03e352ba550 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1215 microversion: 2.1 time: 0.295687 Aug 29 05:29:21.219402 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3352/6699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:20 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1215 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:21.526352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:21.527369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:21.533910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:21.534781 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:21.535433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:21.536626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:21.537316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:21.538027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:21.679957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-60f35c49-0976-4a53-b775-d1ad1b6ed977 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:21.682510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-60f35c49-0976-4a53-b775-d1ad1b6ed977 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:21.697750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60f35c49-0976-4a53-b775-d1ad1b6ed977 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:21.698253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60f35c49-0976-4a53-b775-d1ad1b6ed977 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:21.698702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60f35c49-0976-4a53-b775-d1ad1b6ed977 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:21.699849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60f35c49-0976-4a53-b775-d1ad1b6ed977 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:21.700487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60f35c49-0976-4a53-b775-d1ad1b6ed977 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:21.701070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-60f35c49-0976-4a53-b775-d1ad1b6ed977 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:21.722260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:21.734486 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-759dbcac-b54f-47e1-8d66-f7df2125f5e8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.212239 Aug 29 05:29:21.736950 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3348/6700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:21 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:21.764224 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-60f35c49-0976-4a53-b775-d1ad1b6ed977 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089808 Aug 29 05:29:21.768178 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3353/6701] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:21 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:22.239101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:22.239713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:22.251800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:22.252333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:22.252771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:22.253646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:22.254107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:22.254536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:22.545452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:22.557477 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aaa85699-ae75-42b6-b778-a8bd27ddda27 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1215 microversion: 2.1 time: 0.320251 Aug 29 05:29:22.560498 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3349/6702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:22 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:22.561769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c042cf73-3408-46ef-8cea-2625e63b5818 req-cda61e83-e489-4a70-83b3-5b44bab01356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8d8441-1027-49af-924e-d954c35d0dab", "name": "network-vif-plugged", "status": "completed", "tag": "faf36ed5-589f-4e1c-b005-6d2f33f14902"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:22.578162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c042cf73-3408-46ef-8cea-2625e63b5818 req-cda61e83-e489-4a70-83b3-5b44bab01356 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:22.578639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c042cf73-3408-46ef-8cea-2625e63b5818 req-cda61e83-e489-4a70-83b3-5b44bab01356 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:22.579056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c042cf73-3408-46ef-8cea-2625e63b5818 req-cda61e83-e489-4a70-83b3-5b44bab01356 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:22.609832 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c042cf73-3408-46ef-8cea-2625e63b5818 req-cda61e83-e489-4a70-83b3-5b44bab01356 service nova] Creating event network-vif-plugged:faf36ed5-589f-4e1c-b005-6d2f33f14902 for instance 0a8d8441-1027-49af-924e-d954c35d0dab on n-h1-854119-9 Aug 29 05:29:22.616426 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c042cf73-3408-46ef-8cea-2625e63b5818 req-cda61e83-e489-4a70-83b3-5b44bab01356 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058414 Aug 29 05:29:22.618437 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3354/6703] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:22.756777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:22.757386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:22.764549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:22.765354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:22.766026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:22.766974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:22.767633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:22.768292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:22.777780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-30aa7be7-912f-421b-8db7-da848bb87cdf tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:22.781544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-30aa7be7-912f-421b-8db7-da848bb87cdf tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:22.794389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30aa7be7-912f-421b-8db7-da848bb87cdf tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:22.795102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30aa7be7-912f-421b-8db7-da848bb87cdf tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:22.795502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30aa7be7-912f-421b-8db7-da848bb87cdf tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:22.796026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30aa7be7-912f-421b-8db7-da848bb87cdf tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:22.796667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30aa7be7-912f-421b-8db7-da848bb87cdf tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:22.797090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-30aa7be7-912f-421b-8db7-da848bb87cdf tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:22.870745 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-30aa7be7-912f-421b-8db7-da848bb87cdf tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098422 Aug 29 05:29:22.877698 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3355/6704] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:22 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:23.072918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:23.084452 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97db881e-03ea-466d-bfe5-45801caabd6d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.331311 Aug 29 05:29:23.138104 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3350/6705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:22 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:23.580565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:23.581999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:23.591624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:23.592903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:23.595685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:23.598846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:23.599482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:23.600823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:23.847349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:23.866758 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ff68d422-d488-4882-a588-cbb439f1126e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1215 microversion: 2.1 time: 0.291501 Aug 29 05:29:23.870751 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3356/6706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:23 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1215 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:23.885524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d906a82-2da7-45ed-bdb0-82170210d8d7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:23.888554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d906a82-2da7-45ed-bdb0-82170210d8d7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:23.905024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d906a82-2da7-45ed-bdb0-82170210d8d7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:23.905763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d906a82-2da7-45ed-bdb0-82170210d8d7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:23.906375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d906a82-2da7-45ed-bdb0-82170210d8d7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:23.907256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d906a82-2da7-45ed-bdb0-82170210d8d7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:23.907866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d906a82-2da7-45ed-bdb0-82170210d8d7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:23.908315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d906a82-2da7-45ed-bdb0-82170210d8d7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:23.963549 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d906a82-2da7-45ed-bdb0-82170210d8d7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082151 Aug 29 05:29:23.969348 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3351/6707] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:29:23 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:29:24.039808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:24.040287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:24.047180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:24.047763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:24.048208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:24.049063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:24.049660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:24.050225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:24.079862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:29:24.126537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:24.127417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:24.149639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:24.151536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:24.152148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:24.154956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:24.155736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:24.168451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:24.250645 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6c312ce9-f7e1-4842-b972-5f7e593ceb9d tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 204 len: 0 microversion: 2.1 time: 0.216680 Aug 29 05:29:24.255790 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3357/6708] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:29:24 2022] DELETE /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:29:24.262062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:24.263302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:24.272496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:24.273446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:24.274036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:24.274995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:24.275692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:24.276554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:24.412036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:24.445163 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6710ea89-5186-45d0-ae17-029569cf75c6 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1270 microversion: 2.1 time: 0.322837 Aug 29 05:29:24.470770 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3352/6709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:24 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1270 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:24.585872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:24.595298 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6dac21e4-fa9f-4ba4-a3dd-cdca90a092e7 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1682 microversion: 2.1 time: 0.337585 Aug 29 05:29:24.614733 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3358/6710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:24 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1682 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:24.887594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:24.888965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:24.896991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:24.897834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:24.898272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:24.898986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:24.899983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:24.900648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:25.059065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:25.069374 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ca1d536-c0e1-460b-981a-4954949bea9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1215 microversion: 2.1 time: 0.186062 Aug 29 05:29:25.070471 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3353/6711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:24 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:25.466422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:25.467036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:25.473119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:25.473592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:25.474235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:25.475082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:25.475714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:25.476324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:25.626228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:25.627024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:25.638231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:25.638729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:25.639234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:25.643748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:25.644286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:25.644731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:25.885494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:25.897334 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a614732a-9576-4f25-84c3-3ce8d15f77e9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1460 microversion: 2.1 time: 0.432395 Aug 29 05:29:25.898027 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3359/6712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:25 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1460 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:25.922052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:25.922841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:25.933431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:25.940467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:25.941042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:25.942249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:25.943128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:25.943895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:25.954534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:25.965035 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-55f79955-0d91-4a02-acba-ca64e1520152 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1682 microversion: 2.1 time: 0.346641 Aug 29 05:29:25.985179 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3354/6713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:25 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1682 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:26.104449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:26.105362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:26.111987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:26.112794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:26.113419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:26.114360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:26.115008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:26.115588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:26.231227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:26.234908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:26.239551 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-068773cd-5751-4af1-9c3b-8ea9e754545b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1460 microversion: 2.1 time: 0.321832 Aug 29 05:29:26.240152 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3360/6714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:25 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1460 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:26.363793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:26.373034 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-589870fc-36a9-4b56-b40d-b98a47ade165 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1203 microversion: 2.1 time: 0.286160 Aug 29 05:29:26.374243 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3355/6715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:26 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1203 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:27.007852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:27.009156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:27.017932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:27.018718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:27.020482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:27.023342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:27.024043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:27.025681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:27.394077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:27.394744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:27.406595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:27.411801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:27.412487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:27.414350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:27.414995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:27.415621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:27.515586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:27.528833 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea4ccc1f-a40c-4c10-94f5-db31ddafff34 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1682 microversion: 2.1 time: 0.520864 Aug 29 05:29:27.529574 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3361/6716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:27 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1682 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:27.694709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:27.709079 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8a069c31-7c69-4ee1-9255-6ee065c4e7a3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1203 microversion: 2.1 time: 0.318537 Aug 29 05:29:27.712280 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3356/6717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:27 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1203 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:28.558157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:28.558157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:28.576993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:28.578437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:28.579056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:28.580029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:28.581801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:28.583209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:28.739033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:28.746372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:28.761720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:28.767667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:28.768145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:28.768931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:28.769381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:28.773238 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:29.016215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:29.025309 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-25cbf908-fcd1-4b02-a8a7-de21a37c5ca8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1614 microversion: 2.1 time: 0.475638 Aug 29 05:29:29.025901 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3362/6718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:28 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1614 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:29.209469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:29.220917 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c43c8413-3120-45d5-a974-30c4e0297956 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1203 microversion: 2.1 time: 0.490325 Aug 29 05:29:29.221746 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3357/6719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:28 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1203 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:30.026959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9e6066ad-36bf-4cb2-8601-74325ea43842 req-fd902d7a-012b-4e28-8e49-615885781d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a8d8441-1027-49af-924e-d954c35d0dab", "tag": "faf36ed5-589f-4e1c-b005-6d2f33f14902"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:30.050722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:30.051996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:30.088165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9e6066ad-36bf-4cb2-8601-74325ea43842 req-fd902d7a-012b-4e28-8e49-615885781d78 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:30.088616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:30.108959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:30.109855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9e6066ad-36bf-4cb2-8601-74325ea43842 req-fd902d7a-012b-4e28-8e49-615885781d78 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:30.110453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9e6066ad-36bf-4cb2-8601-74325ea43842 req-fd902d7a-012b-4e28-8e49-615885781d78 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:30.112895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:30.114064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:30.116531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:30.125690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:30.163788 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9e6066ad-36bf-4cb2-8601-74325ea43842 req-fd902d7a-012b-4e28-8e49-615885781d78 service nova] Creating event network-changed:faf36ed5-589f-4e1c-b005-6d2f33f14902 for instance 0a8d8441-1027-49af-924e-d954c35d0dab on n-h1-854119-9 Aug 29 05:29:30.173472 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9e6066ad-36bf-4cb2-8601-74325ea43842 req-fd902d7a-012b-4e28-8e49-615885781d78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149560 Aug 29 05:29:30.175923 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3363/6720] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:30.247743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:30.248572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:30.261164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:30.261656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:30.264469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:30.265679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:30.266227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:30.266720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:30.483761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6430b480c54898b9ed01529f25049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5039ad3dc0f947d68d7ff5b0724f5926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:30.495710 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4c76af4a-4e64-4cdc-bba5-cf16c3c9d6e8 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 200 len: 1614 microversion: 2.1 time: 0.453452 Aug 29 05:29:30.503906 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3358/6721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:30 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 1614 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:30.514712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-850d8898-941f-48e5-94b5-41bf10f6eec0 req-af636c4b-5525-4d0e-9d46-0866c22ce0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5ca19b-3af5-4450-8826-7b31d6e8a098", "name": "network-vif-deleted", "tag": "67810816-2417-4cb8-8d2b-96dd9fa06a7c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:30.560936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-850d8898-941f-48e5-94b5-41bf10f6eec0 req-af636c4b-5525-4d0e-9d46-0866c22ce0e2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:30.562444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-850d8898-941f-48e5-94b5-41bf10f6eec0 req-af636c4b-5525-4d0e-9d46-0866c22ce0e2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:30.563034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-850d8898-941f-48e5-94b5-41bf10f6eec0 req-af636c4b-5525-4d0e-9d46-0866c22ce0e2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:30.592505 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-850d8898-941f-48e5-94b5-41bf10f6eec0 req-af636c4b-5525-4d0e-9d46-0866c22ce0e2 service nova] Creating event network-vif-deleted:67810816-2417-4cb8-8d2b-96dd9fa06a7c for instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 on n-h2-854119-9 Aug 29 05:29:30.625106 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-850d8898-941f-48e5-94b5-41bf10f6eec0 req-af636c4b-5525-4d0e-9d46-0866c22ce0e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119636 Aug 29 05:29:30.627876 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3359/6722] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:30.859948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:30.880884 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-46152262-586b-472f-9a93-4a33ddc1ca28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1203 microversion: 2.1 time: 0.637920 Aug 29 05:29:30.894000 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3364/6723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:30 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1203 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:31.518684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:31.519382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:31.533957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:31.534377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:31.534812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:31.535541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:31.535985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:31.536433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:31.577518 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 HTTP/1.1 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7e5ca19b-3af5-4450-8826-7b31d6e8a098'} Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:31.579204 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9515fc97-0804-4ea8-97c2-7d472d6edad0 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 404 len: 111 microversion: 2.1 time: 0.067285 Aug 29 05:29:31.584037 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3360/6724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:31 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:31.589701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c924403f-f61d-4151-9a66-bd3c4941dc45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '.version_select at 0x7f1ab8973e50>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:31.635114 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c924403f-f61d-4151-9a66-bd3c4941dc45 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024541327" status: 202 len: 0 microversion: 2.1 time: 0.049190 Aug 29 05:29:31.636011 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3365/6725] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 05:29:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024541327 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:29:31.903424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:31.904048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:31.914398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:31.918178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:31.918878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:31.923900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:31.925193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:31.926016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:32.315228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:32.325128 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-908b207a-6d0d-4558-80de-d97be8996f3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1203 microversion: 2.1 time: 0.425602 Aug 29 05:29:32.326499 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3361/6726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:31 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1203 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:33.373747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:33.375404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:33.396581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:33.398422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:33.400267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:33.403134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:33.404273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:33.404794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:33.475755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-bddbbadd-b9bc-4088-82a5-7eb68e9b70fd req-a72c43d1-572d-41f1-a404-59c9861fd244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a8d8441-1027-49af-924e-d954c35d0dab", "tag": "faf36ed5-589f-4e1c-b005-6d2f33f14902"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:33.496620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bddbbadd-b9bc-4088-82a5-7eb68e9b70fd req-a72c43d1-572d-41f1-a404-59c9861fd244 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:33.499331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bddbbadd-b9bc-4088-82a5-7eb68e9b70fd req-a72c43d1-572d-41f1-a404-59c9861fd244 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:33.499943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bddbbadd-b9bc-4088-82a5-7eb68e9b70fd req-a72c43d1-572d-41f1-a404-59c9861fd244 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:33.525989 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-bddbbadd-b9bc-4088-82a5-7eb68e9b70fd req-a72c43d1-572d-41f1-a404-59c9861fd244 service nova] Creating event network-changed:faf36ed5-589f-4e1c-b005-6d2f33f14902 for instance 0a8d8441-1027-49af-924e-d954c35d0dab on n-h1-854119-9 Aug 29 05:29:33.536332 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-bddbbadd-b9bc-4088-82a5-7eb68e9b70fd req-a72c43d1-572d-41f1-a404-59c9861fd244 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063596 Aug 29 05:29:33.539978 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3362/6727] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:34.413228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:34.427398 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06572cf5-0fc3-420d-aaa6-178070377ead tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1203 microversion: 2.1 time: 1.083145 Aug 29 05:29:34.428549 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3366/6728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:33 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1203 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:35.451894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:35.453070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:35.475451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:35.475973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:35.476851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:35.479931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:35.485246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:35.487145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:35.563868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5f160e16-e3cb-4eb2-93f4-2a6149e12e97 req-35b61a56-f278-420d-ab93-1b3a8fe1cb59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a8d8441-1027-49af-924e-d954c35d0dab", "tag": "faf36ed5-589f-4e1c-b005-6d2f33f14902"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:35.599286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5f160e16-e3cb-4eb2-93f4-2a6149e12e97 req-35b61a56-f278-420d-ab93-1b3a8fe1cb59 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:35.599995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5f160e16-e3cb-4eb2-93f4-2a6149e12e97 req-35b61a56-f278-420d-ab93-1b3a8fe1cb59 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:35.600255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5f160e16-e3cb-4eb2-93f4-2a6149e12e97 req-35b61a56-f278-420d-ab93-1b3a8fe1cb59 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:35.638743 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5f160e16-e3cb-4eb2-93f4-2a6149e12e97 req-35b61a56-f278-420d-ab93-1b3a8fe1cb59 service nova] Creating event network-changed:faf36ed5-589f-4e1c-b005-6d2f33f14902 for instance 0a8d8441-1027-49af-924e-d954c35d0dab on n-h1-854119-9 Aug 29 05:29:35.649491 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5f160e16-e3cb-4eb2-93f4-2a6149e12e97 req-35b61a56-f278-420d-ab93-1b3a8fe1cb59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095678 Aug 29 05:29:35.650105 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3367/6729] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:29:36.159515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:36.172038 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-13045ee8-b5e1-4836-99fc-618f2c05fb22 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1203 microversion: 2.1 time: 0.720771 Aug 29 05:29:36.172916 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3363/6730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:35 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1203 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:36.558259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:36.559394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:36.571502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:36.572159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:36.576533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:36.577303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:36.577773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:36.578204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:36.609477 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] HTTP exception thrown: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Request method failure captured: Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf HTTP/1.1 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEyx4gTPkmmeipeKem59YTyW3XgB_hVHiK4YvZ-HMrD_RVfxUWIvGJIAJ1_GXjt94zavkoiTAB4F3wbwR5ZI5fH8TstPob5EEHbemffcl40crjZLGShtdw5Pr8MwNOWo3UQD9MiRei90E8thqW_u81OGw150LvqngwogFF7yUseGKYs Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb004e20c1594762809ba319a68c50b9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 78bdd41026f34da095323a31c14f2606 Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6d5a238e-39c9-4b26-b927-17d5be2ee3bf'} Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:36.615173 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.619756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Returning 404 to user: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:36.620996 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-49835421-262b-41f8-8ba6-c5aaa3b6752a tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 404 len: 111 microversion: 2.1 time: 0.069965 Aug 29 05:29:36.621739 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3368/6731] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:29:36 2022] DELETE /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:36.629746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:36.630935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 6d5a238e-39c9-4b26-b927-17d5be2ee3bf] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:36.643366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:36.644316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:36.645273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:36.648948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:36.649584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:36.650762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:36.682065 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] HTTP exception thrown: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Request method failure captured: Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf HTTP/1.1 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEyx4gTPkmmeipeKem59YTyW3XgB_hVHiK4YvZ-HMrD_RVfxUWIvGJIAJ1_GXjt94zavkoiTAB4F3wbwR5ZI5fH8TstPob5EEHbemffcl40crjZLGShtdw5Pr8MwNOWo3UQD9MiRei90E8thqW_u81OGw150LvqngwogFF7yUseGKYs Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb004e20c1594762809ba319a68c50b9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 78bdd41026f34da095323a31c14f2606 Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6d5a238e-39c9-4b26-b927-17d5be2ee3bf'} Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:36.687783 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.691667 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:36.691667 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:36.691667 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:36.691667 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:36.691667 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:36.691667 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. Aug 29 05:29:36.691667 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:36.693893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Returning 404 to user: Instance 6d5a238e-39c9-4b26-b927-17d5be2ee3bf could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:36.696787 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f5fc71dd-f6ec-4eb2-a4b1-86032fcfadcf tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf" status: 404 len: 111 microversion: 2.1 time: 0.070950 Aug 29 05:29:36.701602 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3364/6732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:36 2022] GET /compute/v2.1/servers/6d5a238e-39c9-4b26-b927-17d5be2ee3bf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:37.193377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:37.194452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:37.203608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:37.206826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:37.207598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:37.210777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:37.211567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:37.212279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:37.687421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4d7154f0-63e6-4b0c-8dd9-bf059c865f77 req-0ec8c2fc-9ca2-4bf7-97c8-d698f634058c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b1e19-7385-437f-86ae-2e63ca39d0ff", "name": "network-vif-plugged", "status": "completed", "tag": "125eb6a2-e08b-4ea8-8815-5d549a0b3532"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:37.702765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4d7154f0-63e6-4b0c-8dd9-bf059c865f77 req-0ec8c2fc-9ca2-4bf7-97c8-d698f634058c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:37.709849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4d7154f0-63e6-4b0c-8dd9-bf059c865f77 req-0ec8c2fc-9ca2-4bf7-97c8-d698f634058c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:37.710595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4d7154f0-63e6-4b0c-8dd9-bf059c865f77 req-0ec8c2fc-9ca2-4bf7-97c8-d698f634058c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:37.740648 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4d7154f0-63e6-4b0c-8dd9-bf059c865f77 req-0ec8c2fc-9ca2-4bf7-97c8-d698f634058c service nova] Creating event network-vif-plugged:125eb6a2-e08b-4ea8-8815-5d549a0b3532 for instance b06b1e19-7385-437f-86ae-2e63ca39d0ff on n-h2-854119-9 Aug 29 05:29:37.757985 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4d7154f0-63e6-4b0c-8dd9-bf059c865f77 req-0ec8c2fc-9ca2-4bf7-97c8-d698f634058c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074652 Aug 29 05:29:37.759464 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3365/6733] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:29:38.168192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:38.179248 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-16e56e15-8535-4908-abcd-e5ced65e00b7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1203 microversion: 2.1 time: 0.990260 Aug 29 05:29:38.181472 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3369/6734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:37 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1203 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:38.991042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:38.992267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:38.999593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:39.002080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:39.003224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:39.004085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:39.005578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:39.006369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:39.007026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:39.038151 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 HTTP/1.1 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '7e5ca19b-3af5-4450-8826-7b31d6e8a098'} Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:39.041370 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:39.045778 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c92d1c67-31f6-4fb5-8125-8b9271a0b55e tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 404 len: 111 microversion: 2.1 time: 0.058032 Aug 29 05:29:39.047282 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3366/6735] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:29:38 2022] DELETE /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:39.052967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:39.053784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 7e5ca19b-3af5-4450-8826-7b31d6e8a098] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:39.062871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:39.065435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:39.066195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:39.066908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:39.068465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:39.069280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:39.070581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:39.102338 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 HTTP/1.1 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '7e5ca19b-3af5-4450-8826-7b31d6e8a098'} Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:39.103946 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance 7e5ca19b-3af5-4450-8826-7b31d6e8a098 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c585532e-1c0f-4810-bcd1-a69dacea19b5 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098" status: 404 len: 111 microversion: 2.1 time: 0.057161 Aug 29 05:29:39.108100 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3370/6736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:39 2022] GET /compute/v2.1/servers/7e5ca19b-3af5-4450-8826-7b31d6e8a098 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:39.202769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:39.204097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:39.215255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:39.215756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:39.216230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:39.216978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:39.217430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:39.225054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:39.289246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=100 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:39.516952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:39.531277 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b739be84-6757-4569-bd0e-40e2589f5e3d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1203 microversion: 2.1 time: 0.330051 Aug 29 05:29:39.532535 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3367/6737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:39 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1203 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:40.556536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:40.558067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:40.568053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:40.569011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:40.569690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:40.570811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:40.571504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:40.573647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:40.813077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:40.824519 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-769bbf75-40b2-44c6-aefa-9559126ea4c1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1389 microversion: 2.1 time: 0.273373 Aug 29 05:29:40.826135 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3371/6738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:40 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1389 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:40.851589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:40.852254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:40.865558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:40.866048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:40.866485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:40.867205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:40.867643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:40.868200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:41.236742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:41.249724 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7fd70443-169b-4233-93d7-3fae6ebf7923 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1389 microversion: 2.1 time: 0.403174 Aug 29 05:29:41.268712 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3368/6739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:40 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1389 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:41.275473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:41.276093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:41.283078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:41.283575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:41.285038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:41.285948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:41.286571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:41.287190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:41.545000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:41.553787 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4f8edb3d-f448-4ba3-8ef5-72054d28ff01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1389 microversion: 2.1 time: 0.282110 Aug 29 05:29:41.569186 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3372/6740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:41 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1389 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:41.575795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:41.576594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:41.583944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:41.584692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:41.585319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:41.586191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:41.586804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:41.587543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:41.655874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:29:41.788882 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d55a93cb-69ef-4622-a041-241d58e54658 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 204 len: 0 microversion: 2.1 time: 0.216199 Aug 29 05:29:41.790141 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3369/6741] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:29:41 2022] DELETE /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:29:41.808722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:41.808722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:41.819363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:41.819867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:41.820343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:41.821227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:41.821864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:41.822449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:42.055749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:42.064443 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2b2d73cd-690d-4c2d-bcca-d711e3849655 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1395 microversion: 2.1 time: 0.268001 Aug 29 05:29:42.073375 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3373/6742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:41 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1395 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:42.320608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:42.321764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:42.330771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:42.331509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:42.332101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:42.332989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:42.333712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:42.334321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:42.355503 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] HTTP exception thrown: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Request method failure captured: Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba HTTP/1.1 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEyx4gTPkmmeipeKem59YTyW3XgB_hVHiK4YvZ-HMrD_RVfxUWIvGJIAJ1_GXjt94zavkoiTAB4F3wbwR5ZI5fH8TstPob5EEHbemffcl40crjZLGShtdw5Pr8MwNOWo3UQD9MiRei90E8thqW_u81OGw150LvqngwogFF7yUseGKYs Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb004e20c1594762809ba319a68c50b9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 78bdd41026f34da095323a31c14f2606 Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '635e3272-74c9-40af-931a-531bb7658fba'} Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:42.358208 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.362629 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.364349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Returning 404 to user: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:42.365420 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fbab2c4a-b3ed-4b6a-b697-09ff74e7aa8e tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "DELETE /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 404 len: 111 microversion: 2.1 time: 0.051957 Aug 29 05:29:42.367084 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3370/6743] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:29:42 2022] DELETE /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:42.375674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:42.376814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] [instance: 635e3272-74c9-40af-931a-531bb7658fba] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:42.385790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:42.386574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:42.387160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:42.388892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:42.391083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:42.392380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:42.408964 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] HTTP exception thrown: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Request method failure captured: Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba HTTP/1.1 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEyx4gTPkmmeipeKem59YTyW3XgB_hVHiK4YvZ-HMrD_RVfxUWIvGJIAJ1_GXjt94zavkoiTAB4F3wbwR5ZI5fH8TstPob5EEHbemffcl40crjZLGShtdw5Pr8MwNOWo3UQD9MiRei90E8thqW_u81OGw150LvqngwogFF7yUseGKYs Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb004e20c1594762809ba319a68c50b9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb004e20c1594762809ba319a68c50b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fb004e20c1594762809ba319a68c50b9 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971144147 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 78bdd41026f34da095323a31c14f2606 Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeTestJSON-1971144147-project Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '635e3272-74c9-40af-931a-531bb7658fba'} Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:42.411116 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.415704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:42.415704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:42.415704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:42.415704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:42.415704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:42.415704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. Aug 29 05:29:42.415704 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:42.417171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] Returning 404 to user: Instance 635e3272-74c9-40af-931a-531bb7658fba could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:42.418184 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d5702e8e-8492-4256-991d-0df1114c60b0 tempest-AttachVolumeTestJSON-1971144147 tempest-AttachVolumeTestJSON-1971144147-project] 10.222.0.20 "GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba" status: 404 len: 111 microversion: 2.1 time: 0.047236 Aug 29 05:29:42.419207 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3374/6744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:42 2022] GET /compute/v2.1/servers/635e3272-74c9-40af-931a-531bb7658fba => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:43.087838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:43.088598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:43.104092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:43.104935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:43.106595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:43.107953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:43.109736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:43.110189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:43.470883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:43.484641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-35756afd-8dce-41fb-be13-090c536a72ab tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1395 microversion: 2.1 time: 0.401373 Aug 29 05:29:43.487367 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3371/6745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:43 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1395 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:44.185083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-26bac71f-385c-49df-99f3-fa6bc6d5ec70 req-2737dcc3-d0b7-4851-8ea9-47462dea2c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b1e19-7385-437f-86ae-2e63ca39d0ff", "name": "network-vif-deleted", "tag": "125eb6a2-e08b-4ea8-8815-5d549a0b3532"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:29:44.200710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-26bac71f-385c-49df-99f3-fa6bc6d5ec70 req-2737dcc3-d0b7-4851-8ea9-47462dea2c17 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:44.201231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-26bac71f-385c-49df-99f3-fa6bc6d5ec70 req-2737dcc3-d0b7-4851-8ea9-47462dea2c17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:44.201663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-26bac71f-385c-49df-99f3-fa6bc6d5ec70 req-2737dcc3-d0b7-4851-8ea9-47462dea2c17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:44.223118 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-26bac71f-385c-49df-99f3-fa6bc6d5ec70 req-2737dcc3-d0b7-4851-8ea9-47462dea2c17 service nova] Creating event network-vif-deleted:125eb6a2-e08b-4ea8-8815-5d549a0b3532 for instance b06b1e19-7385-437f-86ae-2e63ca39d0ff on n-h2-854119-9 Aug 29 05:29:44.229939 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-26bac71f-385c-49df-99f3-fa6bc6d5ec70 req-2737dcc3-d0b7-4851-8ea9-47462dea2c17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048648 Aug 29 05:29:44.237650 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3375/6746] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:29:44.521728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:44.522392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:44.531905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:44.536024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:44.536829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:44.537896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:44.541122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:44.541744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:44.724240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:44.743899 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-82270f26-fa25-4ae1-a2b4-5bc65518cfff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1188 microversion: 2.1 time: 0.236036 Aug 29 05:29:44.765440 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3372/6747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:44 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1188 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:45.782866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:45.783539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:45.814111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:45.814649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:45.821571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:45.824387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:45.826309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:45.827385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:46.167540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:46.182488 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8228fe44-bb75-4cca-8b30-0bdca6f8881a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1188 microversion: 2.1 time: 0.407990 Aug 29 05:29:46.188696 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3376/6748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:45 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1188 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:46.989692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:46.991020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:46.999019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:46.999841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.000695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.001830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:47.024954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.026725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.048546 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 HTTP/1.1 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'daaf5180-0cbc-4564-807b-563d307e99d7'} Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:47.050712 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.056861 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.062847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:47.064038 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c2c5071-1a17-4ae3-a4a7-d87d3f513fda tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 404 len: 111 microversion: 2.1 time: 0.078863 Aug 29 05:29:47.067859 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3373/6749] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:29:46 2022] DELETE /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:47.076548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:47.077360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: daaf5180-0cbc-4564-807b-563d307e99d7] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:47.093954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:47.094461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.094900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.095626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:47.096080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.099651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.133643 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 HTTP/1.1 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'daaf5180-0cbc-4564-807b-563d307e99d7'} Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:47.138275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.143464 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.143464 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:47.143464 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:47.143464 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:47.143464 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:47.143464 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. Aug 29 05:29:47.143464 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.149164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance daaf5180-0cbc-4564-807b-563d307e99d7 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:47.150919 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21c0a291-5ce1-4560-99b8-a58808278972 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7" status: 404 len: 111 microversion: 2.1 time: 0.078547 Aug 29 05:29:47.151671 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3377/6750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:47 2022] GET /compute/v2.1/servers/daaf5180-0cbc-4564-807b-563d307e99d7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:47.160382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:47.161141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:47.168345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:47.169389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.170479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.171421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:47.172351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.173008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.189557 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d HTTP/1.1 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ca7086a3-4bf4-4069-92a4-dc6185fafe8d'} Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:47.191636 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.197183 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.207914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:47.208761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:47.212505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:47.215447 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9152ceb1-eee9-4895-9831-bfefae82d791 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 404 len: 111 microversion: 2.1 time: 0.059228 Aug 29 05:29:47.216581 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3374/6751] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:29:47 2022] DELETE /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:47.218979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:47.232706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.235876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.236949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:47.237354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:47.237766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.238179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: ca7086a3-4bf4-4069-92a4-dc6185fafe8d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:47.238557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.246012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:47.247836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.248584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.249530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:47.250236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:47.251070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:47.270399 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d HTTP/1.1 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ca7086a3-4bf4-4069-92a4-dc6185fafe8d'} Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:47.273339 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.280524 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:47.280524 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:47.280524 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:47.280524 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:47.280524 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:47.280524 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. Aug 29 05:29:47.280524 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:47.283743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance ca7086a3-4bf4-4069-92a4-dc6185fafe8d could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:47.285039 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f2f320e3-9679-47f8-a702-db6ef5dc2dc6 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d" status: 404 len: 111 microversion: 2.1 time: 0.053950 Aug 29 05:29:47.286384 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3375/6752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:47 2022] GET /compute/v2.1/servers/ca7086a3-4bf4-4069-92a4-dc6185fafe8d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:47.581636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:47.594105 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28a07968-c860-45a6-a25d-239275e5d580 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1188 microversion: 2.1 time: 0.390558 Aug 29 05:29:47.595537 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3378/6753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:47 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1188 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:29:48.624010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:48.624751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:48.642991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:48.643470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:48.643911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:48.644644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:48.645092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:48.645522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:48.867268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:48.892025 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cedf2570-1c1f-48ce-b2bd-2add801805fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1188 microversion: 2.1 time: 0.272272 Aug 29 05:29:48.907778 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3376/6754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:48 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:49.917639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:49.918991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:49.953616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:49.954045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:49.954476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:49.955199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:49.955654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:49.956076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:50.183296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:50.195785 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-009b6ffa-e4a4-4122-8487-8c97057812e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1188 microversion: 2.1 time: 0.279734 Aug 29 05:29:50.197330 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3379/6755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:49 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1188 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:51.220554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:51.221828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:51.234516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:51.235216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:51.235810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:51.241436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:51.244076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:51.244564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:51.346826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:29:51.358653 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-991c360d-5f84-41ee-a384-9fe33ef5052f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 200 len: 1188 microversion: 2.1 time: 0.141927 Aug 29 05:29:51.359412 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3377/6756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:51 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 1188 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:29:52.378898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:52.379515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: b06b1e19-7385-437f-86ae-2e63ca39d0ff] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:52.388960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:52.391368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:52.393155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:52.394846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:52.395671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:52.397669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:52.427062 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance b06b1e19-7385-437f-86ae-2e63ca39d0ff could not be found. Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff HTTP/1.1 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance b06b1e19-7385-437f-86ae-2e63ca39d0ff could not be found. Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'b06b1e19-7385-437f-86ae-2e63ca39d0ff'} Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06b1e19-7385-437f-86ae-2e63ca39d0ff could not be found. Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06b1e19-7385-437f-86ae-2e63ca39d0ff could not be found. Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:52.429457 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:52.433734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:52.433734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:52.433734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:52.433734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:52.433734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:52.433734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06b1e19-7385-437f-86ae-2e63ca39d0ff could not be found. Aug 29 05:29:52.433734 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:52.436467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance b06b1e19-7385-437f-86ae-2e63ca39d0ff could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:52.437855 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-787f822a-e93d-4ab4-8166-3c5566ac6257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff" status: 404 len: 111 microversion: 2.1 time: 0.062932 Aug 29 05:29:52.438990 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3380/6757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:52 2022] GET /compute/v2.1/servers/b06b1e19-7385-437f-86ae-2e63ca39d0ff => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:58.459688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:58.460300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:58.484142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:58.484663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:58.485106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:58.485843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:58.486328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:58.486756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:58.509763 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 HTTP/1.1 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '9c32e9f9-9b4d-4503-9659-ca08f6ce7328'} Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:58.518977 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.523916 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.524851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:58.525884 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d96b671e-0fbb-4efe-a38a-85321deb40de tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 404 len: 111 microversion: 2.1 time: 0.070920 Aug 29 05:29:58.526477 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3378/6758] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:29:58 2022] DELETE /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:29:58.534775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:29:58.535418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] [instance: 9c32e9f9-9b4d-4503-9659-ca08f6ce7328] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:29:58.545115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:58.547260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:58.547711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:58.555104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:29:58.555625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:29:58.556071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:29:58.560740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=83 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:29:58.591882 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] HTTP exception thrown: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Request method failure captured: Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 HTTP/1.1 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDEx_p9J18Wb2kWTV8CfXZiYZ34O4guVKLaFEr2wCwlRilz45wS6Tug2IfQZZ5eRPeofszhd5DTjVHc1eMaU8AUgh2rnqGP7MnGD3AFPLp4UM4NJTefNOd1uuwHX3UexiyUTLpFDHX71XkWSOL_oAE1_5vRMamt23NJ9rgU1ELUA7GL4 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5039ad3dc0f947d68d7ff5b0724f5926", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5039ad3dc0f947d68d7ff5b0724f5926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 5039ad3dc0f947d68d7ff5b0724f5926 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1852939451 Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: ca6430b480c54898b9ed01529f25049a Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-AttachVolumeNegativeTest-1852939451-project Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '9c32e9f9-9b4d-4503-9659-ca08f6ce7328'} Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:29:58.595505 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.600219 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:29:58.600219 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:29:58.600219 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:29:58.600219 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:29:58.600219 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:29:58.600219 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. Aug 29 05:29:58.600219 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:29:58.604259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] Returning 404 to user: Instance 9c32e9f9-9b4d-4503-9659-ca08f6ce7328 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:29:58.609424 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09f277b3-1ca0-4402-a6e7-f44f26488329 tempest-AttachVolumeNegativeTest-1852939451 tempest-AttachVolumeNegativeTest-1852939451-project] 10.222.0.20 "GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328" status: 404 len: 111 microversion: 2.1 time: 0.078514 Aug 29 05:29:58.610882 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3381/6759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:29:58 2022] GET /compute/v2.1/servers/9c32e9f9-9b4d-4503-9659-ca08f6ce7328 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 05:30:02.873006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-316103771", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ba42af1e-b65b-4db9-9100-9ce1f0370fc1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77c879e8-8923-4ae0-9869-fe659563295c"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:03.036903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] validate_networks() for [('77c879e8-8923-4ae0-9869-fe659563295c', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:30:04.786549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:30:04.787161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:30:04.787411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:30:04.787817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:30:04.788257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:30:04.806542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:04.807033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:04.807472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:04.808211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:04.808664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:04.809085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:04.827217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:30:04.834524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for user 83565ba99afd41f4b0d5de74365c3b2f and project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:30:04.930829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:30:04.932896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba42af1e-b65b-4db9-9100-9ce1f0370fc1',volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:30:05.228089 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-49749e98-c628-42fb-9714-74251430b548 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.347611 Aug 29 05:30:05.231485 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3379/6760] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:30:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:30:05.258879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-075ea9ea-18e3-4efc-9e1f-dae6db4708b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:05.259747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-075ea9ea-18e3-4efc-9e1f-dae6db4708b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:05.414989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-075ea9ea-18e3-4efc-9e1f-dae6db4708b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:05.429334 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-075ea9ea-18e3-4efc-9e1f-dae6db4708b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1056 microversion: 2.1 time: 0.188817 Aug 29 05:30:05.433750 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3382/6761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:05 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1056 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:06.456789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:06.458762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:06.474375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:06.475201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:06.478179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:06.482164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:06.484950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:06.488783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:06.612761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:06.627210 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e74a8c48-93c2-43f5-a5af-310e97f7c5f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1154 microversion: 2.1 time: 0.176125 Aug 29 05:30:06.628630 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3380/6762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:06 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1154 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:07.429169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:07.430302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:07.441229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:07.442015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:07.443188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:07.444066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:07.444707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:07.445285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:07.451171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e9f5ff75-4bcc-4371-ae2e-b24c16b6850a req-3e824630-9b55-47ce-84a6-f00b2f32cc1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a8d8441-1027-49af-924e-d954c35d0dab", "tag": "faf36ed5-589f-4e1c-b005-6d2f33f14902"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:07.468997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e9f5ff75-4bcc-4371-ae2e-b24c16b6850a req-3e824630-9b55-47ce-84a6-f00b2f32cc1d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:07.469677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e9f5ff75-4bcc-4371-ae2e-b24c16b6850a req-3e824630-9b55-47ce-84a6-f00b2f32cc1d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:07.469897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e9f5ff75-4bcc-4371-ae2e-b24c16b6850a req-3e824630-9b55-47ce-84a6-f00b2f32cc1d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:07.516150 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e9f5ff75-4bcc-4371-ae2e-b24c16b6850a req-3e824630-9b55-47ce-84a6-f00b2f32cc1d service nova] Creating event network-changed:faf36ed5-589f-4e1c-b005-6d2f33f14902 for instance 0a8d8441-1027-49af-924e-d954c35d0dab on n-h1-854119-9 Aug 29 05:30:07.517750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:30:07.527511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e9f5ff75-4bcc-4371-ae2e-b24c16b6850a req-3e824630-9b55-47ce-84a6-f00b2f32cc1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083417 Aug 29 05:30:07.528759 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3381/6763] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:30:07.652519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:07.653773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:07.668464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:07.670241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:07.671569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:07.683469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:07.685749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:07.687183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:07.704018 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7bf810f1-61a8-481c-990b-422761f9a8e4 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 204 len: 0 microversion: 2.1 time: 0.280274 Aug 29 05:30:07.705029 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3383/6764] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:30:07 2022] DELETE /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:30:07.717664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:07.719966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:07.746170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:07.751590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:07.752160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:07.756657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:07.758131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:07.770456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:07.836515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:07.864022 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87823234-c70c-4c63-a561-19b326f5fe19 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1172 microversion: 2.1 time: 0.216857 Aug 29 05:30:07.879098 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3382/6765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:07 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1172 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:30:08.176053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:08.187183 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-010b4830-cdb9-4a2d-9614-4a9ba4c7a981 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1584 microversion: 2.1 time: 0.476458 Aug 29 05:30:08.190670 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3384/6766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:07 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1584 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:30:08.890239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:08.891797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:08.907039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:08.908597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:08.910865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:08.916159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:08.917427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:08.918144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:09.215359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:09.216079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:09.222415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:09.233288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:09.251498 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9d961cfb-909f-4fae-a959-1ccc45c1a33f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1172 microversion: 2.1 time: 0.370320 Aug 29 05:30:09.254748 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3383/6767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:08 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1172 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:09.272270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:09.276010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:09.276010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:09.276010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:09.276010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:09.276010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:09.941899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:09.951019 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d4e1241d-7932-4823-bf3d-79cfd0fc3cfc tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1584 microversion: 2.1 time: 0.739865 Aug 29 05:30:09.961046 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3385/6768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:09 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1584 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:30:10.279893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:10.281599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:10.292295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:10.314920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:10.317813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:10.320762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:10.321745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:10.324863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:10.325646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:10.340866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:10.958816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:10.969561 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6b08c89e-b6ae-4aa5-a2cd-5add30df7036 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1214 microversion: 2.1 time: 0.697417 Aug 29 05:30:10.972868 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3384/6769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:10 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1214 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:10.980930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:10.982243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:10.994399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:10.995796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:10.998645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:10.999852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:11.000575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:11.006872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:11.520188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:11.528695 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c807c612-935f-4113-9951-fc3fe9bce389 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1584 microversion: 2.1 time: 0.551395 Aug 29 05:30:11.552213 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3386/6770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:10 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1584 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:11.604097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-e968513f-4ced-459a-8562-428f55efe3b2 req-555a8cf8-992b-48df-ad37-9efeb20b19b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8d8441-1027-49af-924e-d954c35d0dab", "name": "network-vif-deleted", "tag": "faf36ed5-589f-4e1c-b005-6d2f33f14902"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:11.629479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e968513f-4ced-459a-8562-428f55efe3b2 req-555a8cf8-992b-48df-ad37-9efeb20b19b7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:11.630330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e968513f-4ced-459a-8562-428f55efe3b2 req-555a8cf8-992b-48df-ad37-9efeb20b19b7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:11.630952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-e968513f-4ced-459a-8562-428f55efe3b2 req-555a8cf8-992b-48df-ad37-9efeb20b19b7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:11.651131 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-e968513f-4ced-459a-8562-428f55efe3b2 req-555a8cf8-992b-48df-ad37-9efeb20b19b7 service nova] Creating event network-vif-deleted:faf36ed5-589f-4e1c-b005-6d2f33f14902 for instance 0a8d8441-1027-49af-924e-d954c35d0dab on n-h1-854119-9 Aug 29 05:30:11.665978 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-e968513f-4ced-459a-8562-428f55efe3b2 req-555a8cf8-992b-48df-ad37-9efeb20b19b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072919 Aug 29 05:30:11.666763 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3385/6771] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:30:11.695772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-41398fc6-3821-4cac-a299-3b0413346e58 req-9da81d98-f616-4ae4-a248-202823349d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f481ee61-64ac-4479-b941-71044bd5a694", "tag": "ab31a869-2725-4e86-9751-ac76d799f08a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:11.713086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-41398fc6-3821-4cac-a299-3b0413346e58 req-9da81d98-f616-4ae4-a248-202823349d2f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:11.714006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-41398fc6-3821-4cac-a299-3b0413346e58 req-9da81d98-f616-4ae4-a248-202823349d2f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:11.714829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-41398fc6-3821-4cac-a299-3b0413346e58 req-9da81d98-f616-4ae4-a248-202823349d2f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:11.727537 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-41398fc6-3821-4cac-a299-3b0413346e58 req-9da81d98-f616-4ae4-a248-202823349d2f service nova] Creating event network-changed:ab31a869-2725-4e86-9751-ac76d799f08a for instance f481ee61-64ac-4479-b941-71044bd5a694 on n-h2-854119-9 Aug 29 05:30:11.742015 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-41398fc6-3821-4cac-a299-3b0413346e58 req-9da81d98-f616-4ae4-a248-202823349d2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050207 Aug 29 05:30:11.743242 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3387/6772] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:30:11.997232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:11.998038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:12.012484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:12.014432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:12.014881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:12.016947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:12.019510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:12.020221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:12.438444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:12.469276 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-13888184-f559-4ae5-ae53-1113d34debf2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1214 microversion: 2.1 time: 0.468453 Aug 29 05:30:12.471795 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3386/6773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:11 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1214 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:12.576490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:12.577884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:12.588819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:12.589593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:12.590768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:12.595736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:12.596514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:12.601388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:12.749829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:12.759934 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2e42f92f-0062-461a-b13d-5611871a00b9 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1230 microversion: 2.1 time: 0.209157 Aug 29 05:30:12.763856 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3388/6774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:12 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1230 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:13.490347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:13.490958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:13.503387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:13.503883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:13.508544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:13.509332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:13.509968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:13.510401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:13.798405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:13.807868 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e266bc6-3c84-482e-8384-329baf61a727 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1214 microversion: 2.1 time: 0.321846 Aug 29 05:30:13.825145 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3387/6775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:13 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:13.837957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:13.839003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:13.845899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:13.846624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:13.847195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:13.848052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:13.848765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:13.849521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:13.868608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1333804f-9b54-4652-9cc6-eadbeb3197ff tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Action: 'create', calling method: .version_select at 0x7f1abd907d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1636024503", "metadata": {"Type": "work"}}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:13.983159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:13.995764 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a47f5fa0-46f1-4bf4-a4b9-e4aaeba84832 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1230 microversion: 2.1 time: 0.168547 Aug 29 05:30:13.997343 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3388/6776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:13 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1230 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:14.837690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:14.838393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:14.841127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:14.845529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:14.851247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:14.851747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:14.852205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:14.852928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:14.853486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:14.855132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:15.066582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:15.080871 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a5d43607-ac27-42ec-b990-f6a36b0c4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1214 microversion: 2.1 time: 0.247236 Aug 29 05:30:15.081461 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3389/6777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:14 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1214 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:15.090319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:15.091219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:15.100944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:15.101683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:15.102435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:15.103299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:15.103897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:15.104488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:15.177869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:15.186113 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3bc4a8a3-b6ba-453e-b764-2bf32806f24d tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1230 microversion: 2.1 time: 0.103498 Aug 29 05:30:15.186921 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3390/6778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:15 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:15.427922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:16.101649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:16.103373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:16.118338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:16.118848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:16.119285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:16.121819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:16.122294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:16.122723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:16.403204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:16.432032 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4e2a9bd9-7e7d-4fb9-9b1a-c2fb3606d559 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1214 microversion: 2.1 time: 0.334527 Aug 29 05:30:16.446443 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3391/6779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:16 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1214 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:30:16.469265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:16.471171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:16.506147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:16.506734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:16.508413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:16.509225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:16.510129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:16.510975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:16.598063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:16.605237 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-488a1b42-e468-4508-97b5-a84138d326d8 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1230 microversion: 2.1 time: 0.156676 Aug 29 05:30:16.605881 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3392/6780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:16 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1230 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:17.463212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:17.465481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:17.474144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:17.474779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:17.475498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:17.478160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:17.479028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:17.489758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:18.254475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:18.263841 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aec2c7e3-1194-4a6e-9107-35788c1d2766 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1214 microversion: 2.1 time: 0.806085 Aug 29 05:30:18.268477 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3393/6781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:17 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1214 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:18.278265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:18.279726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:18.293951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:18.297464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:18.298085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:18.298882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:18.299350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:18.299797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:18.395123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:18.395680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:18.396111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:18.396978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lazy-loading 'fault' on Instance uuid 0a8d8441-1027-49af-924e-d954c35d0dab {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:30:18.570121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f134c218cc476088d2317121588d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f61eb236ba40caaec504709faf1e0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:18.603698 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c19dd0c-d918-4d32-b98c-a5906c784705 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 200 len: 1189 microversion: 2.1 time: 0.332205 Aug 29 05:30:18.604861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3394/6782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:18 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 1189 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:18.738703 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1333804f-9b54-4652-9cc6-eadbeb3197ff tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.079843 Aug 29 05:30:18.739757 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3389/6783] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 29 05:30:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5082 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 05:30:18.754339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c855da6c-7545-479c-8c3a-c372ecd80c0a tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1abd847f70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:18.836450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c855da6c-7545-479c-8c3a-c372ecd80c0a tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 200 len: 353 microversion: 2.1 time: 0.087954 Aug 29 05:30:18.841111 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3395/6784] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:18 2022] GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:30:19.292056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:19.293343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:19.307989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:19.308755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:19.309391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:19.310321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:19.310979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:19.314509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:19.632341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:19.633123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] [instance: 0a8d8441-1027-49af-924e-d954c35d0dab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:19.650282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:19.651841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:19.656002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:19.657036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:19.659092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:19.659810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:19.699774 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] HTTP exception thrown: Instance 0a8d8441-1027-49af-924e-d954c35d0dab could not be found. Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Request method failure captured: Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab HTTP/1.1 Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE3ULfNImLJTEhe00ZazzNJiKyOE_99klKnXnVXpHUZVgeNx94xOsYiifLF3RLkVoDyph32R12lTcPfIMJAwTl8CJZW7ZyrrkacnGQjkkD9TZawRJ1ALb6UewVipN4EmsXTGAMk96D1hH_7ZjA9GQ_9zLxz4904JFjiuqJTmdLp_JaA Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: b6f61eb236ba40caaec504709faf1e0b Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBackupRestore-562995478 Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6f61eb236ba40caaec504709faf1e0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6f61eb236ba40caaec504709faf1e0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6f61eb236ba40caaec504709faf1e0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6f61eb236ba40caaec504709faf1e0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBackupRestore-562995478 Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: b6f61eb236ba40caaec504709faf1e0b Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBackupRestore-562995478 Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBackupRestore-562995478-project Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 71f134c218cc476088d2317121588d3d Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBackupRestore-562995478-project Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 0a8d8441-1027-49af-924e-d954c35d0dab could not be found. Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '0a8d8441-1027-49af-924e-d954c35d0dab'} Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a8d8441-1027-49af-924e-d954c35d0dab could not be found. Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a8d8441-1027-49af-924e-d954c35d0dab could not be found. Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:19.701759 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:19.705642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:19.705642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:19.705642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:19.705642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:30:19.705642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:30:19.705642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a8d8441-1027-49af-924e-d954c35d0dab could not be found. Aug 29 05:30:19.705642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:19.709670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Returning 404 to user: Instance 0a8d8441-1027-49af-924e-d954c35d0dab could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:30:19.712043 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-619649d0-a7be-4738-b613-c062b6e713f5 tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab" status: 404 len: 111 microversion: 2.1 time: 0.086786 Aug 29 05:30:19.715278 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3396/6785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:19 2022] GET /compute/v2.1/servers/0a8d8441-1027-49af-924e-d954c35d0dab => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:30:19.854854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-96ac8364-f81c-46a4-aca8-2b4e84c657f6 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1abd8208b0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:19.887210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:19.909888 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fce84f21-bbe4-48e7-a494-507443e3a3c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1214 microversion: 2.1 time: 0.621587 Aug 29 05:30:19.911182 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3390/6786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:19 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1214 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:19.993666 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-96ac8364-f81c-46a4-aca8-2b4e84c657f6 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 200 len: 353 microversion: 2.1 time: 0.142668 Aug 29 05:30:20.002311 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3397/6787] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:19 2022] GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:30:20.156419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-19e125bb-a9d2-4c2e-95d5-e3e27986058b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] Calling method '.version_select at 0x7f1ab3fd9ca0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:20.216928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-19e125bb-a9d2-4c2e-95d5-e3e27986058b tempest-TestVolumeBackupRestore-562995478 tempest-TestVolumeBackupRestore-562995478-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1689084540" status: 202 len: 0 microversion: 2.1 time: 0.064645 Aug 29 05:30:20.218583 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3391/6788] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 05:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1689084540 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:30:20.931181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:20.931996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:20.947553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:20.948070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:20.948595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:20.949247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:20.954335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:20.955180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:21.009152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2549b118-308c-4a4a-b111-de1b01eddf8a tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1ab8176310>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:21.174816 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2549b118-308c-4a4a-b111-de1b01eddf8a tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 200 len: 354 microversion: 2.1 time: 0.169634 Aug 29 05:30:21.175473 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3392/6789] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:21 2022] GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 354 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:30:21.187791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee214fdc-7f3b-4119-9275-f3ab3d3d2652 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1ab8240e50>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:21.366522 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee214fdc-7f3b-4119-9275-f3ab3d3d2652 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 200 len: 354 microversion: 2.1 time: 0.182559 Aug 29 05:30:21.367537 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3393/6790] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:21 2022] GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:30:21.385256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-686e9af6-a213-430a-8b5c-210dddf8aa14 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1ab3fd50d0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:21.449003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:21.463293 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-056e9a29-a97c-4abd-96c5-17dbd7687f2c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1214 microversion: 2.1 time: 0.530774 Aug 29 05:30:21.466332 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3398/6791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:20 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1214 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:21.542089 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-686e9af6-a213-430a-8b5c-210dddf8aa14 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 202 len: 0 microversion: 2.1 time: 0.154234 Aug 29 05:30:21.542987 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3394/6792] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:30:21 2022] DELETE /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:30:21.553289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3e5e35bc-4845-4634-9318-a37350d96605 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1ab9548a60>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:21.721358 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3e5e35bc-4845-4634-9318-a37350d96605 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 200 len: 353 microversion: 2.1 time: 0.173214 Aug 29 05:30:21.722884 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3399/6793] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:21 2022] GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:30:22.502780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:22.505468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:22.544666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:22.547443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:22.549200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:22.550782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:22.552506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:22.574332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:22.736437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a102f2cd-ebff-4009-97f5-d511cb37b40a tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1ab8591310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:23.286371 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a102f2cd-ebff-4009-97f5-d511cb37b40a tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 200 len: 353 microversion: 2.1 time: 0.555106 Aug 29 05:30:23.287191 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3400/6794] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:22 2022] GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 353 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:30:23.450298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:23.487990 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9dd41eba-7862-4307-ab3d-a6319071f1ff tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 0.997577 Aug 29 05:30:23.489303 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3395/6795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:22 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:24.301738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-91aae0d8-d51d-4dc4-ba54-02d347116b15 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1ab85a1ee0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:24.426118 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-91aae0d8-d51d-4dc4-ba54-02d347116b15 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 200 len: 353 microversion: 2.1 time: 0.129510 Aug 29 05:30:24.427197 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3401/6796] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:24 2022] GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:30:24.513281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:24.523233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:24.543812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:24.545638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:24.548213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:24.550634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:24.551189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:24.551765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:25.440665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86d7a623-5e88-4d7c-a816-93befff9a7a4 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1abd847550>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:25.607120 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86d7a623-5e88-4d7c-a816-93befff9a7a4 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 200 len: 353 microversion: 2.1 time: 0.171007 Aug 29 05:30:25.610711 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3402/6797] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:25 2022] GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:30:25.862323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:25.875096 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb7ebbda-6ebe-40eb-b9b3-b57d2cd89d4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 1.366562 Aug 29 05:30:25.876246 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3396/6798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:24 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:26.623970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-880b4642-3cd5-4828-b537-f5539ec14ff1 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Calling method '.version_select at 0x7f1ab874e1f0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:26.697752 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-880b4642-3cd5-4828-b537-f5539ec14ff1 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] HTTP exception thrown: Volume eecae014-f7ac-4b59-ba94-1f557b5b317a could not be found. Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-880b4642-3cd5-4828-b537-f5539ec14ff1 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Request method failure captured: Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a HTTP/1.1 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE7lS9GtEwPiHjDU1knkLHI2sPYDi-obRPAM_D296r6GjEzxCbY1_o7k7bLq8nRtxaOFyT4264rIWQelfql1L0083ktuRLzw6d87P8QLVnXwacgt0v0aq-nBb5EjTJDWaZXHANG-TdoX_g5yBTYin7vMSELOaorslYkwVMKbrgah2uw Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 445e15b4b5d84e98b2d5fe15a53a2796 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesGetTestJSON-144872235 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/445e15b4b5d84e98b2d5fe15a53a2796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/445e15b4b5d84e98b2d5fe15a53a2796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_445e15b4b5d84e98b2d5fe15a53a2796", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/445e15b4b5d84e98b2d5fe15a53a2796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesGetTestJSON-144872235 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 445e15b4b5d84e98b2d5fe15a53a2796 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesGetTestJSON-144872235 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesGetTestJSON-144872235-project Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: c25a5323aa174f699d33ed229b4e2956 Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesGetTestJSON-144872235-project Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: exception: Volume eecae014-f7ac-4b59-ba94-1f557b5b317a could not be found. Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'eecae014-f7ac-4b59-ba94-1f557b5b317a'} Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eecae014-f7ac-4b59-ba94-1f557b5b317a could not be found. (HTTP 404) (Request-ID: req-66a5bffa-8b49-4139-9902-c727109eada7) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 05:30:26.699850 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eecae014-f7ac-4b59-ba94-1f557b5b317a could not be found. Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eecae014-f7ac-4b59-ba94-1f557b5b317a could not be found. Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eecae014-f7ac-4b59-ba94-1f557b5b317a could not be found. Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:26.705579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-880b4642-3cd5-4828-b537-f5539ec14ff1 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] Returning 404 to user: Volume eecae014-f7ac-4b59-ba94-1f557b5b317a could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:30:26.709173 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-880b4642-3cd5-4828-b537-f5539ec14ff1 tempest-VolumesGetTestJSON-144872235 tempest-VolumesGetTestJSON-144872235-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a" status: 404 len: 109 microversion: 2.1 time: 0.085564 Aug 29 05:30:26.709173 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3403/6799] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:26 2022] GET /compute/v2.1/os-volumes/eecae014-f7ac-4b59-ba94-1f557b5b317a => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:30:26.905330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:26.906363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:26.925116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:26.937262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:26.937974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:26.944547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:26.946490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:26.947348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:27.380980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:27.398035 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3c4cc693-6724-4a9b-b515-b03cdc0e276b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 0.495789 Aug 29 05:30:27.402825 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3397/6800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:26 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:28.423126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:28.424564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:28.446892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:28.447902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:28.450110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:28.452301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:28.457360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:28.459669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:28.997409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:29.006158 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-27a3721d-d8cd-4150-8573-0fb85c7b2909 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 0.586942 Aug 29 05:30:29.015061 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3404/6801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:28 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:30.035761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:30.036596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:30.072891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:30.073727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:30.074572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:30.076980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:30.081004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:30.081862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:30.151687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:30.494370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:30.503798 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80ab44c7-554f-4532-ba56-9b82a8456ac4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 0.472776 Aug 29 05:30:30.510051 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3398/6802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:30 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:31.529994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:31.530993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:31.541844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:31.542342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:31.548971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:31.550297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:31.551399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:31.552047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:32.315111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-688afc00-788e-47cb-889f-94e6ac2ae5a5 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Action: 'create', calling method: .version_select at 0x7f1ab3faf5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-435900091", "metadata": {"Type": "work"}}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:32.320376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:32.328789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4344193-4cc9-4b0e-aa39-41004b219191 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 0.802436 Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-688afc00-788e-47cb-889f-94e6ac2ae5a5 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Request method failure captured: Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 121 Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE73ZV-qGLuTiUzR60Y5NyN4-QrXfO91Q5p85DLoK_BmIwy1yvPNbUwqMdgpNIkiwMpHzBzIOdQjk4ATHiSUbkbu8xxatEmAni3QVf8TeM-EUHuCuq7lfI1pjl51uKfQnN6BIWxGpJlVyRQHRdMKgODf9SJZVBcnRBoZBFnxaHRAthc Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2fef31d1305e4356bb98e65db23e1d5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 3615dad2c51042d6bd37998c1c8a88f6 Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-435900091", "metadata": {"Type": "work"}}} Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-435900091', 'metadata': {'Type': 'work'}}}} Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:30:32.328968 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-688afc00-788e-47cb-889f-94e6ac2ae5a5 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:30:32.338462 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-688afc00-788e-47cb-889f-94e6ac2ae5a5 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.354706 Aug 29 05:30:32.341609 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3405/6803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:31 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:32.341944 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3399/6804] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 29 05:30:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 358 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 05:30:32.342682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63cfcbe3-e203-41d8-a478-c298b36705f5 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Action: 'create', calling method: .version_select at 0x7f1ab85a1700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-479776262", "metadata": {"Type": "work"}}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63cfcbe3-e203-41d8-a478-c298b36705f5 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Request method failure captured: Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 119 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE73ZV-qGLuTiUzR60Y5NyN4-QrXfO91Q5p85DLoK_BmIwy1yvPNbUwqMdgpNIkiwMpHzBzIOdQjk4ATHiSUbkbu8xxatEmAni3QVf8TeM-EUHuCuq7lfI1pjl51uKfQnN6BIWxGpJlVyRQHRdMKgODf9SJZVBcnRBoZBFnxaHRAthc Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2fef31d1305e4356bb98e65db23e1d5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 3615dad2c51042d6bd37998c1c8a88f6 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-479776262", "metadata": {"Type": "work"}}} Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-479776262', 'metadata': {'Type': 'work'}}}} Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi '0' Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:30:32.346677 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-63cfcbe3-e203-41d8-a478-c298b36705f5 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:30:32.350857 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-63cfcbe3-e203-41d8-a478-c298b36705f5 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009470 Aug 29 05:30:32.360643 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3406/6805] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 29 05:30:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:30:32.372553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-61f3bf49-0505-4cde-a737-19c7a854ad12 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Action: 'create', calling method: .version_select at 0x7f1abd91a700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-995964135", "metadata": {"Type": "work"}}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-61f3bf49-0505-4cde-a737-19c7a854ad12 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Request method failure captured: Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 118 Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE73ZV-qGLuTiUzR60Y5NyN4-QrXfO91Q5p85DLoK_BmIwy1yvPNbUwqMdgpNIkiwMpHzBzIOdQjk4ATHiSUbkbu8xxatEmAni3QVf8TeM-EUHuCuq7lfI1pjl51uKfQnN6BIWxGpJlVyRQHRdMKgODf9SJZVBcnRBoZBFnxaHRAthc Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2fef31d1305e4356bb98e65db23e1d5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 3615dad2c51042d6bd37998c1c8a88f6 Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-995964135", "metadata": {"Type": "work"}}} Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-995964135', 'metadata': {'Type': 'work'}}}} Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi '' Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:30:32.376210 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-61f3bf49-0505-4cde-a737-19c7a854ad12 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:30:32.380169 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-61f3bf49-0505-4cde-a737-19c7a854ad12 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013724 Aug 29 05:30:32.396515 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3400/6806] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 29 05:30:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 05:30:32.409297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8fce2a2-e8b3-423f-a63e-7890d02f31bd tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Calling method '.version_select at 0x7f1abd7d10d0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:32.472388 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e8fce2a2-e8b3-423f-a63e-7890d02f31bd tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] HTTP exception thrown: Volume tempest-invalid-1710400485 could not be found. Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8fce2a2-e8b3-423f-a63e-7890d02f31bd tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Request method failure captured: Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1710400485 HTTP/1.1 Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE73ZV-qGLuTiUzR60Y5NyN4-QrXfO91Q5p85DLoK_BmIwy1yvPNbUwqMdgpNIkiwMpHzBzIOdQjk4ATHiSUbkbu8xxatEmAni3QVf8TeM-EUHuCuq7lfI1pjl51uKfQnN6BIWxGpJlVyRQHRdMKgODf9SJZVBcnRBoZBFnxaHRAthc Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2fef31d1305e4356bb98e65db23e1d5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 3615dad2c51042d6bd37998c1c8a88f6 Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: exception: Volume tempest-invalid-1710400485 could not be found. Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'tempest-invalid-1710400485'} Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1710400485 could not be found. (HTTP 404) (Request-ID: req-cc67204a-88c8-4aa0-a2e9-bc415959ea11) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 05:30:32.474377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1710400485 could not be found. Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1710400485 could not be found. Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1710400485 could not be found. Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8fce2a2-e8b3-423f-a63e-7890d02f31bd tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Returning 404 to user: Volume tempest-invalid-1710400485 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:30:32.479497 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8fce2a2-e8b3-423f-a63e-7890d02f31bd tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1710400485" status: 404 len: 99 microversion: 2.1 time: 0.070594 Aug 29 05:30:32.489894 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3407/6807] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:30:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1710400485 => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 05:30:32.494020 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e2db74af-83e8-41b7-b0aa-876e74dcc451 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005984 Aug 29 05:30:32.495198 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3401/6808] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 29 05:30:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 05:30:32.515541 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09d68dd5-1055-40b6-b6cd-214df4aa404b tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010798 Aug 29 05:30:32.530277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76045550-f6d1-40f1-92b7-5614e049fbc3 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Calling method '.version_select at 0x7f1ab807c940>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:32.534647 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3408/6809] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 29 05:30:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 05:30:32.617746 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-76045550-f6d1-40f1-92b7-5614e049fbc3 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] HTTP exception thrown: Volume e782540f-c770-4c12-b598-96c915cc4bce could not be found. Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76045550-f6d1-40f1-92b7-5614e049fbc3 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Request method failure captured: Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/os-volumes/e782540f-c770-4c12-b598-96c915cc4bce HTTP/1.1 Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE73ZV-qGLuTiUzR60Y5NyN4-QrXfO91Q5p85DLoK_BmIwy1yvPNbUwqMdgpNIkiwMpHzBzIOdQjk4ATHiSUbkbu8xxatEmAni3QVf8TeM-EUHuCuq7lfI1pjl51uKfQnN6BIWxGpJlVyRQHRdMKgODf9SJZVBcnRBoZBFnxaHRAthc Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2fef31d1305e4356bb98e65db23e1d5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 3615dad2c51042d6bd37998c1c8a88f6 Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: method: Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: exception: Volume e782540f-c770-4c12-b598-96c915cc4bce could not be found. Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'e782540f-c770-4c12-b598-96c915cc4bce'} Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e782540f-c770-4c12-b598-96c915cc4bce could not be found. (HTTP 404) (Request-ID: req-ebaef1a0-c60f-442f-aa12-9ff281117471) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 05:30:32.620330 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e782540f-c770-4c12-b598-96c915cc4bce could not be found. Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e782540f-c770-4c12-b598-96c915cc4bce could not be found. Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e782540f-c770-4c12-b598-96c915cc4bce could not be found. Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-76045550-f6d1-40f1-92b7-5614e049fbc3 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Returning 404 to user: Volume e782540f-c770-4c12-b598-96c915cc4bce could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:30:32.627501 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-76045550-f6d1-40f1-92b7-5614e049fbc3 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/e782540f-c770-4c12-b598-96c915cc4bce" status: 404 len: 109 microversion: 2.1 time: 0.098471 Aug 29 05:30:32.630276 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3402/6810] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 29 05:30:32 2022] DELETE /compute/v2.1/os-volumes/e782540f-c770-4c12-b598-96c915cc4bce => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:30:32.631942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e55b50bc-fdcd-4f0b-bcdb-04949ff3a324 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Calling method '.version_select at 0x7f1ab8bbb550>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:32.696298 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e55b50bc-fdcd-4f0b-bcdb-04949ff3a324 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] HTTP exception thrown: Volume e7241af4-153a-45cb-8b72-4224f6714ffb could not be found. Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e55b50bc-fdcd-4f0b-bcdb-04949ff3a324 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Request method failure captured: Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/os-volumes/e7241af4-153a-45cb-8b72-4224f6714ffb HTTP/1.1 Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE73ZV-qGLuTiUzR60Y5NyN4-QrXfO91Q5p85DLoK_BmIwy1yvPNbUwqMdgpNIkiwMpHzBzIOdQjk4ATHiSUbkbu8xxatEmAni3QVf8TeM-EUHuCuq7lfI1pjl51uKfQnN6BIWxGpJlVyRQHRdMKgODf9SJZVBcnRBoZBFnxaHRAthc Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2fef31d1305e4356bb98e65db23e1d5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fef31d1305e4356bb98e65db23e1d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 2fef31d1305e4356bb98e65db23e1d5f Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesNegativeTest-332035769 Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 3615dad2c51042d6bd37998c1c8a88f6 Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesNegativeTest-332035769-project Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: method: Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: exception: Volume e7241af4-153a-45cb-8b72-4224f6714ffb could not be found. Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'e7241af4-153a-45cb-8b72-4224f6714ffb'} Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7241af4-153a-45cb-8b72-4224f6714ffb could not be found. (HTTP 404) (Request-ID: req-5daece49-2d51-4f2d-8c39-719f76536840) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 05:30:32.699105 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7241af4-153a-45cb-8b72-4224f6714ffb could not be found. Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7241af4-153a-45cb-8b72-4224f6714ffb could not be found. Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7241af4-153a-45cb-8b72-4224f6714ffb could not be found. Aug 29 05:30:32.703007 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:32.707489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e55b50bc-fdcd-4f0b-bcdb-04949ff3a324 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] Returning 404 to user: Volume e7241af4-153a-45cb-8b72-4224f6714ffb could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:30:32.708534 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e55b50bc-fdcd-4f0b-bcdb-04949ff3a324 tempest-VolumesNegativeTest-332035769 tempest-VolumesNegativeTest-332035769-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e7241af4-153a-45cb-8b72-4224f6714ffb" status: 404 len: 109 microversion: 2.1 time: 0.080780 Aug 29 05:30:32.709560 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3409/6811] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 29 05:30:32 2022] GET /compute/v2.1/os-volumes/e7241af4-153a-45cb-8b72-4224f6714ffb => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:30:33.354847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:33.357360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:33.377920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:33.379639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:33.380307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:33.381892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:33.385545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:33.386320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:34.248916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:34.263151 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f907a461-a46a-4dfb-8b73-689ef08aff8b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 0.914788 Aug 29 05:30:34.264047 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3403/6812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:33 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:30:35.310253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:35.313490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:35.339593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:35.341570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:35.343078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:35.346203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:35.348048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:35.349897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:35.921054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:35.930352 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9d3fe6ae-14e4-4c38-9a40-edb950c237dd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 0.644566 Aug 29 05:30:35.944220 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3410/6813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:35 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:35.944598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-eade202d-734e-448a-b962-f8ec40594508 req-99380845-e0d2-4f37-8993-4515de8fa426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f481ee61-64ac-4479-b941-71044bd5a694", "name": "network-vif-plugged", "status": "completed", "tag": "ab31a869-2725-4e86-9751-ac76d799f08a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:35.980467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-eade202d-734e-448a-b962-f8ec40594508 req-99380845-e0d2-4f37-8993-4515de8fa426 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:35.987712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-eade202d-734e-448a-b962-f8ec40594508 req-99380845-e0d2-4f37-8993-4515de8fa426 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:35.989909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-eade202d-734e-448a-b962-f8ec40594508 req-99380845-e0d2-4f37-8993-4515de8fa426 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:36.030882 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-eade202d-734e-448a-b962-f8ec40594508 req-99380845-e0d2-4f37-8993-4515de8fa426 service nova] Creating event network-vif-plugged:ab31a869-2725-4e86-9751-ac76d799f08a for instance f481ee61-64ac-4479-b941-71044bd5a694 on n-h2-854119-9 Aug 29 05:30:36.041330 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-eade202d-734e-448a-b962-f8ec40594508 req-99380845-e0d2-4f37-8993-4515de8fa426 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097855 Aug 29 05:30:36.044389 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3404/6814] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:30:36.959696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:36.960651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:36.984068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:36.984620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:36.989530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:36.993588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:36.994227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:36.999333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:37.655493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:37.675630 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bbf30997-2d3c-4d06-a387-175e574f9ee2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 0.718757 Aug 29 05:30:37.678255 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3411/6815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:36 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:38.702793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:38.703471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:38.719059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:38.720476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:38.721531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:38.724385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:38.727312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:38.727984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:39.425060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:39.443061 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45b03c99-1cfb-4804-8981-cce098565b92 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1202 microversion: 2.1 time: 0.741350 Aug 29 05:30:39.445545 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3405/6816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:38 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1202 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:40.464957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:40.466165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:40.470971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=36 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:40.486770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:40.487270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:40.487708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:40.488540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:40.488997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:40.489419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:40.502869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:40.786567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:40.796454 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b32bcab-7eb5-4e38-b0d8-e98d29e6d908 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1388 microversion: 2.1 time: 0.337375 Aug 29 05:30:40.798504 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3412/6817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:40 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1388 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:40.819602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:40.821896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:40.825646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:40.845924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:40.846421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:40.851706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:40.859866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:40.860625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:40.864976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:42.061462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:42.076736 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-402fbb0f-9cda-4df6-8f77-e69e1809c544 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1388 microversion: 2.1 time: 1.261180 Aug 29 05:30:42.097879 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3406/6818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:40 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1388 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:42.123444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:42.131216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:42.142348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:42.142867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:42.144638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:42.163008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:42.165423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:42.166138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:42.512965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:42.524790 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aeb90a99-5727-422b-9c22-1d3f0cc723c9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1388 microversion: 2.1 time: 0.411278 Aug 29 05:30:42.525394 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3413/6819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:42 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1388 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:42.545452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:42.546928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:42.558765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:42.559547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:42.560173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:42.561050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:42.565308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:42.566038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:42.622647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:30:42.816494 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b46a44c3-7b19-458e-a248-3a392ca9b772 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 204 len: 0 microversion: 2.1 time: 0.274943 Aug 29 05:30:42.817840 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3407/6820] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:30:42 2022] DELETE /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:30:42.830252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:42.831324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:42.858717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:42.859384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:42.859837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:42.860597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:42.863887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:42.865090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:43.368079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:43.387615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-adbac63b-0a85-440a-a310-605fe40105b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1394 microversion: 2.1 time: 0.564425 Aug 29 05:30:43.390046 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3414/6821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:42 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1394 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:44.088664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1615576876", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "a16fbebe-ca3e-4173-886b-3f03dfe43b37"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:44.207007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] validate_networks() for [('a16fbebe-ca3e-4173-886b-3f03dfe43b37', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:30:44.414619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:44.415774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:44.428368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:44.431149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:44.433936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:44.435952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:44.437136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:44.439002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:45.011693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:45.028407 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d739caf3-2ca8-407c-90a3-97da085cdf72 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1394 microversion: 2.1 time: 0.621174 Aug 29 05:30:45.029808 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3415/6822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:44 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1394 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:30:45.695130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:30:45.695714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:30:45.696345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:30:45.696763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:30:45.697280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:30:45.725777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:45.740270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:45.741732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:45.744438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:45.747247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:45.748020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:45.800819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Getting quotas for project abbc349276c44f51a44878b9b4b17b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:30:45.818319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Getting quotas for user f9270ebb0e4d47dbac0f3c709f125e34 and project abbc349276c44f51a44878b9b4b17b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:30:45.854780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:30:45.864376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:30:45.944408 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8f656b29-15d5-4919-8192-0d7af79422ca tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862810 Aug 29 05:30:45.946215 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3408/6823] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:30:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:30:45.958777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-335ba033-031a-4bdf-9845-a07cf372fd57 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:45.959930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-335ba033-031a-4bdf-9845-a07cf372fd57 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:46.051054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:46.051837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:46.083379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:46.084101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:46.089128 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:46.093138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:46.097071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:46.099319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:46.110920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-335ba033-031a-4bdf-9845-a07cf372fd57 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:46.141393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-335ba033-031a-4bdf-9845-a07cf372fd57 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1214 microversion: 2.1 time: 0.188109 Aug 29 05:30:46.149465 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3416/6824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:45 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1214 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:46.573789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:46.587589 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa767bbd-dc75-4415-991a-5a5684957e5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1394 microversion: 2.1 time: 0.541709 Aug 29 05:30:46.593058 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3409/6825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:46 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1394 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:30:47.137600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c0b0c520-5731-4f1f-b603-4c271ccdefa4 req-df605667-67d2-48d5-9831-8452532a35b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f481ee61-64ac-4479-b941-71044bd5a694", "name": "network-vif-deleted", "tag": "ab31a869-2725-4e86-9751-ac76d799f08a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:47.169914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:47.170530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:47.182763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:47.184938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:47.185813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c0b0c520-5731-4f1f-b603-4c271ccdefa4 req-df605667-67d2-48d5-9831-8452532a35b0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:47.186357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:47.187081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:47.187209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c0b0c520-5731-4f1f-b603-4c271ccdefa4 req-df605667-67d2-48d5-9831-8452532a35b0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:47.187523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:47.190953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c0b0c520-5731-4f1f-b603-4c271ccdefa4 req-df605667-67d2-48d5-9831-8452532a35b0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:47.209605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:47.238649 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c0b0c520-5731-4f1f-b603-4c271ccdefa4 req-df605667-67d2-48d5-9831-8452532a35b0 service nova] Creating event network-vif-deleted:ab31a869-2725-4e86-9751-ac76d799f08a for instance f481ee61-64ac-4479-b941-71044bd5a694 on n-h2-854119-9 Aug 29 05:30:47.259144 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c0b0c520-5731-4f1f-b603-4c271ccdefa4 req-df605667-67d2-48d5-9831-8452532a35b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127002 Aug 29 05:30:47.264078 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3417/6826] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:30:47.477175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:47.491822 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-02a5ca8c-e580-4b6d-b2dd-ab43e75c3c6d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1210 microversion: 2.1 time: 0.325885 Aug 29 05:30:47.504149 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3410/6827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:47 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1210 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:30:47.613806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:47.615096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:47.627400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:47.632248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:47.633224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:47.636386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:47.637220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:47.639969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:47.996262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:48.006370 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0676af13-17d0-4e3f-a4cd-4ae0148d616d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1187 microversion: 2.1 time: 0.398957 Aug 29 05:30:48.007689 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3418/6828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:47 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1187 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:48.516149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:48.516852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:48.528221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:48.528724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:48.529170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:48.529885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:48.540922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:48.541606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:48.701816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:48.720460 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b9fd5c05-62e0-4625-8cd1-ebb65f6845a4 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1272 microversion: 2.1 time: 0.207268 Aug 29 05:30:48.727650 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3411/6829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:48 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:49.042463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:49.044299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:49.069962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:49.070643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:49.071393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:49.073704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:49.074478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:49.076465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:49.315773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:49.333391 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-df14ea74-d42b-492a-afef-770cd99fc16f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1187 microversion: 2.1 time: 0.295034 Aug 29 05:30:49.338798 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3419/6830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:49 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1187 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:49.747905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:49.748663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:49.764978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:49.771887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:49.772601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:49.774819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:49.775559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:49.776714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:49.928786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:49.936927 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb12c02e-84ce-43ff-b6c7-9f7257903a78 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1272 microversion: 2.1 time: 0.193254 Aug 29 05:30:49.937457 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3412/6831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:49 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:50.357992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:50.358595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:50.373082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:50.379908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:50.381750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:50.383446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:50.386142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:50.388370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:50.873020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:50.888241 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e7df1f2-c56f-48bb-9981-987c49a1f38a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1187 microversion: 2.1 time: 0.537748 Aug 29 05:30:50.890767 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3420/6832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:50 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1187 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:50.960190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:50.961667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:50.992060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:50.993278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:50.994002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:51.000364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:51.001636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:51.005163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:51.498300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:51.512736 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ce8ac33d-ad3d-4dec-bde1-6eade291186d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1314 microversion: 2.1 time: 0.558241 Aug 29 05:30:51.516498 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3413/6833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:50 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:51.910367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:51.912084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:51.932040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:51.933670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:51.935540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:51.938415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:51.941058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:51.943229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:52.107961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:52.116644 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e2a35622-cb65-4a58-aa93-ade497923498 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1187 microversion: 2.1 time: 0.210247 Aug 29 05:30:52.129956 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3421/6834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:51 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1187 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:52.540227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:52.541139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:52.564993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:52.565510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:52.565954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:52.574836 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:52.575622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:52.576344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:53.034434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:53.042672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c3469aea-b0f4-4202-a351-919266fe4202 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1314 microversion: 2.1 time: 0.507544 Aug 29 05:30:53.043258 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3414/6835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:52 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:53.142360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:53.142975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:53.171172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-00a522ba-998f-4ed5-ab00-58c1179d8b10 req-817ba586-561b-4d9e-a487-384c0c5eef34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff605aa1-9cd3-4b01-a511-991926418210", "tag": "5f5b5c5b-11f7-4433-a7e9-69391add5cd3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:30:53.188048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:53.196910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:53.197624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:53.199013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:53.204300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-00a522ba-998f-4ed5-ab00-58c1179d8b10 req-817ba586-561b-4d9e-a487-384c0c5eef34 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:53.206074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:53.206764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:53.215114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-00a522ba-998f-4ed5-ab00-58c1179d8b10 req-817ba586-561b-4d9e-a487-384c0c5eef34 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:53.216143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-00a522ba-998f-4ed5-ab00-58c1179d8b10 req-817ba586-561b-4d9e-a487-384c0c5eef34 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:53.253879 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-00a522ba-998f-4ed5-ab00-58c1179d8b10 req-817ba586-561b-4d9e-a487-384c0c5eef34 service nova] Creating event network-changed:5f5b5c5b-11f7-4433-a7e9-69391add5cd3 for instance ff605aa1-9cd3-4b01-a511-991926418210 on n-h1-854119-9 Aug 29 05:30:53.263756 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-00a522ba-998f-4ed5-ab00-58c1179d8b10 req-817ba586-561b-4d9e-a487-384c0c5eef34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096951 Aug 29 05:30:53.272087 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3415/6836] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:30:53.372574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:53.386193 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-39679a64-dba9-4315-a17c-19e3d86e752e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1187 microversion: 2.1 time: 0.248467 Aug 29 05:30:53.387693 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3422/6837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:53 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1187 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:54.064609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:54.066741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:54.084449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:54.085246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:54.085916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:54.086903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:54.089910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:54.090774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:54.383612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:54.392605 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3fe466a-d191-4052-8a7b-674e689fa6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1314 microversion: 2.1 time: 0.333174 Aug 29 05:30:54.409547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:54.409547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:54.411624 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3416/6838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:54 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:54.421380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:54.421928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:54.426736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:54.427608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:54.428094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:54.428563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:54.562825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:54.574457 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e5931edd-9e1b-43f5-9ef8-cbbe1d7a610a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1187 microversion: 2.1 time: 0.170351 Aug 29 05:30:54.577590 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3423/6839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:54 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1187 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:55.418730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:55.419358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:55.431000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:55.431518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:55.431943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:55.437846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:55.441010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:55.445585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:55.601134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:55.601937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:55.609121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:55.609620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:55.610165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:55.610886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:55.611348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:55.611914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:55.686824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:55.687499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:55.688104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:55.688743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lazy-loading 'fault' on Instance uuid f481ee61-64ac-4479-b941-71044bd5a694 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:30:55.770412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:55.776211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:55.794278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:55.799410 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-610c3301-6be5-4568-80b0-5bd9cce1bba5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1314 microversion: 2.1 time: 0.386380 Aug 29 05:30:55.800677 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4331fe3d-2032-4e9b-9d69-bc2fdb843504 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 200 len: 1146 microversion: 2.1 time: 0.199646 Aug 29 05:30:55.801513 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3424/6840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:55 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 1146 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:55.802456 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3417/6841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:55 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:56.836680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:56.837357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: f481ee61-64ac-4479-b941-71044bd5a694] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:56.841101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:56.841945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:56.844161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:56.847749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:56.848331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:56.848961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:56.849861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:56.850315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:56.850936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:56.854813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:30:56.864387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:56.868069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:56.868430 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance f481ee61-64ac-4479-b941-71044bd5a694 could not be found. Aug 29 05:30:56.869996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 HTTP/1.1 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance f481ee61-64ac-4479-b941-71044bd5a694 could not be found. Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'f481ee61-64ac-4479-b941-71044bd5a694'} Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f481ee61-64ac-4479-b941-71044bd5a694 could not be found. Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f481ee61-64ac-4479-b941-71044bd5a694 could not be found. Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:30:56.870495 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:56.875601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:30:56.875601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:30:56.875601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:30:56.875601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:30:56.875601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:30:56.875601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f481ee61-64ac-4479-b941-71044bd5a694 could not be found. Aug 29 05:30:56.875601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:30:56.876163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:56.877109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance f481ee61-64ac-4479-b941-71044bd5a694 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:30:56.877677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:56.878194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:56.878589 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a41546cf-4722-4ec0-acfd-c49371aa54b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694" status: 404 len: 111 microversion: 2.1 time: 0.059089 Aug 29 05:30:56.879318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3425/6842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:56 2022] GET /compute/v2.1/servers/f481ee61-64ac-4479-b941-71044bd5a694 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:30:57.390341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:57.401548 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40a32b07-f39b-4f9f-9721-b8316fa130ef tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1314 microversion: 2.1 time: 0.580569 Aug 29 05:30:57.403330 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3418/6843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:56 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:58.422335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:58.423129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:58.432254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:58.434112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:58.437652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:58.438637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:58.440639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:58.441197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:58.850616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:30:58.865645 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1e3bae7b-45f3-4e11-a382-bebe5fa7f6f0 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1314 microversion: 2.1 time: 0.442517 Aug 29 05:30:58.866462 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3426/6844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:58 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:30:59.887342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:30:59.887822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:30:59.897072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:59.897731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:59.899038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:59.901340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:30:59.901821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:30:59.902406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:30:59.912788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:00.083260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:00.097818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1a7f024-b193-4756-9254-211d8d08350d tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1314 microversion: 2.1 time: 0.210067 Aug 29 05:31:00.098576 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3419/6845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:30:59 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:00.954069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-db96ab8e-1a3a-4d8d-b9ef-847b69105b99 req-3f5e83eb-fa7c-4857-99c0-02bfb3de52a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff605aa1-9cd3-4b01-a511-991926418210", "name": "network-vif-plugged", "status": "completed", "tag": "5f5b5c5b-11f7-4433-a7e9-69391add5cd3"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:31:00.964401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-db96ab8e-1a3a-4d8d-b9ef-847b69105b99 req-3f5e83eb-fa7c-4857-99c0-02bfb3de52a2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:00.964805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-db96ab8e-1a3a-4d8d-b9ef-847b69105b99 req-3f5e83eb-fa7c-4857-99c0-02bfb3de52a2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:00.965235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-db96ab8e-1a3a-4d8d-b9ef-847b69105b99 req-3f5e83eb-fa7c-4857-99c0-02bfb3de52a2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:01.003109 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-db96ab8e-1a3a-4d8d-b9ef-847b69105b99 req-3f5e83eb-fa7c-4857-99c0-02bfb3de52a2 service nova] Creating event network-vif-plugged:5f5b5c5b-11f7-4433-a7e9-69391add5cd3 for instance ff605aa1-9cd3-4b01-a511-991926418210 on n-h1-854119-9 Aug 29 05:31:01.011907 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-db96ab8e-1a3a-4d8d-b9ef-847b69105b99 req-3f5e83eb-fa7c-4857-99c0-02bfb3de52a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061378 Aug 29 05:31:01.016338 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3427/6846] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:31:01.120324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:01.121668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:01.133248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:01.133984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:01.134591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:01.136466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:01.140028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:01.140714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:01.451678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:01.465264 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-27229d23-b2f1-4a17-8093-cf671c133e66 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1314 microversion: 2.1 time: 0.348606 Aug 29 05:31:01.469971 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3420/6847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:01 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:02.505393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:02.506394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:02.519895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:02.520527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:02.521201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:02.528312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:02.529664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:02.530196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:02.844235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:02.868670 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1881a553-64c3-4a33-8b56-af06bff5c53f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1314 microversion: 2.1 time: 0.371000 Aug 29 05:31:02.881230 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3428/6848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:02 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:03.890817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:03.902109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:03.924267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:03.924763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:03.925246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:03.927535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:03.928834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:03.929259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:04.166206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:04.174973 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e135f5e5-b0ce-4973-b90c-b626863b2fd9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1498 microversion: 2.1 time: 0.288018 Aug 29 05:31:04.176476 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3421/6849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:03 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1498 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:04.756830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:04.757834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:04.770472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:04.771597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:04.772458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:04.773397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:04.774325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:04.774976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:04.828810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:31:04.911073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:04.971946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f7b385f3-39eb-4916-a1e1-cc8b4ed24b9c tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 204 len: 0 microversion: 2.1 time: 0.220760 Aug 29 05:31:04.972908 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3429/6850] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:31:04 2022] DELETE /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:31:04.981712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:04.982959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:04.998339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:04.998827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:04.999258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:05.000294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:05.001028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:05.001445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:05.193258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:05.207530 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7008bdb3-89f0-4068-abba-3fb2ca57881e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1504 microversion: 2.1 time: 0.230520 Aug 29 05:31:05.208146 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3422/6851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:04 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:06.235615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:06.236341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:06.251489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:06.252646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:06.253123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:06.254605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:06.255356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:06.258109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:06.649574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:06.665243 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bcaca043-e3d0-4931-ac53-c2f675781627 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1504 microversion: 2.1 time: 0.433275 Aug 29 05:31:06.667077 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3430/6852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:06 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:07.257460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-876254f9-8899-4e06-94a0-1326e22a2657 req-9a58c744-6c06-429f-afee-e294c5e3ecd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff605aa1-9cd3-4b01-a511-991926418210", "name": "network-vif-deleted", "tag": "5f5b5c5b-11f7-4433-a7e9-69391add5cd3"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:31:07.276413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-876254f9-8899-4e06-94a0-1326e22a2657 req-9a58c744-6c06-429f-afee-e294c5e3ecd4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:07.277072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-876254f9-8899-4e06-94a0-1326e22a2657 req-9a58c744-6c06-429f-afee-e294c5e3ecd4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:07.277660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-876254f9-8899-4e06-94a0-1326e22a2657 req-9a58c744-6c06-429f-afee-e294c5e3ecd4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:07.293871 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-876254f9-8899-4e06-94a0-1326e22a2657 req-9a58c744-6c06-429f-afee-e294c5e3ecd4 service nova] Creating event network-vif-deleted:5f5b5c5b-11f7-4433-a7e9-69391add5cd3 for instance ff605aa1-9cd3-4b01-a511-991926418210 on n-h1-854119-9 Aug 29 05:31:07.300908 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-876254f9-8899-4e06-94a0-1326e22a2657 req-9a58c744-6c06-429f-afee-e294c5e3ecd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048928 Aug 29 05:31:07.302380 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3423/6853] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:31:07.697790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:07.700284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:07.715143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:07.715692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:07.716622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:07.732753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:07.733717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:07.734340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:07.797595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:07.798545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:07.799245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:07.799988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lazy-loading 'fault' on Instance uuid ff605aa1-9cd3-4b01-a511-991926418210 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:31:08.192420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:08.211244 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b4bcec37-45d6-4feb-99f6-2a1bffb3a0f5 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 200 len: 1304 microversion: 2.1 time: 0.525155 Aug 29 05:31:08.218413 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3431/6854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:07 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 1304 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:09.241764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:09.242475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: ff605aa1-9cd3-4b01-a511-991926418210] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:09.249436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:09.250265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:09.250859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:09.251738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:09.252713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:09.253183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:09.268524 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] HTTP exception thrown: Instance ff605aa1-9cd3-4b01-a511-991926418210 could not be found. Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Request method failure captured: Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 HTTP/1.1 Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE7_j1C46ZUrwyA63BeMPopyIDszZGOaQruVk7DtoXf3IYwxYxYZtJA6GsEYQV3JQAeI3Ov6awC7DYg6awqFkUfiAuf0IUecsR05ZSAN2x_wDa1qrBfQBk_mTY5vQG9wKNpNw2cu3Z65Dnhuyi1fBAOdnnBAbcuxkLJBCplLK-cwdBo Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: abbc349276c44f51a44878b9b4b17b9e Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-VolumesActionsTest-132546401 Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "tempest-type-323073934", "name": "tempest-service-613135343", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abbc349276c44f51a44878b9b4b17b9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abbc349276c44f51a44878b9b4b17b9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abbc349276c44f51a44878b9b4b17b9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abbc349276c44f51a44878b9b4b17b9e"}]}, {"type": "tempest-type-1955559094", "name": "tempest-service-283038954", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-VolumesActionsTest-132546401 Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: abbc349276c44f51a44878b9b4b17b9e Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-VolumesActionsTest-132546401 Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-VolumesActionsTest-132546401-project Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: f9270ebb0e4d47dbac0f3c709f125e34 Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-VolumesActionsTest-132546401-project Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance ff605aa1-9cd3-4b01-a511-991926418210 could not be found. Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'ff605aa1-9cd3-4b01-a511-991926418210'} Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff605aa1-9cd3-4b01-a511-991926418210 could not be found. Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff605aa1-9cd3-4b01-a511-991926418210 could not be found. Aug 29 05:31:09.269773 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff605aa1-9cd3-4b01-a511-991926418210 could not be found. Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Returning 404 to user: Instance ff605aa1-9cd3-4b01-a511-991926418210 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:31:09.274393 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6f88acf4-6b35-42fe-a788-295479070ba9 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210" status: 404 len: 111 microversion: 2.1 time: 0.036113 Aug 29 05:31:09.282492 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3424/6855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:09 2022] GET /compute/v2.1/servers/ff605aa1-9cd3-4b01-a511-991926418210 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:31:09.417436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2098212764", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "a16fbebe-ca3e-4173-886b-3f03dfe43b37"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:31:09.499830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] validate_networks() for [('a16fbebe-ca3e-4173-886b-3f03dfe43b37', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:31:09.941435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:31:09.942262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:31:09.942871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:31:09.943428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:31:09.944080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:31:09.955989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:09.956581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:09.957359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:09.958237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:09.958824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:09.959548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:09.978980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Getting quotas for project abbc349276c44f51a44878b9b4b17b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:31:09.986701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Getting quotas for user f9270ebb0e4d47dbac0f3c709f125e34 and project abbc349276c44f51a44878b9b4b17b9e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:31:10.003339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:31:10.006305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:31:10.063240 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d818109e-8f25-45bf-9ccd-89aefb251486 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649759 Aug 29 05:31:10.064442 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3432/6856] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:31:10.075670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-44ae2e40-435e-423d-bf48-91542932c9f1 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:10.076363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-44ae2e40-435e-423d-bf48-91542932c9f1 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:10.159035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-44ae2e40-435e-423d-bf48-91542932c9f1 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:10.177665 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-44ae2e40-435e-423d-bf48-91542932c9f1 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1214 microversion: 2.1 time: 0.105968 Aug 29 05:31:10.179282 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3425/6857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:10 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:11.203986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:11.205302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:11.209321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:11.218051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:11.220616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:11.221257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:11.222107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:11.222726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:11.223331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:11.320198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:11.332611 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-166aedf9-5c44-423b-8f0e-147b6046ffc3 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1266 microversion: 2.1 time: 0.133175 Aug 29 05:31:11.333258 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3433/6858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:11 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:12.353770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:12.354395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:12.366171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:12.371766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:12.371766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:12.372208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:12.373424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:12.374044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:12.374459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:12.594507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:12.606865 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eaf12ff4-7b89-4599-ba92-73a7ebb44e10 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1314 microversion: 2.1 time: 0.257057 Aug 29 05:31:12.607441 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3426/6859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:12 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:13.631284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:13.633990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:13.644771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:13.646174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:13.646856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:13.647801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:13.648514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:13.649145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:13.723289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a8b61d68-30dd-4ce9-82f8-33b0c76a40e4 req-15a71da4-02e1-41d5-8c6e-8134b0bcc85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c1bcba-aef5-496f-95d2-f9ad1f46d911", "tag": "79617e14-2f95-4d35-a100-c1740f92ee35"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:31:13.749674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a8b61d68-30dd-4ce9-82f8-33b0c76a40e4 req-15a71da4-02e1-41d5-8c6e-8134b0bcc85a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:13.750228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a8b61d68-30dd-4ce9-82f8-33b0c76a40e4 req-15a71da4-02e1-41d5-8c6e-8134b0bcc85a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:13.750658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a8b61d68-30dd-4ce9-82f8-33b0c76a40e4 req-15a71da4-02e1-41d5-8c6e-8134b0bcc85a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:13.786205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a8b61d68-30dd-4ce9-82f8-33b0c76a40e4 req-15a71da4-02e1-41d5-8c6e-8134b0bcc85a service nova] Creating event network-changed:79617e14-2f95-4d35-a100-c1740f92ee35 for instance 37c1bcba-aef5-496f-95d2-f9ad1f46d911 on n-h2-854119-9 Aug 29 05:31:13.797204 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a8b61d68-30dd-4ce9-82f8-33b0c76a40e4 req-15a71da4-02e1-41d5-8c6e-8134b0bcc85a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079380 Aug 29 05:31:13.797791 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3427/6860] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:31:13.925420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:13.935479 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d66dd5ba-d70d-44dc-a75d-87f5c82d046b tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1314 microversion: 2.1 time: 0.308489 Aug 29 05:31:13.936040 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3434/6861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:13 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:14.962382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:14.963094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:14.981514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:14.982712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:14.983436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:14.985118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:14.985753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:14.986367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:15.246193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:15.262790 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9c4f757b-842e-4553-936a-c4aa864110e2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1314 microversion: 2.1 time: 0.306778 Aug 29 05:31:15.265438 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3428/6862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:14 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:16.294301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:16.294301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:16.314010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:16.314836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:16.315636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:16.327240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:16.327767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:16.330011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:16.857933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:16.869720 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6fdb4581-621c-4e37-bf80-5aa3c65e00d2 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1314 microversion: 2.1 time: 0.586498 Aug 29 05:31:16.870904 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3435/6863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:16 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:17.926320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:17.928327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:17.955459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:17.957583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:17.958281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:17.960979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:17.962109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:17.963951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:18.259109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:18.278552 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e5f068f-ccdf-4e3a-99e2-3d1fb73b7b34 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1314 microversion: 2.1 time: 0.378084 Aug 29 05:31:18.279450 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3429/6864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:17 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:19.301103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:19.301996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:19.327127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:19.327127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:19.327127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:19.327127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:19.327127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:19.327127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:19.623423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:19.634550 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a9635c48-9146-4547-b889-962d8d854f49 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1314 microversion: 2.1 time: 0.337710 Aug 29 05:31:19.635151 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3436/6865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:19 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:20.667463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:20.668085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:20.678150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:20.698119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:20.698922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:20.699513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:20.700429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:20.701164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:20.701831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:21.057021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:21.069242 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea1da2d7-ace1-45e5-a482-e6f0ed43fbed tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1314 microversion: 2.1 time: 0.417902 Aug 29 05:31:21.073751 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3430/6866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:20 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:21.972797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-04525b57-c498-464f-abe0-6b7a1a36a2d6 req-38a0418f-53e6-4f25-a480-57862094c51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c1bcba-aef5-496f-95d2-f9ad1f46d911", "name": "network-vif-plugged", "status": "completed", "tag": "79617e14-2f95-4d35-a100-c1740f92ee35"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:31:21.989531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:21.990205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:22.001334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-04525b57-c498-464f-abe0-6b7a1a36a2d6 req-38a0418f-53e6-4f25-a480-57862094c51f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:22.001812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-04525b57-c498-464f-abe0-6b7a1a36a2d6 req-38a0418f-53e6-4f25-a480-57862094c51f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:22.002239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-04525b57-c498-464f-abe0-6b7a1a36a2d6 req-38a0418f-53e6-4f25-a480-57862094c51f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:22.034606 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-04525b57-c498-464f-abe0-6b7a1a36a2d6 req-38a0418f-53e6-4f25-a480-57862094c51f service nova] Creating event network-vif-plugged:79617e14-2f95-4d35-a100-c1740f92ee35 for instance 37c1bcba-aef5-496f-95d2-f9ad1f46d911 on n-h2-854119-9 Aug 29 05:31:22.045853 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-04525b57-c498-464f-abe0-6b7a1a36a2d6 req-38a0418f-53e6-4f25-a480-57862094c51f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082943 Aug 29 05:31:22.046486 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3437/6867] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:31:22.096856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:22.097577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:22.106804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:22.107788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:22.108309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:22.110142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:22.112308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:22.113134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:22.319869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:22.335966 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-26cff4f4-29e3-4e23-adcb-d900891ca478 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1314 microversion: 2.1 time: 0.244892 Aug 29 05:31:22.336593 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3431/6868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:22 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:23.361308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:23.362907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:23.374459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:23.375996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:23.377150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:23.379455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:23.380429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:23.381983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:23.673299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:23.687827 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ae4c30e5-af77-4782-9683-551e6987d1f8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1314 microversion: 2.1 time: 0.330700 Aug 29 05:31:23.688804 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3438/6869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:23 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:24.710288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:24.711028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:24.720347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:24.720908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:24.721891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:24.722780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:24.723349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:24.723864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:25.183339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:25.196934 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7061c9b8-292a-4185-addd-3209dfea520f tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1499 microversion: 2.1 time: 0.490906 Aug 29 05:31:25.209723 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3432/6870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:24 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1499 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:26.217706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:26.219051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:26.227533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:26.228376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:26.228996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:26.229952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:26.230571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:26.231160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:26.302279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:31:26.445025 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-25168058-84dc-4f24-a151-0e536da5f7bd tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 204 len: 0 microversion: 2.1 time: 0.231180 Aug 29 05:31:26.446117 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3439/6871] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:31:26 2022] DELETE /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:31:26.470644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:26.473047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:26.493257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:26.494288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:26.494973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:26.495822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:26.496467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:26.497122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:27.399264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:27.412431 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7f0960ed-b18e-4469-a1bc-7cffccc00af8 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1505 microversion: 2.1 time: 0.959431 Aug 29 05:31:27.416453 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3433/6872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:26 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1505 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:28.438337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:28.439148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:28.454648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:28.456475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:28.457055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:28.459016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:28.459848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:28.462730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:29.015971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9270ebb0e4d47dbac0f3c709f125e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbc349276c44f51a44878b9b4b17b9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:29.029811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0498f729-2902-48dd-9bd4-41e4e301a01c req-a54d41d9-29f1-4b13-880f-86233afcffd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c1bcba-aef5-496f-95d2-f9ad1f46d911", "name": "network-vif-deleted", "tag": "79617e14-2f95-4d35-a100-c1740f92ee35"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:31:29.041538 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cbbbdbde-0ab9-4034-b4c5-dd13537ed30e tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 200 len: 1505 microversion: 2.1 time: 0.609848 Aug 29 05:31:29.050067 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3440/6873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:28 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:29.051581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0498f729-2902-48dd-9bd4-41e4e301a01c req-a54d41d9-29f1-4b13-880f-86233afcffd4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:29.053157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0498f729-2902-48dd-9bd4-41e4e301a01c req-a54d41d9-29f1-4b13-880f-86233afcffd4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:29.056223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0498f729-2902-48dd-9bd4-41e4e301a01c req-a54d41d9-29f1-4b13-880f-86233afcffd4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:29.096567 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0498f729-2902-48dd-9bd4-41e4e301a01c req-a54d41d9-29f1-4b13-880f-86233afcffd4 service nova] Creating event network-vif-deleted:79617e14-2f95-4d35-a100-c1740f92ee35 for instance 37c1bcba-aef5-496f-95d2-f9ad1f46d911 on n-h2-854119-9 Aug 29 05:31:29.103885 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0498f729-2902-48dd-9bd4-41e4e301a01c req-a54d41d9-29f1-4b13-880f-86233afcffd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077656 Aug 29 05:31:29.108969 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3434/6874] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:31:30.072626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:30.073374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] [instance: 37c1bcba-aef5-496f-95d2-f9ad1f46d911] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:30.091741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:30.093314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:30.097522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:30.100756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:30.101583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:30.104583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:30.125022 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] HTTP exception thrown: Instance 37c1bcba-aef5-496f-95d2-f9ad1f46d911 could not be found. Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Request method failure captured: Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 HTTP/1.1 Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE7_j1C46ZUrwyA63BeMPopyIDszZGOaQruVk7DtoXf3IYwxYxYZtJA6GsEYQV3JQAeI3Ov6awC7DYg6awqFkUfiAuf0IUecsR05ZSAN2x_wDa1qrBfQBk_mTY5vQG9wKNpNw2cu3Z65Dnhuyi1fBAOdnnBAbcuxkLJBCplLK-cwdBo Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: abbc349276c44f51a44878b9b4b17b9e Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesActionsTest-132546401 Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "tempest-type-323073934", "name": "tempest-service-613135343", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abbc349276c44f51a44878b9b4b17b9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abbc349276c44f51a44878b9b4b17b9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abbc349276c44f51a44878b9b4b17b9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abbc349276c44f51a44878b9b4b17b9e"}]}, {"type": "tempest-type-1955559094", "name": "tempest-service-283038954", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesActionsTest-132546401 Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: abbc349276c44f51a44878b9b4b17b9e Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesActionsTest-132546401 Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesActionsTest-132546401-project Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: f9270ebb0e4d47dbac0f3c709f125e34 Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesActionsTest-132546401-project Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 37c1bcba-aef5-496f-95d2-f9ad1f46d911 could not be found. Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '37c1bcba-aef5-496f-95d2-f9ad1f46d911'} Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c1bcba-aef5-496f-95d2-f9ad1f46d911 could not be found. Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c1bcba-aef5-496f-95d2-f9ad1f46d911 could not be found. Aug 29 05:31:30.130584 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c1bcba-aef5-496f-95d2-f9ad1f46d911 could not be found. Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] Returning 404 to user: Instance 37c1bcba-aef5-496f-95d2-f9ad1f46d911 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5402926c-4d9d-45b9-b311-7c91353b3b73 tempest-VolumesActionsTest-132546401 tempest-VolumesActionsTest-132546401-project] 10.222.0.20 "GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911" status: 404 len: 111 microversion: 2.1 time: 0.065404 Aug 29 05:31:30.136438 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3441/6875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:30 2022] GET /compute/v2.1/servers/37c1bcba-aef5-496f-95d2-f9ad1f46d911 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:31:34.265385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-148675042", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "222565b6-9df1-433c-b94b-b4124014b1d3", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "77c879e8-8923-4ae0-9869-fe659563295c"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:31:34.435387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] validate_networks() for [('77c879e8-8923-4ae0-9869-fe659563295c', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:31:35.517048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:31:35.518333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:31:35.519232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:31:35.519867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:31:35.520582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:31:35.547903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:35.553993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:35.554817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:35.557782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:35.559155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:35.561536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:35.589389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=74 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:35.619923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:31:35.644237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for user 83565ba99afd41f4b0d5de74365c3b2f and project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:31:35.682800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:31:35.696060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='222565b6-9df1-433c-b94b-b4124014b1d3',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:31:35.865336 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2ebd1a88-4c26-4503-b2a3-812d1e9da776 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601806 Aug 29 05:31:35.869603 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3435/6876] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:31:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:31:35.881504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-96d6a54f-6990-456a-af0f-9fd7cf410f2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:35.882874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-96d6a54f-6990-456a-af0f-9fd7cf410f2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:36.070811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-96d6a54f-6990-456a-af0f-9fd7cf410f2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:36.082992 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-96d6a54f-6990-456a-af0f-9fd7cf410f2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1056 microversion: 2.1 time: 0.206261 Aug 29 05:31:36.085941 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3442/6877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:35 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1056 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:37.107973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:37.108624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:37.126059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:37.129450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:37.130123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:37.131105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:37.133587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:37.136410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:37.436113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:37.449240 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb15c91e-9a49-49c5-930e-99d4a781ceba tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1052 microversion: 2.1 time: 0.345907 Aug 29 05:31:37.449861 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3436/6878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:37 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1052 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:38.471421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:38.472167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:38.499312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:38.508856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:38.516252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:38.517142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:38.521684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:38.522177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:38.550765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=71,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:38.851626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:38.870081 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69f8c5d2-4a58-48ec-b870-0678c4e2507b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1126 microversion: 2.1 time: 0.401754 Aug 29 05:31:38.873227 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3443/6879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:38 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1126 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:39.897987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:39.898611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:39.918829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:39.919329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:39.919783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:39.920721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:39.921369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:39.921780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:40.069461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:40.083592 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2f93ea2-d849-4c6f-8b13-c2ddf28de2b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1126 microversion: 2.1 time: 0.190189 Aug 29 05:31:40.087670 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3437/6880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:39 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1126 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:41.112765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:41.113560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:41.140440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:41.141226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:41.142281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:41.146517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:41.149065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:41.153970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:41.551917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:41.561051 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f0852583-1407-46ef-ba81-100bae61fe0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.454675 Aug 29 05:31:41.562423 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3444/6881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:41 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:42.550689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-17a4bae5-a5f2-46f5-ba0b-00dc16e834e5 req-844634b8-2191-4e33-83ee-ef6de494f813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce865be-a0fd-4127-8752-a6948907e466", "tag": "073df37a-0293-4476-ba49-a111863bda77"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:31:42.557257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:42.583074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:42.584345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:42.594846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:42.599031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-17a4bae5-a5f2-46f5-ba0b-00dc16e834e5 req-844634b8-2191-4e33-83ee-ef6de494f813 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:42.605397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:42.607310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-17a4bae5-a5f2-46f5-ba0b-00dc16e834e5 req-844634b8-2191-4e33-83ee-ef6de494f813 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:42.610216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-17a4bae5-a5f2-46f5-ba0b-00dc16e834e5 req-844634b8-2191-4e33-83ee-ef6de494f813 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:42.614248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:42.617377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:42.620023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:42.623312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:42.624457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:42.660732 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-17a4bae5-a5f2-46f5-ba0b-00dc16e834e5 req-844634b8-2191-4e33-83ee-ef6de494f813 service nova] Creating event network-changed:073df37a-0293-4476-ba49-a111863bda77 for instance 3ce865be-a0fd-4127-8752-a6948907e466 on n-h2-854119-9 Aug 29 05:31:42.681274 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-17a4bae5-a5f2-46f5-ba0b-00dc16e834e5 req-844634b8-2191-4e33-83ee-ef6de494f813 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134035 Aug 29 05:31:42.689491 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3438/6882] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:31:42.934330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:42.944966 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a43cfd69-b5b3-426d-a743-fa916e872e50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.366679 Aug 29 05:31:42.947524 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3445/6883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:42 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:43.969624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:43.970316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:43.987332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:43.991973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:43.992542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:43.993722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:43.994354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:43.994942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:44.413271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:44.430025 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-649f31d8-8932-4281-876b-1772b2cefad6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.463509 Aug 29 05:31:44.433623 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3439/6884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:43 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:45.461599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:45.465203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:45.486836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:45.488980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:45.489942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:45.491196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:45.493458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:45.494822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:46.005894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:46.026186 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d3e2b133-acc3-4ab0-a2b5-a292bd7700fb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.575044 Aug 29 05:31:46.053240 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3446/6885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:45 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:47.063702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:47.065501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:47.089560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:47.091373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:47.095862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:47.099169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:47.099889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:47.101941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:47.104179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:47.106747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:47.584675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:47.639334 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a98ad79-29eb-468f-acd3-28606a25b6ac tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.581298 Aug 29 05:31:47.656233 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3440/6886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:47 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:48.683888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:48.685129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:48.693553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:31:48.696782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:48.697711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:48.698583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:48.699520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:48.700214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:48.700881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:49.303173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:49.317749 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3e9d280d-f934-43c4-9e06-d7e42f3bb82e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.640988 Aug 29 05:31:49.341501 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3447/6887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:48 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:50.354069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:50.355256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:50.372491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:50.375862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:50.376678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:50.381552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:50.382289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:50.385922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:50.874294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:50.886946 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80c628c4-61f4-4f8b-b2d6-738795b64e17 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.537331 Aug 29 05:31:50.887711 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3441/6888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:50 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:51.909567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:51.911535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:51.925894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:51.927565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:51.929716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:51.930783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:51.932311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:51.932916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:52.926023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:52.948266 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f6c7b71-83f0-44a9-8752-7c8b714ef704 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 1.041206 Aug 29 05:31:52.956636 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3448/6889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:51 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:53.976569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:53.978027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:53.994995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:53.995914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:53.999702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:54.001871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:54.006853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:54.008506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:54.442416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:54.450873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-77f19303-fe65-4abc-87c3-3dca9a105f59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.478896 Aug 29 05:31:54.461056 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3442/6890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:53 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:55.491208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:55.491928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:55.528593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:55.530390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:55.534166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:55.539481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:55.541879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:55.543148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:55.864479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:55.876922 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f09be80d-5946-43d8-be2a-87d5b584ccc2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.398014 Aug 29 05:31:55.891412 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3449/6891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:55 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:56.902349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:56.904900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:56.926860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:56.929456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:56.930704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:56.933189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:56.933679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:56.934170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:57.273356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:57.282872 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43a5a85b-e2c8-428b-b767-47b32f97a5d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.387580 Aug 29 05:31:57.283659 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3443/6892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:56 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:31:58.309378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:58.311090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:58.353779 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:31:58.356871 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:31:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 (ip 10.222.0.20) !!! Aug 29 05:31:58.366440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:58.368349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:58.370194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:58.373399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:58.375270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:58.376510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:58.811422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:31:58.826943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d9d2b17a-dba1-4b04-95b6-c6f04e937160 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.524423 Aug 29 05:31:58.845373 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3450/6893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:58 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:31:59.870772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:31:59.874287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:31:59.922778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:59.924482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:59.925553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:31:59.927269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:31:59.928575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:31:59.929563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:00.795094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:00.808704 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a8017c8e-5b75-4992-955d-ebee4ce8ea9d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.951650 Aug 29 05:32:00.830089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3444/6894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:31:59 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:01.838889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:01.840204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:01.859191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:01.860166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:01.862380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:01.864025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:01.867423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:01.872315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:02.528237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:02.544201 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc952aa7-4c53-465f-9086-154a375d321f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.709206 Aug 29 05:32:02.566927 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3451/6895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:01 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:03.581025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:03.581669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:03.617657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:03.622658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:03.625482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:03.628015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:03.632812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:03.635145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:04.122586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:04.154211 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6036b727-79dc-4bbf-85b5-6d7ded706cae tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.578715 Aug 29 05:32:04.156395 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3445/6896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:03 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:32:05.185455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:05.187061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:05.211127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:05.213666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:05.214666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:05.216055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:05.219816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:05.221474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:05.481108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:05.526218 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-66e1dcce-6cea-43f1-b087-3794f3efbab8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.348352 Aug 29 05:32:05.545350 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3452/6897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:05 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:06.550571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:06.552216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:06.562404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:06.568649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:06.575556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:06.576362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:06.576841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:06.577269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:06.611858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=58 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:32:07.007752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:07.028901 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7ebd7be-8554-4bd8-9511-f9bfc8c9ccb1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.481195 Aug 29 05:32:07.032989 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3446/6898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:06 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:08.059518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:08.060174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:08.085631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:08.086626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:08.090630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:08.091804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:08.092771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:08.094753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:08.486859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:08.511043 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0656ff80-8c0f-47a9-bad1-5c314bbb119f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1168 microversion: 2.1 time: 0.458364 Aug 29 05:32:08.512307 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3453/6899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:08 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1168 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:09.543785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:09.545064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:09.559205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:09.561093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:09.561822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:09.562924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:09.564039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:09.581476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:09.793814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:09.806928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b42de6d5-f547-473f-bb87-5ef57cc9f476 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1202 microversion: 2.1 time: 0.269028 Aug 29 05:32:09.808299 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3447/6900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:09 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1202 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:10.832098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:10.835180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:10.859603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:10.861827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:10.862655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:10.863718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:10.867448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:10.869399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:10.939541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=66 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:32:11.352443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:11.376541 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-849077f3-dd29-43d8-8664-28d244271241 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1202 microversion: 2.1 time: 0.550471 Aug 29 05:32:11.380298 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3454/6901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:10 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1202 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:12.404777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:12.407020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:12.426835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:12.430796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:12.431498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:12.432571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:12.433134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:12.442015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:12.905020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:12.926923 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-812913cc-6951-4f03-a4c9-6d3a70bf1e53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1202 microversion: 2.1 time: 0.527406 Aug 29 05:32:12.946334 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3448/6902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:12 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1202 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:13.954839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:13.955593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:13.958607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=20 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:32:13.997404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:14.002468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:14.006410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:14.013779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:14.014830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:14.018459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:14.633748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:14.647450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-690a79b9-eba8-4a29-aa7d-9670bb26c9e9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1202 microversion: 2.1 time: 0.697414 Aug 29 05:32:14.650375 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3455/6903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:13 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1202 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:15.675751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:15.676338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:15.687502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=22 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:32:15.703332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:15.703838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:15.704363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:15.705088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:15.708690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:15.713723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:16.060520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:16.073717 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1f8e46e8-7809-45e4-867f-fadf85e97b67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1202 microversion: 2.1 time: 0.404414 Aug 29 05:32:16.074822 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3449/6904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:15 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:17.103258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:17.104263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:17.124800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:17.132253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:17.133999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:17.135948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:17.136945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:17.140364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:17.723295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:17.732330 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b94f2763-04e9-4401-88d5-80ce9152d8b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1202 microversion: 2.1 time: 0.637181 Aug 29 05:32:17.749994 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3456/6905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:17 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1202 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:18.758363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:18.759976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:18.794514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:18.805180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:18.812396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:18.813379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:18.813902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:18.814341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:19.450604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:19.463829 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1e642b5b-bb4e-4150-91a0-5ffc9376c0c7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1202 microversion: 2.1 time: 0.706056 Aug 29 05:32:19.467604 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3450/6906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:18 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1202 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:20.498015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:20.499934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:20.542894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:20.544581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:20.546036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:20.547274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:20.549253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:20.550531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:20.687571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-aafe81d6-8ac8-4e33-be23-acf62d5a821a req-01de2f33-ad6f-49ad-b3ed-563348a9a20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce865be-a0fd-4127-8752-a6948907e466", "name": "network-vif-plugged", "status": "completed", "tag": "073df37a-0293-4476-ba49-a111863bda77"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:32:20.713748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-aafe81d6-8ac8-4e33-be23-acf62d5a821a req-01de2f33-ad6f-49ad-b3ed-563348a9a20a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:20.714333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-aafe81d6-8ac8-4e33-be23-acf62d5a821a req-01de2f33-ad6f-49ad-b3ed-563348a9a20a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:20.714842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-aafe81d6-8ac8-4e33-be23-acf62d5a821a req-01de2f33-ad6f-49ad-b3ed-563348a9a20a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:20.732610 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-aafe81d6-8ac8-4e33-be23-acf62d5a821a req-01de2f33-ad6f-49ad-b3ed-563348a9a20a service nova] Creating event network-vif-plugged:073df37a-0293-4476-ba49-a111863bda77 for instance 3ce865be-a0fd-4127-8752-a6948907e466 on n-h2-854119-9 Aug 29 05:32:20.747701 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-aafe81d6-8ac8-4e33-be23-acf62d5a821a req-01de2f33-ad6f-49ad-b3ed-563348a9a20a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.430434 Aug 29 05:32:20.749095 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3457/6907] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:32:20.994956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:21.019523 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-58fd452e-a5d3-4039-945a-aa1a8e18f783 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1202 microversion: 2.1 time: 0.530589 Aug 29 05:32:21.020178 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3451/6908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:20 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1202 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:22.048800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:22.050254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:22.060647 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:22.061487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:22.062058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:22.063064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:22.063693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:22.064410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:22.301329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:22.311682 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c2a71b3-fada-428d-9848-6c58ead11774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1202 microversion: 2.1 time: 0.269608 Aug 29 05:32:22.313142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3458/6909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:22 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1202 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:23.342392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:23.343635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:23.354944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:23.355554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:23.356267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:23.357401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:23.359059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:23.359787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:23.703411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:23.715001 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d396df2-5611-4d83-adb8-22c5ab248e59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1389 microversion: 2.1 time: 0.378922 Aug 29 05:32:23.716071 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3452/6910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:23 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1389 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:23.742522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:23.743658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:23.755776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:23.760399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:23.761161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:23.762164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:23.769662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:23.770473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:24.022070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:24.034208 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-12ab085f-5f8c-4eb8-a3b1-248c693b81de tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1389 microversion: 2.1 time: 0.298403 Aug 29 05:32:24.036322 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3459/6911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:23 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1389 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:24.065279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:24.066297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:24.074861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:24.076055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:24.077542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:24.078853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:24.079720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:24.080786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:24.413171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:24.424957 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ffd78bb-7aa3-4dc9-8a5a-ef5638945717 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1389 microversion: 2.1 time: 0.363982 Aug 29 05:32:24.426639 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3453/6912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:24 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1389 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:24.574015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:24.574848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:24.620356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:24.623830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:24.624653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:24.625829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:24.627950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:24.629835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:24.712094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:32:24.873017 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-53195238-0e9d-4774-9c0a-76f77ee0d06b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 204 len: 0 microversion: 2.1 time: 0.305827 Aug 29 05:32:24.873724 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3460/6913] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:32:24 2022] DELETE /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:32:24.883990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:24.884706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:24.892086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:24.893083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:24.893709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:24.894584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:24.895199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:24.895784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:25.249343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:25.259127 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-62c3a96c-4557-4787-b65d-d2d43ce7059c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1395 microversion: 2.1 time: 0.380345 Aug 29 05:32:25.260823 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3454/6914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:24 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1395 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:26.291111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:26.298133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:26.360992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:26.362704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:26.367667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:26.368720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:26.369359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:26.370738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:26.700997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:26.717296 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e2000c1-77a3-43d5-a663-ba58372c6db3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1395 microversion: 2.1 time: 0.438868 Aug 29 05:32:26.740558 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3461/6915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:26 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1395 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:27.419410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6dfd210c-30af-4320-85d1-f0dac16be0b9 req-5b3054eb-b1b1-4678-b7fc-5d857cc74359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce865be-a0fd-4127-8752-a6948907e466", "name": "network-vif-deleted", "tag": "073df37a-0293-4476-ba49-a111863bda77"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:32:27.452649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6dfd210c-30af-4320-85d1-f0dac16be0b9 req-5b3054eb-b1b1-4678-b7fc-5d857cc74359 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:27.453141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6dfd210c-30af-4320-85d1-f0dac16be0b9 req-5b3054eb-b1b1-4678-b7fc-5d857cc74359 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:27.453567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6dfd210c-30af-4320-85d1-f0dac16be0b9 req-5b3054eb-b1b1-4678-b7fc-5d857cc74359 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:27.482018 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6dfd210c-30af-4320-85d1-f0dac16be0b9 req-5b3054eb-b1b1-4678-b7fc-5d857cc74359 service nova] Creating event network-vif-deleted:073df37a-0293-4476-ba49-a111863bda77 for instance 3ce865be-a0fd-4127-8752-a6948907e466 on n-h2-854119-9 Aug 29 05:32:27.495336 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6dfd210c-30af-4320-85d1-f0dac16be0b9 req-5b3054eb-b1b1-4678-b7fc-5d857cc74359 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077160 Aug 29 05:32:27.502199 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3455/6916] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:32:27.757416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:27.764342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:27.773154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:27.773994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:27.774642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:27.775588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:27.776344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:27.777081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:27.906062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:27.923816 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b1a4572f-3e7e-4dee-b9a1-80af83676c3e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1187 microversion: 2.1 time: 0.171542 Aug 29 05:32:27.926285 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3462/6917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:27 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1187 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:28.957699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:28.959419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:28.972282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:28.974581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:28.976235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:28.980140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:28.980626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:28.981063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:29.106885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:29.119608 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2469c807-6fbc-4dd5-a34c-a93ce09ea8e2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1187 microversion: 2.1 time: 0.167507 Aug 29 05:32:29.123436 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3456/6918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:28 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1187 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:30.145949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:30.147691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:30.167818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:30.169759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:30.170502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:30.172619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:30.174510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:30.178526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:30.293684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:30.310755 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c96d8ada-eccc-4f84-bb00-209c1a0d4b00 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1187 microversion: 2.1 time: 0.170043 Aug 29 05:32:30.312613 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3463/6919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:30 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1187 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:31.335661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:31.336616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:31.349365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:31.353933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:31.354626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:31.355533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:31.356323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:31.356991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:31.450467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:31.464590 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23b8ad5d-609f-4afe-86bc-bfc482ba52f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1187 microversion: 2.1 time: 0.133461 Aug 29 05:32:31.467261 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3457/6920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:31 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1187 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:32.492433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:32.493477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:32.516404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:32.516953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:32.517386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:32.518095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:32.518545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:32.518965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:32.662236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:32.688226 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ad2132f9-5896-43db-9271-44cf7ceb6ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1187 microversion: 2.1 time: 0.202343 Aug 29 05:32:32.707638 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3464/6921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:32 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1187 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:33.724040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:33.725765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:33.751980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:33.752639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:33.753245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:33.754148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:33.755594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:33.760395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:33.851181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:33.863748 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8805ce07-bb0d-4dbf-933d-30f9a68b11b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1187 microversion: 2.1 time: 0.144476 Aug 29 05:32:33.864842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3458/6922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:33 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1187 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:34.891967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:34.893989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:34.903088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:34.904254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:34.904880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:34.906595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:34.907461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:34.908386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:34.957434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:34.958201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:34.958812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:34.959433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lazy-loading 'fault' on Instance uuid 3ce865be-a0fd-4127-8752-a6948907e466 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:32:35.040969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:32:35.060345 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7a07492a-847d-477a-9cfa-f51ecff8d085 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 200 len: 1192 microversion: 2.1 time: 0.170366 Aug 29 05:32:35.062111 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3465/6923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:34 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 1192 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:32:36.084918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:36.086262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:36.104325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:36.105154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:36.105772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:36.111123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:36.115214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:36.116233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:36.142145 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 HTTP/1.1 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '3ce865be-a0fd-4127-8752-a6948907e466'} Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:32:36.145013 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:36.150427 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:32:36.150427 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:32:36.150427 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:32:36.150427 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:32:36.150427 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:32:36.150427 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:36.150427 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:36.150427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:32:36.150427 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-caab5b93-5ae0-4f39-aad8-21f303c223a4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 404 len: 111 microversion: 2.1 time: 0.067253 Aug 29 05:32:36.152779 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3459/6924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:36 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:32:40.710190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:40.711445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:40.730883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:40.734618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:40.735355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:40.736419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:40.737101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:40.741034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:40.783266 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 HTTP/1.1 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '3ce865be-a0fd-4127-8752-a6948907e466'} Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:32:40.788601 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.793227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.798071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:32:40.804945 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7321e5d-0eac-496e-8bce-bc2cffd5a48d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 404 len: 111 microversion: 2.1 time: 0.098573 Aug 29 05:32:40.806305 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3466/6925] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:32:40 2022] DELETE /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:32:40.815178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:32:40.815804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 3ce865be-a0fd-4127-8752-a6948907e466] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:32:40.850551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:40.857390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:40.858211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:40.862137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:32:40.862854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:32:40.866186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:32:40.880971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=76 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:32:40.952068 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 HTTP/1.1 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '3ce865be-a0fd-4127-8752-a6948907e466'} Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:32:40.966766 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.975574 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:32:40.975574 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:32:40.975574 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:32:40.975574 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:32:40.975574 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:32:40.975574 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. Aug 29 05:32:40.975574 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:32:40.975574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 3ce865be-a0fd-4127-8752-a6948907e466 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:32:40.975574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2cf8516-47ce-4afc-a0be-d4a0d8e13ac2 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466" status: 404 len: 111 microversion: 2.1 time: 0.159097 Aug 29 05:32:40.982160 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3460/6926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:32:40 2022] GET /compute/v2.1/servers/3ce865be-a0fd-4127-8752-a6948907e466 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:33:26.616228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-676939401", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bccecd36-33c6-4cc8-b9d6-d24cd028e575", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "77c879e8-8923-4ae0-9869-fe659563295c"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:33:26.647369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:26.656252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:26.739180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] validate_networks() for [('77c879e8-8923-4ae0-9869-fe659563295c', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:33:27.777675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:33:27.778628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:33:27.778628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:33:27.778947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:33:27.779686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:33:27.809527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:27.814081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:27.814906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:27.819696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:27.824180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:27.825157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:27.877748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:33:27.892393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for user 83565ba99afd41f4b0d5de74365c3b2f and project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:33:28.026766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:33:28.033170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bccecd36-33c6-4cc8-b9d6-d24cd028e575',volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:33:28.382530 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [dd1b89bb-156e-42a6-8426-e6b8a5de3b1c] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 05:33:29.393490 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [dd1b89bb-156e-42a6-8426-e6b8a5de3b1c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43112. Aug 29 05:33:29.407254 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cf24031e-5354-4f9f-8a4e-f2ae7b8828c0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.794871 Aug 29 05:33:29.411908 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3467/6927] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:33:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:33:29.423202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d36c7fd8-f8d6-419d-88b7-85a85ce16bd0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:29.423988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d36c7fd8-f8d6-419d-88b7-85a85ce16bd0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:29.436143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=23 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:29.443027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:29.563146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d36c7fd8-f8d6-419d-88b7-85a85ce16bd0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:29.571219 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d36c7fd8-f8d6-419d-88b7-85a85ce16bd0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1070 microversion: 2.1 time: 0.152157 Aug 29 05:33:29.573632 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3461/6928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:29 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1070 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:30.600627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7aaff6fa-dd24-4e57-9f8d-f51148418270 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:30.601426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7aaff6fa-dd24-4e57-9f8d-f51148418270 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:30.711119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7aaff6fa-dd24-4e57-9f8d-f51148418270 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:30.721137 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7aaff6fa-dd24-4e57-9f8d-f51148418270 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1070 microversion: 2.1 time: 0.124973 Aug 29 05:33:30.721869 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3468/6929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:30 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1070 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:33:31.750115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b354f525-ed53-418e-bfef-6b2276fdf256 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:31.751339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b354f525-ed53-418e-bfef-6b2276fdf256 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:31.829268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b354f525-ed53-418e-bfef-6b2276fdf256 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:31.837406 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b354f525-ed53-418e-bfef-6b2276fdf256 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1070 microversion: 2.1 time: 0.091982 Aug 29 05:33:31.838101 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3462/6930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:31 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1070 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:32.858501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8c9f135-633c-42b7-b15a-0328824fa257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:32.859113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8c9f135-633c-42b7-b15a-0328824fa257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:32.928277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8c9f135-633c-42b7-b15a-0328824fa257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:32.939835 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8c9f135-633c-42b7-b15a-0328824fa257 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1070 microversion: 2.1 time: 0.085548 Aug 29 05:33:32.941263 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3469/6931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:32 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1070 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:33.960988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:33.962372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:33.970210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:33.970886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:33.971757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:33.972717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:33.973356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:33.974035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:34.042559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:34.056929 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-861b15d5-2c3c-47df-8087-2258458a1feb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1120 microversion: 2.1 time: 0.099760 Aug 29 05:33:34.058015 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3463/6932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:33 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1120 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:35.078336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:35.078982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:35.086409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:35.086893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:35.087329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:35.088051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:35.088524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:35.088997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:35.199389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:35.213188 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-88b88d9a-7a70-4b03-9bf2-59c26e6e2f82 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1168 microversion: 2.1 time: 0.136904 Aug 29 05:33:35.225730 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3470/6933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:35 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1168 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:36.244825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:36.248994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:36.277066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:36.281170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:36.283025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:36.290445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:36.291723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:36.310449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:36.469494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:36.478597 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4f68cc1-f0c5-4ba0-9b10-8670d521d926 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1186 microversion: 2.1 time: 0.245082 Aug 29 05:33:36.480075 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3464/6934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:36 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1186 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:37.511145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:37.512311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:37.535498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:37.536754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:37.537580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:37.545539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:37.546693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:37.547500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:37.847033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:38.159311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:38.168566 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a800ba77-6011-4237-9066-1072855731c8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1228 microversion: 2.1 time: 0.661964 Aug 29 05:33:38.173041 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3471/6935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:37 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1228 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:38.950887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9df5242b-7dec-434b-9b55-28f47442495d req-fdf57c7d-5b99-4091-933f-5f00fc784df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008e8d89-5d72-42ed-92d7-31550d9bb38b", "tag": "d3ad1264-d5f5-467f-b203-b294ecb1f088"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:33:38.977364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9df5242b-7dec-434b-9b55-28f47442495d req-fdf57c7d-5b99-4091-933f-5f00fc784df2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:38.979021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9df5242b-7dec-434b-9b55-28f47442495d req-fdf57c7d-5b99-4091-933f-5f00fc784df2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:38.979692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9df5242b-7dec-434b-9b55-28f47442495d req-fdf57c7d-5b99-4091-933f-5f00fc784df2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:39.017696 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9df5242b-7dec-434b-9b55-28f47442495d req-fdf57c7d-5b99-4091-933f-5f00fc784df2 service nova] Creating event network-changed:d3ad1264-d5f5-467f-b203-b294ecb1f088 for instance 008e8d89-5d72-42ed-92d7-31550d9bb38b on n-h2-854119-9 Aug 29 05:33:39.040651 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9df5242b-7dec-434b-9b55-28f47442495d req-fdf57c7d-5b99-4091-933f-5f00fc784df2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092789 Aug 29 05:33:39.043981 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3465/6936] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:33:39.199099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:39.199750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:39.220050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:39.220929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:39.223374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:39.225055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:39.229004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:39.229822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:39.612065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:39.628205 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8a7cd0c7-3031-4971-a323-62bae1568793 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1228 microversion: 2.1 time: 0.432523 Aug 29 05:33:39.630119 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3472/6937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:39 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1228 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:40.653810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:40.654532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:40.665020 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:33:40.668033 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:33:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b (ip 10.222.0.20) !!! Aug 29 05:33:40.673067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:40.675559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:40.676269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:40.677197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:40.682658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:40.683129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:41.182388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:41.199491 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2518c021-4ff8-44f4-b3da-531a1898cb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1228 microversion: 2.1 time: 0.552778 Aug 29 05:33:41.203401 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3466/6938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:40 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1228 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:42.225249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:42.226549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:42.239546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:42.241915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:42.246458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:42.249504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:42.250165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:42.252669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:42.519654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:42.532740 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2d8a512-aa58-4243-85f2-349a016f1a0a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1228 microversion: 2.1 time: 0.312608 Aug 29 05:33:42.552652 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3473/6939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:42 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1228 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:43.564363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:43.565673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:43.568941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:43.594755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:43.595918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:43.598163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:43.603976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:43.606592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:43.607370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:43.922399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:43.937877 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-41677fe3-f18f-4bf2-b1c1-db387432d3cf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1228 microversion: 2.1 time: 0.377619 Aug 29 05:33:43.939151 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3467/6940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:43 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1228 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:44.975668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:44.977618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:44.981941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=10 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:44.993930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:44.994707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:44.995432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:44.996607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:44.997329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:44.998272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:45.187321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:45.202064 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e2f4cde-56ce-496f-b20c-d95f2cc77ba1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.238104 Aug 29 05:33:45.215527 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3474/6941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:44 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:46.225031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:46.225731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:46.235968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:46.242692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:46.243184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:46.244363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:46.244868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:46.245277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:46.445300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:46.455809 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d66a9672-a998-42bc-8f7a-45fcb44f2ef4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.236097 Aug 29 05:33:46.457018 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3468/6942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:46 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:33:47.477330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:47.478061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:47.486056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:47.486786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:47.487226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:47.487940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:47.488609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:47.489027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:47.653506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:47.662996 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-442dbe2c-58f4-47f9-8afb-e55adfef8669 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.189799 Aug 29 05:33:47.664226 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3475/6943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:47 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:48.695791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:48.710007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:48.749642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:48.752878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:48.753737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:48.755809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:48.758181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:48.761429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:49.206617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:49.215593 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2dd0f523-813e-4c56-aca5-e883681a5c24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.530937 Aug 29 05:33:49.216216 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3469/6944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:48 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:50.238948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:50.240380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:50.249858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:50.251254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:50.258410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:50.259749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:50.261338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:50.261962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:50.601377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:50.629553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-37464ab5-2e07-4452-9410-c70084bf12eb tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.394495 Aug 29 05:33:50.633726 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3476/6945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:50 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:52.098685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:52.099891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:52.107183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:52.107765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:52.108149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:52.108870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:52.109343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:52.109737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:52.305956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:52.317368 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ccf8818a-e017-41b8-bbed-e82db89ffb1a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.668984 Aug 29 05:33:52.318962 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3470/6946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:51 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:53.351254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:53.351254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:53.371939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:53.372496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:53.373270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:53.374272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:53.374779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:53.377730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:53.597974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:53.612425 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-240c4aea-6bb0-4d62-9ad6-c78f7591d467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.277203 Aug 29 05:33:53.615396 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3477/6947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:53 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:54.135413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-138648331", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:33:54.210621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:33:54.666197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:54.669677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:54.700461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:54.701116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:54.701657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:54.702495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:54.703073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:54.703600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:55.282633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:33:55.283751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:33:55.284443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:33:55.285054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:33:55.285771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:33:55.304775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:55.305597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:55.306387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:55.307316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:55.307771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:55.308245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:55.337141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Getting quotas for project 3182f9aa35cd4a97aac8b0364b3c8dfc. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:33:55.362777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Getting quotas for user ca38de9e0c4544d483f93a663a1f9298 and project 3182f9aa35cd4a97aac8b0364b3c8dfc. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:33:55.395162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:55.396533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:33:55.399949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:33:55.412418 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e8f1609-fc20-4e88-9dde-8722b5724ab5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.757393 Aug 29 05:33:55.430055 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3478/6948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:54 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:55.548919 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9e0d8d72-3c48-4c3a-bdc4-c495b85c26a2 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417465 Aug 29 05:33:55.549592 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3471/6949] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:33:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:33:55.565166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e0763ff-ed96-4221-bf3a-13ac4c4c50ac tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:55.565936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e0763ff-ed96-4221-bf3a-13ac4c4c50ac tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:55.685078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e0763ff-ed96-4221-bf3a-13ac4c4c50ac tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:55.698871 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e0763ff-ed96-4221-bf3a-13ac4c4c50ac tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1214 microversion: 2.1 time: 0.139704 Aug 29 05:33:55.706440 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3479/6950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:55 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:56.436762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:56.438250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:56.463591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:56.466816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:56.468171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:56.470722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:56.471870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:56.473074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:56.734486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:56.739378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:56.740420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:56.749679 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eafd226c-0632-4eaf-9275-291c4f7d0def tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.319072 Aug 29 05:33:56.750147 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3472/6951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:56 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:33:56.770749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:56.773219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:56.774809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:56.775867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:56.777305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:56.777991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:56.778584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:56.809494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=57 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:56.903223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:56.912711 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-76c30275-289d-47b1-a545-7f67d7bba4fe tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1266 microversion: 2.1 time: 0.178351 Aug 29 05:33:56.919320 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3480/6952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:56 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:33:57.778931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:57.779845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:57.790437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:57.795839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:57.796517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:57.797499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:57.798161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:57.798780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:57.814834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-468e5b68-ad0a-4c2c-9f3f-7808b382e653 req-a90458c2-920c-44e0-9d0b-e0aa95405b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008e8d89-5d72-42ed-92d7-31550d9bb38b", "name": "network-vif-plugged", "status": "completed", "tag": "d3ad1264-d5f5-467f-b203-b294ecb1f088"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:33:57.834674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-468e5b68-ad0a-4c2c-9f3f-7808b382e653 req-a90458c2-920c-44e0-9d0b-e0aa95405b40 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:57.835155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-468e5b68-ad0a-4c2c-9f3f-7808b382e653 req-a90458c2-920c-44e0-9d0b-e0aa95405b40 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:57.840206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-468e5b68-ad0a-4c2c-9f3f-7808b382e653 req-a90458c2-920c-44e0-9d0b-e0aa95405b40 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:57.858419 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-468e5b68-ad0a-4c2c-9f3f-7808b382e653 req-a90458c2-920c-44e0-9d0b-e0aa95405b40 service nova] Creating event network-vif-plugged:d3ad1264-d5f5-467f-b203-b294ecb1f088 for instance 008e8d89-5d72-42ed-92d7-31550d9bb38b on n-h2-854119-9 Aug 29 05:33:57.882432 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-468e5b68-ad0a-4c2c-9f3f-7808b382e653 req-a90458c2-920c-44e0-9d0b-e0aa95405b40 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071562 Aug 29 05:33:57.883656 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3481/6953] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:33:57.945928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:57.947610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:57.962152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:57.962649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:57.963083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:57.963775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:57.972747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:57.973060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:58.287319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:58.299754 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-001696c4-fa74-42db-9b65-5af19f3dff07 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1272 microversion: 2.1 time: 0.358351 Aug 29 05:33:58.300874 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3482/6954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:57 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1272 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:33:58.455964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:33:58.475180 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bbdb74c9-cbab-4927-9b4b-681482aaed2e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 0.698795 Aug 29 05:33:58.493001 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3473/6955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:57 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:33:59.322398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:59.323295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:59.361498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:59.367067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:59.370837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:59.371653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:59.383722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:59.384609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:59.499806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:33:59.501286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:33:59.525885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:33:59.531815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:59.532548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:59.533004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:59.535143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:33:59.565117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:33:59.565779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:33:59.600488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=59 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:01.316906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:01.333176 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ef04045-a638-4a43-b061-0ed4942ab864 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1216 microversion: 2.1 time: 1.838184 Aug 29 05:34:01.339825 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3474/6956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:59 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1216 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:01.420909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:01.438183 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ae90b443-7bb4-42f2-9ddb-efb8843c39b0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1314 microversion: 2.1 time: 2.120276 Aug 29 05:34:01.442060 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3483/6957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:33:59 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1314 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:02.364622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:02.365716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:02.381187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:02.382035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:02.383112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:02.384092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:02.384771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:02.386181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:02.674885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b817e31c-167d-42d8-baad-849130045d09 req-d33103a2-5422-4340-b6b2-d77e63e14f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fba0623-63fa-4588-9eb8-d964de92e695", "tag": "0806de14-cdfd-4e1d-b099-7de63deba76c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:02.716521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b817e31c-167d-42d8-baad-849130045d09 req-d33103a2-5422-4340-b6b2-d77e63e14f8b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:02.717269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b817e31c-167d-42d8-baad-849130045d09 req-d33103a2-5422-4340-b6b2-d77e63e14f8b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:02.717872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b817e31c-167d-42d8-baad-849130045d09 req-d33103a2-5422-4340-b6b2-d77e63e14f8b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:02.733617 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b817e31c-167d-42d8-baad-849130045d09 req-d33103a2-5422-4340-b6b2-d77e63e14f8b service nova] Creating event network-changed:0806de14-cdfd-4e1d-b099-7de63deba76c for instance 6fba0623-63fa-4588-9eb8-d964de92e695 on n-h1-854119-9 Aug 29 05:34:02.738564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:02.741807 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b817e31c-167d-42d8-baad-849130045d09 req-d33103a2-5422-4340-b6b2-d77e63e14f8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.572048 Aug 29 05:34:02.744002 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3475/6958] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:34:02.752316 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e5be895f-45be-4f97-a8aa-bf676f63aaed tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1403 microversion: 2.1 time: 0.395669 Aug 29 05:34:02.754036 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3484/6959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:02 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1403 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:02.755835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:02.757146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:02.769754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:02.771945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:02.773021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:02.774440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:02.775600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:02.776541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:02.785319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:02.786210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:02.794870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:02.797281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:02.798217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:02.801056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:02.802442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:02.803664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:03.183012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:03.203368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:03.211540 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ee1133d6-3dc7-4577-9ef0-37fa8605c162 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1314 microversion: 2.1 time: 0.452348 Aug 29 05:34:03.215703 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3476/6960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:02 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:03.226588 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-935baa63-b393-422d-9ae1-1485d2d4b6f9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1403 microversion: 2.1 time: 0.445434 Aug 29 05:34:03.243379 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3485/6961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:02 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1403 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:03.253379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-361389016"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:03.256507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:03.266631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:03.267540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:03.268424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:03.269956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:03.270675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:03.271795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:03.410884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-58732d53-e036-4a81-8fba-185022379833 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Action: 'create', calling method: .version_select at 0x7f1ab8176e50>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1059919766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc3X6akHnBMefR5b2s+318tgKbXbDmbecGce2woSEwLPKSaAkZAmX0LDlzNGhQxhjDkx/Vab5PYoMpnkbOzs6Y7+Q2tFH3HGYlpRhdikmS5Ra7Xvb0IqyvLnHaKDm2RqA=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:03.448305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-58732d53-e036-4a81-8fba-185022379833 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Getting quotas for project 0e9ff964acbf4ae7b5d4358d0cbe173d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:34:03.450442 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Attempting to quiesce instance before volume snapshot. Aug 29 05:34:03.458139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-58732d53-e036-4a81-8fba-185022379833 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Getting quotas for user 8bffc42cd0994bdd911dc1e0af4dca46 and project 0e9ff964acbf4ae7b5d4358d0cbe173d. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:34:03.495086 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-58732d53-e036-4a81-8fba-185022379833 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.277478 Aug 29 05:34:03.495710 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3477/6962] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:34:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:34:03.513869 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 29 05:34:03.635193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Creating snapshot from volume bccecd36-33c6-4cc8-b9d6-d24cd028e575. {{(pid=128871) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 29 05:34:04.245129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:04.247043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:04.258459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:04.259345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:04.260019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:04.260999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:04.261674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:04.262444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:04.551385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:04.562169 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0170fef7-548e-409b-80cc-5be2446b0377 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1314 microversion: 2.1 time: 0.322869 Aug 29 05:34:04.563721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3478/6963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:04 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:05.270449 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42cd3d4f-bbe0-47e2-b350-33b4053bed96 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b/action" status: 202 len: 0 microversion: 2.1 time: 2.021319 Aug 29 05:34:05.271127 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3486/6964] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:34:03 2022] POST /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b/action => generated 0 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 05:34:05.575844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1072363911", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1059919766", "security_groups": [{"name": "tempest-secgroup-smoke-1508008623"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "c5154c78-b4ff-4f8a-9e0c-978a125f7e5a"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:05.594341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:05.596457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:05.608469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:05.612147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:05.615395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:05.616023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:05.616934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:05.620998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:05.625034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:05.694058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:06.038033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] validate_networks() for [('c5154c78-b4ff-4f8a-9e0c-978a125f7e5a', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:34:06.044986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:06.094623 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-feb9907a-9d00-41dc-848f-a9e2cd5d277b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1314 microversion: 2.1 time: 0.505307 Aug 29 05:34:06.111690 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3487/6965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:05 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:07.122368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:07.123788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Getting quotas for project 0e9ff964acbf4ae7b5d4358d0cbe173d. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:34:07.124491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:07.136701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Getting quotas for user 8bffc42cd0994bdd911dc1e0af4dca46 and project 0e9ff964acbf4ae7b5d4358d0cbe173d. Resources: dict_keys(['metadata_items']) {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:34:07.138601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:07.139507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:07.141251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:07.142564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:07.143637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:07.144489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:07.159372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:34:07.164943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:34:07.165539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:34:07.165946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:34:07.166367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:34:07.177597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:07.178423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:07.179029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:07.179963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:07.180620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:07.181240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:07.214848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Getting quotas for project 0e9ff964acbf4ae7b5d4358d0cbe173d. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:34:07.239237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Getting quotas for user 8bffc42cd0994bdd911dc1e0af4dca46 and project 0e9ff964acbf4ae7b5d4358d0cbe173d. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:34:07.263936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:34:07.266630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:34:07.387481 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-20bedf5f-d210-495c-8400-ed418787f36a tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.817777 Aug 29 05:34:07.388728 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3479/6966] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:34:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:34:07.426325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:07.433035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9d80a10-87ab-4a21-a04e-b7415cea0d93 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:07.434420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a9d80a10-87ab-4a21-a04e-b7415cea0d93 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:07.439764 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dda16e53-1931-434a-abde-72bd4ab103d0 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1314 microversion: 2.1 time: 0.323193 Aug 29 05:34:07.461223 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3488/6967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:07 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:07.583216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a9d80a10-87ab-4a21-a04e-b7415cea0d93 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:07.601237 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9d80a10-87ab-4a21-a04e-b7415cea0d93 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1303 microversion: 2.1 time: 0.195098 Aug 29 05:34:07.603211 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3480/6968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:07 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:07.771791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1187496759", "imageRef": "9a79aed5-69e0-4c55-bb07-e28abb72bc92", "flavorRef": "452", "networks": [{"uuid": "77c879e8-8923-4ae0-9869-fe659563295c"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:07.891747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] validate_networks() for [('77c879e8-8923-4ae0-9869-fe659563295c', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:34:08.473507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:08.474432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:08.493428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:08.494456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:08.494456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:08.501196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:08.502037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:08.502731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:08.804154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:08.812876 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dbe4a4a8-d92f-4e00-82fa-13948f05e093 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1314 microversion: 2.1 time: 0.348496 Aug 29 05:34:08.825297 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3481/6969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:08 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:08.850550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:08.855028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:08.867536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:08.868659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:08.869398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:08.870488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:08.875492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:08.877683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:08.915758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:34:08.917286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:34:08.923494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:34:08.925803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:34:08.926775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:34:08.945788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:08.946954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:08.947559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:08.948496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:08.949229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:08.950749 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:08.981352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:34:08.989218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for user 83565ba99afd41f4b0d5de74365c3b2f and project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:34:09.010858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:34:09.015242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6033c57d-f1c8-4386-afa3-18263bfbe558',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:34:09.030512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:09.039874 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-384b5473-6923-4f1b-92d9-553fa28c73b3 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1355 microversion: 2.1 time: 0.200496 Aug 29 05:34:09.040698 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3482/6970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:08 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1355 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:09.112225 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b528ebed-8df6-4207-b9ff-890d252dc754 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342613 Aug 29 05:34:09.112225 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3489/6971] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:34:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:34:09.123880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11eb3dfa-c6cd-4d84-8088-80b1f4021e02 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:09.124651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-11eb3dfa-c6cd-4d84-8088-80b1f4021e02 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:09.219340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-11eb3dfa-c6cd-4d84-8088-80b1f4021e02 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:09.231372 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11eb3dfa-c6cd-4d84-8088-80b1f4021e02 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1230 microversion: 2.1 time: 0.113225 Aug 29 05:34:09.232579 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3483/6972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:09 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:09.853428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:09.859625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:09.882074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:09.903247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:09.904156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:09.905344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:09.906205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:09.907062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:09.989947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-83b7bc59-ceac-4ced-9226-23ad30f66b40 req-5e4890be-51b1-4a28-8900-f090fdefc416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fba0623-63fa-4588-9eb8-d964de92e695", "name": "network-vif-plugged", "status": "completed", "tag": "0806de14-cdfd-4e1d-b099-7de63deba76c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:10.009184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-83b7bc59-ceac-4ced-9226-23ad30f66b40 req-5e4890be-51b1-4a28-8900-f090fdefc416 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:10.009689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-83b7bc59-ceac-4ced-9226-23ad30f66b40 req-5e4890be-51b1-4a28-8900-f090fdefc416 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:10.010113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-83b7bc59-ceac-4ced-9226-23ad30f66b40 req-5e4890be-51b1-4a28-8900-f090fdefc416 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:10.051705 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-83b7bc59-ceac-4ced-9226-23ad30f66b40 req-5e4890be-51b1-4a28-8900-f090fdefc416 service nova] Creating event network-vif-plugged:0806de14-cdfd-4e1d-b099-7de63deba76c for instance 6fba0623-63fa-4588-9eb8-d964de92e695 on n-h1-854119-9 Aug 29 05:34:10.076786 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-83b7bc59-ceac-4ced-9226-23ad30f66b40 req-5e4890be-51b1-4a28-8900-f090fdefc416 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090554 Aug 29 05:34:10.077720 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3484/6973] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:34:10.084693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:10.091873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:10.107485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:10.108609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:10.110054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:10.112474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:10.113369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:10.114196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:10.338931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:10.349807 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-187f9186-c4bb-45e1-8f33-133d8c2cfbc4 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1361 microversion: 2.1 time: 0.270654 Aug 29 05:34:10.353787 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3485/6974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:10 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:10.362971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:10.366038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:10.380144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:10.382779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:10.389465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:10.390032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:10.390798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:10.391293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:10.395766 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-33c18a09-a1fb-4481-9b15-01462f94b110 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1314 microversion: 2.1 time: 0.551335 Aug 29 05:34:10.396412 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3490/6975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:09 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:10.400791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:10.520414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:10.534871 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-04fa42d9-4b23-4cd3-8275-eef2c4d4b744 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1226 microversion: 2.1 time: 0.175607 Aug 29 05:34:10.536150 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3486/6976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:10 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1226 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:11.377446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:11.378285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:11.386623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:11.388640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:11.389424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:11.390564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:11.391278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:11.391856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:11.421607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:11.423586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:11.432303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:11.433327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:11.434035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:11.435007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:11.435713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:11.436456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:11.656440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:11.665462 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95b49302-38b0-4be9-9e9c-9952950d7c17 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1429 microversion: 2.1 time: 0.294240 Aug 29 05:34:11.681153 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3491/6977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:11 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1429 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:11.712019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d3ab44aa-c695-4b4b-a5df-98434dc4dc76 req-1703d53c-8f69-476c-b19c-ad35e2f5b5aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfb32e8-b182-4749-b047-9882e92d37bd", "tag": "0880bff4-aa14-4271-8502-cee2c20ac6b2"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:11.744497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d3ab44aa-c695-4b4b-a5df-98434dc4dc76 req-1703d53c-8f69-476c-b19c-ad35e2f5b5aa service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:11.746297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d3ab44aa-c695-4b4b-a5df-98434dc4dc76 req-1703d53c-8f69-476c-b19c-ad35e2f5b5aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:11.751088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d3ab44aa-c695-4b4b-a5df-98434dc4dc76 req-1703d53c-8f69-476c-b19c-ad35e2f5b5aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:11.751303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:11.775609 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d3ab44aa-c695-4b4b-a5df-98434dc4dc76 req-1703d53c-8f69-476c-b19c-ad35e2f5b5aa service nova] Creating event network-changed:0880bff4-aa14-4271-8502-cee2c20ac6b2 for instance 4dfb32e8-b182-4749-b047-9882e92d37bd on n-h2-854119-9 Aug 29 05:34:11.782989 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b31af42d-adc0-498c-bb1b-f0f8d716f114 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1314 microversion: 2.1 time: 0.365494 Aug 29 05:34:11.783710 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3487/6978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:11 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:11.786997 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d3ab44aa-c695-4b4b-a5df-98434dc4dc76 req-1703d53c-8f69-476c-b19c-ad35e2f5b5aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091653 Aug 29 05:34:11.790703 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3492/6979] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:34:11.791393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:11.796430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:11.805818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:11.806522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:11.807321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:11.808235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:11.809120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:11.809711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:11.894143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:11.908152 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bce71a82-74b1-4d4a-9496-c22b47cb4fb6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1300 microversion: 2.1 time: 0.122818 Aug 29 05:34:11.944890 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3488/6980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:11 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1300 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:12.709654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:12.710386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:12.729707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:12.729856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:12.730304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:12.731074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:12.731542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:12.732393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:12.812814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:12.814514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:12.838734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:12.839497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:12.840408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:12.841278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:12.841884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:12.842633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:13.161386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:13.176152 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-61edeb80-3bcf-45c1-9bea-28ac2f914f20 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1429 microversion: 2.1 time: 0.470598 Aug 29 05:34:13.190718 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3493/6981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:12 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1429 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:13.205125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:13.206208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:13.214793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:13.215638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:13.216344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:13.217315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:13.217993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:13.218599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:13.337899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:13.348299 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f265ee15-dff2-4875-82cc-a97b1401bf80 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1464 microversion: 2.1 time: 0.541206 Aug 29 05:34:13.357565 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3489/6982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:12 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1464 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:13.409325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:13.410752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:13.423596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:13.424746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:13.425395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:13.426337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:13.427492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:13.428094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:13.462211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:34:13.501357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:13.511409 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c0f254c2-55a9-43fe-be19-417b5b64a199 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.324061 Aug 29 05:34:13.514504 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3494/6983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:13 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:13.612109 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6845edd-017d-4409-b2b6-a887507afa90 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 204 len: 0 microversion: 2.1 time: 0.212259 Aug 29 05:34:13.612902 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3490/6984] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:34:13 2022] DELETE /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:34:13.622678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:13.628812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:13.637202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:13.637983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:13.638587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:13.639494 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:13.640113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:13.640721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:14.167402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:14.177215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-578a7c60-761b-4aae-b05b-c5b189f51b39 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1470 microversion: 2.1 time: 0.558277 Aug 29 05:34:14.177875 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3495/6985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:13 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1470 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:14.201585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:14.214393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:14.225940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:14.226776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:14.227227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:14.228073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:14.229492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:14.230095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:14.302906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-bafb9019-f7c0-4d6b-b44f-b24f109307ce req-0c576726-13a6-4184-98e2-e810965c6bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "868738b1-f70c-41fc-a2fb-48ad334c4b46", "tag": "e61d4c79-b0b4-4551-8a37-c23ebbb928a1"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:14.335649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bafb9019-f7c0-4d6b-b44f-b24f109307ce req-0c576726-13a6-4184-98e2-e810965c6bca service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:14.336592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bafb9019-f7c0-4d6b-b44f-b24f109307ce req-0c576726-13a6-4184-98e2-e810965c6bca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:14.337498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bafb9019-f7c0-4d6b-b44f-b24f109307ce req-0c576726-13a6-4184-98e2-e810965c6bca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:14.358610 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-bafb9019-f7c0-4d6b-b44f-b24f109307ce req-0c576726-13a6-4184-98e2-e810965c6bca service nova] Creating event network-changed:e61d4c79-b0b4-4551-8a37-c23ebbb928a1 for instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 on n-h1-854119-9 Aug 29 05:34:14.370838 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-bafb9019-f7c0-4d6b-b44f-b24f109307ce req-0c576726-13a6-4184-98e2-e810965c6bca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081906 Aug 29 05:34:14.372076 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3496/6986] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:34:14.443214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:14.455068 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e5d905cd-5e9d-495c-a9d9-6d71e1def994 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1429 microversion: 2.1 time: 0.257820 Aug 29 05:34:14.476677 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3491/6987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:14 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1429 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:14.536982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:14.537948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:14.564236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:14.589405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:14.593498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:14.595710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:14.604890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:14.607991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:14.620806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:15.039317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:15.047761 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc78cbb0-c65e-4fe4-a9e2-14ecb8176ec5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.515066 Aug 29 05:34:15.048399 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3497/6988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:14 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:15.202519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:15.203148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:15.211992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:15.217395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:15.219428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:15.220446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:15.223138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:15.223812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:15.482794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:15.483268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:15.494432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:15.494953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:15.495407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:15.496196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:15.504958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:15.505550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:15.846309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:15.856728 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b6423196-77a8-4136-9140-ba279a02031b tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1470 microversion: 2.1 time: 0.661188 Aug 29 05:34:15.857738 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3492/6989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:15 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1470 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:15.958051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:15.976317 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-250435bf-6f35-4ae7-90d6-f7107d479f56 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1429 microversion: 2.1 time: 0.499150 Aug 29 05:34:15.980630 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3498/6990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:15 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1429 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:16.070572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:16.071126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:16.078419 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:16.079023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:16.079691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:16.080496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:16.081236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:16.081875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:16.604467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:16.622527 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d6cd2a9c-0547-44af-a85a-bb98acd259f5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.554949 Aug 29 05:34:16.642359 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3493/6991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:16 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:16.704338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-066755dd-25a5-47f8-83d1-1ffd3f1e6e10 req-a5abcc07-aa13-4695-b966-41a8e1fadfff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fba0623-63fa-4588-9eb8-d964de92e695", "name": "network-vif-deleted", "tag": "0806de14-cdfd-4e1d-b099-7de63deba76c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:16.736587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-066755dd-25a5-47f8-83d1-1ffd3f1e6e10 req-a5abcc07-aa13-4695-b966-41a8e1fadfff service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:16.738052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-066755dd-25a5-47f8-83d1-1ffd3f1e6e10 req-a5abcc07-aa13-4695-b966-41a8e1fadfff service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:16.739086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-066755dd-25a5-47f8-83d1-1ffd3f1e6e10 req-a5abcc07-aa13-4695-b966-41a8e1fadfff service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:16.780182 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-066755dd-25a5-47f8-83d1-1ffd3f1e6e10 req-a5abcc07-aa13-4695-b966-41a8e1fadfff service nova] Creating event network-vif-deleted:0806de14-cdfd-4e1d-b099-7de63deba76c for instance 6fba0623-63fa-4588-9eb8-d964de92e695 on n-h1-854119-9 Aug 29 05:34:16.799115 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-066755dd-25a5-47f8-83d1-1ffd3f1e6e10 req-a5abcc07-aa13-4695-b966-41a8e1fadfff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128278 Aug 29 05:34:16.801667 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3499/6992] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:34:16.886193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:16.889745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:16.911848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:16.912966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:16.915813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:16.916590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:16.917053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:16.917562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:16.927336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:16.985650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:16.986137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:16.986581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:16.987139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lazy-loading 'fault' on Instance uuid 6fba0623-63fa-4588-9eb8-d964de92e695 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:34:17.000704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:17.001260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:17.012638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:17.013240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:17.013776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:17.014575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:17.015115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:17.015598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:17.034970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca38de9e0c4544d483f93a663a1f9298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3182f9aa35cd4a97aac8b0364b3c8dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:17.044850 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3d3369d2-4de9-4bbc-ae73-9f7b0ba0e8da tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 200 len: 1304 microversion: 2.1 time: 0.169125 Aug 29 05:34:17.045883 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3494/6993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:16 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:17.212095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:17.223267 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-492cb14a-65c1-4cdc-aef7-64a74d0fdd77 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1429 microversion: 2.1 time: 0.227447 Aug 29 05:34:17.226155 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3500/6994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:16 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1429 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:17.659085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:17.660352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:17.661934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:17.672497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:17.673278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:17.674020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:17.675649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:17.680357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-422c3950-8f52-4aad-a25c-80041711767f req-82f7a026-1ffd-4a54-bb8d-ec4d28d602b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfb32e8-b182-4749-b047-9882e92d37bd", "name": "network-vif-plugged", "status": "completed", "tag": "0880bff4-aa14-4271-8502-cee2c20ac6b2"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:17.687521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:17.688452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:17.694066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-422c3950-8f52-4aad-a25c-80041711767f req-82f7a026-1ffd-4a54-bb8d-ec4d28d602b0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:17.694720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-422c3950-8f52-4aad-a25c-80041711767f req-82f7a026-1ffd-4a54-bb8d-ec4d28d602b0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:17.695197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-422c3950-8f52-4aad-a25c-80041711767f req-82f7a026-1ffd-4a54-bb8d-ec4d28d602b0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:17.710365 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-422c3950-8f52-4aad-a25c-80041711767f req-82f7a026-1ffd-4a54-bb8d-ec4d28d602b0 service nova] Creating event network-vif-plugged:0880bff4-aa14-4271-8502-cee2c20ac6b2 for instance 4dfb32e8-b182-4749-b047-9882e92d37bd on n-h2-854119-9 Aug 29 05:34:17.721268 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-422c3950-8f52-4aad-a25c-80041711767f req-82f7a026-1ffd-4a54-bb8d-ec4d28d602b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044883 Aug 29 05:34:17.723028 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3501/6995] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:34:17.905586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:17.924406 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47b3c0e1-096c-45a7-9104-e6fb6da6293f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.269209 Aug 29 05:34:17.928176 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3495/6996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:17 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:18.074852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:18.076454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] [instance: 6fba0623-63fa-4588-9eb8-d964de92e695] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:18.100521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:18.100521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:18.100521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:18.100521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:18.100521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:18.100521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:18.124532 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] HTTP exception thrown: Instance 6fba0623-63fa-4588-9eb8-d964de92e695 could not be found. Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Request method failure captured: Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 HTTP/1.1 Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE--EsninCGo3gS1pRWM4ABtpcm6wdBx7rhou7y_8IDCshYgerJ7ICFuXsw8OOPOu84X78ILdiAc7V8wQjlBi9CwdFGnjEQ3oFWgnsWgrTJVUejMkrOU8qhonYkncUvvn1dAfNxjj5DslMFrcsSvqTULsw_-bc7rMRTveLvYmZzgnFc Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 3182f9aa35cd4a97aac8b0364b3c8dfc Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-VolumesNegativeTest-826796301 Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3182f9aa35cd4a97aac8b0364b3c8dfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3182f9aa35cd4a97aac8b0364b3c8dfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3182f9aa35cd4a97aac8b0364b3c8dfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3182f9aa35cd4a97aac8b0364b3c8dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-VolumesNegativeTest-826796301 Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 3182f9aa35cd4a97aac8b0364b3c8dfc Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-VolumesNegativeTest-826796301 Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-VolumesNegativeTest-826796301-project Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: ca38de9e0c4544d483f93a663a1f9298 Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-VolumesNegativeTest-826796301-project Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6fba0623-63fa-4588-9eb8-d964de92e695 could not be found. Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6fba0623-63fa-4588-9eb8-d964de92e695'} Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fba0623-63fa-4588-9eb8-d964de92e695 could not be found. Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fba0623-63fa-4588-9eb8-d964de92e695 could not be found. Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:34:18.127972 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:18.136431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:34:18.136431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:34:18.136431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:34:18.136431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:34:18.136431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:34:18.136431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fba0623-63fa-4588-9eb8-d964de92e695 could not be found. Aug 29 05:34:18.136431 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:18.136431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] Returning 404 to user: Instance 6fba0623-63fa-4588-9eb8-d964de92e695 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:34:18.139271 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a91f986e-09db-4e12-b606-c5f331824276 tempest-VolumesNegativeTest-826796301 tempest-VolumesNegativeTest-826796301-project] 10.222.0.20 "GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695" status: 404 len: 111 microversion: 2.1 time: 0.068630 Aug 29 05:34:18.140916 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3502/6997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:18 2022] GET /compute/v2.1/servers/6fba0623-63fa-4588-9eb8-d964de92e695 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:34:18.253938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:18.253938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:18.275278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:18.275787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:18.276339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:18.280456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:18.281388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:18.282472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:18.492160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:18.505455 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9d2b3292-0bad-4843-a32e-d612c329fbb1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1429 microversion: 2.1 time: 0.260306 Aug 29 05:34:18.506523 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3496/6998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:18 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1429 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:18.946848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:18.947478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:18.957247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:18.958031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:18.959531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:18.960452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:18.961075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:18.961714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:18.982716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:19.004343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:19.255533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:19.287816 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3c2aab72-1992-46c4-87b6-522a9f750b06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.343498 Aug 29 05:34:19.292204 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3503/6999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:18 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:19.530386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:19.531018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:19.535292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=24 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:19.540328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:19.541107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:19.542626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:19.543708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:19.544432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:19.545492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:19.750800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:19.761917 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a3c111e-c9d4-4c36-bc6b-956ad6c34676 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1608 microversion: 2.1 time: 0.236818 Aug 29 05:34:19.762609 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3497/7000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:19 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1608 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:34:19.787189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:19.788139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:19.795466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:19.796303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:19.797010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:19.797924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:19.798886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:19.799465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:19.985702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:19.994945 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-304731c4-c1c1-4852-aeb8-243d842a8160 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1608 microversion: 2.1 time: 0.212857 Aug 29 05:34:19.997284 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3504/7001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:19 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1608 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:20.036035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:20.038086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:20.049579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:20.051008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:20.051668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:20.052587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:20.053316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:20.054242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:20.326405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:20.327397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:20.340915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:20.341658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:20.343845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:20.344979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:20.348886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:20.358672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40bbed20-b29c-4784-a184-5f8e029dbb8f tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1608 microversion: 2.1 time: 0.338517 Aug 29 05:34:20.359886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:20.360657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:20.366492 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3498/7002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:20 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1608 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:20.660075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:20.692729 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ebef3294-e2af-4093-a165-46748fdcaa4c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.383970 Aug 29 05:34:20.694952 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3505/7003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:20 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:21.722578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:21.723990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:21.732345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:21.733239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:21.733989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:21.735278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:21.735993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:21.736633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:22.078445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:22.088748 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5fa46b4-2910-4148-b89c-a4bc4456bc48 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.370672 Aug 29 05:34:22.099360 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3499/7004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:21 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:23.118361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:23.120267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:23.141139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:23.141868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:23.142421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:23.144332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:23.145362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:23.147421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:23.494777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7d9210a6-8fdf-41d3-8813-4b254ea4a50e req-19906cc8-c998-428a-a925-9e54b0689717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfb32e8-b182-4749-b047-9882e92d37bd", "tag": "0880bff4-aa14-4271-8502-cee2c20ac6b2"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:23.499652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:23.509494 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-714e56d1-568b-457b-a6fe-2872c5f4f1b8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.397308 Aug 29 05:34:23.509916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7d9210a6-8fdf-41d3-8813-4b254ea4a50e req-19906cc8-c998-428a-a925-9e54b0689717 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:23.511354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7d9210a6-8fdf-41d3-8813-4b254ea4a50e req-19906cc8-c998-428a-a925-9e54b0689717 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:23.519600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7d9210a6-8fdf-41d3-8813-4b254ea4a50e req-19906cc8-c998-428a-a925-9e54b0689717 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:23.528166 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3506/7005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:23 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:23.537039 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7d9210a6-8fdf-41d3-8813-4b254ea4a50e req-19906cc8-c998-428a-a925-9e54b0689717 service nova] Creating event network-changed:0880bff4-aa14-4271-8502-cee2c20ac6b2 for instance 4dfb32e8-b182-4749-b047-9882e92d37bd on n-h2-854119-9 Aug 29 05:34:23.547772 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7d9210a6-8fdf-41d3-8813-4b254ea4a50e req-19906cc8-c998-428a-a925-9e54b0689717 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183232 Aug 29 05:34:23.550584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3500/7006] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:34:24.553598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:24.555645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:24.573033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:24.573556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:24.574015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:24.574787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:24.575273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:24.575716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:24.775335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:24.788732 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-84440ac9-f157-4772-8bcc-b6b57453dcdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.255992 Aug 29 05:34:24.789516 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3507/7007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:24 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:25.814273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:25.815115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:25.821753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:25.824829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:25.825440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:25.826053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:25.826897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:25.827760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:25.828217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:25.990700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:26.001100 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea9bea04-45d1-424e-a3d6-5def129a0ed3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.191668 Aug 29 05:34:26.013306 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3501/7008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:25 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:27.029144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:27.034779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:27.041656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:27.073291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:27.074622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:27.075635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:27.077442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:27.085546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:27.086715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:27.511711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:27.528403 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b734ab9c-a02d-4ccd-b633-b8c4eb20c0e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.506396 Aug 29 05:34:27.529793 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3508/7009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:27 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:28.571858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:28.572510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:28.580929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:28.581710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:28.582152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:28.582908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:28.583436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:28.583868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:28.735341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:28.743940 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d095a690-37ab-4e73-a377-5655773a7519 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.176620 Aug 29 05:34:28.745030 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3502/7010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:28 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:29.765213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:29.766537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:29.774339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:29.775194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:29.775888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:29.776910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:29.777595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:29.778232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:29.940790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:29.949761 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-73c345b4-07d9-4fdd-9ac7-aa9442cfbc90 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1342 microversion: 2.1 time: 0.188347 Aug 29 05:34:29.950367 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3509/7011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:29 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1342 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:30.972663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:30.973552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:30.984271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:30.985273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:30.985741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:30.986664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:30.987352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:30.987819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:31.170942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:31.180437 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eaa16a93-6d71-4718-848e-1749b0260f83 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1388 microversion: 2.1 time: 0.212737 Aug 29 05:34:31.181196 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3503/7012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:30 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1388 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:32.204535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:32.205086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:32.212589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:32.213127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:32.213570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:32.214292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:32.214751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:32.215178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:32.434567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:32.453004 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2f56fb0f-42da-4b2c-8a4e-f9bea52832e0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.252129 Aug 29 05:34:32.455439 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3510/7013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:32 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:33.487869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:33.488671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:33.496931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:33.497608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:33.498123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:33.499047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:33.499501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:33.499930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:33.640358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:33.651036 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4f31c707-72e8-456a-bb8f-48e2dd390774 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.167760 Aug 29 05:34:33.651721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3504/7014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:33 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:34.673628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:34.674221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:34.682267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:34.682776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:34.683222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:34.683945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:34.684451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:34.684886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:34.835116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:34.843631 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-43bbd7c3-5b25-4917-ba40-d2986ddaca9e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.173921 Aug 29 05:34:34.844782 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3511/7015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:34 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:35.864862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:35.865479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:35.872973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:35.873459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:35.873891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:35.874585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:35.875034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:35.875517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:36.006990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:36.015368 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed38ee36-2c1f-42b8-8471-f6fa841c7a28 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.154424 Aug 29 05:34:36.015981 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3505/7016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:35 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:37.037431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:37.038129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:37.045678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:37.046188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:37.046631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:37.047347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:37.047839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:37.048300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:37.182814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:37.190892 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-970a83fd-12e5-405d-afc4-e5190f6134ce tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.157553 Aug 29 05:34:37.191615 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3512/7017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:37 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:38.212340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:38.212953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:38.220486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:38.220975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:38.221413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:38.222114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:38.222568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:38.222993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:38.654712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:38.664403 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-086730b2-c35d-4994-9ff1-fd135207fd6b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.456070 Aug 29 05:34:38.664963 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3506/7018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:38 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:39.686063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:39.686667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:39.693803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:39.694738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:39.695181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:39.695909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:39.696435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:39.696867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:39.844516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:39.853500 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5c7222b5-636f-4b14-a1c3-5a96087ea14f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.171292 Aug 29 05:34:39.854173 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3513/7019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:39 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:40.875847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:40.876449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:40.883456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:40.883948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:40.884403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:40.885115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:40.885570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:40.885994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:41.030003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:41.038672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ca01e3c0-929e-4ba6-8437-efc19513519c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.166942 Aug 29 05:34:41.039279 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3507/7020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:40 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:41.791441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4b362d8a-ae84-400e-8a39-8a5deea4512c req-bb59df2a-8faf-49b3-aead-b3382180da73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868738b1-f70c-41fc-a2fb-48ad334c4b46", "name": "network-vif-plugged", "status": "completed", "tag": "e61d4c79-b0b4-4551-8a37-c23ebbb928a1"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:41.804146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4b362d8a-ae84-400e-8a39-8a5deea4512c req-bb59df2a-8faf-49b3-aead-b3382180da73 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:41.804772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4b362d8a-ae84-400e-8a39-8a5deea4512c req-bb59df2a-8faf-49b3-aead-b3382180da73 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:41.805369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4b362d8a-ae84-400e-8a39-8a5deea4512c req-bb59df2a-8faf-49b3-aead-b3382180da73 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:41.817606 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4b362d8a-ae84-400e-8a39-8a5deea4512c req-bb59df2a-8faf-49b3-aead-b3382180da73 service nova] Creating event network-vif-plugged:e61d4c79-b0b4-4551-8a37-c23ebbb928a1 for instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 on n-h1-854119-9 Aug 29 05:34:41.823803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4b362d8a-ae84-400e-8a39-8a5deea4512c req-bb59df2a-8faf-49b3-aead-b3382180da73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035999 Aug 29 05:34:41.824457 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3514/7021] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:34:42.060018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:42.060641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:42.067879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:42.068417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:42.068852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:42.070071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:42.070669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:42.071219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:42.225327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:42.234132 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07a5a0e2-03e3-4e5d-8de9-207afaba118e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.178196 Aug 29 05:34:42.234732 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3508/7022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:42 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:43.257978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:43.258925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:43.265862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:43.266554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:43.267097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:43.267932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:43.268518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:43.269042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:43.409624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:43.418335 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-606261ab-b648-46ac-a5b2-8dd0f1c88a5b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1376 microversion: 2.1 time: 0.165879 Aug 29 05:34:43.418934 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3515/7023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:43 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:44.441374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:44.442085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:44.451022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:44.451553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:44.452149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:44.453008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:44.453592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:44.454245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:44.686780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:44.698546 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-872a9f70-3bbd-4708-86ff-e0695f51bd6c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1562 microversion: 2.1 time: 0.262937 Aug 29 05:34:44.699670 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3509/7024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:44 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1562 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:44.719429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:44.720053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:44.727382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:44.727991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:44.728558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:44.729294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:44.729762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:44.730222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:44.734685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:44.953655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:44.962723 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b07556b0-c731-4b9e-a868-f227d38a875d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1562 microversion: 2.1 time: 0.247267 Aug 29 05:34:44.963336 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3516/7025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:44 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1562 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:45.062179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:45.062965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:45.073197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:45.073871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:45.074418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:45.075393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:45.075951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:45.076562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:45.110665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:34:45.126457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:45.222410 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5b3eaf83-6b99-47c1-a32d-32e9047ebf67 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 204 len: 0 microversion: 2.1 time: 0.165011 Aug 29 05:34:45.223271 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3510/7026] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:34:45 2022] DELETE /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:34:45.232610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:45.233263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:45.240603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:45.241397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:45.241714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:45.242456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:45.242933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:45.243690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:45.400549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:45.408852 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0b2f170a-2d66-4811-9566-bc5a3aa6fc24 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1568 microversion: 2.1 time: 0.180728 Aug 29 05:34:45.409455 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3517/7027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:45 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:46.432006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:46.432760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:46.440085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:46.440604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:46.441028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:46.441717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:46.442159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:46.442557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:46.613276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:46.623615 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8a293bc0-c65d-433c-a561-7161b5781dfd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1568 microversion: 2.1 time: 0.195945 Aug 29 05:34:46.624412 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3511/7028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:46 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:47.562845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-61db42d3-01a4-4131-ba2c-38683123c337 req-e74ca66a-cb60-4ca0-b7da-75fa51182954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868738b1-f70c-41fc-a2fb-48ad334c4b46", "name": "network-vif-deleted", "tag": "e61d4c79-b0b4-4551-8a37-c23ebbb928a1"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:34:47.580809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-61db42d3-01a4-4131-ba2c-38683123c337 req-e74ca66a-cb60-4ca0-b7da-75fa51182954 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:47.581313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-61db42d3-01a4-4131-ba2c-38683123c337 req-e74ca66a-cb60-4ca0-b7da-75fa51182954 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:47.581835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-61db42d3-01a4-4131-ba2c-38683123c337 req-e74ca66a-cb60-4ca0-b7da-75fa51182954 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:47.601147 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-61db42d3-01a4-4131-ba2c-38683123c337 req-e74ca66a-cb60-4ca0-b7da-75fa51182954 service nova] Creating event network-vif-deleted:e61d4c79-b0b4-4551-8a37-c23ebbb928a1 for instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 on n-h1-854119-9 Aug 29 05:34:47.607291 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-61db42d3-01a4-4131-ba2c-38683123c337 req-e74ca66a-cb60-4ca0-b7da-75fa51182954 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053102 Aug 29 05:34:47.608365 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3518/7029] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:34:47.645639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:47.646230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:47.654860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:47.655355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:47.655791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:47.657787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:47.659061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:47.659495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:47.757903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:47.765808 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef817e3e-4971-415d-81e4-d04c631ad6bc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1361 microversion: 2.1 time: 0.123972 Aug 29 05:34:47.766547 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3512/7030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:47 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1361 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:48.788726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:48.789464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:48.796576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:48.796962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:48.797482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:48.798202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:48.798670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:48.799103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:48.873034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:48.881428 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09f97037-8e6d-449b-a70d-d7ca621c6a3c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1361 microversion: 2.1 time: 0.098073 Aug 29 05:34:48.882396 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3519/7031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:48 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1361 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:49.903649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:49.904234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:49.912663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:49.913192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:49.913620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:49.914393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:49.914850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:49.915268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:49.985955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:49.994898 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5653082b-3ceb-4b53-acff-663ebe6bb4d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1361 microversion: 2.1 time: 0.095402 Aug 29 05:34:49.995495 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3513/7032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:49 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:51.017038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:51.017983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:51.025285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:51.025828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:51.026258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:51.026978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:51.027437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:51.027941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:51.101395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:51.111342 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-49c52c07-9e37-4de3-be47-79ea294b9f63 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1361 microversion: 2.1 time: 0.098126 Aug 29 05:34:51.112659 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3520/7033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:51 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1361 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:52.136784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:52.137719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:52.145285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:52.145769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:52.146196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:52.146887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:52.147376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:52.147779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:52.184144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:52.184630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:52.185048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:52.185494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lazy-loading 'fault' on Instance uuid 868738b1-f70c-41fc-a2fb-48ad334c4b46 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:34:52.237107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:52.248701 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-66fcf004-2fc4-4d2e-9c79-257b0a3c185d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 200 len: 1366 microversion: 2.1 time: 0.118690 Aug 29 05:34:52.249513 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3514/7034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:52 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:53.270709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:53.271326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:53.279330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:53.280175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:53.280817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:53.281747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:53.282266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:53.282725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:53.301378 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 HTTP/1.1 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '868738b1-f70c-41fc-a2fb-48ad334c4b46'} Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:34:53.303121 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc67dc5d-4457-4fd4-90f2-38ed47c9124d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 404 len: 111 microversion: 2.1 time: 0.038000 Aug 29 05:34:53.308513 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3521/7035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:53 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:34:57.647138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:57.647674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:57.650471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:57.658230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:57.658925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:57.659383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:57.660389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:57.660913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:57.661404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:57.689394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:34:57.782124 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb651086-f867-4bd5-98a5-6720b1e485c5 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 204 len: 0 microversion: 2.1 time: 0.139151 Aug 29 05:34:57.782728 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3515/7036] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:34:57 2022] DELETE /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:34:57.791973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:57.792757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:57.795771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=28 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:34:57.801796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:57.802307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:57.802755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:57.803474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:57.803942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:57.804413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:57.961017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:57.970304 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a937116f-d134-4db6-b687-564138582228 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1409 microversion: 2.1 time: 0.182211 Aug 29 05:34:57.971248 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3522/7037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:57 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1409 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:34:58.993718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:34:58.994437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:34:59.002721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:59.003211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:59.003646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:59.004371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:34:59.004821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:34:59.005232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:34:59.162792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:34:59.172996 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7d32fb59-2fd8-42c8-b8d0-380057f8443e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1409 microversion: 2.1 time: 0.183726 Aug 29 05:34:59.173596 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3516/7038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:34:58 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:00.031263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-aa792c5d-7238-4701-88b6-727333542bc1 req-cfdc2a0f-0b93-4e00-a18c-e05b05848e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008e8d89-5d72-42ed-92d7-31550d9bb38b", "name": "network-vif-deleted", "tag": "d3ad1264-d5f5-467f-b203-b294ecb1f088"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:35:00.045700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-aa792c5d-7238-4701-88b6-727333542bc1 req-cfdc2a0f-0b93-4e00-a18c-e05b05848e77 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:00.046216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-aa792c5d-7238-4701-88b6-727333542bc1 req-cfdc2a0f-0b93-4e00-a18c-e05b05848e77 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:00.046675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-aa792c5d-7238-4701-88b6-727333542bc1 req-cfdc2a0f-0b93-4e00-a18c-e05b05848e77 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:00.059719 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-aa792c5d-7238-4701-88b6-727333542bc1 req-cfdc2a0f-0b93-4e00-a18c-e05b05848e77 service nova] Creating event network-vif-deleted:d3ad1264-d5f5-467f-b203-b294ecb1f088 for instance 008e8d89-5d72-42ed-92d7-31550d9bb38b on n-h2-854119-9 Aug 29 05:35:00.065309 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-aa792c5d-7238-4701-88b6-727333542bc1 req-cfdc2a0f-0b93-4e00-a18c-e05b05848e77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037677 Aug 29 05:35:00.065931 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3523/7039] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:35:00.204750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:00.205520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:00.214216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:00.214942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:00.215446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:00.216312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:00.216838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:00.217328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:00.290242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:00.301203 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-675f596f-bd8c-45ac-8997-788aee370fbf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1201 microversion: 2.1 time: 0.100650 Aug 29 05:35:00.301807 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3517/7040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:00 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:35:01.324226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:01.325021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:01.332445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:01.333019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:01.333474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:01.334215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:01.334986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:01.335149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:01.401007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:01.409386 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-89313820-bb4b-4e65-9c7c-4bd0bdb26811 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1201 microversion: 2.1 time: 0.090866 Aug 29 05:35:01.409974 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3524/7041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:01 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:02.431500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:02.432272 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:02.439827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:02.440420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:02.440851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:02.441525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:02.441998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:02.442414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:02.516505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:02.525090 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa727d94-d9a0-4850-84f2-5e0b4b647bc9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1201 microversion: 2.1 time: 0.097631 Aug 29 05:35:02.525704 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3518/7042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:02 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:03.546420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:03.547045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:03.556239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:03.556752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:03.557202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:03.557974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:03.558440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:03.558880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:03.630365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:03.638810 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-08c05fe1-c03e-4efc-9d3c-ce1176e6c0db tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1201 microversion: 2.1 time: 0.096278 Aug 29 05:35:03.639353 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3525/7043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:03 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:04.659776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:04.660668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:04.667942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:04.668489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:04.668920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:04.669614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:04.670062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:04.670512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:05.003080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:05.003784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:05.004255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:05.004702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lazy-loading 'fault' on Instance uuid 008e8d89-5d72-42ed-92d7-31550d9bb38b {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:35:05.049385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:05.057521 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-91d6dcb1-bad5-407f-a701-e255c5d3ddf9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 200 len: 1160 microversion: 2.1 time: 0.402230 Aug 29 05:35:05.058428 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3519/7044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:04 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 1160 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:06.079451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:06.079990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:06.087479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:06.087966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:06.088554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:06.089272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:06.089737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:06.090172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:06.104057 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b HTTP/1.1 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '008e8d89-5d72-42ed-92d7-31550d9bb38b'} Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:06.105899 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ba9711cf-4136-4b8f-b54d-9a6bd46c98b3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 404 len: 111 microversion: 2.1 time: 0.032214 Aug 29 05:35:06.109153 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3526/7045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:06 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:35:07.207777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:07.208361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:07.215629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:07.216103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:07.216566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:07.217325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:07.217875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:07.218134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:07.232441 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 HTTP/1.1 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '868738b1-f70c-41fc-a2fb-48ad334c4b46'} Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:35:07.234192 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06c671e4-d524-4aaa-9e27-631a78a799da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 404 len: 111 microversion: 2.1 time: 0.031802 Aug 29 05:35:07.237824 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3520/7046] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:35:07 2022] DELETE /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:35:07.244823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:07.245452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 868738b1-f70c-41fc-a2fb-48ad334c4b46] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:07.252940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:07.253446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:07.253890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:07.255033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:07.255328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:07.255764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:07.270324 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 HTTP/1.1 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '868738b1-f70c-41fc-a2fb-48ad334c4b46'} Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:07.271938 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.274955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.274955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:07.274955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:07.274955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:35:07.274955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:35:07.274955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. Aug 29 05:35:07.274955 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.274955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 868738b1-f70c-41fc-a2fb-48ad334c4b46 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:35:07.274955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-faf0c495-f403-4f7c-a9fc-9f35b4130ff7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46" status: 404 len: 111 microversion: 2.1 time: 0.032653 Aug 29 05:35:07.275573 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3527/7047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:07 2022] GET /compute/v2.1/servers/868738b1-f70c-41fc-a2fb-48ad334c4b46 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:35:07.806356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:07.806864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:07.813721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:07.814227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:07.814664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:07.815357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:07.815815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:07.816349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:07.831742 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b HTTP/1.1 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '008e8d89-5d72-42ed-92d7-31550d9bb38b'} Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:35:07.833564 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-647a815f-d68a-4c30-92d2-1e6b6ebfd67b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 404 len: 111 microversion: 2.1 time: 0.032879 Aug 29 05:35:07.840526 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3521/7048] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:35:07 2022] DELETE /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:35:07.846548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:07.847177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 008e8d89-5d72-42ed-92d7-31550d9bb38b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:07.853672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:07.854264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:07.854780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:07.855583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:07.856143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:07.856693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:07.871939 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b HTTP/1.1 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '008e8d89-5d72-42ed-92d7-31550d9bb38b'} Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:35:07.873613 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.877573 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:35:07.877573 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:35:07.877573 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:35:07.877573 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:35:07.877573 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:35:07.877573 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. Aug 29 05:35:07.877573 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:35:07.877573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 008e8d89-5d72-42ed-92d7-31550d9bb38b could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:35:07.877573 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c7e0fca4-7629-49c7-9a12-f4a916557d9b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b" status: 404 len: 111 microversion: 2.1 time: 0.032458 Aug 29 05:35:07.878852 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3528/7049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:07 2022] GET /compute/v2.1/servers/008e8d89-5d72-42ed-92d7-31550d9bb38b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:35:07.958032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e2e881b-5f72-486a-b2a4-21c88d69c439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'create', calling method: .version_select at 0x7f1ab3f730d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1888824102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC1ia16MDAxmXd/xXYQKP7wZY2XOYesjjWjZ9ciHX5KNVunbZyRZ4Fqpt95A1FNeGNJkVBnhk2361dRSWjCIRpK+6tpGos12fFVt0saAYsOG/llxdCrd3E4HBCmUOut8A=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:35:07.974683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7e2e881b-5f72-486a-b2a4-21c88d69c439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for project fd65b810665c460a8c767d83ec33b490. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:35:07.980110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7e2e881b-5f72-486a-b2a4-21c88d69c439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for user 83565ba99afd41f4b0d5de74365c3b2f and project fd65b810665c460a8c767d83ec33b490. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:35:08.008542 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e2e881b-5f72-486a-b2a4-21c88d69c439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.054482 Aug 29 05:35:08.009209 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3522/7050] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:35:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:35:25.487533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-589075904", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1888824102", "security_groups": [{"name": "tempest-secgroup-smoke-1218546524"}], "block_device_mapping_v2": [{"uuid": "e40ae88e-3f2c-4b58-beb7-f3b06cb3f5ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77c879e8-8923-4ae0-9869-fe659563295c"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:35:25.498586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=13 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:35:25.499228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=53 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:35:25.500334 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:35:25.500582 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:35:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Aug 29 05:35:25.807222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] validate_networks() for [('77c879e8-8923-4ae0-9869-fe659563295c', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:35:26.373284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:35:26.373731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:35:26.374253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:35:26.374678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:35:26.375101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:35:26.384713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:26.385219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:26.385666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:26.386421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:26.386891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:26.387330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:26.405936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:35:26.411753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for user 83565ba99afd41f4b0d5de74365c3b2f and project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:35:26.475418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:35:26.477737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e40ae88e-3f2c-4b58-beb7-f3b06cb3f5ec',volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:35:26.612844 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-743e006d-c300-4f66-853c-8982f41fa40d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.129510 Aug 29 05:35:26.613845 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3529/7051] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:35:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:35:26.623140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:35:26.623903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:35:26.624642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:35:26.630553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-03e8de4a-4703-4542-81b3-85fa8e91d9f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:26.631186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-03e8de4a-4703-4542-81b3-85fa8e91d9f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:26.761484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-03e8de4a-4703-4542-81b3-85fa8e91d9f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:26.768492 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-03e8de4a-4703-4542-81b3-85fa8e91d9f4 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1094 microversion: 2.1 time: 0.147306 Aug 29 05:35:26.769017 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3523/7052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:26 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1094 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:27.789628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:27.790271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:27.797254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:27.797785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:27.798178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:27.798930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:27.799363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:27.799799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:27.874121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:27.884165 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a1e4c11-9f9c-4273-9254-9dcbc000f0c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1210 microversion: 2.1 time: 0.099629 Aug 29 05:35:27.884763 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3530/7053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:27 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:28.910671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:28.912525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:28.926336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:28.927124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:28.927567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:28.928323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:28.928783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:28.929205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:29.304722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:29.313151 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-807bf5d7-811c-4482-9b2f-61086e9f2cb8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1278 microversion: 2.1 time: 0.409959 Aug 29 05:35:29.313950 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3524/7054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:28 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:35:29.422962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f62a0897-fb1c-4353-bfcb-cc5064696f6f req-ce7059da-524e-4617-b9f0-005b8b75fa84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f9d8db-5116-43c9-b575-dab05b4a8df2", "tag": "f85a887c-d982-4ee2-8aa7-3e4be518274d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:35:29.441391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f62a0897-fb1c-4353-bfcb-cc5064696f6f req-ce7059da-524e-4617-b9f0-005b8b75fa84 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:29.442399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f62a0897-fb1c-4353-bfcb-cc5064696f6f req-ce7059da-524e-4617-b9f0-005b8b75fa84 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:29.443041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f62a0897-fb1c-4353-bfcb-cc5064696f6f req-ce7059da-524e-4617-b9f0-005b8b75fa84 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:29.457539 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f62a0897-fb1c-4353-bfcb-cc5064696f6f req-ce7059da-524e-4617-b9f0-005b8b75fa84 service nova] Creating event network-changed:f85a887c-d982-4ee2-8aa7-3e4be518274d for instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 on n-h1-854119-9 Aug 29 05:35:29.463412 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f62a0897-fb1c-4353-bfcb-cc5064696f6f req-ce7059da-524e-4617-b9f0-005b8b75fa84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048486 Aug 29 05:35:29.464160 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3531/7055] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:35:30.335632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:30.336442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:30.344550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:30.345050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:30.345487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:30.346206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:30.346665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:30.347096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:30.592783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:30.601249 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fca4adee-c7f0-4154-a762-e56c25c7fd54 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1278 microversion: 2.1 time: 0.269856 Aug 29 05:35:30.601851 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3525/7056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:30 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1278 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:31.624367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:31.625140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:31.632031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:31.632984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:31.633140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:31.633984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:31.634333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:31.634768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:31.799742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:31.808394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0ae19b65-e3f8-41e2-b48f-8f09e8532467 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1278 microversion: 2.1 time: 0.189167 Aug 29 05:35:31.808982 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3532/7057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:31 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:32.830046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:32.830748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:32.838524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:32.839035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:32.839477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:32.840290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:32.840753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:32.841188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:33.001473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:33.009574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3144cc13-1a99-4538-a2c5-353058136a07 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1278 microversion: 2.1 time: 0.183742 Aug 29 05:35:33.010214 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3526/7058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:32 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:34.031451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:34.032063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:34.039709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:34.040235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:34.040684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:34.041402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:34.041863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:34.042293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:34.217631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:34.225758 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-40dcbebb-35fa-41c9-9589-e634df679576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.198331 Aug 29 05:35:34.226354 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3533/7059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:34 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:35.247473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:35.248068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:35.255551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:35.256048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:35.256510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:35.257219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:35.257673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:35.258098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:35.398602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:35.406941 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-239407ae-2c16-4d65-969c-01bf14b5eb01 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.163381 Aug 29 05:35:35.407519 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3527/7060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:35 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:36.427736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:36.428296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:36.431199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:35:36.431889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:35:36.438933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:36.439439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:36.439895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:36.440675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:36.441150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:36.441585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:36.578069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:36.586855 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c3c46fed-3e27-4f5a-b0c9-a7e66a80caf3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.163172 Aug 29 05:35:36.587480 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3534/7061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:36 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:37.609227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:37.610043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:37.612680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:35:37.618494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:37.618933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:37.619398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:37.620092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:37.620609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:37.621027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:37.771980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:37.780176 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a8b3f8ac-0ecb-4496-a1a6-a9d104741dcd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.175149 Aug 29 05:35:37.780780 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3528/7062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:37 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:38.800804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:38.801394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:38.809292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:38.809709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:38.810153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:38.810867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:38.811323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:38.811754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:38.967045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:38.975410 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-161a3c49-c70d-4790-960d-34dbfe8be439 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.178567 Aug 29 05:35:38.976014 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3535/7063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:38 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:39.998191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:39.998953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:40.006293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:40.006845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:40.007329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:40.008041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:40.008529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:40.008952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:40.156325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:40.165285 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-31a0456b-1152-46ee-aee9-b03aa9862bb9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.171537 Aug 29 05:35:40.166021 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3529/7064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:39 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:40.457565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2053c816-2745-42c8-9f54-2bd2be3845d1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:40.458165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2053c816-2745-42c8-9f54-2bd2be3845d1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:40.465471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2053c816-2745-42c8-9f54-2bd2be3845d1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:40.465967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2053c816-2745-42c8-9f54-2bd2be3845d1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:40.466409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2053c816-2745-42c8-9f54-2bd2be3845d1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:40.467120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2053c816-2745-42c8-9f54-2bd2be3845d1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:40.467577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2053c816-2745-42c8-9f54-2bd2be3845d1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:40.468007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2053c816-2745-42c8-9f54-2bd2be3845d1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:40.494364 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2053c816-2745-42c8-9f54-2bd2be3845d1 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.041056 Aug 29 05:35:40.494963 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3536/7065] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Aug 29 05:35:40 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd/os-server-password => generated 116 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:35:41.186811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:41.187489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:41.195303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:41.195796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:41.196263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:41.196995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:41.197457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:41.197884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:41.334215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:41.342016 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8756dabc-4df3-4fb3-836c-5e7d853c7ef3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.159151 Aug 29 05:35:41.342894 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3530/7066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:41 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:42.366991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:42.367967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:42.381056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:42.381877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:42.382654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:42.383499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:42.384159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:42.385145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:42.817035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:42.825473 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-87e802e6-ac3c-4f0f-9db1-1d8069de3137 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.465926 Aug 29 05:35:42.826051 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3537/7067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:42 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:43.846004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:43.846716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:43.854195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:43.854828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:43.855366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:43.856201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:43.856984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:43.857626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:44.015599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:44.025391 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4c2f2ceb-bc00-4153-821e-0679a89057f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.183464 Aug 29 05:35:44.026103 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3531/7068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:43 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:44.055190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c397226d-7110-40a9-b6a3-bff61433fdcb req-c82dd773-03b7-4215-b42e-ac7f41d2ecaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f9d8db-5116-43c9-b575-dab05b4a8df2", "name": "network-vif-plugged", "status": "completed", "tag": "f85a887c-d982-4ee2-8aa7-3e4be518274d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:35:44.065550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c397226d-7110-40a9-b6a3-bff61433fdcb req-c82dd773-03b7-4215-b42e-ac7f41d2ecaa service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:44.066038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c397226d-7110-40a9-b6a3-bff61433fdcb req-c82dd773-03b7-4215-b42e-ac7f41d2ecaa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:44.066471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c397226d-7110-40a9-b6a3-bff61433fdcb req-c82dd773-03b7-4215-b42e-ac7f41d2ecaa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:44.078959 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c397226d-7110-40a9-b6a3-bff61433fdcb req-c82dd773-03b7-4215-b42e-ac7f41d2ecaa service nova] Creating event network-vif-plugged:f85a887c-d982-4ee2-8aa7-3e4be518274d for instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 on n-h1-854119-9 Aug 29 05:35:44.084491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c397226d-7110-40a9-b6a3-bff61433fdcb req-c82dd773-03b7-4215-b42e-ac7f41d2ecaa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039546 Aug 29 05:35:44.085115 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3538/7069] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:35:45.047249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:45.047863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:45.055901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:45.056436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:45.056891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:45.057587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:45.058046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:45.058502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:45.199074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:45.207626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f3d6854c-811a-4fd8-b0bd-e73867fbc13b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1266 microversion: 2.1 time: 0.164370 Aug 29 05:35:45.208233 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3532/7070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:45 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:46.230415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:46.231125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:46.238096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:46.238602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:46.239048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:46.239772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:46.240268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:46.240864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:46.399114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:46.409615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a281c5f7-639c-4723-89f5-7caf5da022bd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1452 microversion: 2.1 time: 0.184452 Aug 29 05:35:46.410268 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3539/7071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:46 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:46.430817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:35:46.431416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:35:46.439728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:46.440268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:46.440750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:46.441473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:46.441921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:46.442342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:46.587858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:35:46.596795 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7eee8d72-10bd-4071-80ed-5f1dac736734 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1452 microversion: 2.1 time: 0.170197 Aug 29 05:35:46.597379 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3533/7072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:35:46 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:35:48.515352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-43acf3ae-465c-4d8e-9282-151db5d84216 req-db1ce560-2709-4d30-8775-c9620a8cfca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f9d8db-5116-43c9-b575-dab05b4a8df2", "tag": "f85a887c-d982-4ee2-8aa7-3e4be518274d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:35:48.526618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-43acf3ae-465c-4d8e-9282-151db5d84216 req-db1ce560-2709-4d30-8775-c9620a8cfca9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:35:48.527128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-43acf3ae-465c-4d8e-9282-151db5d84216 req-db1ce560-2709-4d30-8775-c9620a8cfca9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:35:48.527577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-43acf3ae-465c-4d8e-9282-151db5d84216 req-db1ce560-2709-4d30-8775-c9620a8cfca9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:35:48.541257 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-43acf3ae-465c-4d8e-9282-151db5d84216 req-db1ce560-2709-4d30-8775-c9620a8cfca9 service nova] Creating event network-changed:f85a887c-d982-4ee2-8aa7-3e4be518274d for instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 on n-h1-854119-9 Aug 29 05:35:48.546704 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-43acf3ae-465c-4d8e-9282-151db5d84216 req-db1ce560-2709-4d30-8775-c9620a8cfca9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035157 Aug 29 05:35:48.547448 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3540/7073] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:37:45.864697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=24 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:37:45.865444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=60 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:37:45.866262 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:37:45.866385 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 (ip 10.222.0.20) !!! Aug 29 05:37:45.867510 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:37:45.867663 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 (ip 10.222.0.20) !!! Aug 29 05:37:45.872683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:45.873181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:45.882106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:45.882611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:45.883042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:45.883742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:45.884212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:45.884636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:45.912164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:37:46.019714 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e56ebcc0-a2b6-4126-bad7-4937d94a668d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 204 len: 0 microversion: 2.1 time: 0.156954 Aug 29 05:37:46.020394 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3534/7074] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:37:45 2022] DELETE /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:37:46.028338 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 05:37:46.029051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:37:46.029876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=54 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:37:46.031678 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 05:37:46.031881 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:37:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 (ip 10.222.0.20) !!! Aug 29 05:37:46.037954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:46.038700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:46.047997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:46.048529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:46.048977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:46.049694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:46.050157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:46.050596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:46.188819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:46.197655 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-acf79b8c-dd45-49b5-a919-a7444e6a51b1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1576 microversion: 2.1 time: 0.172346 Aug 29 05:37:46.198226 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3541/7075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:46 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:37:47.220055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:47.220821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:47.228481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:47.228973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:47.229407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:47.230113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:47.230564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:47.230991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:47.379196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:47.387393 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bded1c03-833e-48e3-8a91-4f40e355a8da tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1576 microversion: 2.1 time: 0.171712 Aug 29 05:37:47.388014 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3535/7076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:47 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:37:48.409205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:48.409822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:48.419717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:48.420334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:48.420703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:48.421423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:48.421883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:48.422311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:48.430566 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44784. Aug 29 05:37:48.647444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:48.656535 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e1f772c2-0bd2-43d8-987e-8419a5ab054c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1576 microversion: 2.1 time: 0.251561 Aug 29 05:37:48.657119 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3542/7077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:48 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1576 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:37:49.357999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3d273f07-053f-4c08-ac09-0ace41225228 req-7f595934-2458-4e3a-ad13-9957992b4064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f9d8db-5116-43c9-b575-dab05b4a8df2", "name": "network-vif-deleted", "tag": "f85a887c-d982-4ee2-8aa7-3e4be518274d"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:37:49.372026 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3d273f07-053f-4c08-ac09-0ace41225228 req-7f595934-2458-4e3a-ad13-9957992b4064 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:49.372522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3d273f07-053f-4c08-ac09-0ace41225228 req-7f595934-2458-4e3a-ad13-9957992b4064 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:49.372978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3d273f07-053f-4c08-ac09-0ace41225228 req-7f595934-2458-4e3a-ad13-9957992b4064 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:49.386595 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3d273f07-053f-4c08-ac09-0ace41225228 req-7f595934-2458-4e3a-ad13-9957992b4064 service nova] Creating event network-vif-deleted:f85a887c-d982-4ee2-8aa7-3e4be518274d for instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 on n-h1-854119-9 Aug 29 05:37:49.393639 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3d273f07-053f-4c08-ac09-0ace41225228 req-7f595934-2458-4e3a-ad13-9957992b4064 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039619 Aug 29 05:37:49.394565 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3536/7078] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:37:49.678824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:49.679598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:49.687306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:49.688026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:49.688499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:49.689216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:49.689702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:49.690131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:49.755904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:49.764802 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b5765825-63fc-4e45-beab-5a9c1f6bdf06 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1225 microversion: 2.1 time: 0.089959 Aug 29 05:37:49.765394 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3543/7079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:49 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:37:50.787487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:50.788079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:50.795007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:50.795498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:50.795935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:50.796678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:50.797135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:50.797563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:50.862673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:50.870955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c2044a03-242b-4578-95c4-fde03aa6964d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1225 microversion: 2.1 time: 0.088736 Aug 29 05:37:50.871559 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3537/7080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:50 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:37:51.891821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:51.892701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:51.900609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:51.901213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:51.901750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:51.902592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:51.903132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:51.903638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:51.971627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:51.979840 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16f7a35f-2ce9-4d82-bc7e-06df2f9cf113 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1225 microversion: 2.1 time: 0.092513 Aug 29 05:37:51.980507 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3544/7081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:51 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:37:53.001380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:53.001944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:53.009293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:53.009780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:53.010206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:53.010897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:53.011359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:53.011772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:53.074883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:53.083953 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4641becf-4869-4963-8fe3-e81a7ae2f3ee tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 200 len: 1225 microversion: 2.1 time: 0.086770 Aug 29 05:37:53.096141 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3538/7082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:52 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:37:54.106456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:54.107050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:54.114542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:54.115037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:54.115521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:54.116314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:54.116776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:54.117207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:54.131641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 HTTP/1.1 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '70f9d8db-5116-43c9-b575-dab05b4a8df2'} Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:37:54.133377 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-81ae6046-3e89-42f3-b8b0-a7601c930065 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 404 len: 111 microversion: 2.1 time: 0.032332 Aug 29 05:37:54.136959 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3545/7083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:54 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:37:54.184896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1677051217", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1888824102", "security_groups": [{"name": "tempest-secgroup-smoke-1218546524"}], "block_device_mapping_v2": [{"uuid": "e40ae88e-3f2c-4b58-beb7-f3b06cb3f5ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77c879e8-8923-4ae0-9869-fe659563295c"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:37:54.303109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] validate_networks() for [('77c879e8-8923-4ae0-9869-fe659563295c', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:37:54.736445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:37:54.736875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:37:54.737342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:37:54.737754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:37:54.738162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:37:54.747271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:54.747774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:54.748231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:54.749018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:54.749464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:54.749883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:54.767190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:37:54.772533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for user 83565ba99afd41f4b0d5de74365c3b2f and project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:37:54.835284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:37:54.837610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e40ae88e-3f2c-4b58-beb7-f3b06cb3f5ec',volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:37:54.979732 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0a46710-6e44-49b6-a609-e9b793017b20 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798731 Aug 29 05:37:54.980413 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3539/7084] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:37:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:37:54.991879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4885b261-f3c7-4d30-9c2e-1a3cbdbda756 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:54.992567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4885b261-f3c7-4d30-9c2e-1a3cbdbda756 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:55.056730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4885b261-f3c7-4d30-9c2e-1a3cbdbda756 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:55.064006 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4885b261-f3c7-4d30-9c2e-1a3cbdbda756 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1095 microversion: 2.1 time: 0.076255 Aug 29 05:37:55.064696 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3546/7085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:54 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:37:56.086681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:56.087533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:56.095345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:56.096403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:56.096821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:56.097773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:56.098287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:56.098927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:56.191070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:56.199932 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-497f5d31-de96-4453-a1f3-6b9efe3339c6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1201 microversion: 2.1 time: 0.119525 Aug 29 05:37:56.200878 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3540/7086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:56 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1201 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:37:57.221504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:57.222091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:57.230309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:57.231058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:57.231707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:57.232462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:57.233027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:57.233471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:57.472996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:57.482508 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cb55450f-36c3-44a5-a959-31cccd4580a7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1279 microversion: 2.1 time: 0.264873 Aug 29 05:37:57.483084 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3547/7087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:57 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:37:57.759810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-21379052-18fa-4a63-99ea-de9e9cd06387 req-863b988b-6f34-4f9f-8a33-ef8ab9ef72e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435c4c0e-15e9-4708-a8c5-408010e6647e", "tag": "fa08dbe6-07a3-458e-abb5-663319065b84"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:37:57.778043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-21379052-18fa-4a63-99ea-de9e9cd06387 req-863b988b-6f34-4f9f-8a33-ef8ab9ef72e1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:57.779101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-21379052-18fa-4a63-99ea-de9e9cd06387 req-863b988b-6f34-4f9f-8a33-ef8ab9ef72e1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:57.779876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-21379052-18fa-4a63-99ea-de9e9cd06387 req-863b988b-6f34-4f9f-8a33-ef8ab9ef72e1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:57.796586 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-21379052-18fa-4a63-99ea-de9e9cd06387 req-863b988b-6f34-4f9f-8a33-ef8ab9ef72e1 service nova] Creating event network-changed:fa08dbe6-07a3-458e-abb5-663319065b84 for instance 435c4c0e-15e9-4708-a8c5-408010e6647e on n-h1-854119-9 Aug 29 05:37:57.805924 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-21379052-18fa-4a63-99ea-de9e9cd06387 req-863b988b-6f34-4f9f-8a33-ef8ab9ef72e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050143 Aug 29 05:37:57.807314 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3541/7088] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:37:58.508339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:58.511541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:58.521202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:58.522098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:58.522641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:58.523609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:58.524389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:58.525079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:58.778019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:58.786521 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1d163cfe-db57-4f94-8a68-05e4f7008cdc tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1279 microversion: 2.1 time: 0.284921 Aug 29 05:37:58.787787 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3548/7089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:58 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1279 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:37:59.808995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:37:59.809646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:37:59.816352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:59.816945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:59.817379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:59.818086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:37:59.818534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:37:59.818960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:37:59.978131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:37:59.987057 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c56a9c7f-a571-4681-ac61-9eacc3790c13 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1279 microversion: 2.1 time: 0.183385 Aug 29 05:37:59.987657 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3542/7090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:37:59 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:01.009512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:01.010154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:01.017834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:01.018345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:01.018798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:01.019638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:01.020018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:01.020499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:01.173483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:01.187588 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa577fdd-47d9-4e92-878d-e218a9720c5a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1279 microversion: 2.1 time: 0.181769 Aug 29 05:38:01.188560 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3549/7091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:01 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:38:02.209601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:02.210221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:02.218008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:02.218484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:02.219071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:02.220065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:02.220658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:02.221189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:02.367139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:02.375859 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0dac2ca-89d3-4a5a-bc54-8a3c0cee0f75 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.170140 Aug 29 05:38:02.376484 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3543/7092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:02 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:03.398516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:03.399172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:03.406936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:03.407447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:03.407897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:03.408667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:03.409214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:03.409655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:03.562707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:03.570802 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b646c054-245d-4a81-8e8e-052fde6e71d3 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.176245 Aug 29 05:38:03.571686 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3550/7093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:03 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:04.594666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:04.595293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:04.603655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:04.604269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:04.604972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:04.606286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:04.607156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:04.607926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:04.756960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:04.760549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:38:04.768769 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-44391113-98b5-400b-8cdb-0c2d87fae513 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.178065 Aug 29 05:38:04.769369 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3544/7094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:04 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:05.799948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:05.800560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:05.803359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:38:05.810761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:05.811411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:05.811945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:05.812714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:05.813187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:05.813619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:05.957509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:05.964543 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c8f4ad52-462b-430f-8e31-f340ddb246ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.168507 Aug 29 05:38:05.965106 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3551/7095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:05 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:06.986971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:06.987591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:06.989786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:38:06.996507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:06.997088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:06.997564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:06.998284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:06.998740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:06.999168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:07.142202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:07.150612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37624b2f-0184-4e23-8acc-b447b8d5eade tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.169162 Aug 29 05:38:07.151541 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3545/7096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:06 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:08.172486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:08.173119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:08.180197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:08.180698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:08.181136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:08.181845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:08.182307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:08.182735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:08.331706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:08.344470 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd9c46f2-3f46-4dd0-8ef2-24ca76a64611 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.175785 Aug 29 05:38:08.345213 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3552/7097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:08 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:09.370942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:09.371519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:09.378995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:09.379463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:09.379892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:09.380632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:09.381083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:09.381583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:09.537806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:09.546344 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4ee491f7-71c6-453f-9936-da8414e5b1ca tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.179343 Aug 29 05:38:09.547071 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3546/7098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:09 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:10.567225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:10.567832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:10.575872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:10.576519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:10.576973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:10.577710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:10.578179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:10.578622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:10.727698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:10.735955 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e9ca29a6-88a8-49bb-aff9-f6743816f418 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.172682 Aug 29 05:38:10.736567 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3553/7099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:10 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:11.763164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:11.763745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:11.771100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:11.771590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:11.772032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:11.772761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:11.773218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:11.773639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:11.913674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:11.927253 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab3febf3-aada-4125-8256-a225a81bf880 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.167741 Aug 29 05:38:11.928270 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3547/7100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:11 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:12.682253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6231ae83-293d-4128-a0c0-5b4c739dc6b6 req-fb3e523b-4339-4f99-9373-bad8289ccc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435c4c0e-15e9-4708-a8c5-408010e6647e", "name": "network-vif-plugged", "status": "completed", "tag": "fa08dbe6-07a3-458e-abb5-663319065b84"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:38:12.691866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6231ae83-293d-4128-a0c0-5b4c739dc6b6 req-fb3e523b-4339-4f99-9373-bad8289ccc8a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:12.692394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6231ae83-293d-4128-a0c0-5b4c739dc6b6 req-fb3e523b-4339-4f99-9373-bad8289ccc8a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:12.692838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6231ae83-293d-4128-a0c0-5b4c739dc6b6 req-fb3e523b-4339-4f99-9373-bad8289ccc8a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:12.705069 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6231ae83-293d-4128-a0c0-5b4c739dc6b6 req-fb3e523b-4339-4f99-9373-bad8289ccc8a service nova] Creating event network-vif-plugged:fa08dbe6-07a3-458e-abb5-663319065b84 for instance 435c4c0e-15e9-4708-a8c5-408010e6647e on n-h1-854119-9 Aug 29 05:38:12.710138 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6231ae83-293d-4128-a0c0-5b4c739dc6b6 req-fb3e523b-4339-4f99-9373-bad8289ccc8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106571 Aug 29 05:38:12.710739 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3554/7101] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:38:12.949127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:12.949696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:12.957801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:12.958372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:12.959124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:12.959925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:12.960454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:12.960876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:13.107739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:13.117423 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-29a90408-8b68-4f29-838f-61be90960d0d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.172529 Aug 29 05:38:13.118037 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3548/7102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:12 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:14.140110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:14.140867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:14.147526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:14.148059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:14.148612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:14.149256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:14.149725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:14.150159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:14.284109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:14.292015 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6044ae92-c94d-4b45-b66f-d123b524ee7b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1267 microversion: 2.1 time: 0.157037 Aug 29 05:38:14.292627 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3555/7103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:14 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:15.313054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:15.313660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:15.321102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:15.321927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:15.322400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:15.323106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:15.323564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:15.323975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:15.459372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:15.467716 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-66e4f2a5-ec39-491c-894b-641911e24aaf tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1454 microversion: 2.1 time: 0.158804 Aug 29 05:38:15.468399 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3549/7104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:15 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:15.487935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:38:15.488560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:38:15.495757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:15.496295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:15.496750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:15.497475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:15.497944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:15.498429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:15.634993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:38:15.643218 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68059193-7437-4083-93ef-ec62bb7d2d65 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1454 microversion: 2.1 time: 0.159238 Aug 29 05:38:15.643792 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3556/7105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:38:15 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:38:17.374551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c38ccedf-4e55-4baa-a55c-567cc0b19014 req-b1708184-8a5c-4f51-b06c-b5f302bb4e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435c4c0e-15e9-4708-a8c5-408010e6647e", "tag": "fa08dbe6-07a3-458e-abb5-663319065b84"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:38:17.380485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:38:17.387188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c38ccedf-4e55-4baa-a55c-567cc0b19014 req-b1708184-8a5c-4f51-b06c-b5f302bb4e46 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:38:17.387903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c38ccedf-4e55-4baa-a55c-567cc0b19014 req-b1708184-8a5c-4f51-b06c-b5f302bb4e46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:38:17.388367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c38ccedf-4e55-4baa-a55c-567cc0b19014 req-b1708184-8a5c-4f51-b06c-b5f302bb4e46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:38:17.392860 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:38:17.401741 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c38ccedf-4e55-4baa-a55c-567cc0b19014 req-b1708184-8a5c-4f51-b06c-b5f302bb4e46 service nova] Creating event network-changed:fa08dbe6-07a3-458e-abb5-663319065b84 for instance 435c4c0e-15e9-4708-a8c5-408010e6647e on n-h1-854119-9 Aug 29 05:38:17.407179 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c38ccedf-4e55-4baa-a55c-567cc0b19014 req-b1708184-8a5c-4f51-b06c-b5f302bb4e46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036401 Aug 29 05:38:17.408179 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3550/7106] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:39:44.000223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=34 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:39:44.000976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=82 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:39:44.001834 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:39:44.002243 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd (ip 10.222.0.20) !!! Aug 29 05:39:44.134521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:39:44.135246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:39:44.144687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:44.145368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:44.146052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:44.147132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:44.147784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:44.148452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:44.178557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:39:44.268728 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d3ef7d82-da26-4a51-9f1f-375959d9d3ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 204 len: 0 microversion: 2.1 time: 0.270336 Aug 29 05:39:44.272581 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3557/7107] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:39:43 2022] DELETE /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:39:44.282906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:39:44.283618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:39:44.290798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:44.291294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:44.291733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:44.292474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:44.292931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:44.293361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:44.439638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:39:44.449139 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a46bea7-2f4c-4061-878e-8b0224294886 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1733 microversion: 2.1 time: 0.175084 Aug 29 05:39:44.449877 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3551/7108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:39:44 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:39:45.471407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:39:45.472155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:39:45.479822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:45.481791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:45.481791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:45.481791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:45.482048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:45.482354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:45.634905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bffc42cd0994bdd911dc1e0af4dca46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9ff964acbf4ae7b5d4358d0cbe173d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:39:45.644081 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f7c80137-9dfb-427b-8398-532064ef6f81 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 200 len: 1733 microversion: 2.1 time: 0.176982 Aug 29 05:39:45.644710 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3558/7109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:39:45 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:39:46.106938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-dcf319e3-a0a7-49fc-8c59-c6839d5a4aff req-a691a205-6b64-4c21-a5ea-aab10b7c697c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfb32e8-b182-4749-b047-9882e92d37bd", "name": "network-vif-deleted", "tag": "0880bff4-aa14-4271-8502-cee2c20ac6b2"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:39:46.125646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dcf319e3-a0a7-49fc-8c59-c6839d5a4aff req-a691a205-6b64-4c21-a5ea-aab10b7c697c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:46.126436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dcf319e3-a0a7-49fc-8c59-c6839d5a4aff req-a691a205-6b64-4c21-a5ea-aab10b7c697c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:46.127090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dcf319e3-a0a7-49fc-8c59-c6839d5a4aff req-a691a205-6b64-4c21-a5ea-aab10b7c697c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:46.144537 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-dcf319e3-a0a7-49fc-8c59-c6839d5a4aff req-a691a205-6b64-4c21-a5ea-aab10b7c697c service nova] Creating event network-vif-deleted:0880bff4-aa14-4271-8502-cee2c20ac6b2 for instance 4dfb32e8-b182-4749-b047-9882e92d37bd on n-h2-854119-9 Aug 29 05:39:46.150201 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-dcf319e3-a0a7-49fc-8c59-c6839d5a4aff req-a691a205-6b64-4c21-a5ea-aab10b7c697c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142223 Aug 29 05:39:46.150950 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3552/7110] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:39:46.665120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:39:46.666000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:39:46.673694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:46.674287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:46.675246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:46.675434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:46.675893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:46.676363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:46.692772 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] HTTP exception thrown: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Request method failure captured: Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd HTTP/1.1 Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE_BtJqjJkV9Y52fGD0uGqazwMPSTtdzMttC9QQ9_hSRSkdHi3DVBefY4TNSosU6fY8vSrohd7bNhOaMlReHjOTtT7QpDzuiZuC0bEBO5G4xQEG_oa06IUyvYwRXFxBZxCNvPlajDhvXdVSPJs5wUXou1C7fc8KmvXQR4GDDL0TaczE Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0e9ff964acbf4ae7b5d4358d0cbe173d Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestServerBasicOps-105283423 Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9ff964acbf4ae7b5d4358d0cbe173d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9ff964acbf4ae7b5d4358d0cbe173d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9ff964acbf4ae7b5d4358d0cbe173d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9ff964acbf4ae7b5d4358d0cbe173d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestServerBasicOps-105283423 Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0e9ff964acbf4ae7b5d4358d0cbe173d Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestServerBasicOps-105283423 Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestServerBasicOps-105283423-project Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 8bffc42cd0994bdd911dc1e0af4dca46 Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestServerBasicOps-105283423-project Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '4dfb32e8-b182-4749-b047-9882e92d37bd'} Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:39:46.694457 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Returning 404 to user: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8add979-a41a-4d4a-b046-495205874025 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 404 len: 111 microversion: 2.1 time: 0.034981 Aug 29 05:39:46.699050 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3559/7111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:39:46 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:39:47.212454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:39:47.213039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:39:47.219485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:47.219974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:47.220424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:47.221114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:47.221554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:47.221943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:47.238478 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] HTTP exception thrown: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Request method failure captured: Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd HTTP/1.1 Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE_BtJqjJkV9Y52fGD0uGqazwMPSTtdzMttC9QQ9_hSRSkdHi3DVBefY4TNSosU6fY8vSrohd7bNhOaMlReHjOTtT7QpDzuiZuC0bEBO5G4xQEG_oa06IUyvYwRXFxBZxCNvPlajDhvXdVSPJs5wUXou1C7fc8KmvXQR4GDDL0TaczE Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 0e9ff964acbf4ae7b5d4358d0cbe173d Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestServerBasicOps-105283423 Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9ff964acbf4ae7b5d4358d0cbe173d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9ff964acbf4ae7b5d4358d0cbe173d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9ff964acbf4ae7b5d4358d0cbe173d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9ff964acbf4ae7b5d4358d0cbe173d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestServerBasicOps-105283423 Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 0e9ff964acbf4ae7b5d4358d0cbe173d Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestServerBasicOps-105283423 Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestServerBasicOps-105283423-project Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 8bffc42cd0994bdd911dc1e0af4dca46 Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestServerBasicOps-105283423-project Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '4dfb32e8-b182-4749-b047-9882e92d37bd'} Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:39:47.240285 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Returning 404 to user: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a65e501e-740e-44d7-9f11-504b929cba10 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 404 len: 111 microversion: 2.1 time: 0.034482 Aug 29 05:39:47.246257 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3553/7112] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:39:47 2022] DELETE /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:39:47.250919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:39:47.251558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] [instance: 4dfb32e8-b182-4749-b047-9882e92d37bd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:39:47.259064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:47.259566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:47.260011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:47.261406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:39:47.261879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:39:47.262431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:39:47.279971 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] HTTP exception thrown: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Request method failure captured: Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd HTTP/1.1 Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE_BtJqjJkV9Y52fGD0uGqazwMPSTtdzMttC9QQ9_hSRSkdHi3DVBefY4TNSosU6fY8vSrohd7bNhOaMlReHjOTtT7QpDzuiZuC0bEBO5G4xQEG_oa06IUyvYwRXFxBZxCNvPlajDhvXdVSPJs5wUXou1C7fc8KmvXQR4GDDL0TaczE Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 0e9ff964acbf4ae7b5d4358d0cbe173d Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestServerBasicOps-105283423 Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9ff964acbf4ae7b5d4358d0cbe173d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e9ff964acbf4ae7b5d4358d0cbe173d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e9ff964acbf4ae7b5d4358d0cbe173d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e9ff964acbf4ae7b5d4358d0cbe173d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestServerBasicOps-105283423 Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 0e9ff964acbf4ae7b5d4358d0cbe173d Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestServerBasicOps-105283423 Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestServerBasicOps-105283423-project Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 8bffc42cd0994bdd911dc1e0af4dca46 Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestServerBasicOps-105283423-project Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '4dfb32e8-b182-4749-b047-9882e92d37bd'} Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:39:47.281580 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Returning 404 to user: Instance 4dfb32e8-b182-4749-b047-9882e92d37bd could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ae153b49-da5b-4117-8ff8-34490d921832 tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd" status: 404 len: 111 microversion: 2.1 time: 0.036360 Aug 29 05:39:47.285227 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3560/7113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:39:47 2022] GET /compute/v2.1/servers/4dfb32e8-b182-4749-b047-9882e92d37bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:39:47.462252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d4342f70-bde9-4bfc-8ab3-782800b471ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] Calling method '.version_select at 0x7f1ab81d5ca0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:39:47.493300 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d4342f70-bde9-4bfc-8ab3-782800b471ee tempest-TestServerBasicOps-105283423 tempest-TestServerBasicOps-105283423-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1059919766" status: 202 len: 0 microversion: 2.1 time: 0.034892 Aug 29 05:39:47.494201 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3554/7114] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Aug 29 05:39:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1059919766 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:40:07.883660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-777823084", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1888824102", "security_groups": [{"name": "tempest-secgroup-smoke-1218546524"}], "block_device_mapping_v2": [{"uuid": "522391c7-5d0c-4ad2-9d30-38431b8ee221", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77c879e8-8923-4ae0-9869-fe659563295c"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:40:07.894538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:40:07.895186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:40:08.009366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] validate_networks() for [('77c879e8-8923-4ae0-9869-fe659563295c', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:40:08.413001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:40:08.413437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:40:08.413921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:40:08.414340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:40:08.414796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:40:08.425003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:08.425499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:08.425946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:08.426685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:08.427148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:08.427839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:08.446346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:40:08.452250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Getting quotas for user 83565ba99afd41f4b0d5de74365c3b2f and project fd65b810665c460a8c767d83ec33b490. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:40:08.515476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:40:08.517774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='522391c7-5d0c-4ad2-9d30-38431b8ee221',volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:40:08.665656 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1cb51f5e-4b7f-4194-b396-1602afc50c53 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784368 Aug 29 05:40:08.665656 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3561/7115] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:40:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:40:08.673669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=11 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:40:08.674423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:40:08.678802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e1f4dfc1-3abf-4066-ad15-38e67aca5d95 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:08.679671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e1f4dfc1-3abf-4066-ad15-38e67aca5d95 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:08.739768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e1f4dfc1-3abf-4066-ad15-38e67aca5d95 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:08.747041 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e1f4dfc1-3abf-4066-ad15-38e67aca5d95 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1094 microversion: 2.1 time: 0.075179 Aug 29 05:40:08.747589 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3555/7116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:08 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:09.772489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:09.773527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:09.779882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:09.780590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:09.781333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:09.782511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:09.783284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:09.784008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:09.857848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:09.867044 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3f4d443-73ef-4693-a2cb-b54ccdbe9211 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1192 microversion: 2.1 time: 0.100399 Aug 29 05:40:09.867801 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3562/7117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:09 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1192 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:10.890355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:10.891494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:10.903908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:10.904516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:10.904972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:10.905686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:10.906140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:10.906555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:10.990172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:11.002532 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9b24b38-55e8-4cf8-a15b-4b4cc7cc9c7a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1210 microversion: 2.1 time: 0.116400 Aug 29 05:40:11.003784 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3556/7118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:10 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:11.799436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-485929a6-5933-4329-b76b-7556a90f8adc req-9b319a46-d7d1-47ea-86d9-fa262e7973a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b57d2c4-909f-4f95-bfab-09533b20bec9", "tag": "89d2c0e6-7029-4197-be69-4b79b330775d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:40:11.812631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-485929a6-5933-4329-b76b-7556a90f8adc req-9b319a46-d7d1-47ea-86d9-fa262e7973a6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:11.813473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-485929a6-5933-4329-b76b-7556a90f8adc req-9b319a46-d7d1-47ea-86d9-fa262e7973a6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:11.813988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-485929a6-5933-4329-b76b-7556a90f8adc req-9b319a46-d7d1-47ea-86d9-fa262e7973a6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:11.828167 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-485929a6-5933-4329-b76b-7556a90f8adc req-9b319a46-d7d1-47ea-86d9-fa262e7973a6 service nova] Creating event network-changed:89d2c0e6-7029-4197-be69-4b79b330775d for instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 on n-h2-854119-9 Aug 29 05:40:11.833750 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-485929a6-5933-4329-b76b-7556a90f8adc req-9b319a46-d7d1-47ea-86d9-fa262e7973a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038720 Aug 29 05:40:11.834943 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3563/7119] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:40:12.024476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:12.025116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:12.033731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:12.034645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:12.035453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:12.036232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:12.036948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:12.037547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:12.192158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:12.203651 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f889e01a-f1a7-45ee-b1d2-0bab42f4a42a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1278 microversion: 2.1 time: 0.182949 Aug 29 05:40:12.208177 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3557/7120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:12 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:13.227169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:13.227915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:13.238406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:13.238888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:13.239370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:13.240277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:13.240762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:13.241187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:13.387290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:13.396970 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eff1ce7f-3ee2-42d1-971e-a70ce6f013ef tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1278 microversion: 2.1 time: 0.174812 Aug 29 05:40:13.412706 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3564/7121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:13 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:14.420841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:14.421458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:14.429835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:14.430354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:14.430793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:14.431513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:14.432184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:14.432636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:14.606301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:14.616230 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a587b33-8c7c-452d-9b03-0b0e4f13700a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1278 microversion: 2.1 time: 0.199690 Aug 29 05:40:14.616830 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3558/7122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:14 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:15.637672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:15.638267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:15.645756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:15.646262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:15.646706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:15.647438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:15.647929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:15.648412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:15.808753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:15.818682 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-096c592e-cf86-4441-92e0-f94a5c96fb50 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.184901 Aug 29 05:40:15.819345 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3565/7123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:15 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:16.840425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:16.841244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:16.851137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:16.851614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:16.852091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:16.852872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:16.853281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:16.853719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:16.998288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:17.007040 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4eae5ce0-ef97-4044-b2fd-ae9d6b28f6b0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.170720 Aug 29 05:40:17.007634 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3559/7124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:16 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:18.032851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:18.033602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:18.042122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:18.042853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:18.043616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:18.044372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:18.044832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:18.045264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:18.195795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:18.204294 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c8eb4409-de1b-4a50-b066-72fa5a1f51d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.178888 Aug 29 05:40:18.204872 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3566/7125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:18 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:19.229161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:19.229783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:19.232647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:40:19.239232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:19.239733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:19.240176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:19.240912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:19.241347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:19.241781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:19.387634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:19.395888 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ceb78634-917c-470c-adc3-7f357a784a2f tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.170830 Aug 29 05:40:19.396509 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3560/7126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:19 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:20.418295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:20.419026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:20.420981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:40:20.421660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:40:20.428145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:20.428629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:20.429072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:20.429790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:20.430254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:20.430691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:20.885735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:20.895592 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b6678c1c-19d0-4cb4-b1cf-13de1bf84296 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.482074 Aug 29 05:40:20.896227 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3567/7127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:20 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:21.918405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:21.919141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:21.926695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:21.927185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:21.927618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:21.930116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:21.930116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:21.930116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:22.073905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:22.082494 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1fd7757f-484d-4028-902d-bdb39d0a7ce1 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.168758 Aug 29 05:40:22.083095 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3561/7128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:21 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:23.103721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:23.104365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:23.112448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:23.112960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:23.113411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:23.114132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:23.114598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:23.115033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:23.257580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:23.268696 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69db97b2-9a02-48b5-8ba8-9209f9b5f19a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.168720 Aug 29 05:40:23.269359 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3568/7129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:23 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:24.289754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:24.290354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:24.298805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:24.299300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:24.299731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:24.300498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:24.300963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:24.301366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:24.440566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:24.449946 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8f1ec6b0-5d70-4d9a-b44f-f3ed0a1741e8 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.164047 Aug 29 05:40:24.450516 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3562/7130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:24 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:25.473233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:25.473985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:25.482010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:25.482519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:25.482967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:25.483687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:25.484148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:25.484615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:25.849961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:25.860166 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3d67f3c7-4758-421c-ac93-ffea50583c5c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.391910 Aug 29 05:40:25.861106 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3569/7131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:25 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:26.885468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:26.886294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:26.894437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:26.894942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:26.895387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:26.896153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:26.896730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:26.897236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:27.107811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:27.116163 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-793bc021-7573-40d5-bb64-0e4cb83668e6 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.234590 Aug 29 05:40:27.116753 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3563/7132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:26 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:27.145517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c1cbed32-c0a4-469c-b457-0f2e5daf0ec7 req-a1ce6863-608e-479e-bb16-273df48d3d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57d2c4-909f-4f95-bfab-09533b20bec9", "name": "network-vif-plugged", "status": "completed", "tag": "89d2c0e6-7029-4197-be69-4b79b330775d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:40:27.159668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c1cbed32-c0a4-469c-b457-0f2e5daf0ec7 req-a1ce6863-608e-479e-bb16-273df48d3d98 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:27.160478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c1cbed32-c0a4-469c-b457-0f2e5daf0ec7 req-a1ce6863-608e-479e-bb16-273df48d3d98 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:27.161079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c1cbed32-c0a4-469c-b457-0f2e5daf0ec7 req-a1ce6863-608e-479e-bb16-273df48d3d98 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:27.176234 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c1cbed32-c0a4-469c-b457-0f2e5daf0ec7 req-a1ce6863-608e-479e-bb16-273df48d3d98 service nova] Creating event network-vif-plugged:89d2c0e6-7029-4197-be69-4b79b330775d for instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 on n-h2-854119-9 Aug 29 05:40:27.181608 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c1cbed32-c0a4-469c-b457-0f2e5daf0ec7 req-a1ce6863-608e-479e-bb16-273df48d3d98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039925 Aug 29 05:40:27.182403 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3570/7133] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:40:28.137327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:28.137915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:28.145355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:28.145878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:28.146320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:28.147030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:28.147494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:28.147921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:28.294281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:28.303105 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d628819a-95b4-4c07-be3d-73e574fbb26a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1266 microversion: 2.1 time: 0.169706 Aug 29 05:40:28.303701 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3564/7134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:28 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:29.328580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:29.329396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:29.336155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:29.336791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:29.337428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:29.339861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:29.339861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:29.339861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:29.483914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:29.494750 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-958e4cc8-5215-46f5-9068-be506e84c107 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1452 microversion: 2.1 time: 0.171338 Aug 29 05:40:29.504569 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3571/7135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:29 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:29.515611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:40:29.516183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:40:29.523425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:29.523911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:29.524392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:29.525091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:29.525540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:29.525958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:29.674764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:40:29.683437 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-05bf2f2e-5250-4743-828c-4b579d85f853 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1452 microversion: 2.1 time: 0.171828 Aug 29 05:40:29.684064 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3565/7136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:40:29 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:40:31.553983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-62dfe2e0-e98d-4161-8da0-0196ed81e19b req-ffbb3d60-79d2-42bf-b4c7-db7f966d7ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b57d2c4-909f-4f95-bfab-09533b20bec9", "tag": "89d2c0e6-7029-4197-be69-4b79b330775d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:40:31.566897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-62dfe2e0-e98d-4161-8da0-0196ed81e19b req-ffbb3d60-79d2-42bf-b4c7-db7f966d7ea2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:40:31.568252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-62dfe2e0-e98d-4161-8da0-0196ed81e19b req-ffbb3d60-79d2-42bf-b4c7-db7f966d7ea2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:40:31.569113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-62dfe2e0-e98d-4161-8da0-0196ed81e19b req-ffbb3d60-79d2-42bf-b4c7-db7f966d7ea2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:40:31.584922 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-62dfe2e0-e98d-4161-8da0-0196ed81e19b req-ffbb3d60-79d2-42bf-b4c7-db7f966d7ea2 service nova] Creating event network-changed:89d2c0e6-7029-4197-be69-4b79b330775d for instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 on n-h2-854119-9 Aug 29 05:40:31.590269 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-62dfe2e0-e98d-4161-8da0-0196ed81e19b req-ffbb3d60-79d2-42bf-b4c7-db7f966d7ea2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109871 Aug 29 05:40:31.591330 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3572/7137] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:42:08.465654 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 05:42:08.466496 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 05:42:08.466620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:08.467152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:08.467281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:42:08.467972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=56 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:42:08.470680 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 05:42:08.471231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=24 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:42:08.471915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=60 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:42:08.473223 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 05:42:08.473373 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:42:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 (ip 10.222.0.20) !!! Aug 29 05:42:08.475009 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:42:08.475348 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:42:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 (ip 10.222.0.20) !!! Aug 29 05:42:08.475599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0907499d-8ef1-419b-a2a0-b48046e9bbbd req-159665c0-c6fa-4e05-9363-692d5f4f9eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b57d2c4-909f-4f95-bfab-09533b20bec9", "tag": "89d2c0e6-7029-4197-be69-4b79b330775d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:42:08.486235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:08.486812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:08.487466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:08.488290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:08.488813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:08.489132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0907499d-8ef1-419b-a2a0-b48046e9bbbd req-159665c0-c6fa-4e05-9363-692d5f4f9eb6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:08.489632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0907499d-8ef1-419b-a2a0-b48046e9bbbd req-159665c0-c6fa-4e05-9363-692d5f4f9eb6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:08.489956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:08.490067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0907499d-8ef1-419b-a2a0-b48046e9bbbd req-159665c0-c6fa-4e05-9363-692d5f4f9eb6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:08.501349 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0907499d-8ef1-419b-a2a0-b48046e9bbbd req-159665c0-c6fa-4e05-9363-692d5f4f9eb6 service nova] Creating event network-changed:89d2c0e6-7029-4197-be69-4b79b330775d for instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 on n-h2-854119-9 Aug 29 05:42:08.506300 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0907499d-8ef1-419b-a2a0-b48046e9bbbd req-159665c0-c6fa-4e05-9363-692d5f4f9eb6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042449 Aug 29 05:42:08.506875 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3573/7138] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:42:08.519378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:42:08.628110 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-81980c25-b876-4ab8-af30-5a14cdb43576 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 204 len: 0 microversion: 2.1 time: 0.166383 Aug 29 05:42:08.630150 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3566/7139] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:42:08 2022] DELETE /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:42:08.639315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:08.640855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:08.647289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:08.647849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:08.648390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:08.649179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:08.649711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:08.650203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:08.794223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:08.802208 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e81115aa-cd34-46c8-8c77-8c78bb125454 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1576 microversion: 2.1 time: 0.167849 Aug 29 05:42:08.802795 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3574/7140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:08 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:09.825035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:09.825747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:09.833725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:09.834211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:09.834636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:09.835337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:09.835792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:09.836235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:09.855806 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45188. Aug 29 05:42:09.977193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:09.985868 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cb1e6de9-e302-4567-a8fd-dc304d6997d0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1576 microversion: 2.1 time: 0.165504 Aug 29 05:42:09.986464 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3567/7141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:09 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:10.913120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-11cf0a1d-f77f-4700-8e2c-6605d786fc42 req-165c5b6d-b461-4667-8b86-798493d3585c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57d2c4-909f-4f95-bfab-09533b20bec9", "name": "network-vif-deleted", "tag": "89d2c0e6-7029-4197-be69-4b79b330775d"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:42:10.925631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-11cf0a1d-f77f-4700-8e2c-6605d786fc42 req-165c5b6d-b461-4667-8b86-798493d3585c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:10.926247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-11cf0a1d-f77f-4700-8e2c-6605d786fc42 req-165c5b6d-b461-4667-8b86-798493d3585c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:10.926785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-11cf0a1d-f77f-4700-8e2c-6605d786fc42 req-165c5b6d-b461-4667-8b86-798493d3585c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:10.941484 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-11cf0a1d-f77f-4700-8e2c-6605d786fc42 req-165c5b6d-b461-4667-8b86-798493d3585c service nova] Creating event network-vif-deleted:89d2c0e6-7029-4197-be69-4b79b330775d for instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 on n-h2-854119-9 Aug 29 05:42:10.945142 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45192. Aug 29 05:42:10.947667 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-11cf0a1d-f77f-4700-8e2c-6605d786fc42 req-165c5b6d-b461-4667-8b86-798493d3585c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038351 Aug 29 05:42:10.948692 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3575/7142] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:42:11.007772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:11.008420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:11.015624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:11.016144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:11.016587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:11.017371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:11.017894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:11.018196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:11.081810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:11.090129 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da8b47f4-41ab-411b-a0e7-213669bd011d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1225 microversion: 2.1 time: 0.087002 Aug 29 05:42:11.090710 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3568/7143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:11 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:12.110067 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45194. Aug 29 05:42:12.114712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:12.115603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:12.124156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:12.124643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:12.125120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:12.125831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:12.126281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:12.126708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:12.200766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:12.209036 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2362b67-aac7-401c-9ee6-1e84e660561e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1225 microversion: 2.1 time: 0.100605 Aug 29 05:42:12.209600 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3576/7144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:12 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:13.229736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:13.230306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:13.238091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:13.238575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:13.239007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:13.239697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:13.240147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:13.240581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:13.304344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:13.312953 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4a58bc6f-220f-4e9c-9892-833222e6f5f7 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1225 microversion: 2.1 time: 0.087589 Aug 29 05:42:13.313764 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3569/7145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:13 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:14.334738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:14.335449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:14.343418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:14.343939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:14.344632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:14.345357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:14.345818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:14.346247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:14.409711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:14.417966 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-accd8586-1393-44e1-b41c-235ac59f791d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1225 microversion: 2.1 time: 0.087405 Aug 29 05:42:14.418531 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3577/7146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:14 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:15.439276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:15.439997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:15.447481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:15.448341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:15.449300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:15.450003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:15.450453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:15.450888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:15.484414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:15.484900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:15.485360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:15.485781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lazy-loading 'fault' on Instance uuid 6b57d2c4-909f-4f95-bfab-09533b20bec9 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:42:15.531090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:15.539175 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed5f6d02-11ef-4e0a-8c2b-8f893661ad6a tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 200 len: 1230 microversion: 2.1 time: 0.103968 Aug 29 05:42:15.542091 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3570/7147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:15 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:16.563913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:16.564536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 6b57d2c4-909f-4f95-bfab-09533b20bec9] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:16.574482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:16.574983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:16.575432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:16.576164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:16.576637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:16.577076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:16.590686 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 could not be found. Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 HTTP/1.1 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 could not be found. Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6b57d2c4-909f-4f95-bfab-09533b20bec9'} Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 could not be found. Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 could not be found. Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:42:16.592392 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 could not be found. Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 6b57d2c4-909f-4f95-bfab-09533b20bec9 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f7de7d34-e3e0-4e78-bdf8-7d95229fb87d tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9" status: 404 len: 111 microversion: 2.1 time: 0.036015 Aug 29 05:42:16.596933 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3578/7148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:16 2022] GET /compute/v2.1/servers/6b57d2c4-909f-4f95-bfab-09533b20bec9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:42:23.212470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:23.213260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:23.217681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6a23a59a-45a0-4267-a126-dd0b0b3030dc req-56305ff7-8751-4c10-97c0-04ca98aa2ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435c4c0e-15e9-4708-a8c5-408010e6647e", "tag": "fa08dbe6-07a3-458e-abb5-663319065b84"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:42:23.224668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:23.225564 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:23.226266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:23.227679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:23.228559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:23.229529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:23.236355 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6a23a59a-45a0-4267-a126-dd0b0b3030dc req-56305ff7-8751-4c10-97c0-04ca98aa2ca4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:23.237270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6a23a59a-45a0-4267-a126-dd0b0b3030dc req-56305ff7-8751-4c10-97c0-04ca98aa2ca4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:23.238005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6a23a59a-45a0-4267-a126-dd0b0b3030dc req-56305ff7-8751-4c10-97c0-04ca98aa2ca4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:23.257261 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6a23a59a-45a0-4267-a126-dd0b0b3030dc req-56305ff7-8751-4c10-97c0-04ca98aa2ca4 service nova] Creating event network-changed:fa08dbe6-07a3-458e-abb5-663319065b84 for instance 435c4c0e-15e9-4708-a8c5-408010e6647e on n-h1-854119-9 Aug 29 05:42:23.265553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6a23a59a-45a0-4267-a126-dd0b0b3030dc req-56305ff7-8751-4c10-97c0-04ca98aa2ca4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054375 Aug 29 05:42:23.266530 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3579/7149] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:42:23.274372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:42:23.363058 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e3eeddf8-8f1f-46d3-aa0d-4703124efa1b tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 204 len: 0 microversion: 2.1 time: 0.156250 Aug 29 05:42:23.369012 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3571/7150] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:42:23 2022] DELETE /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:42:23.379542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:23.380431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:23.387420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:23.387947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:23.388403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:23.389113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:23.389570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:23.390161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:23.539782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:23.547890 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bb9ff03b-14b5-43c3-a45c-56dff4f473d9 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1579 microversion: 2.1 time: 0.175353 Aug 29 05:42:23.548513 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3580/7151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:23 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:24.571673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:24.572458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:24.580852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:24.581342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:24.581772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:24.582672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:24.583116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:24.583601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:24.796003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:24.806034 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd87e3f4-3533-4774-ba87-b2f60cfcd5fd tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1579 microversion: 2.1 time: 0.238648 Aug 29 05:42:24.806638 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3572/7152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:24 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1579 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:25.517100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4cfcf0ee-7721-4489-9d2d-09ca80bd61ec req-a2797e3f-0e33-47ff-a728-b331ece24df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435c4c0e-15e9-4708-a8c5-408010e6647e", "name": "network-vif-deleted", "tag": "fa08dbe6-07a3-458e-abb5-663319065b84"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:42:25.528008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4cfcf0ee-7721-4489-9d2d-09ca80bd61ec req-a2797e3f-0e33-47ff-a728-b331ece24df8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:25.528533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4cfcf0ee-7721-4489-9d2d-09ca80bd61ec req-a2797e3f-0e33-47ff-a728-b331ece24df8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:25.528975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4cfcf0ee-7721-4489-9d2d-09ca80bd61ec req-a2797e3f-0e33-47ff-a728-b331ece24df8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:25.540802 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4cfcf0ee-7721-4489-9d2d-09ca80bd61ec req-a2797e3f-0e33-47ff-a728-b331ece24df8 service nova] Creating event network-vif-deleted:fa08dbe6-07a3-458e-abb5-663319065b84 for instance 435c4c0e-15e9-4708-a8c5-408010e6647e on n-h1-854119-9 Aug 29 05:42:25.546971 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4cfcf0ee-7721-4489-9d2d-09ca80bd61ec req-a2797e3f-0e33-47ff-a728-b331ece24df8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Aug 29 05:42:25.547605 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3581/7153] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:42:25.830896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:25.831619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:25.840515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:25.841032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:25.841483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:25.842240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:25.842705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:25.843144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:25.938114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:25.954619 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-906087cb-57af-4e42-9223-4384ef95483c tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1226 microversion: 2.1 time: 0.127506 Aug 29 05:42:25.956233 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3573/7154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:25 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:26.980727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:26.981440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:26.988607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:26.989114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:26.989563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:26.990282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:26.990896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:26.991358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:27.055058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:27.063535 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-276cf7d7-cf39-4b8c-8ac0-cb86002258f0 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1226 microversion: 2.1 time: 0.087950 Aug 29 05:42:27.064334 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3582/7155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:26 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:28.085783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:28.086391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:28.095262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:28.095742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:28.096251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:28.096992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:28.097440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:28.097871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:28.166258 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:28.174922 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-209f62a6-8cf7-47d4-b280-79eca1fa501e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1226 microversion: 2.1 time: 0.093251 Aug 29 05:42:28.175569 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3574/7156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:28 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:29.196810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:29.197449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:29.205150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:29.205644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:29.206082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:29.206789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:29.207243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:29.207675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:29.275738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83565ba99afd41f4b0d5de74365c3b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd65b810665c460a8c767d83ec33b490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:29.284306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-beb834e2-a607-4bdb-9ef7-f7749b57fd03 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 200 len: 1226 microversion: 2.1 time: 0.091401 Aug 29 05:42:29.291636 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3583/7157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:29 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:30.306305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:30.306912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 435c4c0e-15e9-4708-a8c5-408010e6647e] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:30.314129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:30.314616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:30.315028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:30.315743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:30.316245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:30.316650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:30.331416 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 435c4c0e-15e9-4708-a8c5-408010e6647e could not be found. Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e HTTP/1.1 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 435c4c0e-15e9-4708-a8c5-408010e6647e could not be found. Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '435c4c0e-15e9-4708-a8c5-408010e6647e'} Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435c4c0e-15e9-4708-a8c5-408010e6647e could not be found. Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435c4c0e-15e9-4708-a8c5-408010e6647e could not be found. Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:42:30.333154 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435c4c0e-15e9-4708-a8c5-408010e6647e could not be found. Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 435c4c0e-15e9-4708-a8c5-408010e6647e could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3c2827a7-47fd-46cd-a49d-40bf07abf62e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e" status: 404 len: 111 microversion: 2.1 time: 0.032399 Aug 29 05:42:30.336719 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3575/7158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:30 2022] GET /compute/v2.1/servers/435c4c0e-15e9-4708-a8c5-408010e6647e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:42:30.783335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:30.783870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:30.791057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:30.791550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:30.791996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:30.792748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:30.793216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:30.793649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:30.810169 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 HTTP/1.1 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '70f9d8db-5116-43c9-b575-dab05b4a8df2'} Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:42:30.811858 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e0f458d4-0275-4cb8-ae49-5834d3840b59 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 404 len: 111 microversion: 2.1 time: 0.033972 Aug 29 05:42:30.815571 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3584/7159] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:42:30 2022] DELETE /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:42:30.822430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:30.823373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] [instance: 70f9d8db-5116-43c9-b575-dab05b4a8df2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:30.829805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:30.830300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:30.830743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:30.831438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:30.831895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:30.832365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:30.846250 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] HTTP exception thrown: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Request method failure captured: Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 HTTP/1.1 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDE6JjXHmA1_mP1o_Pjy7puGKyaT7gAc0uZgQhiMdROOdPfxZ_mQdzYxEpxoKj7Rl3NvfCpvxaHT8uBHRqfV8tH48ES6tKvU8R1VclkfOjHHpeERYJejf1BTVUOqtMHsdEyG1n539aV2zgmxSdG7QcKFjsB4Y66XFGkfZWzS-OPFGde0 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd65b810665c460a8c767d83ec33b490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd65b810665c460a8c767d83ec33b490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: fd65b810665c460a8c767d83ec33b490 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestVolumeBootPattern-738443516 Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 83565ba99afd41f4b0d5de74365c3b2f Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestVolumeBootPattern-738443516-project Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '70f9d8db-5116-43c9-b575-dab05b4a8df2'} Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:42:30.847808 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Returning 404 to user: Instance 70f9d8db-5116-43c9-b575-dab05b4a8df2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ce025e0b-19f0-45cf-b8ad-9dd12d3d260e tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2" status: 404 len: 111 microversion: 2.1 time: 0.030916 Aug 29 05:42:30.852113 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3576/7160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:30 2022] GET /compute/v2.1/servers/70f9d8db-5116-43c9-b575-dab05b4a8df2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:42:34.269206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9813d060-d0b0-465a-a43c-494150e69c88 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] Calling method '.version_select at 0x7f1ab9d7cc10>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:34.298495 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9813d060-d0b0-465a-a43c-494150e69c88 tempest-TestVolumeBootPattern-738443516 tempest-TestVolumeBootPattern-738443516-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1888824102" status: 202 len: 0 microversion: 2.1 time: 0.033170 Aug 29 05:42:34.299539 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3585/7161] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 29 05:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1888824102 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:42:53.369974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:42:53.370593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:42:53.500253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-554177695", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:42:53.559157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] validate_networks() for None {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:42:53.764492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:42:53.764935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:42:53.765404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:42:53.765809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:42:53.766251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:42:53.776680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:53.777163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:53.777603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:53.778330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:53.778779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:53.779195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:53.798520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Getting quotas for project aba0601b6e074e4c9f5d8bdf3c1a64a4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:42:53.804601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Getting quotas for user 5eda4a67a97c4d1386d0132527e8c305 and project aba0601b6e074e4c9f5d8bdf3c1a64a4. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:42:53.819081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:42:53.821622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:42:53.870784 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-89787801-20ae-45e0-a514-c0caea618a82 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506585 Aug 29 05:42:53.871421 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3577/7162] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:42:53.882606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=48 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:42:53.883543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:42:53.887779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8161bbcd-eb42-4709-aa5c-5153382006ac tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:53.889433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8161bbcd-eb42-4709-aa5c-5153382006ac tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:53.953141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8161bbcd-eb42-4709-aa5c-5153382006ac tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:53.961696 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8161bbcd-eb42-4709-aa5c-5153382006ac tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1221 microversion: 2.1 time: 0.080904 Aug 29 05:42:53.962421 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3586/7163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:53 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:54.987269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:54.987921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:54.994674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:54.995168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:54.995605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:54.996392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:54.996813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:54.997236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:55.064996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:55.074565 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-77165ff2-b480-4a2a-8156-8f60c0dea36b tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1273 microversion: 2.1 time: 0.092503 Aug 29 05:42:55.075153 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3578/7164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:54 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:56.099170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:56.100111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:56.107565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:56.108953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:56.109659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:56.110677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:56.111200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:56.111730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:56.269623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:56.279120 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b16bb72-5566-46cc-9ee5-be15a17ca9eb tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1321 microversion: 2.1 time: 0.185458 Aug 29 05:42:56.279862 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3587/7165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:56 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:56.759902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-280241ad-53fc-40a5-bc33-5b030538cd66 req-9c6b26ca-c22a-4736-9be6-dffaf07efdbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6159c471-d7f6-41f7-9f5b-fa7223389664", "tag": "809789ff-8751-4aac-9495-0cd1b0670630"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:42:56.780335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-280241ad-53fc-40a5-bc33-5b030538cd66 req-9c6b26ca-c22a-4736-9be6-dffaf07efdbd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:56.780682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-280241ad-53fc-40a5-bc33-5b030538cd66 req-9c6b26ca-c22a-4736-9be6-dffaf07efdbd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:56.781104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-280241ad-53fc-40a5-bc33-5b030538cd66 req-9c6b26ca-c22a-4736-9be6-dffaf07efdbd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:56.795982 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-280241ad-53fc-40a5-bc33-5b030538cd66 req-9c6b26ca-c22a-4736-9be6-dffaf07efdbd service nova] Creating event network-changed:809789ff-8751-4aac-9495-0cd1b0670630 for instance 6159c471-d7f6-41f7-9f5b-fa7223389664 on n-h2-854119-9 Aug 29 05:42:56.803175 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-280241ad-53fc-40a5-bc33-5b030538cd66 req-9c6b26ca-c22a-4736-9be6-dffaf07efdbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046228 Aug 29 05:42:56.804167 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3579/7166] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:42:57.302715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:57.303266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:57.310498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:57.311038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:57.311450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:57.312223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:57.312695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:57.313134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:57.453547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:57.462177 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-31034a85-66ae-4eb0-8595-4e851c820989 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1321 microversion: 2.1 time: 0.163939 Aug 29 05:42:57.462754 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3588/7167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:57 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:58.484905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:58.485702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:58.493380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:58.493871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:58.494306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:58.495011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:58.495466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:58.495894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:58.644704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:58.656981 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1776136-9563-4c76-bdc8-2e4124156d54 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1321 microversion: 2.1 time: 0.176424 Aug 29 05:42:58.657874 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3580/7168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:58 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:42:59.681769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:42:59.682456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:42:59.689913 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:59.690402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:59.690918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:59.691568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:42:59.692028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:42:59.692527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:42:59.837725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:42:59.846283 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b4fe194-1cdd-435b-a72e-1b504beb0f40 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1321 microversion: 2.1 time: 0.168591 Aug 29 05:42:59.846915 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3589/7169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:42:59 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:00.867486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:00.868361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:00.877360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:00.877957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:00.878585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:00.879541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:00.880147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:00.880701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:01.021040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:01.029087 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef0c81e1-74f4-42a2-9960-d82269e41f5a tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1321 microversion: 2.1 time: 0.165577 Aug 29 05:43:01.029665 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3581/7170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:00 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:02.050597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:02.051184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:02.058679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:02.059179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:02.059651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:02.060397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:02.060859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:02.061290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:02.200493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:02.208451 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fd52c1f0-b57a-48f7-b4a5-e44020c1af7c tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1321 microversion: 2.1 time: 0.161955 Aug 29 05:43:02.209031 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3590/7171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:02 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:03.229823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:03.230885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:03.238556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:03.239104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:03.239535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:03.240281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:03.240735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:03.241151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:03.384881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:03.393245 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7063282d-1377-4faf-929c-2de961804b9d tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1321 microversion: 2.1 time: 0.167794 Aug 29 05:43:03.393833 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3582/7172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:03 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:43:03.837905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-30fb6f33-53aa-4024-a7b4-e9e16b1ffc97 req-47d98710-936e-4025-8a9c-d0677c0146f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6159c471-d7f6-41f7-9f5b-fa7223389664", "name": "network-vif-plugged", "status": "completed", "tag": "809789ff-8751-4aac-9495-0cd1b0670630"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:03.851635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-30fb6f33-53aa-4024-a7b4-e9e16b1ffc97 req-47d98710-936e-4025-8a9c-d0677c0146f9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:03.852277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-30fb6f33-53aa-4024-a7b4-e9e16b1ffc97 req-47d98710-936e-4025-8a9c-d0677c0146f9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:03.853097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-30fb6f33-53aa-4024-a7b4-e9e16b1ffc97 req-47d98710-936e-4025-8a9c-d0677c0146f9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:03.865918 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-30fb6f33-53aa-4024-a7b4-e9e16b1ffc97 req-47d98710-936e-4025-8a9c-d0677c0146f9 service nova] Creating event network-vif-plugged:809789ff-8751-4aac-9495-0cd1b0670630 for instance 6159c471-d7f6-41f7-9f5b-fa7223389664 on n-h2-854119-9 Aug 29 05:43:03.872943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-30fb6f33-53aa-4024-a7b4-e9e16b1ffc97 req-47d98710-936e-4025-8a9c-d0677c0146f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038902 Aug 29 05:43:03.874225 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3591/7173] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:43:04.416480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:04.417308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:04.422752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:04.423370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:04.430662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:04.431154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:04.431584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:04.432339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:04.432785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:04.433209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:04.575823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:04.584745 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ec10d547-376b-4663-be6a-9430d3edd2dd tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1321 microversion: 2.1 time: 0.169300 Aug 29 05:43:04.585315 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3583/7174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:04 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:05.606689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:05.607392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:05.609475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:05.616779 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:05.617270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:05.617710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:05.618535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:05.618993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:05.619427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:05.766960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:05.779360 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7f13e8a4-6679-4edc-868e-6ceac00615c0 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1470 microversion: 2.1 time: 0.177242 Aug 29 05:43:05.780302 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3592/7175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:05 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:05.866852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f428bc0b-430a-4a9a-b511-0ac2098f229b tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Calling method '.version_select at 0x7f1abd96c040>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:05.949274 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f428bc0b-430a-4a9a-b511-0ac2098f229b tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6ca82091ee0e4938b08cbe6153e16b6a" status: 200 len: 371 microversion: 2.1 time: 0.139591 Aug 29 05:43:05.949871 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3584/7176] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 05:43:05 2022] GET /compute/v2.1/os-quota-sets/6ca82091ee0e4938b08cbe6153e16b6a => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:43:05.962233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7595d09f-2954-4ccf-b58f-1b87f22fcbeb tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1072204356", "id": 352155588, "os-flavor-access:is_public": "True"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:05.980394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7595d09f-2954-4ccf-b58f-1b87f22fcbeb tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022432 Aug 29 05:43:05.980968 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3593/7177] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:43:05 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:43:05.993457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "352155588"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:05.995784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:06.002156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.002639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.003076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.003757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.004244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.004664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.201450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4bc2f593c4c0429c8ae98ee655466b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca82091ee0e4938b08cbe6153e16b6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:06.208313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1072204356 {{(pid=128872) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:43:06.215191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.215690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.216097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.216869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.217321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.217740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.240275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Getting quotas for project aba0601b6e074e4c9f5d8bdf3c1a64a4. Resources: {'ram', 'cores'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:43:06.245600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Getting quotas for user 5eda4a67a97c4d1386d0132527e8c305 and project aba0601b6e074e4c9f5d8bdf3c1a64a4. Resources: {'ram', 'cores'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:43:06.260858 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.compute.api [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] ram quota exceeded for 6ca82091ee0e4938b08cbe6153e16b6a, tried to resize instance. Aug 29 05:43:06.261504 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Request method failure captured: Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664/action HTTP/1.1 Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 38 Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFHdKTcX0sdjYiJHL30TeC4VKWNL-EmwgOoJdzRDw_ReKLpievi9Lsezt49bBPcjshs8RccS6QYQt4JQSjkXB0vSdg54NMytW32SWiFmfx7_E-TtEQdR-DRGKfRUsItRwPr2iPR0LI5jiJ74zu7x8zparZhVRYVoAvdyO4UNsH_in0M Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6ca82091ee0e4938b08cbe6153e16b6a Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-69849871 Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Role: admin,member,reader Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: admin,member,reader Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ca82091ee0e4938b08cbe6153e16b6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ca82091ee0e4938b08cbe6153e16b6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ca82091ee0e4938b08cbe6153e16b6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ca82091ee0e4938b08cbe6153e16b6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersAdminNegativeTestJSON-69849871 Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6ca82091ee0e4938b08cbe6153e16b6a Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-69849871 Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersAdminNegativeTestJSON-69849871-project-admin Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 4bc2f593c4c0429c8ae98ee655466b65 Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersAdminNegativeTestJSON-69849871-project-admin Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: {"resize": {"flavorRef": "352155588"}} Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6159c471-d7f6-41f7-9f5b-fa7223389664', 'body': {'resize': {'flavorRef': '352155588'}}} Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:43:06.269589 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85e516b4-7d2a-46ed-ae20-e3aeab81be8f tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664/action" status: 403 len: 118 microversion: 2.1 time: 0.281629 Aug 29 05:43:06.274910 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3585/7178] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:43:05 2022] POST /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664/action => generated 118 bytes in 283 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:43:06.280769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f88b0ecd-85bf-478e-97ee-ff46e9d190d4 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:06.300819 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f88b0ecd-85bf-478e-97ee-ff46e9d190d4 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/352155588" status: 202 len: 0 microversion: 2.1 time: 0.024184 Aug 29 05:43:06.301401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3594/7179] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Aug 29 05:43:06 2022] DELETE /compute/v2.1/flavors/352155588 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:43:06.310313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41dd252f-65d0-4a83-b21b-8de90af1e419 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:06.334158 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-41dd252f-65d0-4a83-b21b-8de90af1e419 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028182 Aug 29 05:43:06.334842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3586/7180] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 05:43:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:06.354901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9967ee85-69c1-4684-b381-d62755014102 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Calling method '.version_select at 0x7f1ab8a22f70>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:06.435388 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9967ee85-69c1-4684-b381-d62755014102 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6ca82091ee0e4938b08cbe6153e16b6a" status: 200 len: 371 microversion: 2.1 time: 0.084274 Aug 29 05:43:06.435983 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3595/7181] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Aug 29 05:43:06 2022] GET /compute/v2.1/os-quota-sets/6ca82091ee0e4938b08cbe6153e16b6a => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:43:06.447833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d07a66b-5608-470e-abc4-ccd3cf1ca5d5 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1676884010", "id": 63277781, "os-flavor-access:is_public": "True"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:06.467637 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7d07a66b-5608-470e-abc4-ccd3cf1ca5d5 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.023536 Aug 29 05:43:06.468250 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3587/7182] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:43:06 2022] POST /compute/v2.1/flavors => generated 431 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:43:06.482396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "63277781"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:06.485028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:06.496153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.496664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.497106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.497825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.498592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.498795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.655731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4bc2f593c4c0429c8ae98ee655466b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca82091ee0e4938b08cbe6153e16b6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:06.662427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1676884010 {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:43:06.669532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.670021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.670546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.671272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.671727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.672151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.692680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Getting quotas for project aba0601b6e074e4c9f5d8bdf3c1a64a4. Resources: {'ram', 'cores'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:43:06.698297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Getting quotas for user 5eda4a67a97c4d1386d0132527e8c305 and project aba0601b6e074e4c9f5d8bdf3c1a64a4. Resources: {'ram', 'cores'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:43:06.710782 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] cores quota exceeded for 6ca82091ee0e4938b08cbe6153e16b6a, tried to resize instance. Aug 29 05:43:06.711649 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Request method failure captured: Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664/action HTTP/1.1 Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 37 Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFHdKTcX0sdjYiJHL30TeC4VKWNL-EmwgOoJdzRDw_ReKLpievi9Lsezt49bBPcjshs8RccS6QYQt4JQSjkXB0vSdg54NMytW32SWiFmfx7_E-TtEQdR-DRGKfRUsItRwPr2iPR0LI5jiJ74zu7x8zparZhVRYVoAvdyO4UNsH_in0M Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6ca82091ee0e4938b08cbe6153e16b6a Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-69849871 Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Role: admin,member,reader Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: admin,member,reader Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ca82091ee0e4938b08cbe6153e16b6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ca82091ee0e4938b08cbe6153e16b6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ca82091ee0e4938b08cbe6153e16b6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ca82091ee0e4938b08cbe6153e16b6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-69849871 Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6ca82091ee0e4938b08cbe6153e16b6a Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-69849871 Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminNegativeTestJSON-69849871-project-admin Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 4bc2f593c4c0429c8ae98ee655466b65 Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-69849871-project-admin Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: {"resize": {"flavorRef": "63277781"}} Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6159c471-d7f6-41f7-9f5b-fa7223389664', 'body': {'resize': {'flavorRef': '63277781'}}} Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:43:06.736172 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a49e5137-24c5-4177-903e-431e35dca699 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664/action" status: 403 len: 113 microversion: 2.1 time: 0.259645 Aug 29 05:43:06.740328 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3596/7183] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:43:06 2022] POST /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664/action => generated 113 bytes in 261 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:43:06.747410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cbb1741c-9cfc-46a9-b710-0cd4ab6c4694 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:06.766374 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cbb1741c-9cfc-46a9-b710-0cd4ab6c4694 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/63277781" status: 202 len: 0 microversion: 2.1 time: 0.023156 Aug 29 05:43:06.766976 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3588/7184] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 29 05:43:06 2022] DELETE /compute/v2.1/flavors/63277781 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:43:06.775158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee860d60-22f3-4e4d-b744-8ac94ed83288 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:06.795698 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee860d60-22f3-4e4d-b744-8ac94ed83288 tempest-ServersAdminNegativeTestJSON-69849871 tempest-ServersAdminNegativeTestJSON-69849871-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024231 Aug 29 05:43:06.796281 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3597/7185] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Aug 29 05:43:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:06.817939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:06.818434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:06.830065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.830561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.830993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.831715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.832256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.832858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.860147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:43:06.942082 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b403555d-d4f9-4c80-aa8a-9a2a3aabf149 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 204 len: 0 microversion: 2.1 time: 0.127762 Aug 29 05:43:06.943127 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3589/7186] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:43:06 2022] DELETE /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:43:06.951677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:06.952472 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:06.958815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.959311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.959745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:06.960476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:06.960937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:06.961381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:07.098838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:07.107278 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de256c9f-1e9b-47a2-becc-96fcec50f489 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1476 microversion: 2.1 time: 0.160137 Aug 29 05:43:07.107829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3598/7187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:06 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1476 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:08.131662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:08.132408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:08.139886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:08.140407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:08.140854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:08.141549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:08.142007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:08.142431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:08.280643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:08.288791 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45d7160c-8bf2-4256-9b37-14b3d8f664a8 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1476 microversion: 2.1 time: 0.161719 Aug 29 05:43:08.289367 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3590/7188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:08 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:08.964673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-be311f5e-f116-45c9-a3d5-90907cc46a58 req-bb61c117-2406-4013-b3ce-f6f9f738d9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6159c471-d7f6-41f7-9f5b-fa7223389664", "name": "network-vif-deleted", "tag": "809789ff-8751-4aac-9495-0cd1b0670630"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:08.976260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-be311f5e-f116-45c9-a3d5-90907cc46a58 req-bb61c117-2406-4013-b3ce-f6f9f738d9a6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:08.976762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-be311f5e-f116-45c9-a3d5-90907cc46a58 req-bb61c117-2406-4013-b3ce-f6f9f738d9a6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:08.977264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-be311f5e-f116-45c9-a3d5-90907cc46a58 req-bb61c117-2406-4013-b3ce-f6f9f738d9a6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:08.991379 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-be311f5e-f116-45c9-a3d5-90907cc46a58 req-bb61c117-2406-4013-b3ce-f6f9f738d9a6 service nova] Creating event network-vif-deleted:809789ff-8751-4aac-9495-0cd1b0670630 for instance 6159c471-d7f6-41f7-9f5b-fa7223389664 on n-h2-854119-9 Aug 29 05:43:08.997389 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-be311f5e-f116-45c9-a3d5-90907cc46a58 req-bb61c117-2406-4013-b3ce-f6f9f738d9a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036475 Aug 29 05:43:08.998357 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3599/7189] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:43:09.310401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:09.311072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:09.318442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:09.318936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:09.319373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:09.320076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:09.320565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:09.321050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:09.353592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:09.354080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:09.354519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:09.354998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lazy-loading 'fault' on Instance uuid 6159c471-d7f6-41f7-9f5b-fa7223389664 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:43:09.397899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eda4a67a97c4d1386d0132527e8c305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba0601b6e074e4c9f5d8bdf3c1a64a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:09.406158 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc52f1f8-7e97-4193-841a-0f284354e6b1 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 200 len: 1311 microversion: 2.1 time: 0.099937 Aug 29 05:43:09.406741 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3591/7190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:09 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:10.430264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:10.430956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] [instance: 6159c471-d7f6-41f7-9f5b-fa7223389664] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:10.437637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:10.438118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:10.438559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:10.439255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:10.439721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:10.440327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:10.454515 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] HTTP exception thrown: Instance 6159c471-d7f6-41f7-9f5b-fa7223389664 could not be found. Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Request method failure captured: Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 HTTP/1.1 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFHcQwI2Dkp-KDC-YYG5e43AfhVdEJVMj3y71BelD2uasEZcqCAK4FaelP8i__D8BxllHm07iOmH41wEUwc53-GSVQKTTSRotlXLVUtLshzTB8gd4gqDXzU-K6_xcgMC-tRoS2euFgNkhmtOcQqX0pMjzwsMar5KGt04XvFQ8jHBSDc Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: aba0601b6e074e4c9f5d8bdf3c1a64a4 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1751903086 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aba0601b6e074e4c9f5d8bdf3c1a64a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aba0601b6e074e4c9f5d8bdf3c1a64a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aba0601b6e074e4c9f5d8bdf3c1a64a4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aba0601b6e074e4c9f5d8bdf3c1a64a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1751903086 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: aba0601b6e074e4c9f5d8bdf3c1a64a4 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1751903086 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersAdminNegativeTestJSON-1751903086-project Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5eda4a67a97c4d1386d0132527e8c305 Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1751903086-project Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6159c471-d7f6-41f7-9f5b-fa7223389664 could not be found. Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6159c471-d7f6-41f7-9f5b-fa7223389664'} Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6159c471-d7f6-41f7-9f5b-fa7223389664 could not be found. Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6159c471-d7f6-41f7-9f5b-fa7223389664 could not be found. Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:10.456174 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6159c471-d7f6-41f7-9f5b-fa7223389664 could not be found. Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] Returning 404 to user: Instance 6159c471-d7f6-41f7-9f5b-fa7223389664 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd946956-e679-4bd4-897b-a7a72f564f39 tempest-ServersAdminNegativeTestJSON-1751903086 tempest-ServersAdminNegativeTestJSON-1751903086-project] 10.222.0.20 "GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664" status: 404 len: 111 microversion: 2.1 time: 0.032638 Aug 29 05:43:10.459843 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3600/7191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:10 2022] GET /compute/v2.1/servers/6159c471-d7f6-41f7-9f5b-fa7223389664 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:43:16.560789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:16.562006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:16.691998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1958318066", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "496b58c8-0ddf-43f6-8c0f-655af59d0651"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:16.753845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] validate_networks() for [('496b58c8-0ddf-43f6-8c0f-655af59d0651', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:43:17.164771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:43:17.165204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:43:17.165675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:43:17.166126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:43:17.166696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:43:17.176346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:17.176918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:17.177312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:17.178032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:17.178483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:17.178905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:17.199367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Getting quotas for project 3b80c483d8514443b0b3deaa5c8b7e3b. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:43:17.205505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Getting quotas for user 349841ce0d7f4bf1a45db37afcb250dc and project 3b80c483d8514443b0b3deaa5c8b7e3b. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:43:17.219001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:43:17.221662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:43:17.271831 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b2c3cfc-13f2-442d-a1c4-10f4983ee58b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716103 Aug 29 05:43:17.272644 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3592/7192] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:43:17.284162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9ffaaa33-3dd1-4614-8248-acefab512aba tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:17.285145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ffaaa33-3dd1-4614-8248-acefab512aba tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:17.287457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:17.288442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:17.364055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ffaaa33-3dd1-4614-8248-acefab512aba tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:17.371031 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9ffaaa33-3dd1-4614-8248-acefab512aba tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1215 microversion: 2.1 time: 0.091176 Aug 29 05:43:17.371577 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3601/7193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:17 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:18.396799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:18.397740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:18.414902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:18.415585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:18.416192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:18.417086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:18.417690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:18.418306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:18.517947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:18.527529 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3933d8ac-0564-40b3-a8d0-9d4e4ccc9cae tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1275 microversion: 2.1 time: 0.136076 Aug 29 05:43:18.542876 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3593/7194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:18 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:19.550726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:19.551399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:19.564378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:19.564916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:19.565387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:19.566224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:19.566742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:19.567205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:19.728438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:19.743560 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2bdfaeed-5880-4d39-92f4-f8a33ad91300 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1315 microversion: 2.1 time: 0.197160 Aug 29 05:43:19.744183 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3602/7195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:19 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:19.846305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5c6eebb9-f0e7-4686-93e5-579f5d1ab0c0 req-b4b5cf4e-8ab1-40b2-bc8f-537d18ae68a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd98ee5-8dff-4b65-a15e-7a30297ae578", "tag": "6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:19.857441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5c6eebb9-f0e7-4686-93e5-579f5d1ab0c0 req-b4b5cf4e-8ab1-40b2-bc8f-537d18ae68a3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:19.858216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5c6eebb9-f0e7-4686-93e5-579f5d1ab0c0 req-b4b5cf4e-8ab1-40b2-bc8f-537d18ae68a3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:19.858789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5c6eebb9-f0e7-4686-93e5-579f5d1ab0c0 req-b4b5cf4e-8ab1-40b2-bc8f-537d18ae68a3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:19.873004 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5c6eebb9-f0e7-4686-93e5-579f5d1ab0c0 req-b4b5cf4e-8ab1-40b2-bc8f-537d18ae68a3 service nova] Creating event network-changed:6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c for instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 on n-h2-854119-9 Aug 29 05:43:19.879629 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5c6eebb9-f0e7-4686-93e5-579f5d1ab0c0 req-b4b5cf4e-8ab1-40b2-bc8f-537d18ae68a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053799 Aug 29 05:43:19.881332 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3594/7196] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:43:20.765570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:20.766176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:20.774578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:20.775076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:20.775514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:20.776263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:20.776733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:20.777164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:20.916761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:20.925385 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1708168d-6c70-45d0-87af-f8f012c10b98 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1315 microversion: 2.1 time: 0.164008 Aug 29 05:43:20.925984 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3603/7197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:20 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:21.948545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:21.949253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:21.956982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:21.957605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:21.958125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:21.959006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:21.959573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:21.960044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:22.404859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:22.413614 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ff3842a-3674-4ba8-ada5-14bc798ffe4e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1315 microversion: 2.1 time: 0.470529 Aug 29 05:43:22.414109 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3595/7198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:21 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:23.434500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:23.435125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:23.443635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:23.444155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:23.444608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:23.445315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:23.445871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:23.446401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:23.581196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:23.589564 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16599edb-bb78-46c5-9835-6a6006f4d97e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1315 microversion: 2.1 time: 0.159091 Aug 29 05:43:23.590170 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3604/7199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:23 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:24.610375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:24.611216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:24.613845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:24.619352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:24.619841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:24.620418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:24.621123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:24.621576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:24.621998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:24.625361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:24.763450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:24.771526 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-521c2272-3141-4984-90e4-02cc9719ce0e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1315 microversion: 2.1 time: 0.165086 Aug 29 05:43:24.772098 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3596/7200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:24 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:25.792973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:25.793605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:25.796514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:25.803662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:25.804220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:25.804703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:25.805601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:25.806135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:25.806768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:25.811871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=74 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:25.949533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:25.963657 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-73da5934-6629-405c-8b1a-fe0c4359803f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1315 microversion: 2.1 time: 0.174748 Aug 29 05:43:25.964289 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3605/7201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:25 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:25.990914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0b0c8fe5-4b8b-4ce1-aad2-8bc1840e0913 req-8ad8f4c9-79b4-4020-8760-c4d6341e7964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd98ee5-8dff-4b65-a15e-7a30297ae578", "name": "network-vif-plugged", "status": "completed", "tag": "6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:26.000731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0b0c8fe5-4b8b-4ce1-aad2-8bc1840e0913 req-8ad8f4c9-79b4-4020-8760-c4d6341e7964 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:26.001250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0b0c8fe5-4b8b-4ce1-aad2-8bc1840e0913 req-8ad8f4c9-79b4-4020-8760-c4d6341e7964 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:26.001747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0b0c8fe5-4b8b-4ce1-aad2-8bc1840e0913 req-8ad8f4c9-79b4-4020-8760-c4d6341e7964 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:26.012857 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0b0c8fe5-4b8b-4ce1-aad2-8bc1840e0913 req-8ad8f4c9-79b4-4020-8760-c4d6341e7964 service nova] Creating event network-vif-plugged:6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c for instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 on n-h2-854119-9 Aug 29 05:43:26.018190 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0b0c8fe5-4b8b-4ce1-aad2-8bc1840e0913 req-8ad8f4c9-79b4-4020-8760-c4d6341e7964 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118601 Aug 29 05:43:26.018901 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3597/7202] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:43:26.985397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:26.986027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:26.993378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:26.993884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:26.994331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:26.995045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:26.995511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:26.995955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:27.126406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:27.134543 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c43a06e2-258f-4017-868f-cf28925ef722 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1315 microversion: 2.1 time: 0.153231 Aug 29 05:43:27.135088 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3606/7203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:26 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:28.153239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:28.154016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:28.158267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:28.158965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:28.166434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:28.166918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:28.167348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:28.168041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:28.168522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:28.168937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:28.317448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:28.326140 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5bbd0295-a5e3-4911-9158-da29801c7b54 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1503 microversion: 2.1 time: 0.174739 Aug 29 05:43:28.326726 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3598/7204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:28 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:28.346554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:28.348809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:28.350745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:28.356850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:28.357346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:28.357794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:28.358501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:28.358960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:28.359391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:28.387332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:28.393481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Old instance type m1.heat2, new instance type m1.heat {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:43:28.400031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:43:28.400489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:43:28.400973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:43:28.401389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:43:28.401811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:43:28.463843 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [dd1b89bb-156e-42a6-8426-e6b8a5de3b1c] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 05:43:29.471141 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [dd1b89bb-156e-42a6-8426-e6b8a5de3b1c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45554. Aug 29 05:43:29.475009 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4db4d295-bd06-4111-94f4-ad5fbe08ca3b tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "POST /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578/action" status: 202 len: 0 microversion: 2.1 time: 1.132534 Aug 29 05:43:29.476078 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3607/7205] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:43:28 2022] POST /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:43:29.485186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:29.486639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:29.494604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:29.495102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:29.495567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:29.496368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:29.496831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:29.497262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:29.651989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:29.660069 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fc04e283-f6ce-489b-ab42-561e333b95be tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1512 microversion: 2.1 time: 0.179719 Aug 29 05:43:29.660764 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3599/7206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:29 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:30.687367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:30.688010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:30.694291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:30.694813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:30.695287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:30.696098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:30.696589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:30.697019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:30.841082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:30.849191 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8a54c59e-c6fa-457a-b374-baef91c416fb tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1512 microversion: 2.1 time: 0.170696 Aug 29 05:43:30.849781 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3608/7207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:30 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:31.870969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:31.871599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:31.879066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:31.879562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:31.880000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:31.880739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:31.881197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:31.881628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:32.014390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:32.022659 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa534987-21f1-4904-b6d1-116013ea727d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.155744 Aug 29 05:43:32.023251 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3600/7208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:31 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:33.044066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:33.044674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:33.052239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:33.052744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:33.053197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:33.053912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:33.054381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:33.054834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:33.192416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:33.201764 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ceabd0e2-ce6c-474f-80b5-39a28ffcae43 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.161684 Aug 29 05:43:33.202331 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3609/7209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:33 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:34.223390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:34.224146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:34.231567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:34.232110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:34.232619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:34.233461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:34.234024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:34.234529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:34.374102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:34.383866 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-290ea071-d70b-4bd3-9766-221cf049b1f6 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.164429 Aug 29 05:43:34.385271 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3601/7210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:34 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:35.409227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:35.409855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:35.417189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:35.417677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:35.418119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:35.418821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:35.419278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:35.419705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:35.551451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:35.559468 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b077a2d7-c94a-4160-b595-9c812e597b72 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.154135 Aug 29 05:43:35.560046 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3610/7211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:35 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:36.580990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:36.581676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:36.589252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:36.589760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:36.590199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:36.590914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:36.591421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:36.591813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:36.738360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:36.746966 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-deb04c72-4249-4344-8b81-20e1cecf065e tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.169881 Aug 29 05:43:36.747588 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3602/7212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:36 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:37.769036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:37.769676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:37.776936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:37.777453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:37.777903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:37.778603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:37.779117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:37.779541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:37.918033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:37.926718 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-749fc557-8f78-4e2c-b584-46fff405b8c2 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.161666 Aug 29 05:43:37.927339 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3611/7213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:37 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:38.948855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:38.949439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:38.957857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:38.958344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:38.958773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:38.959468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:38.959914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:38.960373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:39.099925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:39.108311 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-15019b69-1a6f-4b0c-9ee1-887380040693 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.163783 Aug 29 05:43:39.108962 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3603/7214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:38 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:40.129596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:40.130263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:40.138124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:40.138619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:40.139062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:40.139766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:40.140244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:40.140703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:40.273876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:40.282643 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2c96bac6-3a9f-4612-bb5a-2580ac143194 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.157121 Aug 29 05:43:40.283382 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3612/7215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:40 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:41.306958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:41.307590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:41.315109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:41.315713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:41.316364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:41.317237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:41.317816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:41.318312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:41.455842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:41.464473 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5c21538a-60bf-4ec5-b9ff-e22f6ade4e42 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.162000 Aug 29 05:43:41.465080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3604/7216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:41 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:42.486142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:42.486810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:42.493309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:42.493816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:42.494265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:42.494988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:42.495457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:42.495895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:42.633194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:42.641463 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-776a13b7-ff4d-4cc5-85e5-c88e3e31efc7 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.159432 Aug 29 05:43:42.642043 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3613/7217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:42 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:43.662938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:43.663558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:43.670751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:43.671231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:43.671733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:43.672466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:43.672916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:43.673335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:43.805799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:43.814595 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-83648d24-33c4-45f5-a7ff-bb3ebf628f33 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.155697 Aug 29 05:43:43.815238 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3605/7218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:43 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:44.836459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:44.837286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:44.844621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:44.845112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:44.845560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:44.846285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:44.846754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:44.847195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:44.991111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:44.999386 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d0ca7acf-8265-406f-bf20-4a8ddabf8c9c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.166979 Aug 29 05:43:45.000015 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3614/7219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:44 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:46.021432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:46.021972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:46.029483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:46.029954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:46.030386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:46.031086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:46.031531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:46.031954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:46.167271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:46.175770 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7107a32c-298d-4168-9955-d24ea1473fa1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.158365 Aug 29 05:43:46.176361 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3606/7220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:46 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:47.197388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:47.198572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:47.206070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:47.206571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:47.207014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:47.207742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:47.208394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:47.209401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:47.354945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:47.364429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0bfe61de-df34-4caf-8ef5-96c625d78cf1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.170866 Aug 29 05:43:47.365306 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3615/7221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:47 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:48.386319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:48.386982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:48.394341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:48.394847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:48.395287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:48.395999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:48.396495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:48.396933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:48.484627 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:43:48.484828 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 (ip 10.222.0.20) !!! Aug 29 05:43:48.539450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:48.547839 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7083f283-c5ad-484b-878e-d1a2746b3f3d tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.165504 Aug 29 05:43:48.548434 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3607/7222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:48 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:49.569397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:49.570018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:49.578348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:49.578857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:49.579305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:49.580026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:49.580532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:49.580968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:49.714466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:49.722847 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-727e8ba7-dfd4-439b-bea2-e6025b849d94 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.157326 Aug 29 05:43:49.723433 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3616/7223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:49 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:50.745478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:50.746123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:50.753604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:50.754091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:50.754592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:50.755346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:50.755795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:50.756246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:50.897276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:50.907023 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8fcedef7-1c75-4479-b2d0-52147c2d97b1 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.166624 Aug 29 05:43:50.907649 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3608/7224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:50 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:51.931341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:51.931957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:51.939593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:51.940107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:51.940614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:51.941342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:51.941814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:51.942256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:52.090222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:52.099199 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3838d7e4-85e6-461f-86f7-de2d2114b130 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.171819 Aug 29 05:43:52.099760 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3617/7225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:51 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:53.121418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:53.122013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:53.129382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:53.129863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:53.130312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:53.131009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:53.131463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:53.131890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:53.270180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:53.278900 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-edebae47-6f22-4aca-ad92-5c850d29823f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.161822 Aug 29 05:43:53.279481 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3609/7226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:53 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:54.299578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:54.300223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:54.307612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:54.308113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:54.308606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:54.309306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:54.309772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:54.310204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:54.443510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:54.452325 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2fc5f77-1246-47d1-a24c-cb68afee7cfc tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.156411 Aug 29 05:43:54.452970 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3618/7227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:54 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:55.475309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:55.476348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:55.479378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=28 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:55.485112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:55.485608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:55.486043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:55.486752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:55.487211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:55.487634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:55.491032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=80 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:55.634804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:55.643684 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa356b27-63dd-46b2-be15-7af994102a5c tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.173154 Aug 29 05:43:55.644289 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3610/7228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:55 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:56.665280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:56.665854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:56.668649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=32 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:56.674044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:56.674552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:56.674973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:56.675676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:56.676137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:56.676690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:56.679513 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:43:56.814431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:56.822393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a976ed27-3c5e-4033-8e9c-cb24c1eb1154 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.161048 Aug 29 05:43:56.822938 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3619/7229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:56 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:57.844820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:57.845405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:57.852920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:57.853420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:57.853852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:57.854550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:57.855003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:57.855406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:57.990571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:57.998717 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cfe33bbd-8c89-4a4a-9e50-e6a589683a1f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1517 microversion: 2.1 time: 0.158556 Aug 29 05:43:57.999303 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3611/7230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:57 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:43:59.019482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:43:59.020113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:43:59.027443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:59.027947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:59.028420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:59.029139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:59.029581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:59.030042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:59.282887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:43:59.291079 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8361ad66-65fa-49b6-8150-8274d0a8fba3 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1516 microversion: 2.1 time: 0.275543 Aug 29 05:43:59.291667 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3620/7231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:43:59 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:43:59.472519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b390efb3-2a09-4fe4-ba5d-914af814c393 req-85b44e04-8b62-4413-b9e1-22aca5eba217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd98ee5-8dff-4b65-a15e-7a30297ae578", "name": "network-vif-unplugged", "status": "completed", "tag": "6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:43:59.484220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b390efb3-2a09-4fe4-ba5d-914af814c393 req-85b44e04-8b62-4413-b9e1-22aca5eba217 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:43:59.484746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b390efb3-2a09-4fe4-ba5d-914af814c393 req-85b44e04-8b62-4413-b9e1-22aca5eba217 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:43:59.485182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b390efb3-2a09-4fe4-ba5d-914af814c393 req-85b44e04-8b62-4413-b9e1-22aca5eba217 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:43:59.497553 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b390efb3-2a09-4fe4-ba5d-914af814c393 req-85b44e04-8b62-4413-b9e1-22aca5eba217 service nova] Creating event network-vif-unplugged:6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c for instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 on n-h1-854119-9 Aug 29 05:43:59.503213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-b390efb3-2a09-4fe4-ba5d-914af814c393 req-85b44e04-8b62-4413-b9e1-22aca5eba217 service nova] Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:43:59.515275 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b390efb3-2a09-4fe4-ba5d-914af814c393 req-85b44e04-8b62-4413-b9e1-22aca5eba217 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046802 Aug 29 05:43:59.515939 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3612/7232] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:44:00.326854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:00.327404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:00.335756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:00.336300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:00.336753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:00.337477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:00.337946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:00.338388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:00.473682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:00.482170 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22b7cd54-dabd-49bd-8f74-614958cc888a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1514 microversion: 2.1 time: 0.160163 Aug 29 05:44:00.482745 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3621/7233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:00 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:01.506197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:01.507012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:01.513812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:01.514304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:01.514739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:01.515482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:01.515989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:01.516448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:01.532350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8aaaa1f6-5b1f-43f9-9641-da2e5609afe8 req-9148c675-4d9c-4d45-b96b-f6ee3580fc47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd98ee5-8dff-4b65-a15e-7a30297ae578", "tag": "6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:44:01.542939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8aaaa1f6-5b1f-43f9-9641-da2e5609afe8 req-9148c675-4d9c-4d45-b96b-f6ee3580fc47 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:01.543435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8aaaa1f6-5b1f-43f9-9641-da2e5609afe8 req-9148c675-4d9c-4d45-b96b-f6ee3580fc47 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:01.544012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8aaaa1f6-5b1f-43f9-9641-da2e5609afe8 req-9148c675-4d9c-4d45-b96b-f6ee3580fc47 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:01.556511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8aaaa1f6-5b1f-43f9-9641-da2e5609afe8 req-9148c675-4d9c-4d45-b96b-f6ee3580fc47 service nova] Creating event network-changed:6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c for instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 on n-h1-854119-9 Aug 29 05:44:01.562633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-8aaaa1f6-5b1f-43f9-9641-da2e5609afe8 req-9148c675-4d9c-4d45-b96b-f6ee3580fc47 service nova] Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:44:01.574401 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8aaaa1f6-5b1f-43f9-9641-da2e5609afe8 req-9148c675-4d9c-4d45-b96b-f6ee3580fc47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045850 Aug 29 05:44:01.575211 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3622/7234] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:44:01.659178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:01.667509 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8097a878-9d75-455b-8039-c949f33ef87a tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1514 microversion: 2.1 time: 0.166923 Aug 29 05:44:01.668095 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3613/7235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:01 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:02.691153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:02.691857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:02.699500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:02.700081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:02.700557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:02.701269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:02.701709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:02.702196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:03.000373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:03.008759 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-14406fb8-f6e1-4c4e-84c0-f79d3ae50248 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1514 microversion: 2.1 time: 0.323191 Aug 29 05:44:03.009488 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3623/7236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:02 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:04.031877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:04.032587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:04.040445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:04.040946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:04.041392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:04.045768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:04.046255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:04.047044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:04.185277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:04.193981 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bb1caf81-5e22-42be-907c-15ba6a5bc330 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1511 microversion: 2.1 time: 0.166602 Aug 29 05:44:04.194551 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3614/7237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:04 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:04.215212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:04.215965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:04.223360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:04.223855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:04.224368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:04.225052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:04.225512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:04.226107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:04.253126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:44:04.305335 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Found an unconfirmed migration during delete, id: 16, status: finished Aug 29 05:44:05.839832 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a02a2034-44c9-4fb8-ad94-b08bd7684021 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 204 len: 0 microversion: 2.1 time: 1.628171 Aug 29 05:44:05.840629 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3624/7238] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:44:04 2022] DELETE /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 0 bytes in 1630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:44:05.849697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:05.850345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:05.857397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:05.857905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:05.858343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:05.859091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:05.859549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:05.860010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:05.995962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:06.003991 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c77ea473-8b7f-498d-bbdc-3abd9342e1de tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1503 microversion: 2.1 time: 0.158682 Aug 29 05:44:06.004630 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3615/7239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:05 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:06.343004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-423ae674-3e61-4703-b943-ce4065e69d41 req-943d7605-0948-4217-ad9b-a693e2eb2c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd98ee5-8dff-4b65-a15e-7a30297ae578", "name": "network-vif-plugged", "status": "completed", "tag": "6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:44:06.355351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-423ae674-3e61-4703-b943-ce4065e69d41 req-943d7605-0948-4217-ad9b-a693e2eb2c14 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:06.355848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-423ae674-3e61-4703-b943-ce4065e69d41 req-943d7605-0948-4217-ad9b-a693e2eb2c14 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:06.356317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-423ae674-3e61-4703-b943-ce4065e69d41 req-943d7605-0948-4217-ad9b-a693e2eb2c14 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:06.367715 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-423ae674-3e61-4703-b943-ce4065e69d41 req-943d7605-0948-4217-ad9b-a693e2eb2c14 service nova] Creating event network-vif-plugged:6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c for instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 on n-h1-854119-9 Aug 29 05:44:06.372803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-423ae674-3e61-4703-b943-ce4065e69d41 req-943d7605-0948-4217-ad9b-a693e2eb2c14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034196 Aug 29 05:44:06.373400 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3625/7240] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:44:07.025661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:07.026330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:07.033512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:07.034011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:07.034442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:07.035135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:07.035588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:07.036013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:07.170504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349841ce0d7f4bf1a45db37afcb250dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b80c483d8514443b0b3deaa5c8b7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:07.178641 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8291bf54-0419-469d-a9c6-89c678a37210 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 200 len: 1503 microversion: 2.1 time: 0.157018 Aug 29 05:44:07.179288 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3616/7241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:07 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:07.776518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8ad553fb-9562-465b-b616-5a6cffe0ee21 req-1341a20e-40f8-40f4-af27-ecfbb64e7e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd98ee5-8dff-4b65-a15e-7a30297ae578", "name": "network-vif-deleted", "tag": "6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:44:07.795760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8ad553fb-9562-465b-b616-5a6cffe0ee21 req-1341a20e-40f8-40f4-af27-ecfbb64e7e68 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:07.797005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8ad553fb-9562-465b-b616-5a6cffe0ee21 req-1341a20e-40f8-40f4-af27-ecfbb64e7e68 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:07.798050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8ad553fb-9562-465b-b616-5a6cffe0ee21 req-1341a20e-40f8-40f4-af27-ecfbb64e7e68 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:07.820016 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8ad553fb-9562-465b-b616-5a6cffe0ee21 req-1341a20e-40f8-40f4-af27-ecfbb64e7e68 service nova] Creating event network-vif-deleted:6ecaf4f8-c6c6-407d-ab0d-3aae3f31c22c for instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 on n-h1-854119-9 Aug 29 05:44:07.825628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8ad553fb-9562-465b-b616-5a6cffe0ee21 req-1341a20e-40f8-40f4-af27-ecfbb64e7e68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055717 Aug 29 05:44:07.826434 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3626/7242] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:44:08.201708 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:08.202321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:08.209676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:08.210164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:08.210599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:08.211305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:08.211767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:08.212213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:08.226149 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] HTTP exception thrown: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Request method failure captured: Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 HTTP/1.1 Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFH0-Z-uGlcXqNKZz4TtueShfzVHtDzKmyEvzGCnAL9klmWhztXnVVjmjATW29IwYRCJskAvUatBCqs6aQTCDfvg7AlwyfFW_HEW0nnPvY_ObavXFGbXANGYYRiO1apT0PY5vGjyzWdajBE225nXY_TQifkgNQxh9AjJOCyzO1BdQ8E Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3b80c483d8514443b0b3deaa5c8b7e3b Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-1149934303 Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b80c483d8514443b0b3deaa5c8b7e3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b80c483d8514443b0b3deaa5c8b7e3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b80c483d8514443b0b3deaa5c8b7e3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b80c483d8514443b0b3deaa5c8b7e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-1149934303 Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3b80c483d8514443b0b3deaa5c8b7e3b Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-1149934303 Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-1149934303-project Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 349841ce0d7f4bf1a45db37afcb250dc Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-1149934303-project Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'bfd98ee5-8dff-4b65-a15e-7a30297ae578'} Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:44:08.227828 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Returning 404 to user: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4105ca4f-d633-4158-aaec-445914213943 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 404 len: 111 microversion: 2.1 time: 0.031940 Aug 29 05:44:08.231956 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3617/7243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:08 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:44:08.251662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:08.252419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:08.259771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:08.260332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:08.260769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:08.261467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:08.261924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:08.262357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:08.276390 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] HTTP exception thrown: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Request method failure captured: Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 HTTP/1.1 Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFH0-Z-uGlcXqNKZz4TtueShfzVHtDzKmyEvzGCnAL9klmWhztXnVVjmjATW29IwYRCJskAvUatBCqs6aQTCDfvg7AlwyfFW_HEW0nnPvY_ObavXFGbXANGYYRiO1apT0PY5vGjyzWdajBE225nXY_TQifkgNQxh9AjJOCyzO1BdQ8E Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 3b80c483d8514443b0b3deaa5c8b7e3b Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-DeleteServersTestJSON-1149934303 Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b80c483d8514443b0b3deaa5c8b7e3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b80c483d8514443b0b3deaa5c8b7e3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b80c483d8514443b0b3deaa5c8b7e3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b80c483d8514443b0b3deaa5c8b7e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-DeleteServersTestJSON-1149934303 Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 3b80c483d8514443b0b3deaa5c8b7e3b Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1149934303 Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-DeleteServersTestJSON-1149934303-project Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 349841ce0d7f4bf1a45db37afcb250dc Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-DeleteServersTestJSON-1149934303-project Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'bfd98ee5-8dff-4b65-a15e-7a30297ae578'} Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:44:08.278082 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Returning 404 to user: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bb59931b-9aec-4854-bd6f-265eb2b35337 tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 404 len: 111 microversion: 2.1 time: 0.033776 Aug 29 05:44:08.282246 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3627/7244] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:44:08 2022] DELETE /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:44:08.288293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:08.288978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] [instance: bfd98ee5-8dff-4b65-a15e-7a30297ae578] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:08.295659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:08.296218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:08.296617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:08.297320 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:08.297779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:08.298208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:08.312518 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] HTTP exception thrown: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Request method failure captured: Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 HTTP/1.1 Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFH0-Z-uGlcXqNKZz4TtueShfzVHtDzKmyEvzGCnAL9klmWhztXnVVjmjATW29IwYRCJskAvUatBCqs6aQTCDfvg7AlwyfFW_HEW0nnPvY_ObavXFGbXANGYYRiO1apT0PY5vGjyzWdajBE225nXY_TQifkgNQxh9AjJOCyzO1BdQ8E Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3b80c483d8514443b0b3deaa5c8b7e3b Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-DeleteServersTestJSON-1149934303 Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b80c483d8514443b0b3deaa5c8b7e3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b80c483d8514443b0b3deaa5c8b7e3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b80c483d8514443b0b3deaa5c8b7e3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b80c483d8514443b0b3deaa5c8b7e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-DeleteServersTestJSON-1149934303 Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3b80c483d8514443b0b3deaa5c8b7e3b Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-DeleteServersTestJSON-1149934303 Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-DeleteServersTestJSON-1149934303-project Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 349841ce0d7f4bf1a45db37afcb250dc Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-DeleteServersTestJSON-1149934303-project Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'bfd98ee5-8dff-4b65-a15e-7a30297ae578'} Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:44:08.314103 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] Returning 404 to user: Instance bfd98ee5-8dff-4b65-a15e-7a30297ae578 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d6dc7ec8-e731-41a7-a615-8b22db15a57f tempest-DeleteServersTestJSON-1149934303 tempest-DeleteServersTestJSON-1149934303-project] 10.222.0.20 "GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578" status: 404 len: 111 microversion: 2.1 time: 0.031210 Aug 29 05:44:08.318149 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3618/7245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:08 2022] GET /compute/v2.1/servers/bfd98ee5-8dff-4b65-a15e-7a30297ae578 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:44:17.264815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1320068945", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "89fc5009-8cd4-4f76-97a8-a2e4552bd5bb"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:44:17.321563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] validate_networks() for [('89fc5009-8cd4-4f76-97a8-a2e4552bd5bb', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:44:17.722388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:44:17.723056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:44:17.723571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:44:17.723993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:44:17.724491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:44:17.733895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:17.734390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:17.734835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:17.735599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:17.736062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:17.738890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:17.755736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Getting quotas for project 3f054d3c2ac54e5f837d20eeeb394700. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:44:17.761497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Getting quotas for user e257b686a2ed45f9a1a2f3ec0bceab60 and project 3f054d3c2ac54e5f837d20eeeb394700. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:44:17.775548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:44:17.777999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:44:17.834477 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-84f9ad72-25c3-4129-9b2f-3f6134ad28ce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693397 Aug 29 05:44:17.841590 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3628/7246] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:44:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:44:17.853316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a9aa2806-9041-49e2-bc64-fbdb09600d16 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:17.859656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a9aa2806-9041-49e2-bc64-fbdb09600d16 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:17.924038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a9aa2806-9041-49e2-bc64-fbdb09600d16 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:17.932387 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a9aa2806-9041-49e2-bc64-fbdb09600d16 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1218 microversion: 2.1 time: 0.083095 Aug 29 05:44:17.934985 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3619/7247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:17 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:18.958998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:18.961055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:18.970349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:18.971384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:18.971890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:18.972931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:18.973646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:18.974308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:19.050871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:19.061069 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c013fed3-c51c-4d33-9f64-29d7e7f4f540 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1288 microversion: 2.1 time: 0.106853 Aug 29 05:44:19.061667 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3629/7248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:18 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:20.079840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=43 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:20.085521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:20.086353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:20.097303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:20.097986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:20.098591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:20.099541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:20.100151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:20.100776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:20.362520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:20.376868 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69a743cd-539b-4a0c-88d5-2997e6691d40 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1318 microversion: 2.1 time: 0.297767 Aug 29 05:44:20.377408 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3620/7249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:20 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:20.483034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-7369c5a8-78c4-4499-9ecc-4344dcabda7c req-d6a865d0-ba90-4002-b634-88e3c3ce8995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae015f1b-5c79-460f-bbac-c24fd8ebceca", "tag": "071b4e7e-2d01-4f8d-95b5-912d31518842"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:44:20.497894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7369c5a8-78c4-4499-9ecc-4344dcabda7c req-d6a865d0-ba90-4002-b634-88e3c3ce8995 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:20.498756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7369c5a8-78c4-4499-9ecc-4344dcabda7c req-d6a865d0-ba90-4002-b634-88e3c3ce8995 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:20.499265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-7369c5a8-78c4-4499-9ecc-4344dcabda7c req-d6a865d0-ba90-4002-b634-88e3c3ce8995 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:20.513690 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-7369c5a8-78c4-4499-9ecc-4344dcabda7c req-d6a865d0-ba90-4002-b634-88e3c3ce8995 service nova] Creating event network-changed:071b4e7e-2d01-4f8d-95b5-912d31518842 for instance ae015f1b-5c79-460f-bbac-c24fd8ebceca on n-h1-854119-9 Aug 29 05:44:20.522222 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-7369c5a8-78c4-4499-9ecc-4344dcabda7c req-d6a865d0-ba90-4002-b634-88e3c3ce8995 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042661 Aug 29 05:44:20.522896 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3630/7250] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:44:21.397618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:21.398242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:21.405500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:21.405995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:21.406428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:21.407125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:21.407574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:21.407998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:21.555838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:21.563849 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7d6795d-3e84-434c-baaa-5e9e13735be5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1318 microversion: 2.1 time: 0.170257 Aug 29 05:44:21.564454 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3621/7251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:21 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:22.589946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:22.590619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:22.598942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:22.599435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:22.599880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:22.600623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:22.601183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:22.601619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:22.748598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:22.759518 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ad57bf17-4262-4166-8084-dc7da4f31da4 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1318 microversion: 2.1 time: 0.178124 Aug 29 05:44:22.760079 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3631/7252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:22 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:23.781485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:23.782172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:23.792240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:23.792787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:23.793265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:23.794039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:23.794537 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:23.795004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:23.942132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:23.950946 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7cbbef3-4b11-42d6-8606-37b28b0b5c54 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1318 microversion: 2.1 time: 0.173919 Aug 29 05:44:23.951526 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3622/7253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:23 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:24.974284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:24.975218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:24.982635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:24.983134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:24.983574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:24.984310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:24.984773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:24.985200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:25.126470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:25.134391 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-184b0d5b-eb01-43d9-9610-932cc415998b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1318 microversion: 2.1 time: 0.166770 Aug 29 05:44:25.134949 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3632/7254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:24 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:26.154952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:26.155521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:26.158273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=28 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:26.164082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:26.164601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:26.165042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:26.165749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:26.166203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:26.166617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:26.325486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:26.333720 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3ca0e645-67d0-441b-8445-1793fa3be3ff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1318 microversion: 2.1 time: 0.182786 Aug 29 05:44:26.334254 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3623/7255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:26 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:27.358487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:27.359192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:27.363570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:27.370054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:27.370546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:27.370979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:27.371741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:27.372152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:27.372568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:27.376165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:27.508643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:27.517171 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3a4876fd-e562-497b-8841-d6c9093dcb85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1318 microversion: 2.1 time: 0.164948 Aug 29 05:44:27.517746 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3633/7256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:27 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:28.538366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:28.539560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:28.543351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:28.547618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:28.548104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:28.548555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:28.549249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:28.549694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:28.550115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:28.623603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-29e64506-6915-4d17-906a-a5d178ff87d1 req-8365f15c-cdf2-4890-a030-c978e4e019ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae015f1b-5c79-460f-bbac-c24fd8ebceca", "name": "network-vif-plugged", "status": "completed", "tag": "071b4e7e-2d01-4f8d-95b5-912d31518842"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:44:28.631032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:28.631974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:28.641350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-29e64506-6915-4d17-906a-a5d178ff87d1 req-8365f15c-cdf2-4890-a030-c978e4e019ca service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:28.642192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-29e64506-6915-4d17-906a-a5d178ff87d1 req-8365f15c-cdf2-4890-a030-c978e4e019ca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:28.642841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-29e64506-6915-4d17-906a-a5d178ff87d1 req-8365f15c-cdf2-4890-a030-c978e4e019ca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:28.663728 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-29e64506-6915-4d17-906a-a5d178ff87d1 req-8365f15c-cdf2-4890-a030-c978e4e019ca service nova] Creating event network-vif-plugged:071b4e7e-2d01-4f8d-95b5-912d31518842 for instance ae015f1b-5c79-460f-bbac-c24fd8ebceca on n-h1-854119-9 Aug 29 05:44:28.669028 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-29e64506-6915-4d17-906a-a5d178ff87d1 req-8365f15c-cdf2-4890-a030-c978e4e019ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049044 Aug 29 05:44:28.669652 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3634/7257] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:44:28.703993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:28.713149 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4dfeb7cd-5fc5-40b0-941b-20c008cf01da tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1318 microversion: 2.1 time: 0.179336 Aug 29 05:44:28.713738 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3624/7258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:28 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:29.740907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:29.741854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:29.748512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:29.749028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:29.749447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:29.750181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:29.750695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:29.751068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:29.881379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:29.889305 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cadd7bef-36c0-4564-9783-bf19239ae2d1 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1318 microversion: 2.1 time: 0.157116 Aug 29 05:44:29.889884 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3635/7259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:29 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:30.914243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:30.914956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:30.922490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:30.922982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:30.923415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:30.924140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:30.924606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:30.925067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.067895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:31.081068 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2e4006c8-a518-4511-99e7-608cded57239 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1507 microversion: 2.1 time: 0.172583 Aug 29 05:44:31.081973 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3625/7260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:30 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:31.102775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:31.103398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:31.110536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.111039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.111490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.112365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.112845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.113319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.242182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:31.250621 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9cd2ee4c-f06f-4caf-a842-c6eded53ea4e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1507 microversion: 2.1 time: 0.151799 Aug 29 05:44:31.251175 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3636/7261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:31 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:31.278849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8ff5ee1-d93d-4337-a4e4-ae0ec8272d98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:44:31.281363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f8ff5ee1-d93d-4337-a4e4-ae0ec8272d98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:31.288169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ff5ee1-d93d-4337-a4e4-ae0ec8272d98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.288680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ff5ee1-d93d-4337-a4e4-ae0ec8272d98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.289109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ff5ee1-d93d-4337-a4e4-ae0ec8272d98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.289798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ff5ee1-d93d-4337-a4e4-ae0ec8272d98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.290248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ff5ee1-d93d-4337-a4e4-ae0ec8272d98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.290772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8ff5ee1-d93d-4337-a4e4-ae0ec8272d98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.356981 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f8ff5ee1-d93d-4337-a4e4-ae0ec8272d98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "PUT /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1079 microversion: 2.1 time: 0.082177 Aug 29 05:44:31.357617 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3626/7262] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Aug 29 05:44:31 2022] PUT /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1079 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:31.374740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:31.375359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:31.381608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.382102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.382542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.383288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.383744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.384190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.529615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:31.540906 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-953df930-8173-4533-9e29-51e4e4f06bfd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1505 microversion: 2.1 time: 0.169990 Aug 29 05:44:31.541492 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3637/7263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:31 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:31.560761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:31.561378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:31.567610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.568097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.568558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.569349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.569760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.570183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.702114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:31.710070 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e04591ce-71a3-49a8-896b-a672053c548b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1505 microversion: 2.1 time: 0.153207 Aug 29 05:44:31.710614 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3627/7264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:31 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:31.730483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:44:31.732734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:31.738829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.739328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.739777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.740514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.740980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.741468 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.769948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:31.775920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Old instance type m1.heat2, new instance type m1.heat {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:44:31.782573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:44:31.783004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:44:31.783484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:44:31.783903 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:44:31.784359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:44:31.849671 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6e530080-320a-4dc5-bf27-462136ae1ccb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "POST /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca/action" status: 202 len: 0 microversion: 2.1 time: 0.123204 Aug 29 05:44:31.850284 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3638/7265] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:44:31 2022] POST /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:44:31.863291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:31.864158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:31.871028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.871518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.872025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:31.872840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:31.873293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:31.873717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:32.012658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:32.020578 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cd4a3b20-a355-465f-9535-ac1c52a9032a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1516 microversion: 2.1 time: 0.163311 Aug 29 05:44:32.021283 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3628/7266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:31 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:44:33.043495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:33.044101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:33.050748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:33.051246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:33.051691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:33.052434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:33.052897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:33.053331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:33.200662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:33.209298 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-288dd577-a6ad-4a8e-8833-5a67aa71bccc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1516 microversion: 2.1 time: 0.171119 Aug 29 05:44:33.209885 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3639/7267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:33 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:34.230736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:34.231361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:34.240945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:34.241540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:34.241986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:34.242711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:34.243171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:34.243605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:34.379216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:34.390486 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-835870b5-7b15-465d-934f-c0105abf48ec tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.163560 Aug 29 05:44:34.391340 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3629/7268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:34 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:35.416599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:35.417206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:35.424187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:35.424682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:35.425125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:35.425932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:35.426389 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:35.426817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:35.569632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:35.579945 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5456651b-6fbb-4b42-8036-19952758bd61 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.167609 Aug 29 05:44:35.580665 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3640/7269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:35 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:36.611445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:36.612456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:36.622035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:36.622854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:36.623322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:36.624238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:36.624776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:36.625298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:36.767736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:36.775805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-017cf645-223f-438d-a5e4-b8456f118d2e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.170958 Aug 29 05:44:36.776413 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3630/7270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:36 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:37.797669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:37.798312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:37.807371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:37.808454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:37.808819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:37.809821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:37.810592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:37.811267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:37.962961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:37.972911 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-352c654b-36d8-4841-bb70-eba7e6eca823 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.179210 Aug 29 05:44:37.973491 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3641/7271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:37 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:39.003715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:39.004896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:39.012007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:39.012502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:39.012968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:39.013671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:39.014122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:39.014551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:39.159371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:39.167820 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-758afbb2-2b59-4bbe-8702-752a2721a9b0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.172549 Aug 29 05:44:39.168952 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3631/7272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:38 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:40.189600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:40.190282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:40.197569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:40.198065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:40.198820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:40.199599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:40.200038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:40.200501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:40.338467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:40.346324 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-713f5cc1-1798-410f-bf01-6ce23c3afbd0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.160784 Aug 29 05:44:40.346937 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3642/7273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:40 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:41.368427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:41.369154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:41.375445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:41.375940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:41.376404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:41.377135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:41.377586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:41.378003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:41.522048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:41.530087 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ce0256aa-3cc1-490b-914f-c9b66e88f12c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.166110 Aug 29 05:44:41.530642 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3632/7274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:41 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:42.551603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:42.552330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:42.558703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:42.559207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:42.559698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:42.560395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:42.560866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:42.561306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:43.009545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:43.022102 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-21ec0b64-e5b3-4a14-9151-7f2ffa2f30d0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.474792 Aug 29 05:44:43.023369 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3643/7275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:42 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:44.046265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:44.046888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:44.055210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:44.055692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:44.056152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:44.056847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:44.057307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:44.057723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:44.204000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:44.212046 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2cc697e5-c9a5-40b9-8365-8cac60e73466 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.170683 Aug 29 05:44:44.212659 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3633/7276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:44 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:45.236972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:45.237593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:45.248073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:45.248808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:45.249433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:45.250401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:45.251029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:45.251685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:45.405609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:45.417932 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6426145c-e5a8-4a4a-a9e7-969879279950 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.187021 Aug 29 05:44:45.418580 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3644/7277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:45 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:46.444426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:46.445059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:46.453134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:46.453637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:46.454093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:46.454818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:46.455289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:46.455727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:46.610222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:46.618955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d27269b1-b0a1-410a-9dbb-deb6a4768b7a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.178896 Aug 29 05:44:46.619507 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3634/7278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:46 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:47.640348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:47.640958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:47.648739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:47.649275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:47.649769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:47.650539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:47.651109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:47.651587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:47.797531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:47.806073 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-546e2e0c-e21b-4d20-9605-3c881cb13b5a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.169698 Aug 29 05:44:47.806619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3645/7279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:47 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:48.844556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:48.845684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:48.854842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:48.855324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:48.855759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:48.856482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:48.856930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:48.857352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:48.994905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:49.000243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:49.006947 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13fa9f81-ea06-4cff-8aee-5d577171fda5 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.170872 Aug 29 05:44:49.007487 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3635/7280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:48 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:50.029175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:50.029739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:50.037815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:50.038374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:50.038874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:50.039654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:50.040178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:50.040694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:50.184545 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:50.193251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8f400ebc-0957-42fb-af8b-fed71fc6c4f0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.168840 Aug 29 05:44:50.193849 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3646/7281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:50 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:51.220906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:51.221997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:51.231301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:51.232082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:51.232547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:51.233232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:51.233741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:51.234161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:51.386779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:51.395282 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7c1f25da-02ab-4f10-a260-bd0633d5769d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.183003 Aug 29 05:44:51.395887 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3636/7282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:51 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:52.417515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:52.418129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:52.425601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:52.426103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:52.426555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:52.427261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:52.427730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:52.428214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:52.567518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:52.576837 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-79a95f2e-507c-441f-a3c5-bf0fab344ef6 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.163262 Aug 29 05:44:52.577399 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3647/7283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:52 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:53.601720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:53.602722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:53.614863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:53.615634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:53.616292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:53.616990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:53.617440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:53.617893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:53.757201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:53.768831 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b86f0022-8d2d-45d7-bfe7-379bf11c26aa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.173396 Aug 29 05:44:53.769512 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3637/7284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:53 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:54.792419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:54.792969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:54.800163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:54.800688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:54.801132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:54.801832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:54.802288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:54.802719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:54.945977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:54.954153 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44f1af63-d9f1-4709-9f7d-dcff711aa111 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.165853 Aug 29 05:44:54.954689 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3648/7285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:54 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:55.977808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:55.978720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:55.989371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:55.990064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:55.990806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:55.991514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:55.991963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:55.992416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:56.132753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:56.141342 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-85adda52-bb11-4baf-ba03-bc74c47372b2 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.169237 Aug 29 05:44:56.141929 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3638/7286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:55 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:57.162870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:57.163460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:57.170910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:57.171416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:57.171868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:57.172638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:57.173114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:57.173552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:57.176258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:57.315137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:57.328780 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5132a15a-e4cd-4de9-85a7-f4230e8098b3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.169634 Aug 29 05:44:57.329531 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3649/7287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:57 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:44:58.355462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:58.356534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:58.360879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=32 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:58.368344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:58.368823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:58.369248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:58.369932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:58.370376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:58.370793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:58.505205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:58.513249 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5e5fc2a-89f3-438e-8580-4930ac68165b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.164333 Aug 29 05:44:58.513836 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3639/7288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:58 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:44:59.534237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:44:59.534898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:44:59.538726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=38 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:44:59.542491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:59.543014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:59.543332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:59.544043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:44:59.544642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:44:59.544973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:44:59.685791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:44:59.694174 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c9373864-4316-4b6f-aaf3-5d8bb3fb0d12 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1521 microversion: 2.1 time: 0.163735 Aug 29 05:44:59.694757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3650/7289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:44:59 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:00.722709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:00.723316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:00.731405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:00.732058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:00.732598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:00.733307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:00.733761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:00.734188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:00.881307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:00.889371 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43637410-a7c5-478b-8b29-69e2727b6859 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1520 microversion: 2.1 time: 0.173147 Aug 29 05:45:00.889935 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3640/7290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:00 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:01.365089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-2caecc72-6499-4663-9052-af80c28e244a req-319b10a5-4bcd-4b46-9758-f069359f256e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae015f1b-5c79-460f-bbac-c24fd8ebceca", "name": "network-vif-unplugged", "status": "completed", "tag": "071b4e7e-2d01-4f8d-95b5-912d31518842"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:01.374972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2caecc72-6499-4663-9052-af80c28e244a req-319b10a5-4bcd-4b46-9758-f069359f256e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:01.375470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2caecc72-6499-4663-9052-af80c28e244a req-319b10a5-4bcd-4b46-9758-f069359f256e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:01.375945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-2caecc72-6499-4663-9052-af80c28e244a req-319b10a5-4bcd-4b46-9758-f069359f256e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:01.388358 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-2caecc72-6499-4663-9052-af80c28e244a req-319b10a5-4bcd-4b46-9758-f069359f256e service nova] Creating event network-vif-unplugged:071b4e7e-2d01-4f8d-95b5-912d31518842 for instance ae015f1b-5c79-460f-bbac-c24fd8ebceca on n-h2-854119-9 Aug 29 05:45:01.394814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-2caecc72-6499-4663-9052-af80c28e244a req-319b10a5-4bcd-4b46-9758-f069359f256e service nova] Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:45:01.407280 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-2caecc72-6499-4663-9052-af80c28e244a req-319b10a5-4bcd-4b46-9758-f069359f256e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118949 Aug 29 05:45:01.408038 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3651/7291] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:45:01.911334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:01.912643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:01.920070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:01.920617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:01.921057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:01.921792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:01.922242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:01.922670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:02.061962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:02.069966 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8dc40e21-187a-4435-8599-b6d54d74d709 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1520 microversion: 2.1 time: 0.162826 Aug 29 05:45:02.070654 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3641/7292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:01 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:03.096027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:03.097094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:03.105021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:03.105515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:03.105957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:03.106663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:03.107119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:03.107544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:03.263370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:03.271511 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a0dbd4a-3e21-4965-ad3f-8bb5ea72ae35 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1518 microversion: 2.1 time: 0.182322 Aug 29 05:45:03.272177 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3652/7293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:03 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:03.426295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-dfe5b029-af64-4569-872a-011a17a74a95 req-5d740c7d-154f-46d8-9dec-62e120645955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae015f1b-5c79-460f-bbac-c24fd8ebceca", "tag": "071b4e7e-2d01-4f8d-95b5-912d31518842"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:03.443344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dfe5b029-af64-4569-872a-011a17a74a95 req-5d740c7d-154f-46d8-9dec-62e120645955 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:03.444017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dfe5b029-af64-4569-872a-011a17a74a95 req-5d740c7d-154f-46d8-9dec-62e120645955 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:03.444636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-dfe5b029-af64-4569-872a-011a17a74a95 req-5d740c7d-154f-46d8-9dec-62e120645955 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:03.462476 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-dfe5b029-af64-4569-872a-011a17a74a95 req-5d740c7d-154f-46d8-9dec-62e120645955 service nova] Creating event network-changed:071b4e7e-2d01-4f8d-95b5-912d31518842 for instance ae015f1b-5c79-460f-bbac-c24fd8ebceca on n-h2-854119-9 Aug 29 05:45:03.468328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-dfe5b029-af64-4569-872a-011a17a74a95 req-5d740c7d-154f-46d8-9dec-62e120645955 service nova] Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:45:03.479490 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-dfe5b029-af64-4569-872a-011a17a74a95 req-5d740c7d-154f-46d8-9dec-62e120645955 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059744 Aug 29 05:45:03.480099 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3642/7294] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:45:04.298294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:04.299156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:04.307831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:04.308351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:04.308792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:04.309496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:04.309957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:04.310384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:04.452857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:04.463951 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3c87a0a5-4e6e-4956-bc5b-ce77bc4c004d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1518 microversion: 2.1 time: 0.173023 Aug 29 05:45:04.464636 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3653/7295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:04 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:05.503323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:05.504429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:05.512007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:05.512525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:05.512957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:05.513657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:05.514110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:05.514534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:05.652710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:05.660690 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ab9740e7-27ae-4478-a8f1-87806ba78ff9 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1515 microversion: 2.1 time: 0.165946 Aug 29 05:45:05.661280 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3643/7296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:05 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:05.681325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9a388633-bc05-4961-977d-df020de6d20c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:05.681885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9a388633-bc05-4961-977d-df020de6d20c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:05.689014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a388633-bc05-4961-977d-df020de6d20c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:05.689517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a388633-bc05-4961-977d-df020de6d20c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:05.689967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a388633-bc05-4961-977d-df020de6d20c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:05.690670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a388633-bc05-4961-977d-df020de6d20c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:05.691135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a388633-bc05-4961-977d-df020de6d20c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:05.691567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9a388633-bc05-4961-977d-df020de6d20c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:05.756845 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9a388633-bc05-4961-977d-df020de6d20c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "POST /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca/action" status: 204 len: 0 microversion: 2.1 time: 0.078888 Aug 29 05:45:05.757684 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3654/7297] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:45:05 2022] POST /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:45:05.767093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:05.767686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:05.774005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:05.774598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:05.774903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:05.775594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:05.776038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:05.776558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:06.043961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:06.052138 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c39dc782-f239-4eb7-9b45-09333afc5293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1515 microversion: 2.1 time: 0.289089 Aug 29 05:45:06.052751 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3644/7298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:05 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:45:07.074869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:07.075718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:07.082154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:07.082654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:07.083102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:07.083810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:07.084366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:07.084806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:07.225121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:07.233809 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8428ec4a-5f02-4318-aa89-7eb7038329f7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1507 microversion: 2.1 time: 0.164331 Aug 29 05:45:07.234459 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3655/7299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:07 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:07.254802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:07.255513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:07.263775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:07.264337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:07.264922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:07.265615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:07.266235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:07.266693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:07.402572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:07.413712 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ca3f6195-50c3-4721-84bd-0a3b910e1f3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1507 microversion: 2.1 time: 0.163013 Aug 29 05:45:07.414299 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3645/7300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:07 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:07.437353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-92dc277a-5698-4588-97f5-ce0ec7694503 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Action: 'create', calling method: .version_select at 0x7f1ab84b0ca0>, body: {"keypair": {"name": "tempest-keypair-1466188170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH3ovP3okx1SYu21oVToRBpkjBYeK71mtNoWvJBdyBVdmo8mL4qmxN6YkpZq1QdwpWvuD4OkIk0KH4u62X2AaSaJzfcbaQTdxZCmEO8/E+r7ZsDPIXJz7k+B2AjQPUogQ=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:07.454598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-92dc277a-5698-4588-97f5-ce0ec7694503 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Getting quotas for project 3f054d3c2ac54e5f837d20eeeb394700. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:45:07.460113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-92dc277a-5698-4588-97f5-ce0ec7694503 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Getting quotas for user e257b686a2ed45f9a1a2f3ec0bceab60 and project 3f054d3c2ac54e5f837d20eeeb394700. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:45:07.475239 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-92dc277a-5698-4588-97f5-ce0ec7694503 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [2986978a-48e4-4788-86ed-c5cccf08efe0] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 05:45:08.378066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-615bf643-313c-482f-89a4-d0854ec3dd5d req-56e020f1-4ecd-4065-9714-cd36819abc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae015f1b-5c79-460f-bbac-c24fd8ebceca", "name": "network-vif-plugged", "status": "completed", "tag": "071b4e7e-2d01-4f8d-95b5-912d31518842"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:08.389227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-615bf643-313c-482f-89a4-d0854ec3dd5d req-56e020f1-4ecd-4065-9714-cd36819abc61 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:08.389720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-615bf643-313c-482f-89a4-d0854ec3dd5d req-56e020f1-4ecd-4065-9714-cd36819abc61 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:08.390189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-615bf643-313c-482f-89a4-d0854ec3dd5d req-56e020f1-4ecd-4065-9714-cd36819abc61 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:08.402093 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-615bf643-313c-482f-89a4-d0854ec3dd5d req-56e020f1-4ecd-4065-9714-cd36819abc61 service nova] Creating event network-vif-plugged:071b4e7e-2d01-4f8d-95b5-912d31518842 for instance ae015f1b-5c79-460f-bbac-c24fd8ebceca on n-h2-854119-9 Aug 29 05:45:08.407586 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-615bf643-313c-482f-89a4-d0854ec3dd5d req-56e020f1-4ecd-4065-9714-cd36819abc61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033493 Aug 29 05:45:08.408455 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3646/7301] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:45:08.484214 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [None req-92dc277a-5698-4588-97f5-ce0ec7694503 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [2986978a-48e4-4788-86ed-c5cccf08efe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45876. Aug 29 05:45:08.502615 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-92dc277a-5698-4588-97f5-ce0ec7694503 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.069020 Aug 29 05:45:08.503233 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3656/7302] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:45:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:45:09.844173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:09.844874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:09.851380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:09.851864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:09.852340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:09.853037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:09.853489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:09.853912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:09.991360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:10.002510 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-366f6948-f947-440f-882c-5c00fa1dea8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 200 len: 1507 microversion: 2.1 time: 0.163598 Aug 29 05:45:10.003399 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3647/7303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:09 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:10.032668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:10.033217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:10.040444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:10.041017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:10.041563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:10.042353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:10.042920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:10.043449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:10.070999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:45:10.159541 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6a286f9a-33be-4b25-bce8-4c16589ceb6d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 204 len: 0 microversion: 2.1 time: 0.132786 Aug 29 05:45:10.160552 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3657/7304] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:45:10 2022] DELETE /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:45:10.228487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-331900308", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "89fc5009-8cd4-4f76-97a8-a2e4552bd5bb"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:10.292017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] validate_networks() for [('89fc5009-8cd4-4f76-97a8-a2e4552bd5bb', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:45:10.717864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:45:10.718268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:45:10.718741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:45:10.719176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:45:10.719588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:45:10.729193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:10.729714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:10.730148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:10.730871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:10.731325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:10.731744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:10.749032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Getting quotas for project 3f054d3c2ac54e5f837d20eeeb394700. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:45:10.754721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Getting quotas for user e257b686a2ed45f9a1a2f3ec0bceab60 and project 3f054d3c2ac54e5f837d20eeeb394700. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:45:10.768004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:45:10.770355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:45:10.817681 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b7252e4a-ab4a-4338-a529-0ab27f4e33c7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595177 Aug 29 05:45:10.818348 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3648/7305] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:45:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:45:10.830166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a63d788c-ca90-4dbd-9b6f-f87e03c7d5af tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:10.830881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a63d788c-ca90-4dbd-9b6f-f87e03c7d5af tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:10.890168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a63d788c-ca90-4dbd-9b6f-f87e03c7d5af tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:10.898020 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a63d788c-ca90-4dbd-9b6f-f87e03c7d5af tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1217 microversion: 2.1 time: 0.072178 Aug 29 05:45:10.898626 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3658/7306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:10 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:11.920541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:11.921134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:11.927588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:11.928137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:11.928580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:11.929270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:11.929722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:11.930135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:12.002036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:12.010228 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a5b6aba-30cc-4022-bec2-b0f1d9b19edb tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1269 microversion: 2.1 time: 0.094821 Aug 29 05:45:12.010816 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3649/7307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:11 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:12.221759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a9986ca3-e8bc-414f-ac76-cc92023dc2d0 req-67b0a3f7-20b0-4367-9254-85f62e04016f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae015f1b-5c79-460f-bbac-c24fd8ebceca", "name": "network-vif-deleted", "tag": "071b4e7e-2d01-4f8d-95b5-912d31518842"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:12.254726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9986ca3-e8bc-414f-ac76-cc92023dc2d0 req-67b0a3f7-20b0-4367-9254-85f62e04016f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:12.255911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9986ca3-e8bc-414f-ac76-cc92023dc2d0 req-67b0a3f7-20b0-4367-9254-85f62e04016f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:12.256536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9986ca3-e8bc-414f-ac76-cc92023dc2d0 req-67b0a3f7-20b0-4367-9254-85f62e04016f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:12.268032 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a9986ca3-e8bc-414f-ac76-cc92023dc2d0 req-67b0a3f7-20b0-4367-9254-85f62e04016f service nova] Creating event network-vif-deleted:071b4e7e-2d01-4f8d-95b5-912d31518842 for instance ae015f1b-5c79-460f-bbac-c24fd8ebceca on n-h2-854119-9 Aug 29 05:45:12.273803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a9986ca3-e8bc-414f-ac76-cc92023dc2d0 req-67b0a3f7-20b0-4367-9254-85f62e04016f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060069 Aug 29 05:45:12.274472 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3659/7308] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:45:13.033105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:13.033848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:13.041803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:13.042329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:13.042758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:13.043850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:13.044512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:13.044939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:13.227965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:13.238103 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f9d24aa0-0a3b-4cbd-bc39-4f139803153b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1317 microversion: 2.1 time: 0.208980 Aug 29 05:45:13.238836 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3650/7309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:13 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:14.261213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:14.262045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:14.270294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:14.270878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:14.271401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:14.272268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:14.273010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:14.273530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:14.320778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8069b75e-9bd8-4aaf-8b73-2a3ab4e65478 req-62b73f48-e85d-4342-8b22-4931411862a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6becb80-c5bb-43e1-943f-f73730cc8f09", "tag": "4187cded-644a-4c2b-9862-4f8d9ca42455"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:14.341126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8069b75e-9bd8-4aaf-8b73-2a3ab4e65478 req-62b73f48-e85d-4342-8b22-4931411862a9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:14.341969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8069b75e-9bd8-4aaf-8b73-2a3ab4e65478 req-62b73f48-e85d-4342-8b22-4931411862a9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:14.342740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8069b75e-9bd8-4aaf-8b73-2a3ab4e65478 req-62b73f48-e85d-4342-8b22-4931411862a9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:14.363689 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8069b75e-9bd8-4aaf-8b73-2a3ab4e65478 req-62b73f48-e85d-4342-8b22-4931411862a9 service nova] Creating event network-changed:4187cded-644a-4c2b-9862-4f8d9ca42455 for instance e6becb80-c5bb-43e1-943f-f73730cc8f09 on n-h2-854119-9 Aug 29 05:45:14.377696 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8069b75e-9bd8-4aaf-8b73-2a3ab4e65478 req-62b73f48-e85d-4342-8b22-4931411862a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066281 Aug 29 05:45:14.379231 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3651/7310] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:45:14.431523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:14.439800 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-032fd653-e1bc-4df3-ba83-6fb6c3149e82 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1317 microversion: 2.1 time: 0.183749 Aug 29 05:45:14.440499 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3660/7311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:14 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:15.461844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:15.462511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:15.470032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:15.470507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:15.470934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:15.471621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:15.472326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:15.472753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:15.607121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:15.615832 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d5fdd7c-4449-44eb-8523-d1f619de989e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1317 microversion: 2.1 time: 0.158419 Aug 29 05:45:15.616428 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3652/7312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:15 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:16.637010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:16.637579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:16.644961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:16.645457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:16.645891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:16.646760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:16.647370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:16.647986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:16.807338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:16.815236 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ea6546ce-53ef-4194-b559-26b8654dd079 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1317 microversion: 2.1 time: 0.182235 Aug 29 05:45:16.815954 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3661/7313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:16 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:17.838497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:17.839108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:17.846544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:17.847032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:17.847463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:17.848161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:17.848627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:17.849046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:17.982915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:17.991140 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8dcd849a-1055-4958-adae-2e0432c20df3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1317 microversion: 2.1 time: 0.156896 Aug 29 05:45:17.991724 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3653/7314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:17 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:19.017552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:19.018150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:19.025686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:19.026188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:19.026713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:19.027438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:19.027883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:19.028357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:19.164321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:19.172525 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4fb2f735-3053-4dbb-8637-de1d6d3551e7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1317 microversion: 2.1 time: 0.159204 Aug 29 05:45:19.173142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3662/7315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:19 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:20.194137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:20.194735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:20.202647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:20.202893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:20.203288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:20.203978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:20.204460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:20.204883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:20.346716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:20.352495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=100 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:45:20.358027 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-502dbd57-41f9-4f1e-81ba-024842717d77 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1317 microversion: 2.1 time: 0.168100 Aug 29 05:45:20.358863 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3654/7316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:20 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:20.411335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f77e745a-ebf0-4eac-b9be-d5282ee21897 req-5fd2f093-70da-4cb8-b794-544f4020b4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6becb80-c5bb-43e1-943f-f73730cc8f09", "name": "network-vif-plugged", "status": "completed", "tag": "4187cded-644a-4c2b-9862-4f8d9ca42455"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:20.424387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f77e745a-ebf0-4eac-b9be-d5282ee21897 req-5fd2f093-70da-4cb8-b794-544f4020b4ce service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:20.425501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f77e745a-ebf0-4eac-b9be-d5282ee21897 req-5fd2f093-70da-4cb8-b794-544f4020b4ce service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:20.425960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f77e745a-ebf0-4eac-b9be-d5282ee21897 req-5fd2f093-70da-4cb8-b794-544f4020b4ce service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:20.441797 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f77e745a-ebf0-4eac-b9be-d5282ee21897 req-5fd2f093-70da-4cb8-b794-544f4020b4ce service nova] Creating event network-vif-plugged:4187cded-644a-4c2b-9862-4f8d9ca42455 for instance e6becb80-c5bb-43e1-943f-f73730cc8f09 on n-h2-854119-9 Aug 29 05:45:20.447508 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f77e745a-ebf0-4eac-b9be-d5282ee21897 req-5fd2f093-70da-4cb8-b794-544f4020b4ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040534 Aug 29 05:45:20.448681 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3663/7317] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:45:21.377956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:45:21.378668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:45:21.384897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:21.385510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:21.393299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:21.393771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:21.394208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:21.394909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:21.395360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:21.395781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:21.534574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:21.542636 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9e514e24-2052-4f8f-b576-d187492c2fce tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1317 microversion: 2.1 time: 0.166113 Aug 29 05:45:21.543250 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3655/7318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:21 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:22.565114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:22.565773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:22.567917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:45:22.575148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:22.575638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:22.576079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:22.576811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:22.577369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:22.577786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:22.714104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:22.722648 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8b3ed52-9dcf-47eb-90c4-0dc5f6c912bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1507 microversion: 2.1 time: 0.161755 Aug 29 05:45:22.723227 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3664/7319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:22 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:22.743224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:22.743814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:22.751287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:22.751775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:22.752251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:22.752956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:22.753410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:22.753832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:22.886074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:22.894134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-92af4e41-8697-4de0-be25-00223df8e544 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1507 microversion: 2.1 time: 0.154929 Aug 29 05:45:22.894713 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3656/7320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:22 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:22.915720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:22.918000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:22.924397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:22.924892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:22.925333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:22.926032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:22.926487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:22.926914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:22.955701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:22.962934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Old instance type m1.heat2, new instance type m1.heat {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:45:22.970250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:45:22.970682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:45:22.971194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:45:22.971618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:45:22.972037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:45:23.001767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:45:23.038205 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d0c7e782-d9ad-44a8-a745-fea3a76bde85 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "POST /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09/action" status: 202 len: 0 microversion: 2.1 time: 0.126325 Aug 29 05:45:23.038820 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3665/7321] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:45:22 2022] POST /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:45:23.052197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:23.052439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:23.059112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:23.059625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:23.060036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:23.060777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:23.061228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:23.061651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:23.204307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:23.215708 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ddda25d5-c573-4be8-a0f1-11e0abfe88e8 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1514 microversion: 2.1 time: 0.167490 Aug 29 05:45:23.216620 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3657/7322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:23 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:24.237725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:24.238357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:24.246610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:24.247117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:24.247564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:24.248323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:24.248806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:24.249239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:24.454119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:24.464539 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2a4cf40c-b178-42fd-b996-97b94b3eb84a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1514 microversion: 2.1 time: 0.230383 Aug 29 05:45:24.465591 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3666/7323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:24 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:25.487193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:25.487818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:25.498381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:25.498883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:25.499349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:25.500042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:25.500498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:25.500924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:25.694556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:25.703390 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef49669c-1161-492e-8275-3bc8fba0abf7 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.220169 Aug 29 05:45:25.703980 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3658/7324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:25 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:26.725074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:26.725684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:26.733261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:26.733764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:26.734213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:26.734935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:26.735403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:26.735837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:26.880258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:26.888229 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cd33ed56-6642-4810-bc37-ee05affe1d44 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.167088 Aug 29 05:45:26.888800 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3667/7325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:26 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:27.909780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:27.910443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:27.918328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:27.918833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:27.919269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:27.919972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:27.920495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:27.920946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:28.070566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:28.079462 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-33fa9957-69ba-4843-a5ee-a33f07fe1cae tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.173669 Aug 29 05:45:28.080195 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3659/7326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:27 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:29.103110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:29.103844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:29.111283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:29.111852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:29.112329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:29.113028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:29.113585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:29.114012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:29.246960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:29.255532 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b6ec715-59bf-46c3-96e4-cc05e9b87e32 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.156802 Aug 29 05:45:29.256143 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3668/7327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:29 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:30.277521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:30.278127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:30.281638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:45:30.287759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:30.288267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:30.288698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:30.289401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:30.289847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:30.290270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:30.428937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:30.437509 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6a3c374-c04e-4f2b-ad8d-ca2857ec1c75 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.164254 Aug 29 05:45:30.438146 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3660/7328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:30 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:31.460033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:31.460683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:31.463819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:45:31.469258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:31.469753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:31.470197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:31.470904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:31.471392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:31.471801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:31.603281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:31.611379 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c7917bc-94c1-4187-8510-0ca00e2cb253 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.155327 Aug 29 05:45:31.611945 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3669/7329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:31 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:32.645351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:32.646396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:32.654204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:32.654689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:32.655120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:32.655811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:32.656299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:32.656723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:32.800595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:32.809316 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e6126ce-caf2-4b1a-bf34-876e589a2256 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.170604 Aug 29 05:45:32.809909 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3661/7330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:32 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:33.831478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:33.832062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:33.839521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:33.840017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:33.840496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:33.841184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:33.841643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:33.842068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:33.980897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:33.988979 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1f8de4f-cbe7-40ef-a0b7-f6961c97b7a0 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.161520 Aug 29 05:45:33.989587 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3670/7331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:33 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:35.010746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:35.011302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:35.018878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:35.019367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:35.019802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:35.020534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:35.021089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:35.021545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:35.172104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:35.184098 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f877f89e-fc5f-4933-b405-8de8defceb01 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.177260 Aug 29 05:45:35.184950 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3662/7332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:35 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:36.206678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:36.207415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:36.215963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:36.216586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:36.217116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:36.217939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:36.218487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:36.218993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:36.366995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:36.374962 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b87105dc-0b96-4a34-8590-7b5c64936721 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.172950 Aug 29 05:45:36.375540 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3671/7333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:36 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:45:37.395444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:37.396075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:37.403442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:37.403928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:37.404421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:37.405119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:37.405544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:37.405993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:37.540266 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:37.548400 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-236dd7df-f292-41d3-9b2c-cc28726f0d8f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.156889 Aug 29 05:45:37.548979 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3663/7334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:37 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:38.571099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:38.572439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:38.581055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:38.581847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:38.582572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:38.583596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:38.584108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:38.584627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:38.724025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:38.731812 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c8e82247-d3ec-4698-9f66-a276c7685293 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.165550 Aug 29 05:45:38.732505 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3672/7335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:38 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:39.753284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:39.753899 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:39.761460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:39.761956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:39.762391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:39.763102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:39.763561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:39.763985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:39.905445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:39.913662 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-41fcbc13-832b-4e54-9e01-d910c21c9254 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.164331 Aug 29 05:45:39.914241 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3664/7336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:39 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:40.935234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:40.935852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:40.943199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:40.943691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:40.944158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:40.944862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:40.945344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:40.945773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:41.089324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:41.101963 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e8405877-ceae-4280-9272-48c91d89b565 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.170497 Aug 29 05:45:41.102861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3673/7337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:40 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:42.130194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:42.130843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:42.138389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:42.138874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:42.139301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:42.139990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:42.140465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:42.140883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:42.281504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:42.293625 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2d2059cb-bb81-4f96-8803-506284614543 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.169286 Aug 29 05:45:42.294235 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3665/7338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:42 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:43.319501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:43.320202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:43.327884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:43.328402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:43.328841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:43.329538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:43.329979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:43.330408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:43.477521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:43.490271 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-34313f2f-8b0e-40fa-a892-7880e0c8f160 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.174740 Aug 29 05:45:43.491161 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3674/7339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:43 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:44.523956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:44.525096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:44.533764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:44.534245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:44.534669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:44.535360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:44.535807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:44.536245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:44.672094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:44.680402 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3b6d7e97-cc79-4a69-9b11-58fd0ccb7477 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.160941 Aug 29 05:45:44.681017 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3666/7340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:44 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:45.706046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:45.706694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:45.717322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:45.717946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:45.718531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:45.719589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:45.720271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:45.720785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:45.851084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:45.859207 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a99d9d6-dd00-4ae5-8342-58bdf3d567cc tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.159564 Aug 29 05:45:45.859804 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3675/7341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:45 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:46.880700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:46.881332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:46.889712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:46.890339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:46.890883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:46.891589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:46.892041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:46.892488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:47.037711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:47.046010 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-39cc6d9f-a791-4307-aab0-8a235b88d007 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.169305 Aug 29 05:45:47.046622 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3667/7342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:46 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:48.067585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:48.068311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:48.076303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:48.076797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:48.077235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:48.077938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:48.078396 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:48.078825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:48.222072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:48.230620 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc1bd32c-9b7f-4c40-900d-144a712974be tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.167087 Aug 29 05:45:48.231208 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3676/7343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:48 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:49.252183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:49.252776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:49.260316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:49.260808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:49.261238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:49.261935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:49.262383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:49.262802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:49.401900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:49.410585 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e9231ec2-70ca-4395-b507-fcfcdf297a90 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.162306 Aug 29 05:45:49.411180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3668/7344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:49 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:50.440838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:50.442128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:50.450851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:50.451357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:50.451786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:50.452539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:50.453001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:50.453453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:50.900108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:50.908483 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1115eed7-4820-441a-9421-781256677baa tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1519 microversion: 2.1 time: 0.478849 Aug 29 05:45:50.909172 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3677/7345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:50 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1519 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:51.929539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:51.930817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:51.938087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:51.938618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:51.939054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:51.939760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:51.940253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:51.940685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:51.945204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=85 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:45:52.169044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:52.177486 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6c9c715a-8713-4524-b7ad-aa0640b5f473 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1518 microversion: 2.1 time: 0.252091 Aug 29 05:45:52.191691 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3669/7346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:51 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1518 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:52.558697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-eec8c05b-dd7f-4528-8252-2c9c68667068 req-40f53035-a8ae-470a-a4a8-d5627ba25101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6becb80-c5bb-43e1-943f-f73730cc8f09", "name": "network-vif-unplugged", "status": "completed", "tag": "4187cded-644a-4c2b-9862-4f8d9ca42455"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:52.568776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eec8c05b-dd7f-4528-8252-2c9c68667068 req-40f53035-a8ae-470a-a4a8-d5627ba25101 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:52.569291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eec8c05b-dd7f-4528-8252-2c9c68667068 req-40f53035-a8ae-470a-a4a8-d5627ba25101 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:52.569708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-eec8c05b-dd7f-4528-8252-2c9c68667068 req-40f53035-a8ae-470a-a4a8-d5627ba25101 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:52.582747 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-eec8c05b-dd7f-4528-8252-2c9c68667068 req-40f53035-a8ae-470a-a4a8-d5627ba25101 service nova] Creating event network-vif-unplugged:4187cded-644a-4c2b-9862-4f8d9ca42455 for instance e6becb80-c5bb-43e1-943f-f73730cc8f09 on n-h1-854119-9 Aug 29 05:45:52.590414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-eec8c05b-dd7f-4528-8252-2c9c68667068 req-40f53035-a8ae-470a-a4a8-d5627ba25101 service nova] Instance e6becb80-c5bb-43e1-943f-f73730cc8f09 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:45:52.604674 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-eec8c05b-dd7f-4528-8252-2c9c68667068 req-40f53035-a8ae-470a-a4a8-d5627ba25101 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126715 Aug 29 05:45:52.605190 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3678/7347] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:45:53.200521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:53.201267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:53.208675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:53.209194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:53.209627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:53.210310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:53.210756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:53.211176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:53.344422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:53.352478 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-11e75de9-f844-40ad-bec1-dbc9d9f3e45e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1518 microversion: 2.1 time: 0.157272 Aug 29 05:45:53.353058 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3670/7348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:53 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:54.378900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:54.380422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:54.393085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:54.393914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:54.394670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:54.395918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:54.396421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:54.396859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:54.399527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:45:54.540001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:54.548214 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f1173eff-541f-4599-863d-2217b88f1c70 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1516 microversion: 2.1 time: 0.176679 Aug 29 05:45:54.548787 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3679/7349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:54 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:54.622211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d458e173-636b-477c-9027-4e397cf5357c req-9b848f10-8208-49b0-bb5a-62b042fc2f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6becb80-c5bb-43e1-943f-f73730cc8f09", "tag": "4187cded-644a-4c2b-9862-4f8d9ca42455"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:54.638064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d458e173-636b-477c-9027-4e397cf5357c req-9b848f10-8208-49b0-bb5a-62b042fc2f46 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:54.638607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d458e173-636b-477c-9027-4e397cf5357c req-9b848f10-8208-49b0-bb5a-62b042fc2f46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:54.639226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d458e173-636b-477c-9027-4e397cf5357c req-9b848f10-8208-49b0-bb5a-62b042fc2f46 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:54.657527 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d458e173-636b-477c-9027-4e397cf5357c req-9b848f10-8208-49b0-bb5a-62b042fc2f46 service nova] Creating event network-changed:4187cded-644a-4c2b-9862-4f8d9ca42455 for instance e6becb80-c5bb-43e1-943f-f73730cc8f09 on n-h1-854119-9 Aug 29 05:45:54.664528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-d458e173-636b-477c-9027-4e397cf5357c req-9b848f10-8208-49b0-bb5a-62b042fc2f46 service nova] Instance e6becb80-c5bb-43e1-943f-f73730cc8f09 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:45:54.675926 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d458e173-636b-477c-9027-4e397cf5357c req-9b848f10-8208-49b0-bb5a-62b042fc2f46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059400 Aug 29 05:45:54.676617 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3671/7350] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:45:55.570145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:55.570681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:55.578330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:55.578827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:55.579277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:55.579991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:55.580489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:55.580926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:55.718515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:55.728109 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c3dfdfb4-c190-469f-a939-97f6ba738cbf tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1516 microversion: 2.1 time: 0.162048 Aug 29 05:45:55.728740 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3680/7351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:55 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:56.750769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:56.751930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:56.762251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:56.762759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:56.763660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:56.763897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:56.764392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:56.764811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:56.997561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:57.006657 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bc07ce55-8a2b-4e28-80e8-3e2a54ed130b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1513 microversion: 2.1 time: 0.260639 Aug 29 05:45:57.016084 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3672/7352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:56 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1513 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:57.027265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06c2e2f9-e714-449f-9f01-2475c49c686a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:57.028049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-06c2e2f9-e714-449f-9f01-2475c49c686a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:57.036206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06c2e2f9-e714-449f-9f01-2475c49c686a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:57.036942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06c2e2f9-e714-449f-9f01-2475c49c686a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:57.037626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06c2e2f9-e714-449f-9f01-2475c49c686a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:57.038786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06c2e2f9-e714-449f-9f01-2475c49c686a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:57.038786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06c2e2f9-e714-449f-9f01-2475c49c686a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:57.038786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06c2e2f9-e714-449f-9f01-2475c49c686a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:57.102852 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06c2e2f9-e714-449f-9f01-2475c49c686a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "POST /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09/action" status: 204 len: 0 microversion: 2.1 time: 0.079380 Aug 29 05:45:57.103495 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3681/7353] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:45:57 2022] POST /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:45:57.112701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:57.113423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:57.119834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:57.120449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:57.120971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:57.121764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:57.122262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:57.122634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:57.262710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:57.272607 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-49443979-1f5e-4c1e-93d6-15150ce77699 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1513 microversion: 2.1 time: 0.163895 Aug 29 05:45:57.273341 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3673/7354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:57 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:58.296963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:58.298222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:58.306888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:58.307382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:58.307842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:58.308564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:58.309011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:58.309442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:58.450245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:58.458518 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-de061960-3d2f-4446-be4c-4ba1fa45bf3d tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1513 microversion: 2.1 time: 0.168365 Aug 29 05:45:58.459228 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3682/7355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:58 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:58.944990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-54b540a5-3ef1-4e44-a773-3e49f60e376c req-27d06b5b-3616-46dd-9452-f9ff017b4f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6becb80-c5bb-43e1-943f-f73730cc8f09", "name": "network-vif-plugged", "status": "completed", "tag": "4187cded-644a-4c2b-9862-4f8d9ca42455"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:45:58.957400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-54b540a5-3ef1-4e44-a773-3e49f60e376c req-27d06b5b-3616-46dd-9452-f9ff017b4f49 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:58.957881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-54b540a5-3ef1-4e44-a773-3e49f60e376c req-27d06b5b-3616-46dd-9452-f9ff017b4f49 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:58.958408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-54b540a5-3ef1-4e44-a773-3e49f60e376c req-27d06b5b-3616-46dd-9452-f9ff017b4f49 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:58.973163 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-54b540a5-3ef1-4e44-a773-3e49f60e376c req-27d06b5b-3616-46dd-9452-f9ff017b4f49 service nova] Creating event network-vif-plugged:4187cded-644a-4c2b-9862-4f8d9ca42455 for instance e6becb80-c5bb-43e1-943f-f73730cc8f09 on n-h1-854119-9 Aug 29 05:45:58.978356 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-54b540a5-3ef1-4e44-a773-3e49f60e376c req-27d06b5b-3616-46dd-9452-f9ff017b4f49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037177 Aug 29 05:45:58.979073 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3674/7356] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:45:59.483473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:59.484598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:59.495952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:59.496862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:59.497602 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:59.498770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:59.499540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:59.500312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:59.641881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:59.650206 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1acd7b25-37e0-4105-b3a6-a46e26e1524c tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1505 microversion: 2.1 time: 0.173250 Aug 29 05:45:59.650757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3683/7357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:59 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:59.674459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:59.675427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:59.682595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:59.683075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:59.683504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:59.684226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:59.684678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:59.685100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:59.831319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:45:59.839449 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a50b62f-e73e-459f-ac88-6eccc413bf6e tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1505 microversion: 2.1 time: 0.171908 Aug 29 05:45:59.840031 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3675/7358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:59 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:45:59.866420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:45:59.867045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:45:59.873481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:59.873985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:59.874424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:45:59.875139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:45:59.875598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:45:59.876025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:00.019784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:00.028228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7aaa5518-eba3-40a2-9c11-01d7b07163e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1505 microversion: 2.1 time: 0.167252 Aug 29 05:46:00.028764 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3684/7359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:45:59 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:00.048325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:00.049157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:00.056091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:00.056704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:00.057426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:00.058482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:00.059151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:00.059817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:00.089752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:46:00.171512 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0e629fc2-ac21-48d9-80ec-af8f4bcc2302 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 204 len: 0 microversion: 2.1 time: 0.126891 Aug 29 05:46:00.172143 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3676/7360] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:46:00 2022] DELETE /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:46:00.187148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:00.187687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:00.194021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:00.194524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:00.194965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:00.196553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:00.197161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:00.197634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:00.234048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:46:00.280456 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.compute.api [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Instance is already in deleting state, ignoring this request Aug 29 05:46:00.281204 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d53b5fe2-e9d3-4b3b-adc1-93a35dbf25bd tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 204 len: 0 microversion: 2.1 time: 0.098763 Aug 29 05:46:00.281771 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3685/7361] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:46:00 2022] DELETE /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:46:00.290568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:00.291290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:00.298132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:00.298618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:00.299051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:00.299751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:00.300230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:00.300650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:00.439315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:00.448043 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f0e7bbd7-d1d7-4cd5-8d27-a0973a99deff tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1511 microversion: 2.1 time: 0.161758 Aug 29 05:46:00.448953 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3677/7362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:00 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:01.469827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:01.470446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:01.478135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:01.478631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:01.479074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:01.479776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:01.480308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:01.480698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:01.636851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:01.647219 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b9152029-11a8-4b5a-891a-d618312ca5e3 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1511 microversion: 2.1 time: 0.180937 Aug 29 05:46:01.654612 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3686/7363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:01 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:02.119280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b19c7c1f-ae6d-47a7-af0d-8e8f70cc90bb req-e876c943-f792-4d37-8462-42d573ac1133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6becb80-c5bb-43e1-943f-f73730cc8f09", "name": "network-vif-deleted", "tag": "4187cded-644a-4c2b-9862-4f8d9ca42455"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:46:02.126733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:46:02.136078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b19c7c1f-ae6d-47a7-af0d-8e8f70cc90bb req-e876c943-f792-4d37-8462-42d573ac1133 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:02.136808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b19c7c1f-ae6d-47a7-af0d-8e8f70cc90bb req-e876c943-f792-4d37-8462-42d573ac1133 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:02.137250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b19c7c1f-ae6d-47a7-af0d-8e8f70cc90bb req-e876c943-f792-4d37-8462-42d573ac1133 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:02.151286 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b19c7c1f-ae6d-47a7-af0d-8e8f70cc90bb req-e876c943-f792-4d37-8462-42d573ac1133 service nova] Creating event network-vif-deleted:4187cded-644a-4c2b-9862-4f8d9ca42455 for instance e6becb80-c5bb-43e1-943f-f73730cc8f09 on n-h1-854119-9 Aug 29 05:46:02.158299 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b19c7c1f-ae6d-47a7-af0d-8e8f70cc90bb req-e876c943-f792-4d37-8462-42d573ac1133 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042846 Aug 29 05:46:02.158945 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3678/7364] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:46:02.667815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:02.668473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:02.671432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=36 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:46:02.677070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:02.677578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:02.678031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:02.678916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:02.679322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:02.679764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:02.715498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:02.716006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:02.716492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:02.716962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lazy-loading 'fault' on Instance uuid e6becb80-c5bb-43e1-943f-f73730cc8f09 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:46:02.761897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e257b686a2ed45f9a1a2f3ec0bceab60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f054d3c2ac54e5f837d20eeeb394700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:02.770281 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0808dfcb-4a7b-4829-9fe8-22089c597e9b tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 200 len: 1305 microversion: 2.1 time: 0.106581 Aug 29 05:46:02.770920 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3687/7365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:02 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:03.791946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:03.792658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: e6becb80-c5bb-43e1-943f-f73730cc8f09] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:03.800103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:03.800636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:03.801088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:03.801787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:03.802210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:03.802625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:03.816600 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] HTTP exception thrown: Instance e6becb80-c5bb-43e1-943f-f73730cc8f09 could not be found. Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Request method failure captured: Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 HTTP/1.1 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFIxl7azKIdWmTwm-y1PkHjK7pYZYx0fWl1qOucJ0SSwu3PLA6aL4RwkpPvPWh4MywPDK0xZ3ogVlxwz6n3z2WKzEIUvOVZ3juqYxHq9rEd26VUg-bPxDPmaU5JShpm8c6RSNxytLApWDUmI9jJGVHr4IxFZ-aaR74OzH7do884rC-4 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3f054d3c2ac54e5f837d20eeeb394700 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerDiskConfigTestJSON-39669068 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f054d3c2ac54e5f837d20eeeb394700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f054d3c2ac54e5f837d20eeeb394700"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f054d3c2ac54e5f837d20eeeb394700", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f054d3c2ac54e5f837d20eeeb394700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerDiskConfigTestJSON-39669068 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3f054d3c2ac54e5f837d20eeeb394700 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-39669068 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerDiskConfigTestJSON-39669068-project Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e257b686a2ed45f9a1a2f3ec0bceab60 Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerDiskConfigTestJSON-39669068-project Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance e6becb80-c5bb-43e1-943f-f73730cc8f09 could not be found. Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'e6becb80-c5bb-43e1-943f-f73730cc8f09'} Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6becb80-c5bb-43e1-943f-f73730cc8f09 could not be found. Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6becb80-c5bb-43e1-943f-f73730cc8f09 could not be found. Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:46:03.818399 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6becb80-c5bb-43e1-943f-f73730cc8f09 could not be found. Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Returning 404 to user: Instance e6becb80-c5bb-43e1-943f-f73730cc8f09 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d3f9bc46-0128-4956-9b1e-474247a2bf3a tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09" status: 404 len: 111 microversion: 2.1 time: 0.032196 Aug 29 05:46:03.823045 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3679/7366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:03 2022] GET /compute/v2.1/servers/e6becb80-c5bb-43e1-943f-f73730cc8f09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:46:03.829658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17d3298f-c9fd-4536-a274-46ba63849b98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '.version_select at 0x7f1abd81d3a0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:03.850373 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17d3298f-c9fd-4536-a274-46ba63849b98 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466188170" status: 202 len: 0 microversion: 2.1 time: 0.024771 Aug 29 05:46:03.850931 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3688/7367] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 29 05:46:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466188170 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:46:04.486257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:04.486759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:04.493123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:04.493615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:04.494050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:04.494752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:04.495213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:04.495636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:04.510388 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] HTTP exception thrown: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Request method failure captured: Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca HTTP/1.1 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFIxl7azKIdWmTwm-y1PkHjK7pYZYx0fWl1qOucJ0SSwu3PLA6aL4RwkpPvPWh4MywPDK0xZ3ogVlxwz6n3z2WKzEIUvOVZ3juqYxHq9rEd26VUg-bPxDPmaU5JShpm8c6RSNxytLApWDUmI9jJGVHr4IxFZ-aaR74OzH7do884rC-4 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 3f054d3c2ac54e5f837d20eeeb394700 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerDiskConfigTestJSON-39669068 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f054d3c2ac54e5f837d20eeeb394700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f054d3c2ac54e5f837d20eeeb394700"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f054d3c2ac54e5f837d20eeeb394700", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f054d3c2ac54e5f837d20eeeb394700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerDiskConfigTestJSON-39669068 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 3f054d3c2ac54e5f837d20eeeb394700 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-39669068 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerDiskConfigTestJSON-39669068-project Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: e257b686a2ed45f9a1a2f3ec0bceab60 Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerDiskConfigTestJSON-39669068-project Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'ae015f1b-5c79-460f-bbac-c24fd8ebceca'} Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:46:04.511957 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Returning 404 to user: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d2f6d1d7-c970-4dab-852a-8a9026943500 tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 404 len: 111 microversion: 2.1 time: 0.031167 Aug 29 05:46:04.516233 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3680/7368] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:46:04 2022] DELETE /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:46:04.522280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:04.522910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] [instance: ae015f1b-5c79-460f-bbac-c24fd8ebceca] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:04.529810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:04.530309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:04.530758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:04.531466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:04.531937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:04.532397 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:04.545879 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] HTTP exception thrown: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Request method failure captured: Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca HTTP/1.1 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFIxl7azKIdWmTwm-y1PkHjK7pYZYx0fWl1qOucJ0SSwu3PLA6aL4RwkpPvPWh4MywPDK0xZ3ogVlxwz6n3z2WKzEIUvOVZ3juqYxHq9rEd26VUg-bPxDPmaU5JShpm8c6RSNxytLApWDUmI9jJGVHr4IxFZ-aaR74OzH7do884rC-4 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 3f054d3c2ac54e5f837d20eeeb394700 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerDiskConfigTestJSON-39669068 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f054d3c2ac54e5f837d20eeeb394700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f054d3c2ac54e5f837d20eeeb394700"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f054d3c2ac54e5f837d20eeeb394700", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f054d3c2ac54e5f837d20eeeb394700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerDiskConfigTestJSON-39669068 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 3f054d3c2ac54e5f837d20eeeb394700 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-39669068 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerDiskConfigTestJSON-39669068-project Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: e257b686a2ed45f9a1a2f3ec0bceab60 Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerDiskConfigTestJSON-39669068-project Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'ae015f1b-5c79-460f-bbac-c24fd8ebceca'} Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:46:04.547599 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] Returning 404 to user: Instance ae015f1b-5c79-460f-bbac-c24fd8ebceca could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-55be135f-bd79-4589-b610-5f835339389f tempest-ServerDiskConfigTestJSON-39669068 tempest-ServerDiskConfigTestJSON-39669068-project] 10.222.0.20 "GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca" status: 404 len: 111 microversion: 2.1 time: 0.030843 Aug 29 05:46:04.551237 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3689/7369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:04 2022] GET /compute/v2.1/servers/ae015f1b-5c79-460f-bbac-c24fd8ebceca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:46:13.954443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93358cf2-b18a-4e36-a524-95090019797a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'create', calling method: .version_select at 0x7f1ab814fdc0>, body: {"keypair": {"name": "tempest-keypair-349192370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcpCValIO56lvmBx/2uvtsDrMUEKKcCXNPIWgQBXNHjQh+YPtacoM9RH6LjipRnMGU44cqdAzObjMjIoWqsrBcUvXyqrJzcCFKiBTs8cd0QEnda0B9qY9HfTcKqfiWWlA=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:46:13.971965 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-93358cf2-b18a-4e36-a524-95090019797a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for project 6078095aa4044d27813d2b678396a21e. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:46:13.977664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-93358cf2-b18a-4e36-a524-95090019797a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for user bbc2df5c46bd4c629906f7da08f694e5 and project 6078095aa4044d27813d2b678396a21e. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:46:14.011647 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-93358cf2-b18a-4e36-a524-95090019797a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.207366 Aug 29 05:46:14.012313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3681/7370] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:46:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:46:15.355055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2041257612", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c1d24f6-b96a-4519-80f0-d994c365cbd4"}], "security_groups": [{"name": "tempest-securitygroup--1422042689"}], "key_name": "tempest-keypair-349192370", "user_data": "}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:46:15.364331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:46:15.365019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:46:15.469199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] validate_networks() for [('5c1d24f6-b96a-4519-80f0-d994c365cbd4', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:46:15.862048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:46:15.862489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:46:15.862993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:46:15.863407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:46:15.864214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:46:15.874599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:15.875612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:15.876324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:15.877331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:15.878285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:15.878954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:15.909976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:46:15.917446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for user bbc2df5c46bd4c629906f7da08f694e5 and project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:46:15.930772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:46:15.933211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:46:15.983238 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fdc82cae-dfe7-43aa-9385-5260bfd9b0bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.632138 Aug 29 05:46:15.984296 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3690/7371] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:46:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:46:15.996189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8a26070-9836-458a-99df-b8124c1410fd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:15.996940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f8a26070-9836-458a-99df-b8124c1410fd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:16.004040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:46:16.079155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f8a26070-9836-458a-99df-b8124c1410fd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:16.089550 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f8a26070-9836-458a-99df-b8124c1410fd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1238 microversion: 2.1 time: 0.098565 Aug 29 05:46:16.090343 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3682/7372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:15 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:17.112091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:17.112754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:17.120497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:17.121012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:17.121454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:17.122170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:17.122830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:17.123269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:17.191831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:17.201374 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83071681-7932-4515-afd7-fdce72004494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1290 microversion: 2.1 time: 0.093966 Aug 29 05:46:17.201988 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3691/7373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:17 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:18.226963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:18.228941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:18.239117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:18.239919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:18.240529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:18.241483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:18.242173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:18.242783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:18.391193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:18.401817 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d710584-b4b4-4f2e-8c01-8e03aa700688 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1364 microversion: 2.1 time: 0.182508 Aug 29 05:46:18.402559 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3683/7374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:18 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:18.866390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-58284242-6d1c-4bee-8ff5-ead5fdcf36f9 req-44e75b83-0e53-4593-8861-e2cd00bba60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d598dd3e-0a49-4c1b-bdc7-8792e2208e71", "tag": "d2dab797-0a2d-468c-be65-d8233ba0abd0"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:46:18.872833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-58284242-6d1c-4bee-8ff5-ead5fdcf36f9 req-44e75b83-0e53-4593-8861-e2cd00bba60a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:18.873561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-58284242-6d1c-4bee-8ff5-ead5fdcf36f9 req-44e75b83-0e53-4593-8861-e2cd00bba60a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:18.874086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-58284242-6d1c-4bee-8ff5-ead5fdcf36f9 req-44e75b83-0e53-4593-8861-e2cd00bba60a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:18.886429 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-58284242-6d1c-4bee-8ff5-ead5fdcf36f9 req-44e75b83-0e53-4593-8861-e2cd00bba60a service nova] Creating event network-changed:d2dab797-0a2d-468c-be65-d8233ba0abd0 for instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 on n-h2-854119-9 Aug 29 05:46:18.892360 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-58284242-6d1c-4bee-8ff5-ead5fdcf36f9 req-44e75b83-0e53-4593-8861-e2cd00bba60a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035745 Aug 29 05:46:18.893337 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3692/7375] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:46:19.434422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:19.435098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:19.443186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:19.443644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:19.444083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:19.444832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:19.445290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:19.445718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:19.589104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:19.597248 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2afe9c28-8321-414a-813d-70d6121d5d43 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1364 microversion: 2.1 time: 0.166896 Aug 29 05:46:19.598011 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3684/7376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:19 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:20.621721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:20.622908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:20.632653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:20.633162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:20.633609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:20.634336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:20.634815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:20.635229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:20.781927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:20.793512 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-35bb7f4e-bb72-4a63-b3ae-047294b63236 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1364 microversion: 2.1 time: 0.178258 Aug 29 05:46:20.794118 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3693/7377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:20 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:21.818703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:21.819410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:21.827438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:21.828011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:21.828471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:21.829342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:21.829823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:21.830573 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:21.977784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:21.987329 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47639dba-c46d-4df8-a11b-0c9a341edab5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1364 microversion: 2.1 time: 0.173011 Aug 29 05:46:21.988263 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3685/7378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:21 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:23.010857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:23.011909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:23.019614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:23.020215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:23.020660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:23.021379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:23.021880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:23.022294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:23.175261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:23.185859 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5aa53c31-7060-4817-a2fc-2d27a63ce377 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1364 microversion: 2.1 time: 0.180062 Aug 29 05:46:23.186534 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3694/7379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:23 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:24.208147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:24.208943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:24.216654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:24.217331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:24.217779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:24.218498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:24.218953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:24.219381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:24.369455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:24.381130 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d9a88328-49e1-4dcc-9168-4ca5eca0b268 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1364 microversion: 2.1 time: 0.176625 Aug 29 05:46:24.382016 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3686/7380] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:24 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:24.855497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ee68aaeb-d2c7-47f3-9d38-18327970177d req-6cc4fc64-88b2-4a75-a86e-ada88cd6c6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d598dd3e-0a49-4c1b-bdc7-8792e2208e71", "name": "network-vif-plugged", "status": "completed", "tag": "d2dab797-0a2d-468c-be65-d8233ba0abd0"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:46:24.866985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ee68aaeb-d2c7-47f3-9d38-18327970177d req-6cc4fc64-88b2-4a75-a86e-ada88cd6c6d6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:24.867473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ee68aaeb-d2c7-47f3-9d38-18327970177d req-6cc4fc64-88b2-4a75-a86e-ada88cd6c6d6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:24.867914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ee68aaeb-d2c7-47f3-9d38-18327970177d req-6cc4fc64-88b2-4a75-a86e-ada88cd6c6d6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:24.882473 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ee68aaeb-d2c7-47f3-9d38-18327970177d req-6cc4fc64-88b2-4a75-a86e-ada88cd6c6d6 service nova] Creating event network-vif-plugged:d2dab797-0a2d-468c-be65-d8233ba0abd0 for instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 on n-h2-854119-9 Aug 29 05:46:24.893332 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ee68aaeb-d2c7-47f3-9d38-18327970177d req-6cc4fc64-88b2-4a75-a86e-ada88cd6c6d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041531 Aug 29 05:46:24.894113 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3695/7381] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:46:25.406347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:25.406935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:25.414653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:25.415177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:25.415587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:25.416349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:25.416805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:25.417232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:25.557729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:25.566955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bbd2cdf3-d75d-4e81-9fb1-87b0ce5eed85 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1364 microversion: 2.1 time: 0.164609 Aug 29 05:46:25.567521 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3687/7382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:25 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:26.588610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:46:26.589856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:46:26.594685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:26.595751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:26.603234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:26.603738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:26.604185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:26.604968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:26.605385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:26.605815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:26.745698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:46:26.754567 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9b8d089a-64b9-4f4a-ac87-8f42966c34f0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1551 microversion: 2.1 time: 0.167744 Aug 29 05:46:26.755758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3696/7383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:46:26 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:46:26.775298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-62c69a1e-2372-4408-be2a-51c075d8e0ad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:46:26.775886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-62c69a1e-2372-4408-be2a-51c075d8e0ad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:46:26.778724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:46:26.786753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c69a1e-2372-4408-be2a-51c075d8e0ad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:26.787278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c69a1e-2372-4408-be2a-51c075d8e0ad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:26.787707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c69a1e-2372-4408-be2a-51c075d8e0ad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:26.788451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c69a1e-2372-4408-be2a-51c075d8e0ad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:26.788905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c69a1e-2372-4408-be2a-51c075d8e0ad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:26.789330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-62c69a1e-2372-4408-be2a-51c075d8e0ad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:26.875641 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-62c69a1e-2372-4408-be2a-51c075d8e0ad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104286 Aug 29 05:46:26.876287 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3688/7384] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:46:26 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:46:28.198002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b1c2be4b-1213-4224-bd1f-10eef1c84510 req-c217decb-3377-4f43-9256-b1a4b1660e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d598dd3e-0a49-4c1b-bdc7-8792e2208e71", "tag": "d2dab797-0a2d-468c-be65-d8233ba0abd0"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:46:28.208755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b1c2be4b-1213-4224-bd1f-10eef1c84510 req-c217decb-3377-4f43-9256-b1a4b1660e66 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:46:28.209325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b1c2be4b-1213-4224-bd1f-10eef1c84510 req-c217decb-3377-4f43-9256-b1a4b1660e66 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:46:28.209768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b1c2be4b-1213-4224-bd1f-10eef1c84510 req-c217decb-3377-4f43-9256-b1a4b1660e66 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:46:28.221066 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b1c2be4b-1213-4224-bd1f-10eef1c84510 req-c217decb-3377-4f43-9256-b1a4b1660e66 service nova] Creating event network-changed:d2dab797-0a2d-468c-be65-d8233ba0abd0 for instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 on n-h2-854119-9 Aug 29 05:46:28.226272 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b1c2be4b-1213-4224-bd1f-10eef1c84510 req-c217decb-3377-4f43-9256-b1a4b1660e66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031915 Aug 29 05:46:28.227109 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3697/7385] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:47:43.617259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:47:43.618290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=34 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:47:43.619451 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 05:47:43.626406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:43.627044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:43.635354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:43.635832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:43.636289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:43.636977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:43.637424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:43.637841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:43.780483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:43.792508 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-889a3af4-ac06-4e24-b5ab-d0b66058c97b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1669 microversion: 2.1 time: 0.177481 Aug 29 05:47:43.793393 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3689/7386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:43 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:43.812430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:47:43.813209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=32 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:47:43.818471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:43.819214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:43.827211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:43.827706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:43.828154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:43.828878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:43.829337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:43.829753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:43.963139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:43.971344 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6c06d597-5bf6-4cc8-8740-c1a6ae6610c0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1669 microversion: 2.1 time: 0.161931 Aug 29 05:47:43.971919 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3698/7387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:43 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:43.991809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:43.992595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:43.998983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:43.999469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:43.999902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:44.000749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:44.001210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:44.001709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:44.142968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:44.151183 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-64b4b142-645a-4167-973c-e35a1ef8132d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1669 microversion: 2.1 time: 0.163146 Aug 29 05:47:44.151665 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3690/7388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:43 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:44.174215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:47:44.176514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:44.182902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:44.183401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:44.183850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:44.184601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:44.185068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:44.185502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:44.214444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:44.220662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Old instance type m1.heat2, new instance type m1.heat {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:47:44.227409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:47:44.227840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:47:44.228362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:47:44.228778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:47:44.229197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:47:44.298251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ff0a637d-6b01-4728-aca3-dc17226927bc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71/action" status: 202 len: 0 microversion: 2.1 time: 0.128070 Aug 29 05:47:44.298866 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3699/7389] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:47:44 2022] POST /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:47:44.307379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:44.308337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:44.314734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:44.315277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:44.315721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:44.316458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:44.316917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:44.317342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:44.455257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:44.463388 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0c719d21-58e8-428a-85f3-894bbfa2bd57 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1678 microversion: 2.1 time: 0.159903 Aug 29 05:47:44.464068 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3691/7390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:44 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:45.485771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:45.486393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:45.493810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:45.494530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:45.495163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:45.495872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:45.496377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:45.496800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:45.629427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:45.637507 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2bd3080b-5d84-4455-9549-0603c6763797 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1678 microversion: 2.1 time: 0.156517 Aug 29 05:47:45.638069 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3700/7391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:45 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:46.660420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:46.661052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:46.668360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:46.668852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:46.669282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:46.669979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:46.670430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:46.670856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:46.809007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:46.817233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-028e9546-c530-4db0-b8d5-cb4bca7aba16 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.161612 Aug 29 05:47:46.817844 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3692/7392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:46 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:47.840230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:47.840875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:47.848232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:47.848742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:47.849220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:47.849931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:47.850398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:47.850832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:47.990407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:47.999428 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa48be36-5923-43fc-a381-a108bb4d2dad tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.163189 Aug 29 05:47:48.000047 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3701/7393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:47 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:49.022264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:49.022861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:49.030344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:49.031003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:49.031629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:49.032754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:49.033428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:49.034079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:49.176982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:49.188209 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8ef6febb-c021-4549-b8fc-1cf2b6bc60cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.169745 Aug 29 05:47:49.189051 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3693/7394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:49 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:50.217802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:50.218390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:50.225479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:50.225969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:50.226411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:50.227105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:50.227569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:50.227996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:50.365763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:50.373780 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e3687ed6-e8a1-48b9-8636-72322a62b6e5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.160130 Aug 29 05:47:50.374401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3702/7395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:50 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:51.395629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:51.396274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:51.403445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:51.403932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:51.404397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:51.405102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:51.405553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:51.405990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:51.538467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:51.546439 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5b3495af-c92d-4c62-8043-4fc58586786c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.154946 Aug 29 05:47:51.546977 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3694/7396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:51 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:52.567245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:52.567831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:52.575411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:52.575915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:52.576393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:52.577103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:52.577568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:52.578000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:52.714886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:52.723255 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-27fe96da-29b4-4407-bec9-5924778e5390 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.160098 Aug 29 05:47:52.724032 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3703/7397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:52 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:53.745336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:53.745988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:53.753489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:53.753980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:53.754417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:53.755130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:53.755565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:53.755986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:53.897057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:53.905405 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-797a5137-3720-4dcb-9c74-bf0ec6591c95 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.164100 Aug 29 05:47:53.905983 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3695/7398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:53 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:54.927009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:54.927595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:54.935198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:54.935783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:54.936464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:54.937242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:54.937811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:54.938415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:55.078817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:55.087442 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f6a5618e-502e-4b9d-b461-49c7ee8f5532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.164299 Aug 29 05:47:55.088029 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3704/7399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:54 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:56.109690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:56.110288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:56.117694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:56.118206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:56.118704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:56.119329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:56.119775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:56.120207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:56.252809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:56.261067 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-87319720-07cf-4410-8347-91a3568af979 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.155386 Aug 29 05:47:56.261678 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3696/7400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:56 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:57.282684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:57.283291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:57.291643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:57.292177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:57.292656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:57.293383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:57.294048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:57.294771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:57.432149 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:57.440166 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-81e87dc2-1040-4afc-9f9c-3b0cba9f2bdc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.161405 Aug 29 05:47:57.440750 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3705/7401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:57 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:58.465314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:58.465964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:58.472937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:58.473397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:58.473829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:58.474531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:58.474985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:58.475413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:58.609420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:58.617575 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc72e830-9699-43df-bd63-76c860f53f25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1683 microversion: 2.1 time: 0.158556 Aug 29 05:47:58.618167 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3697/7402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:58 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:47:59.085589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0a1083dd-b70b-4f91-af63-dbd9119a3b36 req-66e43c9f-e0c6-48b6-9571-524c5ea0b9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d598dd3e-0a49-4c1b-bdc7-8792e2208e71", "name": "network-vif-unplugged", "status": "completed", "tag": "d2dab797-0a2d-468c-be65-d8233ba0abd0"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:47:59.096867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0a1083dd-b70b-4f91-af63-dbd9119a3b36 req-66e43c9f-e0c6-48b6-9571-524c5ea0b9a9 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:59.097357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0a1083dd-b70b-4f91-af63-dbd9119a3b36 req-66e43c9f-e0c6-48b6-9571-524c5ea0b9a9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:59.097804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0a1083dd-b70b-4f91-af63-dbd9119a3b36 req-66e43c9f-e0c6-48b6-9571-524c5ea0b9a9 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:59.119251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0a1083dd-b70b-4f91-af63-dbd9119a3b36 req-66e43c9f-e0c6-48b6-9571-524c5ea0b9a9 service nova] Creating event network-vif-unplugged:d2dab797-0a2d-468c-be65-d8233ba0abd0 for instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 on n-h1-854119-9 Aug 29 05:47:59.125354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-0a1083dd-b70b-4f91-af63-dbd9119a3b36 req-66e43c9f-e0c6-48b6-9571-524c5ea0b9a9 service nova] Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:47:59.138326 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0a1083dd-b70b-4f91-af63-dbd9119a3b36 req-66e43c9f-e0c6-48b6-9571-524c5ea0b9a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056519 Aug 29 05:47:59.138965 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3706/7403] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:47:59.638247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:47:59.638818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:47:59.646376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:59.646863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:59.647295 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:59.647981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:47:59.648580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:47:59.649012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:47:59.867409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:47:59.875700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9ddfa44c-a98a-4426-8851-22b9d41e3394 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1682 microversion: 2.1 time: 0.241346 Aug 29 05:47:59.888345 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3698/7404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:47:59 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:00.898445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:00.898873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:00.906431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:00.906905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:00.907347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:00.908043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:00.908648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:00.909085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:01.045218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:01.053144 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1bd5212-ae97-4b28-a43f-be6c8fdf8725 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1680 microversion: 2.1 time: 0.159292 Aug 29 05:48:01.053752 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3707/7405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:00 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:01.185099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-03ce8bf8-1ece-4409-9164-29c10ecc32ac req-791dcc57-a76c-448c-82ec-0c3b8c566f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d598dd3e-0a49-4c1b-bdc7-8792e2208e71", "tag": "d2dab797-0a2d-468c-be65-d8233ba0abd0"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:48:01.195714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-03ce8bf8-1ece-4409-9164-29c10ecc32ac req-791dcc57-a76c-448c-82ec-0c3b8c566f83 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:01.196232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-03ce8bf8-1ece-4409-9164-29c10ecc32ac req-791dcc57-a76c-448c-82ec-0c3b8c566f83 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:01.196669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-03ce8bf8-1ece-4409-9164-29c10ecc32ac req-791dcc57-a76c-448c-82ec-0c3b8c566f83 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:01.211193 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-03ce8bf8-1ece-4409-9164-29c10ecc32ac req-791dcc57-a76c-448c-82ec-0c3b8c566f83 service nova] Creating event network-changed:d2dab797-0a2d-468c-be65-d8233ba0abd0 for instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 on n-h1-854119-9 Aug 29 05:48:01.217327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-03ce8bf8-1ece-4409-9164-29c10ecc32ac req-791dcc57-a76c-448c-82ec-0c3b8c566f83 service nova] Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:48:01.228990 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-03ce8bf8-1ece-4409-9164-29c10ecc32ac req-791dcc57-a76c-448c-82ec-0c3b8c566f83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047679 Aug 29 05:48:01.229619 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3699/7406] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:48:02.075471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:02.076106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:02.083398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:02.083902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:02.084391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:02.085079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:02.085574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:02.086155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:02.215534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:02.223736 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a57051b6-6269-44ff-a544-55af67adc2c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1680 microversion: 2.1 time: 0.152726 Aug 29 05:48:02.224342 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3708/7407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:02 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:03.247161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:03.247848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:03.254574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:03.255053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:03.255464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:03.256190 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:03.256640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:03.257057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:03.413186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:03.421812 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7132edfc-294e-457b-86e3-fd72715205c4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1680 microversion: 2.1 time: 0.180104 Aug 29 05:48:03.422617 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3700/7408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:03 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:48:04.443821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:04.444651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:04.452147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:04.452689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:04.453191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:04.454004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:04.454471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:04.455005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:04.591782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:04.600215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-548f231c-f2ad-4d5f-bfce-6adf8ed1637b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1677 microversion: 2.1 time: 0.160733 Aug 29 05:48:04.600809 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3709/7409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:04 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:04.621435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3172b789-9dc1-423e-a606-bf946ac5d48b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:48:04.621996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3172b789-9dc1-423e-a606-bf946ac5d48b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:04.629645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3172b789-9dc1-423e-a606-bf946ac5d48b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:04.630130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3172b789-9dc1-423e-a606-bf946ac5d48b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:04.630562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3172b789-9dc1-423e-a606-bf946ac5d48b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:04.631259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3172b789-9dc1-423e-a606-bf946ac5d48b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:04.631706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3172b789-9dc1-423e-a606-bf946ac5d48b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:04.632146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3172b789-9dc1-423e-a606-bf946ac5d48b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:04.703697 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3172b789-9dc1-423e-a606-bf946ac5d48b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71/action" status: 204 len: 0 microversion: 2.1 time: 0.085632 Aug 29 05:48:04.704486 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3701/7410] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:48:04 2022] POST /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:48:04.714416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:04.715536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:04.722008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:04.722484 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:04.722924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:04.723690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:04.724171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:04.724609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:04.866276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:04.875251 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e854b465-2c0e-4e90-ac2b-9bb8c19f249f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1677 microversion: 2.1 time: 0.164764 Aug 29 05:48:04.875843 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3710/7411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:04 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:05.903126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:05.904810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:05.915854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:05.916407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:05.916844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:05.917558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:05.918037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:05.918488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:06.065919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:06.078275 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-92828b4d-94c3-4ab9-837a-c880d4cef73f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1677 microversion: 2.1 time: 0.181533 Aug 29 05:48:06.078709 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3702/7412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:05 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:07.103900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:07.104812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:07.113415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.113922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.114367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.115087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.115556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.115995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.256795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:07.268256 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-62131224-29c2-40b5-9384-165e8a33fcbc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1669 microversion: 2.1 time: 0.168142 Aug 29 05:48:07.268844 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3711/7413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:07 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:07.289317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:07.289915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:07.298133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.298636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.299251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.299950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.300433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.300851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.440944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:07.451134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d781f6b5-da67-49cb-be2d-9955645fb279 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1669 microversion: 2.1 time: 0.165717 Aug 29 05:48:07.451755 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3703/7414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:07 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:07.475025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:07.475650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:07.483359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.483875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.484360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.485075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.485542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.485977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.636443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:07.645675 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f3d4ec15-3792-49fb-8325-b3363b2ace88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1669 microversion: 2.1 time: 0.174683 Aug 29 05:48:07.646265 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3712/7415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:07 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:07.659018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7bb7ec67-0904-4513-b0ff-c29972ad0819 req-d0e293bb-6c9a-4c92-8e53-b59cb2e761a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d598dd3e-0a49-4c1b-bdc7-8792e2208e71", "name": "network-vif-plugged", "status": "completed", "tag": "d2dab797-0a2d-468c-be65-d8233ba0abd0"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:48:07.667026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:07.667774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:07.671268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7bb7ec67-0904-4513-b0ff-c29972ad0819 req-d0e293bb-6c9a-4c92-8e53-b59cb2e761a1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.672021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7bb7ec67-0904-4513-b0ff-c29972ad0819 req-d0e293bb-6c9a-4c92-8e53-b59cb2e761a1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.672480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7bb7ec67-0904-4513-b0ff-c29972ad0819 req-d0e293bb-6c9a-4c92-8e53-b59cb2e761a1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.675591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.676486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.676945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.677686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.678157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.678595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.685796 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7bb7ec67-0904-4513-b0ff-c29972ad0819 req-d0e293bb-6c9a-4c92-8e53-b59cb2e761a1 service nova] Creating event network-vif-plugged:d2dab797-0a2d-468c-be65-d8233ba0abd0 for instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 on n-h1-854119-9 Aug 29 05:48:07.692102 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7bb7ec67-0904-4513-b0ff-c29972ad0819 req-d0e293bb-6c9a-4c92-8e53-b59cb2e761a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036687 Aug 29 05:48:07.692851 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3704/7416] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:48:07.700009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:48:07.711687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:48:07.795337 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b0a327e-d610-44d0-9840-b24d09769820 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 204 len: 0 microversion: 2.1 time: 0.132579 Aug 29 05:48:07.796174 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3713/7417] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:48:07 2022] DELETE /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:48:07.807834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:07.808567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:07.815242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.815733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.816186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.816891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:07.817344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:07.817769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:07.833878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:48:07.967710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:07.977858 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e3e393a0-9fdd-4ba5-afbc-f64b05da4cca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1675 microversion: 2.1 time: 0.176402 Aug 29 05:48:07.978488 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3705/7418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:07 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:09.005784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:09.006516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:09.016827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:09.017586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:09.018325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:09.019497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:09.020240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:09.020957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:09.165758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:09.173618 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0fe106f0-093d-48c4-978a-e29e549e728d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1675 microversion: 2.1 time: 0.172830 Aug 29 05:48:09.174205 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3714/7419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:08 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:10.197307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fbfe728a-4727-4b5a-9cd2-a504af7f3ead req-84e40f67-d6f0-4211-9dc5-55eed7461b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d598dd3e-0a49-4c1b-bdc7-8792e2208e71", "name": "network-vif-deleted", "tag": "d2dab797-0a2d-468c-be65-d8233ba0abd0"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:48:10.202617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:10.203272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:10.209668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fbfe728a-4727-4b5a-9cd2-a504af7f3ead req-84e40f67-d6f0-4211-9dc5-55eed7461b9d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:10.210521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fbfe728a-4727-4b5a-9cd2-a504af7f3ead req-84e40f67-d6f0-4211-9dc5-55eed7461b9d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:10.210946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:10.211523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:10.211798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fbfe728a-4727-4b5a-9cd2-a504af7f3ead req-84e40f67-d6f0-4211-9dc5-55eed7461b9d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:10.211978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:10.212946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:10.213584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:10.214566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:10.226735 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fbfe728a-4727-4b5a-9cd2-a504af7f3ead req-84e40f67-d6f0-4211-9dc5-55eed7461b9d service nova] Creating event network-vif-deleted:d2dab797-0a2d-468c-be65-d8233ba0abd0 for instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 on n-h1-854119-9 Aug 29 05:48:10.233488 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fbfe728a-4727-4b5a-9cd2-a504af7f3ead req-84e40f67-d6f0-4211-9dc5-55eed7461b9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039553 Aug 29 05:48:10.237670 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3706/7420] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:48:10.298499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:10.307150 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5c8402e7-a7c4-4975-bda7-785065f0a9b5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 200 len: 1607 microversion: 2.1 time: 0.108726 Aug 29 05:48:10.307754 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3715/7421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:10 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 1607 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:11.331096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:11.331776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:11.338291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:11.338815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:11.339306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:11.339991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:11.340481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:11.340904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:11.362550 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 HTTP/1.1 Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'd598dd3e-0a49-4c1b-bdc7-8792e2208e71'} Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:48:11.362811 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0634e5a8-84bb-4701-81c2-5a5aa0763a88 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 404 len: 111 microversion: 2.1 time: 0.038689 Aug 29 05:48:11.367275 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3707/7422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:11 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:48:11.380193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:11.380655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:11.387283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:11.387833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:11.388436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:11.389167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:11.389636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:11.390049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:11.404826 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 HTTP/1.1 Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'd598dd3e-0a49-4c1b-bdc7-8792e2208e71'} Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:48:11.406537 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b24511ca-b13a-4a18-bbb5-0946e6bef4ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 404 len: 111 microversion: 2.1 time: 0.032265 Aug 29 05:48:11.411333 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3716/7423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:11 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:48:11.477892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1334409261", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "5c1d24f6-b96a-4519-80f0-d994c365cbd4"}], "security_groups": [{"name": "tempest-securitygroup--1422042689"}], "key_name": "tempest-keypair-349192370", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:48:11.677054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] validate_networks() for [('5c1d24f6-b96a-4519-80f0-d994c365cbd4', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:48:12.130110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:48:12.130541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:48:12.131043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:48:12.131477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:48:12.131889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:48:12.141664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:12.142151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:12.142615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:12.143342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:12.143789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:12.144251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:12.162314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:48:12.167895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for user bbc2df5c46bd4c629906f7da08f694e5 and project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:48:12.181470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:48:12.183796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:48:12.234621 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47b889fc-9a77-400c-9d59-488503fc3947 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760814 Aug 29 05:48:12.235292 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3708/7424] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:48:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:48:12.247044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9c431e2-c801-4cf9-a153-4271aae0575d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:12.247894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b9c431e2-c801-4cf9-a153-4271aae0575d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:12.358208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b9c431e2-c801-4cf9-a153-4271aae0575d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:12.368525 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b9c431e2-c801-4cf9-a153-4271aae0575d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1238 microversion: 2.1 time: 0.125075 Aug 29 05:48:12.369644 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3717/7425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:12 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1238 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:13.391801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:13.393171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:13.403302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:13.403818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:13.404310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:13.405002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:13.405455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:13.405904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:13.802133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:13.810206 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23f1a64d-061a-4011-a461-602a63acf92e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1308 microversion: 2.1 time: 0.423509 Aug 29 05:48:13.810928 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3709/7426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:13 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:14.833042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:14.833990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:14.836686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:48:14.843014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:14.843535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:14.843979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:14.844751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:14.845215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:14.845680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:14.857648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-860348ae-d9be-4dad-9a52-fd5972dd7bf6 req-31f6678b-f861-4344-8299-74edbfe7ba2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b558cfa-301f-4f50-b3a9-b4333f7e755c", "tag": "cf290572-826f-4dcd-ae38-55b07dd2ed65"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:48:14.868552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:48:14.871366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-860348ae-d9be-4dad-9a52-fd5972dd7bf6 req-31f6678b-f861-4344-8299-74edbfe7ba2a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:14.872306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-860348ae-d9be-4dad-9a52-fd5972dd7bf6 req-31f6678b-f861-4344-8299-74edbfe7ba2a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:14.873040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-860348ae-d9be-4dad-9a52-fd5972dd7bf6 req-31f6678b-f861-4344-8299-74edbfe7ba2a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:14.888348 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-860348ae-d9be-4dad-9a52-fd5972dd7bf6 req-31f6678b-f861-4344-8299-74edbfe7ba2a service nova] Creating event network-changed:cf290572-826f-4dcd-ae38-55b07dd2ed65 for instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c on n-h2-854119-9 Aug 29 05:48:14.894693 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-860348ae-d9be-4dad-9a52-fd5972dd7bf6 req-31f6678b-f861-4344-8299-74edbfe7ba2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041245 Aug 29 05:48:14.896313 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3710/7427] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:48:14.996493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:15.005372 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-00c6952c-acab-42fa-b020-bd84ef717c25 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1364 microversion: 2.1 time: 0.176347 Aug 29 05:48:15.006157 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3718/7428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:14 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:48:16.033530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:16.034358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:16.045791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:16.046530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:16.047261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:16.048477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:16.049120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:16.049542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:16.191794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:16.209701 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-efc731b5-57d4-4018-aa9a-9cc5b2666c3a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1364 microversion: 2.1 time: 0.184319 Aug 29 05:48:16.210325 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3711/7429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:16 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:17.233270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:17.233899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:17.241406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:17.241919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:17.242372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:17.243085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:17.243555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:17.243998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:17.382629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:17.391102 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2839fe1f-a928-4acf-a893-a034fd3f2f96 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1364 microversion: 2.1 time: 0.161739 Aug 29 05:48:17.391861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3719/7430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:17 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:18.416501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:18.417119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:18.426891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:18.427385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:18.427812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:18.428556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:18.429005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:18.429431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:18.584487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:18.594004 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57f4e376-f71f-44b6-b964-f0a318b41b77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1364 microversion: 2.1 time: 0.183822 Aug 29 05:48:18.594588 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3712/7431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:18 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:19.616138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:19.616767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:19.624547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:19.625047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:19.625492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:19.626211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:19.626760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:19.627176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:19.865008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:19.873093 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec405c36-7f0a-4df7-828f-b58e67bc5129 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1364 microversion: 2.1 time: 0.261100 Aug 29 05:48:19.873690 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3720/7432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:19 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:20.894966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:20.895593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:20.906684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:20.907182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:20.907616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:20.909015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:20.909216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:20.909847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:21.070637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:21.079326 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98ab8f0a-4106-4860-9822-a147744524b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1364 microversion: 2.1 time: 0.188431 Aug 29 05:48:21.082910 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3713/7433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:20 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:21.487193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3bf8a151-3d2c-4e73-ba6a-b8bcc07b4424 req-6ceb355f-086e-41f6-86fd-ef3e1b4c61f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b558cfa-301f-4f50-b3a9-b4333f7e755c", "name": "network-vif-plugged", "status": "completed", "tag": "cf290572-826f-4dcd-ae38-55b07dd2ed65"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:48:21.497232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3bf8a151-3d2c-4e73-ba6a-b8bcc07b4424 req-6ceb355f-086e-41f6-86fd-ef3e1b4c61f3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:21.497719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3bf8a151-3d2c-4e73-ba6a-b8bcc07b4424 req-6ceb355f-086e-41f6-86fd-ef3e1b4c61f3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:21.498156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3bf8a151-3d2c-4e73-ba6a-b8bcc07b4424 req-6ceb355f-086e-41f6-86fd-ef3e1b4c61f3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:21.513570 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3bf8a151-3d2c-4e73-ba6a-b8bcc07b4424 req-6ceb355f-086e-41f6-86fd-ef3e1b4c61f3 service nova] Creating event network-vif-plugged:cf290572-826f-4dcd-ae38-55b07dd2ed65 for instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c on n-h2-854119-9 Aug 29 05:48:21.519193 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3bf8a151-3d2c-4e73-ba6a-b8bcc07b4424 req-6ceb355f-086e-41f6-86fd-ef3e1b4c61f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Aug 29 05:48:21.519708 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3721/7434] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:48:22.101237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:22.101850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:22.109358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:22.109845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:22.110378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:22.111144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:22.111590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:22.112010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:22.151054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:48:22.174685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:48:22.371422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:22.379936 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af84718e-b103-484d-95f9-b567a3053d52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1364 microversion: 2.1 time: 0.282660 Aug 29 05:48:22.380540 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3714/7435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:22 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:23.402857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:48:23.408002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:23.408746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:23.415557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:23.416083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:23.416554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:23.417265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:23.417721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:23.418137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:23.557217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:48:23.566698 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1618e886-cd47-42b1-a496-62324f1ec442 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1551 microversion: 2.1 time: 0.164556 Aug 29 05:48:23.567356 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3722/7436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:48:23 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:48:23.589036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-160a689f-614c-4943-a662-d2c558871da2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:48:23.589856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-160a689f-614c-4943-a662-d2c558871da2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:48:23.597490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-160a689f-614c-4943-a662-d2c558871da2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:23.597992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-160a689f-614c-4943-a662-d2c558871da2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:23.598459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-160a689f-614c-4943-a662-d2c558871da2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:23.599193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-160a689f-614c-4943-a662-d2c558871da2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:23.599647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-160a689f-614c-4943-a662-d2c558871da2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:23.600096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-160a689f-614c-4943-a662-d2c558871da2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:23.689134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-160a689f-614c-4943-a662-d2c558871da2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104778 Aug 29 05:48:23.689782 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3715/7437] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:48:23 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:48:24.731671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c3734df3-4d9e-4ff6-b2d4-31a4fc51f135 req-246370e4-5cbc-4303-98f8-45055354d83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b558cfa-301f-4f50-b3a9-b4333f7e755c", "tag": "cf290572-826f-4dcd-ae38-55b07dd2ed65"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:48:24.742362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c3734df3-4d9e-4ff6-b2d4-31a4fc51f135 req-246370e4-5cbc-4303-98f8-45055354d83f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:48:24.742849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c3734df3-4d9e-4ff6-b2d4-31a4fc51f135 req-246370e4-5cbc-4303-98f8-45055354d83f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:48:24.743323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c3734df3-4d9e-4ff6-b2d4-31a4fc51f135 req-246370e4-5cbc-4303-98f8-45055354d83f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:48:24.755784 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c3734df3-4d9e-4ff6-b2d4-31a4fc51f135 req-246370e4-5cbc-4303-98f8-45055354d83f service nova] Creating event network-changed:cf290572-826f-4dcd-ae38-55b07dd2ed65 for instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c on n-h2-854119-9 Aug 29 05:48:24.761496 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c3734df3-4d9e-4ff6-b2d4-31a4fc51f135 req-246370e4-5cbc-4303-98f8-45055354d83f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033460 Aug 29 05:48:24.762362 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3723/7438] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:49:36.796794 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 05:49:36.797591 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0fdfc1a5-fcdd-4106-99be-9e46d6a37d4e] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 05:49:36.798168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=11 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:49:36.799375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=45 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:49:36.799997 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:49:36.800185 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:49:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/action (ip 10.222.0.20) !!! Aug 29 05:49:36.806817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e8acc1e6-117c-4fb0-bb7d-86919d8abf30 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:49:36.815372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8acc1e6-117c-4fb0-bb7d-86919d8abf30 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:36.815868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8acc1e6-117c-4fb0-bb7d-86919d8abf30 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:36.816335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8acc1e6-117c-4fb0-bb7d-86919d8abf30 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:36.845686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e8acc1e6-117c-4fb0-bb7d-86919d8abf30 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Going to try to stop instance {{(pid=128872) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 05:49:36.914760 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e8acc1e6-117c-4fb0-bb7d-86919d8abf30 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/action" status: 202 len: 0 microversion: 2.1 time: 0.119365 Aug 29 05:49:36.919913 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3716/7439] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:49:36 2022] POST /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:49:36.927994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=11 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:49:36.927994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:49:36.927994 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:49:36.927994 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:49:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c (ip 10.222.0.20) !!! Aug 29 05:49:36.938354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:36.939114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:36.948785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:36.949274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:36.950022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:36.950822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:36.951289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:36.951916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:37.109853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:37.118415 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-66c4ef18-448e-449c-883d-4d895cedc4d4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.196977 Aug 29 05:49:37.119001 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3724/7440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:36 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:38.145627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:38.146346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:38.155157 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46424. Aug 29 05:49:38.164159 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] [0fdfc1a5-fcdd-4106-99be-9e46d6a37d4e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46426. Aug 29 05:49:38.168939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:38.169630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:38.170182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:38.171217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:38.171888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:38.172531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:38.316980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:38.326965 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-26e8177d-5ab0-4537-9984-949e2ca28532 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.190778 Aug 29 05:49:38.327917 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3717/7441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:38 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:39.353317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:39.354026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:39.369034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:39.369617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:39.370171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:39.370983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:39.371509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:39.372030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:39.520694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:39.529008 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d07bf0b-ea48-4bce-96d2-2bc44d9f9786 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.179834 Aug 29 05:49:39.529592 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3725/7442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:39 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:40.550735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:40.551343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:40.558914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:40.559409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:40.559843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:40.560595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:40.561059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:40.561473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:40.705606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:40.714165 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d9279e16-a44b-42e9-a86a-573636052ed2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.167361 Aug 29 05:49:40.714754 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3718/7443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:40 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:41.735450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:41.736091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:41.742593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:41.743096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:41.743549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:41.744304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:41.744772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:41.745206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:41.883549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:41.891483 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8fd3ebf3-591b-4165-8fbb-ed21835440e0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.160168 Aug 29 05:49:41.892071 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3726/7444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:41 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:42.922077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:42.922596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:42.933898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:42.934390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:42.934820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:42.935522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:42.935970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:42.936420 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:43.088049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:43.099664 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1e06c7fb-dfb2-4dfc-8954-9430fbc2f4f8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.187743 Aug 29 05:49:43.100435 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3719/7445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:42 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:44.122024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:44.122690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:44.130820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:44.131348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:44.131799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:44.132537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:44.132998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:44.133430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:44.274161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:44.284206 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f11a67f-eda3-4409-9ce9-ad9737bf1c0f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.166081 Aug 29 05:49:44.284819 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3727/7446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:44 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:45.307619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:45.308775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:45.319322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:45.320177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:45.320878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:45.321988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:45.322749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:45.323799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:45.462744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:45.471089 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ec01b0f8-20d3-43cf-b1e8-759f5960fd10 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.168561 Aug 29 05:49:45.471659 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3720/7447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:45 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:46.494333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:46.494939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:46.502650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:46.503180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:46.503628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:46.504404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:46.504873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:46.505312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:46.640831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:46.648757 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3790e28d-8b98-445d-8742-12b61048bb51 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.158542 Aug 29 05:49:46.649357 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3728/7448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:46 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:47.675557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:47.676164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:47.683886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:47.684401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:47.684842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:47.685549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:47.686000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:47.686421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:47.828322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:47.836510 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2ee5cea2-83c2-4dae-957a-c1fadac293f4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1656 microversion: 2.1 time: 0.165297 Aug 29 05:49:47.837088 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3721/7449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:47 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1656 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:47.858652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:49:47.860973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:47.868062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:47.868618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:47.869057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:47.869762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:47.870224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:47.870653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:47.898863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:47.905433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:49:47.912523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:49:47.912953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:49:47.913464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:49:47.913880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:49:47.914293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:49:47.980083 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a4eeb536-007a-4977-88d2-bd9ad6531b2f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/action" status: 202 len: 0 microversion: 2.1 time: 0.125335 Aug 29 05:49:47.980727 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3729/7450] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:49:47 2022] POST /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:49:47.989119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:47.989735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:47.995782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:47.996311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:47.996764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:47.997453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:47.997932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:47.998352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:48.131094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:48.138998 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d6b09a2b-c787-482a-9719-653b52c3a959 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.153740 Aug 29 05:49:48.139675 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3722/7451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:47 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:49.163439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:49.164203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:49.170751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:49.171336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:49.171834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:49.172953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:49.173432 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:49.173854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:49.320496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:49.331091 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3f9260bf-deb2-4a98-bcfc-67be314c61b2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1679 microversion: 2.1 time: 0.173965 Aug 29 05:49:49.331668 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3730/7452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:49 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:50.352758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:50.353339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:50.361043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:50.361525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:50.361954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:50.362644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:50.363091 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:50.363516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:50.500650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:50.508862 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4126432a-8e10-4fc5-9861-f24fa9b7ed61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1684 microversion: 2.1 time: 0.160167 Aug 29 05:49:50.509473 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3723/7453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:50 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:51.530678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:51.531311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:51.538592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:51.539095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:51.539546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:51.540287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:51.540754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:51.541188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:51.677764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:51.689439 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16466184-0fc6-4f74-856e-4b553d561c76 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1684 microversion: 2.1 time: 0.162595 Aug 29 05:49:51.690412 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3731/7454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:51 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:52.713970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:52.714819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:52.722059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:52.722532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:52.722932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:52.723639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:52.724081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:52.724562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:52.862393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-83053003-a0d1-4d13-9f21-81e2e4e53c4e req-c4746a41-fa9f-44d1-b923-d8b902bebc78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b558cfa-301f-4f50-b3a9-b4333f7e755c", "name": "network-vif-unplugged", "status": "completed", "tag": "cf290572-826f-4dcd-ae38-55b07dd2ed65"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:49:52.872487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-83053003-a0d1-4d13-9f21-81e2e4e53c4e req-c4746a41-fa9f-44d1-b923-d8b902bebc78 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:52.872985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-83053003-a0d1-4d13-9f21-81e2e4e53c4e req-c4746a41-fa9f-44d1-b923-d8b902bebc78 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:52.873427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-83053003-a0d1-4d13-9f21-81e2e4e53c4e req-c4746a41-fa9f-44d1-b923-d8b902bebc78 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:52.885750 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-83053003-a0d1-4d13-9f21-81e2e4e53c4e req-c4746a41-fa9f-44d1-b923-d8b902bebc78 service nova] Creating event network-vif-unplugged:cf290572-826f-4dcd-ae38-55b07dd2ed65 for instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c on n-h1-854119-9 Aug 29 05:49:52.892148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-83053003-a0d1-4d13-9f21-81e2e4e53c4e req-c4746a41-fa9f-44d1-b923-d8b902bebc78 service nova] Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:49:52.904767 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-83053003-a0d1-4d13-9f21-81e2e4e53c4e req-c4746a41-fa9f-44d1-b923-d8b902bebc78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106357 Aug 29 05:49:52.905535 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3732/7455] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:49:53.012366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:53.020716 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75f9f28b-ae00-49d8-8946-727270d53083 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1683 microversion: 2.1 time: 0.311592 Aug 29 05:49:53.021306 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3724/7456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:52 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1683 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:54.043665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:54.044296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:54.051721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:54.052251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:54.052699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:54.053412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:54.053874 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:54.054308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:54.192763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:54.203678 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-630ecec4-29d3-4f2f-be59-9a11c1d3bca0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1681 microversion: 2.1 time: 0.164407 Aug 29 05:49:54.204286 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3733/7457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:54 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:54.921188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7c2abb71-f40b-4a7e-b3fa-2556d26e194e req-1242c5d7-2489-498d-9bac-18563f9175ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b558cfa-301f-4f50-b3a9-b4333f7e755c", "tag": "cf290572-826f-4dcd-ae38-55b07dd2ed65"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:49:54.931807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7c2abb71-f40b-4a7e-b3fa-2556d26e194e req-1242c5d7-2489-498d-9bac-18563f9175ec service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:54.932332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7c2abb71-f40b-4a7e-b3fa-2556d26e194e req-1242c5d7-2489-498d-9bac-18563f9175ec service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:54.932759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7c2abb71-f40b-4a7e-b3fa-2556d26e194e req-1242c5d7-2489-498d-9bac-18563f9175ec service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:54.945284 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7c2abb71-f40b-4a7e-b3fa-2556d26e194e req-1242c5d7-2489-498d-9bac-18563f9175ec service nova] Creating event network-changed:cf290572-826f-4dcd-ae38-55b07dd2ed65 for instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c on n-h1-854119-9 Aug 29 05:49:54.951376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-7c2abb71-f40b-4a7e-b3fa-2556d26e194e req-1242c5d7-2489-498d-9bac-18563f9175ec service nova] Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:49:54.963034 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7c2abb71-f40b-4a7e-b3fa-2556d26e194e req-1242c5d7-2489-498d-9bac-18563f9175ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045516 Aug 29 05:49:54.963656 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3725/7458] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:49:55.225949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:55.226764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:55.233155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:55.233721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:55.234147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:55.234861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:55.235325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:55.235766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:55.392826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:55.404344 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-180b112f-d37c-4506-9b32-fec609369f5e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1681 microversion: 2.1 time: 0.182817 Aug 29 05:49:55.405312 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3734/7459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:55 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:56.428601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:56.429308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:56.435956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:56.436476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:56.436986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:56.437693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:56.438146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:56.438567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:56.637787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:56.646334 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7c1cb41a-ea91-4084-8cee-a271cd9faae5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1677 microversion: 2.1 time: 0.222830 Aug 29 05:49:56.646852 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3726/7460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:56 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:56.667505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-651d9cf7-b921-4619-9dec-473752ef3534 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:49:56.668094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-651d9cf7-b921-4619-9dec-473752ef3534 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:56.675153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651d9cf7-b921-4619-9dec-473752ef3534 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:56.675719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651d9cf7-b921-4619-9dec-473752ef3534 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:56.676197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651d9cf7-b921-4619-9dec-473752ef3534 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:56.676910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651d9cf7-b921-4619-9dec-473752ef3534 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:56.677379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651d9cf7-b921-4619-9dec-473752ef3534 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:56.677822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-651d9cf7-b921-4619-9dec-473752ef3534 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:56.740943 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-651d9cf7-b921-4619-9dec-473752ef3534 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/action" status: 204 len: 0 microversion: 2.1 time: 0.077071 Aug 29 05:49:56.741596 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3735/7461] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:49:56 2022] POST /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:49:56.758229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:56.758901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:56.765366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:56.765983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:56.766511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:56.767289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:56.767811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:56.768333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:56.996482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:57.005833 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6fe56dc0-1e27-41b6-8f89-60b6efdd2318 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1677 microversion: 2.1 time: 0.259617 Aug 29 05:49:57.006423 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3727/7462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:56 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1677 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:58.028286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:58.028960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:58.035758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:58.036264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:58.036698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:58.037408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:58.037869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:58.038295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:58.182043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:58.192089 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a29e2584-5a5e-4b23-85f4-3790cc0a1caf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1656 microversion: 2.1 time: 0.168666 Aug 29 05:49:58.193075 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3736/7463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:58 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1656 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:58.213885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:58.214505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:58.222505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:58.223172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:58.223614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:58.224357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:58.224815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:58.225239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:58.358789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:58.367082 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7a63f9d-2465-4a43-95d6-7cacaea9d7d6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1656 microversion: 2.1 time: 0.157660 Aug 29 05:49:58.367654 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3728/7464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:58 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:49:58.387181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e37c693-081e-40ec-ab7a-8212978f7254 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:49:58.393360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e37c693-081e-40ec-ab7a-8212978f7254 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:58.393821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e37c693-081e-40ec-ab7a-8212978f7254 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:58.394260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e37c693-081e-40ec-ab7a-8212978f7254 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:58.420526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4e37c693-081e-40ec-ab7a-8212978f7254 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Going to try to start instance {{(pid=128871) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 05:49:58.450023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:49:58.474453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4e37c693-081e-40ec-ab7a-8212978f7254 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/action" status: 202 len: 0 microversion: 2.1 time: 0.091019 Aug 29 05:49:58.475039 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3737/7465] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:49:58 2022] POST /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:49:58.484089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:58.484794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:58.491351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:58.491846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:58.492319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:58.493015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:58.493463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:58.493918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:58.708016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:58.717134 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1b1b123-d09c-4e13-bbb1-def49f147d58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1665 microversion: 2.1 time: 0.237511 Aug 29 05:49:58.717850 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3729/7466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:58 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1665 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:59.741045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:59.741772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:59.748296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:59.748802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:59.749222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:59.749940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:59.750399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:59.750828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:59.883118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:49:59.891103 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-372153ae-3cfa-495f-a618-9f88b6ca41a0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1669 microversion: 2.1 time: 0.155380 Aug 29 05:49:59.891652 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3738/7467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:49:59 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:49:59.916625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:49:59.917121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:49:59.924465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:59.924944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:59.925371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:59.926059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:49:59.926563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:49:59.927048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:49:59.955862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:49:59.989783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:50:00.035024 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-414a7002-883a-4e83-9206-df16d27772e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 204 len: 0 microversion: 2.1 time: 0.121877 Aug 29 05:50:00.035914 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3730/7468] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:49:59 2022] DELETE /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:50:00.046293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:00.046910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:00.057284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:00.057780 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:00.058292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:00.059048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:00.059510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:00.059942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:00.191627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:00.200026 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-75253a71-cfa1-49d4-868f-800a130bbf5c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1675 microversion: 2.1 time: 0.159533 Aug 29 05:50:00.200644 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3739/7469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:00 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:00.321722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-09fb6cbc-0b18-45ce-a920-7aa035eaeaa9 req-a188217c-29c3-48f0-b322-fdf094096b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b558cfa-301f-4f50-b3a9-b4333f7e755c", "name": "network-vif-plugged", "status": "completed", "tag": "cf290572-826f-4dcd-ae38-55b07dd2ed65"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:50:00.331494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-09fb6cbc-0b18-45ce-a920-7aa035eaeaa9 req-a188217c-29c3-48f0-b322-fdf094096b31 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:00.331971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-09fb6cbc-0b18-45ce-a920-7aa035eaeaa9 req-a188217c-29c3-48f0-b322-fdf094096b31 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:00.332424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-09fb6cbc-0b18-45ce-a920-7aa035eaeaa9 req-a188217c-29c3-48f0-b322-fdf094096b31 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:00.348422 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-09fb6cbc-0b18-45ce-a920-7aa035eaeaa9 req-a188217c-29c3-48f0-b322-fdf094096b31 service nova] Creating event network-vif-plugged:cf290572-826f-4dcd-ae38-55b07dd2ed65 for instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c on n-h1-854119-9 Aug 29 05:50:00.355720 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-09fb6cbc-0b18-45ce-a920-7aa035eaeaa9 req-a188217c-29c3-48f0-b322-fdf094096b31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088824 Aug 29 05:50:00.356618 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3731/7470] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:50:01.226621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:01.227880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:01.237333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:01.237832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:01.238282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:01.238990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:01.239451 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:01.239888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:01.380655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:01.389064 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3612862c-52d2-422e-8fe5-8a69fd9e8504 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1675 microversion: 2.1 time: 0.169734 Aug 29 05:50:01.389655 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3740/7471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:01 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:02.412197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:02.412827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:02.419983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:02.420617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:02.421291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:02.422207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:02.422942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:02.423603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:02.717080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:02.725316 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-816b4cdb-317b-4bbd-9593-d62c546b451d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 200 len: 1607 microversion: 2.1 time: 0.318325 Aug 29 05:50:02.725902 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3732/7472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:02 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 1607 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:02.907700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a31e3f7c-9eec-43d5-9eba-6553f91bde68 req-ab964c51-3b1a-40f4-98a5-42a6901f917f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b558cfa-301f-4f50-b3a9-b4333f7e755c", "name": "network-vif-deleted", "tag": "cf290572-826f-4dcd-ae38-55b07dd2ed65"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:50:02.930344 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a31e3f7c-9eec-43d5-9eba-6553f91bde68 req-ab964c51-3b1a-40f4-98a5-42a6901f917f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:02.930830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a31e3f7c-9eec-43d5-9eba-6553f91bde68 req-ab964c51-3b1a-40f4-98a5-42a6901f917f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:02.931269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a31e3f7c-9eec-43d5-9eba-6553f91bde68 req-ab964c51-3b1a-40f4-98a5-42a6901f917f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:02.943727 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a31e3f7c-9eec-43d5-9eba-6553f91bde68 req-ab964c51-3b1a-40f4-98a5-42a6901f917f service nova] Creating event network-vif-deleted:cf290572-826f-4dcd-ae38-55b07dd2ed65 for instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c on n-h1-854119-9 Aug 29 05:50:02.949146 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a31e3f7c-9eec-43d5-9eba-6553f91bde68 req-ab964c51-3b1a-40f4-98a5-42a6901f917f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058221 Aug 29 05:50:02.950163 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3741/7473] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:50:03.747115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:03.747737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:03.755226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:03.755713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:03.756225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:03.756917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:03.757378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:03.757808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:03.771934 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c HTTP/1.1 Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6b558cfa-301f-4f50-b3a9-b4333f7e755c'} Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:50:03.773655 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad8d735f-d546-4eec-8430-5556c2ff277a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 404 len: 111 microversion: 2.1 time: 0.031970 Aug 29 05:50:03.777745 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3733/7474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:03 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:50:03.793482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:03.794190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:03.800947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:03.801374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:03.801845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:03.802539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:03.803114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:03.803550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:03.817401 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c HTTP/1.1 Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6b558cfa-301f-4f50-b3a9-b4333f7e755c'} Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:50:03.819048 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d231ac4c-94ae-4834-aa64-0dcff924e7e4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 404 len: 111 microversion: 2.1 time: 0.031281 Aug 29 05:50:03.823836 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3742/7475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:03 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:50:03.870744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1805856905", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "5c1d24f6-b96a-4519-80f0-d994c365cbd4"}], "security_groups": [{"name": "tempest-securitygroup--1422042689"}], "key_name": "tempest-keypair-349192370", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:50:03.978120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] validate_networks() for [('5c1d24f6-b96a-4519-80f0-d994c365cbd4', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:50:04.440481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:50:04.440912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:50:04.441386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:50:04.441793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:50:04.442194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:50:04.455068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:04.455553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:04.455973 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:04.456720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:04.457170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:04.457591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:04.478036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:50:04.483439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for user bbc2df5c46bd4c629906f7da08f694e5 and project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:50:04.498159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:50:04.500585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:50:04.549782 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cb782f22-4bcf-4f61-90d6-38dcbdefe864 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.682918 Aug 29 05:50:04.550433 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3734/7476] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:50:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:50:04.561717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-89ccf90c-5c88-491a-8cb7-ec3dd6ce30a4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:04.562515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-89ccf90c-5c88-491a-8cb7-ec3dd6ce30a4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:04.621491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-89ccf90c-5c88-491a-8cb7-ec3dd6ce30a4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:04.631752 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-89ccf90c-5c88-491a-8cb7-ec3dd6ce30a4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1238 microversion: 2.1 time: 0.073967 Aug 29 05:50:04.632329 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3743/7477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:04 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:05.655385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:05.655946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:05.663242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:05.663741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:05.664201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:05.664913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:05.665372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:05.665800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:05.734146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:05.743404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea9b75d4-c0d8-467c-b441-fbe74b0feb8e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1298 microversion: 2.1 time: 0.093423 Aug 29 05:50:05.745052 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3735/7478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:05 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:06.765445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:06.766045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:06.773121 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:06.773621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:06.774066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:06.774775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:06.775273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:06.775703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:06.910430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:06.919496 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ec8b4324-76de-48b6-af2a-96fe2461dd61 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1364 microversion: 2.1 time: 0.157945 Aug 29 05:50:06.920086 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3744/7479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:06 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:07.221519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b60fe258-8c7d-42f0-bf39-292886a32643 req-2f0e5ba3-62a4-4591-9287-d95bbfd49116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:50:07.226635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:50:07.232732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b60fe258-8c7d-42f0-bf39-292886a32643 req-2f0e5ba3-62a4-4591-9287-d95bbfd49116 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:07.233145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b60fe258-8c7d-42f0-bf39-292886a32643 req-2f0e5ba3-62a4-4591-9287-d95bbfd49116 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:07.233602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b60fe258-8c7d-42f0-bf39-292886a32643 req-2f0e5ba3-62a4-4591-9287-d95bbfd49116 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:07.245417 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b60fe258-8c7d-42f0-bf39-292886a32643 req-2f0e5ba3-62a4-4591-9287-d95bbfd49116 service nova] Creating event network-changed:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h2-854119-9 Aug 29 05:50:07.250395 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b60fe258-8c7d-42f0-bf39-292886a32643 req-2f0e5ba3-62a4-4591-9287-d95bbfd49116 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087370 Aug 29 05:50:07.250982 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3736/7480] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:50:07.944341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:07.945031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:07.949721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=49 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:50:07.955823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:07.956378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:07.956827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:07.957566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:07.958031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:07.958479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:08.092064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:08.099925 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8bd2054e-6695-47ab-9cfe-34b8b301d42d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1364 microversion: 2.1 time: 0.161344 Aug 29 05:50:08.100642 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3745/7481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:07 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:09.123687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:09.124421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:09.131234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:09.131713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:09.132142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:09.132848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:09.133292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:09.133713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:09.268552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:09.276638 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a71b81b-8b4c-4b46-b9b1-383e91f1c952 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1364 microversion: 2.1 time: 0.158313 Aug 29 05:50:09.277215 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3737/7482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:09 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:10.300944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:10.301700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:10.310544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:10.311156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:10.311711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:10.312642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:10.313213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:10.313748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:10.456183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:10.464226 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e879f611-926d-4c7c-8823-17733b2aa8c9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1364 microversion: 2.1 time: 0.168686 Aug 29 05:50:10.464809 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3746/7483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:10 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:11.491477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:11.492548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:11.502340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:11.502900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:11.503329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:11.504008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:11.504521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:11.504937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:11.644110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:11.656982 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e086d1d8-7f9d-4c07-bae2-4f551377a300 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1364 microversion: 2.1 time: 0.171935 Aug 29 05:50:11.657861 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3738/7484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:11 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:12.680027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:12.680655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:12.688551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:12.689048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:12.689493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:12.690197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:12.690630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:12.691093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:12.831175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:12.843205 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2c958dec-23b6-47f7-86b4-64bc535519b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1364 microversion: 2.1 time: 0.167098 Aug 29 05:50:12.843780 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3747/7485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:12 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:13.869536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:13.870450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:13.881934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:13.882742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:13.883467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:13.884710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:13.885452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:13.886161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:14.033067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:14.041256 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2344f4ee-40b8-4b10-bd6b-8dac9424f4d3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1364 microversion: 2.1 time: 0.178519 Aug 29 05:50:14.041891 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3739/7486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:13 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:14.207020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-07e09bfe-5450-4dfb-a597-e2bb35c34a4f req-0dcf163c-1838-4812-a9d2-3fc64241f8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "name": "network-vif-plugged", "status": "completed", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:50:14.219217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-07e09bfe-5450-4dfb-a597-e2bb35c34a4f req-0dcf163c-1838-4812-a9d2-3fc64241f8ab service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:14.220434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-07e09bfe-5450-4dfb-a597-e2bb35c34a4f req-0dcf163c-1838-4812-a9d2-3fc64241f8ab service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:14.220888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-07e09bfe-5450-4dfb-a597-e2bb35c34a4f req-0dcf163c-1838-4812-a9d2-3fc64241f8ab service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:14.236255 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-07e09bfe-5450-4dfb-a597-e2bb35c34a4f req-0dcf163c-1838-4812-a9d2-3fc64241f8ab service nova] Creating event network-vif-plugged:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h2-854119-9 Aug 29 05:50:14.241323 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-07e09bfe-5450-4dfb-a597-e2bb35c34a4f req-0dcf163c-1838-4812-a9d2-3fc64241f8ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038302 Aug 29 05:50:14.241937 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3748/7487] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:50:15.063443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:15.064080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:15.066093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:50:15.066771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:50:15.073615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:15.074099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:15.074539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:15.075230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:15.075688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:15.076104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:15.214224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:15.222326 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a528cc76-b23c-49c7-a375-803507f12650 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1364 microversion: 2.1 time: 0.162900 Aug 29 05:50:15.223030 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3740/7488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:15 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:16.246621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:16.247452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:16.249790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:50:16.260275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:16.260865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:16.261388 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:16.262214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:16.262759 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:16.263276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:16.406382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:50:16.414583 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-16762fd2-8d3a-43c6-9bec-5c978414402f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1551 microversion: 2.1 time: 0.173052 Aug 29 05:50:16.415159 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3749/7489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:50:16 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:50:16.435393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-70c1dde9-c6f7-4ad1-87ee-6c3b1b3ce884 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:50:16.435913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-70c1dde9-c6f7-4ad1-87ee-6c3b1b3ce884 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:50:16.442963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70c1dde9-c6f7-4ad1-87ee-6c3b1b3ce884 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:16.443451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70c1dde9-c6f7-4ad1-87ee-6c3b1b3ce884 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:16.443881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70c1dde9-c6f7-4ad1-87ee-6c3b1b3ce884 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:16.444612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70c1dde9-c6f7-4ad1-87ee-6c3b1b3ce884 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:16.445065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70c1dde9-c6f7-4ad1-87ee-6c3b1b3ce884 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:16.445481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-70c1dde9-c6f7-4ad1-87ee-6c3b1b3ce884 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:16.532833 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-70c1dde9-c6f7-4ad1-87ee-6c3b1b3ce884 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101270 Aug 29 05:50:16.533434 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3741/7490] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:50:16 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:50:17.809359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d5bf0185-ba87-4fcd-a053-f8452ea3b2a5 req-04949d4a-c01b-4226-a559-bbe1a5fe04b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:50:17.819813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d5bf0185-ba87-4fcd-a053-f8452ea3b2a5 req-04949d4a-c01b-4226-a559-bbe1a5fe04b4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:50:17.820357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d5bf0185-ba87-4fcd-a053-f8452ea3b2a5 req-04949d4a-c01b-4226-a559-bbe1a5fe04b4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:50:17.820810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d5bf0185-ba87-4fcd-a053-f8452ea3b2a5 req-04949d4a-c01b-4226-a559-bbe1a5fe04b4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:50:17.832577 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d5bf0185-ba87-4fcd-a053-f8452ea3b2a5 req-04949d4a-c01b-4226-a559-bbe1a5fe04b4 service nova] Creating event network-changed:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h2-854119-9 Aug 29 05:50:17.837541 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d5bf0185-ba87-4fcd-a053-f8452ea3b2a5 req-04949d4a-c01b-4226-a559-bbe1a5fe04b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031899 Aug 29 05:50:17.838139 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3750/7491] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:51:30.215150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=11 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:51:30.215962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:51:30.278794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:51:30.282430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:30.290422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:30.290942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:30.291384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:30.292083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:30.292565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:30.292982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:30.323569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:30.332999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Old instance type m1.heat2, new instance type m1.heat {{(pid=128872) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:51:30.340350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:51:30.340856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:51:30.341331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:51:30.341739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:51:30.342147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:51:30.415581 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-86f881b8-6eea-4188-9190-e04eeb6bc0ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc/action" status: 202 len: 0 microversion: 2.1 time: 0.202806 Aug 29 05:51:30.416635 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3742/7492] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:51:30 2022] POST /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:51:30.424724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=11 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:51:30.425898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:51:30.432955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:30.433527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:30.441527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:30.442035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:30.442473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:30.443462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:30.443857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:30.444508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:30.598103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:30.606906 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a50d733f-b74c-421a-bdf8-ac0d2317c4c2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1678 microversion: 2.1 time: 0.185551 Aug 29 05:51:30.607620 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3751/7493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:30 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:31.631943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:31.632734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:31.639619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:31.640172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:31.640881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:31.641327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:31.641789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:31.642209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:31.796334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:31.804788 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6195cc8d-0fe7-4a66-acad-5726fe503cb9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1678 microversion: 2.1 time: 0.178514 Aug 29 05:51:31.805390 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3743/7494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:31 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:32.828792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:32.829353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:32.837414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:32.837949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:32.838394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:32.839182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:32.839675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:32.840146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:32.976924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:32.984933 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e7aa9ac3-978f-4ed9-b843-4ee1e952d8af tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.160285 Aug 29 05:51:32.985556 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3752/7495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:32 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:34.018105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:34.018709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:34.026197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:34.026691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:34.027125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:34.027831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:34.028324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:34.028744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:34.172738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:34.185405 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-058f7e19-b8b9-49df-a17e-d3e60a18f339 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.170963 Aug 29 05:51:34.186309 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3744/7496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:34 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:35.212728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:35.213340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:35.220572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:35.221074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:35.221518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:35.222266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:35.222730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:35.223164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:35.365893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:35.374634 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0f92b79c-d7d4-4ed6-9886-c8f24ac96d54 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.165777 Aug 29 05:51:35.375219 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3753/7497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:35 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:36.397432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:36.398062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:36.408716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:36.409207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:36.409640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:36.410347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:36.410793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:36.411209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:36.553403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:36.561664 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07b8fb68-24b8-49d2-83c8-c07cb3702781 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.168651 Aug 29 05:51:36.562252 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3745/7498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:36 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:37.587880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:37.588476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:37.595963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:37.596499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:37.596943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:37.598842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:37.598842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:37.598842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:37.746585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:37.760191 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71f3d3e1-a343-4d2a-9777-df2081879d06 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.176285 Aug 29 05:51:37.760787 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3754/7499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:37 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:38.781808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:38.782447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:38.789290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:38.789782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:38.790197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:38.791058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:38.791510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:38.791927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:38.930267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:38.939428 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b78f7385-d81c-480c-912c-530f2ae59476 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.161518 Aug 29 05:51:38.940022 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3746/7500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:38 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:39.961060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:39.961688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:39.969158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:39.969663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:39.970103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:39.970823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:39.971280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:39.971710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:40.118109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:40.126453 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cdd3d4f5-1ebb-4904-a000-36db4a56b444 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.169253 Aug 29 05:51:40.127065 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3755/7501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:39 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:41.149701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:41.150280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:41.158119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:41.159916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:41.159916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:41.159916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:41.160265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:41.160682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:41.302988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:41.311121 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ff07578-4baf-4677-8786-a5f64812900f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.165787 Aug 29 05:51:41.311721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3747/7502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:41 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:42.339709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:42.340333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:42.347002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:42.347501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:42.347948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:42.348696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:42.349161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:42.349628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:42.508715 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:42.517331 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a8f433f6-c9c0-4c17-8efa-5c69464388c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.181933 Aug 29 05:51:42.517892 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3756/7503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:42 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:43.543480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:43.544071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:43.554047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:43.554705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:43.555348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:43.556346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:43.556925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:43.557535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:43.705807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:43.714335 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-27b74327-7799-4891-bb9f-af45e5dd676e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.177879 Aug 29 05:51:43.714899 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3748/7504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:43 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:44.735385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:44.736019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:44.744231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:44.744750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:44.745204 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:44.745934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:44.746439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:44.746902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:44.898019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:44.906590 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30b31838-2b52-4d26-8b35-f4ed1711c20b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.175084 Aug 29 05:51:44.907186 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3757/7505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:44 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:45.928741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:45.929362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:45.936748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:45.937236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:45.937661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:45.938363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:45.938784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:45.939198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:46.096848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:46.105533 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0a66dc8-e371-4079-bbe4-9ae1680f76cd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.180508 Aug 29 05:51:46.106413 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3749/7506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:45 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:47.127587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:47.128224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:47.135510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:47.135996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:47.136464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:47.137269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:47.137732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:47.138162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:47.277332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:47.285856 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c3b284ea-ecd8-445a-a7f5-aebd3d40453e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.162179 Aug 29 05:51:47.286422 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3758/7507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:47 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:48.307133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:48.307760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:48.315997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:48.316525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:48.316963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:48.317674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:48.318132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:48.318555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:48.472758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:48.481275 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a0d0f037-707f-4d50-963c-bff5d6efdbbf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.178054 Aug 29 05:51:48.481869 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3750/7508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:48 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:49.503352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:49.504596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:49.512567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:49.513079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:49.513530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:49.514259 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:49.514729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:49.515172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:49.653698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:49.662450 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4cfa42f5-ec2f-4d64-afc1-421810b00f82 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1683 microversion: 2.1 time: 0.163206 Aug 29 05:51:49.663389 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3759/7509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:49 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:50.237698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d99266a8-113a-418f-a54f-4400c9822410 req-ba7f9b54-4406-44b3-8ddf-6c360e245f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "name": "network-vif-unplugged", "status": "completed", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:51:50.248985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d99266a8-113a-418f-a54f-4400c9822410 req-ba7f9b54-4406-44b3-8ddf-6c360e245f5f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:50.249414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d99266a8-113a-418f-a54f-4400c9822410 req-ba7f9b54-4406-44b3-8ddf-6c360e245f5f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:50.249845 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d99266a8-113a-418f-a54f-4400c9822410 req-ba7f9b54-4406-44b3-8ddf-6c360e245f5f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:50.263405 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d99266a8-113a-418f-a54f-4400c9822410 req-ba7f9b54-4406-44b3-8ddf-6c360e245f5f service nova] Creating event network-vif-unplugged:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h1-854119-9 Aug 29 05:51:50.269455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-d99266a8-113a-418f-a54f-4400c9822410 req-ba7f9b54-4406-44b3-8ddf-6c360e245f5f service nova] Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:51:50.281440 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d99266a8-113a-418f-a54f-4400c9822410 req-ba7f9b54-4406-44b3-8ddf-6c360e245f5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047627 Aug 29 05:51:50.282246 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3751/7510] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:51:50.684704 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:50.685408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:50.692584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:50.693089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:50.693503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:50.694223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:50.694684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:50.695116 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:50.925134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:50.933424 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-269a7ffe-93a8-4c1d-8556-b813dfbad2d2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1682 microversion: 2.1 time: 0.252574 Aug 29 05:51:50.934090 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3760/7511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:50 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:51.958394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:51.959076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:51.966065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:51.966554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:51.966976 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:51.967668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:51.968112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:51.968566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:52.110129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:52.123620 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8d879c25-eabe-49f3-8aeb-64571aebd69f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1680 microversion: 2.1 time: 0.170979 Aug 29 05:51:52.124580 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3752/7512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:51 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:52.301996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d7272a67-50bc-42bc-8ba7-74a3c0d2dcd2 req-6e71da17-ba34-48cc-9fd6-4cc6ad9bbdca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:51:52.313265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d7272a67-50bc-42bc-8ba7-74a3c0d2dcd2 req-6e71da17-ba34-48cc-9fd6-4cc6ad9bbdca service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:52.313756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d7272a67-50bc-42bc-8ba7-74a3c0d2dcd2 req-6e71da17-ba34-48cc-9fd6-4cc6ad9bbdca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:52.314195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d7272a67-50bc-42bc-8ba7-74a3c0d2dcd2 req-6e71da17-ba34-48cc-9fd6-4cc6ad9bbdca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:52.327388 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d7272a67-50bc-42bc-8ba7-74a3c0d2dcd2 req-6e71da17-ba34-48cc-9fd6-4cc6ad9bbdca service nova] Creating event network-changed:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h1-854119-9 Aug 29 05:51:52.333383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-d7272a67-50bc-42bc-8ba7-74a3c0d2dcd2 req-6e71da17-ba34-48cc-9fd6-4cc6ad9bbdca service nova] Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:51:52.345300 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d7272a67-50bc-42bc-8ba7-74a3c0d2dcd2 req-6e71da17-ba34-48cc-9fd6-4cc6ad9bbdca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047075 Aug 29 05:51:52.345958 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3761/7513] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:51:53.150192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:53.150748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:53.158180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:53.158697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:53.159131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:53.159832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:53.160337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:53.160765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:53.300066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:53.308417 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3ed9dcfc-5716-43b5-b617-548901429aa9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1680 microversion: 2.1 time: 0.162334 Aug 29 05:51:53.309036 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3753/7514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:53 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:54.332218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:54.332932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:54.339473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:54.339984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:54.340441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:54.341156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:54.341614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:54.342050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:54.537643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:54.545854 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0c359a07-7dfd-4c59-b831-83bf452d8bbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1677 microversion: 2.1 time: 0.219595 Aug 29 05:51:54.546478 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3762/7515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:54 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:54.566366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:51:54.566933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:54.574341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:54.574872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:54.575307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:54.576009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:54.576493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:54.576917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:54.616669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:54.616669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:54.616669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:54.617217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:54.617434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:54.617857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:54.639465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:51:54.645252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for user bbc2df5c46bd4c629906f7da08f694e5 and project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:51:54.733664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:51:54.759758 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-872c4e74-9f19-464b-877b-90db4c7e7f4a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc/action" status: 202 len: 0 microversion: 2.1 time: 0.197088 Aug 29 05:51:54.760737 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3754/7516] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:51:54 2022] POST /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:51:54.769271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:54.770198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:54.776549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:54.777063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:54.777553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:54.778521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:54.779436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:54.779953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:55.007177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:55.021651 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d2b41a23-253a-4189-9103-ff88fa68476c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1676 microversion: 2.1 time: 0.256518 Aug 29 05:51:55.035755 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3763/7517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:54 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1676 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:56.043989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:56.044730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:56.053138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:56.053626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:56.054084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:56.054780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:56.055237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:56.055680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:56.191685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:56.200301 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dce154ba-3034-4213-a1f4-63ddb177bf65 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1676 microversion: 2.1 time: 0.160893 Aug 29 05:51:56.200915 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3755/7518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:56 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:56.916459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4e17ac5e-56bf-4a9a-beaa-1f9455f8c43b req-1208f51c-d654-47d3-8856-7ee2d9c674e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "name": "network-vif-plugged", "status": "completed", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:51:56.927462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4e17ac5e-56bf-4a9a-beaa-1f9455f8c43b req-1208f51c-d654-47d3-8856-7ee2d9c674e4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:56.927948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4e17ac5e-56bf-4a9a-beaa-1f9455f8c43b req-1208f51c-d654-47d3-8856-7ee2d9c674e4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:56.928419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4e17ac5e-56bf-4a9a-beaa-1f9455f8c43b req-1208f51c-d654-47d3-8856-7ee2d9c674e4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:56.941901 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4e17ac5e-56bf-4a9a-beaa-1f9455f8c43b req-1208f51c-d654-47d3-8856-7ee2d9c674e4 service nova] Creating event network-vif-plugged:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h1-854119-9 Aug 29 05:51:56.948343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-4e17ac5e-56bf-4a9a-beaa-1f9455f8c43b req-1208f51c-d654-47d3-8856-7ee2d9c674e4 service nova] Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:51:56.960172 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4e17ac5e-56bf-4a9a-beaa-1f9455f8c43b req-1208f51c-d654-47d3-8856-7ee2d9c674e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047813 Aug 29 05:51:56.960788 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3764/7519] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:51:57.221904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:57.222498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:57.229898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:57.230424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:57.230897 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:57.231600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:57.232056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:57.232524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:57.393429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:57.403215 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1d9c7d42-32fd-4125-8030-53797556dcaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1676 microversion: 2.1 time: 0.185162 Aug 29 05:51:57.403816 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3756/7520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:57 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:58.187057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c4052c1d-ed92-4a8d-a77c-b2d3c76d22a1 req-262182a9-e0b2-4095-812a-0c40af6f3f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "name": "network-vif-unplugged", "status": "completed", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:51:58.198206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c4052c1d-ed92-4a8d-a77c-b2d3c76d22a1 req-262182a9-e0b2-4095-812a-0c40af6f3f9f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:58.198923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c4052c1d-ed92-4a8d-a77c-b2d3c76d22a1 req-262182a9-e0b2-4095-812a-0c40af6f3f9f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:58.199700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c4052c1d-ed92-4a8d-a77c-b2d3c76d22a1 req-262182a9-e0b2-4095-812a-0c40af6f3f9f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:58.213008 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c4052c1d-ed92-4a8d-a77c-b2d3c76d22a1 req-262182a9-e0b2-4095-812a-0c40af6f3f9f service nova] Creating event network-vif-unplugged:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h2-854119-9 Aug 29 05:51:58.218380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-c4052c1d-ed92-4a8d-a77c-b2d3c76d22a1 req-262182a9-e0b2-4095-812a-0c40af6f3f9f service nova] Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:51:58.229746 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c4052c1d-ed92-4a8d-a77c-b2d3c76d22a1 req-262182a9-e0b2-4095-812a-0c40af6f3f9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048183 Aug 29 05:51:58.230749 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3765/7521] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:51:58.424793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:58.425426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:58.432263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:58.432716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:58.433393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:58.434139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:58.434591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:58.434985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:58.565385 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:58.573713 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1b09294c-4cee-4906-bc54-b1d7fc5f89b8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1676 microversion: 2.1 time: 0.152866 Aug 29 05:51:58.574331 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3757/7522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:58 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:51:59.602480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:51:59.603631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:51:59.612168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:59.612684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:59.613126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:59.613823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:51:59.614262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:51:59.614710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:51:59.755881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:51:59.764920 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ac900e7a-3a0f-4da6-91a4-bd6439394418 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1676 microversion: 2.1 time: 0.169716 Aug 29 05:51:59.765485 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3766/7523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:51:59 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:00.265458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-603747d2-154d-4de6-bf8e-ba997a3a11bb req-b9157490-950f-4634-b8f0-23c1a5d57a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:52:00.271173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:52:00.277543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-603747d2-154d-4de6-bf8e-ba997a3a11bb req-b9157490-950f-4634-b8f0-23c1a5d57a31 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:00.278065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-603747d2-154d-4de6-bf8e-ba997a3a11bb req-b9157490-950f-4634-b8f0-23c1a5d57a31 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:00.278493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-603747d2-154d-4de6-bf8e-ba997a3a11bb req-b9157490-950f-4634-b8f0-23c1a5d57a31 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:00.290917 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-603747d2-154d-4de6-bf8e-ba997a3a11bb req-b9157490-950f-4634-b8f0-23c1a5d57a31 service nova] Creating event network-changed:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h2-854119-9 Aug 29 05:52:00.296421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-603747d2-154d-4de6-bf8e-ba997a3a11bb req-b9157490-950f-4634-b8f0-23c1a5d57a31 service nova] Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:52:00.307249 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-603747d2-154d-4de6-bf8e-ba997a3a11bb req-b9157490-950f-4634-b8f0-23c1a5d57a31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046239 Aug 29 05:52:00.307843 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3758/7524] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:52:00.786279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:00.787274 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:00.790281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=33 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:52:00.797228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:00.797727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:00.798191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:00.798996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:00.799458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:00.799944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:00.803870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=91 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:52:00.945821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:00.958293 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-24075763-6766-4c14-97f8-61707bd591d0 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1676 microversion: 2.1 time: 0.175869 Aug 29 05:52:00.959166 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3767/7525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:00 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:01.983885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:01.984614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:01.993192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:01.993192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:01.993192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:01.993658 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:01.994027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:01.994449 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:02.135411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:02.145431 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23526129-d676-4654-841b-c972950e20ea tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1676 microversion: 2.1 time: 0.166753 Aug 29 05:52:02.146049 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3759/7526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:01 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:03.173198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:03.174194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:03.185151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:03.185650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:03.186099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:03.186808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:03.187275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:03.187707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:03.325209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:03.336057 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4e7196f5-9039-4d12-aa9a-d93cb429401c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1669 microversion: 2.1 time: 0.169854 Aug 29 05:52:03.336752 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3768/7527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:03 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:03.357818 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:03.358448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:03.365491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:03.365971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:03.366396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:03.367113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:03.367555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:03.367963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:03.814772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:03.826829 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-185bb462-dd45-496e-962b-a5cf62167790 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1669 microversion: 2.1 time: 0.473294 Aug 29 05:52:03.827633 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3760/7528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:03 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1669 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:03.851463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:03.852093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:03.858530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:03.859041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:03.859492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:03.860232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:03.860707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:03.861156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:03.998764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:04.007571 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ebdb2861-6a9a-47ae-b41e-c121f44ded69 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1669 microversion: 2.1 time: 0.159836 Aug 29 05:52:04.008547 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3769/7529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:03 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:04.028583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:04.028990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:04.036476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:04.037012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:04.037644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:04.038758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:04.039514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:04.039983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:04.070112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:52:04.155197 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-438070fd-a4b3-4ea2-805b-4e307c6afdf6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 204 len: 0 microversion: 2.1 time: 0.130548 Aug 29 05:52:04.155842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3761/7530] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:52:04 2022] DELETE /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:52:04.165569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:04.166342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:04.172937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:04.173622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:04.174610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:04.175240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:04.175796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:04.176387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:04.577332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:04.585861 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b2be8909-815c-411c-b550-fa7754b808c3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1675 microversion: 2.1 time: 0.424994 Aug 29 05:52:04.586476 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3770/7531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:04 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1675 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:04.612963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a405b67d-293a-4380-a4c9-a0bc57ce954e req-03e8a225-292b-42f0-aae1-e8f7eb969c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "name": "network-vif-plugged", "status": "completed", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:52:04.625167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a405b67d-293a-4380-a4c9-a0bc57ce954e req-03e8a225-292b-42f0-aae1-e8f7eb969c1f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:04.625654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a405b67d-293a-4380-a4c9-a0bc57ce954e req-03e8a225-292b-42f0-aae1-e8f7eb969c1f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:04.626090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a405b67d-293a-4380-a4c9-a0bc57ce954e req-03e8a225-292b-42f0-aae1-e8f7eb969c1f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:04.630567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:52:04.637768 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a405b67d-293a-4380-a4c9-a0bc57ce954e req-03e8a225-292b-42f0-aae1-e8f7eb969c1f service nova] Creating event network-vif-plugged:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h2-854119-9 Aug 29 05:52:04.642936 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a405b67d-293a-4380-a4c9-a0bc57ce954e req-03e8a225-292b-42f0-aae1-e8f7eb969c1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034152 Aug 29 05:52:04.643550 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3762/7532] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:52:05.608252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:05.608949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:05.616081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:05.616614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:05.617058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:05.617768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:05.618225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:05.618664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:05.754989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:05.763081 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-222a1a3d-a1c7-485e-862b-548f2f5ecc89 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1675 microversion: 2.1 time: 0.159250 Aug 29 05:52:05.763649 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3771/7533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:05 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:06.793259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:06.793910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:06.803211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:06.803703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:06.804172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:06.804874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:06.805324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:06.805742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:06.958344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:06.967241 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d07b1910-9ff2-4eca-bc12-be6106a65811 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 200 len: 1675 microversion: 2.1 time: 0.179693 Aug 29 05:52:06.967842 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3763/7534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:06 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:52:07.229487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d4014c9c-667c-410e-ae60-94630d62b2fd req-4f49be4e-3b7f-4fc6-aeb3-8f14f66f2097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc", "name": "network-vif-deleted", "tag": "68d3d76b-fe6c-426f-bcec-73f5a911235e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:52:07.243194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d4014c9c-667c-410e-ae60-94630d62b2fd req-4f49be4e-3b7f-4fc6-aeb3-8f14f66f2097 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:07.243684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d4014c9c-667c-410e-ae60-94630d62b2fd req-4f49be4e-3b7f-4fc6-aeb3-8f14f66f2097 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:07.244145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d4014c9c-667c-410e-ae60-94630d62b2fd req-4f49be4e-3b7f-4fc6-aeb3-8f14f66f2097 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:07.258703 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d4014c9c-667c-410e-ae60-94630d62b2fd req-4f49be4e-3b7f-4fc6-aeb3-8f14f66f2097 service nova] Creating event network-vif-deleted:68d3d76b-fe6c-426f-bcec-73f5a911235e for instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc on n-h2-854119-9 Aug 29 05:52:07.264807 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d4014c9c-667c-410e-ae60-94630d62b2fd req-4f49be4e-3b7f-4fc6-aeb3-8f14f66f2097 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040516 Aug 29 05:52:07.265835 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3772/7535] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:52:07.989141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:07.989728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:07.998804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:07.998804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:07.999207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:08.000154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:08.001400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:08.001546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:08.019881 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc HTTP/1.1 Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc'} Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:52:08.021695 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9a7c251b-f7cd-408a-b7d3-4c05c1fd6fb7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 404 len: 111 microversion: 2.1 time: 0.038211 Aug 29 05:52:08.025757 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3764/7536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:07 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:52:08.047303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:08.048170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:08.054932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:08.055442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:08.055891 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:08.056640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:08.057110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:08.057551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:08.072639 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc HTTP/1.1 Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc'} Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:52:08.074747 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6cc7733b-6835-4d35-aad7-87e3603904b1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 404 len: 111 microversion: 2.1 time: 0.040797 Aug 29 05:52:08.081004 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3773/7537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:08 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:52:08.126878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1182655613", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "5c1d24f6-b96a-4519-80f0-d994c365cbd4"}], "security_groups": [{"name": "tempest-securitygroup--1422042689"}], "key_name": "tempest-keypair-349192370", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:52:08.241459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] validate_networks() for [('5c1d24f6-b96a-4519-80f0-d994c365cbd4', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:52:08.631755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:52:08.632171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:52:08.632644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:52:08.633066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:52:08.633477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:52:08.642710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:08.643484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:08.643926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:08.644692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:08.645142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:08.645563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:08.662979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:52:08.668780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for user bbc2df5c46bd4c629906f7da08f694e5 and project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:52:08.681756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:52:08.684112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:52:08.733641 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ea7dc545-c64d-458b-8599-05e0062cf9c6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.610731 Aug 29 05:52:08.734299 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3765/7538] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:52:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:52:08.745583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3bff249f-9011-4f35-83cb-077b484e556c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:08.746187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3bff249f-9011-4f35-83cb-077b484e556c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:08.804519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3bff249f-9011-4f35-83cb-077b484e556c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:08.812501 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3bff249f-9011-4f35-83cb-077b484e556c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1238 microversion: 2.1 time: 0.070967 Aug 29 05:52:08.813063 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3774/7539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:08 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:52:09.834930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:09.835559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:09.843911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:09.844433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:09.844864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:09.845669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:09.846127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:09.846621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:09.916951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:09.925746 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-395ea09a-0e45-4a09-afea-dd6457e36395 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1298 microversion: 2.1 time: 0.095231 Aug 29 05:52:09.926495 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3766/7540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:09 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:10.948467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:10.949292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:10.956992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:10.957586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:10.958103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:10.958855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:10.959305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:10.959773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:11.098035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:11.106361 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-469a1357-a832-44ee-86a8-4ee84b94ae2c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1364 microversion: 2.1 time: 0.162199 Aug 29 05:52:11.106949 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3775/7541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:10 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:11.329497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-27073978-3b68-4c96-9d6d-7df5e7ca222f req-8d44a81f-d217-4119-a61f-e785c57876b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:52:11.341547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-27073978-3b68-4c96-9d6d-7df5e7ca222f req-8d44a81f-d217-4119-a61f-e785c57876b4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:11.342063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-27073978-3b68-4c96-9d6d-7df5e7ca222f req-8d44a81f-d217-4119-a61f-e785c57876b4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:11.342489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-27073978-3b68-4c96-9d6d-7df5e7ca222f req-8d44a81f-d217-4119-a61f-e785c57876b4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:11.358030 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-27073978-3b68-4c96-9d6d-7df5e7ca222f req-8d44a81f-d217-4119-a61f-e785c57876b4 service nova] Creating event network-changed:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h2-854119-9 Aug 29 05:52:11.363459 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-27073978-3b68-4c96-9d6d-7df5e7ca222f req-8d44a81f-d217-4119-a61f-e785c57876b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037444 Aug 29 05:52:11.364089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3767/7542] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:52:12.130065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:12.130869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:12.139887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:12.140556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:12.141101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:12.141970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:12.142548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:12.143093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:12.284338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:12.295384 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-68dc261b-5477-41f4-984c-7f31578205b7 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1364 microversion: 2.1 time: 0.170076 Aug 29 05:52:12.295994 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3776/7543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:12 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:13.317452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:13.318088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:13.326088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:13.326571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:13.327002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:13.327691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:13.328152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:13.328562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:13.469762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:13.477830 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f65a4a5d-7a51-45cb-bc21-0c1abed4a280 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1364 microversion: 2.1 time: 0.164831 Aug 29 05:52:13.478414 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3768/7544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:13 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:14.501314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:14.501925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:14.509914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:14.510447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:14.510902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:14.511613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:14.512224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:14.512608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:14.647207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:14.655138 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-22505f12-dc8f-4e39-9c40-afc826529f80 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1364 microversion: 2.1 time: 0.157789 Aug 29 05:52:14.655942 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3777/7545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:14 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:15.680649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:15.681288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:15.689663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:15.690151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:15.690603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:15.691289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:15.691739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:15.692232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:15.835124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:15.844494 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37b056ec-3073-4947-9cb0-ca07b73457c1 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1364 microversion: 2.1 time: 0.169936 Aug 29 05:52:15.845057 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3769/7546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:15 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:16.822279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8f7f0026-d871-4db9-a04f-d445b3592b95 req-94e4dcf3-c91d-49d9-ac5e-36b267e991a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "name": "network-vif-plugged", "status": "completed", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:52:16.834087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8f7f0026-d871-4db9-a04f-d445b3592b95 req-94e4dcf3-c91d-49d9-ac5e-36b267e991a6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:16.834698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8f7f0026-d871-4db9-a04f-d445b3592b95 req-94e4dcf3-c91d-49d9-ac5e-36b267e991a6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:16.835218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8f7f0026-d871-4db9-a04f-d445b3592b95 req-94e4dcf3-c91d-49d9-ac5e-36b267e991a6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:16.850013 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8f7f0026-d871-4db9-a04f-d445b3592b95 req-94e4dcf3-c91d-49d9-ac5e-36b267e991a6 service nova] Creating event network-vif-plugged:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h2-854119-9 Aug 29 05:52:16.855229 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8f7f0026-d871-4db9-a04f-d445b3592b95 req-94e4dcf3-c91d-49d9-ac5e-36b267e991a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036676 Aug 29 05:52:16.856366 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3778/7547] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:52:16.872902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:16.873501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:16.880607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:16.881113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:16.881545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:16.882238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:16.882680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:16.883099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:17.037010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:17.046312 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b1d5ca74-4e30-4c0e-afe3-1c3aa4cb3bef tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1364 microversion: 2.1 time: 0.177715 Aug 29 05:52:17.046964 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3770/7548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:16 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:18.073454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:18.074284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:18.080973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:18.081507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:18.082103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:18.082821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:18.083314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:18.083757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:18.222448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:18.230686 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a7cd5550-0d3e-451a-8a01-dde39600c168 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1364 microversion: 2.1 time: 0.162721 Aug 29 05:52:18.231265 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3779/7549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:18 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:19.253463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:19.254023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:19.256904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:52:19.257568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:52:19.264165 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:19.264681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:19.265126 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:19.265822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:19.266278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:19.266702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:19.408319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:52:19.416626 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-989c5f39-bf84-4582-998f-8bf9e91e5cd2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1552 microversion: 2.1 time: 0.167054 Aug 29 05:52:19.417175 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3771/7550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:52:19 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:52:19.437566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3bf4bf8b-c8c9-4555-9286-068ac6d8d60c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:52:19.438084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3bf4bf8b-c8c9-4555-9286-068ac6d8d60c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:52:19.440060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:52:19.446275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf4bf8b-c8c9-4555-9286-068ac6d8d60c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:19.446767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf4bf8b-c8c9-4555-9286-068ac6d8d60c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:19.447211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf4bf8b-c8c9-4555-9286-068ac6d8d60c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:19.448264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf4bf8b-c8c9-4555-9286-068ac6d8d60c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:19.448733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf4bf8b-c8c9-4555-9286-068ac6d8d60c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:19.449207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3bf4bf8b-c8c9-4555-9286-068ac6d8d60c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:19.528194 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3bf4bf8b-c8c9-4555-9286-068ac6d8d60c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094615 Aug 29 05:52:19.528810 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3780/7551] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:52:19 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:52:20.535632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c8ad0cbb-ffc8-4caa-82ea-7f431c6209a3 req-4ed810c6-0e5d-4e48-98ca-1e079c2e33c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:52:20.546607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c8ad0cbb-ffc8-4caa-82ea-7f431c6209a3 req-4ed810c6-0e5d-4e48-98ca-1e079c2e33c6 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:52:20.547167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c8ad0cbb-ffc8-4caa-82ea-7f431c6209a3 req-4ed810c6-0e5d-4e48-98ca-1e079c2e33c6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:52:20.547693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c8ad0cbb-ffc8-4caa-82ea-7f431c6209a3 req-4ed810c6-0e5d-4e48-98ca-1e079c2e33c6 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:52:20.560077 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c8ad0cbb-ffc8-4caa-82ea-7f431c6209a3 req-4ed810c6-0e5d-4e48-98ca-1e079c2e33c6 service nova] Creating event network-changed:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h2-854119-9 Aug 29 05:52:20.565243 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c8ad0cbb-ffc8-4caa-82ea-7f431c6209a3 req-4ed810c6-0e5d-4e48-98ca-1e079c2e33c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033475 Aug 29 05:52:20.565867 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3772/7552] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:53:33.922822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=29 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:53:33.923663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=63 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:53:33.924756 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:53:33.924879 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:53:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 (ip 10.222.0.20) !!! Aug 29 05:53:33.926649 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:53:33.926754 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 05:53:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 (ip 10.222.0.20) !!! Aug 29 05:53:33.931883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:33.932548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:33.947267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:33.948000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:33.948725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:33.949722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:33.950211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:33.950806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:34.154777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:34.166803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8bd5b249-3b7c-42d8-a43f-0383ae9259ee tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1670 microversion: 2.1 time: 0.246589 Aug 29 05:53:34.167382 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3781/7553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:33 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1670 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:34.187031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:53:34.187774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:53:34.189032 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:53:34.189175 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:53:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/os-volume_attachments (ip 10.222.0.20) !!! Aug 29 05:53:34.195950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9362a145-df0b-46b9-8ee0-d54d8855e8f6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09407244-55cd-41e7-921c-df3ba8b9214f"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:53:34.198819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9362a145-df0b-46b9-8ee0-d54d8855e8f6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:34.209096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9362a145-df0b-46b9-8ee0-d54d8855e8f6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:34.209579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9362a145-df0b-46b9-8ee0-d54d8855e8f6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:34.210013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9362a145-df0b-46b9-8ee0-d54d8855e8f6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:34.210702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9362a145-df0b-46b9-8ee0-d54d8855e8f6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:34.211146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9362a145-df0b-46b9-8ee0-d54d8855e8f6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:34.211569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9362a145-df0b-46b9-8ee0-d54d8855e8f6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:34.663038 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9362a145-df0b-46b9-8ee0-d54d8855e8f6 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478568 Aug 29 05:53:34.663669 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3773/7554] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:53:34 2022] POST /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:53:45.466618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:53:45.469985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:45.473237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:53:45.474020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:53:45.480151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:45.480678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:45.481160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:45.481895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:45.482385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:45.482820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:45.609197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:45.616635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Old instance type m1.heat2, new instance type m1.heat {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 05:53:45.624191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:53:45.624657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:53:45.625178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:53:45.625680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:53:45.626094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:53:45.706486 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86137498-1dce-457f-88ed-de421a865ee8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/action" status: 202 len: 0 microversion: 2.1 time: 0.247126 Aug 29 05:53:45.707382 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3782/7555] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:53:45 2022] POST /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:53:45.713733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:53:45.714669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:53:45.719376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:45.719982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:45.727909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:45.728481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:45.729083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:45.729817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:45.730350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:45.730834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:45.872205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:45.880791 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9df96e49-328b-489c-9ae8-5602725da704 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1725 microversion: 2.1 time: 0.169074 Aug 29 05:53:45.881368 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3774/7556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:45 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:53:46.906809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:46.907848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:46.918332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:46.918841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:46.919327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:46.920051 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:46.920557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:46.920996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:47.066289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:47.075471 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7507d5cf-3153-47cb-a29d-b44e4dd744bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1725 microversion: 2.1 time: 0.175129 Aug 29 05:53:47.075873 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3783/7557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:46 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:48.101476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:48.102501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:48.113978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:48.114792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:48.115515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:48.116763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:48.117574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:48.118329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:48.256432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:48.265201 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9b941fbc-db37-4de4-bb7c-3e74d70921cc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1725 microversion: 2.1 time: 0.170521 Aug 29 05:53:48.265798 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3775/7558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:48 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:49.289445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:49.290133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:49.298137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:49.298719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:49.299194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:49.299973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:49.300514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:49.301005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:49.438306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:49.446784 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fe9b6232-e109-49b9-86bd-4d643d78a4ed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1725 microversion: 2.1 time: 0.161764 Aug 29 05:53:49.447726 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3784/7559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:49 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:50.475074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:50.475712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:50.484228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:50.484734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:50.486231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:50.486945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:50.487404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:50.487832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:50.627811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:50.638592 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-79609dde-c4d1-4e07-b3d8-780ee21952fa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1725 microversion: 2.1 time: 0.167585 Aug 29 05:53:50.639169 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3776/7560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:50 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:51.660143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:51.660821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:51.668502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:51.669005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:51.669485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:51.670199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:51.670681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:51.671124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:51.818243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:51.829039 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-51634167-5ea4-457d-8a90-840a7427aac5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.172913 Aug 29 05:53:51.829620 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3785/7561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:51 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:52.854987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:52.855590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:52.862930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:52.863414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:52.863847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:52.864569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:52.865017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:52.865438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:53.009941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:53.018798 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-56b13af3-61ef-4370-9b37-457fb71a207a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.169529 Aug 29 05:53:53.019379 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3777/7562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:52 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:54.044532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:54.045565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:54.056828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:54.057330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:54.058013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:54.058463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:54.058937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:54.059372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:54.195854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:54.208904 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b679d91-e5e3-42e9-8fe0-7ed6a96f74e3 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.170558 Aug 29 05:53:54.209685 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3786/7563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:54 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:55.235856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:55.237015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:55.249334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:55.250179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:55.250985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:55.252182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:55.252994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:55.253721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:55.406345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:55.415006 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af382b4b-22ee-495d-9733-511935144a44 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.186408 Aug 29 05:53:55.415599 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3778/7564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:55 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:56.441073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:56.442220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:56.451669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:56.452159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:56.452642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:56.453358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:56.453826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:56.454260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:56.589751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:56.601639 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-edf3db57-d104-4bac-8e3c-df6864ee763d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.166921 Aug 29 05:53:56.602459 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3787/7565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:56 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:57.623713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:57.624360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:57.631669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:57.632150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:57.632610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:57.633305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:57.633758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:57.634244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:57.777183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:57.785952 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-100bdeff-dc26-492c-87bf-4bdc25983919 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.166251 Aug 29 05:53:57.786587 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3779/7566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:57 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:58.810821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:58.811520 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:53:58.820310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:58.820814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:58.821331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:58.822183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:53:58.823046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:53:58.823553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:53:58.963195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:53:58.972083 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5549ba41-53fe-44f1-9d9e-fee2964c61bf tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.167006 Aug 29 05:53:58.972728 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3788/7567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:58 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:53:59.993869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:53:59.994575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:00.001802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:00.002285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:00.002711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:00.003402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:00.003842 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:00.004287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:00.138659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:00.150928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-300fb27f-e9c1-481d-ad8d-255e49d1b827 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.161079 Aug 29 05:54:00.151512 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3780/7568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:53:59 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:01.176328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:01.177211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:01.189077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:01.189896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:01.190641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:01.191798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:01.192675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:01.193443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:01.331844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:01.344182 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1a548e03-c557-4a38-a700-b04704406a24 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.174096 Aug 29 05:54:01.344813 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3789/7569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:01 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:02.372713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:02.373815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:02.385236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:02.386050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:02.386780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:02.387951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:02.388761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:02.389474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:02.533422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:02.545641 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-41f80986-0d0a-41a8-8e34-c14e846f747e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.179517 Aug 29 05:54:02.546484 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3781/7570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:02 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:03.574483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:03.575339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:03.584136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:03.584754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:03.585308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:03.586178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:03.586755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:03.587323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:03.724464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:03.733543 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8ffab72e-c3f5-4d9e-80bf-fad8ed496c22 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.165383 Aug 29 05:54:03.734130 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3790/7571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:03 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:04.767014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:04.767985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:04.778002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:04.778443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:04.778901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:04.779586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:04.780024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:04.780480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:04.914032 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:04.922670 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ceca323e-284a-4b0a-9970-cfdfd42cebbe tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.162642 Aug 29 05:54:04.923224 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3782/7572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:04 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:05.944568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:05.945199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:05.952866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:05.953365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:05.953813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:05.954523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:05.954988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:05.955424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:06.100449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:06.112804 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e2b9ccd-0d3e-4569-a810-e04d09d8719a tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.171922 Aug 29 05:54:06.113597 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3791/7573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:05 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:07.135682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:07.136322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:07.145155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:07.145808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:07.146349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:07.147278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:07.147928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:07.148553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:07.287207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:07.295886 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bdffec81-4b38-423d-b2d9-b360575a7d9e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.164243 Aug 29 05:54:07.296493 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3783/7574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:07 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:08.321979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:08.323203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:08.334806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:08.335630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:08.336426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:08.337549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:08.338040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:08.338492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:08.486134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:08.495063 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7cb0af8c-8339-4034-beed-c86c1cc0ad41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.179872 Aug 29 05:54:08.495636 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3792/7575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:08 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:09.516898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:09.517519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:09.524291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:09.524798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:09.525223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:09.525908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:09.526364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:09.526782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:09.659775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:09.668673 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9e1ada2d-1cec-4f13-93d2-116a3107687f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.155959 Aug 29 05:54:09.669247 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3784/7576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:09 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:10.690321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:10.691085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:10.698901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:10.699416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:10.699867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:10.700620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:10.701074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:10.701503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:10.844672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:10.853614 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-36c02368-72af-4c32-8f13-3cdf75071fbd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1730 microversion: 2.1 time: 0.167290 Aug 29 05:54:10.854315 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3793/7577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:10 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:11.208551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ee57730d-0cff-49ef-ae7d-b287ca41e952 req-8f4dbcf1-0435-4b5d-9aab-37548ec1e9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "name": "network-vif-unplugged", "status": "completed", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:54:11.226259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ee57730d-0cff-49ef-ae7d-b287ca41e952 req-8f4dbcf1-0435-4b5d-9aab-37548ec1e9cc service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:11.226962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ee57730d-0cff-49ef-ae7d-b287ca41e952 req-8f4dbcf1-0435-4b5d-9aab-37548ec1e9cc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:11.227647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ee57730d-0cff-49ef-ae7d-b287ca41e952 req-8f4dbcf1-0435-4b5d-9aab-37548ec1e9cc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:11.241827 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ee57730d-0cff-49ef-ae7d-b287ca41e952 req-8f4dbcf1-0435-4b5d-9aab-37548ec1e9cc service nova] Creating event network-vif-unplugged:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h1-854119-9 Aug 29 05:54:11.248332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-ee57730d-0cff-49ef-ae7d-b287ca41e952 req-8f4dbcf1-0435-4b5d-9aab-37548ec1e9cc service nova] Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:54:11.263205 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ee57730d-0cff-49ef-ae7d-b287ca41e952 req-8f4dbcf1-0435-4b5d-9aab-37548ec1e9cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058742 Aug 29 05:54:11.264076 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3785/7578] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:54:11.875280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:11.875944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:11.882283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:11.882788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:11.883235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:11.884039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:11.884550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:11.885088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:12.038502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2d431eb3-5f62-45a1-8cbb-102c886efa69 req-72dc9636-871f-4ae2-b490-9442abb8419d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:54:12.048461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2d431eb3-5f62-45a1-8cbb-102c886efa69 req-72dc9636-871f-4ae2-b490-9442abb8419d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:12.049019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2d431eb3-5f62-45a1-8cbb-102c886efa69 req-72dc9636-871f-4ae2-b490-9442abb8419d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:12.049517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2d431eb3-5f62-45a1-8cbb-102c886efa69 req-72dc9636-871f-4ae2-b490-9442abb8419d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:12.062004 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2d431eb3-5f62-45a1-8cbb-102c886efa69 req-72dc9636-871f-4ae2-b490-9442abb8419d service nova] Creating event network-changed:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h1-854119-9 Aug 29 05:54:12.068029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-2d431eb3-5f62-45a1-8cbb-102c886efa69 req-72dc9636-871f-4ae2-b490-9442abb8419d service nova] Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:54:12.079738 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2d431eb3-5f62-45a1-8cbb-102c886efa69 req-72dc9636-871f-4ae2-b490-9442abb8419d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045418 Aug 29 05:54:12.080530 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3786/7579] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:54:12.150613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:12.171387 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f604a993-9a21-42ce-a102-948ba4e254d5 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1729 microversion: 2.1 time: 0.300041 Aug 29 05:54:12.172063 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3794/7580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:11 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:13.195766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:13.196501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:13.203366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:13.203857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:13.204327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:13.205014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:13.205457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:13.205855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:13.346840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:13.355730 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4c1ecd50-ec7b-47b2-bbb0-5b281ff555ae tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.165214 Aug 29 05:54:13.356570 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3787/7581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:13 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:14.377400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:14.378007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:14.385413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:14.385938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:14.386365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:14.387082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:14.387548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:14.387985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:14.527150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:14.535791 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4df41bd6-3283-43e3-a489-bd0d2ef1fddc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.162364 Aug 29 05:54:14.536542 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3795/7582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:14 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:15.558261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:15.559316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:15.566717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:15.567185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:15.567638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:15.568374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:15.568827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:15.569252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:15.707475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:15.716646 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a29bd8b9-d6b2-41aa-b4f6-e3d57f787ff8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.162411 Aug 29 05:54:15.717272 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3788/7583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:15 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:16.740182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:16.740773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:16.743562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=33 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:54:16.749517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:16.749942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:16.750371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:16.751079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:16.751543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:16.751983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:16.754789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:54:16.890366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:16.899743 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ed4f856d-d59c-46dc-8dba-96977503abb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.163553 Aug 29 05:54:16.900358 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3796/7584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:16 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:17.921669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:17.922299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:17.925264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=31 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:54:17.930816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:17.931303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:17.931742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:17.932473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:17.932925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:17.933373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:17.936101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=87 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:54:18.067843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:18.076762 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a748f30-dea4-4e57-ab89-71ad14a7beaa tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.159039 Aug 29 05:54:18.077318 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3789/7585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:17 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:19.098686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:19.099712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:19.107218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:19.107709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:19.108187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:19.108930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:19.109405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:19.109831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:19.253703 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:19.262416 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dba50a92-2c09-4588-8bf8-a68e2212a888 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.167925 Aug 29 05:54:19.263027 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3797/7586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:19 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:20.286647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:20.287348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:20.296160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:20.296820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:20.297329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:20.298146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:20.298681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:20.299177 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:20.456531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:20.464904 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3ad8376a-47a3-4490-af7a-0502296549ba tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.183125 Aug 29 05:54:20.465470 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3790/7587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:20 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:21.486035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:21.486697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:21.494199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:21.494712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:21.495171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:21.495878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:21.496376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:21.496811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:21.628384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:21.639623 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3752ac3b-09e4-466c-ba43-64c3a618ab07 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.155035 Aug 29 05:54:21.640284 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3798/7588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:21 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:22.668695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:22.669523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:22.679148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:22.679791 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:22.680437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:22.681408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:22.681997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:22.682552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:22.825858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:22.834877 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4baf7a91-c772-4cf2-8a6f-3b2093260c64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.171646 Aug 29 05:54:22.835449 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3791/7589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:22 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:23.857882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:23.858492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:23.864914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:23.865460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:23.865914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:23.866639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:23.867104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:23.867541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:24.008367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:24.017547 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d502f52a-c802-483f-bdb0-bcb6ffa8e169 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.164668 Aug 29 05:54:24.018147 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3799/7590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:23 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:25.043831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:25.044778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:25.053649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:25.054132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:25.054565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:25.055275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:25.055724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:25.056155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:25.194911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:25.204064 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80063efb-46b5-4cdb-95f6-af01dac6bd41 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.167110 Aug 29 05:54:25.204740 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3792/7591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:25 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:26.229363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:26.230421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:26.242260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:26.243088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:26.243833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:26.245054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:26.245836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:26.246565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:26.389176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:26.402603 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3ea4c90c-1cfe-4a23-96f0-5ed10d80202e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1727 microversion: 2.1 time: 0.179776 Aug 29 05:54:26.403400 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3800/7592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:26 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:27.426104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:27.426801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:27.434328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:27.434788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:27.435249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:27.435947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:27.436427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:27.436850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:27.570599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:27.580373 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e8de8055-983a-46f5-93b9-5521350821b4 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1724 microversion: 2.1 time: 0.158257 Aug 29 05:54:27.580969 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3793/7593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:27 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:27.604009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:54:27.604668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:27.612215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:27.612821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:27.613350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:27.614193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:27.614719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:27.615218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:27.656564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:27.657056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:27.657583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:27.658315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:27.658772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:27.659193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:27.682741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:54:27.688540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Getting quotas for user bbc2df5c46bd4c629906f7da08f694e5 and project 6078095aa4044d27813d2b678396a21e. Resources: {'ram', 'cores'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:54:27.808754 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3678fa46-e00a-4e1f-9dcd-97e7f12af45f tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "POST /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/action" status: 202 len: 0 microversion: 2.1 time: 0.209826 Aug 29 05:54:27.809598 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3801/7594] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:54:27 2022] POST /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 05:54:27.818376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:27.819081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:27.826421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:27.827005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:27.827441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:27.828179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:27.828634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:27.829108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:28.037195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:28.045894 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ef1731c1-8072-4d48-b763-79982684a311 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.231763 Aug 29 05:54:28.046489 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3794/7595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:27 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:29.076376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:29.077665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:29.090015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:29.090842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:29.091579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:29.092787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:29.093603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:29.094278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:29.534048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b54b7653-82e7-408a-824d-20be1b48276c req-17f2431e-8002-4f6d-b533-d1c68ab109fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "name": "network-vif-plugged", "status": "completed", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:54:29.547794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b54b7653-82e7-408a-824d-20be1b48276c req-17f2431e-8002-4f6d-b533-d1c68ab109fd service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:29.548606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b54b7653-82e7-408a-824d-20be1b48276c req-17f2431e-8002-4f6d-b533-d1c68ab109fd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:29.549170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b54b7653-82e7-408a-824d-20be1b48276c req-17f2431e-8002-4f6d-b533-d1c68ab109fd service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:29.557751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:29.561758 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b54b7653-82e7-408a-824d-20be1b48276c req-17f2431e-8002-4f6d-b533-d1c68ab109fd service nova] Creating event network-vif-plugged:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h1-854119-9 Aug 29 05:54:29.566868 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-31ab0ae3-a0ef-4aa2-ba2a-6d67d2f5b494 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.499516 Aug 29 05:54:29.567240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-b54b7653-82e7-408a-824d-20be1b48276c req-17f2431e-8002-4f6d-b533-d1c68ab109fd service nova] Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:54:29.568627 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3802/7596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:29 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:29.579726 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b54b7653-82e7-408a-824d-20be1b48276c req-17f2431e-8002-4f6d-b533-d1c68ab109fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050186 Aug 29 05:54:29.580519 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3795/7597] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:54:30.594628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:30.595334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:30.602764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:30.603338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:30.603722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:30.604799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:30.605636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:30.606416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:30.743810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:30.752690 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95ce36dc-3946-497e-8000-991de8992260 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.162016 Aug 29 05:54:30.753403 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3803/7598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:30 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:54:31.776105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:31.776906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:31.783589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:31.784083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:31.784528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:31.785216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:31.785657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:31.786071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:31.926643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:31.935187 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3a7e033e-6c6a-4c93-89c9-5c692ec9fafc tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.164346 Aug 29 05:54:31.935748 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3796/7599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:31 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:32.957124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:32.958428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:32.965552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:32.966126 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:32.966614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:32.967334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:32.968046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:32.968606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:33.105305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:33.117761 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9cecc774-1159-4efd-a481-421501ac6c52 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.164121 Aug 29 05:54:33.118582 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3804/7600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:32 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:33.303607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-161c662a-4436-4325-8407-a6801cd0dbc3 req-decc1878-fc10-4bff-a0e5-08b1c03dd41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "name": "network-vif-unplugged", "status": "completed", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:54:33.315104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-161c662a-4436-4325-8407-a6801cd0dbc3 req-decc1878-fc10-4bff-a0e5-08b1c03dd41e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:33.315590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-161c662a-4436-4325-8407-a6801cd0dbc3 req-decc1878-fc10-4bff-a0e5-08b1c03dd41e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:33.316020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-161c662a-4436-4325-8407-a6801cd0dbc3 req-decc1878-fc10-4bff-a0e5-08b1c03dd41e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:33.329179 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-161c662a-4436-4325-8407-a6801cd0dbc3 req-decc1878-fc10-4bff-a0e5-08b1c03dd41e service nova] Creating event network-vif-unplugged:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h2-854119-9 Aug 29 05:54:33.335020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-161c662a-4436-4325-8407-a6801cd0dbc3 req-decc1878-fc10-4bff-a0e5-08b1c03dd41e service nova] Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:54:33.346037 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-161c662a-4436-4325-8407-a6801cd0dbc3 req-decc1878-fc10-4bff-a0e5-08b1c03dd41e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047217 Aug 29 05:54:33.346819 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3797/7601] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:54:34.144528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:34.145103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:34.152283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:34.152784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:34.153227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:34.153969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:34.154503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:34.154936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:34.287526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:34.296146 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ee01435d-1c35-49cb-8b8e-c5ca79d0bbd9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.155668 Aug 29 05:54:34.296730 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3805/7602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:34 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:35.319250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:35.320090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:35.327010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:35.327492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:35.327921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:35.328650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:35.329095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:35.329515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:35.386360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-0b51c8a8-bf29-46cd-aad8-0778573dc70d req-92c1c2a5-b409-4280-8ecf-e11932aea014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:54:35.403392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0b51c8a8-bf29-46cd-aad8-0778573dc70d req-92c1c2a5-b409-4280-8ecf-e11932aea014 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:35.406989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0b51c8a8-bf29-46cd-aad8-0778573dc70d req-92c1c2a5-b409-4280-8ecf-e11932aea014 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:35.407752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-0b51c8a8-bf29-46cd-aad8-0778573dc70d req-92c1c2a5-b409-4280-8ecf-e11932aea014 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:35.421787 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-0b51c8a8-bf29-46cd-aad8-0778573dc70d req-92c1c2a5-b409-4280-8ecf-e11932aea014 service nova] Creating event network-changed:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h2-854119-9 Aug 29 05:54:35.428013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-0b51c8a8-bf29-46cd-aad8-0778573dc70d req-92c1c2a5-b409-4280-8ecf-e11932aea014 service nova] Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 05:54:35.439664 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-0b51c8a8-bf29-46cd-aad8-0778573dc70d req-92c1c2a5-b409-4280-8ecf-e11932aea014 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057114 Aug 29 05:54:35.440965 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3806/7603] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:54:35.471721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:35.481862 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75a84248-6bf0-42cc-ad70-36d38f617405 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.167871 Aug 29 05:54:35.483159 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3798/7604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:35 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:36.512008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:36.513008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:36.521035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:36.521547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:36.521991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:36.522709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:36.523179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:36.523612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:36.658161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:36.666700 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c925e53-4481-4eea-b476-20b773184a77 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.161285 Aug 29 05:54:36.667277 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3807/7605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:36 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:37.688958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:37.689745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:37.706876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:37.707515 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:37.708071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:37.708892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:37.714197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:37.714681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:37.863470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:37.872404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75509782-d5e4-44d7-b864-c1ccce0961b9 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.187627 Aug 29 05:54:37.873438 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3799/7606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:37 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:38.896306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:38.896306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:38.899221 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:54:38.903511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:38.904030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:38.904490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:38.905214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:38.905682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:38.906117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:39.043386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:39.051899 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-49e23e38-06f9-4784-83ce-10c39d926e6c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.161351 Aug 29 05:54:39.052519 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3808/7607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:38 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:40.081977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:40.082562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:40.089136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:40.089628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:40.090065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:40.090759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:40.091206 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:40.091607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:40.229569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:40.238182 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1aef1d36-9110-4699-8372-7b6934f05776 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.162142 Aug 29 05:54:40.238732 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3800/7608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:40 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:41.272026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:41.273131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:41.283971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:41.284515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:41.284959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:41.285669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:41.286136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:41.286576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:41.424613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:41.433500 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eec29c57-bbb0-43b2-be2a-ad56af3c5144 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.168057 Aug 29 05:54:41.434098 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3809/7609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:41 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:42.458492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:42.459118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:42.466879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:42.467364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:42.467859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:42.468623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:42.469099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:42.469546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:42.616456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:42.628404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-25eb6264-56d9-4d0d-a89a-32e0b019159d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.175066 Aug 29 05:54:42.628984 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3801/7610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:42 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:43.707567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:43.708207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:43.715644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:43.716155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:43.716717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:43.717417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:43.717880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:43.718311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:43.720868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:54:43.857213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:43.865918 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-61f9d57e-9cd4-4c3a-8fdd-233e3c3841bd tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.163919 Aug 29 05:54:43.866500 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3810/7611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:43 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:44.889343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:44.890048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:44.898631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:44.898631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:44.899097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:44.900173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:44.900173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:44.900540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:45.036025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:45.044420 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-788942c2-f6c9-4f15-a8b1-8c22653e13ff tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.159083 Aug 29 05:54:45.044997 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3802/7612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:44 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:46.065856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:46.066481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:46.074094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:46.074584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:46.075023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:46.075720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:46.076182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:46.076634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:46.212642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:46.223237 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a4a02a5a-3805-4a44-bf4c-b8510c02ae58 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.161050 Aug 29 05:54:46.224220 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3811/7613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:46 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:47.249932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:47.250548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:47.257703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:47.258198 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:47.258638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:47.259347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:47.259799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:47.260249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:47.405168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:47.414062 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed7cabdb-3776-4d15-b11b-35a9cc1b9003 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1723 microversion: 2.1 time: 0.168134 Aug 29 05:54:47.414958 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3803/7614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:47 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:48.440446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:48.441514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:48.446054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:54:48.455473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:48.455975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:48.456441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:48.457142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:48.457603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:48.458033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:48.612416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:48.621416 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3988b202-9dfe-40d5-b7f1-013fe97c4bdb tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1716 microversion: 2.1 time: 0.187699 Aug 29 05:54:48.621993 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3812/7615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:48 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1716 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:48.642463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:48.643330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:48.646171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=30 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:54:48.651812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:48.652333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:48.652763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:48.653498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:48.654043 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:48.654458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:48.658599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=86 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:54:48.799238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:48.807963 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2908c637-fa03-465e-9ba1-8366cf55126e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1716 microversion: 2.1 time: 0.169467 Aug 29 05:54:48.808565 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3804/7616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:48 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:48.828708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:48.829340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:48.835564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:48.836062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:48.836547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:48.837283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:48.837736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:48.838189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:48.972582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:48.981379 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bcfe839f-594d-4635-8f96-e9a2e983f69b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1716 microversion: 2.1 time: 0.156556 Aug 29 05:54:48.981951 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3813/7617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:48 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:54:49.001975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:49.002395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:49.008825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:49.009332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:49.009762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:49.010448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:49.010892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:49.011311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:49.037312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:54:49.118695 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f53e7a7e-4ddd-4fd7-acd3-e41066eab540 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 204 len: 0 microversion: 2.1 time: 0.120538 Aug 29 05:54:49.119679 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3805/7618] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:54:48 2022] DELETE /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:54:49.128144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:49.128793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:49.135122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:49.135617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:49.136063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:49.136804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:49.137267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:49.137701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:49.273808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:49.282225 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-44d952bf-af0b-4f0d-a11e-a4aafbd3ab3e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1722 microversion: 2.1 time: 0.158031 Aug 29 05:54:49.282794 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3814/7619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:49 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:49.423329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-01497c06-7350-42f7-9877-bccf079afb29 req-8dfdef69-0bd2-4b65-b4e2-ef33e742c716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "name": "network-vif-plugged", "status": "completed", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:54:49.432832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-01497c06-7350-42f7-9877-bccf079afb29 req-8dfdef69-0bd2-4b65-b4e2-ef33e742c716 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:49.433343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-01497c06-7350-42f7-9877-bccf079afb29 req-8dfdef69-0bd2-4b65-b4e2-ef33e742c716 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:49.433721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-01497c06-7350-42f7-9877-bccf079afb29 req-8dfdef69-0bd2-4b65-b4e2-ef33e742c716 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:49.445512 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-01497c06-7350-42f7-9877-bccf079afb29 req-8dfdef69-0bd2-4b65-b4e2-ef33e742c716 service nova] Creating event network-vif-plugged:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h2-854119-9 Aug 29 05:54:49.450868 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-01497c06-7350-42f7-9877-bccf079afb29 req-8dfdef69-0bd2-4b65-b4e2-ef33e742c716 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031655 Aug 29 05:54:49.451635 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3806/7620] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:54:50.307965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:50.309015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:50.318653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:50.319159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:50.319608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:50.320361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:50.320838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:50.321277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:50.477054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:50.485628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c1f8a44-8ca7-4aa8-85d4-833849fbba84 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1722 microversion: 2.1 time: 0.184328 Aug 29 05:54:50.486174 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3815/7621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:50 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:51.511629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:51.512748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:51.519226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:51.519722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:51.520175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:51.520892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:51.521377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:51.521804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:51.599256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:51.607977 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2045bb06-3eec-4950-837a-c77e30672740 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1654 microversion: 2.1 time: 0.103431 Aug 29 05:54:51.608913 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3807/7622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:51 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1654 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:51.827261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c5a9d5df-f5a3-40e7-aeb0-9b7bec612162 req-6edd8b4c-60d7-49c2-b05b-ac34c19ee318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedd0559-12b1-442c-8b36-c669cb4e26e2", "name": "network-vif-deleted", "tag": "15102da3-9eac-44ce-abca-b647af2c55dd"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:54:51.839942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c5a9d5df-f5a3-40e7-aeb0-9b7bec612162 req-6edd8b4c-60d7-49c2-b05b-ac34c19ee318 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:51.840482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c5a9d5df-f5a3-40e7-aeb0-9b7bec612162 req-6edd8b4c-60d7-49c2-b05b-ac34c19ee318 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:51.840924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c5a9d5df-f5a3-40e7-aeb0-9b7bec612162 req-6edd8b4c-60d7-49c2-b05b-ac34c19ee318 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:51.853374 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c5a9d5df-f5a3-40e7-aeb0-9b7bec612162 req-6edd8b4c-60d7-49c2-b05b-ac34c19ee318 service nova] Creating event network-vif-deleted:15102da3-9eac-44ce-abca-b647af2c55dd for instance cedd0559-12b1-442c-8b36-c669cb4e26e2 on n-h2-854119-9 Aug 29 05:54:51.859052 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c5a9d5df-f5a3-40e7-aeb0-9b7bec612162 req-6edd8b4c-60d7-49c2-b05b-ac34c19ee318 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035675 Aug 29 05:54:51.859663 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3816/7623] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:54:52.629984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:52.630591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:52.638392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:52.638857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:52.639321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:52.640002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:52.640530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:52.640948 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:52.710369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:52.719845 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-33dad89d-560d-4b6e-973b-ab554b3db163 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1369 microversion: 2.1 time: 0.093920 Aug 29 05:54:52.720481 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3808/7624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:52 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:53.743000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:53.743720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:53.750797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:53.751292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:53.751740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:53.752525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:53.752997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:53.753444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:53.819493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:53.828572 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2113ffe1-b380-4d55-87e8-cb942a7b92ca tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1369 microversion: 2.1 time: 0.090837 Aug 29 05:54:53.829157 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3817/7625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:53 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:54.850479 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:54.851143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:54.858345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:54.858829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:54.859260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:54.859974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:54.860542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:54.860979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:54.925045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:54.934011 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-826a673f-7b40-4634-ad91-be220f57edb2 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1369 microversion: 2.1 time: 0.087634 Aug 29 05:54:54.934606 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3809/7626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:54 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:55.955056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:55.955771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:55.964362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:55.964863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:55.965306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:55.966017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:55.966478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:55.966908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:56.041970 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc2df5c46bd4c629906f7da08f694e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6078095aa4044d27813d2b678396a21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:54:56.050612 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4dfb327d-6439-45a4-86f0-1a63e9438e55 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 200 len: 1369 microversion: 2.1 time: 0.099474 Aug 29 05:54:56.051366 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3818/7627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:55 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:54:57.072709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:57.073469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:57.080917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:57.081437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:57.081882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:57.082577 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:57.083027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:57.083448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:57.102505 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 HTTP/1.1 Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'cedd0559-12b1-442c-8b36-c669cb4e26e2'} Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:54:57.104167 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c2d278a5-b59f-4854-9c68-477e3ef7983c tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 404 len: 111 microversion: 2.1 time: 0.037153 Aug 29 05:54:57.108265 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3810/7628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:54:57 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:54:57.167535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:54:57.169912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:54:57.177086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:57.177582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:57.178032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:57.178726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:54:57.179187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:54:57.179610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:54:57.192672 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/os-volume_attachments HTTP/1.1 Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'server_id': 'cedd0559-12b1-442c-8b36-c669cb4e26e2'} Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:54:57.194424 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e8429c8-b80e-4bc8-973b-c98a64573361 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032395 Aug 29 05:54:57.199352 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3819/7629] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:54:57 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:00.526491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:00.526995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:00.534019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.534547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.535023 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.535752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.536220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.536639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.550890 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 HTTP/1.1 Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'cedd0559-12b1-442c-8b36-c669cb4e26e2'} Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:00.552767 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f8aebeb7-a0df-465c-bbef-51908bc48782 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 404 len: 111 microversion: 2.1 time: 0.031950 Aug 29 05:55:00.556774 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3811/7630] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:55:00 2022] DELETE /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:00.563300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:00.563933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: cedd0559-12b1-442c-8b36-c669cb4e26e2] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:00.571254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.571760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.572593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.573638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.574158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.574634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.588353 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 HTTP/1.1 Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'cedd0559-12b1-442c-8b36-c669cb4e26e2'} Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.589941 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance cedd0559-12b1-442c-8b36-c669cb4e26e2 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ca946263-0e87-4c56-9bc0-3ae2ec085d0b tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2" status: 404 len: 111 microversion: 2.1 time: 0.032195 Aug 29 05:55:00.593866 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3820/7631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:00 2022] GET /compute/v2.1/servers/cedd0559-12b1-442c-8b36-c669cb4e26e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:00.600933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:00.601790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:00.608691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.609288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.609733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.610458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.610928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.611354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.626866 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc HTTP/1.1 Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc'} Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:00.628603 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7e046ab9-17fc-4cf0-8279-4b95d9a927e8 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 404 len: 111 microversion: 2.1 time: 0.033304 Aug 29 05:55:00.632612 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3812/7632] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:55:00 2022] DELETE /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:00.639426 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:00.640063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:00.646732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.647220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.647670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.648412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.648871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.649292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.664477 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc HTTP/1.1 Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc'} Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.666079 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-51add71c-700f-4f70-bd11-2031abac1d64 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc" status: 404 len: 111 microversion: 2.1 time: 0.032353 Aug 29 05:55:00.670062 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3821/7633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:00 2022] GET /compute/v2.1/servers/fcfcae4b-1dcb-4fcc-b867-5cb28d83a7cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:00.676830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:00.677647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:00.684397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.684967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.685465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.686231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.686769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.687260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.702009 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c HTTP/1.1 Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6b558cfa-301f-4f50-b3a9-b4333f7e755c'} Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:00.703685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:00.708360 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d476e59a-1b22-4161-8dcc-02acfa0e2c9d tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 404 len: 111 microversion: 2.1 time: 0.033765 Aug 29 05:55:00.709642 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3813/7634] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:55:00 2022] DELETE /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:00.716374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:00.717028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: 6b558cfa-301f-4f50-b3a9-b4333f7e755c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:00.724538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.725038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.725481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.726203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.726665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.727098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.741246 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c HTTP/1.1 Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '6b558cfa-301f-4f50-b3a9-b4333f7e755c'} Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.742782 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance 6b558cfa-301f-4f50-b3a9-b4333f7e755c could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7af27296-35ad-4eb0-a299-e32e319d702e tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c" status: 404 len: 111 microversion: 2.1 time: 0.031843 Aug 29 05:55:00.746642 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3822/7635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:00 2022] GET /compute/v2.1/servers/6b558cfa-301f-4f50-b3a9-b4333f7e755c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:00.753315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:00.754153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:00.760379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.760945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.761474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.762268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.762788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.763282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.777184 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 HTTP/1.1 Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'd598dd3e-0a49-4c1b-bdc7-8792e2208e71'} Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:00.778752 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6371a20e-ff24-4457-8784-c4ab7c268f68 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 404 len: 111 microversion: 2.1 time: 0.031018 Aug 29 05:55:00.782931 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3814/7636] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:55:00 2022] DELETE /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:00.789208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:00.789852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] [instance: d598dd3e-0a49-4c1b-bdc7-8792e2208e71] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:00.796245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.796752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.797236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.797954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:00.798423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:00.798858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:00.813215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] HTTP exception thrown: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Request method failure captured: Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 HTTP/1.1 Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFKlEbLfsxA2A0-KwQYp4WzYjRhRBwWJ3ysbSUpNDE0r7mTDgyT0IB2yrxa0NHzLjdBi_5D_M0spr-X3A8inyawvkHg1BEnYq1wej344q05ZcwNY6__7sG7e6mPIK3weRXpN6wbHjVHqEI-QiukN_PdO_LBWL9KUx9FN8B8n-O76Pms Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6078095aa4044d27813d2b678396a21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6078095aa4044d27813d2b678396a21e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6078095aa4044d27813d2b678396a21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 6078095aa4044d27813d2b678396a21e Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServerActionsTestJSON-2141816280 Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: bbc2df5c46bd4c629906f7da08f694e5 Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServerActionsTestJSON-2141816280-project Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'd598dd3e-0a49-4c1b-bdc7-8792e2208e71'} Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:00.814894 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Returning 404 to user: Instance d598dd3e-0a49-4c1b-bdc7-8792e2208e71 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8b3a8c73-ec2c-490f-807a-7d321c10c482 tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71" status: 404 len: 111 microversion: 2.1 time: 0.031099 Aug 29 05:55:00.819271 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3823/7637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:00 2022] GET /compute/v2.1/servers/d598dd3e-0a49-4c1b-bdc7-8792e2208e71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:00.828828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-afdedab7-22a6-4022-9e15-ee130c8b3bed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] Calling method '.version_select at 0x7f1ab89c0c10>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:00.854733 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-afdedab7-22a6-4022-9e15-ee130c8b3bed tempest-ServerActionsTestJSON-2141816280 tempest-ServerActionsTestJSON-2141816280-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-349192370" status: 202 len: 0 microversion: 2.1 time: 0.029677 Aug 29 05:55:00.855648 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3815/7638] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 29 05:55:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-349192370 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:55:10.104742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1440869356", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "7de5d7d3-c095-40e0-aeb0-ee1883347fc7"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:10.167847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] validate_networks() for [('7de5d7d3-c095-40e0-aeb0-ee1883347fc7', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:55:10.578585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:55:10.579137 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:55:10.579603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:55:10.580016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:55:10.580560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:55:10.589947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:10.590439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:10.590962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:10.591700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:10.592299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:10.592735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:10.614770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Getting quotas for project 1cd0395a582646569db195338462da0e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:55:10.620623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Getting quotas for user 5bec1e6b2d8b4a0ab04e8d342bf378d6 and project 1cd0395a582646569db195338462da0e. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:55:10.633810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:55:10.636562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:55:10.689285 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c87bdb3-1649-442c-8991-ff1ab052118d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711819 Aug 29 05:55:10.689994 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3824/7639] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:55:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:55:10.702944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73455895-eaae-459e-9f08-2d3f6a522b23 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:10.703548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73455895-eaae-459e-9f08-2d3f6a522b23 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:10.759511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73455895-eaae-459e-9f08-2d3f6a522b23 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:10.767051 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73455895-eaae-459e-9f08-2d3f6a522b23 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1217 microversion: 2.1 time: 0.069762 Aug 29 05:55:10.767640 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3816/7640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:10 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:11.789035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e3ce0df-6fb0-41c7-8292-1a31edd78779 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:11.789687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e3ce0df-6fb0-41c7-8292-1a31edd78779 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:11.849963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e3ce0df-6fb0-41c7-8292-1a31edd78779 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:11.857051 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e3ce0df-6fb0-41c7-8292-1a31edd78779 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1217 microversion: 2.1 time: 0.072081 Aug 29 05:55:11.857622 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3825/7641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:11 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:12.879809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1bf13d4d-0b25-4e60-80c6-763b7f0e5c10 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:12.880638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1bf13d4d-0b25-4e60-80c6-763b7f0e5c10 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:12.882783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:12.943144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1bf13d4d-0b25-4e60-80c6-763b7f0e5c10 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:12.952110 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1bf13d4d-0b25-4e60-80c6-763b7f0e5c10 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1217 microversion: 2.1 time: 0.077067 Aug 29 05:55:12.953101 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3817/7642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:12 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:13.974154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-648d09dc-7023-4d01-9077-4717edd5d296 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:13.974868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-648d09dc-7023-4d01-9077-4717edd5d296 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:14.034505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-648d09dc-7023-4d01-9077-4717edd5d296 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:14.042344 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-648d09dc-7023-4d01-9077-4717edd5d296 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1217 microversion: 2.1 time: 0.072671 Aug 29 05:55:14.042893 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3826/7643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:13 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:55:15.067133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:15.067833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:15.071800 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 05:55:15.071994 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 05:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc (ip 10.222.0.20) !!! Aug 29 05:55:15.080684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:15.081345 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:15.081943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:15.082819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:15.083361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:15.083953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:15.158844 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:15.170327 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b3898090-852a-4c02-8f85-560948b7597b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1221 microversion: 2.1 time: 0.108737 Aug 29 05:55:15.171050 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3818/7644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:15 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:16.204431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:16.205300 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:16.213917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:16.214528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:16.215035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:16.215852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:16.216408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:16.216904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:16.222898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=62 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:16.298631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:16.307228 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3ef04dc6-0c4f-4e27-9b40-b62b8ee715e5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1275 microversion: 2.1 time: 0.108382 Aug 29 05:55:16.312644 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3827/7645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:16 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:17.329183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:17.329777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:17.337065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:17.337557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:17.338015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:17.338707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:17.339148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:17.339591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:17.474405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:17.483207 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b722be2-963b-4a2f-b6f4-464302e292db tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1317 microversion: 2.1 time: 0.157850 Aug 29 05:55:17.497578 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3819/7646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:17 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:17.537684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4c886af6-53e0-49ac-894f-f5bc73b89532 req-e661c712-3020-4fd6-b62e-7056e56d2e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f6481b-6264-4eb4-a708-6e94e7b8d4cc", "tag": "93c60ba6-4290-4ccb-b1f9-9fccaa998c92"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:17.548179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4c886af6-53e0-49ac-894f-f5bc73b89532 req-e661c712-3020-4fd6-b62e-7056e56d2e16 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:17.548690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4c886af6-53e0-49ac-894f-f5bc73b89532 req-e661c712-3020-4fd6-b62e-7056e56d2e16 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:17.549144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4c886af6-53e0-49ac-894f-f5bc73b89532 req-e661c712-3020-4fd6-b62e-7056e56d2e16 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:17.560897 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4c886af6-53e0-49ac-894f-f5bc73b89532 req-e661c712-3020-4fd6-b62e-7056e56d2e16 service nova] Creating event network-changed:93c60ba6-4290-4ccb-b1f9-9fccaa998c92 for instance 48f6481b-6264-4eb4-a708-6e94e7b8d4cc on n-h2-854119-9 Aug 29 05:55:17.566281 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4c886af6-53e0-49ac-894f-f5bc73b89532 req-e661c712-3020-4fd6-b62e-7056e56d2e16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099081 Aug 29 05:55:17.566820 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3828/7647] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 05:55:18.507424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:18.508066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:18.516155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:18.516745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:18.517223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:18.517984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:18.518474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:18.518935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:18.663150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:18.671415 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed682c02-26cb-42e2-98b8-8d1e95717ca1 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1317 microversion: 2.1 time: 0.168695 Aug 29 05:55:18.671965 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3820/7648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:18 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:19.698919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:19.700112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:19.703237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:19.710066 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:19.710568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:19.711024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:19.711766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:19.712268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:19.712694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:19.851351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:19.859747 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e6c8d078-5764-4e95-b13c-dfee2f90faed tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1317 microversion: 2.1 time: 0.169672 Aug 29 05:55:19.860347 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3829/7649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:19 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:20.885680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:20.886762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:20.891166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:20.900964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:20.901834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:20.903442 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:20.903681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:20.904619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:20.905331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:21.058518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:21.066921 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-77e26850-5428-432f-9d17-1edac4f34f4f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1317 microversion: 2.1 time: 0.187870 Aug 29 05:55:21.067527 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3821/7650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:20 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:22.088439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:22.089061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:22.091107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:22.097485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:22.097980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:22.098422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:22.099205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:22.099586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:22.100020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:22.235764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:22.244156 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0d180b5e-736c-467e-9342-5ea15386f108 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1317 microversion: 2.1 time: 0.159679 Aug 29 05:55:22.244743 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3830/7651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:22 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:23.271407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:23.272439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:23.276700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:23.285168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:23.285651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:23.286081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:23.286767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:23.287216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:23.287639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:23.427714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:23.435739 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5ebe6e38-7483-4ebb-9707-10bd5f51585a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1317 microversion: 2.1 time: 0.171004 Aug 29 05:55:23.436347 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3822/7652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:23 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:23.626422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d58349a1-20c6-42d2-b02c-bddbc73b8438 req-5e269c44-0998-4bd1-b04c-da09b15827e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f6481b-6264-4eb4-a708-6e94e7b8d4cc", "name": "network-vif-plugged", "status": "completed", "tag": "93c60ba6-4290-4ccb-b1f9-9fccaa998c92"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:23.637225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d58349a1-20c6-42d2-b02c-bddbc73b8438 req-5e269c44-0998-4bd1-b04c-da09b15827e7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:23.637225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d58349a1-20c6-42d2-b02c-bddbc73b8438 req-5e269c44-0998-4bd1-b04c-da09b15827e7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:23.637555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d58349a1-20c6-42d2-b02c-bddbc73b8438 req-5e269c44-0998-4bd1-b04c-da09b15827e7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:23.648727 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d58349a1-20c6-42d2-b02c-bddbc73b8438 req-5e269c44-0998-4bd1-b04c-da09b15827e7 service nova] Creating event network-vif-plugged:93c60ba6-4290-4ccb-b1f9-9fccaa998c92 for instance 48f6481b-6264-4eb4-a708-6e94e7b8d4cc on n-h2-854119-9 Aug 29 05:55:23.653849 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d58349a1-20c6-42d2-b02c-bddbc73b8438 req-5e269c44-0998-4bd1-b04c-da09b15827e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089980 Aug 29 05:55:23.654433 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3831/7653] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:55:24.460301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:24.461085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:24.470649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:24.471301 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:24.471944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:24.472970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:24.473583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:24.474155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:24.610961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:24.619325 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e24d59f4-94b7-43b2-883e-b905aac87612 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1317 microversion: 2.1 time: 0.164598 Aug 29 05:55:24.619910 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3823/7654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:24 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:25.642754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=10 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:25.649013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:25.649858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:25.657629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:25.658217 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:25.658739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:25.659569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:25.660143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:25.660662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:25.801605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:25.810248 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7b0d835b-5a4b-4435-882b-7dff8188e958 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1505 microversion: 2.1 time: 0.169314 Aug 29 05:55:25.810824 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3832/7655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:25 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:25.886123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-161641877", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "7de5d7d3-c095-40e0-aeb0-ee1883347fc7"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:25.943426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] validate_networks() for [('7de5d7d3-c095-40e0-aeb0-ee1883347fc7', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:55:26.408724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:55:26.409141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:55:26.409608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:55:26.410031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:55:26.410431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:55:26.420493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:26.420969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:26.421369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:26.422103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:26.422545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:26.422957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:26.440106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Getting quotas for project 1cd0395a582646569db195338462da0e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:55:26.445594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Getting quotas for user 5bec1e6b2d8b4a0ab04e8d342bf378d6 and project 1cd0395a582646569db195338462da0e. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:55:26.458746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:55:26.461056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:55:26.510106 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1e434fc9-13cf-48ef-8a00-efd4b0989445 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630242 Aug 29 05:55:26.510755 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3824/7656] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:55:26.521862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dbcaa528-80f8-49aa-9c07-fb71abb52f13 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:26.522583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dbcaa528-80f8-49aa-9c07-fb71abb52f13 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:26.580401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dbcaa528-80f8-49aa-9c07-fb71abb52f13 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:26.587423 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dbcaa528-80f8-49aa-9c07-fb71abb52f13 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1216 microversion: 2.1 time: 0.069516 Aug 29 05:55:26.588005 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3833/7657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:26 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:27.609176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:27.610964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:27.618065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:27.618559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:27.619366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:27.620061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:27.620550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:27.620980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:27.715181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:27.723113 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e052fd0f-42fe-409c-9b48-c2c8876c35e2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1276 microversion: 2.1 time: 0.118878 Aug 29 05:55:27.724055 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3825/7658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:27 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:28.744677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:28.745435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:28.753890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:28.754401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:28.754850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:28.755605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:28.756148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:28.756606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:29.057454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:29.066264 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e248c160-d9f1-4481-812d-8546e4b7b3a4 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1316 microversion: 2.1 time: 0.325529 Aug 29 05:55:29.066917 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3834/7659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:28 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:29.467688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6a0bd0c2-c3ef-4eb5-98dc-e18e0d0992b3 req-ea82a00e-4d1a-49b6-9aeb-f10fdfb703aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8dd152a-6fb6-4e00-9c64-2d0179c29e4c", "tag": "1871a40b-676c-4b36-a601-9704319de34c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:29.477049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6a0bd0c2-c3ef-4eb5-98dc-e18e0d0992b3 req-ea82a00e-4d1a-49b6-9aeb-f10fdfb703aa service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:29.477517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6a0bd0c2-c3ef-4eb5-98dc-e18e0d0992b3 req-ea82a00e-4d1a-49b6-9aeb-f10fdfb703aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:29.477941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6a0bd0c2-c3ef-4eb5-98dc-e18e0d0992b3 req-ea82a00e-4d1a-49b6-9aeb-f10fdfb703aa service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:29.489600 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6a0bd0c2-c3ef-4eb5-98dc-e18e0d0992b3 req-ea82a00e-4d1a-49b6-9aeb-f10fdfb703aa service nova] Creating event network-changed:1871a40b-676c-4b36-a601-9704319de34c for instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c on n-h1-854119-9 Aug 29 05:55:29.494848 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6a0bd0c2-c3ef-4eb5-98dc-e18e0d0992b3 req-ea82a00e-4d1a-49b6-9aeb-f10fdfb703aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096477 Aug 29 05:55:29.495639 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3826/7660] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:55:30.090269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:30.090949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:30.099434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:30.099926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:30.100404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:30.101109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:30.101572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:30.102001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:30.247686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:30.259227 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6ad0a3fa-e500-472c-b65f-bbc5e50da658 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1316 microversion: 2.1 time: 0.174798 Aug 29 05:55:30.259942 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3835/7661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:30 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:31.285430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:31.286197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:31.292806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:31.293267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:31.293727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:31.294422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:31.294900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:31.295305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:31.437851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:31.445716 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-49847122-0db8-4f9b-9989-ddc6ab9b418c tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1316 microversion: 2.1 time: 0.167802 Aug 29 05:55:31.446308 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3827/7662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:31 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:32.470721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:32.472291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:32.484568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:32.485381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:32.486115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:32.487084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:32.487547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:32.487986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:32.629509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:32.637948 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a003d8df-3db4-4088-8c6e-1543d9ce8418 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1316 microversion: 2.1 time: 0.173735 Aug 29 05:55:32.638518 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3836/7663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:32 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:33.661337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:33.661917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:33.669367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:33.669872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:33.670287 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:33.670982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:33.671430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:33.671854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:33.811076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:33.819214 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bce63cbf-b759-4caf-b1c9-96cfe46d5ca5 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1316 microversion: 2.1 time: 0.162764 Aug 29 05:55:33.819918 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3828/7664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:33 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:34.844633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:34.845675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:34.857089 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:34.857905 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:34.858633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:34.859786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:34.860596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:34.861462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:34.988979 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:34.997306 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-db855a78-1855-483c-8a9f-9f6b53f35873 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1316 microversion: 2.1 time: 0.159146 Aug 29 05:55:34.997858 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3837/7665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:34 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:35.814689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-2b6d39f5-c8fa-496f-b4cb-32081232c8ec req-e02691ac-7858-454e-bdcb-e524b28c8ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8dd152a-6fb6-4e00-9c64-2d0179c29e4c", "name": "network-vif-plugged", "status": "completed", "tag": "1871a40b-676c-4b36-a601-9704319de34c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:35.826568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2b6d39f5-c8fa-496f-b4cb-32081232c8ec req-e02691ac-7858-454e-bdcb-e524b28c8ae8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:35.827053 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2b6d39f5-c8fa-496f-b4cb-32081232c8ec req-e02691ac-7858-454e-bdcb-e524b28c8ae8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:35.827482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-2b6d39f5-c8fa-496f-b4cb-32081232c8ec req-e02691ac-7858-454e-bdcb-e524b28c8ae8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:35.838892 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-2b6d39f5-c8fa-496f-b4cb-32081232c8ec req-e02691ac-7858-454e-bdcb-e524b28c8ae8 service nova] Creating event network-vif-plugged:1871a40b-676c-4b36-a601-9704319de34c for instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c on n-h1-854119-9 Aug 29 05:55:35.843918 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-2b6d39f5-c8fa-496f-b4cb-32081232c8ec req-e02691ac-7858-454e-bdcb-e524b28c8ae8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Aug 29 05:55:35.844564 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3829/7666] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:55:36.021301 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:36.021934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:36.032556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:36.033253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:36.033702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:36.034415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:36.034886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:36.035322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:36.172464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:36.180770 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dca0252d-679b-4899-a40e-a0fc4e4c2887 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1316 microversion: 2.1 time: 0.165303 Aug 29 05:55:36.181346 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3838/7667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:36 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:37.205536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:37.206290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:37.208344 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:37.209018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:37.215501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:37.215983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:37.216439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:37.217129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:37.217571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:37.217986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:37.362980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:37.371683 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-de18489a-63df-4980-a95c-5ede017c2322 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1316 microversion: 2.1 time: 0.172406 Aug 29 05:55:37.372428 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3830/7668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:37 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:38.398186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:38.398722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:38.400589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:38.406867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:38.407368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:38.407823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:38.408574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:38.409045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:38.409487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:38.549613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:38.557570 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f962d097-cea0-4e73-81a3-1ef7cdfbdc6a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1504 microversion: 2.1 time: 0.163629 Aug 29 05:55:38.558150 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3839/7669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:38 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:38.578189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:38.578743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:38.585411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:38.585884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:38.586314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:38.587042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:38.587474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:38.587900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:38.613347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:55:38.695565 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7b367d9c-eef1-4161-b9ad-7844cac31514 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 204 len: 0 microversion: 2.1 time: 0.120899 Aug 29 05:55:38.696067 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3831/7670] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:55:38 2022] DELETE /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:55:38.704728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:38.705447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:38.711605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:38.712359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:38.712802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:38.713515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:38.713988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:38.714430 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:38.844837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:38.853075 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e488ccc-6755-4a8d-bd37-1193df93eb9d tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1510 microversion: 2.1 time: 0.152253 Aug 29 05:55:38.853655 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3840/7671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:38 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:39.874963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:39.875590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:39.883159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:39.883645 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:39.884067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:39.884785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:39.885231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:39.885644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:40.023139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:40.036173 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3d47e1ce-e3ee-4a40-9a4e-c230cd6904f0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1510 microversion: 2.1 time: 0.165214 Aug 29 05:55:40.037064 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3832/7672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:39 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:40.580614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-4de85975-9fad-4897-bfd7-d4fb649e395e req-898bff38-07c5-4e48-8754-d7c0ae4b5136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8dd152a-6fb6-4e00-9c64-2d0179c29e4c", "name": "network-vif-deleted", "tag": "1871a40b-676c-4b36-a601-9704319de34c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:40.600209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4de85975-9fad-4897-bfd7-d4fb649e395e req-898bff38-07c5-4e48-8754-d7c0ae4b5136 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:40.600817 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4de85975-9fad-4897-bfd7-d4fb649e395e req-898bff38-07c5-4e48-8754-d7c0ae4b5136 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:40.601234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-4de85975-9fad-4897-bfd7-d4fb649e395e req-898bff38-07c5-4e48-8754-d7c0ae4b5136 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:40.622763 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-4de85975-9fad-4897-bfd7-d4fb649e395e req-898bff38-07c5-4e48-8754-d7c0ae4b5136 service nova] Creating event network-vif-deleted:1871a40b-676c-4b36-a601-9704319de34c for instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c on n-h1-854119-9 Aug 29 05:55:40.629160 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-4de85975-9fad-4897-bfd7-d4fb649e395e req-898bff38-07c5-4e48-8754-d7c0ae4b5136 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053076 Aug 29 05:55:40.630230 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3841/7673] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:55:41.062253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:41.062978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:41.070178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:41.070805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:41.071408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:41.072426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:41.072952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:41.073440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:41.107019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:41.107506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:41.107939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:41.108517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lazy-loading 'fault' on Instance uuid d8dd152a-6fb6-4e00-9c64-2d0179c29e4c {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:55:41.155989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:41.164063 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-59d6c08b-4d68-4b65-ae61-f05d383cc040 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 200 len: 1306 microversion: 2.1 time: 0.105955 Aug 29 05:55:41.164690 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3833/7674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:41 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:42.191007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:42.192182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:42.203026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.203852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.204653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.205541 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.206008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.206443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.220357 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] HTTP exception thrown: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Request method failure captured: Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c HTTP/1.1 Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFS9to6W_osgS2uT11Ae_p-kwk6Vw0WS01d1ehOhops2EK5K2M-rHuvgKC6tHGHJksVjvQ2E3MqKAHuOkF-v2WCtfVmk4SRbMeM564iaTAIN9GSCGN301ijvhR7BP_WyLG2waVujbhu8S-w8ZwFjZvaIPOMCrJFC-7gQO1jQthiKmf4 Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1cd0395a582646569db195338462da0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1cd0395a582646569db195338462da0e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5bec1e6b2d8b4a0ab04e8d342bf378d6 Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'd8dd152a-6fb6-4e00-9c64-2d0179c29e4c'} Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:42.222033 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Returning 404 to user: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b9029b0a-e7ea-4a51-a869-f393c6791ca2 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 404 len: 111 microversion: 2.1 time: 0.041217 Aug 29 05:55:42.226152 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3842/7675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:42 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:42.232952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:42.233569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:42.240857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.241348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.241766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.242471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.242924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.243353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.265714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:42.386232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:42.394692 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-40ba162c-e196-44f5-a349-8b856e75b8cf tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1505 microversion: 2.1 time: 0.165651 Aug 29 05:55:42.395259 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3834/7676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:42 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:42.415026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b5a2cca-4a2e-4aee-9951-4ddadf51a756 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:42.417447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2b5a2cca-4a2e-4aee-9951-4ddadf51a756 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: a2f3e8c2-58b3-4157-b241-c16c3a2240e3] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:42.423483 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-2b5a2cca-4a2e-4aee-9951-4ddadf51a756 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] HTTP exception thrown: Instance a2f3e8c2-58b3-4157-b241-c16c3a2240e3 could not be found. Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b5a2cca-4a2e-4aee-9951-4ddadf51a756 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Request method failure captured: Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/a2f3e8c2-58b3-4157-b241-c16c3a2240e3/action HTTP/1.1 Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 32 Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFS9to6W_osgS2uT11Ae_p-kwk6Vw0WS01d1ehOhops2EK5K2M-rHuvgKC6tHGHJksVjvQ2E3MqKAHuOkF-v2WCtfVmk4SRbMeM564iaTAIN9GSCGN301ijvhR7BP_WyLG2waVujbhu8S-w8ZwFjZvaIPOMCrJFC-7gQO1jQthiKmf4 Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1cd0395a582646569db195338462da0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1cd0395a582646569db195338462da0e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5bec1e6b2d8b4a0ab04e8d342bf378d6 Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: {"resize": {"flavorRef": "452"}} Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance a2f3e8c2-58b3-4157-b241-c16c3a2240e3 could not be found. Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'a2f3e8c2-58b3-4157-b241-c16c3a2240e3', 'body': {'resize': {'flavorRef': '452'}}} Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f3e8c2-58b3-4157-b241-c16c3a2240e3 could not be found. Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:42.425194 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f3e8c2-58b3-4157-b241-c16c3a2240e3 could not be found. Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f3e8c2-58b3-4157-b241-c16c3a2240e3 could not be found. Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2b5a2cca-4a2e-4aee-9951-4ddadf51a756 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Returning 404 to user: Instance a2f3e8c2-58b3-4157-b241-c16c3a2240e3 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2b5a2cca-4a2e-4aee-9951-4ddadf51a756 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3e8c2-58b3-4157-b241-c16c3a2240e3/action" status: 404 len: 111 microversion: 2.1 time: 0.015643 Aug 29 05:55:42.429723 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3843/7677] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:55:42 2022] POST /compute/v2.1/servers/a2f3e8c2-58b3-4157-b241-c16c3a2240e3/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:42.437810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:42.438464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:42.448090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.448723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.449336 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.450319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.450929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.451421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.585644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:42.593628 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6bb7722-36bd-4a03-aa9b-d87f0e1662ec tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1505 microversion: 2.1 time: 0.162258 Aug 29 05:55:42.594200 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3835/7678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:42 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:42.614548 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:42.615174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:42.622502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.622998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.623449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.624162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.624664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.625101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.771623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:42.780530 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bcb146a-b4b8-481a-af77-697478866f8f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1505 microversion: 2.1 time: 0.169835 Aug 29 05:55:42.781074 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3844/7679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:42 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:42.801381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "0957bd6b-49f7-46d9-bf53-8967113733ed"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:42.803647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:42.809871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.810354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.810787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.811468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.811914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.812372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.852051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:42.857757 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] HTTP exception thrown: Flavor 0957bd6b-49f7-46d9-bf53-8967113733ed could not be found. Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Request method failure captured: Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: request: POST /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc/action HTTP/1.1 Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 65 Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFS9to6W_osgS2uT11Ae_p-kwk6Vw0WS01d1ehOhops2EK5K2M-rHuvgKC6tHGHJksVjvQ2E3MqKAHuOkF-v2WCtfVmk4SRbMeM564iaTAIN9GSCGN301ijvhR7BP_WyLG2waVujbhu8S-w8ZwFjZvaIPOMCrJFC-7gQO1jQthiKmf4 Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1cd0395a582646569db195338462da0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1cd0395a582646569db195338462da0e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 5bec1e6b2d8b4a0ab04e8d342bf378d6 Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: {"resize": {"flavorRef": "0957bd6b-49f7-46d9-bf53-8967113733ed"}} Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: exception: Flavor 0957bd6b-49f7-46d9-bf53-8967113733ed could not be found. Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '48f6481b-6264-4eb4-a708-6e94e7b8d4cc', 'body': {'resize': {'flavorRef': '0957bd6b-49f7-46d9-bf53-8967113733ed'}}} Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:42.864559 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0957bd6b-49f7-46d9-bf53-8967113733ed could not be found. Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 0957bd6b-49f7-46d9-bf53-8967113733ed could not be found. Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0957bd6b-49f7-46d9-bf53-8967113733ed could not be found. Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Returning 400 to user: Flavor 0957bd6b-49f7-46d9-bf53-8967113733ed could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-185d88e2-a9af-41e4-a197-459e32b19015 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "POST /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc/action" status: 400 len: 107 microversion: 2.1 time: 0.068622 Aug 29 05:55:42.869970 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3836/7680] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:55:42 2022] POST /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc/action => generated 107 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 05:55:42.876063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:42.876756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:42.884880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.885586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.886203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:42.887260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:42.887939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:42.888649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.022395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:43.034471 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60e5f843-5ac3-40ae-9b84-72114bbce43b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1505 microversion: 2.1 time: 0.161986 Aug 29 05:55:43.035225 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3845/7681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:42 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:43.060455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:43.061071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:43.067355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.067839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.068319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.069007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.069463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.069881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.204365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:43.212935 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6808e2e-2d23-4e80-9de2-12abb8929a5f tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1505 microversion: 2.1 time: 0.156489 Aug 29 05:55:43.213479 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3837/7682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:43 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:43.233956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1c626d4-481d-44f6-9f25-2c87a3caa925 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1c626d4-481d-44f6-9f25-2c87a3caa925 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Request method failure captured: Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: request: POST /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc/action HTTP/1.1 Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 29 Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFS9to6W_osgS2uT11Ae_p-kwk6Vw0WS01d1ehOhops2EK5K2M-rHuvgKC6tHGHJksVjvQ2E3MqKAHuOkF-v2WCtfVmk4SRbMeM564iaTAIN9GSCGN301ijvhR7BP_WyLG2waVujbhu8S-w8ZwFjZvaIPOMCrJFC-7gQO1jQthiKmf4 Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1cd0395a582646569db195338462da0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1cd0395a582646569db195338462da0e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5bec1e6b2d8b4a0ab04e8d342bf378d6 Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: {"resize": {"flavorRef": ""}} Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '48f6481b-6264-4eb4-a708-6e94e7b8d4cc', 'body': {'resize': {'flavorRef': ''}}} Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise error Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi '' Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.237670 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b1c626d4-481d-44f6-9f25-2c87a3caa925 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b1c626d4-481d-44f6-9f25-2c87a3caa925 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "POST /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc/action" status: 400 len: 113 microversion: 2.1 time: 0.009868 Aug 29 05:55:43.242460 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3846/7683] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:55:43 2022] POST /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 05:55:43.248367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:43.248983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:43.256359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.256885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.257316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.258085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.258570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.259070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.393782 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:43.402083 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e99ab736-2dac-4e09-a614-93e0ad363c0a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1505 microversion: 2.1 time: 0.157592 Aug 29 05:55:43.402651 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3838/7684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:43 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:43.428276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:43.428782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:43.436469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.436967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.437406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.438111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.438568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.439002 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.453414 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] HTTP exception thrown: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Request method failure captured: Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: request: DELETE /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c HTTP/1.1 Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFS9to6W_osgS2uT11Ae_p-kwk6Vw0WS01d1ehOhops2EK5K2M-rHuvgKC6tHGHJksVjvQ2E3MqKAHuOkF-v2WCtfVmk4SRbMeM564iaTAIN9GSCGN301ijvhR7BP_WyLG2waVujbhu8S-w8ZwFjZvaIPOMCrJFC-7gQO1jQthiKmf4 Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1cd0395a582646569db195338462da0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1cd0395a582646569db195338462da0e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 5bec1e6b2d8b4a0ab04e8d342bf378d6 Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'd8dd152a-6fb6-4e00-9c64-2d0179c29e4c'} Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:43.455114 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Returning 404 to user: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3be545b4-9428-4939-aede-fbba9db09433 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 404 len: 111 microversion: 2.1 time: 0.033052 Aug 29 05:55:43.459160 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3847/7685] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:55:43 2022] DELETE /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:43.465433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:43.466080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: d8dd152a-6fb6-4e00-9c64-2d0179c29e4c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:43.472701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.473185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.473617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.474317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.474765 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.475185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.489137 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] HTTP exception thrown: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Request method failure captured: Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c HTTP/1.1 Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFS9to6W_osgS2uT11Ae_p-kwk6Vw0WS01d1ehOhops2EK5K2M-rHuvgKC6tHGHJksVjvQ2E3MqKAHuOkF-v2WCtfVmk4SRbMeM564iaTAIN9GSCGN301ijvhR7BP_WyLG2waVujbhu8S-w8ZwFjZvaIPOMCrJFC-7gQO1jQthiKmf4 Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1cd0395a582646569db195338462da0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1cd0395a582646569db195338462da0e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 5bec1e6b2d8b4a0ab04e8d342bf378d6 Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'd8dd152a-6fb6-4e00-9c64-2d0179c29e4c'} Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:43.490578 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Returning 404 to user: Instance d8dd152a-6fb6-4e00-9c64-2d0179c29e4c could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69ea2871-9359-4b41-86ae-3704b6f1b5d0 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c" status: 404 len: 111 microversion: 2.1 time: 0.030580 Aug 29 05:55:43.495057 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3839/7686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:43 2022] GET /compute/v2.1/servers/d8dd152a-6fb6-4e00-9c64-2d0179c29e4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:55:43.500752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:43.501269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:43.507614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.508143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.508587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.509293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.509758 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.510197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.535651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:55:43.585466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:55:43.621253 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b4ac16dc-f6f8-4dbe-8ea9-ef5a228bba1b tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 204 len: 0 microversion: 2.1 time: 0.124152 Aug 29 05:55:43.621883 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3848/7687] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:55:43 2022] DELETE /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:55:43.633833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:43.634459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:43.640608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.641097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.641532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.642304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:43.642758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:43.643180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:43.776071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:43.784020 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ec056e2b-f14d-4d73-b70d-3714182d0347 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1511 microversion: 2.1 time: 0.156988 Aug 29 05:55:43.784632 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3840/7688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:43 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:44.809552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:44.810620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:44.819292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:44.819802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:44.820295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:44.821008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:44.821505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:44.821974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:44.964385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:44.974292 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d9984ac3-da9d-4947-a25f-60a1377a20ae tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1511 microversion: 2.1 time: 0.172223 Aug 29 05:55:44.974871 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3849/7689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:44 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:45.660613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-73409921-677b-4f1e-9901-aaf1ff06666e req-ab90dddc-641e-4c9d-bc95-eb650908e542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f6481b-6264-4eb4-a708-6e94e7b8d4cc", "name": "network-vif-deleted", "tag": "93c60ba6-4290-4ccb-b1f9-9fccaa998c92"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:55:45.673550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-73409921-677b-4f1e-9901-aaf1ff06666e req-ab90dddc-641e-4c9d-bc95-eb650908e542 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:45.674696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-73409921-677b-4f1e-9901-aaf1ff06666e req-ab90dddc-641e-4c9d-bc95-eb650908e542 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:45.675082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-73409921-677b-4f1e-9901-aaf1ff06666e req-ab90dddc-641e-4c9d-bc95-eb650908e542 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:45.688997 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-73409921-677b-4f1e-9901-aaf1ff06666e req-ab90dddc-641e-4c9d-bc95-eb650908e542 service nova] Creating event network-vif-deleted:93c60ba6-4290-4ccb-b1f9-9fccaa998c92 for instance 48f6481b-6264-4eb4-a708-6e94e7b8d4cc on n-h2-854119-9 Aug 29 05:55:45.696177 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-73409921-677b-4f1e-9901-aaf1ff06666e req-ab90dddc-641e-4c9d-bc95-eb650908e542 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039193 Aug 29 05:55:45.698023 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3841/7690] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:55:45.999097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:45.999981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:46.010695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:46.011495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:46.012364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:46.013452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:46.014166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:46.014830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:46.051601 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:46.052090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:46.052566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:46.053022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lazy-loading 'fault' on Instance uuid 48f6481b-6264-4eb4-a708-6e94e7b8d4cc {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:55:46.094599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bec1e6b2d8b4a0ab04e8d342bf378d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd0395a582646569db195338462da0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:55:46.102569 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-162f3caf-59f8-40de-96bd-e23041a08d9a tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 200 len: 1307 microversion: 2.1 time: 0.109771 Aug 29 05:55:46.103150 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3850/7691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:45 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:55:47.127838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:55:47.128729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] [instance: 48f6481b-6264-4eb4-a708-6e94e7b8d4cc] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:55:47.137048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:47.137587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:47.138067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:47.138833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:55:47.139330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:55:47.139778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:55:47.160938 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] HTTP exception thrown: Instance 48f6481b-6264-4eb4-a708-6e94e7b8d4cc could not be found. Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Request method failure captured: Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc HTTP/1.1 Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFS9to6W_osgS2uT11Ae_p-kwk6Vw0WS01d1ehOhops2EK5K2M-rHuvgKC6tHGHJksVjvQ2E3MqKAHuOkF-v2WCtfVmk4SRbMeM564iaTAIN9GSCGN301ijvhR7BP_WyLG2waVujbhu8S-w8ZwFjZvaIPOMCrJFC-7gQO1jQthiKmf4 Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1cd0395a582646569db195338462da0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1cd0395a582646569db195338462da0e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1cd0395a582646569db195338462da0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1cd0395a582646569db195338462da0e Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-ServersNegativeTestJSON-960059499 Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 5bec1e6b2d8b4a0ab04e8d342bf378d6 Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-ServersNegativeTestJSON-960059499-project Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 48f6481b-6264-4eb4-a708-6e94e7b8d4cc could not be found. Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '48f6481b-6264-4eb4-a708-6e94e7b8d4cc'} Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f6481b-6264-4eb4-a708-6e94e7b8d4cc could not be found. Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f6481b-6264-4eb4-a708-6e94e7b8d4cc could not be found. Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:55:47.162517 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f6481b-6264-4eb4-a708-6e94e7b8d4cc could not be found. Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] Returning 404 to user: Instance 48f6481b-6264-4eb4-a708-6e94e7b8d4cc could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6aac8ae2-b9d4-4876-96d1-01c0af5f7ad7 tempest-ServersNegativeTestJSON-960059499 tempest-ServersNegativeTestJSON-960059499-project] 10.222.0.20 "GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc" status: 404 len: 111 microversion: 2.1 time: 0.043021 Aug 29 05:55:47.166685 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3842/7692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:55:47 2022] GET /compute/v2.1/servers/48f6481b-6264-4eb4-a708-6e94e7b8d4cc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:56:20.501181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:20.502605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:20.713401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be7de132-2abe-44df-8175-7877a1fb7645 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Action: 'create', calling method: .version_select at 0x7f1ab95c4dc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1516420769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQNvGpREw65vrSS4+l6c2F85I6F2rWlaE2ZXCQ9hhPnbP2BEF8RXO7BqsCVBAY33kpCM+TGc1esAY/jEypxnQMmDLJ7bGcG6b5R85rxpo/J5YWm6J9mxEeg6VBqe9Ts0Q=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:56:20.731021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-be7de132-2abe-44df-8175-7877a1fb7645 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:56:20.737710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-be7de132-2abe-44df-8175-7877a1fb7645 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for user 42555dfc357f488b8f7d689a36513941 and project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:56:20.774627 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be7de132-2abe-44df-8175-7877a1fb7645 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.279217 Aug 29 05:56:20.786797 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3851/7693] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:56:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:20.828147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1050266216", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1516420769", "networks": [{"uuid": "d1106225-b95d-404a-9a30-06771fe7ed79"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:56:20.838363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:20.839130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=36 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:20.887035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] validate_networks() for [('d1106225-b95d-404a-9a30-06771fe7ed79', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:56:21.287224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:56:21.287657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:56:21.288210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:56:21.288665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:56:21.289078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:56:21.298626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:21.299107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:21.299521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:21.300288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:21.300753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:21.301179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:21.319923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:56:21.325936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for user 42555dfc357f488b8f7d689a36513941 and project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:56:21.338995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:56:21.341406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:56:21.390476 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b8eaf127-7ed4-4777-aac4-6ee9e803af63 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566248 Aug 29 05:56:21.391323 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3843/7694] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:56:21.402036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-edcc3dc3-a108-4484-9ec3-2bc7701cb7ff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:21.402662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-edcc3dc3-a108-4484-9ec3-2bc7701cb7ff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:21.462348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-edcc3dc3-a108-4484-9ec3-2bc7701cb7ff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:21.469906 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-edcc3dc3-a108-4484-9ec3-2bc7701cb7ff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1263 microversion: 2.1 time: 0.071809 Aug 29 05:56:21.470490 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3852/7695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:21 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:22.492001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:22.492655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:22.500810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:22.501569 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:22.502229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:22.503107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:22.503721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:22.504413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:22.581711 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:22.589840 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-43bf46ae-9ac6-480d-b891-d617e838fef8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1323 microversion: 2.1 time: 0.101729 Aug 29 05:56:22.600561 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3844/7696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:22 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1323 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:23.611286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:23.611829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:23.620486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:23.620818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:23.621272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:23.621973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:23.622617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:23.623201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:23.763987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:23.772071 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c6eb987-81bb-416a-9250-cbfecd48806e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1363 microversion: 2.1 time: 0.164861 Aug 29 05:56:23.772683 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3853/7697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:23 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:23.829068 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-4ba3415f-f578-493c-8bc0-d2a5d76e00ad req-a7147742-2c16-4d97-b067-d16c63e6add1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbe1578-07e0-4730-872d-f8db54e1d910", "tag": "e6e4c3b6-0573-41a2-acd1-2d7524d18e3e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:56:23.846779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4ba3415f-f578-493c-8bc0-d2a5d76e00ad req-a7147742-2c16-4d97-b067-d16c63e6add1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:23.847276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4ba3415f-f578-493c-8bc0-d2a5d76e00ad req-a7147742-2c16-4d97-b067-d16c63e6add1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:23.847693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4ba3415f-f578-493c-8bc0-d2a5d76e00ad req-a7147742-2c16-4d97-b067-d16c63e6add1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:23.859818 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-4ba3415f-f578-493c-8bc0-d2a5d76e00ad req-a7147742-2c16-4d97-b067-d16c63e6add1 service nova] Creating event network-changed:e6e4c3b6-0573-41a2-acd1-2d7524d18e3e for instance 6bbe1578-07e0-4730-872d-f8db54e1d910 on n-h2-854119-9 Aug 29 05:56:23.868360 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-4ba3415f-f578-493c-8bc0-d2a5d76e00ad req-a7147742-2c16-4d97-b067-d16c63e6add1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043518 Aug 29 05:56:23.869514 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3845/7698] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:24.797729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:24.798761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:24.810260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:24.811096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:24.811840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:24.813220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:24.813687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:24.814123 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:24.977847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:24.986348 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-401e9c73-7f30-4fce-86b5-486b0c5769b9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1363 microversion: 2.1 time: 0.195322 Aug 29 05:56:24.986920 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3854/7699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:24 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:26.013633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:26.014740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:26.025543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:26.026346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:26.027057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:26.028205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:26.028960 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:26.029651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:26.170145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:26.178348 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e882d044-eec5-4370-8e92-68de33fc6ad2 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1363 microversion: 2.1 time: 0.173203 Aug 29 05:56:26.191671 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3846/7700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:26 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:27.203699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:27.204380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:27.211651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:27.212153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:27.212627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:27.213329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:27.213793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:27.214225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:27.351646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:27.360100 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5218b4e1-bc8a-4f38-a8f8-b5a172d64cea tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1363 microversion: 2.1 time: 0.163379 Aug 29 05:56:27.360707 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3855/7701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:27 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:28.382004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:28.382576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:28.389928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:28.390410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:28.390862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:28.391549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:28.391996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:28.392446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:28.531374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:28.539416 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c2616f4-dc3d-4e56-a877-f3e542e9aebc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1363 microversion: 2.1 time: 0.161429 Aug 29 05:56:28.539978 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3847/7702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:28 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:29.560423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:29.561208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:29.568606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:29.569111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:29.569561 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:29.570285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:29.570762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:29.571196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:29.721912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:29.730561 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-190d076d-3c95-4047-9f2d-7cbe425ce8be tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1363 microversion: 2.1 time: 0.174120 Aug 29 05:56:29.731142 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3856/7703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:29 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:29.866548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d6f1ae8f-3e89-4559-be62-802e72439b4d req-ae0ff2e8-bed2-4864-bfa2-321d3fda5279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbe1578-07e0-4730-872d-f8db54e1d910", "name": "network-vif-plugged", "status": "completed", "tag": "e6e4c3b6-0573-41a2-acd1-2d7524d18e3e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:56:29.879873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d6f1ae8f-3e89-4559-be62-802e72439b4d req-ae0ff2e8-bed2-4864-bfa2-321d3fda5279 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:29.880510 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d6f1ae8f-3e89-4559-be62-802e72439b4d req-ae0ff2e8-bed2-4864-bfa2-321d3fda5279 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:29.881012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d6f1ae8f-3e89-4559-be62-802e72439b4d req-ae0ff2e8-bed2-4864-bfa2-321d3fda5279 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:29.893617 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d6f1ae8f-3e89-4559-be62-802e72439b4d req-ae0ff2e8-bed2-4864-bfa2-321d3fda5279 service nova] Creating event network-vif-plugged:e6e4c3b6-0573-41a2-acd1-2d7524d18e3e for instance 6bbe1578-07e0-4730-872d-f8db54e1d910 on n-h2-854119-9 Aug 29 05:56:29.899388 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d6f1ae8f-3e89-4559-be62-802e72439b4d req-ae0ff2e8-bed2-4864-bfa2-321d3fda5279 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036596 Aug 29 05:56:29.899976 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3848/7704] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:30.757279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:30.758294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:30.770554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:30.771375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:30.772307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:30.773614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:30.774371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:30.775203 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:30.921057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:30.929293 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5b1e7570-6800-4cfb-93d6-2224a94075e7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1363 microversion: 2.1 time: 0.179535 Aug 29 05:56:30.929871 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3857/7705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:30 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:31.949100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:31.949872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:31.954289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:31.954983 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:31.962202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:31.962692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:31.963118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:31.963806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:31.964280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:31.964700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:32.097694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:32.105623 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a4ad27f1-6852-43c3-a6e1-c5654f07681c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1555 microversion: 2.1 time: 0.158704 Aug 29 05:56:32.106357 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3849/7706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:31 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:32.127350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:32.127992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:32.129877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:32.136408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:32.136963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:32.137409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:32.138110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:32.138567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:32.138997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:32.279278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:32.287614 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b9cf1315-4b0f-4d1d-81b4-36d319956b2c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1555 microversion: 2.1 time: 0.164384 Aug 29 05:56:32.288235 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3858/7707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:32 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:33.911683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-529494c9-8def-4989-9384-689a25855a85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d485c52b-7e7a-4897-bde3-7fbe57203e9e"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:56:33.914055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-529494c9-8def-4989-9384-689a25855a85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:33.921060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-529494c9-8def-4989-9384-689a25855a85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:33.921542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-529494c9-8def-4989-9384-689a25855a85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:33.921969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-529494c9-8def-4989-9384-689a25855a85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:33.922734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-529494c9-8def-4989-9384-689a25855a85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:33.923176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-529494c9-8def-4989-9384-689a25855a85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:33.923595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-529494c9-8def-4989-9384-689a25855a85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:34.191172 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-529494c9-8def-4989-9384-689a25855a85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "POST /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283266 Aug 29 05:56:34.191802 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3850/7708] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:56:33 2022] POST /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:44.944249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:44.944740 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:44.947398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:44.948173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=36 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:44.954889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:44.955387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:44.955835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:44.956564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:44.957029 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:44.957546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:45.049917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lazy-loading 'services' on Instance uuid 6bbe1578-07e0-4730-872d-f8db54e1d910 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:56:45.140473 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bded65b9-d233-4ecd-abf6-c91833c79d82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments/d485c52b-7e7a-4897-bde3-7fbe57203e9e" status: 202 len: 0 microversion: 2.1 time: 0.199708 Aug 29 05:56:45.141231 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3859/7709] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:56:44 2022] DELETE /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments/d485c52b-7e7a-4897-bde3-7fbe57203e9e => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:56:45.147933 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:45.148768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:56:45.153003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3278d05b-1e61-454c-9289-1fd7f2d56895 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:45.155368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3278d05b-1e61-454c-9289-1fd7f2d56895 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:45.162958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3278d05b-1e61-454c-9289-1fd7f2d56895 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:45.163458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3278d05b-1e61-454c-9289-1fd7f2d56895 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:45.163882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3278d05b-1e61-454c-9289-1fd7f2d56895 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:45.164664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3278d05b-1e61-454c-9289-1fd7f2d56895 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:45.165110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3278d05b-1e61-454c-9289-1fd7f2d56895 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:45.165531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3278d05b-1e61-454c-9289-1fd7f2d56895 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:45.197401 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3278d05b-1e61-454c-9289-1fd7f2d56895 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051031 Aug 29 05:56:45.198075 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3851/7710] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:56:45 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:46.211869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e9b8bdd7-a251-412b-bbf6-b7179e77e064 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:46.214327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e9b8bdd7-a251-412b-bbf6-b7179e77e064 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:46.221100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9b8bdd7-a251-412b-bbf6-b7179e77e064 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:46.221598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9b8bdd7-a251-412b-bbf6-b7179e77e064 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:46.222047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9b8bdd7-a251-412b-bbf6-b7179e77e064 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:46.222755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9b8bdd7-a251-412b-bbf6-b7179e77e064 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:46.223220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9b8bdd7-a251-412b-bbf6-b7179e77e064 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:46.223655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9b8bdd7-a251-412b-bbf6-b7179e77e064 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:46.254661 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e9b8bdd7-a251-412b-bbf6-b7179e77e064 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048144 Aug 29 05:56:46.255229 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3860/7711] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:56:46 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:47.267650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9443ed1-9a4c-41bf-b557-a795eb63235c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:47.270613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c9443ed1-9a4c-41bf-b557-a795eb63235c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:47.278219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9443ed1-9a4c-41bf-b557-a795eb63235c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:47.278718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9443ed1-9a4c-41bf-b557-a795eb63235c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:47.279155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9443ed1-9a4c-41bf-b557-a795eb63235c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:47.279879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9443ed1-9a4c-41bf-b557-a795eb63235c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:47.280364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9443ed1-9a4c-41bf-b557-a795eb63235c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:47.280787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9443ed1-9a4c-41bf-b557-a795eb63235c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:47.315639 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9443ed1-9a4c-41bf-b557-a795eb63235c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052048 Aug 29 05:56:47.316220 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3852/7712] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:56:47 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:48.328372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2c10fe48-e3c7-430e-a881-3a277e68f8cb tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:48.331407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2c10fe48-e3c7-430e-a881-3a277e68f8cb tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:48.338867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c10fe48-e3c7-430e-a881-3a277e68f8cb tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:48.339365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c10fe48-e3c7-430e-a881-3a277e68f8cb tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:48.339809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c10fe48-e3c7-430e-a881-3a277e68f8cb tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:48.340562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c10fe48-e3c7-430e-a881-3a277e68f8cb tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:48.341030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c10fe48-e3c7-430e-a881-3a277e68f8cb tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:48.341459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2c10fe48-e3c7-430e-a881-3a277e68f8cb tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:48.372576 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2c10fe48-e3c7-430e-a881-3a277e68f8cb tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048249 Aug 29 05:56:48.373065 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3861/7713] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:56:48 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:49.385291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-31b9db5d-328b-44f8-a2c5-47bf775eda55 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:49.387662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-31b9db5d-328b-44f8-a2c5-47bf775eda55 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:49.395084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31b9db5d-328b-44f8-a2c5-47bf775eda55 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:49.395652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31b9db5d-328b-44f8-a2c5-47bf775eda55 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:49.396167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31b9db5d-328b-44f8-a2c5-47bf775eda55 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:49.396892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31b9db5d-328b-44f8-a2c5-47bf775eda55 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:49.397342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31b9db5d-328b-44f8-a2c5-47bf775eda55 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:49.397761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31b9db5d-328b-44f8-a2c5-47bf775eda55 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:49.435326 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-31b9db5d-328b-44f8-a2c5-47bf775eda55 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054031 Aug 29 05:56:49.436381 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3853/7714] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:56:49 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:50.452449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-512488cf-521a-4aa6-ac2f-cab6d09a3241 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:50.455197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-512488cf-521a-4aa6-ac2f-cab6d09a3241 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:50.463117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-512488cf-521a-4aa6-ac2f-cab6d09a3241 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:50.463655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-512488cf-521a-4aa6-ac2f-cab6d09a3241 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:50.464155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-512488cf-521a-4aa6-ac2f-cab6d09a3241 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:50.464962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-512488cf-521a-4aa6-ac2f-cab6d09a3241 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:50.465762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-512488cf-521a-4aa6-ac2f-cab6d09a3241 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:50.466165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-512488cf-521a-4aa6-ac2f-cab6d09a3241 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:50.497903 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-512488cf-521a-4aa6-ac2f-cab6d09a3241 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052443 Aug 29 05:56:50.498440 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3862/7715] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:56:50 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:56:50.509556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:50.510081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:50.517069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:50.517546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:50.517972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:50.518653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:50.519100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:50.519514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:50.604871 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] HTTP exception thrown: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 is not attached to volume d485c52b-7e7a-4897-bde3-7fbe57203e9e Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Request method failure captured: Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments/d485c52b-7e7a-4897-bde3-7fbe57203e9e HTTP/1.1 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFT_m6g_p6IcwzE7_E0hgLYqhzUSw5IJo27lGmmg0CExJNDtBzsAokKD2Or0lL_6-1av28_FA7fVwl7ka3S4nli67l8grgHPo45yXncZWBMwxwQMgKikqHzXbFolP5aPBG4zD2zUlB-_i4oOvm7j9C0n5DswbhQ5X90K95FmQJw6w-4 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b2ba8a42b7d4a0e96d17a0283509b55", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 42555dfc357f488b8f7d689a36513941 Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 is not attached to volume d485c52b-7e7a-4897-bde3-7fbe57203e9e Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'server_id': '6bbe1578-07e0-4730-872d-f8db54e1d910', 'id': 'd485c52b-7e7a-4897-bde3-7fbe57203e9e'} Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d485c52b-7e7a-4897-bde3-7fbe57203e9e. Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 is not attached to volume d485c52b-7e7a-4897-bde3-7fbe57203e9e Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:56:50.613409 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:56:50.618004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:56:50.618004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:56:50.618004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 is not attached to volume d485c52b-7e7a-4897-bde3-7fbe57203e9e Aug 29 05:56:50.618004 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:50.618004 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Returning 404 to user: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 is not attached to volume d485c52b-7e7a-4897-bde3-7fbe57203e9e {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:56:50.618004 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-77371857-5d99-4db7-b33b-bd9cd4c6391c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments/d485c52b-7e7a-4897-bde3-7fbe57203e9e" status: 404 len: 154 microversion: 2.1 time: 0.109390 Aug 29 05:56:50.618004 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3854/7716] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:56:50 2022] DELETE /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910/os-volume_attachments/d485c52b-7e7a-4897-bde3-7fbe57203e9e => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:56:53.967127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:53.967641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:53.974912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:53.975410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:53.975885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:53.976642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:53.977104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:53.977538 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:54.003914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:56:54.091337 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b8f3e6dd-2eac-43fb-9259-caac8387cb26 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 204 len: 0 microversion: 2.1 time: 0.127841 Aug 29 05:56:54.091944 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3863/7717] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:56:53 2022] DELETE /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:56:54.102246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:54.102859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:54.111163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:54.111655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:54.112082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:54.112850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:54.113299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:54.113718 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:54.248342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:54.257048 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-04001d54-e9fe-4be5-99d5-65ed9f3702a5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1561 microversion: 2.1 time: 0.160197 Aug 29 05:56:54.257600 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3855/7718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:54 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:55.279872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:55.280613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:55.288065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:55.288603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:55.289047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:55.289772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:55.290232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:55.290680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:55.439182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:55.447985 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-eb656d6d-03b7-410c-a758-cd2769eecf98 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1561 microversion: 2.1 time: 0.172580 Aug 29 05:56:55.448603 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3864/7719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:55 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:56.286307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-6390f107-bc64-42ae-b517-f451668d21f8 req-0ceca42d-0cf7-4060-89ba-fe720bd51480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbe1578-07e0-4730-872d-f8db54e1d910", "name": "network-vif-deleted", "tag": "e6e4c3b6-0573-41a2-acd1-2d7524d18e3e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:56:56.299518 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6390f107-bc64-42ae-b517-f451668d21f8 req-0ceca42d-0cf7-4060-89ba-fe720bd51480 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:56.299999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6390f107-bc64-42ae-b517-f451668d21f8 req-0ceca42d-0cf7-4060-89ba-fe720bd51480 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:56.300466 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-6390f107-bc64-42ae-b517-f451668d21f8 req-0ceca42d-0cf7-4060-89ba-fe720bd51480 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:56.312934 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-6390f107-bc64-42ae-b517-f451668d21f8 req-0ceca42d-0cf7-4060-89ba-fe720bd51480 service nova] Creating event network-vif-deleted:e6e4c3b6-0573-41a2-acd1-2d7524d18e3e for instance 6bbe1578-07e0-4730-872d-f8db54e1d910 on n-h2-854119-9 Aug 29 05:56:56.318144 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-6390f107-bc64-42ae-b517-f451668d21f8 req-0ceca42d-0cf7-4060-89ba-fe720bd51480 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035585 Aug 29 05:56:56.318758 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3856/7720] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:56.468373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:56.469109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:56.475899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:56.476431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:56.476879 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:56.477568 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:56.478030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:56.478465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:56.510147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:56.510563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:56.511003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:56.511461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lazy-loading 'fault' on Instance uuid 6bbe1578-07e0-4730-872d-f8db54e1d910 {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:56:56.562633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:56.570780 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1546964d-afb3-45fa-942e-de2b0e94ae86 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 200 len: 1353 microversion: 2.1 time: 0.106431 Aug 29 05:56:56.571352 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3865/7721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:56 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 1353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:57.597995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:57.598874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: 6bbe1578-07e0-4730-872d-f8db54e1d910] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:57.606922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:57.607525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:57.608067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:57.609058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:57.609635 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:57.610156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:57.631022 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] HTTP exception thrown: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 could not be found. Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Request method failure captured: Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 HTTP/1.1 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFT_m6g_p6IcwzE7_E0hgLYqhzUSw5IJo27lGmmg0CExJNDtBzsAokKD2Or0lL_6-1av28_FA7fVwl7ka3S4nli67l8grgHPo45yXncZWBMwxwQMgKikqHzXbFolP5aPBG4zD2zUlB-_i4oOvm7j9C0n5DswbhQ5X90K95FmQJw6w-4 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b2ba8a42b7d4a0e96d17a0283509b55", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 42555dfc357f488b8f7d689a36513941 Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 could not be found. Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '6bbe1578-07e0-4730-872d-f8db54e1d910'} Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 could not be found. Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 could not be found. Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:57.632741 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 could not be found. Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Returning 404 to user: Instance 6bbe1578-07e0-4730-872d-f8db54e1d910 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a66fcbd-fb97-405e-909f-b9ef73e9ccbd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910" status: 404 len: 111 microversion: 2.1 time: 0.043807 Aug 29 05:56:57.637082 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3857/7722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:57 2022] GET /compute/v2.1/servers/6bbe1578-07e0-4730-872d-f8db54e1d910 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:56:57.643418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-872c812f-3da8-4cab-ae6f-4efba8c22a91 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '.version_select at 0x7f1ab8d38e50>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:57.665338 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-872c812f-3da8-4cab-ae6f-4efba8c22a91 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1516420769" status: 202 len: 0 microversion: 2.1 time: 0.026073 Aug 29 05:56:57.665940 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3866/7723] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Aug 29 05:56:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1516420769 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:56:57.683044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dd1f52d6-4df4-4d2f-8966-9e6149240fed tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Action: 'create', calling method: .version_select at 0x7f1abd7fd3a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-201071305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNVHnuORGshcsj79JRvzc3L+GveL3BGB4utpsESm/un97wY28lgVQZYG5/TZdV1x468G89DZuF45gIdryb4xu9vJtcSjc7yPY4O8ZCYijswh8MKPMziUhT7lLRRExMX4A=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:56:57.699086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-dd1f52d6-4df4-4d2f-8966-9e6149240fed tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:56:57.704376 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-dd1f52d6-4df4-4d2f-8966-9e6149240fed tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for user 42555dfc357f488b8f7d689a36513941 and project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:56:57.730787 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dd1f52d6-4df4-4d2f-8966-9e6149240fed tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051649 Aug 29 05:56:57.731376 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3858/7724] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:56:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:56:57.783351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1942694513", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-201071305", "networks": [{"uuid": "d1106225-b95d-404a-9a30-06771fe7ed79"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:56:57.837756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] validate_networks() for [('d1106225-b95d-404a-9a30-06771fe7ed79', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:56:58.548828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:56:58.549286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:56:58.549767 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:56:58.550180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:56:58.550596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:56:58.560420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:58.560912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:58.561623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:58.562366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:58.562908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:58.563349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:58.580998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:56:58.586959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for user 42555dfc357f488b8f7d689a36513941 and project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:56:58.601383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:56:58.603936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:56:58.652646 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-309c4b59-ec25-4151-b12f-de533cc105aa tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.873291 Aug 29 05:56:58.653318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3867/7725] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:56:58.665296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49d813e4-f3c3-42ac-8a2c-38667be68c2d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:58.665992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-49d813e4-f3c3-42ac-8a2c-38667be68c2d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:58.723176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-49d813e4-f3c3-42ac-8a2c-38667be68c2d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:58.730394 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-49d813e4-f3c3-42ac-8a2c-38667be68c2d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1262 microversion: 2.1 time: 0.070036 Aug 29 05:56:58.731076 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3859/7726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:58 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:56:59.751191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:56:59.752094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:56:59.760015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:59.760620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:59.761154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:59.761897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:56:59.762478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:56:59.762919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:56:59.840968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:56:59.849934 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-644a529a-2295-4e21-8854-7f1bc658c1cd tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1314 microversion: 2.1 time: 0.102534 Aug 29 05:56:59.851023 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3868/7727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:56:59 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1314 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:00.871276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:00.871851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:00.879222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:00.879719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:00.880427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:00.881160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:00.881617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:00.882044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:01.022800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:01.031230 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5a773c20-d874-48d0-aa4a-d411489e8b57 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1362 microversion: 2.1 time: 0.164030 Aug 29 05:57:01.032004 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3860/7728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:00 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:01.132756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f7a9e230-c883-41f1-8c69-1b18927fda40 req-88fc874f-cff3-4a88-afc6-c52eaf34692d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2dc02de-54de-4f39-8832-255da5f24ebd", "tag": "0c8cf11e-d18e-455a-aca7-3436af32878b"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:57:01.144303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f7a9e230-c883-41f1-8c69-1b18927fda40 req-88fc874f-cff3-4a88-afc6-c52eaf34692d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:01.144716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f7a9e230-c883-41f1-8c69-1b18927fda40 req-88fc874f-cff3-4a88-afc6-c52eaf34692d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:01.145157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f7a9e230-c883-41f1-8c69-1b18927fda40 req-88fc874f-cff3-4a88-afc6-c52eaf34692d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:01.156587 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f7a9e230-c883-41f1-8c69-1b18927fda40 req-88fc874f-cff3-4a88-afc6-c52eaf34692d service nova] Creating event network-changed:0c8cf11e-d18e-455a-aca7-3436af32878b for instance e2dc02de-54de-4f39-8832-255da5f24ebd on n-h2-854119-9 Aug 29 05:57:01.161617 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f7a9e230-c883-41f1-8c69-1b18927fda40 req-88fc874f-cff3-4a88-afc6-c52eaf34692d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032682 Aug 29 05:57:01.162807 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3869/7729] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:02.056670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:02.057648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:02.066855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:02.067338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:02.067767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:02.068495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:02.068942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:02.069362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:02.211904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:02.220225 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8183093e-116f-484a-b3fe-e7ed8bb6dd94 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1362 microversion: 2.1 time: 0.170237 Aug 29 05:57:02.220777 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3861/7730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:02 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:03.247658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:03.248863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:03.259502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:03.260373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:03.261112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:03.262263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:03.263028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:03.263751 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:03.404857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:03.416372 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-183c4abb-6e51-423c-bc32-db7a2e89edff tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1362 microversion: 2.1 time: 0.177010 Aug 29 05:57:03.417151 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3870/7731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:03 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:04.439630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:04.440390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:04.448083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:04.448591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:04.449017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:04.449712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:04.450158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:04.450574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:04.585980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:04.594143 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78fe6ef3-b69b-4b9c-94a8-bdba8f38f143 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1362 microversion: 2.1 time: 0.158832 Aug 29 05:57:04.594731 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3862/7732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:04 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:05.625448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:05.626529 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:05.638382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:05.639171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:05.639916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:05.641220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:05.641688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:05.642125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:05.777643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:05.785899 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5135ff26-e065-483d-afed-6b86328d02c7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1362 microversion: 2.1 time: 0.167210 Aug 29 05:57:05.786492 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3871/7733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:05 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:06.019924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c3207051-aee2-4afe-b760-ff8794e12893 req-1fc46dc4-475c-46ec-a480-1cc7e5be1e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2dc02de-54de-4f39-8832-255da5f24ebd", "name": "network-vif-plugged", "status": "completed", "tag": "0c8cf11e-d18e-455a-aca7-3436af32878b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:57:06.030670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c3207051-aee2-4afe-b760-ff8794e12893 req-1fc46dc4-475c-46ec-a480-1cc7e5be1e6d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:06.031156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c3207051-aee2-4afe-b760-ff8794e12893 req-1fc46dc4-475c-46ec-a480-1cc7e5be1e6d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:06.031758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c3207051-aee2-4afe-b760-ff8794e12893 req-1fc46dc4-475c-46ec-a480-1cc7e5be1e6d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:06.043224 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c3207051-aee2-4afe-b760-ff8794e12893 req-1fc46dc4-475c-46ec-a480-1cc7e5be1e6d service nova] Creating event network-vif-plugged:0c8cf11e-d18e-455a-aca7-3436af32878b for instance e2dc02de-54de-4f39-8832-255da5f24ebd on n-h2-854119-9 Aug 29 05:57:06.048244 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c3207051-aee2-4afe-b760-ff8794e12893 req-1fc46dc4-475c-46ec-a480-1cc7e5be1e6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032260 Aug 29 05:57:06.048865 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3863/7734] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:06.810847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:06.811475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:06.819235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:06.819738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:06.820212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:06.820925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:06.821387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:06.822135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:06.971716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:06.979574 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d4171dc-0bbb-4c0d-b622-3409acc5882d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1362 microversion: 2.1 time: 0.175190 Aug 29 05:57:06.980201 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3872/7735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:06 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:08.004218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:08.004937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:08.012231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:08.012670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:08.013138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:08.013873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:08.014410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:08.014801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:08.149796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:08.158066 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c6998194-50e7-44bb-aa00-5e5f69b06760 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1555 microversion: 2.1 time: 0.160529 Aug 29 05:57:08.158622 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3864/7736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:07 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:08.179012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:08.179646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:08.187107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:08.187656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:08.188141 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:08.188850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:08.189316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:08.189757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:08.330136 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:08.342374 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-097def10-f62d-41ae-8cbc-38ab8a5e838d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1555 microversion: 2.1 time: 0.167144 Aug 29 05:57:08.343192 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3873/7737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:08 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:09.852263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b4d7edca-15b5-4f01-9205-ef522d3e4474 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:57:09.856236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b4d7edca-15b5-4f01-9205-ef522d3e4474 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:09.859464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:09.867450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4d7edca-15b5-4f01-9205-ef522d3e4474 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:09.867450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4d7edca-15b5-4f01-9205-ef522d3e4474 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:09.867450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4d7edca-15b5-4f01-9205-ef522d3e4474 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:09.868031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4d7edca-15b5-4f01-9205-ef522d3e4474 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:09.868528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4d7edca-15b5-4f01-9205-ef522d3e4474 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:09.868952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b4d7edca-15b5-4f01-9205-ef522d3e4474 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:10.146845 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b4d7edca-15b5-4f01-9205-ef522d3e4474 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "POST /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301124 Aug 29 05:57:10.147511 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3865/7738] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:57:09 2022] POST /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:20.935534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:20.936404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:20.939118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:20.940074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:20.940837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:20.941449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:20.948404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:20.948896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:20.949335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:20.950021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:20.950479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:20.950908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:21.042477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lazy-loading 'services' on Instance uuid e2dc02de-54de-4f39-8832-255da5f24ebd {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:57:21.131002 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1b178d0c-a19f-42c8-bd2c-712bf8f31ec9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments/e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe" status: 202 len: 0 microversion: 2.1 time: 0.201781 Aug 29 05:57:21.131625 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3874/7739] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:57:20 2022] DELETE /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments/e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:57:21.143638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e836fea0-2022-46e7-9070-670ea7f3f5bc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:21.146373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e836fea0-2022-46e7-9070-670ea7f3f5bc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:21.149487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:21.150383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:21.156771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e836fea0-2022-46e7-9070-670ea7f3f5bc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:21.157264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e836fea0-2022-46e7-9070-670ea7f3f5bc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:21.157698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e836fea0-2022-46e7-9070-670ea7f3f5bc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:21.158399 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e836fea0-2022-46e7-9070-670ea7f3f5bc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:21.158852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e836fea0-2022-46e7-9070-670ea7f3f5bc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:21.159274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e836fea0-2022-46e7-9070-670ea7f3f5bc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:21.192904 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e836fea0-2022-46e7-9070-670ea7f3f5bc tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054481 Aug 29 05:57:21.193538 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3866/7740] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:57:21 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:22.207502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4e14a3b0-6697-4586-ace4-08e5a4bcc43c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:22.210052 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4e14a3b0-6697-4586-ace4-08e5a4bcc43c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:22.216870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e14a3b0-6697-4586-ace4-08e5a4bcc43c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:22.217351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e14a3b0-6697-4586-ace4-08e5a4bcc43c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:22.217801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e14a3b0-6697-4586-ace4-08e5a4bcc43c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:22.218634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e14a3b0-6697-4586-ace4-08e5a4bcc43c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:22.219093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e14a3b0-6697-4586-ace4-08e5a4bcc43c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:22.219525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4e14a3b0-6697-4586-ace4-08e5a4bcc43c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:22.251412 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4e14a3b0-6697-4586-ace4-08e5a4bcc43c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049141 Aug 29 05:57:22.251988 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3875/7741] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:57:22 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:23.263682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-144820d5-d409-4b24-9c79-eaedf554be3c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:23.266391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-144820d5-d409-4b24-9c79-eaedf554be3c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:23.276112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144820d5-d409-4b24-9c79-eaedf554be3c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:23.276774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144820d5-d409-4b24-9c79-eaedf554be3c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:23.277351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144820d5-d409-4b24-9c79-eaedf554be3c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:23.278400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144820d5-d409-4b24-9c79-eaedf554be3c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:23.279022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144820d5-d409-4b24-9c79-eaedf554be3c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:23.279698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-144820d5-d409-4b24-9c79-eaedf554be3c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:23.314106 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-144820d5-d409-4b24-9c79-eaedf554be3c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054521 Aug 29 05:57:23.314698 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3867/7742] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:57:23 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:24.328073 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d57898b-4c42-4fd8-9d0e-cca57a00a380 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:24.330707 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d57898b-4c42-4fd8-9d0e-cca57a00a380 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:24.338650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d57898b-4c42-4fd8-9d0e-cca57a00a380 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:24.339288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d57898b-4c42-4fd8-9d0e-cca57a00a380 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:24.339709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d57898b-4c42-4fd8-9d0e-cca57a00a380 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:24.340603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d57898b-4c42-4fd8-9d0e-cca57a00a380 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:24.341097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d57898b-4c42-4fd8-9d0e-cca57a00a380 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:24.341638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d57898b-4c42-4fd8-9d0e-cca57a00a380 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:24.374641 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d57898b-4c42-4fd8-9d0e-cca57a00a380 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051474 Aug 29 05:57:24.375133 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3876/7743] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:57:24 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:25.387356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7198a34b-c0a6-427d-bdf3-4bbe2a847ff9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:25.389488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7198a34b-c0a6-427d-bdf3-4bbe2a847ff9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:25.397237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7198a34b-c0a6-427d-bdf3-4bbe2a847ff9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:25.397723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7198a34b-c0a6-427d-bdf3-4bbe2a847ff9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:25.398179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7198a34b-c0a6-427d-bdf3-4bbe2a847ff9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:25.398848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7198a34b-c0a6-427d-bdf3-4bbe2a847ff9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:25.399299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7198a34b-c0a6-427d-bdf3-4bbe2a847ff9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:25.399720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7198a34b-c0a6-427d-bdf3-4bbe2a847ff9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:25.431336 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7198a34b-c0a6-427d-bdf3-4bbe2a847ff9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048128 Aug 29 05:57:25.431919 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3868/7744] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:57:25 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:26.447923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a4d953e-5a37-479c-91eb-1aa1de1ee813 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:26.451522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a4d953e-5a37-479c-91eb-1aa1de1ee813 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:26.459638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4d953e-5a37-479c-91eb-1aa1de1ee813 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:26.460140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4d953e-5a37-479c-91eb-1aa1de1ee813 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:26.460608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4d953e-5a37-479c-91eb-1aa1de1ee813 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:26.461305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4d953e-5a37-479c-91eb-1aa1de1ee813 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:26.461766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4d953e-5a37-479c-91eb-1aa1de1ee813 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:26.462199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a4d953e-5a37-479c-91eb-1aa1de1ee813 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:26.495734 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a4d953e-5a37-479c-91eb-1aa1de1ee813 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055126 Aug 29 05:57:26.496319 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3877/7745] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:57:26 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:57:26.507357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:26.507871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:26.515533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:26.516005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:26.516476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:26.517155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:26.517596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:26.518013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:26.599893 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] HTTP exception thrown: Instance e2dc02de-54de-4f39-8832-255da5f24ebd is not attached to volume e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Request method failure captured: Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments/e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe HTTP/1.1 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFT_m6g_p6IcwzE7_E0hgLYqhzUSw5IJo27lGmmg0CExJNDtBzsAokKD2Or0lL_6-1av28_FA7fVwl7ka3S4nli67l8grgHPo45yXncZWBMwxwQMgKikqHzXbFolP5aPBG4zD2zUlB-_i4oOvm7j9C0n5DswbhQ5X90K95FmQJw6w-4 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b2ba8a42b7d4a0e96d17a0283509b55", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 42555dfc357f488b8f7d689a36513941 Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance e2dc02de-54de-4f39-8832-255da5f24ebd is not attached to volume e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'server_id': 'e2dc02de-54de-4f39-8832-255da5f24ebd', 'id': 'e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe'} Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe. Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2dc02de-54de-4f39-8832-255da5f24ebd is not attached to volume e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:57:26.602362 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:57:26.606627 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:57:26.606627 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:57:26.606627 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2dc02de-54de-4f39-8832-255da5f24ebd is not attached to volume e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe Aug 29 05:57:26.606627 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:26.606627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Returning 404 to user: Instance e2dc02de-54de-4f39-8832-255da5f24ebd is not attached to volume e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:57:26.606627 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa04300f-37f4-4b6a-8a8a-cec57df59653 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments/e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe" status: 404 len: 154 microversion: 2.1 time: 0.100512 Aug 29 05:57:26.606627 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3869/7746] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:57:26 2022] DELETE /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd/os-volume_attachments/e11a78ea-ccc0-42e5-8b75-a63d4cc3fdbe => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:57:30.147040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:30.147586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:30.155099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:30.155533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:30.156013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:30.156965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:30.157202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:30.157635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:30.183032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:57:30.266995 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-59d6d624-7ed6-430e-89d2-ee4b8f3254b8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 204 len: 0 microversion: 2.1 time: 0.123501 Aug 29 05:57:30.267592 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3878/7747] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:57:30 2022] DELETE /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 05:57:30.276603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:30.277318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:30.285049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:30.285536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:30.285968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:30.286664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:30.287118 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:30.287554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:30.421027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:30.429449 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1e3f1587-fcc7-4ebc-9a8e-3298fc173b9e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1561 microversion: 2.1 time: 0.157082 Aug 29 05:57:30.430066 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3870/7748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:30 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:31.453047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:31.453895 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:31.462241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:31.462926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:31.463491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:31.464446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:31.465030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:31.465621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:31.602945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:31.613077 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5214b953-6f69-49f0-bef1-61edad001ada tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1561 microversion: 2.1 time: 0.165977 Aug 29 05:57:31.613675 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3879/7749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:31 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:32.488302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-42a9a52a-6285-4abb-ba28-a829c0e49df6 req-d19bb9a8-ba6a-4f36-870c-aa3e998ef3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2dc02de-54de-4f39-8832-255da5f24ebd", "name": "network-vif-deleted", "tag": "0c8cf11e-d18e-455a-aca7-3436af32878b"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:57:32.500861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-42a9a52a-6285-4abb-ba28-a829c0e49df6 req-d19bb9a8-ba6a-4f36-870c-aa3e998ef3be service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:32.501352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-42a9a52a-6285-4abb-ba28-a829c0e49df6 req-d19bb9a8-ba6a-4f36-870c-aa3e998ef3be service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:32.502610 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-42a9a52a-6285-4abb-ba28-a829c0e49df6 req-d19bb9a8-ba6a-4f36-870c-aa3e998ef3be service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:32.515911 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-42a9a52a-6285-4abb-ba28-a829c0e49df6 req-d19bb9a8-ba6a-4f36-870c-aa3e998ef3be service nova] Creating event network-vif-deleted:0c8cf11e-d18e-455a-aca7-3436af32878b for instance e2dc02de-54de-4f39-8832-255da5f24ebd on n-h2-854119-9 Aug 29 05:57:32.521380 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-42a9a52a-6285-4abb-ba28-a829c0e49df6 req-d19bb9a8-ba6a-4f36-870c-aa3e998ef3be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037372 Aug 29 05:57:32.521989 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3871/7750] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:32.633132 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:32.633765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:32.640428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:32.640918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:32.641362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:32.642060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:32.642522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:32.642958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:32.675183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:32.675680 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:32.676155 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:32.676605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lazy-loading 'fault' on Instance uuid e2dc02de-54de-4f39-8832-255da5f24ebd {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:57:32.721976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:32.733224 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4805f13-52d4-4f42-af24-2b1eabfead82 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 200 len: 1352 microversion: 2.1 time: 0.103607 Aug 29 05:57:32.734048 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3880/7751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:32 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:33.762113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:33.762843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: e2dc02de-54de-4f39-8832-255da5f24ebd] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:33.769318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:33.769997 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:33.770650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:33.771380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:33.771859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:33.772311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:33.786724 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] HTTP exception thrown: Instance e2dc02de-54de-4f39-8832-255da5f24ebd could not be found. Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Request method failure captured: Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd HTTP/1.1 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFT_m6g_p6IcwzE7_E0hgLYqhzUSw5IJo27lGmmg0CExJNDtBzsAokKD2Or0lL_6-1av28_FA7fVwl7ka3S4nli67l8grgHPo45yXncZWBMwxwQMgKikqHzXbFolP5aPBG4zD2zUlB-_i4oOvm7j9C0n5DswbhQ5X90K95FmQJw6w-4 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b2ba8a42b7d4a0e96d17a0283509b55", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 42555dfc357f488b8f7d689a36513941 Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance e2dc02de-54de-4f39-8832-255da5f24ebd could not be found. Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'e2dc02de-54de-4f39-8832-255da5f24ebd'} Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2dc02de-54de-4f39-8832-255da5f24ebd could not be found. Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2dc02de-54de-4f39-8832-255da5f24ebd could not be found. Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:33.788401 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2dc02de-54de-4f39-8832-255da5f24ebd could not be found. Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Returning 404 to user: Instance e2dc02de-54de-4f39-8832-255da5f24ebd could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dfa432ed-d294-4347-bcb6-ae360548ad59 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd" status: 404 len: 111 microversion: 2.1 time: 0.032991 Aug 29 05:57:33.792560 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3872/7752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:33 2022] GET /compute/v2.1/servers/e2dc02de-54de-4f39-8832-255da5f24ebd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:57:33.798876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-85e7f14c-cfa6-4fad-85e3-6a47ad7334ab tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '.version_select at 0x7f1ab9e52c10>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:33.824061 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-85e7f14c-cfa6-4fad-85e3-6a47ad7334ab tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-201071305" status: 202 len: 0 microversion: 2.1 time: 0.028949 Aug 29 05:57:33.824780 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3881/7753] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 29 05:57:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-201071305 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:57:33.842337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fd5f2864-3775-4b88-9162-ed188d740396 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Action: 'create', calling method: .version_select at 0x7f1ab8882430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1086579528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj4cKZZgzr9ZFM6FdBNRuy7oCQPYC0Rfl0ro+RQ4e2FcX4Q0R1LVgu6ujdyPEU+6hPX4SDby42DO4w40o5zxQzqc4PymaXztfEv4I4sAJZi58gh0n5IFXNw8PkcPAhTHg=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:57:33.858393 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-fd5f2864-3775-4b88-9162-ed188d740396 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:57:33.867436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-fd5f2864-3775-4b88-9162-ed188d740396 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for user 42555dfc357f488b8f7d689a36513941 and project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:57:33.892632 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fd5f2864-3775-4b88-9162-ed188d740396 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054229 Aug 29 05:57:33.893674 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3873/7754] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:57:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:33.947514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-178842562", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1086579528", "networks": [{"uuid": "d1106225-b95d-404a-9a30-06771fe7ed79"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:57:34.006582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] validate_networks() for [('d1106225-b95d-404a-9a30-06771fe7ed79', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:57:34.406514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:57:34.406952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:57:34.407440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:57:34.407861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:57:34.408367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:57:34.418586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:34.419087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:34.419534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:34.420314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:34.420786 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:34.421216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:34.439093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:57:34.444947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Getting quotas for user 42555dfc357f488b8f7d689a36513941 and project 1b2ba8a42b7d4a0e96d17a0283509b55. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:57:34.458907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:57:34.461285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:57:34.511213 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e409a635-d89a-416a-83cf-123a2cd572d8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568036 Aug 29 05:57:34.511879 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3882/7755] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:57:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 05:57:34.523149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-afa07a83-d8ee-40e8-90b8-26e31c94d113 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:34.523762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-afa07a83-d8ee-40e8-90b8-26e31c94d113 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:34.579848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-afa07a83-d8ee-40e8-90b8-26e31c94d113 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:34.587372 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-afa07a83-d8ee-40e8-90b8-26e31c94d113 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1262 microversion: 2.1 time: 0.068300 Aug 29 05:57:34.587966 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3874/7756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:34 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:35.608748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:35.609381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:35.617078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:35.617638 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:35.618090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:35.618834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:35.619299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:35.619734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:35.683697 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:35.691626 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8c6703d3-32a3-4f5d-87b4-58c70b9a9e23 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1322 microversion: 2.1 time: 0.086958 Aug 29 05:57:35.692426 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3883/7757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:35 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:36.713953 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:36.715181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:36.726436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:36.727890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:36.727890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:36.728832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:36.729550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:36.729672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:36.871334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:36.879784 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a1137847-247a-423a-955b-2e425931bba9 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1362 microversion: 2.1 time: 0.170230 Aug 29 05:57:36.880669 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3875/7758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:36 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:36.989011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b9d52236-e053-4cf9-8620-83f2b7b6e762 req-5d30e98a-f1ec-4378-911e-445650ef356a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a10d94da-8118-49a4-a082-dbf4a3f02a0d", "tag": "02865d14-b1e7-4f1f-81cd-f4e09c4b7d0c"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:57:37.004901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b9d52236-e053-4cf9-8620-83f2b7b6e762 req-5d30e98a-f1ec-4378-911e-445650ef356a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:37.005793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b9d52236-e053-4cf9-8620-83f2b7b6e762 req-5d30e98a-f1ec-4378-911e-445650ef356a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:37.006742 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b9d52236-e053-4cf9-8620-83f2b7b6e762 req-5d30e98a-f1ec-4378-911e-445650ef356a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:37.024393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b9d52236-e053-4cf9-8620-83f2b7b6e762 req-5d30e98a-f1ec-4378-911e-445650ef356a service nova] Creating event network-changed:02865d14-b1e7-4f1f-81cd-f4e09c4b7d0c for instance a10d94da-8118-49a4-a082-dbf4a3f02a0d on n-h2-854119-9 Aug 29 05:57:37.029713 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b9d52236-e053-4cf9-8620-83f2b7b6e762 req-5d30e98a-f1ec-4378-911e-445650ef356a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046227 Aug 29 05:57:37.030326 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3884/7759] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:37.902618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:37.903239 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:37.910902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:37.911396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:37.913146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:37.913891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:37.914331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:37.914815 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:38.048487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:38.059438 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-498545bb-a800-4cff-b304-4f4f5e50f56b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1362 microversion: 2.1 time: 0.161550 Aug 29 05:57:38.060298 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3876/7760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:37 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:39.085597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:39.086381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:39.094368 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:39.094877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:39.095306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:39.096008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:39.096506 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:39.096942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:39.233683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:39.242088 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f729c668-abec-43fa-81cc-94647caeb6f7 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1362 microversion: 2.1 time: 0.163264 Aug 29 05:57:39.242661 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3885/7761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:39 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:40.275438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:40.276493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:40.284788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:40.285274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:40.285716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:40.286434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:40.286911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:40.287335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:40.425135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:40.436919 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-09556280-e940-454a-9280-baffa66ff593 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1362 microversion: 2.1 time: 0.168773 Aug 29 05:57:40.437520 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3877/7762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:40 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:41.459330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:41.460016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:41.466761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:41.467392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:41.467861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:41.468641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:41.469111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:41.469552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:41.603280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:41.613099 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-61dc890c-819c-4381-ad34-bacb5b3b5314 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1362 microversion: 2.1 time: 0.158183 Aug 29 05:57:41.613669 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3886/7763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:41 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:42.633877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:42.634477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:42.641482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:42.641984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:42.642406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:42.643097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:42.643509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:42.643931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:42.776170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:42.786746 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b6b6685c-5d91-465a-afd4-9f72ce60b0df tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1362 microversion: 2.1 time: 0.156597 Aug 29 05:57:42.787594 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3878/7764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:42 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 05:57:43.811902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:43.813387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:43.825454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:43.826279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:43.826987 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:43.827938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:43.828439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:43.828875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:43.966572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:43.975840 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e9fbc7bd-2c74-4a51-81cd-e0394006ca45 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1362 microversion: 2.1 time: 0.170437 Aug 29 05:57:43.976463 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3887/7765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:43 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:44.182552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-aa9e8dd1-fb6e-4ea0-becb-75ad24dabd33 req-65a51db0-724f-467a-91de-e7daf1888447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a10d94da-8118-49a4-a082-dbf4a3f02a0d", "name": "network-vif-plugged", "status": "completed", "tag": "02865d14-b1e7-4f1f-81cd-f4e09c4b7d0c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:57:44.193993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-aa9e8dd1-fb6e-4ea0-becb-75ad24dabd33 req-65a51db0-724f-467a-91de-e7daf1888447 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:44.194557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-aa9e8dd1-fb6e-4ea0-becb-75ad24dabd33 req-65a51db0-724f-467a-91de-e7daf1888447 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:44.195315 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-aa9e8dd1-fb6e-4ea0-becb-75ad24dabd33 req-65a51db0-724f-467a-91de-e7daf1888447 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:44.208978 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-aa9e8dd1-fb6e-4ea0-becb-75ad24dabd33 req-65a51db0-724f-467a-91de-e7daf1888447 service nova] Creating event network-vif-plugged:02865d14-b1e7-4f1f-81cd-f4e09c4b7d0c for instance a10d94da-8118-49a4-a082-dbf4a3f02a0d on n-h2-854119-9 Aug 29 05:57:44.214142 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-aa9e8dd1-fb6e-4ea0-becb-75ad24dabd33 req-65a51db0-724f-467a-91de-e7daf1888447 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035446 Aug 29 05:57:44.214909 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3879/7766] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:45.001800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:45.002456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:45.004499 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:45.005188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:45.012054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:45.012575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:45.013022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:45.013725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:45.014184 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:45.014620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:45.153292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:45.161534 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-81d8ebb2-cd18-4b71-966f-dd4dad719096 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1362 microversion: 2.1 time: 0.165122 Aug 29 05:57:45.162109 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3888/7767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:44 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:46.182351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:46.190387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:46.191591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:46.202505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:46.202991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:46.203422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:46.204129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:46.204587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:46.205005 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:46.340318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:46.351265 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e5e827a2-8dee-4a94-905b-6cc1cfe64614 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1555 microversion: 2.1 time: 0.170853 Aug 29 05:57:46.351824 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3880/7768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:46 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:46.382760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:46.383883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:46.394683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:46.395435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:46.396142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:46.397199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:46.397910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:46.398533 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:46.549117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:57:46.558023 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8caf749d-a9c9-4d84-99b2-7b5dd08d2828 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1555 microversion: 2.1 time: 0.181487 Aug 29 05:57:46.558568 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3889/7769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:57:46 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:57:48.076151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9c51764-f209-4616-a937-ee2fadcc2ad8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccf032dc-32ab-4f9d-be2b-d19ab618ed87"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:57:48.078458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d9c51764-f209-4616-a937-ee2fadcc2ad8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:48.085755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9c51764-f209-4616-a937-ee2fadcc2ad8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:48.086232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9c51764-f209-4616-a937-ee2fadcc2ad8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:48.086778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9c51764-f209-4616-a937-ee2fadcc2ad8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:48.087473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9c51764-f209-4616-a937-ee2fadcc2ad8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:48.087908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9c51764-f209-4616-a937-ee2fadcc2ad8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:48.088361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9c51764-f209-4616-a937-ee2fadcc2ad8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:48.368605 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d9c51764-f209-4616-a937-ee2fadcc2ad8 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "POST /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296688 Aug 29 05:57:48.369255 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3881/7770] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:57:48 2022] POST /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:57:59.115614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:59.116188 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:59.119125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:59.119811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:59.126391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:59.126893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:59.127395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:59.128094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:59.128581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:59.129046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:59.217144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lazy-loading 'services' on Instance uuid a10d94da-8118-49a4-a082-dbf4a3f02a0d {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:57:59.297652 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-54bfd4b6-4c14-449f-9d3b-e81ed2dc3318 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments/ccf032dc-32ab-4f9d-be2b-d19ab618ed87" status: 202 len: 0 microversion: 2.1 time: 0.185816 Aug 29 05:57:59.298186 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3890/7771] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:57:59 2022] DELETE /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments/ccf032dc-32ab-4f9d-be2b-d19ab618ed87 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:57:59.305006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:59.305778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:57:59.310123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6c6bd2de-9206-42ac-a4db-4dec5d3a7e10 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:57:59.312568 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6c6bd2de-9206-42ac-a4db-4dec5d3a7e10 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:57:59.320323 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c6bd2de-9206-42ac-a4db-4dec5d3a7e10 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:59.320662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c6bd2de-9206-42ac-a4db-4dec5d3a7e10 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:59.321199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c6bd2de-9206-42ac-a4db-4dec5d3a7e10 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:59.322199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c6bd2de-9206-42ac-a4db-4dec5d3a7e10 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:57:59.322642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c6bd2de-9206-42ac-a4db-4dec5d3a7e10 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:57:59.323055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6c6bd2de-9206-42ac-a4db-4dec5d3a7e10 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:57:59.354955 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6c6bd2de-9206-42ac-a4db-4dec5d3a7e10 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051967 Aug 29 05:57:59.355524 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3882/7772] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:57:59 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:58:00.369476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be201bb7-3159-4477-b461-b10c4a150be5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:00.371890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be201bb7-3159-4477-b461-b10c4a150be5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:00.378648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be201bb7-3159-4477-b461-b10c4a150be5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:00.379142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be201bb7-3159-4477-b461-b10c4a150be5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:00.379579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be201bb7-3159-4477-b461-b10c4a150be5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:00.380335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be201bb7-3159-4477-b461-b10c4a150be5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:00.380894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be201bb7-3159-4477-b461-b10c4a150be5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:00.381524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be201bb7-3159-4477-b461-b10c4a150be5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:00.414028 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be201bb7-3159-4477-b461-b10c4a150be5 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049988 Aug 29 05:58:00.414709 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3891/7773] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:58:00 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:58:01.427057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-522c8bf4-6353-4cad-a962-b182febe4a92 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:01.429312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-522c8bf4-6353-4cad-a962-b182febe4a92 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:01.436978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-522c8bf4-6353-4cad-a962-b182febe4a92 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:01.437471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-522c8bf4-6353-4cad-a962-b182febe4a92 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:01.437903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-522c8bf4-6353-4cad-a962-b182febe4a92 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:01.438622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-522c8bf4-6353-4cad-a962-b182febe4a92 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:01.439070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-522c8bf4-6353-4cad-a962-b182febe4a92 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:01.439491 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-522c8bf4-6353-4cad-a962-b182febe4a92 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:01.472452 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-522c8bf4-6353-4cad-a962-b182febe4a92 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049385 Aug 29 05:58:01.473050 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3883/7774] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:58:01 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:58:02.485293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7588b95-8674-490e-8948-805a9de5b22d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:02.487551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7588b95-8674-490e-8948-805a9de5b22d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:02.494842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7588b95-8674-490e-8948-805a9de5b22d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:02.495346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7588b95-8674-490e-8948-805a9de5b22d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:02.495787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7588b95-8674-490e-8948-805a9de5b22d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:02.496527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7588b95-8674-490e-8948-805a9de5b22d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:02.496988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7588b95-8674-490e-8948-805a9de5b22d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:02.497419 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7588b95-8674-490e-8948-805a9de5b22d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:02.534071 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7588b95-8674-490e-8948-805a9de5b22d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052886 Aug 29 05:58:02.534982 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3892/7775] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:58:02 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:58:03.546770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7881c8a6-9ba0-4a6c-9c89-fb5eb9e9e36b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:03.549099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7881c8a6-9ba0-4a6c-9c89-fb5eb9e9e36b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:03.556389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7881c8a6-9ba0-4a6c-9c89-fb5eb9e9e36b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:03.556876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7881c8a6-9ba0-4a6c-9c89-fb5eb9e9e36b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:03.557303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7881c8a6-9ba0-4a6c-9c89-fb5eb9e9e36b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:03.557993 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7881c8a6-9ba0-4a6c-9c89-fb5eb9e9e36b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:03.558436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7881c8a6-9ba0-4a6c-9c89-fb5eb9e9e36b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:03.558851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7881c8a6-9ba0-4a6c-9c89-fb5eb9e9e36b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:03.591162 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7881c8a6-9ba0-4a6c-9c89-fb5eb9e9e36b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048543 Aug 29 05:58:03.591708 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3884/7776] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:58:03 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:58:04.608103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9ccfa550-84cb-4c64-a1b4-319f1727fe4e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:04.610339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ccfa550-84cb-4c64-a1b4-319f1727fe4e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:04.617644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ccfa550-84cb-4c64-a1b4-319f1727fe4e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:04.618176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ccfa550-84cb-4c64-a1b4-319f1727fe4e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:04.618614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ccfa550-84cb-4c64-a1b4-319f1727fe4e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:04.619339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ccfa550-84cb-4c64-a1b4-319f1727fe4e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:04.619810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ccfa550-84cb-4c64-a1b4-319f1727fe4e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:04.620295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9ccfa550-84cb-4c64-a1b4-319f1727fe4e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:04.650417 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9ccfa550-84cb-4c64-a1b4-319f1727fe4e tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049238 Aug 29 05:58:04.650975 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3893/7777] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 05:58:04 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 05:58:04.661732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:04.662283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:04.669783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:04.670263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:04.670732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:04.671418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:04.671864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:04.672329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:04.750816 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] HTTP exception thrown: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d is not attached to volume ccf032dc-32ab-4f9d-be2b-d19ab618ed87 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Request method failure captured: Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments/ccf032dc-32ab-4f9d-be2b-d19ab618ed87 HTTP/1.1 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFT_m6g_p6IcwzE7_E0hgLYqhzUSw5IJo27lGmmg0CExJNDtBzsAokKD2Or0lL_6-1av28_FA7fVwl7ka3S4nli67l8grgHPo45yXncZWBMwxwQMgKikqHzXbFolP5aPBG4zD2zUlB-_i4oOvm7j9C0n5DswbhQ5X90K95FmQJw6w-4 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b2ba8a42b7d4a0e96d17a0283509b55", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 42555dfc357f488b8f7d689a36513941 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d is not attached to volume ccf032dc-32ab-4f9d-be2b-d19ab618ed87 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'server_id': 'a10d94da-8118-49a4-a082-dbf4a3f02a0d', 'id': 'ccf032dc-32ab-4f9d-be2b-d19ab618ed87'} Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ccf032dc-32ab-4f9d-be2b-d19ab618ed87. Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d is not attached to volume ccf032dc-32ab-4f9d-be2b-d19ab618ed87 Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:58:04.752489 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:58:04.757122 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:58:04.757122 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:58:04.757122 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d is not attached to volume ccf032dc-32ab-4f9d-be2b-d19ab618ed87 Aug 29 05:58:04.757122 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:04.757122 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Returning 404 to user: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d is not attached to volume ccf032dc-32ab-4f9d-be2b-d19ab618ed87 {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:58:04.757122 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cafb3f2d-b67e-4968-ae6f-683a1af80f85 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments/ccf032dc-32ab-4f9d-be2b-d19ab618ed87" status: 404 len: 154 microversion: 2.1 time: 0.096266 Aug 29 05:58:04.757122 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3885/7778] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 05:58:04 2022] DELETE /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d/os-volume_attachments/ccf032dc-32ab-4f9d-be2b-d19ab618ed87 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:58:08.111348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:08.111900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:08.119317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:08.119892 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:08.120462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:08.121171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:08.121641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:08.122080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:08.149655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 05:58:08.240555 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b08c75bc-6edc-4963-8601-6c7646291c01 tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 204 len: 0 microversion: 2.1 time: 0.132816 Aug 29 05:58:08.241299 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3894/7779] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 05:58:08 2022] DELETE /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 05:58:08.249840 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:08.250613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:08.257497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:08.258095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:08.258548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:08.259310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:08.259825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:08.260370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:08.395994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:08.404228 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af5ecab8-a1f0-4bc1-9e0b-a0253f98330d tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1561 microversion: 2.1 time: 0.158304 Aug 29 05:58:08.404798 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3886/7780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:08 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:09.430567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:09.431939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:09.443625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:09.444521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:09.445277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:09.446440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:09.447572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:09.448366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:09.582169 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:09.590330 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9b1a9a83-830c-4fbf-b8e1-500c1e497e3b tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1561 microversion: 2.1 time: 0.167041 Aug 29 05:58:09.591084 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3895/7781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:09 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:10.460358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c476903f-418a-4e98-9ed8-e323cbb2c26b req-72649ad1-bb97-43a2-90fc-c7f76d1d3c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a10d94da-8118-49a4-a082-dbf4a3f02a0d", "name": "network-vif-deleted", "tag": "02865d14-b1e7-4f1f-81cd-f4e09c4b7d0c"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:58:10.471010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c476903f-418a-4e98-9ed8-e323cbb2c26b req-72649ad1-bb97-43a2-90fc-c7f76d1d3c63 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:10.471488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c476903f-418a-4e98-9ed8-e323cbb2c26b req-72649ad1-bb97-43a2-90fc-c7f76d1d3c63 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:10.471911 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c476903f-418a-4e98-9ed8-e323cbb2c26b req-72649ad1-bb97-43a2-90fc-c7f76d1d3c63 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:10.487285 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c476903f-418a-4e98-9ed8-e323cbb2c26b req-72649ad1-bb97-43a2-90fc-c7f76d1d3c63 service nova] Creating event network-vif-deleted:02865d14-b1e7-4f1f-81cd-f4e09c4b7d0c for instance a10d94da-8118-49a4-a082-dbf4a3f02a0d on n-h2-854119-9 Aug 29 05:58:10.493200 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c476903f-418a-4e98-9ed8-e323cbb2c26b req-72649ad1-bb97-43a2-90fc-c7f76d1d3c63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036465 Aug 29 05:58:10.494098 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3887/7782] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:58:10.619174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:10.619804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:10.627008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:10.627505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:10.627946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:10.628689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:10.629228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:10.629658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:10.664851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:10.665346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:10.665787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:10.666244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lazy-loading 'fault' on Instance uuid a10d94da-8118-49a4-a082-dbf4a3f02a0d {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 05:58:10.706231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42555dfc357f488b8f7d689a36513941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ba8a42b7d4a0e96d17a0283509b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:10.714394 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3dce911c-a445-496a-9673-a82ffccdf88c tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 200 len: 1352 microversion: 2.1 time: 0.099357 Aug 29 05:58:10.714928 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3896/7783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:10 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:11.741725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:11.742862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] [instance: a10d94da-8118-49a4-a082-dbf4a3f02a0d] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:11.751596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:11.752073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:11.752617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:11.753302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:11.753752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:11.754173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:11.767865 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] HTTP exception thrown: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d could not be found. Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Request method failure captured: Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d HTTP/1.1 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFT_m6g_p6IcwzE7_E0hgLYqhzUSw5IJo27lGmmg0CExJNDtBzsAokKD2Or0lL_6-1av28_FA7fVwl7ka3S4nli67l8grgHPo45yXncZWBMwxwQMgKikqHzXbFolP5aPBG4zD2zUlB-_i4oOvm7j9C0n5DswbhQ5X90K95FmQJw6w-4 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b2ba8a42b7d4a0e96d17a0283509b55", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b2ba8a42b7d4a0e96d17a0283509b55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1b2ba8a42b7d4a0e96d17a0283509b55 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1080469355 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 42555dfc357f488b8f7d689a36513941 Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestEncryptedCinderVolumes-1080469355-project Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d could not be found. Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a10d94da-8118-49a4-a082-dbf4a3f02a0d'} Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d could not be found. Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d could not be found. Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:11.769557 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d could not be found. Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Returning 404 to user: Instance a10d94da-8118-49a4-a082-dbf4a3f02a0d could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3876562c-8167-4c96-8c65-d70be1adb6bf tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d" status: 404 len: 111 microversion: 2.1 time: 0.037764 Aug 29 05:58:11.774080 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3888/7784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:11 2022] GET /compute/v2.1/servers/a10d94da-8118-49a4-a082-dbf4a3f02a0d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 05:58:11.780257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-38092639-d773-4258-800f-01bc64681d0f tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] Calling method '.version_select at 0x7f1ab95c7310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:11.802793 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-38092639-d773-4258-800f-01bc64681d0f tempest-TestEncryptedCinderVolumes-1080469355 tempest-TestEncryptedCinderVolumes-1080469355-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1086579528" status: 202 len: 0 microversion: 2.1 time: 0.026518 Aug 29 05:58:11.803363 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3897/7785] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Aug 29 05:58:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1086579528 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:58:38.509963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-45678f7d-0243-453f-bf34-4bc8c8f9d887 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'create', calling method: .version_select at 0x7f1ab807cdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-160509394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkFS1iOwOqzPZ6m/bxrSxhoB+4UyMVeQ6I04ZBqyRxBu/ZaLPB+ysMLOftTT+fhq67JbYSAC9IYn84g7R14asHzURQU86nEpPGbv6CZn1esQnVRbY/F8xHH4uFXSQvqqw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:58:38.515643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=14 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:58:38.516341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=34 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:58:38.529784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-45678f7d-0243-453f-bf34-4bc8c8f9d887 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Getting quotas for project 8441eddcb9134d87b8d05471c3c87c3a. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:58:38.535351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-45678f7d-0243-453f-bf34-4bc8c8f9d887 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Getting quotas for user 75c89e30160f4e64a16038c7bdc60f0f and project 8441eddcb9134d87b8d05471c3c87c3a. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:58:38.564754 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-45678f7d-0243-453f-bf34-4bc8c8f9d887 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058647 Aug 29 05:58:38.565597 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3889/7786] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 05:58:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:58:38.614969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:58:38.616001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:58:38.621031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-35021212", "imageRef": "ea0d248e-5397-4554-a5be-77edc8c4f3d2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-160509394", "networks": [{"uuid": "abaab465-276a-4397-afef-012bad7ed264"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:58:38.800076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] validate_networks() for [('abaab465-276a-4397-afef-012bad7ed264', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 05:58:39.191040 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 05:58:39.191478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 05:58:39.191963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 05:58:39.192409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 05:58:39.192816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 05:58:39.202667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:39.203161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:39.203609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:39.204374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:39.204842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:39.205273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:39.222053 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Getting quotas for project 8441eddcb9134d87b8d05471c3c87c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 05:58:39.227414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Getting quotas for user 75c89e30160f4e64a16038c7bdc60f0f and project 8441eddcb9134d87b8d05471c3c87c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 05:58:39.240022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 05:58:39.242324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ea0d248e-5397-4554-a5be-77edc8c4f3d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 05:58:39.299409 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-30ebb8ca-f173-4c9d-9856-ad23d1b50ce0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686644 Aug 29 05:58:39.300087 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3898/7787] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 05:58:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 05:58:39.310767 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa5921e7-aebc-4e2d-9ef7-b41aa75dcdc6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:39.311374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa5921e7-aebc-4e2d-9ef7-b41aa75dcdc6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:39.471019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa5921e7-aebc-4e2d-9ef7-b41aa75dcdc6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:39.479526 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa5921e7-aebc-4e2d-9ef7-b41aa75dcdc6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1256 microversion: 2.1 time: 0.172616 Aug 29 05:58:39.480092 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3890/7788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:39 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1256 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:40.501268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:40.502177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:40.511588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:40.512395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:40.512852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:40.513773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:40.514283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:40.514726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:40.581598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:40.592335 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7fb4422e-4c87-45ad-9c69-53c2d31ef1c9 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1314 microversion: 2.1 time: 0.095166 Aug 29 05:58:40.593241 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3899/7789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:40 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1314 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:41.613608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:41.614141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:41.621484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:41.622267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:41.622734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:41.623431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:41.624186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:41.624834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:41.766623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:41.774654 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c0850a42-9f46-4091-a893-7c754d23d82b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.165016 Aug 29 05:58:41.775813 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3891/7790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:41 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:42.801105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:42.801830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:42.810945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:42.811659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:42.812330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:42.813206 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:42.813828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:42.814417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:42.953481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:42.963537 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-484feacb-b17b-4693-b42a-e2b5eccc710d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.168870 Aug 29 05:58:42.964559 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3900/7791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:42 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:43.984892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:43.985517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:43.992462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:43.992942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:43.993372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:43.994076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:43.994504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:43.994994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:44.148904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:44.158074 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2b5979a2-524e-45f9-a75a-6835799bf8b1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.177003 Aug 29 05:58:44.158665 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3892/7792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:43 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:45.183788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:45.184885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:45.192091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:45.192639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:45.193097 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:45.193860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:45.194321 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:45.194753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:45.334092 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:45.342598 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c4b60d7-f74f-49bc-918f-10ed548da34d tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.166169 Aug 29 05:58:45.343370 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3901/7793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:45 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:46.365539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:46.366874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:46.375386 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:46.376024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:46.376502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:46.377210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:46.377659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:46.378082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:46.513651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:46.521416 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a7a95ec-b754-4eb5-8536-0d2cd8eede14 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.161568 Aug 29 05:58:46.522078 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3893/7794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:46 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:47.543919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:47.544948 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:47.552482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:47.552961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:47.553414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:47.554181 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:47.554645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:47.555074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:47.702433 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:47.710743 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dffb19e1-5974-4c05-a123-4770c25f9943 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.171114 Aug 29 05:58:47.725074 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3902/7795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:47 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:48.735556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:48.736619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:48.748498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:48.748990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:48.749428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:48.750132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:48.750586 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:48.751012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:48.885170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:48.894426 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5d1c7b4-5ab7-41cd-9b6a-f1691e6e6905 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.165515 Aug 29 05:58:48.895212 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3894/7796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:48 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:49.919340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:49.919977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:49.922744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:58:49.923421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:58:49.929289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:49.929789 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:49.930230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:49.930961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:49.931455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:49.931888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:50.076857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:50.084946 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-be6d92eb-8fe9-40db-a315-415e11589b3e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.172438 Aug 29 05:58:50.085496 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3903/7797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:49 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:51.108817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:51.109414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:51.111281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:58:51.117828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:51.118306 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:51.118742 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:51.119434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:51.119893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:51.120374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:51.254474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:51.263013 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c3275215-76e4-47ad-9176-4dea2aa78229 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.159597 Aug 29 05:58:51.263596 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3895/7798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:51 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:52.039328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-cfb4aec3-41a6-4d4a-b89a-547a8211361f req-6cc16e2d-7910-457c-ab1f-7ae486c78a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9913e7-bae2-441b-834f-104145de1bf6", "tag": "112dfb4f-3ddd-4ac2-992f-8d8857ceb77a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:58:52.050000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-cfb4aec3-41a6-4d4a-b89a-547a8211361f req-6cc16e2d-7910-457c-ab1f-7ae486c78a72 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:52.050495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-cfb4aec3-41a6-4d4a-b89a-547a8211361f req-6cc16e2d-7910-457c-ab1f-7ae486c78a72 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:52.050952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-cfb4aec3-41a6-4d4a-b89a-547a8211361f req-6cc16e2d-7910-457c-ab1f-7ae486c78a72 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:52.062572 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-cfb4aec3-41a6-4d4a-b89a-547a8211361f req-6cc16e2d-7910-457c-ab1f-7ae486c78a72 service nova] Creating event network-changed:112dfb4f-3ddd-4ac2-992f-8d8857ceb77a for instance fd9913e7-bae2-441b-834f-104145de1bf6 on n-h2-854119-9 Aug 29 05:58:52.067388 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-cfb4aec3-41a6-4d4a-b89a-547a8211361f req-6cc16e2d-7910-457c-ab1f-7ae486c78a72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031872 Aug 29 05:58:52.068001 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3904/7799] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:58:52.284593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:52.285311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:52.292734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:52.293228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:52.293656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:52.294346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:52.294780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:52.295197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:52.424335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:52.432083 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9bdbfbe3-67f1-4c70-88c3-33833432a0ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.151927 Aug 29 05:58:52.432697 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3896/7800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:52 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:53.456589 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:53.457291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:53.465264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:53.466000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:53.466663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:53.467756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:53.468303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:53.468909 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:53.615261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:53.626741 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d25dbc0-4233-4077-9939-d366f2314810 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.175124 Aug 29 05:58:53.627571 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3905/7801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:53 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:54.648776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:54.649377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:54.656605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:54.657105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:54.657549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:54.658219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:54.658662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:54.659067 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:54.797940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:54.805989 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d720a4b4-59fb-414e-b1f1-1c3804e7f365 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.161280 Aug 29 05:58:54.806576 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3897/7802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:54 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:55.831590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:55.832669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:55.844196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:55.845061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:55.845804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:55.846965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:55.847734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:55.848526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:55.986536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:55.997603 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6a741465-f7e5-4acb-96cb-6b12e4d41190 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.172402 Aug 29 05:58:55.998151 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3906/7803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:55 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:57.018593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:57.019211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:57.026747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:57.027224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:57.027664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:57.028447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:57.028917 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:57.029337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:57.169988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:57.178440 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-975bfc58-6b37-4c0b-950e-f8be8e84beef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.163874 Aug 29 05:58:57.179023 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3898/7804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:57 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:58.202941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:58.203716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:58.212555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:58.213167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:58.213722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:58.214591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:58.215201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:58.215711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:58.353016 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:58.365352 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-72356c6d-ea08-4287-84a1-e758ec72f228 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.168625 Aug 29 05:58:58.366150 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3907/7805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:58 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:58:58.534958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-90870cce-8e50-4cf8-9a52-405bf0c1bd33 req-8a397949-c332-4919-8c35-709de2842e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9913e7-bae2-441b-834f-104145de1bf6", "name": "network-vif-plugged", "status": "completed", "tag": "112dfb4f-3ddd-4ac2-992f-8d8857ceb77a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:58:58.545624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-90870cce-8e50-4cf8-9a52-405bf0c1bd33 req-8a397949-c332-4919-8c35-709de2842e71 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:58.546094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-90870cce-8e50-4cf8-9a52-405bf0c1bd33 req-8a397949-c332-4919-8c35-709de2842e71 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:58.546511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-90870cce-8e50-4cf8-9a52-405bf0c1bd33 req-8a397949-c332-4919-8c35-709de2842e71 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:58.558035 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-90870cce-8e50-4cf8-9a52-405bf0c1bd33 req-8a397949-c332-4919-8c35-709de2842e71 service nova] Creating event network-vif-plugged:112dfb4f-3ddd-4ac2-992f-8d8857ceb77a for instance fd9913e7-bae2-441b-834f-104145de1bf6 on n-h2-854119-9 Aug 29 05:58:58.563238 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-90870cce-8e50-4cf8-9a52-405bf0c1bd33 req-8a397949-c332-4919-8c35-709de2842e71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032082 Aug 29 05:58:58.564302 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3899/7806] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:58:59.393528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:58:59.394525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:58:59.406303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:59.407138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:59.407894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:59.410251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:58:59.410251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:58:59.410629 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:58:59.551750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:58:59.563013 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-719c948a-68c1-4557-9490-479cddddd7fb tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1356 microversion: 2.1 time: 0.176217 Aug 29 05:58:59.563787 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3908/7807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:58:59 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:59:00.591294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:59:00.591876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:59:00.598787 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:00.599276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:00.599713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:00.600474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:00.600923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:00.601348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:00.735583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:59:00.746757 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d02d7e5e-ddc3-4229-acda-1aa012d934a6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1546 microversion: 2.1 time: 0.164356 Aug 29 05:59:00.747606 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3900/7808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:59:00 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:59:00.767304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:59:00.767929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:59:00.775240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:00.775765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:00.776231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:00.776930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:00.777411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:00.777836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:00.929028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:59:00.937385 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bd14fd8-6e41-47ba-9558-27e7969a001c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1546 microversion: 2.1 time: 0.173908 Aug 29 05:59:00.937942 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3909/7809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:59:00 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:59:00.957868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:59:00.962536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:59:00.963307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Searching by: {'deleted': False, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a'} {{(pid=128872) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 05:59:00.969164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:00.969642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:00.970074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:00.970792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:00.971244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:00.971667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:00.995847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.multi_cell_list [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 05:59:01.022317 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c73a597a-fa9a-4405-bc3e-61cc3f754035 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.068324 Aug 29 05:59:01.022904 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3901/7810] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 05:59:00 2022] GET /compute/v2.1/servers => generated 341 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:59:01.037075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:59:01.038093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:59:01.045678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:01.046182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:01.046635 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:01.047382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:01.047852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:01.048331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:01.197127 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:59:01.207191 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9b28967d-d58c-4a22-bd27-34dd7ad6cfe4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1546 microversion: 2.1 time: 0.176395 Aug 29 05:59:01.207768 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3910/7811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:59:01 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:59:02.762384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ad69b75c-d6bb-4347-ad47-5f5b8ac15b47 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26bad091-bace-433e-a26e-5e0336e398ec"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:59:02.764923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ad69b75c-d6bb-4347-ad47-5f5b8ac15b47 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:59:02.771929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad69b75c-d6bb-4347-ad47-5f5b8ac15b47 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:02.772455 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad69b75c-d6bb-4347-ad47-5f5b8ac15b47 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:02.772886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad69b75c-d6bb-4347-ad47-5f5b8ac15b47 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:02.773571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad69b75c-d6bb-4347-ad47-5f5b8ac15b47 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:02.774016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad69b75c-d6bb-4347-ad47-5f5b8ac15b47 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:02.774444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ad69b75c-d6bb-4347-ad47-5f5b8ac15b47 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:03.051120 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ad69b75c-d6bb-4347-ad47-5f5b8ac15b47 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292532 Aug 29 05:59:03.051779 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3902/7812] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 05:59:02 2022] POST /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:59:16.152757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:59:16.153452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=70 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:59:16.157619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:59:16.158235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:59:16.165317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:16.165840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:16.166282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:16.166974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:16.167421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:16.167860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:16.312131 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:59:16.325847 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1117ab3e-0e3a-4904-89cb-cc8386a75343 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1592 microversion: 2.1 time: 0.174272 Aug 29 05:59:16.326678 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3911/7813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:59:16 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1592 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:59:18.076169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:59:18.077521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:59:18.078464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 05:59:18.083404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b4122d09-322b-46bc-b7eb-e9b251093840 req-4fafa8be-7a3e-4fc2-b880-d2f50061436a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9913e7-bae2-441b-834f-104145de1bf6", "tag": "112dfb4f-3ddd-4ac2-992f-8d8857ceb77a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:59:18.096862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b4122d09-322b-46bc-b7eb-e9b251093840 req-4fafa8be-7a3e-4fc2-b880-d2f50061436a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:18.097351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b4122d09-322b-46bc-b7eb-e9b251093840 req-4fafa8be-7a3e-4fc2-b880-d2f50061436a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:18.097795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b4122d09-322b-46bc-b7eb-e9b251093840 req-4fafa8be-7a3e-4fc2-b880-d2f50061436a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:18.111002 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b4122d09-322b-46bc-b7eb-e9b251093840 req-4fafa8be-7a3e-4fc2-b880-d2f50061436a service nova] Creating event network-changed:112dfb4f-3ddd-4ac2-992f-8d8857ceb77a for instance fd9913e7-bae2-441b-834f-104145de1bf6 on n-h2-854119-9 Aug 29 05:59:18.116496 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b4122d09-322b-46bc-b7eb-e9b251093840 req-4fafa8be-7a3e-4fc2-b880-d2f50061436a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042588 Aug 29 05:59:18.117109 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3903/7814] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 05:59:19.078139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-118540528"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:59:19.079311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:59:19.086652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:19.087446 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:19.087896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:19.088655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:19.089110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:19.089553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:19.221789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.network.security_group_api [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Adding security group 0e79687a-9aa2-4cfe-95f5-1291db7018ad to port 112dfb4f-3ddd-4ac2-992f-8d8857ceb77a Aug 29 05:59:19.539067 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f52c221a-5c8c-4eac-9eb7-f60ca5584488 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/action" status: 202 len: 0 microversion: 2.1 time: 0.465114 Aug 29 05:59:19.541618 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3912/7815] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 05:59:19 2022] POST /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 05:59:19.551412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 05:59:19.552188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 05:59:19.560294 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:19.560788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:19.561214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:19.561914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:19.562342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:19.562982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:20.020243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 05:59:20.029203 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-26543572-06f7-4ff3-9562-6cabaebc80df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1756 microversion: 2.1 time: 0.482039 Aug 29 05:59:20.029784 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3904/7816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 05:59:19 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1756 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 05:59:20.133098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-bc09a518-2120-45c6-b618-dc99b907a8c6 req-c5e5d4c1-7d46-489b-bbea-67d3a4a06590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9913e7-bae2-441b-834f-104145de1bf6", "tag": "112dfb4f-3ddd-4ac2-992f-8d8857ceb77a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 05:59:20.143044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bc09a518-2120-45c6-b618-dc99b907a8c6 req-c5e5d4c1-7d46-489b-bbea-67d3a4a06590 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 05:59:20.143782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bc09a518-2120-45c6-b618-dc99b907a8c6 req-c5e5d4c1-7d46-489b-bbea-67d3a4a06590 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 05:59:20.144440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-bc09a518-2120-45c6-b618-dc99b907a8c6 req-c5e5d4c1-7d46-489b-bbea-67d3a4a06590 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 05:59:20.156533 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-bc09a518-2120-45c6-b618-dc99b907a8c6 req-c5e5d4c1-7d46-489b-bbea-67d3a4a06590 service nova] Creating event network-changed:112dfb4f-3ddd-4ac2-992f-8d8857ceb77a for instance fd9913e7-bae2-441b-834f-104145de1bf6 on n-h2-854119-9 Aug 29 05:59:20.161928 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-bc09a518-2120-45c6-b618-dc99b907a8c6 req-c5e5d4c1-7d46-489b-bbea-67d3a4a06590 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033602 Aug 29 05:59:20.162510 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3913/7817] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 05:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:01:32.704231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:01:32.704986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:01:32.706694 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:01:32.706852 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/action (ip 10.222.0.20) !!! Aug 29 06:01:32.711588 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-93d1311c-1f66-44ed-816a-94f0198c8b29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:01:32.713930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-93d1311c-1f66-44ed-816a-94f0198c8b29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:01:32.723469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d1311c-1f66-44ed-816a-94f0198c8b29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:32.723949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d1311c-1f66-44ed-816a-94f0198c8b29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:32.724412 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d1311c-1f66-44ed-816a-94f0198c8b29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:32.725108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d1311c-1f66-44ed-816a-94f0198c8b29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:32.725558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d1311c-1f66-44ed-816a-94f0198c8b29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:32.725980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-93d1311c-1f66-44ed-816a-94f0198c8b29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:32.802166 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-93d1311c-1f66-44ed-816a-94f0198c8b29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/action" status: 202 len: 0 microversion: 2.1 time: 0.099741 Aug 29 06:01:32.802834 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3905/7818] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:01:32 2022] POST /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:01:32.811290 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 06:01:32.815436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:01:32.816154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:01:32.818884 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 06:01:32.819482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:01:32.820286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:01:32.821594 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:01:32.821755 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 (ip 10.222.0.20) !!! Aug 29 06:01:32.824830 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:01:32.824989 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 (ip 10.222.0.20) !!! Aug 29 06:01:32.843633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:32.844222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:32.844617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:32.845305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:32.845773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:32.846211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:32.993764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:01:33.002327 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1a07bdcd-2705-4842-a432-22f8eb801e06 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1758 microversion: 2.1 time: 0.192979 Aug 29 06:01:33.003186 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3914/7819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:01:32 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:01:34.029864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:01:34.030740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:01:34.041046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:34.041805 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:34.042342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:34.043029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:34.043482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:34.043900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:34.190884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:01:34.200246 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78423de8-11dc-4af3-8986-04c929276b5f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1763 microversion: 2.1 time: 0.179150 Aug 29 06:01:34.200822 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3906/7820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:01:34 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1763 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:01:35.223061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:01:35.223679 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:01:35.236257 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:35.236812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:35.237361 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:35.238540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:35.239246 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:35.239980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:35.245201 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48520. Aug 29 06:01:35.249194 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48518. Aug 29 06:01:35.400183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:01:35.416265 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-11617d36-de41-4363-a1e5-7354fff76e82 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1763 microversion: 2.1 time: 0.196751 Aug 29 06:01:35.417114 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3915/7821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:01:35 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1763 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:01:36.441920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:01:36.442927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:01:36.454839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:36.455629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:36.456438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:36.457584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:36.458337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:36.459040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:36.604066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:01:36.612884 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13083f8e-acfe-4f56-bf52-c886279a19df tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1763 microversion: 2.1 time: 0.177556 Aug 29 06:01:36.613456 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3907/7822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:01:36 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1763 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:01:37.637118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:01:37.637669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:01:37.644966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:37.645465 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:37.645906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:37.646623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:37.647085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:37.647519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:37.799325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:01:37.807990 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e57d27bb-bd5d-4e65-8c6d-1b352a833a1a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1763 microversion: 2.1 time: 0.175125 Aug 29 06:01:37.808585 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3916/7823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:01:37 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1763 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:01:38.834140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:01:38.835153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:01:38.842969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:38.843465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:38.843893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:38.844612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:38.845064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:38.845552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:38.992060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:01:39.000906 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2a88ab17-27a6-4774-bae5-5f2550cd729f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1763 microversion: 2.1 time: 0.174073 Aug 29 06:01:39.001498 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3908/7824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:01:38 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1763 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:01:40.025491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:01:40.026311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:01:40.036556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:40.037258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:40.037885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:40.038875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:01:40.039673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:01:40.040336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:01:40.188187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:01:40.201784 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-da3b5c4b-51ba-42c6-af49-ceed89737911 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1756 microversion: 2.1 time: 0.181869 Aug 29 06:01:40.202529 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3917/7825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:01:40 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:09.758044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:09.759253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:09.766072 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-118540528"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:03:09.766950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:09.775326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:09.775746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:09.776196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:09.776883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:09.777332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:09.777752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:09.914023 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.network.security_group_api [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Removing security group 0e79687a-9aa2-4cfe-95f5-1291db7018ad from port 112dfb4f-3ddd-4ac2-992f-8d8857ceb77a Aug 29 06:03:10.235629 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3e9a7574-b522-4ec4-b773-4a909e019f83 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/action" status: 202 len: 0 microversion: 2.1 time: 0.481201 Aug 29 06:03:10.236278 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3909/7826] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:03:09 2022] POST /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:03:10.243567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:10.244844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=24 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:10.349307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-72e66bd1-0c8a-40a2-8c2e-d30eb0366e16 req-3454f33a-7e57-4829-b5b7-92953ff4c618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9913e7-bae2-441b-834f-104145de1bf6", "tag": "112dfb4f-3ddd-4ac2-992f-8d8857ceb77a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:03:10.359747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-72e66bd1-0c8a-40a2-8c2e-d30eb0366e16 req-3454f33a-7e57-4829-b5b7-92953ff4c618 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:10.360277 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-72e66bd1-0c8a-40a2-8c2e-d30eb0366e16 req-3454f33a-7e57-4829-b5b7-92953ff4c618 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:10.360728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-72e66bd1-0c8a-40a2-8c2e-d30eb0366e16 req-3454f33a-7e57-4829-b5b7-92953ff4c618 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:10.372662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-72e66bd1-0c8a-40a2-8c2e-d30eb0366e16 req-3454f33a-7e57-4829-b5b7-92953ff4c618 service nova] Creating event network-changed:112dfb4f-3ddd-4ac2-992f-8d8857ceb77a for instance fd9913e7-bae2-441b-834f-104145de1bf6 on n-h2-854119-9 Aug 29 06:03:10.379066 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-72e66bd1-0c8a-40a2-8c2e-d30eb0366e16 req-3454f33a-7e57-4829-b5b7-92953ff4c618 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137616 Aug 29 06:03:10.379646 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3918/7827] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:11.342553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:11.343105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:11.349662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:11.350242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:11.350674 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:11.351422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:11.351862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:11.352389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:11.439261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lazy-loading 'services' on Instance uuid fd9913e7-bae2-441b-834f-104145de1bf6 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:03:11.517328 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4d38e4d3-2e9c-4b79-adc2-f80031f8d208 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments/26bad091-bace-433e-a26e-5e0336e398ec" status: 202 len: 0 microversion: 2.1 time: 0.179570 Aug 29 06:03:11.518231 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3910/7828] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 06:03:11 2022] DELETE /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments/26bad091-bace-433e-a26e-5e0336e398ec => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:03:11.529191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-756510bb-d18c-4a96-beaf-88286423d5d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:11.532360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-756510bb-d18c-4a96-beaf-88286423d5d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:11.539712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-756510bb-d18c-4a96-beaf-88286423d5d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:11.540428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-756510bb-d18c-4a96-beaf-88286423d5d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:11.540890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-756510bb-d18c-4a96-beaf-88286423d5d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:11.541654 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-756510bb-d18c-4a96-beaf-88286423d5d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:11.542120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-756510bb-d18c-4a96-beaf-88286423d5d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:11.542556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-756510bb-d18c-4a96-beaf-88286423d5d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:11.578372 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-756510bb-d18c-4a96-beaf-88286423d5d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055424 Aug 29 06:03:11.583840 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3919/7829] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:03:11 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:12.394944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-de9de582-8474-4c8a-8626-6757a63e6b97 req-3e6c6211-f624-4f1a-8cd5-d8364a51fbdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9913e7-bae2-441b-834f-104145de1bf6", "tag": "112dfb4f-3ddd-4ac2-992f-8d8857ceb77a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:03:12.405191 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-de9de582-8474-4c8a-8626-6757a63e6b97 req-3e6c6211-f624-4f1a-8cd5-d8364a51fbdb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:12.405609 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-de9de582-8474-4c8a-8626-6757a63e6b97 req-3e6c6211-f624-4f1a-8cd5-d8364a51fbdb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:12.406030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-de9de582-8474-4c8a-8626-6757a63e6b97 req-3e6c6211-f624-4f1a-8cd5-d8364a51fbdb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:12.419771 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-de9de582-8474-4c8a-8626-6757a63e6b97 req-3e6c6211-f624-4f1a-8cd5-d8364a51fbdb service nova] Creating event network-changed:112dfb4f-3ddd-4ac2-992f-8d8857ceb77a for instance fd9913e7-bae2-441b-834f-104145de1bf6 on n-h2-854119-9 Aug 29 06:03:12.424967 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-de9de582-8474-4c8a-8626-6757a63e6b97 req-3e6c6211-f624-4f1a-8cd5-d8364a51fbdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035117 Aug 29 06:03:12.425550 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3911/7830] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:12.592973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d9dda405-1eb0-40f0-ab8c-cdf0e5d0041a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:12.596033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d9dda405-1eb0-40f0-ab8c-cdf0e5d0041a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:12.603247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dda405-1eb0-40f0-ab8c-cdf0e5d0041a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:12.603801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dda405-1eb0-40f0-ab8c-cdf0e5d0041a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:12.604279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dda405-1eb0-40f0-ab8c-cdf0e5d0041a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:12.605007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dda405-1eb0-40f0-ab8c-cdf0e5d0041a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:12.605474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dda405-1eb0-40f0-ab8c-cdf0e5d0041a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:12.605917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d9dda405-1eb0-40f0-ab8c-cdf0e5d0041a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:12.638744 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d9dda405-1eb0-40f0-ab8c-cdf0e5d0041a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050709 Aug 29 06:03:12.639335 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3920/7831] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:03:12 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:13.652260 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f790256-4069-401a-b94e-0c4bf6f8de29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:13.654589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f790256-4069-401a-b94e-0c4bf6f8de29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:13.657472 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:03:13.657685 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:03:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments (ip 10.222.0.20) !!! Aug 29 06:03:13.670915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f790256-4069-401a-b94e-0c4bf6f8de29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:13.671401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f790256-4069-401a-b94e-0c4bf6f8de29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:13.671825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f790256-4069-401a-b94e-0c4bf6f8de29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:13.672565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f790256-4069-401a-b94e-0c4bf6f8de29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:13.673010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f790256-4069-401a-b94e-0c4bf6f8de29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:13.673426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f790256-4069-401a-b94e-0c4bf6f8de29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:13.705543 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6f790256-4069-401a-b94e-0c4bf6f8de29 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057858 Aug 29 06:03:13.706228 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3912/7832] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:03:13 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:14.718386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-42f174ba-5742-4cc4-a7f7-ff56298e4f7e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:14.720728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-42f174ba-5742-4cc4-a7f7-ff56298e4f7e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:14.722933 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:03:14.723053 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments (ip 10.222.0.20) !!! Aug 29 06:03:14.731639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42f174ba-5742-4cc4-a7f7-ff56298e4f7e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:14.732146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42f174ba-5742-4cc4-a7f7-ff56298e4f7e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:14.732597 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42f174ba-5742-4cc4-a7f7-ff56298e4f7e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:14.733317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42f174ba-5742-4cc4-a7f7-ff56298e4f7e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:14.733792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42f174ba-5742-4cc4-a7f7-ff56298e4f7e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:14.734231 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-42f174ba-5742-4cc4-a7f7-ff56298e4f7e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:14.767312 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-42f174ba-5742-4cc4-a7f7-ff56298e4f7e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051059 Aug 29 06:03:14.767906 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3921/7833] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:03:14 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:15.780038 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb6d5754-3b1f-42b1-8606-6e22c7b41126 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:15.782311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fb6d5754-3b1f-42b1-8606-6e22c7b41126 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:15.789367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6d5754-3b1f-42b1-8606-6e22c7b41126 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:15.789852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6d5754-3b1f-42b1-8606-6e22c7b41126 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:15.790285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6d5754-3b1f-42b1-8606-6e22c7b41126 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:15.790971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6d5754-3b1f-42b1-8606-6e22c7b41126 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:15.791410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6d5754-3b1f-42b1-8606-6e22c7b41126 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:15.791829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb6d5754-3b1f-42b1-8606-6e22c7b41126 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:15.822757 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb6d5754-3b1f-42b1-8606-6e22c7b41126 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Aug 29 06:03:15.823300 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3913/7834] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:03:15 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:16.840324 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9dadc426-e638-4e47-ad59-c89c5d94bcf5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:16.843846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9dadc426-e638-4e47-ad59-c89c5d94bcf5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:16.852343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9dadc426-e638-4e47-ad59-c89c5d94bcf5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:16.852839 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9dadc426-e638-4e47-ad59-c89c5d94bcf5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:16.853280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9dadc426-e638-4e47-ad59-c89c5d94bcf5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:16.853976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9dadc426-e638-4e47-ad59-c89c5d94bcf5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:16.854434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9dadc426-e638-4e47-ad59-c89c5d94bcf5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:16.854869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9dadc426-e638-4e47-ad59-c89c5d94bcf5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:16.884723 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9dadc426-e638-4e47-ad59-c89c5d94bcf5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051794 Aug 29 06:03:16.885279 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3922/7835] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:03:16 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 06:03:16.895928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:16.896508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:16.903570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:16.904060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:16.904528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:16.905222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:16.905687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:16.906100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:16.983672 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] HTTP exception thrown: Instance fd9913e7-bae2-441b-834f-104145de1bf6 is not attached to volume 26bad091-bace-433e-a26e-5e0336e398ec Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Request method failure captured: Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments/26bad091-bace-433e-a26e-5e0336e398ec HTTP/1.1 Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFV_yA0PTdhv3zoAq_3zNCcHEQm5S9yf00uVQf_QybGU2vxAbpj6Vtc3YtZZjpiWR8Ch19hEng53iIR6FqEAlTucn5WEXzZYvgg6S3SDgcBmHmof1UiVpqPp1c2NPOmemFnV3QjxKW1fBvcKq-d82S0InGG3CcGvjQDfo06D0yNUC3M Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 8441eddcb9134d87b8d05471c3c87c3a Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8441eddcb9134d87b8d05471c3c87c3a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 8441eddcb9134d87b8d05471c3c87c3a Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestMinimumBasicScenario-985068194-project Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 75c89e30160f4e64a16038c7bdc60f0f Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestMinimumBasicScenario-985068194-project Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance fd9913e7-bae2-441b-834f-104145de1bf6 is not attached to volume 26bad091-bace-433e-a26e-5e0336e398ec Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'server_id': 'fd9913e7-bae2-441b-834f-104145de1bf6', 'id': '26bad091-bace-433e-a26e-5e0336e398ec'} Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 26bad091-bace-433e-a26e-5e0336e398ec. Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9913e7-bae2-441b-834f-104145de1bf6 is not attached to volume 26bad091-bace-433e-a26e-5e0336e398ec Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:03:16.985324 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:03:16.990149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:03:16.990149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:03:16.990149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9913e7-bae2-441b-834f-104145de1bf6 is not attached to volume 26bad091-bace-433e-a26e-5e0336e398ec Aug 29 06:03:16.990149 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:16.990149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Returning 404 to user: Instance fd9913e7-bae2-441b-834f-104145de1bf6 is not attached to volume 26bad091-bace-433e-a26e-5e0336e398ec {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:03:16.990149 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d393c920-5a82-4efb-9089-3232cae32ff0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments/26bad091-bace-433e-a26e-5e0336e398ec" status: 404 len: 154 microversion: 2.1 time: 0.096637 Aug 29 06:03:16.990149 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3914/7836] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 06:03:16 2022] DELETE /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6/os-volume_attachments/26bad091-bace-433e-a26e-5e0336e398ec => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:03:20.245302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:20.245853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:20.253359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:20.253866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:20.254320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:20.255049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:20.255515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:20.255957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:20.282832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:03:20.363277 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-781eb554-834f-4e1a-babb-65a75dbdbc2e tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 204 len: 0 microversion: 2.1 time: 0.121725 Aug 29 06:03:20.364049 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3923/7837] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:03:20 2022] DELETE /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:03:20.373652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:20.375062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:20.386904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:20.387414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:20.387848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:20.388625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:20.389057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:20.389476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:20.526233 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:20.534661 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6f0fee87-766f-49cc-9e1e-9f1477227932 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1552 microversion: 2.1 time: 0.165293 Aug 29 06:03:20.535278 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3915/7838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:20 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:21.559972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:21.560737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:21.570983 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:21.571491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:21.571950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:21.572700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:21.573170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:21.573594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:21.719049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:21.727378 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-040d4aaa-7e83-48f8-aeba-9f3b64e331c5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1552 microversion: 2.1 time: 0.174543 Aug 29 06:03:21.727963 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3924/7839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:21 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:22.749520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:22.750114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:22.757395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:22.758103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:22.758522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:22.759276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:22.759735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:22.760267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:22.908778 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:22.918013 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-254d33ca-45c3-4354-965d-e82a3810aa00 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 200 len: 1552 microversion: 2.1 time: 0.172598 Aug 29 06:03:22.918621 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3916/7840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:22 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:22.987276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-cfdbf903-964a-4e1e-857c-865148d87e25 req-6c0bad96-884d-437e-a1a1-0ab2779fee6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9913e7-bae2-441b-834f-104145de1bf6", "name": "network-vif-deleted", "tag": "112dfb4f-3ddd-4ac2-992f-8d8857ceb77a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:03:22.996991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-cfdbf903-964a-4e1e-857c-865148d87e25 req-6c0bad96-884d-437e-a1a1-0ab2779fee6d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:22.997487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-cfdbf903-964a-4e1e-857c-865148d87e25 req-6c0bad96-884d-437e-a1a1-0ab2779fee6d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:22.997929 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-cfdbf903-964a-4e1e-857c-865148d87e25 req-6c0bad96-884d-437e-a1a1-0ab2779fee6d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:23.013765 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-cfdbf903-964a-4e1e-857c-865148d87e25 req-6c0bad96-884d-437e-a1a1-0ab2779fee6d service nova] Creating event network-vif-deleted:112dfb4f-3ddd-4ac2-992f-8d8857ceb77a for instance fd9913e7-bae2-441b-834f-104145de1bf6 on n-h2-854119-9 Aug 29 06:03:23.019254 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-cfdbf903-964a-4e1e-857c-865148d87e25 req-6c0bad96-884d-437e-a1a1-0ab2779fee6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093690 Aug 29 06:03:23.019879 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3925/7841] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:03:23.939271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:23.939898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: fd9913e7-bae2-441b-834f-104145de1bf6] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:23.947699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:23.948243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:23.948713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:23.949414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:23.949871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:23.950299 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:23.964168 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] HTTP exception thrown: Instance fd9913e7-bae2-441b-834f-104145de1bf6 could not be found. Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Request method failure captured: Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 HTTP/1.1 Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFV_yA0PTdhv3zoAq_3zNCcHEQm5S9yf00uVQf_QybGU2vxAbpj6Vtc3YtZZjpiWR8Ch19hEng53iIR6FqEAlTucn5WEXzZYvgg6S3SDgcBmHmof1UiVpqPp1c2NPOmemFnV3QjxKW1fBvcKq-d82S0InGG3CcGvjQDfo06D0yNUC3M Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 8441eddcb9134d87b8d05471c3c87c3a Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8441eddcb9134d87b8d05471c3c87c3a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 8441eddcb9134d87b8d05471c3c87c3a Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestMinimumBasicScenario-985068194-project Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 75c89e30160f4e64a16038c7bdc60f0f Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestMinimumBasicScenario-985068194-project Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance fd9913e7-bae2-441b-834f-104145de1bf6 could not be found. Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'fd9913e7-bae2-441b-834f-104145de1bf6'} Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9913e7-bae2-441b-834f-104145de1bf6 could not be found. Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9913e7-bae2-441b-834f-104145de1bf6 could not be found. Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:03:23.965737 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9913e7-bae2-441b-834f-104145de1bf6 could not be found. Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Returning 404 to user: Instance fd9913e7-bae2-441b-834f-104145de1bf6 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1dfc3e05-9e0d-4426-b4a0-9013752ec4be tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6" status: 404 len: 111 microversion: 2.1 time: 0.031856 Aug 29 06:03:23.970416 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3917/7842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:23 2022] GET /compute/v2.1/servers/fd9913e7-bae2-441b-834f-104145de1bf6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:03:23.977755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6359eb54-9b9c-44c0-a08a-e6b30cf310ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '.version_select at 0x7f1ab9548820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:24.004478 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6359eb54-9b9c-44c0-a08a-e6b30cf310ce tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-160509394" status: 202 len: 0 microversion: 2.1 time: 0.031848 Aug 29 06:03:24.005189 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3926/7843] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 29 06:03:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-160509394 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:03:32.898109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ffaaf6f4-a0b7-446a-88a5-46f9edf3c976 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'create', calling method: .version_select at 0x7f1ab807cee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1006750707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8spR2Kcz8tquRYL7GzQTg7PMLiMQaN5MUD1Rr5H9NDQO+Qs20/I2e/WTQ25JheI3OWe/cTQfgIedzDBp9jUtIWAqA6QQgEmUrfbbH4+VlbCXue+TuESNIACkwxWFIY6w=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:03:32.916444 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ffaaf6f4-a0b7-446a-88a5-46f9edf3c976 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Getting quotas for project 8441eddcb9134d87b8d05471c3c87c3a. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:03:32.923116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ffaaf6f4-a0b7-446a-88a5-46f9edf3c976 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Getting quotas for user 75c89e30160f4e64a16038c7bdc60f0f and project 8441eddcb9134d87b8d05471c3c87c3a. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:03:32.953549 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ffaaf6f4-a0b7-446a-88a5-46f9edf3c976 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.117558 Aug 29 06:03:32.954187 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3918/7844] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 06:03:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:33.004794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:33.009186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-374898265", "imageRef": "333bb9fa-e959-4164-9a09-2fb987dbb3cf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1006750707", "networks": [{"uuid": "abaab465-276a-4397-afef-012bad7ed264"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:03:33.063024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] validate_networks() for [('abaab465-276a-4397-afef-012bad7ed264', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:03:33.516730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:03:33.517170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:03:33.517696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:03:33.518122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:03:33.518549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:03:33.528293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:33.528791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:33.529242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:33.529991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:33.530461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:33.530880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:33.548038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Getting quotas for project 8441eddcb9134d87b8d05471c3c87c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:03:33.553450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Getting quotas for user 75c89e30160f4e64a16038c7bdc60f0f and project 8441eddcb9134d87b8d05471c3c87c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:03:33.566492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:03:33.569064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='333bb9fa-e959-4164-9a09-2fb987dbb3cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:03:33.621111 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ef76d79-77ec-45f5-8f4a-ffd1c1bb72ef tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618017 Aug 29 06:03:33.622138 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3927/7845] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:03:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 06:03:33.639173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e1b11cc-d27c-48d4-8840-c03187860f12 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:33.639173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e1b11cc-d27c-48d4-8840-c03187860f12 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:33.691517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1e1b11cc-d27c-48d4-8840-c03187860f12 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:33.698805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1e1b11cc-d27c-48d4-8840-c03187860f12 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1258 microversion: 2.1 time: 0.069469 Aug 29 06:03:33.699376 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3919/7846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:33 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:34.724210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-627ca225-7c35-4383-af3a-fde79b5c5ab2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:34.724981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-627ca225-7c35-4383-af3a-fde79b5c5ab2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:34.784708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-627ca225-7c35-4383-af3a-fde79b5c5ab2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:34.792073 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-627ca225-7c35-4383-af3a-fde79b5c5ab2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1258 microversion: 2.1 time: 0.073171 Aug 29 06:03:34.792755 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3928/7847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:34 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:35.817142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9889b33b-1e22-4226-8e8a-85220bdab4b6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:35.817772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9889b33b-1e22-4226-8e8a-85220bdab4b6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:35.821980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:35.880684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-9889b33b-1e22-4226-8e8a-85220bdab4b6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:35.888299 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9889b33b-1e22-4226-8e8a-85220bdab4b6 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1258 microversion: 2.1 time: 0.078113 Aug 29 06:03:35.888932 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3920/7848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:35 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:36.909722 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2a153f1-af9a-4078-8653-655f03421e57 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:36.910425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2a153f1-af9a-4078-8653-655f03421e57 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:36.968037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2a153f1-af9a-4078-8653-655f03421e57 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:36.975372 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2a153f1-af9a-4078-8653-655f03421e57 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1258 microversion: 2.1 time: 0.070280 Aug 29 06:03:36.975922 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3929/7849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:36 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:38.001642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:38.002699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:38.010768 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:38.011271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:38.011719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:38.012500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:38.012977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:38.013410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:38.082797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:38.091051 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4efcc323-c01c-4492-89dc-158fec56b6cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1262 microversion: 2.1 time: 0.097247 Aug 29 06:03:38.091630 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3921/7850] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:37 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1262 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:39.112861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:39.113888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:39.122831 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:39.123686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:39.124658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:39.125523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:39.126268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:39.126885 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:39.274550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:39.283667 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef4bfd4b-7767-465e-97cd-0831f0091384 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1316 microversion: 2.1 time: 0.176120 Aug 29 06:03:39.284745 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3930/7851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:39 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:40.306628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:40.307172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:40.309929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:40.317837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:40.318628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:40.319335 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:40.321012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:40.321928 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:40.322542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:40.511215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:40.527359 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d61b0b95-b274-443d-990d-904ef6957aa4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.224884 Aug 29 06:03:40.528411 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3922/7852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:40 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:41.548862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:41.549517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:41.552685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:41.563074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:41.563074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:41.563074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:41.563074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:41.563074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:41.563074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:41.708800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:41.717465 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-442842ad-3159-478c-806b-71df42904146 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.172461 Aug 29 06:03:41.718477 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3931/7853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:41 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:03:42.739414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:42.739994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:42.747137 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:42.747636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:42.748075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:42.748794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:42.749243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:42.749669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:42.885228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:42.892992 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e179e6c5-c1b6-4c93-8791-7a6d9987db92 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.157761 Aug 29 06:03:42.893570 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3923/7854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:42 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:43.919112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:43.919775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:43.923955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:43.927962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:43.928526 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:43.929012 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:43.929744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:43.930186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:43.930642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:44.082714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:44.091405 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5d5bb18e-adab-4a76-8e95-8e23195f1b75 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.176499 Aug 29 06:03:44.092318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3932/7855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:43 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:45.117672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:45.118702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:45.127205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:45.127688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:45.128172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:45.128854 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:45.129436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:45.129885 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:45.284046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:45.292552 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2542f156-f38b-421c-872d-cedda188f890 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.182681 Aug 29 06:03:45.293463 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3924/7856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:45 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:46.316912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:46.317866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:46.325849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:46.326349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:46.326795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:46.327512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:46.327978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:46.328444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:46.465350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:46.473737 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b6d9dfbb-fd52-4630-b66c-ad01f5f70f93 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.163090 Aug 29 06:03:46.474509 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3933/7857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:46 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:47.495042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:47.495670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:47.497591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=8 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:47.504242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:47.504722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:47.505140 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:47.505830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:47.506300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:47.506720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:47.653411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:47.661433 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-be83d170-5545-4f61-8cfd-330b4711df74 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.170398 Aug 29 06:03:47.662014 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3925/7858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:47 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:48.682656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:48.683320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:48.685138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=10 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:03:48.691880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:48.692400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:48.692840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:48.693547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:48.694004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:48.694431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:48.837613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:48.850518 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-378dc9de-d302-4b0f-a191-baa8f3f648d0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.171495 Aug 29 06:03:48.851271 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3934/7859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:48 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:49.789400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a0aa6f08-14f0-49fc-9d66-536e234235b1 req-6f60bf9b-dac5-4aa3-a1da-983cb9f3fbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b5b9a0-9b36-45ae-9204-2c990b56fc2c", "tag": "010cc968-597d-4a2c-ae7b-919d0d379a85"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:03:49.801797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a0aa6f08-14f0-49fc-9d66-536e234235b1 req-6f60bf9b-dac5-4aa3-a1da-983cb9f3fbf8 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:49.802261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a0aa6f08-14f0-49fc-9d66-536e234235b1 req-6f60bf9b-dac5-4aa3-a1da-983cb9f3fbf8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:49.802686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a0aa6f08-14f0-49fc-9d66-536e234235b1 req-6f60bf9b-dac5-4aa3-a1da-983cb9f3fbf8 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:49.814477 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a0aa6f08-14f0-49fc-9d66-536e234235b1 req-6f60bf9b-dac5-4aa3-a1da-983cb9f3fbf8 service nova] Creating event network-changed:010cc968-597d-4a2c-ae7b-919d0d379a85 for instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c on n-h2-854119-9 Aug 29 06:03:49.820480 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a0aa6f08-14f0-49fc-9d66-536e234235b1 req-6f60bf9b-dac5-4aa3-a1da-983cb9f3fbf8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034702 Aug 29 06:03:49.821871 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3926/7860] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:49.876723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:49.877339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:49.884860 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:49.885364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:49.885816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:49.886560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:49.887018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:49.887470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:50.022288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:50.030468 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-899330f1-303d-4f00-a7ad-543375cab1f3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.157912 Aug 29 06:03:50.031264 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3935/7861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:49 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:51.053311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:51.054010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:51.060682 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:51.061160 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:51.061617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:51.062309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:51.062757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:51.063202 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:51.206243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:51.214700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-42f71ad0-457a-4754-a72f-a369ad1150e3 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.166600 Aug 29 06:03:51.215278 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3927/7862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:51 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:52.237229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:52.238431 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:52.249072 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:52.249594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:52.250166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:52.250967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:52.251463 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:52.251914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:52.420498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:52.428464 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-867f25b7-17d8-4bf8-add1-10bfc551386a tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.197114 Aug 29 06:03:52.429250 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3936/7863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:52 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:53.453780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:53.454754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:53.466719 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:53.467533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:53.468304 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:53.469473 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:53.470228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:53.470949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:53.609480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:53.621275 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e06d095a-ef96-41ac-8bbe-0daf34e608ed tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.173924 Aug 29 06:03:53.622084 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3928/7864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:53 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:54.644610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:54.645263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:54.653086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:54.653632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:54.654075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:54.654930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:54.655390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:54.655819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:54.802038 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:54.810346 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-78817c23-567e-40e6-9e00-78603485b5e4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.170738 Aug 29 06:03:54.810908 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3937/7865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:54 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:55.832659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:55.833400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:55.840841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:55.841325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:55.841751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:55.842445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:55.842876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:55.843318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:55.988630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c5636d37-612f-47e3-b318-0bb372ba7231 req-34ed3478-41fb-476a-8c6b-2d4577218517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b5b9a0-9b36-45ae-9204-2c990b56fc2c", "name": "network-vif-plugged", "status": "completed", "tag": "010cc968-597d-4a2c-ae7b-919d0d379a85"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:03:55.989655 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:55.999639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c5636d37-612f-47e3-b318-0bb372ba7231 req-34ed3478-41fb-476a-8c6b-2d4577218517 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:56.000406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c5636d37-612f-47e3-b318-0bb372ba7231 req-34ed3478-41fb-476a-8c6b-2d4577218517 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:56.001061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c5636d37-612f-47e3-b318-0bb372ba7231 req-34ed3478-41fb-476a-8c6b-2d4577218517 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:56.002928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e6af6b4c-ed10-4653-9eea-b980fb5f8f7c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.174319 Aug 29 06:03:56.003481 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3929/7866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:55 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:56.013927 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c5636d37-612f-47e3-b318-0bb372ba7231 req-34ed3478-41fb-476a-8c6b-2d4577218517 service nova] Creating event network-vif-plugged:010cc968-597d-4a2c-ae7b-919d0d379a85 for instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c on n-h2-854119-9 Aug 29 06:03:56.019073 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c5636d37-612f-47e3-b318-0bb372ba7231 req-34ed3478-41fb-476a-8c6b-2d4577218517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095227 Aug 29 06:03:56.019705 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3938/7867] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:03:57.025724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:57.026346 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:57.033780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:57.034268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:57.034709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:57.035414 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:57.035871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:57.036348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:57.170439 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:57.178355 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55b62ef6-a5f5-45b0-992d-7df2b9742c28 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1358 microversion: 2.1 time: 0.157840 Aug 29 06:03:57.178976 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3930/7868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:57 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:58.205313 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:58.206474 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:58.219152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:58.219975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:58.220796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:58.221914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:58.222717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:58.223444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:58.361150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:58.369691 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-36dd4c6c-9f5f-446f-9d56-3b56fc247717 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1548 microversion: 2.1 time: 0.171692 Aug 29 06:03:58.370308 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3939/7869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:58 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:58.390156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:58.390803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:58.398373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:58.398859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:58.399296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:58.399994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:58.400493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:58.400924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:58.535188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:58.543599 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08649944-ab1e-47eb-bdbb-88e143f9344f tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1548 microversion: 2.1 time: 0.157436 Aug 29 06:03:58.544229 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3931/7870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:58 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:03:58.563586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:58.568546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:58.569335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Searching by: {'deleted': False, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a'} {{(pid=128871) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 06:03:58.575278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:58.575814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:58.576290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:58.577034 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:58.577501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:58.577932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:58.602716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.multi_cell_list [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 06:03:58.629488 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-962b08a2-168e-4609-a741-cbc8b941acc1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069755 Aug 29 06:03:58.630066 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3940/7871] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 29 06:03:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:03:58.641790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:03:58.642436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:03:58.649046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:58.649591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:58.650269 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:58.650797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:03:58.651317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:03:58.651713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:03:58.787042 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:03:58.795387 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6552badc-5858-4e8c-8e35-00d29e900812 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1548 microversion: 2.1 time: 0.157629 Aug 29 06:03:58.795961 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3932/7872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:03:58 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:04:00.347528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a60497f7-b52c-4cf7-87d1-e26269f3a379 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0774ae6-c647-4204-9615-a269421391b2"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:04:00.349954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a60497f7-b52c-4cf7-87d1-e26269f3a379 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:04:00.357466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a60497f7-b52c-4cf7-87d1-e26269f3a379 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:00.358080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a60497f7-b52c-4cf7-87d1-e26269f3a379 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:00.358523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a60497f7-b52c-4cf7-87d1-e26269f3a379 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:00.359225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a60497f7-b52c-4cf7-87d1-e26269f3a379 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:00.359682 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a60497f7-b52c-4cf7-87d1-e26269f3a379 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:00.360111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a60497f7-b52c-4cf7-87d1-e26269f3a379 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:00.636611 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a60497f7-b52c-4cf7-87d1-e26269f3a379 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293025 Aug 29 06:04:00.637287 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3941/7873] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 29 06:04:00 2022] POST /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:04:11.464600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:04:11.465218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:04:11.467809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=21 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:04:11.468963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=68 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:04:11.474784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:11.475261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:11.475695 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:11.476433 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:11.476895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:11.477314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:11.616892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:04:11.625944 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-71403ba5-c119-4460-acf0-bed8785354f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1594 microversion: 2.1 time: 0.165421 Aug 29 06:04:11.626530 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3933/7874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:04:11 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:04:13.590087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:04:13.590912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=21 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:04:13.591659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:04:13.596835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-f8cb35a0-47b0-4350-9ec1-2017f7a4cde2 req-e03c0eea-f908-4641-bbca-30f6c5e4c814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b5b9a0-9b36-45ae-9204-2c990b56fc2c", "tag": "010cc968-597d-4a2c-ae7b-919d0d379a85"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:04:13.607960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f8cb35a0-47b0-4350-9ec1-2017f7a4cde2 req-e03c0eea-f908-4641-bbca-30f6c5e4c814 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:13.608557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f8cb35a0-47b0-4350-9ec1-2017f7a4cde2 req-e03c0eea-f908-4641-bbca-30f6c5e4c814 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:13.608930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-f8cb35a0-47b0-4350-9ec1-2017f7a4cde2 req-e03c0eea-f908-4641-bbca-30f6c5e4c814 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:13.623321 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-f8cb35a0-47b0-4350-9ec1-2017f7a4cde2 req-e03c0eea-f908-4641-bbca-30f6c5e4c814 service nova] Creating event network-changed:010cc968-597d-4a2c-ae7b-919d0d379a85 for instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c on n-h2-854119-9 Aug 29 06:04:13.628729 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-f8cb35a0-47b0-4350-9ec1-2017f7a4cde2 req-e03c0eea-f908-4641-bbca-30f6c5e4c814 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040623 Aug 29 06:04:13.629757 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3942/7875] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:04:15.067717 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-449793911"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:04:15.068298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:04:15.075924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:15.076450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:15.076886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:15.077582 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:15.078036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:15.078461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:15.220803 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.network.security_group_api [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Adding security group 4333b76d-11d7-424a-af96-360ddcc8531f to port 010cc968-597d-4a2c-ae7b-919d0d379a85 Aug 29 06:04:15.560712 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6e66ad5e-fde9-4194-bd4c-4182859afae2 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.497072 Aug 29 06:04:15.561365 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3934/7876] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:04:15 2022] POST /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:04:15.572546 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:04:15.573914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:04:15.580794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:15.581273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:15.581920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:15.582624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:15.583070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:15.583502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:15.658726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5361c1e3-4e0d-4319-a056-6de24fda9d91 req-3110eb03-8e88-4f64-a502-c03eb4989604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b5b9a0-9b36-45ae-9204-2c990b56fc2c", "tag": "010cc968-597d-4a2c-ae7b-919d0d379a85"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:04:15.668741 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5361c1e3-4e0d-4319-a056-6de24fda9d91 req-3110eb03-8e88-4f64-a502-c03eb4989604 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:04:15.669488 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5361c1e3-4e0d-4319-a056-6de24fda9d91 req-3110eb03-8e88-4f64-a502-c03eb4989604 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:04:15.670360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5361c1e3-4e0d-4319-a056-6de24fda9d91 req-3110eb03-8e88-4f64-a502-c03eb4989604 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:04:15.682669 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5361c1e3-4e0d-4319-a056-6de24fda9d91 req-3110eb03-8e88-4f64-a502-c03eb4989604 service nova] Creating event network-changed:010cc968-597d-4a2c-ae7b-919d0d379a85 for instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c on n-h2-854119-9 Aug 29 06:04:15.688259 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5361c1e3-4e0d-4319-a056-6de24fda9d91 req-3110eb03-8e88-4f64-a502-c03eb4989604 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033177 Aug 29 06:04:15.689171 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3935/7877] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:04:15.739908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:04:15.749980 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-906271f8-2c77-46cb-99ef-c44b0179d423 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1759 microversion: 2.1 time: 0.183943 Aug 29 06:04:15.750692 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3943/7878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:04:15 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:05:03.899485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:05:03.900795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=12 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:05:03.903934 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:05:03.903934 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:05:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/action (ip 10.222.0.20) !!! Aug 29 06:05:03.913752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9fa084e0-efcc-455b-86a7-f82008f698a4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:05:03.917507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9fa084e0-efcc-455b-86a7-f82008f698a4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:03.929873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fa084e0-efcc-455b-86a7-f82008f698a4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:03.930358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fa084e0-efcc-455b-86a7-f82008f698a4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:03.930785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fa084e0-efcc-455b-86a7-f82008f698a4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:03.931451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fa084e0-efcc-455b-86a7-f82008f698a4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:03.931915 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fa084e0-efcc-455b-86a7-f82008f698a4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:03.932446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9fa084e0-efcc-455b-86a7-f82008f698a4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:04.007897 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9fa084e0-efcc-455b-86a7-f82008f698a4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.111658 Aug 29 06:05:04.008748 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3936/7879] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:05:03 2022] POST /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:05:04.018594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:04.019227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:04.021592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:05:04.022367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:05:04.028980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:04.029559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:04.029968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:04.030868 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:04.031346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:04.031792 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:04.183056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:04.191892 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-15c018ae-7a52-49fb-b9d4-b14b17675cc5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1751 microversion: 2.1 time: 0.177656 Aug 29 06:05:04.192505 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3944/7880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:04 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:05.219700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:05.220744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:05.231154 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:05.231826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:05.232589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:05.233637 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:05.234373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:05.235049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:05.392957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:05.402184 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-206e684e-dfa5-4a37-bba2-81dcc6a5f90c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1756 microversion: 2.1 time: 0.190955 Aug 29 06:05:05.402951 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3937/7881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:05 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:06.430196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:06.431350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:06.440899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:06.441461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:06.441912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:06.442590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:06.443090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:06.443530 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:06.604339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:06.616947 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69141820-0f41-47a5-ba0c-10b1c5743c19 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1756 microversion: 2.1 time: 0.193811 Aug 29 06:05:06.617758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3945/7882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:06 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:07.638998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:07.639731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:07.647024 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:07.647513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:07.647937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:07.648677 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:07.649157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:07.649580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:07.797328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:07.806297 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-88667316-acdd-4d74-b51c-05d3f837a551 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1756 microversion: 2.1 time: 0.171282 Aug 29 06:05:07.806870 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3938/7883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:07 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:08.832213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:08.833115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:08.845003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:08.845875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:08.846325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:08.847036 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:08.847510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:08.847941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:09.002063 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:09.015371 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5a3cadac-055c-4916-9138-a85cd01081fa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1756 microversion: 2.1 time: 0.189747 Aug 29 06:05:09.015874 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3946/7884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:08 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:10.041603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:10.042665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:10.051552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:10.052020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:10.052497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:10.053195 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:10.053659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:10.054087 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:10.206773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:10.215314 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-976dc263-dad3-4f85-954d-7e1dd00a6af4 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1756 microversion: 2.1 time: 0.180909 Aug 29 06:05:10.215887 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3939/7885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:10 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:11.241194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:11.242215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:11.253619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:11.254443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:11.255174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:11.256375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:11.257144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:11.257854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:11.411699 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:11.420804 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bbcfad3f-f84d-462a-b953-e035b1466a97 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1756 microversion: 2.1 time: 0.186291 Aug 29 06:05:11.421447 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3947/7886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:11 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:12.443922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:12.445116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:12.454578 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:12.455218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:12.455789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:12.456758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:12.457352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:12.457916 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:12.616379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:12.625469 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-070fa292-8a5f-4f8f-aab4-8ad980cda1aa tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1756 microversion: 2.1 time: 0.186726 Aug 29 06:05:12.626062 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3940/7887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:12 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:13.650469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:13.651147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:13.661731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:13.662422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:13.663093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:13.664194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:13.664843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:13.665471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:13.826696 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:13.835399 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d6c91a31-8a23-4141-b269-57a30eeed835 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1756 microversion: 2.1 time: 0.191090 Aug 29 06:05:13.835944 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3948/7888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:13 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:14.861378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:14.862237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:14.874003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:14.874807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:14.875525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:14.876817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:14.877274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:14.877705 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:15.027418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:15.036526 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cf1d5bd3-d865-4aee-b438-d496e20304cf tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1756 microversion: 2.1 time: 0.181906 Aug 29 06:05:15.037136 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3941/7889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:14 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:05:16.063604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:05:16.064599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:05:16.072783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:16.073273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:16.073712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:16.074411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:05:16.074866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:05:16.075294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:05:16.231161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:05:16.243551 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8da9872e-b70b-4803-9af3-84b0f0f313af tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1759 microversion: 2.1 time: 0.186655 Aug 29 06:05:16.244387 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3949/7890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:05:16 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:19.450041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=12 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:06:19.450804 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:06:19.455130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-449793911"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:06:19.455675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:19.463507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:19.464161 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:19.464726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:19.465566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:19.466041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:19.466603 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:19.623968 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.network.security_group_api [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Removing security group 4333b76d-11d7-424a-af96-360ddcc8531f from port 010cc968-597d-4a2c-ae7b-919d0d379a85 Aug 29 06:06:19.955018 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-83d2f5fd-3559-4f37-bcbe-34b586d27ddc tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "POST /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.508098 Aug 29 06:06:19.955652 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3942/7891] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:06:19 2022] POST /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:06:19.982447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-9cc58df2-c141-4a16-b325-b40a94c601cd req-ceaddb86-f403-46a0-8a04-3cebcd5c6d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b5b9a0-9b36-45ae-9204-2c990b56fc2c", "tag": "010cc968-597d-4a2c-ae7b-919d0d379a85"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:06:19.993745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:06:19.995202 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=36 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:06:19.998226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9cc58df2-c141-4a16-b325-b40a94c601cd req-ceaddb86-f403-46a0-8a04-3cebcd5c6d16 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:19.998902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9cc58df2-c141-4a16-b325-b40a94c601cd req-ceaddb86-f403-46a0-8a04-3cebcd5c6d16 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:19.999501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-9cc58df2-c141-4a16-b325-b40a94c601cd req-ceaddb86-f403-46a0-8a04-3cebcd5c6d16 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:20.019502 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-9cc58df2-c141-4a16-b325-b40a94c601cd req-ceaddb86-f403-46a0-8a04-3cebcd5c6d16 service nova] Creating event network-changed:010cc968-597d-4a2c-ae7b-919d0d379a85 for instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c on n-h2-854119-9 Aug 29 06:06:20.036625 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-9cc58df2-c141-4a16-b325-b40a94c601cd req-ceaddb86-f403-46a0-8a04-3cebcd5c6d16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060330 Aug 29 06:06:20.038198 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3950/7892] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:06:21.114132 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:21.114701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:21.121387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:21.121869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:21.122302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:21.123016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:21.123467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:21.123879 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:21.206092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lazy-loading 'services' on Instance uuid a4b5b9a0-9b36-45ae-9204-2c990b56fc2c {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:06:21.282191 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-da73a6e4-810b-489a-8a89-4a3a615a553c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments/a0774ae6-c647-4204-9615-a269421391b2" status: 202 len: 0 microversion: 2.1 time: 0.173670 Aug 29 06:06:21.282955 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3943/7893] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 06:06:21 2022] DELETE /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments/a0774ae6-c647-4204-9615-a269421391b2 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:06:21.294278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-19915754-1ecd-4d21-9852-c197fba8108b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:21.297242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-19915754-1ecd-4d21-9852-c197fba8108b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:21.304390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19915754-1ecd-4d21-9852-c197fba8108b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:21.304889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19915754-1ecd-4d21-9852-c197fba8108b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:21.306470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19915754-1ecd-4d21-9852-c197fba8108b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:21.307797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19915754-1ecd-4d21-9852-c197fba8108b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:21.308573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19915754-1ecd-4d21-9852-c197fba8108b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:21.309100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-19915754-1ecd-4d21-9852-c197fba8108b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:21.349401 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-19915754-1ecd-4d21-9852-c197fba8108b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060749 Aug 29 06:06:21.350252 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3951/7894] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:06:21 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:06:22.054607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0e49e0a8-a304-4a67-b259-fa61d2540ae6 req-13147ca9-0e66-4c43-b30f-0ecb4e9aa2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b5b9a0-9b36-45ae-9204-2c990b56fc2c", "tag": "010cc968-597d-4a2c-ae7b-919d0d379a85"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:06:22.065369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0e49e0a8-a304-4a67-b259-fa61d2540ae6 req-13147ca9-0e66-4c43-b30f-0ecb4e9aa2de service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:22.066112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0e49e0a8-a304-4a67-b259-fa61d2540ae6 req-13147ca9-0e66-4c43-b30f-0ecb4e9aa2de service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:22.066640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0e49e0a8-a304-4a67-b259-fa61d2540ae6 req-13147ca9-0e66-4c43-b30f-0ecb4e9aa2de service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:22.080863 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0e49e0a8-a304-4a67-b259-fa61d2540ae6 req-13147ca9-0e66-4c43-b30f-0ecb4e9aa2de service nova] Creating event network-changed:010cc968-597d-4a2c-ae7b-919d0d379a85 for instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c on n-h2-854119-9 Aug 29 06:06:22.085713 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0e49e0a8-a304-4a67-b259-fa61d2540ae6 req-13147ca9-0e66-4c43-b30f-0ecb4e9aa2de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035821 Aug 29 06:06:22.086517 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3944/7895] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:06:22.362754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e500a81-f8e6-486a-a1a8-bde4ae213401 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:22.365453 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e500a81-f8e6-486a-a1a8-bde4ae213401 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:22.372934 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e500a81-f8e6-486a-a1a8-bde4ae213401 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:22.373537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e500a81-f8e6-486a-a1a8-bde4ae213401 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:22.374173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e500a81-f8e6-486a-a1a8-bde4ae213401 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:22.374952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e500a81-f8e6-486a-a1a8-bde4ae213401 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:22.375523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e500a81-f8e6-486a-a1a8-bde4ae213401 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:22.376195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e500a81-f8e6-486a-a1a8-bde4ae213401 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:22.407756 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e500a81-f8e6-486a-a1a8-bde4ae213401 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048950 Aug 29 06:06:22.408514 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3952/7896] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:06:22 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:06:23.420371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a8bc244-6cba-41ca-b01c-861799cc073c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:23.422796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a8bc244-6cba-41ca-b01c-861799cc073c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:23.430919 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8bc244-6cba-41ca-b01c-861799cc073c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:23.431407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8bc244-6cba-41ca-b01c-861799cc073c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:23.431835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8bc244-6cba-41ca-b01c-861799cc073c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:23.432585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8bc244-6cba-41ca-b01c-861799cc073c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:23.433031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8bc244-6cba-41ca-b01c-861799cc073c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:23.433556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a8bc244-6cba-41ca-b01c-861799cc073c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:23.475534 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a8bc244-6cba-41ca-b01c-861799cc073c tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059794 Aug 29 06:06:23.476113 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3945/7897] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:06:23 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:06:24.487849 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0dd8650c-011a-4047-a91f-50288f90c712 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:24.490091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0dd8650c-011a-4047-a91f-50288f90c712 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:24.497512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dd8650c-011a-4047-a91f-50288f90c712 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:24.498024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dd8650c-011a-4047-a91f-50288f90c712 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:24.498471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dd8650c-011a-4047-a91f-50288f90c712 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:24.499189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dd8650c-011a-4047-a91f-50288f90c712 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:24.499649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dd8650c-011a-4047-a91f-50288f90c712 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:24.500065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0dd8650c-011a-4047-a91f-50288f90c712 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:24.531409 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0dd8650c-011a-4047-a91f-50288f90c712 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047855 Aug 29 06:06:24.531998 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3953/7898] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:06:24 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:06:25.543361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-9f77e751-f635-4692-8318-99efdd630149 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:25.545849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-9f77e751-f635-4692-8318-99efdd630149 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:25.553158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77e751-f635-4692-8318-99efdd630149 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:25.553643 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77e751-f635-4692-8318-99efdd630149 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:25.554078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77e751-f635-4692-8318-99efdd630149 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:25.554834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77e751-f635-4692-8318-99efdd630149 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:25.555290 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77e751-f635-4692-8318-99efdd630149 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:25.555712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-9f77e751-f635-4692-8318-99efdd630149 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:25.586104 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-9f77e751-f635-4692-8318-99efdd630149 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046729 Aug 29 06:06:25.586693 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3946/7899] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:06:25 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:06:26.611651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5b2acd5a-5bd8-4970-89b9-f74bdb8dc182 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:26.615273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5b2acd5a-5bd8-4970-89b9-f74bdb8dc182 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:26.625054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2acd5a-5bd8-4970-89b9-f74bdb8dc182 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:26.625556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2acd5a-5bd8-4970-89b9-f74bdb8dc182 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:26.626006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2acd5a-5bd8-4970-89b9-f74bdb8dc182 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:26.626731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2acd5a-5bd8-4970-89b9-f74bdb8dc182 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:26.627199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2acd5a-5bd8-4970-89b9-f74bdb8dc182 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:26.627628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5b2acd5a-5bd8-4970-89b9-f74bdb8dc182 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:26.665686 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5b2acd5a-5bd8-4970-89b9-f74bdb8dc182 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060796 Aug 29 06:06:26.666280 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3954/7900] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 29 06:06:26 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 06:06:26.680639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:26.681519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:26.693041 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:26.693728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:26.694330 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:26.695654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:26.696361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:26.697070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:26.776215 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] HTTP exception thrown: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c is not attached to volume a0774ae6-c647-4204-9615-a269421391b2 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Request method failure captured: Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: request: DELETE /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments/a0774ae6-c647-4204-9615-a269421391b2 HTTP/1.1 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFV_yA0PTdhv3zoAq_3zNCcHEQm5S9yf00uVQf_QybGU2vxAbpj6Vtc3YtZZjpiWR8Ch19hEng53iIR6FqEAlTucn5WEXzZYvgg6S3SDgcBmHmof1UiVpqPp1c2NPOmemFnV3QjxKW1fBvcKq-d82S0InGG3CcGvjQDfo06D0yNUC3M Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 8441eddcb9134d87b8d05471c3c87c3a Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8441eddcb9134d87b8d05471c3c87c3a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 8441eddcb9134d87b8d05471c3c87c3a Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestMinimumBasicScenario-985068194-project Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 75c89e30160f4e64a16038c7bdc60f0f Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestMinimumBasicScenario-985068194-project Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c is not attached to volume a0774ae6-c647-4204-9615-a269421391b2 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'server_id': 'a4b5b9a0-9b36-45ae-9204-2c990b56fc2c', 'id': 'a0774ae6-c647-4204-9615-a269421391b2'} Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a0774ae6-c647-4204-9615-a269421391b2. Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c is not attached to volume a0774ae6-c647-4204-9615-a269421391b2 Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:06:26.777853 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:06:26.782022 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:06:26.782022 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:06:26.782022 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c is not attached to volume a0774ae6-c647-4204-9615-a269421391b2 Aug 29 06:06:26.782022 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:26.782022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Returning 404 to user: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c is not attached to volume a0774ae6-c647-4204-9615-a269421391b2 {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:06:26.782022 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-113bc465-fba2-42f9-991e-1054ce04d2c1 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments/a0774ae6-c647-4204-9615-a269421391b2" status: 404 len: 154 microversion: 2.1 time: 0.105298 Aug 29 06:06:26.782022 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3947/7901] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 29 06:06:26 2022] DELETE /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c/os-volume_attachments/a0774ae6-c647-4204-9615-a269421391b2 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:06:30.037503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:30.038005 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:30.045976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:30.046490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:30.046931 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:30.047672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:30.048166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:30.048608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:30.076587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:06:30.165158 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a6989c30-5841-4e5f-91ca-b01e23f1181b tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 204 len: 0 microversion: 2.1 time: 0.131319 Aug 29 06:06:30.166176 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3955/7902] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:06:30 2022] DELETE /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:06:30.176522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:30.177139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:30.186964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:30.187452 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:30.187888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:30.188621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:30.189073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:30.189493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:30.328022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:30.337227 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-31fb6e5d-8ac3-4936-8684-331355e25ba0 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1554 microversion: 2.1 time: 0.165553 Aug 29 06:06:30.337918 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3948/7903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:30 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:31.361201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:31.361910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:31.372670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:31.373171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:31.373643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:31.374343 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:31.374807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:31.375234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:31.509348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:31.517646 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4e6b87f-fc05-47a0-8f06-6fec6941f378 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1554 microversion: 2.1 time: 0.160968 Aug 29 06:06:31.518240 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3956/7904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:31 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:32.513631 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-fcfd0cd1-b606-47f4-9326-69353ce89064 req-76b41ad7-3195-49ef-b6cc-0e9bce822672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b5b9a0-9b36-45ae-9204-2c990b56fc2c", "name": "network-vif-deleted", "tag": "010cc968-597d-4a2c-ae7b-919d0d379a85"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:06:32.524951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fcfd0cd1-b606-47f4-9326-69353ce89064 req-76b41ad7-3195-49ef-b6cc-0e9bce822672 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:32.525428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fcfd0cd1-b606-47f4-9326-69353ce89064 req-76b41ad7-3195-49ef-b6cc-0e9bce822672 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:32.525871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-fcfd0cd1-b606-47f4-9326-69353ce89064 req-76b41ad7-3195-49ef-b6cc-0e9bce822672 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:32.538449 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-fcfd0cd1-b606-47f4-9326-69353ce89064 req-76b41ad7-3195-49ef-b6cc-0e9bce822672 service nova] Creating event network-vif-deleted:010cc968-597d-4a2c-ae7b-919d0d379a85 for instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c on n-h2-854119-9 Aug 29 06:06:32.539340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:32.539971 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:32.543861 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-fcfd0cd1-b606-47f4-9326-69353ce89064 req-76b41ad7-3195-49ef-b6cc-0e9bce822672 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034147 Aug 29 06:06:32.544557 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3949/7905] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:06:32.551750 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:32.552336 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:32.552800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:32.553615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:32.554139 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:32.554575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:32.626090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c89e30160f4e64a16038c7bdc60f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441eddcb9134d87b8d05471c3c87c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:32.634321 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-90c7036b-c91f-4b4a-bc41-7472b6c9a6f5 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 200 len: 1343 microversion: 2.1 time: 0.099141 Aug 29 06:06:32.634908 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3957/7906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:32 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 1343 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:33.661623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:33.662766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [instance: a4b5b9a0-9b36-45ae-9204-2c990b56fc2c] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:33.671617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:33.672093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:33.672556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:33.673235 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:33.673673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:33.674088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:33.687958 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] HTTP exception thrown: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c could not be found. Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Request method failure captured: Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c HTTP/1.1 Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFV_yA0PTdhv3zoAq_3zNCcHEQm5S9yf00uVQf_QybGU2vxAbpj6Vtc3YtZZjpiWR8Ch19hEng53iIR6FqEAlTucn5WEXzZYvgg6S3SDgcBmHmof1UiVpqPp1c2NPOmemFnV3QjxKW1fBvcKq-d82S0InGG3CcGvjQDfo06D0yNUC3M Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 8441eddcb9134d87b8d05471c3c87c3a Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8441eddcb9134d87b8d05471c3c87c3a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8441eddcb9134d87b8d05471c3c87c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 8441eddcb9134d87b8d05471c3c87c3a Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestMinimumBasicScenario-985068194 Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestMinimumBasicScenario-985068194-project Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 75c89e30160f4e64a16038c7bdc60f0f Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestMinimumBasicScenario-985068194-project Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c could not be found. Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': 'a4b5b9a0-9b36-45ae-9204-2c990b56fc2c'} Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c could not be found. Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c could not be found. Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:06:33.689606 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c could not be found. Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Returning 404 to user: Instance a4b5b9a0-9b36-45ae-9204-2c990b56fc2c could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73994238-26fb-4515-bb01-ee5bbf2b38e7 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c" status: 404 len: 111 microversion: 2.1 time: 0.037935 Aug 29 06:06:33.694084 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3950/7907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:33 2022] GET /compute/v2.1/servers/a4b5b9a0-9b36-45ae-9204-2c990b56fc2c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:06:33.700525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3b4f2511-687c-4a7e-a895-22813df53129 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] Calling method '.version_select at 0x7f1ab8bc6af0>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:33.705408 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b4f2511-687c-4a7e-a895-22813df53129 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [2986978a-48e4-4788-86ed-c5cccf08efe0] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:06:34.717392 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b4f2511-687c-4a7e-a895-22813df53129 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] [2986978a-48e4-4788-86ed-c5cccf08efe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49036. Aug 29 06:06:34.741896 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3b4f2511-687c-4a7e-a895-22813df53129 tempest-TestMinimumBasicScenario-985068194 tempest-TestMinimumBasicScenario-985068194-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1006750707" status: 202 len: 0 microversion: 2.1 time: 1.045352 Aug 29 06:06:34.742536 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3958/7908] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Aug 29 06:06:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1006750707 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:06:43.827394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=18 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:06:43.828230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:06:43.921267 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:06:43.921494 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:06:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Aug 29 06:06:43.999252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ebc05f1c-b2c9-4e4c-8dd2-489267242e26 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: .version_select at 0x7f1ab3e90790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1052500297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4RmBfJw7w6rQDfDcPxQF0jSnwvbTwE7Mu/RJ7Nt7c1zj/YuDojn6k/38F9qzvSCbOOQWrnEQBg4UctJDDN11V3clV0F8a5NdaqZz7OCznogudGC6tkJnL0suDzWlOrZA=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:06:44.017332 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ebc05f1c-b2c9-4e4c-8dd2-489267242e26 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:06:44.022734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-ebc05f1c-b2c9-4e4c-8dd2-489267242e26 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:06:44.053886 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ebc05f1c-b2c9-4e4c-8dd2-489267242e26 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.231788 Aug 29 06:06:44.054537 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3951/7909] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 06:06:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:06:50.193975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:06:50.195653 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:06:50.195883 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:06:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Aug 29 06:06:50.196824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:06:50.202275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1741155439", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "a0994fb1-a594-48f5-801a-fd4365512b25"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1052500297", "security_groups": [{"name": "tempest-secgroup-smoke-522557145"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:06:50.330608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] validate_networks() for [('a0994fb1-a594-48f5-801a-fd4365512b25', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:06:50.819171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:06:50.819631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:06:50.820706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:06:50.821143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:06:50.821577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:06:50.831595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:50.832101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:50.832575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:50.833330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:50.833800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:50.834240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:50.852618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:06:50.858337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:06:50.871616 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:06:50.874302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:06:50.929828 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-156676fa-d40c-4d2d-8f22-8454cd4b62a4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737780 Aug 29 06:06:50.930494 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3959/7910] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:06:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 06:06:50.942497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-64a46acb-3fde-4bd1-85fe-a95b3ca4fd89 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:50.943849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-64a46acb-3fde-4bd1-85fe-a95b3ca4fd89 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:51.016785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-64a46acb-3fde-4bd1-85fe-a95b3ca4fd89 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:51.024027 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-64a46acb-3fde-4bd1-85fe-a95b3ca4fd89 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1267 microversion: 2.1 time: 0.086352 Aug 29 06:06:51.024655 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3952/7911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:50 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:52.046349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:52.047047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:52.055824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:52.056447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:52.056902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:52.057713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:52.058345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:52.058787 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:52.131456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:52.141478 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cc2cb0c3-8484-48a8-86a1-b0951d66881b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1319 microversion: 2.1 time: 0.100077 Aug 29 06:06:52.142224 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3960/7912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:52 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1319 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:53.163539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:53.164851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:53.173174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:53.173830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:53.174525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:53.175487 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:53.176246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:53.176910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:53.417654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:53.426930 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-69dce3e8-954a-46cb-9b16-8de1f40040c3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1392 microversion: 2.1 time: 0.267771 Aug 29 06:06:53.427516 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3953/7913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:53 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:53.728145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ec8dbfb3-01ca-48cc-81ef-70e84f0169fa req-8f93834c-294f-4ab8-8d20-fa48e43cc942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698bdedd-64c5-481f-a40a-6b16918a0fe0", "tag": "8e3c977b-1329-46fc-bf2b-b8c22a8a7129"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:06:53.742765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ec8dbfb3-01ca-48cc-81ef-70e84f0169fa req-8f93834c-294f-4ab8-8d20-fa48e43cc942 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:53.743694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ec8dbfb3-01ca-48cc-81ef-70e84f0169fa req-8f93834c-294f-4ab8-8d20-fa48e43cc942 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:53.744524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ec8dbfb3-01ca-48cc-81ef-70e84f0169fa req-8f93834c-294f-4ab8-8d20-fa48e43cc942 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:53.763789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ec8dbfb3-01ca-48cc-81ef-70e84f0169fa req-8f93834c-294f-4ab8-8d20-fa48e43cc942 service nova] Creating event network-changed:8e3c977b-1329-46fc-bf2b-b8c22a8a7129 for instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 on n-h1-854119-9 Aug 29 06:06:53.768842 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ec8dbfb3-01ca-48cc-81ef-70e84f0169fa req-8f93834c-294f-4ab8-8d20-fa48e43cc942 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044536 Aug 29 06:06:53.769628 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3961/7914] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:06:54.449531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:54.450144 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:54.457666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:54.458151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:54.458576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:54.459263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:54.459707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:54.460143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:54.601506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:54.609773 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-38fa95a8-df23-4717-9634-6b4de9515545 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1392 microversion: 2.1 time: 0.164688 Aug 29 06:06:54.610359 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3954/7915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:54 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:55.637105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:55.638154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:55.649088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:55.650395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:55.651620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:55.653356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:55.654085 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:55.654737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:55.796342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:55.805065 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c7fbd788-1d5a-4f58-83ad-a897dda0674c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1392 microversion: 2.1 time: 0.176554 Aug 29 06:06:55.805663 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3962/7916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:55 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:56.831216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:56.831817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:56.838889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:56.839379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:56.839812 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:56.840584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:56.841059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:56.841759 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:56.981692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:56.990214 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-80a1f18d-e422-4a9f-ab42-b11fa12b5fc3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1392 microversion: 2.1 time: 0.162826 Aug 29 06:06:56.991046 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3955/7917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:56 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:58.015961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:58.016990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:58.029135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:58.029633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:58.030096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:58.030800 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:58.031256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:58.031685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:58.178855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:58.190595 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-115f607e-1941-483d-9d85-41636d47acec tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1392 microversion: 2.1 time: 0.181123 Aug 29 06:06:58.191250 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3963/7918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:58 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:06:59.212082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:06:59.212707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:06:59.219825 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:59.220384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:59.220828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:59.221527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:06:59.221970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:06:59.222400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:06:59.369693 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:06:59.377857 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-73d965ed-4364-4c5b-a02e-4bbaf0696f70 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1392 microversion: 2.1 time: 0.170087 Aug 29 06:06:59.378463 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3956/7919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:06:59 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:07:00.400212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:07:00.400845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:07:00.408497 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:00.409025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:00.409464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:00.410241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:00.410731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:00.411194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:00.550107 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:07:00.561190 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d1b027c1-65eb-4656-804a-99e96629de0d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1392 microversion: 2.1 time: 0.164766 Aug 29 06:07:00.562368 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3964/7920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:07:00 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:07:00.687036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b97d0f14-ccfa-4918-9d69-92f5f56904ca req-7919ca0f-12bc-41d1-937c-37b6d00f830d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bdedd-64c5-481f-a40a-6b16918a0fe0", "name": "network-vif-plugged", "status": "completed", "tag": "8e3c977b-1329-46fc-bf2b-b8c22a8a7129"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:07:00.699050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b97d0f14-ccfa-4918-9d69-92f5f56904ca req-7919ca0f-12bc-41d1-937c-37b6d00f830d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:00.699533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b97d0f14-ccfa-4918-9d69-92f5f56904ca req-7919ca0f-12bc-41d1-937c-37b6d00f830d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:00.699971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b97d0f14-ccfa-4918-9d69-92f5f56904ca req-7919ca0f-12bc-41d1-937c-37b6d00f830d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:00.711482 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b97d0f14-ccfa-4918-9d69-92f5f56904ca req-7919ca0f-12bc-41d1-937c-37b6d00f830d service nova] Creating event network-vif-plugged:8e3c977b-1329-46fc-bf2b-b8c22a8a7129 for instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 on n-h1-854119-9 Aug 29 06:07:00.717215 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b97d0f14-ccfa-4918-9d69-92f5f56904ca req-7919ca0f-12bc-41d1-937c-37b6d00f830d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034504 Aug 29 06:07:00.717853 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3957/7921] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:07:01.586888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:07:01.587919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:07:01.591213 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:07:01.591890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:07:01.599026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:01.599518 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:01.599959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:01.600701 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:01.601156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:01.601587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:01.738966 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:07:01.747652 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-316fc2ee-0cb4-4024-9b15-0aa8cac1c24d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1392 microversion: 2.1 time: 0.167486 Aug 29 06:07:01.748260 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3965/7922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:07:01 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:07:02.767634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:07:02.775167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:07:02.776194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:07:02.785633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:02.786328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:02.786932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:02.787908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:02.788584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:02.789179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:02.925423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:07:02.933767 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0434e79d-fc83-432c-9a94-46589765296f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1564 microversion: 2.1 time: 0.167885 Aug 29 06:07:02.934353 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3958/7923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:07:02 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:07:02.954810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:07:02.955459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:07:02.962752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:02.963260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:02.963748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:02.964502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:02.964984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:02.965416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:03.104996 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:07:03.113200 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f8580da0-b377-42dd-a0b8-b107bc06d21e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1564 microversion: 2.1 time: 0.162630 Aug 29 06:07:03.113758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3966/7924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:07:02 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:07:05.091030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:07:05.091925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:07:05.093083 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8dc1c196-f2bf-4472-b0e9-cbc141ac0d8b req-6b5d07c8-575c-46ea-9863-b0313b341870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698bdedd-64c5-481f-a40a-6b16918a0fe0", "tag": "8e3c977b-1329-46fc-bf2b-b8c22a8a7129"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:07:05.098810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:05.099394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:05.099891 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:05.100670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:05.101216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:05.101799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:05.104314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8dc1c196-f2bf-4472-b0e9-cbc141ac0d8b req-6b5d07c8-575c-46ea-9863-b0313b341870 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:05.104793 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8dc1c196-f2bf-4472-b0e9-cbc141ac0d8b req-6b5d07c8-575c-46ea-9863-b0313b341870 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:05.105547 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8dc1c196-f2bf-4472-b0e9-cbc141ac0d8b req-6b5d07c8-575c-46ea-9863-b0313b341870 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:05.117570 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8dc1c196-f2bf-4472-b0e9-cbc141ac0d8b req-6b5d07c8-575c-46ea-9863-b0313b341870 service nova] Creating event network-changed:8e3c977b-1329-46fc-bf2b-b8c22a8a7129 for instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 on n-h1-854119-9 Aug 29 06:07:05.122934 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8dc1c196-f2bf-4472-b0e9-cbc141ac0d8b req-6b5d07c8-575c-46ea-9863-b0313b341870 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033698 Aug 29 06:07:05.123517 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3967/7925] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:07:05.676169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:07:05.686387 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-be588473-ee11-464f-87c2-34e805f7ac84 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1564 microversion: 2.1 time: 0.599625 Aug 29 06:07:05.687185 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3959/7926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:07:05 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1564 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:07:39.038169 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:07:39.039398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:07:39.040151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=42 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:07:39.044856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f649fde2-a00f-4af2-94b8-55cf39f6a020 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:07:39.047267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f649fde2-a00f-4af2-94b8-55cf39f6a020 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:07:39.055563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f649fde2-a00f-4af2-94b8-55cf39f6a020 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:39.056129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f649fde2-a00f-4af2-94b8-55cf39f6a020 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:39.056588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f649fde2-a00f-4af2-94b8-55cf39f6a020 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:39.057314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f649fde2-a00f-4af2-94b8-55cf39f6a020 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:07:39.057813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f649fde2-a00f-4af2-94b8-55cf39f6a020 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:07:39.058228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f649fde2-a00f-4af2-94b8-55cf39f6a020 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:07:39.115719 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f649fde2-a00f-4af2-94b8-55cf39f6a020 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action" status: 200 len: 24575 microversion: 2.1 time: 0.078454 Aug 29 06:07:39.116686 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3968/7927] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:07:39 2022] POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action => generated 24575 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:08:17.914362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:17.915552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=38 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:17.922312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f624395e-042f-4b5c-b1a0-386a99ebf4c1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:17.922837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f624395e-042f-4b5c-b1a0-386a99ebf4c1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:17.930152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f624395e-042f-4b5c-b1a0-386a99ebf4c1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:17.930662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f624395e-042f-4b5c-b1a0-386a99ebf4c1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:17.931092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f624395e-042f-4b5c-b1a0-386a99ebf4c1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:17.931893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f624395e-042f-4b5c-b1a0-386a99ebf4c1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:17.932384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f624395e-042f-4b5c-b1a0-386a99ebf4c1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:17.932796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f624395e-042f-4b5c-b1a0-386a99ebf4c1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:18.004074 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f624395e-042f-4b5c-b1a0-386a99ebf4c1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action" status: 202 len: 0 microversion: 2.1 time: 0.092770 Aug 29 06:08:18.004759 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3960/7928] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:08:17 2022] POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:08:18.016630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:18.017331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:18.021906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:18.022624 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:18.034142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:18.034648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:18.035103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:18.035925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:18.036625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:18.037292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:18.043666 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49294. Aug 29 06:08:18.176244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:18.184662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dcae65ea-0fc8-4cb4-81b5-b7899133d1fc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1687 microversion: 2.1 time: 0.172398 Aug 29 06:08:18.185233 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3969/7929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:18 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:19.209774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:19.210459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:19.217248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:19.217724 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:19.218155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:19.218858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:19.219296 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:19.219710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:19.365251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:19.373524 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e28f62b4-b32b-4eeb-827d-2bb7087854af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1667 microversion: 2.1 time: 0.169098 Aug 29 06:08:19.374171 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3961/7930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:19 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:20.468803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e37be9fe-130f-4d2c-86c2-52ba7ce89267 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:20.471088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e37be9fe-130f-4d2c-86c2-52ba7ce89267 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:20.482316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37be9fe-130f-4d2c-86c2-52ba7ce89267 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:20.482820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37be9fe-130f-4d2c-86c2-52ba7ce89267 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:20.483278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37be9fe-130f-4d2c-86c2-52ba7ce89267 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:20.484019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37be9fe-130f-4d2c-86c2-52ba7ce89267 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:20.484519 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37be9fe-130f-4d2c-86c2-52ba7ce89267 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:20.484943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e37be9fe-130f-4d2c-86c2-52ba7ce89267 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:20.668256 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e37be9fe-130f-4d2c-86c2-52ba7ce89267 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action" status: 200 len: 32642 microversion: 2.1 time: 0.202706 Aug 29 06:08:20.670800 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3970/7931] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:08:20 2022] POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action => generated 32642 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:08:20.681823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7fca7461-d30a-4f14-b2f9-c89789f173c5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:20.682492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7fca7461-d30a-4f14-b2f9-c89789f173c5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:20.692516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fca7461-d30a-4f14-b2f9-c89789f173c5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:20.693435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fca7461-d30a-4f14-b2f9-c89789f173c5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:20.693936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fca7461-d30a-4f14-b2f9-c89789f173c5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:20.694900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fca7461-d30a-4f14-b2f9-c89789f173c5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:20.695352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fca7461-d30a-4f14-b2f9-c89789f173c5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:20.695940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7fca7461-d30a-4f14-b2f9-c89789f173c5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:20.767265 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7fca7461-d30a-4f14-b2f9-c89789f173c5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action" status: 202 len: 0 microversion: 2.1 time: 0.089394 Aug 29 06:08:20.767911 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3962/7932] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:08:20 2022] POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:08:20.777356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:20.778088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:20.785603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:20.786098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:20.786630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:20.787323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:20.787794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:20.788263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:20.935011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:20.943755 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a3c9b535-13d2-45be-a4c7-81fbcc001f2b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1674 microversion: 2.1 time: 0.170926 Aug 29 06:08:20.944407 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3971/7933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:20 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:21.967700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:21.968429 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:21.975922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:21.976423 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:21.976852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:21.977532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:21.977975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:21.978387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:22.124971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:22.133093 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ce5832c0-6b7d-49df-a2db-93a068673801 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1682 microversion: 2.1 time: 0.169681 Aug 29 06:08:22.133660 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3963/7934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:21 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:22.241307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f77d6a4-5939-4735-a0b9-6498f29d0ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:22.243582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f77d6a4-5939-4735-a0b9-6498f29d0ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:22.251773 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f77d6a4-5939-4735-a0b9-6498f29d0ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:22.252330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f77d6a4-5939-4735-a0b9-6498f29d0ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:22.252783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f77d6a4-5939-4735-a0b9-6498f29d0ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:22.253495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f77d6a4-5939-4735-a0b9-6498f29d0ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:22.253967 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f77d6a4-5939-4735-a0b9-6498f29d0ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:22.254404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f77d6a4-5939-4735-a0b9-6498f29d0ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:22.306208 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f77d6a4-5939-4735-a0b9-6498f29d0ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action" status: 200 len: 38241 microversion: 2.1 time: 0.068796 Aug 29 06:08:22.306889 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3972/7935] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:08:22 2022] POST /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0/action => generated 38241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:08:23.327873 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:23.328410 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:23.335712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:23.336282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:23.336760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:23.337437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:23.337887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:23.338307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:23.367203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:08:23.387943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-5635048f-8ece-422d-bca1-c74598d4218e req-0cf4c0bb-90f6-430d-a76b-f91c4a00f606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698bdedd-64c5-481f-a40a-6b16918a0fe0", "tag": "8e3c977b-1329-46fc-bf2b-b8c22a8a7129"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:23.399634 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5635048f-8ece-422d-bca1-c74598d4218e req-0cf4c0bb-90f6-430d-a76b-f91c4a00f606 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:23.400153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5635048f-8ece-422d-bca1-c74598d4218e req-0cf4c0bb-90f6-430d-a76b-f91c4a00f606 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:23.400593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-5635048f-8ece-422d-bca1-c74598d4218e req-0cf4c0bb-90f6-430d-a76b-f91c4a00f606 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:23.412341 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-5635048f-8ece-422d-bca1-c74598d4218e req-0cf4c0bb-90f6-430d-a76b-f91c4a00f606 service nova] Creating event network-changed:8e3c977b-1329-46fc-bf2b-b8c22a8a7129 for instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 on n-h1-854119-9 Aug 29 06:08:23.417666 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-5635048f-8ece-422d-bca1-c74598d4218e req-0cf4c0bb-90f6-430d-a76b-f91c4a00f606 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098289 Aug 29 06:08:23.419052 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3973/7936] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:08:23.454947 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4aadbd17-aa95-4e63-85c7-4bc43b910cba tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 204 len: 0 microversion: 2.1 time: 0.138210 Aug 29 06:08:23.461558 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3964/7937] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:08:23 2022] DELETE /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:08:23.465644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:23.466507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:23.473591 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:23.474386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:23.474904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:23.475674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:23.476261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:23.476755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:23.616312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:23.624940 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b92ca668-32d5-4fc7-9745-b3a9f6132dc4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1688 microversion: 2.1 time: 0.164001 Aug 29 06:08:23.625512 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3974/7938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:23 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:08:24.647847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:24.648558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:24.651135 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:08:24.651300 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 (ip 10.222.0.20) !!! Aug 29 06:08:24.661358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:24.661849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:24.662281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:24.662989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:24.663434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:24.663852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:24.886124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:24.894491 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6ad38121-c475-4536-a517-5d17619a33aa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1688 microversion: 2.1 time: 0.250926 Aug 29 06:08:24.906817 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3965/7939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:24 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1688 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:25.838821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-b20c840a-8fba-4dda-abdb-08bf1856d038 req-1f98b3c8-50f9-43a0-96d6-9fff8927e50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bdedd-64c5-481f-a40a-6b16918a0fe0", "name": "network-vif-deleted", "tag": "8e3c977b-1329-46fc-bf2b-b8c22a8a7129"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:25.850245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b20c840a-8fba-4dda-abdb-08bf1856d038 req-1f98b3c8-50f9-43a0-96d6-9fff8927e50c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:25.850738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b20c840a-8fba-4dda-abdb-08bf1856d038 req-1f98b3c8-50f9-43a0-96d6-9fff8927e50c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:25.851174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-b20c840a-8fba-4dda-abdb-08bf1856d038 req-1f98b3c8-50f9-43a0-96d6-9fff8927e50c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:25.862789 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-b20c840a-8fba-4dda-abdb-08bf1856d038 req-1f98b3c8-50f9-43a0-96d6-9fff8927e50c service nova] Creating event network-vif-deleted:8e3c977b-1329-46fc-bf2b-b8c22a8a7129 for instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 on n-h1-854119-9 Aug 29 06:08:25.868095 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-b20c840a-8fba-4dda-abdb-08bf1856d038 req-1f98b3c8-50f9-43a0-96d6-9fff8927e50c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033488 Aug 29 06:08:25.868749 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3975/7940] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:08:25.916558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:25.917153 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:25.924847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:25.925316 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:25.925755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:25.926522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:25.927000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:25.927403 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:25.964726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:25.965211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:25.965648 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:25.966101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lazy-loading 'fault' on Instance uuid 698bdedd-64c5-481f-a40a-6b16918a0fe0 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:08:26.007563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:26.015774 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3ae170f4-448f-420a-bbe1-fd70c7823291 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 200 len: 1357 microversion: 2.1 time: 0.103108 Aug 29 06:08:26.016409 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3966/7941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:25 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:27.043720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:27.044928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 698bdedd-64c5-481f-a40a-6b16918a0fe0] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:27.052100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:27.052618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:27.053069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:27.053774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:27.054235 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:27.054671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:27.068756 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] HTTP exception thrown: Instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 could not be found. Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Request method failure captured: Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 HTTP/1.1 Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFdzcU6Ln1e76E-u6gunWc8awkLlGc3AGZ6HhYHY2LdaFQo88owNZziUF2A8_y_LJCRTMpWrsJgn6f-zILABBD2jfjtctmvqHnaa7Rr48Ij3-Sy92C0Q_XBFhpxZcORt5M_ml2OXzisM3BW7cEQ-tWSe85s2FojHOt7ycSgIn3YJMkQ Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1983828ca6b04d5eac60359468fbd523", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: a795ab5abec743aeadd1344e4b36273d Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 could not be found. Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '698bdedd-64c5-481f-a40a-6b16918a0fe0'} Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 could not be found. Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 could not be found. Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:08:27.070444 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 could not be found. Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Returning 404 to user: Instance 698bdedd-64c5-481f-a40a-6b16918a0fe0 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2dad96f1-07a6-4c47-91c8-0ede97b88f6d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0" status: 404 len: 111 microversion: 2.1 time: 0.036856 Aug 29 06:08:27.075640 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3976/7942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:27 2022] GET /compute/v2.1/servers/698bdedd-64c5-481f-a40a-6b16918a0fe0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:08:30.139025 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb5774c8-9a9c-43c7-8a9c-d828660c007f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '.version_select at 0x7f1ab90afca0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:30.160518 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb5774c8-9a9c-43c7-8a9c-d828660c007f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1052500297" status: 202 len: 0 microversion: 2.1 time: 0.025253 Aug 29 06:08:30.161013 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3967/7943] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Aug 29 06:08:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1052500297 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:08:30.188219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7cb90a9d-db44-4444-a579-681b1ba4e70b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: .version_select at 0x7f1ab8b92ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1609540184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF82ixlHVRACosQvSe+W6+/ue0uxCgITSIYMUIHFi4yP3U6Pfb+LMG8eeIhgSda5gwypaSvGpmeLoKBCzNEw8jHYlJzaZG2ZIjbBzXM0eZKtbjqVwrKM1APknnnEJYUHA=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:30.206405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7cb90a9d-db44-4444-a579-681b1ba4e70b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:08:30.211555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-7cb90a9d-db44-4444-a579-681b1ba4e70b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:08:30.239547 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7cb90a9d-db44-4444-a579-681b1ba4e70b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055201 Aug 29 06:08:30.240187 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3977/7944] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 06:08:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:08:36.065542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:36.069736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-866920948", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "96a5c1d8-8447-49b0-b615-afb501f04acc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1609540184", "security_groups": [{"name": "tempest-secgroup-smoke-503996995"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:36.180504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] validate_networks() for [('96a5c1d8-8447-49b0-b615-afb501f04acc', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:08:36.738549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:08:36.739468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:08:36.739943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:08:36.740407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:08:36.740884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:08:36.753820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:36.755673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:36.756411 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:36.757340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:36.757984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:36.758739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:36.788030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:08:36.797244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:08:36.820806 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:08:36.826226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:08:36.896573 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7d435efb-9389-407f-bdc2-870227c97c22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.832581 Aug 29 06:08:36.897861 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3968/7945] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:08:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 06:08:36.917305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5ebce8c8-8155-4d2b-854a-55c4a5addeef tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:36.918714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5ebce8c8-8155-4d2b-854a-55c4a5addeef tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:37.020612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5ebce8c8-8155-4d2b-854a-55c4a5addeef tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:37.030120 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5ebce8c8-8155-4d2b-854a-55c4a5addeef tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1266 microversion: 2.1 time: 0.124842 Aug 29 06:08:37.030743 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3978/7946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:36 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:38.051083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-edc71735-ef9f-47ef-8f41-145d3ca240ef tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:38.051704 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-edc71735-ef9f-47ef-8f41-145d3ca240ef tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:38.107502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-edc71735-ef9f-47ef-8f41-145d3ca240ef tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:38.115015 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-edc71735-ef9f-47ef-8f41-145d3ca240ef tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1266 microversion: 2.1 time: 0.067874 Aug 29 06:08:38.115607 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3969/7947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:38 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:08:39.136649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9ef8b77b-ccd8-4cf5-933f-494c9a39373a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:39.137428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ef8b77b-ccd8-4cf5-933f-494c9a39373a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:39.141027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=32 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:39.261422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ef8b77b-ccd8-4cf5-933f-494c9a39373a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:39.270608 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9ef8b77b-ccd8-4cf5-933f-494c9a39373a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1266 microversion: 2.1 time: 0.137929 Aug 29 06:08:39.273027 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3979/7948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:39 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:40.292808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e0b4532b-4afb-42f3-8878-a582c5866831 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:40.293401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e0b4532b-4afb-42f3-8878-a582c5866831 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:40.400493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e0b4532b-4afb-42f3-8878-a582c5866831 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:40.407804 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e0b4532b-4afb-42f3-8878-a582c5866831 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1266 microversion: 2.1 time: 0.119364 Aug 29 06:08:40.408458 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3970/7949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:40 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:41.432146 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:41.433020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:41.442731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:41.443386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:41.443981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:41.444981 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:41.445588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:41.446167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:41.514008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:41.522897 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6a3b13a6-de7e-41df-adf0-d4f82f9b7ced tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1270 microversion: 2.1 time: 0.096268 Aug 29 06:08:41.523603 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3980/7950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:41 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:42.543780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:42.544445 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:42.552152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:42.552692 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:42.553164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:42.553863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:42.554321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:42.554751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:42.618512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:42.626928 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-207100b5-e0f1-4129-ab15-123f41933dff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1324 microversion: 2.1 time: 0.087077 Aug 29 06:08:42.627484 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3971/7951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:42 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1324 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:43.553808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-cc8cc972-361e-4417-8b8d-7c3aa6252b72 req-0ee6a061-ec00-4e6a-a2e6-c72d7d8502e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996c6e82-792b-4994-942c-73da4bf7ac1a", "tag": "a0f84d66-53dd-4cb5-bde3-ade02d28fd20"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:43.565726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-cc8cc972-361e-4417-8b8d-7c3aa6252b72 req-0ee6a061-ec00-4e6a-a2e6-c72d7d8502e0 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:43.566353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-cc8cc972-361e-4417-8b8d-7c3aa6252b72 req-0ee6a061-ec00-4e6a-a2e6-c72d7d8502e0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:43.567020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-cc8cc972-361e-4417-8b8d-7c3aa6252b72 req-0ee6a061-ec00-4e6a-a2e6-c72d7d8502e0 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:43.580527 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-cc8cc972-361e-4417-8b8d-7c3aa6252b72 req-0ee6a061-ec00-4e6a-a2e6-c72d7d8502e0 service nova] Creating event network-changed:a0f84d66-53dd-4cb5-bde3-ade02d28fd20 for instance 996c6e82-792b-4994-942c-73da4bf7ac1a on n-h2-854119-9 Aug 29 06:08:43.585917 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-cc8cc972-361e-4417-8b8d-7c3aa6252b72 req-0ee6a061-ec00-4e6a-a2e6-c72d7d8502e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100991 Aug 29 06:08:43.586527 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3981/7952] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:08:43.648325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:43.649516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:43.657268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:43.657755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:43.658196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:43.658896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:43.659347 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:43.659766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:43.791114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:43.799099 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-89fda9ec-8b0e-4a28-9cc2-0393d4618ebd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1391 microversion: 2.1 time: 0.154707 Aug 29 06:08:43.799669 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3972/7953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:43 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:44.826659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:44.827705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:44.838399 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:44.839292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:44.839985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:44.841400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:44.842047 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:44.842775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:44.985423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:44.993216 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2ec74af-a82d-4a52-b734-e8e7254ced58 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1391 microversion: 2.1 time: 0.175781 Aug 29 06:08:44.993770 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3982/7954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:44 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:46.014436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:46.015057 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:46.022550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:46.023322 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:46.023810 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:46.024460 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:46.024907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:46.025314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:46.159949 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:46.168284 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cf28a8b8-d75a-47b7-b7aa-af68cffc2277 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1391 microversion: 2.1 time: 0.157762 Aug 29 06:08:46.168780 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3973/7955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:46 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:47.191665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:47.192479 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:47.200039 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:47.200672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:47.201122 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:47.201838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:47.202295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:47.202726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:47.337385 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:47.349763 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4a265fc5-baf9-470f-ba94-1c63af2ad7f0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1391 microversion: 2.1 time: 0.162445 Aug 29 06:08:47.350837 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3983/7956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:47 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:48.375549 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:48.376580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:48.378833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:48.380434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:48.386325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:48.386807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:48.387240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:48.387935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:48.388413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:48.388801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:48.530533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:48.538742 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4e6a2162-6fa4-4f34-89bb-f77ae4e0fbca tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1391 microversion: 2.1 time: 0.169882 Aug 29 06:08:48.539332 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3974/7957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:48 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:49.293870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ae0af7a1-930d-4e3e-9c44-c2be63d9134f req-e6488b8e-a907-45b3-bbd0-b7deedbacb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996c6e82-792b-4994-942c-73da4bf7ac1a", "name": "network-vif-plugged", "status": "completed", "tag": "a0f84d66-53dd-4cb5-bde3-ade02d28fd20"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:49.299612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=8 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:49.300287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:49.309908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ae0af7a1-930d-4e3e-9c44-c2be63d9134f req-e6488b8e-a907-45b3-bbd0-b7deedbacb53 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:49.310403 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ae0af7a1-930d-4e3e-9c44-c2be63d9134f req-e6488b8e-a907-45b3-bbd0-b7deedbacb53 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:49.310857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ae0af7a1-930d-4e3e-9c44-c2be63d9134f req-e6488b8e-a907-45b3-bbd0-b7deedbacb53 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:49.324351 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ae0af7a1-930d-4e3e-9c44-c2be63d9134f req-e6488b8e-a907-45b3-bbd0-b7deedbacb53 service nova] Creating event network-vif-plugged:a0f84d66-53dd-4cb5-bde3-ade02d28fd20 for instance 996c6e82-792b-4994-942c-73da4bf7ac1a on n-h2-854119-9 Aug 29 06:08:49.329952 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ae0af7a1-930d-4e3e-9c44-c2be63d9134f req-e6488b8e-a907-45b3-bbd0-b7deedbacb53 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039709 Aug 29 06:08:49.331886 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3984/7958] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:08:49.562800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:49.563754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:49.575688 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:49.576542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:49.577207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:49.578267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:49.578966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:49.579623 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:49.739055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:49.747397 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-49d25f84-0ae2-4d7f-9f82-740e7e9de71b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1391 microversion: 2.1 time: 0.190965 Aug 29 06:08:49.747983 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3975/7959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:49 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:50.773210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:50.773992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:50.784853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:50.785357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:50.785809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:50.786524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:50.786995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:50.787435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:50.930674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:50.942505 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2d846aec-e89c-451d-8cc1-f8d33cd4a14d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1391 microversion: 2.1 time: 0.176083 Aug 29 06:08:50.943287 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3985/7960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:50 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:51.968700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:51.969683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:51.972709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:08:51.983211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:51.984015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:51.984797 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:51.985936 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:51.986706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:51.987490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:52.126530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:52.134751 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fea19481-d4db-4839-85fd-c3bf0d3235a1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1563 microversion: 2.1 time: 0.173213 Aug 29 06:08:52.135347 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3976/7961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:51 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:52.155292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:52.155914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:52.163421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:52.163914 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:52.164395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:52.165102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:52.165563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:52.165992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:52.304769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:52.313132 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-36c75b20-bfcc-4806-ab21-1f645e491b53 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1563 microversion: 2.1 time: 0.161790 Aug 29 06:08:52.313732 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3986/7962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:52 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:08:54.299076 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:08:54.299699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:08:54.302379 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ddc146c0-229f-4405-93f4-af6eeb5239d7 req-ae803da0-4ca1-4196-ae62-efa48658088d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996c6e82-792b-4994-942c-73da4bf7ac1a", "tag": "a0f84d66-53dd-4cb5-bde3-ade02d28fd20"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:08:54.307208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:54.307929 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:54.308675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:54.309602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:54.310557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:54.311193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:54.313211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ddc146c0-229f-4405-93f4-af6eeb5239d7 req-ae803da0-4ca1-4196-ae62-efa48658088d service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:08:54.313825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ddc146c0-229f-4405-93f4-af6eeb5239d7 req-ae803da0-4ca1-4196-ae62-efa48658088d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:08:54.314448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ddc146c0-229f-4405-93f4-af6eeb5239d7 req-ae803da0-4ca1-4196-ae62-efa48658088d service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:08:54.332706 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ddc146c0-229f-4405-93f4-af6eeb5239d7 req-ae803da0-4ca1-4196-ae62-efa48658088d service nova] Creating event network-changed:a0f84d66-53dd-4cb5-bde3-ade02d28fd20 for instance 996c6e82-792b-4994-942c-73da4bf7ac1a on n-h2-854119-9 Aug 29 06:08:54.338051 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ddc146c0-229f-4405-93f4-af6eeb5239d7 req-ae803da0-4ca1-4196-ae62-efa48658088d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040349 Aug 29 06:08:54.338664 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3987/7963] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:08:54.466089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:08:54.475017 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-797e1e6f-4a0f-4983-9f23-74feec5dfd43 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1563 microversion: 2.1 time: 0.179846 Aug 29 06:08:54.475893 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3977/7964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:08:54 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:09:27.822745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:09:27.824401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=36 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:09:27.828896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4b3dba6f-dfde-4e4c-917b-3ebb7d2c9853 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:09:27.831229 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4b3dba6f-dfde-4e4c-917b-3ebb7d2c9853 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:09:27.838282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b3dba6f-dfde-4e4c-917b-3ebb7d2c9853 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:09:27.838797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b3dba6f-dfde-4e4c-917b-3ebb7d2c9853 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:09:27.839241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b3dba6f-dfde-4e4c-917b-3ebb7d2c9853 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:09:27.839935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b3dba6f-dfde-4e4c-917b-3ebb7d2c9853 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:09:27.840420 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b3dba6f-dfde-4e4c-917b-3ebb7d2c9853 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:09:27.840854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4b3dba6f-dfde-4e4c-917b-3ebb7d2c9853 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:09:27.899583 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4b3dba6f-dfde-4e4c-917b-3ebb7d2c9853 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a/action" status: 200 len: 24575 microversion: 2.1 time: 0.079010 Aug 29 06:09:27.900267 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3988/7965] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:09:27 2022] POST /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a/action => generated 24575 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:09:58.350866 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=7 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:09:58.351663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=44 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:09:58.356303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5ce8d3c4-fcd2-4e5e-a139-02ac3d6da452 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:09:58.358699 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5ce8d3c4-fcd2-4e5e-a139-02ac3d6da452 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:09:58.366751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ce8d3c4-fcd2-4e5e-a139-02ac3d6da452 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:09:58.367318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ce8d3c4-fcd2-4e5e-a139-02ac3d6da452 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:09:58.367901 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ce8d3c4-fcd2-4e5e-a139-02ac3d6da452 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:09:58.368749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ce8d3c4-fcd2-4e5e-a139-02ac3d6da452 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:09:58.369211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ce8d3c4-fcd2-4e5e-a139-02ac3d6da452 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:09:58.369761 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5ce8d3c4-fcd2-4e5e-a139-02ac3d6da452 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:09:58.454435 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5ce8d3c4-fcd2-4e5e-a139-02ac3d6da452 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a/action" status: 202 len: 0 microversion: 2.1 time: 0.105239 Aug 29 06:09:58.458298 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3978/7966] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:09:58 2022] POST /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:09:58.465462 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:09:58.466288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:09:58.469263 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:09:58.470059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:09:58.476652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:09:58.477485 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:09:58.478059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:09:58.479319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:09:58.480175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:09:58.480950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:09:58.622857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:09:58.633604 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ddc47c7c-8acd-4566-a448-32455587a393 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1674 microversion: 2.1 time: 0.172165 Aug 29 06:09:58.634179 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3989/7967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:09:58 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:09:59.661084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:09:59.661898 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:09:59.672822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:09:59.673377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:09:59.673881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:09:59.674679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:09:59.675200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:09:59.675720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:09:59.841622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:09:59.850210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3be3f72a-c186-4a68-ba5b-16b17b37ace0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1679 microversion: 2.1 time: 0.196431 Aug 29 06:09:59.850789 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3979/7968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:09:59 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:00.883438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:10:00.884481 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:00.894414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:00.894829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:00.895282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:00.896014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:00.896517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:00.896959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:01.032712 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:10:01.040807 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-89b60e53-ef44-4041-ad4a-e548498c85b6 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1679 microversion: 2.1 time: 0.164227 Aug 29 06:10:01.041356 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3990/7969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:10:00 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:02.065737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:10:02.066501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:02.076157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:02.076770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:02.077312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:02.078176 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:02.078737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:02.079257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:02.221311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:10:02.230014 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d798683c-3c66-464a-bf43-0bb70f666d28 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1679 microversion: 2.1 time: 0.170086 Aug 29 06:10:02.230557 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3980/7970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:10:02 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:03.257288 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:10:03.258461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:03.268281 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:03.268776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:03.269223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:03.269927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:03.270387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:03.270820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:03.424101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:10:03.437270 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f64e1fdc-7370-4330-bf55-047e7aeb6288 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1679 microversion: 2.1 time: 0.186274 Aug 29 06:10:03.437890 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3991/7971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:10:03 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:04.463389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:10:04.464415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:04.473581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:04.474077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:04.474514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:04.475215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:04.475662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:04.476086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:04.612654 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:10:04.620968 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-776885ed-93a5-45e9-b0cc-2496885cff5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1679 microversion: 2.1 time: 0.164252 Aug 29 06:10:04.621560 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3981/7972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:10:04 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:05.647509 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:10:05.648587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:05.658693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:05.659197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:05.659644 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:05.660391 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:05.660858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:05.661294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:05.800151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:10:05.808094 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7e4c8afa-cd1b-4611-94c9-fac724fac7f4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1679 microversion: 2.1 time: 0.167594 Aug 29 06:10:05.808701 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3992/7973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:10:05 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:06.831999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:10:06.832694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:06.841170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:06.841651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:06.842086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:06.842774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:06.843210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:06.843634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:06.989802 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:10:06.997942 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3bcea3d5-002c-4e7b-9823-030fc9373ba9 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1679 microversion: 2.1 time: 0.170249 Aug 29 06:10:06.998486 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3982/7974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:10:06 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:08.024906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:10:08.025739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:08.035329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:08.035820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:08.036294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:08.037007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:08.037467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:08.037900 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:08.188985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:10:08.197531 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6556b483-e14e-4cbe-acfe-fb25008cfa30 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1679 microversion: 2.1 time: 0.179620 Aug 29 06:10:08.198133 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3993/7975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:10:08 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:09.224112 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:10:09.225172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:09.235602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:09.236089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:09.236553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:09.237271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:09.237698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:09.238124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:09.385483 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:10:09.397373 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c9e0f997-d145-4291-b4d0-29c196ea4c19 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1679 microversion: 2.1 time: 0.179786 Aug 29 06:10:09.398134 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3983/7976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:10:09 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:10.423161 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:10:10.423741 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:10.427204 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:10:10.427376 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:10:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a (ip 10.222.0.20) !!! Aug 29 06:10:10.436064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:10.436633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:10.437087 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:10.437818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:10.438319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:10.438778 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:10.574558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:10:10.584509 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1fe6c9bf-a136-49de-a1b4-aa61f56114bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1682 microversion: 2.1 time: 0.165400 Aug 29 06:10:10.585306 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3994/7977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:10:10 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:10:44.857340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f5529684-bc4f-4f8e-b8b3-47db07358339 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:10:44.860313 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f5529684-bc4f-4f8e-b8b3-47db07358339 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:10:44.863380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=12 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:10:44.864039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:10:44.870587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5529684-bc4f-4f8e-b8b3-47db07358339 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:44.871064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5529684-bc4f-4f8e-b8b3-47db07358339 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:44.871493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5529684-bc4f-4f8e-b8b3-47db07358339 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:44.872201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5529684-bc4f-4f8e-b8b3-47db07358339 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:10:44.872634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5529684-bc4f-4f8e-b8b3-47db07358339 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:10:44.873049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f5529684-bc4f-4f8e-b8b3-47db07358339 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:10:44.939341 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f5529684-bc4f-4f8e-b8b3-47db07358339 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a/action" status: 200 len: 69084 microversion: 2.1 time: 0.087508 Aug 29 06:10:44.940012 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3984/7978] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:10:44 2022] POST /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a/action => generated 69084 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:11:02.122444 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:02.122984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:02.125356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-a0bd7642-f89c-48bb-9818-33de69a050f8 req-058b1917-ece1-4772-993d-0067fc41249a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996c6e82-792b-4994-942c-73da4bf7ac1a", "tag": "a0f84d66-53dd-4cb5-bde3-ade02d28fd20"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:11:02.125795 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:11:02.126641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=36 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:11:02.132727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:11:02.133165 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:02.133360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:11:02.133814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:02.134665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:02.136374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:02.137241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:02.137794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:02.141552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a0bd7642-f89c-48bb-9818-33de69a050f8 req-058b1917-ece1-4772-993d-0067fc41249a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:02.142240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a0bd7642-f89c-48bb-9818-33de69a050f8 req-058b1917-ece1-4772-993d-0067fc41249a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:02.142690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-a0bd7642-f89c-48bb-9818-33de69a050f8 req-058b1917-ece1-4772-993d-0067fc41249a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:02.154381 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-a0bd7642-f89c-48bb-9818-33de69a050f8 req-058b1917-ece1-4772-993d-0067fc41249a service nova] Creating event network-changed:a0f84d66-53dd-4cb5-bde3-ade02d28fd20 for instance 996c6e82-792b-4994-942c-73da4bf7ac1a on n-h2-854119-9 Aug 29 06:11:02.159570 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-a0bd7642-f89c-48bb-9818-33de69a050f8 req-058b1917-ece1-4772-993d-0067fc41249a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038343 Aug 29 06:11:02.160691 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3985/7979] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:11:02.167143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:11:02.251291 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-476b95f4-839e-4ff5-a973-0a511b2be70d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 204 len: 0 microversion: 2.1 time: 0.132916 Aug 29 06:11:02.252524 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3995/7980] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:11:02 2022] DELETE /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:11:02.262185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:02.263035 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:02.271227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:02.271807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:02.272351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:02.273150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:02.273667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:02.274197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:02.419097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:02.427150 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e12c5ed4-8365-4835-b5b5-cba5db6a00d1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1688 microversion: 2.1 time: 0.169539 Aug 29 06:11:02.427736 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3986/7981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:02 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:03.455662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:03.456883 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:03.466303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:03.466808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:03.467258 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:03.467968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:03.468478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:03.468918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:03.604614 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:03.612713 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b298a8c4-fbe4-4a85-80cb-7f4b4ab6dea8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1688 microversion: 2.1 time: 0.164630 Aug 29 06:11:03.613505 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3996/7982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:03 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:04.499651 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-3ecdb934-5234-41b2-9d4a-bbe15e3ef7b7 req-1a910a78-67a6-47a2-b9e8-110e53be4e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996c6e82-792b-4994-942c-73da4bf7ac1a", "name": "network-vif-deleted", "tag": "a0f84d66-53dd-4cb5-bde3-ade02d28fd20"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:11:04.510971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3ecdb934-5234-41b2-9d4a-bbe15e3ef7b7 req-1a910a78-67a6-47a2-b9e8-110e53be4e26 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:04.511454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3ecdb934-5234-41b2-9d4a-bbe15e3ef7b7 req-1a910a78-67a6-47a2-b9e8-110e53be4e26 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:04.512630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-3ecdb934-5234-41b2-9d4a-bbe15e3ef7b7 req-1a910a78-67a6-47a2-b9e8-110e53be4e26 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:04.524723 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-3ecdb934-5234-41b2-9d4a-bbe15e3ef7b7 req-1a910a78-67a6-47a2-b9e8-110e53be4e26 service nova] Creating event network-vif-deleted:a0f84d66-53dd-4cb5-bde3-ade02d28fd20 for instance 996c6e82-792b-4994-942c-73da4bf7ac1a on n-h2-854119-9 Aug 29 06:11:04.530354 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-3ecdb934-5234-41b2-9d4a-bbe15e3ef7b7 req-1a910a78-67a6-47a2-b9e8-110e53be4e26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Aug 29 06:11:04.531052 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3987/7983] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:11:04.635477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:04.636104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:04.643455 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:04.643963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:04.644585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:04.645567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:04.646045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:04.646514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:04.679660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:04.680173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:04.680745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:04.681216 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lazy-loading 'fault' on Instance uuid 996c6e82-792b-4994-942c-73da4bf7ac1a {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:11:04.724030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:04.736065 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-78838384-d567-4bc8-a577-939a8cf9f0fa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 200 len: 1356 microversion: 2.1 time: 0.105131 Aug 29 06:11:04.736882 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3997/7984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:04 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:05.765030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:05.766110 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 996c6e82-792b-4994-942c-73da4bf7ac1a] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:05.775282 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:05.776018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:05.776736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:05.777783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:05.778478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:05.779120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:05.799253 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] HTTP exception thrown: Instance 996c6e82-792b-4994-942c-73da4bf7ac1a could not be found. Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Request method failure captured: Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a HTTP/1.1 Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFdzcU6Ln1e76E-u6gunWc8awkLlGc3AGZ6HhYHY2LdaFQo88owNZziUF2A8_y_LJCRTMpWrsJgn6f-zILABBD2jfjtctmvqHnaa7Rr48Ij3-Sy92C0Q_XBFhpxZcORt5M_ml2OXzisM3BW7cEQ-tWSe85s2FojHOt7ycSgIn3YJMkQ Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1983828ca6b04d5eac60359468fbd523", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: a795ab5abec743aeadd1344e4b36273d Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 996c6e82-792b-4994-942c-73da4bf7ac1a could not be found. Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '996c6e82-792b-4994-942c-73da4bf7ac1a'} Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996c6e82-792b-4994-942c-73da4bf7ac1a could not be found. Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996c6e82-792b-4994-942c-73da4bf7ac1a could not be found. Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:11:05.801662 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996c6e82-792b-4994-942c-73da4bf7ac1a could not be found. Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Returning 404 to user: Instance 996c6e82-792b-4994-942c-73da4bf7ac1a could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3382e2c8-47f8-446a-96bc-1f13992d3606 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a" status: 404 len: 111 microversion: 2.1 time: 0.046806 Aug 29 06:11:05.806289 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3988/7985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:05 2022] GET /compute/v2.1/servers/996c6e82-792b-4994-942c-73da4bf7ac1a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:11:09.157990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1331443-bafa-4fc6-9902-5fc6dd11fe8f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '.version_select at 0x7f1ab9718310>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:09.162622 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a1331443-bafa-4fc6-9902-5fc6dd11fe8f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [2986978a-48e4-4788-86ed-c5cccf08efe0] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:11:10.176933 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [None req-a1331443-bafa-4fc6-9902-5fc6dd11fe8f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [2986978a-48e4-4788-86ed-c5cccf08efe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49578. Aug 29 06:11:10.202221 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1331443-bafa-4fc6-9902-5fc6dd11fe8f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1609540184" status: 202 len: 0 microversion: 2.1 time: 1.048328 Aug 29 06:11:10.202823 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3998/7986] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Aug 29 06:11:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1609540184 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:11:10.232268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-761aa539-6691-4d3f-a9a1-cac6154c2302 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: .version_select at 0x7f1ab3ea6430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1364882258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNKngro6BLBcLbLwHFSBZUoWvmZxnK7lmfv3/OBGrNbIwF68nsSqZbtI2sMCGa0wNGvdp5h6V0JiVMaAjhdMrraONOF4HcDV/VKyIbudkp1Y/+/NY1OHsw0XBJ6zy3j4g=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:11:10.250040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-761aa539-6691-4d3f-a9a1-cac6154c2302 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:11:10.257045 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-761aa539-6691-4d3f-a9a1-cac6154c2302 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:11:10.271063 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [None req-761aa539-6691-4d3f-a9a1-cac6154c2302 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [5031f6d2-4dcc-4650-bfc1-4a4277592adf] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:11:11.283136 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [None req-761aa539-6691-4d3f-a9a1-cac6154c2302 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [5031f6d2-4dcc-4650-bfc1-4a4277592adf] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49582. Aug 29 06:11:11.304800 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-761aa539-6691-4d3f-a9a1-cac6154c2302 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.076935 Aug 29 06:11:11.305417 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3989/7987] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 06:11:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:11:16.955418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:11:16.961427 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1236082102", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "56cea836-f73d-4e2b-a25e-f7d59e14ad50"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1364882258", "security_groups": [{"name": "tempest-secgroup-smoke-1862481488"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:11:17.106813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] validate_networks() for [('56cea836-f73d-4e2b-a25e-f7d59e14ad50', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:11:17.621151 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:11:17.621666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:11:17.622175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:11:17.622592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:11:17.623007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:11:17.631896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:17.632380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:17.632820 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:17.633641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:17.634129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:17.634563 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:17.652825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:11:17.658197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:11:17.671318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:11:17.674010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:11:17.724439 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-862e0793-d6e7-44ec-aa23-0906268beb56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.770887 Aug 29 06:11:17.731712 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 3999/7988] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:11:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 06:11:17.734747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=12 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:11:17.740387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-37e4dbf7-03e2-4830-a7b2-a8e5f9f13549 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:17.741303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-37e4dbf7-03e2-4830-a7b2-a8e5f9f13549 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:17.814197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-37e4dbf7-03e2-4830-a7b2-a8e5f9f13549 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:17.825082 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-37e4dbf7-03e2-4830-a7b2-a8e5f9f13549 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1267 microversion: 2.1 time: 0.091712 Aug 29 06:11:17.825767 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3990/7989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:17 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:18.850174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:18.851525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:18.860393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:18.861305 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:18.862049 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:18.863607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:18.864360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:18.865232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:18.959702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:18.970016 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8a832a58-fc13-4313-a21c-338aed1ce395 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1337 microversion: 2.1 time: 0.127042 Aug 29 06:11:18.972058 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4000/7990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:18 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1337 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:19.997377 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:19.998931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:20.005146 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:20.005621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:20.006063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:20.006750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:20.007829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:20.008373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:20.247514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:20.255981 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0ef1b791-556b-4694-af45-90e8b0b2fe67 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1393 microversion: 2.1 time: 0.263268 Aug 29 06:11:20.256606 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3991/7991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:19 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:20.382826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-ef8ce161-1b2f-4112-a2e0-9f088e5b7e32 req-86cc6256-b93b-4d15-a84a-4d9c57f9c18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972189c8-986f-46f9-a64e-32336c459825", "tag": "305f3626-5cbe-45cd-b700-4e5d7571beac"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:11:20.395493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ef8ce161-1b2f-4112-a2e0-9f088e5b7e32 req-86cc6256-b93b-4d15-a84a-4d9c57f9c18f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:20.396091 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ef8ce161-1b2f-4112-a2e0-9f088e5b7e32 req-86cc6256-b93b-4d15-a84a-4d9c57f9c18f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:20.396554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-ef8ce161-1b2f-4112-a2e0-9f088e5b7e32 req-86cc6256-b93b-4d15-a84a-4d9c57f9c18f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:20.409215 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-ef8ce161-1b2f-4112-a2e0-9f088e5b7e32 req-86cc6256-b93b-4d15-a84a-4d9c57f9c18f service nova] Creating event network-changed:305f3626-5cbe-45cd-b700-4e5d7571beac for instance 972189c8-986f-46f9-a64e-32336c459825 on n-h1-854119-9 Aug 29 06:11:20.414343 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-ef8ce161-1b2f-4112-a2e0-9f088e5b7e32 req-86cc6256-b93b-4d15-a84a-4d9c57f9c18f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035526 Aug 29 06:11:20.415217 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4001/7992] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:11:21.281245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:21.281913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:21.290978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:21.291590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:21.292168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:21.293130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:21.293697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:21.294228 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:21.434602 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:21.442503 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-23648d26-a119-46b1-88a9-390f74b3f07c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1393 microversion: 2.1 time: 0.166968 Aug 29 06:11:21.443089 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3992/7993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:21 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:22.469595 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:22.470762 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:22.482145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:22.482650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:22.483134 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:22.483853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:22.484359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:22.484799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:22.635648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:22.646553 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2d7e4ec8-ef68-487b-9232-f77a1566aa88 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1393 microversion: 2.1 time: 0.184334 Aug 29 06:11:22.647424 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4002/7994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:22 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1393 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:23.674133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:23.674992 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:23.686982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:23.687476 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:23.687904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:23.688684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:23.689169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:23.689589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:23.918541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:23.926939 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6143614e-af55-4bf1-a9bf-b7fb3b308c6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1393 microversion: 2.1 time: 0.259480 Aug 29 06:11:23.927500 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3993/7995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:23 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1393 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:24.947562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:24.948186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:24.955859 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:24.956395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:24.956842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:24.957555 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:24.958022 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:24.958456 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:25.105617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:25.113674 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f8d8218f-b6ee-4428-9800-be022d34f454 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1393 microversion: 2.1 time: 0.170158 Aug 29 06:11:25.114248 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4003/7996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:24 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:26.076028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-450b4249-8a37-400d-b68e-a55d1414856b req-be04992a-ac30-4a62-aced-a5403d0ffd47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972189c8-986f-46f9-a64e-32336c459825", "name": "network-vif-plugged", "status": "completed", "tag": "305f3626-5cbe-45cd-b700-4e5d7571beac"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:11:26.085656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-450b4249-8a37-400d-b68e-a55d1414856b req-be04992a-ac30-4a62-aced-a5403d0ffd47 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:26.086135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-450b4249-8a37-400d-b68e-a55d1414856b req-be04992a-ac30-4a62-aced-a5403d0ffd47 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:26.086555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-450b4249-8a37-400d-b68e-a55d1414856b req-be04992a-ac30-4a62-aced-a5403d0ffd47 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:26.097794 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-450b4249-8a37-400d-b68e-a55d1414856b req-be04992a-ac30-4a62-aced-a5403d0ffd47 service nova] Creating event network-vif-plugged:305f3626-5cbe-45cd-b700-4e5d7571beac for instance 972189c8-986f-46f9-a64e-32336c459825 on n-h1-854119-9 Aug 29 06:11:26.103007 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-450b4249-8a37-400d-b68e-a55d1414856b req-be04992a-ac30-4a62-aced-a5403d0ffd47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097217 Aug 29 06:11:26.103611 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3994/7997] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:11:26.135037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:26.135659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:26.143878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:26.144412 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:26.144864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:26.145732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:26.146055 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:26.146528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:26.332706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:26.341140 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ecdd601f-b324-4e09-86b6-e3ac2c762696 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1393 microversion: 2.1 time: 0.209964 Aug 29 06:11:26.341725 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4004/7998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:26 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1393 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:27.367639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:27.368921 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:27.378427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:27.378910 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:27.379338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:27.380027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:27.380505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:27.380925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:27.514164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:27.522474 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-07763101-2bbb-4deb-9857-f2d0aabd7e2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1393 microversion: 2.1 time: 0.162268 Aug 29 06:11:27.523044 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3995/7999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:27 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:28.547770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:28.548832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:28.553443 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:11:28.554549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:11:28.565147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:28.565760 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:28.566208 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:28.566920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:28.567386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:28.567814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:28.710523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:28.718982 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-40174971-ab18-47c7-af17-31c1e1795ea2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1564 microversion: 2.1 time: 0.178095 Aug 29 06:11:28.719608 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4005/8000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:28 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:28.746956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:28.747565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:28.750097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:11:28.756754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:28.757242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:28.757738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:28.758595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:28.759244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:28.759785 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:28.907890 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:28.916363 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-42b5553d-9e4b-4a64-89cc-582e1143c3cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1564 microversion: 2.1 time: 0.173268 Aug 29 06:11:28.916918 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3996/8001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:28 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:11:30.932817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f4e6cb9e-559c-48e3-bba6-10194a6c1f17 req-2186a440-e3dd-449d-abe0-0145b494c4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972189c8-986f-46f9-a64e-32336c459825", "tag": "305f3626-5cbe-45cd-b700-4e5d7571beac"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:11:30.936894 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:11:30.947193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f4e6cb9e-559c-48e3-bba6-10194a6c1f17 req-2186a440-e3dd-449d-abe0-0145b494c4a3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:30.948006 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:11:30.955215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:30.955951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f4e6cb9e-559c-48e3-bba6-10194a6c1f17 req-2186a440-e3dd-449d-abe0-0145b494c4a3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:30.956296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:30.956660 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f4e6cb9e-559c-48e3-bba6-10194a6c1f17 req-2186a440-e3dd-449d-abe0-0145b494c4a3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:30.957227 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:30.958192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:11:30.958869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:11:30.959515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:11:30.973335 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f4e6cb9e-559c-48e3-bba6-10194a6c1f17 req-2186a440-e3dd-449d-abe0-0145b494c4a3 service nova] Creating event network-changed:305f3626-5cbe-45cd-b700-4e5d7571beac for instance 972189c8-986f-46f9-a64e-32336c459825 on n-h1-854119-9 Aug 29 06:11:30.979759 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f4e6cb9e-559c-48e3-bba6-10194a6c1f17 req-2186a440-e3dd-449d-abe0-0145b494c4a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049733 Aug 29 06:11:30.984520 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3997/8002] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:11:31.190962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:11:31.199753 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-abde9e7c-8971-4feb-baac-0429595d6326 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1564 microversion: 2.1 time: 0.273245 Aug 29 06:11:31.206291 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4006/8003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:11:30 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1564 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:06.600204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:12:06.601271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=34 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:12:06.603491 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:12:06.603756 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:12:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825/action (ip 10.222.0.20) !!! Aug 29 06:12:06.664392 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d57a4e9b-1a93-40cd-8f87-6ea928f9bc63 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:12:06.666846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d57a4e9b-1a93-40cd-8f87-6ea928f9bc63 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:06.676665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d57a4e9b-1a93-40cd-8f87-6ea928f9bc63 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:06.677157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d57a4e9b-1a93-40cd-8f87-6ea928f9bc63 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:06.677594 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d57a4e9b-1a93-40cd-8f87-6ea928f9bc63 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:06.678291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d57a4e9b-1a93-40cd-8f87-6ea928f9bc63 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:06.678745 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d57a4e9b-1a93-40cd-8f87-6ea928f9bc63 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:06.679173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d57a4e9b-1a93-40cd-8f87-6ea928f9bc63 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:06.730961 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d57a4e9b-1a93-40cd-8f87-6ea928f9bc63 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825/action" status: 200 len: 24567 microversion: 2.1 time: 0.134536 Aug 29 06:12:06.731835 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3998/8004] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:12:06 2022] POST /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825/action => generated 24567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:12:45.783228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:12:45.784033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=40 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:12:45.791452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:12:45.793816 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:45.801689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:45.802240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:45.802685 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:45.803404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:45.803861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:45.804330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:45.852363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:45.858984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Old instance type m1.heat2, new instance type m1.heat {{(pid=128871) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 06:12:45.866014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:12:45.866454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:12:45.866940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:12:45.867363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:12:45.867784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:12:45.937181 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6aac923b-a7a2-4a55-9381-8c8075d1c5b1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825/action" status: 202 len: 0 microversion: 2.1 time: 0.156782 Aug 29 06:12:45.937827 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4007/8005] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:12:45 2022] POST /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:12:45.950186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:45.950608 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:45.953293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:12:45.954008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:12:45.960907 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:45.961395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:45.961833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:45.962543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:45.963000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:45.963426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:46.100926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:46.109047 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5071ff2b-8607-4946-aed1-b5369be927a8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1691 microversion: 2.1 time: 0.163888 Aug 29 06:12:46.109689 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 3999/8006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:45 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:47.136467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:47.137057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:47.143662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:47.144176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:47.144649 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:47.145360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:47.145827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:47.146265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:47.286850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:47.295176 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a1b8988c-6609-4228-8e29-cab67e7e6778 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1691 microversion: 2.1 time: 0.166622 Aug 29 06:12:47.295727 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4008/8007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:47 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:48.331271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:48.332395 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:48.341981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:48.342471 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:48.342886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:48.343584 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:48.344028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:48.344474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:48.482048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:48.490047 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-90b6ca99-374e-4f04-b0cb-09e38e37722b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1691 microversion: 2.1 time: 0.165740 Aug 29 06:12:48.490831 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4000/8008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:48 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:49.515104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:49.515969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:49.525080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:49.525746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:49.526349 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:49.527289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:49.527915 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:49.528660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:49.668269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:49.676510 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4f9311cc-b416-4768-a068-84eb56a3808a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1691 microversion: 2.1 time: 0.167281 Aug 29 06:12:49.677081 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4009/8009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:49 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:50.711011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:50.712028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:50.719783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:50.720292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:50.720746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:50.721427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:50.721858 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:50.722281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:50.867037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:50.879893 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-786dc633-9ac9-4341-b7ae-550041dccfbd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1691 microversion: 2.1 time: 0.175151 Aug 29 06:12:50.880726 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4001/8010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:50 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:51.903377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:51.904013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:51.911621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:51.912164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:51.912610 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:51.913328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:51.913806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:51.914466 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:52.235395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:52.243765 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5cb1e2f0-2cca-42ff-b0e7-3ae91afa94f3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1691 microversion: 2.1 time: 0.344398 Aug 29 06:12:52.244537 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4010/8011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:51 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1691 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:53.269019 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:53.269977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:53.282243 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:53.283078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:53.283792 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:53.284978 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:53.285721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:53.286418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:53.438617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:53.453242 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-adacdc9d-39a5-4f1f-b3cc-e4a941be2060 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.190448 Aug 29 06:12:53.454309 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4002/8012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:53 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:54.483510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:54.484514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:54.496109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:54.496639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:54.497086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:54.497784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:54.498247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:54.498677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:54.643270 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:54.655294 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-52f5515f-d982-465e-a0a3-ae89ac4fc6db tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.178200 Aug 29 06:12:54.656063 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4011/8013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:54 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:55.681831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:55.682757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:55.690288 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:55.690773 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:55.691199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:55.691882 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:55.692374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:55.692790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:55.832052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:55.840434 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-212d8352-8702-4b38-904e-83031575480a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.165645 Aug 29 06:12:55.841006 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4003/8014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:55 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:56.946678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:56.947353 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:56.955812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:56.956364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:56.956814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:56.957535 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:56.958004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:56.958439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:57.102490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:57.110839 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-95cd77d9-dfd6-43c1-8378-468e8a442c94 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.170778 Aug 29 06:12:57.111448 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4012/8015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:56 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:58.133668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:58.134501 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:58.145241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:58.145967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:58.146613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:58.147641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:58.148525 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:58.149147 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:58.301826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:58.314601 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-241df7e2-bfc5-49bb-b8d2-316e056c1748 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.184802 Aug 29 06:12:58.315391 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4004/8016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:58 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:12:59.344653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:12:59.345503 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:12:59.357179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:59.357671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:59.358138 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:59.358837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:12:59.359294 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:12:59.359723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:12:59.499958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:12:59.508730 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c18c4bdc-eeb7-4b57-826f-fa2c285674bb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.170870 Aug 29 06:12:59.509303 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4013/8017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:12:59 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:00.532362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:00.533083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:00.540440 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:00.540925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:00.541362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:00.542029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:00.542504 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:00.542925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:00.677990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:00.686550 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ded91481-dd58-42c7-a21e-9fc3c662471b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.158306 Aug 29 06:13:00.687132 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4005/8018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:00 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:01.711869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:01.712755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:01.721153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:01.721651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:01.722099 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:01.722799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:01.723284 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:01.723714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:01.865896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:01.874072 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fde9d727-48ea-42e5-9e5e-c7a736300793 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.168270 Aug 29 06:13:01.874652 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4014/8019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:01 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:02.899680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:02.900662 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:02.911424 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:02.912182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:02.913721 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:02.914817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:02.915543 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:02.916485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:03.053843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:03.065902 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-104a55ae-3740-4b20-b1f4-6a9b115dbf62 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.172074 Aug 29 06:13:03.066695 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4006/8020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:02 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:04.093878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:04.094489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:04.102329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:04.102896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:04.103347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:04.104060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:04.104583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:04.105020 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:04.251237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:04.264582 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-18aad7bc-2472-4489-84e8-64462570ca7f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.176537 Aug 29 06:13:04.265348 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4015/8021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:04 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:05.288675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:05.289467 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:05.299327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:05.299808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:05.300273 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:05.300969 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:05.301413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:05.301832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:05.445125 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:05.453754 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4b86b7a9-182e-46a6-bf0c-06f392f55219 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.170720 Aug 29 06:13:05.454375 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4007/8022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:05 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:06.482130 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:06.482872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:06.490841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:06.491340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:06.491785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:06.492534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:06.492999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:06.493438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:06.646993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:06.659004 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0148dc2d-247c-4383-bae0-398efed2433e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.182111 Aug 29 06:13:06.659870 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4016/8023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:06 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:07.685615 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:07.686236 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:07.694174 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:07.694663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:07.695097 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:07.695796 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:07.696286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:07.696716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:07.842918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:07.851414 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5fbaf95a-80ea-4bd1-b8ce-76bd9091f0fb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.169833 Aug 29 06:13:07.852009 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4008/8024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:07 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:08.875383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:08.876310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:08.886106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:08.886808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:08.887417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:08.888441 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:08.889071 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:08.889657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:09.028482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:09.038163 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aef7cbf0-9d9a-4428-a9b1-ea1b89ed1f05 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.168265 Aug 29 06:13:09.038845 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4017/8025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:08 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:10.064881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:10.065869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:10.073950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:10.074430 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:10.074863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:10.075565 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:10.076406 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:10.076857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:10.218369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:10.226574 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c4f83639-4dfe-4e57-8697-eeacca64217b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.168908 Aug 29 06:13:10.227153 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4009/8026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:10 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:11.253532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:11.254566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:11.267186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:11.268023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:11.268823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:11.270027 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:11.270766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:11.272086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:11.417625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:11.429751 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f5bdd30c-2c57-441b-b81c-8fdb77dfd0a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.182612 Aug 29 06:13:11.430535 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4018/8027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:11 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:12.461417 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:12.462192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:12.471355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:12.471961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:12.472545 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:12.473415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:12.473979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:12.474507 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:12.626363 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:12.638240 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-14415bb3-176d-4d11-9b97-267826ba3d6b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.183510 Aug 29 06:13:12.638792 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4010/8028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:12 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:13.665950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:13.666639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:13.675119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:13.675698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:13.676220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:13.677076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:13.677618 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:13.678129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:13.836350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:13.846629 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0a943d40-538a-479f-8a1a-e3cc3388d901 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1696 microversion: 2.1 time: 0.186619 Aug 29 06:13:13.847456 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4019/8029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:13 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:14.869284 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:14.869909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:14.877142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:14.877625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:14.878054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:14.878739 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:14.879182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:14.879600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:15.017544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:15.025807 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-38c53ed2-36d9-4ae4-b56f-b9799307168d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1695 microversion: 2.1 time: 0.160710 Aug 29 06:13:15.026404 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4011/8030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:14 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:15.237911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-53319139-23f3-471c-ab54-d58c75e67032 req-79b6db65-e510-4e81-ad0e-4d243f1972b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972189c8-986f-46f9-a64e-32336c459825", "name": "network-vif-unplugged", "status": "completed", "tag": "305f3626-5cbe-45cd-b700-4e5d7571beac"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:13:15.249511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-53319139-23f3-471c-ab54-d58c75e67032 req-79b6db65-e510-4e81-ad0e-4d243f1972b4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:15.250035 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-53319139-23f3-471c-ab54-d58c75e67032 req-79b6db65-e510-4e81-ad0e-4d243f1972b4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:15.250450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-53319139-23f3-471c-ab54-d58c75e67032 req-79b6db65-e510-4e81-ad0e-4d243f1972b4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:15.263734 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-53319139-23f3-471c-ab54-d58c75e67032 req-79b6db65-e510-4e81-ad0e-4d243f1972b4 service nova] Creating event network-vif-unplugged:305f3626-5cbe-45cd-b700-4e5d7571beac for instance 972189c8-986f-46f9-a64e-32336c459825 on n-h2-854119-9 Aug 29 06:13:15.271710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [req-53319139-23f3-471c-ab54-d58c75e67032 req-79b6db65-e510-4e81-ad0e-4d243f1972b4 service nova] Instance 972189c8-986f-46f9-a64e-32336c459825 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128871) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 06:13:15.283950 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-53319139-23f3-471c-ab54-d58c75e67032 req-79b6db65-e510-4e81-ad0e-4d243f1972b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049846 Aug 29 06:13:15.284619 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4020/8031] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:13:16.047036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:16.047672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:16.050418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=27 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:13:16.055755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:16.056277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:16.056712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:16.057398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:16.057848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:16.058268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:16.061155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=79 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:13:16.195275 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:16.203699 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-54e1a036-a044-4a22-8604-ee96a086b5ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1695 microversion: 2.1 time: 0.160621 Aug 29 06:13:16.204326 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4012/8032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:16 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:17.232460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:17.233636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:17.236857 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=33 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:13:17.244819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:17.245319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:17.245774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:17.246487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:17.246953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:17.247394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:17.250228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:13:17.309827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-19d31c50-62dd-49e7-8a2e-43853a2750fc req-e2f3c9f7-a17c-4358-90f6-c7449e3f7c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972189c8-986f-46f9-a64e-32336c459825", "tag": "305f3626-5cbe-45cd-b700-4e5d7571beac"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:13:17.320752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-19d31c50-62dd-49e7-8a2e-43853a2750fc req-e2f3c9f7-a17c-4358-90f6-c7449e3f7c53 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:17.321254 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-19d31c50-62dd-49e7-8a2e-43853a2750fc req-e2f3c9f7-a17c-4358-90f6-c7449e3f7c53 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:17.321656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-19d31c50-62dd-49e7-8a2e-43853a2750fc req-e2f3c9f7-a17c-4358-90f6-c7449e3f7c53 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:17.334239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-19d31c50-62dd-49e7-8a2e-43853a2750fc req-e2f3c9f7-a17c-4358-90f6-c7449e3f7c53 service nova] Creating event network-changed:305f3626-5cbe-45cd-b700-4e5d7571beac for instance 972189c8-986f-46f9-a64e-32336c459825 on n-h2-854119-9 Aug 29 06:13:17.340173 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [req-19d31c50-62dd-49e7-8a2e-43853a2750fc req-e2f3c9f7-a17c-4358-90f6-c7449e3f7c53 service nova] Instance 972189c8-986f-46f9-a64e-32336c459825 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-9', 'n-h1-854119-9'} {{(pid=128872) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 06:13:17.351568 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-19d31c50-62dd-49e7-8a2e-43853a2750fc req-e2f3c9f7-a17c-4358-90f6-c7449e3f7c53 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045471 Aug 29 06:13:17.352515 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4013/8033] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:13:17.402730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:17.411348 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06b3fc20-98df-4659-b2ed-a99ea29477e8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1693 microversion: 2.1 time: 0.187505 Aug 29 06:13:17.411940 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4021/8034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:17 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1693 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:18.439867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:18.440821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:18.451482 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:18.452179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:18.452849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:18.453944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:18.454628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:18.455314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:18.593951 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:18.602327 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-88864af8-c203-464a-9eb1-acdea666ca4a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1693 microversion: 2.1 time: 0.171041 Aug 29 06:13:18.602983 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4014/8035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:18 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:19.628280 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:19.629128 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:19.637907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:19.638414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:19.639030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:19.639797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:19.640323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:19.640764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:19.782159 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:19.793374 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e5cbeb0-339f-40e1-84be-39a395f41ac8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1690 microversion: 2.1 time: 0.171776 Aug 29 06:13:19.793988 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4022/8036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:19 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:19.824039 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-963ae717-8302-495c-9a6b-b44b93faaf8c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:13:19.824614 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-963ae717-8302-495c-9a6b-b44b93faaf8c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:19.832612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963ae717-8302-495c-9a6b-b44b93faaf8c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:19.833103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963ae717-8302-495c-9a6b-b44b93faaf8c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:19.833534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963ae717-8302-495c-9a6b-b44b93faaf8c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:19.834219 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963ae717-8302-495c-9a6b-b44b93faaf8c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:19.834664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963ae717-8302-495c-9a6b-b44b93faaf8c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:19.835078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-963ae717-8302-495c-9a6b-b44b93faaf8c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:19.899160 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-963ae717-8302-495c-9a6b-b44b93faaf8c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825/action" status: 204 len: 0 microversion: 2.1 time: 0.079086 Aug 29 06:13:19.899702 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4015/8037] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:13:19 2022] POST /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:13:19.908304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:19.909189 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:19.915694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:19.916267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:19.916708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:19.917646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:19.918278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:19.918804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:20.149937 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:20.159906 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-17b9a89f-c96e-43ca-9115-98abe25a7ec8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1690 microversion: 2.1 time: 0.254736 Aug 29 06:13:20.160561 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4023/8038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:19 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:20.183075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:20.183766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:20.190418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:20.191105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:20.191533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:20.192268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:20.192722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:20.193209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:20.405252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:20.413243 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-57f4b002-6992-4cf7-b932-0c62c46c8e56 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1690 microversion: 2.1 time: 0.236288 Aug 29 06:13:20.413910 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4016/8039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:20 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:21.435380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:13:21.436010 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:21.443078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:21.443588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:21.444239 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:21.444943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:21.445439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:21.446003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:21.581135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:13:21.589248 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fd8b5d0b-fff1-42d0-9849-7c0b59bff6d5 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1682 microversion: 2.1 time: 0.158134 Aug 29 06:13:21.589849 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4024/8040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:13:21 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:13:22.715920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-23bcdfe0-a08a-4df0-b6a2-be3c258cc4e1 req-91d6a4b3-16d1-4407-8c61-9a1050160840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972189c8-986f-46f9-a64e-32336c459825", "name": "network-vif-plugged", "status": "completed", "tag": "305f3626-5cbe-45cd-b700-4e5d7571beac"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:13:22.726781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-23bcdfe0-a08a-4df0-b6a2-be3c258cc4e1 req-91d6a4b3-16d1-4407-8c61-9a1050160840 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:22.727356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-23bcdfe0-a08a-4df0-b6a2-be3c258cc4e1 req-91d6a4b3-16d1-4407-8c61-9a1050160840 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:22.727870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-23bcdfe0-a08a-4df0-b6a2-be3c258cc4e1 req-91d6a4b3-16d1-4407-8c61-9a1050160840 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:22.739913 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-23bcdfe0-a08a-4df0-b6a2-be3c258cc4e1 req-91d6a4b3-16d1-4407-8c61-9a1050160840 service nova] Creating event network-vif-plugged:305f3626-5cbe-45cd-b700-4e5d7571beac for instance 972189c8-986f-46f9-a64e-32336c459825 on n-h2-854119-9 Aug 29 06:13:22.745169 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-23bcdfe0-a08a-4df0-b6a2-be3c258cc4e1 req-91d6a4b3-16d1-4407-8c61-9a1050160840 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Aug 29 06:13:22.745869 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4017/8041] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:13:53.877502 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6a6dbb44-af2e-4309-9f54-96ce81c1367a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:13:53.880536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6a6dbb44-af2e-4309-9f54-96ce81c1367a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:13:53.883907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=7 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:13:53.884731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=23 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:13:53.891322 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6dbb44-af2e-4309-9f54-96ce81c1367a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:53.891818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6dbb44-af2e-4309-9f54-96ce81c1367a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:53.892312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6dbb44-af2e-4309-9f54-96ce81c1367a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:53.893025 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6dbb44-af2e-4309-9f54-96ce81c1367a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:13:53.893486 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6dbb44-af2e-4309-9f54-96ce81c1367a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:13:53.893912 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6a6dbb44-af2e-4309-9f54-96ce81c1367a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:13:53.955892 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6a6dbb44-af2e-4309-9f54-96ce81c1367a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825/action" status: 200 len: 24573 microversion: 2.1 time: 0.084859 Aug 29 06:13:53.956584 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4025/8042] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:13:53 2022] POST /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:14:11.026617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=11 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:14:11.027954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:14:11.032164 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:14:11.032919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:14:11.033863 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:11.034448 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:11.042834 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:11.043329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:11.043764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:11.044535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:11.044955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:11.045374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:11.076245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:14:11.106675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-fb49e034-8164-44ed-9e47-9d012f9aae13 req-92ee1b16-a99e-4ba9-99e3-e867b6bc2f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972189c8-986f-46f9-a64e-32336c459825", "tag": "305f3626-5cbe-45cd-b700-4e5d7571beac"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:14:11.118360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fb49e034-8164-44ed-9e47-9d012f9aae13 req-92ee1b16-a99e-4ba9-99e3-e867b6bc2f20 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:11.119143 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fb49e034-8164-44ed-9e47-9d012f9aae13 req-92ee1b16-a99e-4ba9-99e3-e867b6bc2f20 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:11.119658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fb49e034-8164-44ed-9e47-9d012f9aae13 req-92ee1b16-a99e-4ba9-99e3-e867b6bc2f20 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:11.131857 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-fb49e034-8164-44ed-9e47-9d012f9aae13 req-92ee1b16-a99e-4ba9-99e3-e867b6bc2f20 service nova] Creating event network-changed:305f3626-5cbe-45cd-b700-4e5d7571beac for instance 972189c8-986f-46f9-a64e-32336c459825 on n-h2-854119-9 Aug 29 06:14:11.138283 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-fb49e034-8164-44ed-9e47-9d012f9aae13 req-92ee1b16-a99e-4ba9-99e3-e867b6bc2f20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111785 Aug 29 06:14:11.139331 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4026/8043] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:14:11.157609 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-162ca52c-a9f4-4964-b4df-14b469f5651a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 204 len: 0 microversion: 2.1 time: 0.133121 Aug 29 06:14:11.158496 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4018/8044] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:14:11 2022] DELETE /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:14:11.168841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:11.169564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:11.176822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:11.177359 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:11.177808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:11.178532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:11.178997 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:11.179436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:11.371978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:11.379973 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d8df6321-5488-4ddf-8228-98686ee50a01 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1688 microversion: 2.1 time: 0.217054 Aug 29 06:14:11.380553 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4027/8045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:11 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1688 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:12.403760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:12.404509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:12.411630 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:12.412135 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:12.412583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:12.413270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:12.413722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:12.414142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:12.594613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:12.602587 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fece1a0c-7960-48cc-b55c-c7c66c038f71 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1688 microversion: 2.1 time: 0.203204 Aug 29 06:14:12.603136 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4019/8046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:12 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1688 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:13.258884 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-afac1b58-96b1-4ff5-9ab8-2ad7c4aea0e9 req-37fd4142-3a97-46ea-b0ec-6d39bf3f3a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972189c8-986f-46f9-a64e-32336c459825", "name": "network-vif-deleted", "tag": "305f3626-5cbe-45cd-b700-4e5d7571beac"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:14:13.269226 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-afac1b58-96b1-4ff5-9ab8-2ad7c4aea0e9 req-37fd4142-3a97-46ea-b0ec-6d39bf3f3a58 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:13.269711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-afac1b58-96b1-4ff5-9ab8-2ad7c4aea0e9 req-37fd4142-3a97-46ea-b0ec-6d39bf3f3a58 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:13.270140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-afac1b58-96b1-4ff5-9ab8-2ad7c4aea0e9 req-37fd4142-3a97-46ea-b0ec-6d39bf3f3a58 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:13.286224 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-afac1b58-96b1-4ff5-9ab8-2ad7c4aea0e9 req-37fd4142-3a97-46ea-b0ec-6d39bf3f3a58 service nova] Creating event network-vif-deleted:305f3626-5cbe-45cd-b700-4e5d7571beac for instance 972189c8-986f-46f9-a64e-32336c459825 on n-h2-854119-9 Aug 29 06:14:13.291423 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-afac1b58-96b1-4ff5-9ab8-2ad7c4aea0e9 req-37fd4142-3a97-46ea-b0ec-6d39bf3f3a58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090404 Aug 29 06:14:13.292046 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4028/8047] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:14:13.631757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:13.632421 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:13.639880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:13.640475 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:13.640908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:13.641604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:13.642054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:13.642463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:13.674152 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:13.674625 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:13.675079 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:13.675497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lazy-loading 'fault' on Instance uuid 972189c8-986f-46f9-a64e-32336c459825 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:14:13.723735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:13.731645 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-eb724ed7-87fc-4d8b-86ef-d66be841d955 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 200 len: 1357 microversion: 2.1 time: 0.103821 Aug 29 06:14:13.732274 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4020/8048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:13 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:14.755508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:14.756527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 972189c8-986f-46f9-a64e-32336c459825] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:14.763243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:14.763744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:14.764222 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:14.764932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:14.765400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:14.765807 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:14.779602 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] HTTP exception thrown: Instance 972189c8-986f-46f9-a64e-32336c459825 could not be found. Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Request method failure captured: Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 HTTP/1.1 Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFdzcU6Ln1e76E-u6gunWc8awkLlGc3AGZ6HhYHY2LdaFQo88owNZziUF2A8_y_LJCRTMpWrsJgn6f-zILABBD2jfjtctmvqHnaa7Rr48Ij3-Sy92C0Q_XBFhpxZcORt5M_ml2OXzisM3BW7cEQ-tWSe85s2FojHOt7ycSgIn3YJMkQ Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1983828ca6b04d5eac60359468fbd523", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: a795ab5abec743aeadd1344e4b36273d Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 972189c8-986f-46f9-a64e-32336c459825 could not be found. Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '972189c8-986f-46f9-a64e-32336c459825'} Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972189c8-986f-46f9-a64e-32336c459825 could not be found. Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972189c8-986f-46f9-a64e-32336c459825 could not be found. Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:14:14.781381 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972189c8-986f-46f9-a64e-32336c459825 could not be found. Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Returning 404 to user: Instance 972189c8-986f-46f9-a64e-32336c459825 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d6af55db-e2ab-4b62-8ef8-901c13645f2f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825" status: 404 len: 111 microversion: 2.1 time: 0.032684 Aug 29 06:14:14.785968 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4029/8049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:14 2022] GET /compute/v2.1/servers/972189c8-986f-46f9-a64e-32336c459825 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:14:18.203593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-13324f04-a911-4ac1-aea9-1ee46070a7a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '.version_select at 0x7f1ab90bff70>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:18.237180 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-13324f04-a911-4ac1-aea9-1ee46070a7a7 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1364882258" status: 202 len: 0 microversion: 2.1 time: 0.042573 Aug 29 06:14:18.238271 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4021/8050] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Aug 29 06:14:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1364882258 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:14:18.269588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-981f1713-f40d-4586-9375-d75ce1294322 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: .version_select at 0x7f1ab85915e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1840482321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcyly+7avce6j7W0VKo7Qfux4IUxivFD/YcQJK3k5ssyULCton0lroX0MDI0VuhsgSg4gT0+18r3AC6ZBwHM2PrtVWn6cN1C+2y/T4Pa6SUm2XfTyki6d5bzZi9dgyjqg=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:14:18.286011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-981f1713-f40d-4586-9375-d75ce1294322 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:14:18.292876 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-981f1713-f40d-4586-9375-d75ce1294322 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:14:18.308658 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-981f1713-f40d-4586-9375-d75ce1294322 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [2986978a-48e4-4788-86ed-c5cccf08efe0] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:14:19.318747 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [None req-981f1713-f40d-4586-9375-d75ce1294322 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [2986978a-48e4-4788-86ed-c5cccf08efe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49896. Aug 29 06:14:19.337310 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-981f1713-f40d-4586-9375-d75ce1294322 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.071889 Aug 29 06:14:19.337938 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4030/8051] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 06:14:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:14:25.236990 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:14:25.241364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1742705654", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "8460a8e7-d7d5-4ede-a2e4-12585c54e900"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1840482321", "security_groups": [{"name": "tempest-secgroup-smoke-1531994983"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:14:25.364102 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] validate_networks() for [('8460a8e7-d7d5-4ede-a2e4-12585c54e900', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:14:25.865942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:14:25.866783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:14:25.867259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:14:25.868247 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:14:25.869285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:14:25.879496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:25.880327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:25.880964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:25.881856 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:25.882463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:25.883073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:25.921027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:14:25.927292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:14:25.941508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:14:25.944141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:14:25.995468 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-198b3d3b-b622-439c-b07d-8171e75323ee tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760128 Aug 29 06:14:25.996158 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4022/8052] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:14:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 06:14:26.007855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9ec54e29-61d8-40f0-92da-4c8433bcff38 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:26.009250 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9ec54e29-61d8-40f0-92da-4c8433bcff38 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:26.014531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=12 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:14:26.108065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9ec54e29-61d8-40f0-92da-4c8433bcff38 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:26.115194 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9ec54e29-61d8-40f0-92da-4c8433bcff38 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1267 microversion: 2.1 time: 0.111403 Aug 29 06:14:26.129435 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4031/8053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:26 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1267 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:27.136353 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:27.137020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:27.145142 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:27.145872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:27.146539 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:27.147494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:27.147963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:27.148416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:27.282073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:27.290975 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d810aea6-267d-4302-9a44-6e7c817cd925 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1327 microversion: 2.1 time: 0.158541 Aug 29 06:14:27.291660 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4023/8054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:27 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:28.316309 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:28.317124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:28.325042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:28.325550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:28.325978 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:28.327046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:28.327517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:28.327958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:28.532145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:28.540360 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71eb3158-e9e4-4bd9-b4af-edf9ac39ca22 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1393 microversion: 2.1 time: 0.230302 Aug 29 06:14:28.540933 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4032/8055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:28 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1393 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:28.727774 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-d3dc0f83-2ec7-44c3-a2e1-6fdf192977c6 req-feef2aef-5929-40a5-8f1c-7e8f81626056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc7d9e6-fe84-4d7a-9077-d09605bef166", "tag": "44080016-39b5-44df-b7d8-f12823b17a1a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:14:28.741292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d3dc0f83-2ec7-44c3-a2e1-6fdf192977c6 req-feef2aef-5929-40a5-8f1c-7e8f81626056 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:28.741977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d3dc0f83-2ec7-44c3-a2e1-6fdf192977c6 req-feef2aef-5929-40a5-8f1c-7e8f81626056 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:28.742372 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-d3dc0f83-2ec7-44c3-a2e1-6fdf192977c6 req-feef2aef-5929-40a5-8f1c-7e8f81626056 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:28.755598 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-d3dc0f83-2ec7-44c3-a2e1-6fdf192977c6 req-feef2aef-5929-40a5-8f1c-7e8f81626056 service nova] Creating event network-changed:44080016-39b5-44df-b7d8-f12823b17a1a for instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 on n-h1-854119-9 Aug 29 06:14:28.760627 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-d3dc0f83-2ec7-44c3-a2e1-6fdf192977c6 req-feef2aef-5929-40a5-8f1c-7e8f81626056 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036687 Aug 29 06:14:28.761235 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4024/8056] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:14:29.566549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:29.567920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:29.579470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:29.580310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:29.581057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:29.582249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:29.583102 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:29.583846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:29.720659 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:29.729036 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8633beb8-aa22-44ed-97d3-e9dab584be23 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1393 microversion: 2.1 time: 0.169724 Aug 29 06:14:29.729633 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4033/8057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:29 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:30.753817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:30.754678 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:30.762049 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:30.762535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:30.762975 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:30.763663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:30.764139 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:30.764579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:30.907354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:30.920570 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c40c33cf-ddf4-4eec-b116-4f2cbc87d654 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1393 microversion: 2.1 time: 0.173293 Aug 29 06:14:30.921161 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4025/8058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:30 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:31.942084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:31.942726 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:31.950232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:31.950728 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:31.951166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:31.952286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:31.952754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:31.953185 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:32.096328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:32.104340 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f3623d8a-1529-49d3-b1f3-79307b59f359 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1393 microversion: 2.1 time: 0.166293 Aug 29 06:14:32.104933 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4034/8059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:31 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:33.130394 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:33.131058 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:33.138735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:33.139256 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:33.139722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:33.140495 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:33.140980 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:33.141435 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:33.278744 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:33.287469 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2e761424-3b4c-4d39-b30c-ff8f7b2a8bae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1393 microversion: 2.1 time: 0.161288 Aug 29 06:14:33.288044 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4026/8060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:33 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:34.313906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:34.314770 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:34.327339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:34.328175 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:34.328942 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:34.330100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:34.330864 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:34.331576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:34.494617 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:34.502647 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f731a753-e138-4507-b4f4-282f3692f46d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1393 microversion: 2.1 time: 0.195615 Aug 29 06:14:34.503225 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4035/8061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:34 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1393 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:34.822883 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-4e1466b8-7642-4945-88a8-8c04ee3203d8 req-d86af126-dd54-45ed-969a-67be41b73031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc7d9e6-fe84-4d7a-9077-d09605bef166", "name": "network-vif-plugged", "status": "completed", "tag": "44080016-39b5-44df-b7d8-f12823b17a1a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:14:34.835803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4e1466b8-7642-4945-88a8-8c04ee3203d8 req-d86af126-dd54-45ed-969a-67be41b73031 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:34.836681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4e1466b8-7642-4945-88a8-8c04ee3203d8 req-d86af126-dd54-45ed-969a-67be41b73031 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:34.837099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4e1466b8-7642-4945-88a8-8c04ee3203d8 req-d86af126-dd54-45ed-969a-67be41b73031 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:34.848749 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-4e1466b8-7642-4945-88a8-8c04ee3203d8 req-d86af126-dd54-45ed-969a-67be41b73031 service nova] Creating event network-vif-plugged:44080016-39b5-44df-b7d8-f12823b17a1a for instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 on n-h1-854119-9 Aug 29 06:14:34.854050 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-4e1466b8-7642-4945-88a8-8c04ee3203d8 req-d86af126-dd54-45ed-969a-67be41b73031 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035491 Aug 29 06:14:34.854858 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4027/8062] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:14:35.528554 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:35.529556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:35.540840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:35.541273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:35.541752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:35.542477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:35.542932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:35.543373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:35.694237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:35.704703 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0de179ab-e24c-495f-a316-99390fee9daa tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1393 microversion: 2.1 time: 0.182873 Aug 29 06:14:35.705516 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4036/8063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:35 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:36.732715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:36.733333 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:36.736339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:14:36.739109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:14:36.746186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:36.746701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:36.747117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:36.747827 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:36.748464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:36.748889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:36.885667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:36.894210 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f2a3d1b8-07ab-4cb7-a042-58ff2a6d8495 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1566 microversion: 2.1 time: 0.166991 Aug 29 06:14:36.894761 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4028/8064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:36 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:36.917304 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:36.918024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:36.920101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:14:36.926609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:36.927117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:36.927582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:36.928376 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:36.928834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:36.929267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:37.065327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:37.073703 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-334a8603-8105-4b19-928c-4bb9ad205b39 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1566 microversion: 2.1 time: 0.162369 Aug 29 06:14:37.074269 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4037/8065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:36 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:14:39.073052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:14:39.073669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:14:39.075576 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-d6b86682-205a-4405-98c9-d81222bd145f req-4cf588a2-5658-485d-a1cb-9cf9e79da3ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc7d9e6-fe84-4d7a-9077-d09605bef166", "tag": "44080016-39b5-44df-b7d8-f12823b17a1a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:14:39.082734 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:39.082945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:39.083355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:39.084607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:39.084607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:39.085003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:39.087890 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d6b86682-205a-4405-98c9-d81222bd145f req-4cf588a2-5658-485d-a1cb-9cf9e79da3ca service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:14:39.088480 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d6b86682-205a-4405-98c9-d81222bd145f req-4cf588a2-5658-485d-a1cb-9cf9e79da3ca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:14:39.088969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-d6b86682-205a-4405-98c9-d81222bd145f req-4cf588a2-5658-485d-a1cb-9cf9e79da3ca service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:14:39.100580 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-d6b86682-205a-4405-98c9-d81222bd145f req-4cf588a2-5658-485d-a1cb-9cf9e79da3ca service nova] Creating event network-changed:44080016-39b5-44df-b7d8-f12823b17a1a for instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 on n-h1-854119-9 Aug 29 06:14:39.106281 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-d6b86682-205a-4405-98c9-d81222bd145f req-4cf588a2-5658-485d-a1cb-9cf9e79da3ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034645 Aug 29 06:14:39.107468 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4038/8066] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:14:39.304214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:14:39.313387 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a6d67002-4b42-4b0f-9142-8f797e95c6bc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1566 microversion: 2.1 time: 0.244633 Aug 29 06:14:39.314086 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4029/8067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:14:39 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:14.675924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:15:14.676717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=38 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:15:14.681665 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f0a36c49-97a8-4ced-8739-0981d3c3fe1e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:15:14.684196 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f0a36c49-97a8-4ced-8739-0981d3c3fe1e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:14.691205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0a36c49-97a8-4ced-8739-0981d3c3fe1e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:14.691690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0a36c49-97a8-4ced-8739-0981d3c3fe1e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:14.692194 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0a36c49-97a8-4ced-8739-0981d3c3fe1e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:14.692902 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0a36c49-97a8-4ced-8739-0981d3c3fe1e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:14.693386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0a36c49-97a8-4ced-8739-0981d3c3fe1e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:14.693821 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0a36c49-97a8-4ced-8739-0981d3c3fe1e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:14.753168 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f0a36c49-97a8-4ced-8739-0981d3c3fe1e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action" status: 200 len: 24575 microversion: 2.1 time: 0.080052 Aug 29 06:15:14.753819 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4039/8068] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:15:14 2022] POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action => generated 24575 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:15:45.222659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:15:45.224027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=36 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:15:45.228114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2e9f5e68-7b46-42f2-9386-efe60e3ba553 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:15:45.235775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e9f5e68-7b46-42f2-9386-efe60e3ba553 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:45.236302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e9f5e68-7b46-42f2-9386-efe60e3ba553 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:45.236746 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2e9f5e68-7b46-42f2-9386-efe60e3ba553 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:45.261436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2e9f5e68-7b46-42f2-9386-efe60e3ba553 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Going to try to stop instance {{(pid=128872) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 06:15:45.305641 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2e9f5e68-7b46-42f2-9386-efe60e3ba553 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action" status: 202 len: 0 microversion: 2.1 time: 0.084695 Aug 29 06:15:45.306442 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4030/8069] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:15:45 2022] POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:15:45.315776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:45.316651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:45.325031 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:15:45.326114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:15:45.329761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:45.330565 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:45.331307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:45.332384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:45.333074 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:45.333599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:45.477475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:45.485939 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fbf3cac0-7451-4916-9a85-f600ff0cef4d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1695 microversion: 2.1 time: 0.174903 Aug 29 06:15:45.486565 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4040/8070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:45 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:46.510100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:46.510800 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:46.517472 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:46.517946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:46.518367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:46.519054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:46.519484 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:46.519893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:46.661104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:46.669793 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d1a2f5af-ede2-4deb-83c9-592eb4edf331 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1695 microversion: 2.1 time: 0.165662 Aug 29 06:15:46.670447 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4031/8071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:46 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:47.692999 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:47.693626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:47.701008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:47.701510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:47.701938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:47.703080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:47.703532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:47.703989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:47.841487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:47.849757 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fc8d40d2-1ed3-4946-b11e-f74eebb4d2ae tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1695 microversion: 2.1 time: 0.160836 Aug 29 06:15:47.850546 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4041/8072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:47 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:48.871531 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:48.872164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:48.879563 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:48.880069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:48.880529 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:48.881220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:48.881675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:48.882099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:49.017709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:49.025683 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e785d908-3f4d-4d75-9c94-9307f77a4ad3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1695 microversion: 2.1 time: 0.158207 Aug 29 06:15:49.026267 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4032/8073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:48 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:50.047539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:50.048289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:50.055384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:50.055888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:50.056381 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:50.057124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:50.057590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:50.058032 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:50.202657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:50.211055 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b42846e7-ec03-422e-a177-c38c60c09897 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1695 microversion: 2.1 time: 0.167527 Aug 29 06:15:50.211679 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4042/8074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:50 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:51.233533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:51.234199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:51.242338 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:51.242820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:51.243246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:51.243931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:51.244407 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:51.244942 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:51.390817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:51.399901 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-90d2f535-7670-48ab-a3f6-0d1af97fe0da tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1695 microversion: 2.1 time: 0.170174 Aug 29 06:15:51.400902 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4033/8075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:51 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:52.421090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:52.421731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:52.429112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:52.429606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:52.430115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:52.430826 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:52.431286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:52.431719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:52.569923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:52.578758 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-638fd02e-329e-4bc7-b397-94138d40428e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1695 microversion: 2.1 time: 0.161595 Aug 29 06:15:52.579372 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4043/8076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:52 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:53.600541 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:53.601159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:53.608894 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:53.609384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:53.609813 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:53.610516 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:53.610961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:53.611383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:53.746931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:53.755199 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-664b53d1-29e5-41eb-abf3-0b9913d4b4cd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1695 microversion: 2.1 time: 0.158618 Aug 29 06:15:53.755758 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4034/8077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:53 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:54.776990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:54.777628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:54.785015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:54.785488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:54.785976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:54.786761 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:54.787230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:54.787671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:54.925578 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:54.933697 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fdfdafd7-57d5-4750-8019-dda9ef8a4e9c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1695 microversion: 2.1 time: 0.160653 Aug 29 06:15:54.934252 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4044/8078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:54 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:55.955795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:55.956437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:55.963935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:55.964462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:55.964888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:55.965616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:55.966069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:55.966498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:56.099867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:56.108149 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1c655eb6-99db-4410-a697-c32e961d5be1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1672 microversion: 2.1 time: 0.156772 Aug 29 06:15:56.108893 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4035/8079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:55 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:57.205946 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b8341f4-8ebe-4e78-8ec8-37d61d71ec25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:15:57.208187 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0b8341f4-8ebe-4e78-8ec8-37d61d71ec25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:57.215861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b8341f4-8ebe-4e78-8ec8-37d61d71ec25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:57.216413 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b8341f4-8ebe-4e78-8ec8-37d61d71ec25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:57.216840 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b8341f4-8ebe-4e78-8ec8-37d61d71ec25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:57.217575 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b8341f4-8ebe-4e78-8ec8-37d61d71ec25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:57.218177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b8341f4-8ebe-4e78-8ec8-37d61d71ec25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:57.218621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b8341f4-8ebe-4e78-8ec8-37d61d71ec25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:57.272393 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0b8341f4-8ebe-4e78-8ec8-37d61d71ec25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action" status: 200 len: 37569 microversion: 2.1 time: 0.070587 Aug 29 06:15:57.273094 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4045/8080] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:15:57 2022] POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action => generated 37569 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:15:57.287500 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e5c74fde-6dd9-47ef-ac6a-878f0988646c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:15:57.295350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5c74fde-6dd9-47ef-ac6a-878f0988646c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:57.295835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5c74fde-6dd9-47ef-ac6a-878f0988646c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:57.296404 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e5c74fde-6dd9-47ef-ac6a-878f0988646c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:57.319218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e5c74fde-6dd9-47ef-ac6a-878f0988646c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Going to try to start instance {{(pid=128872) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 06:15:57.368078 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e5c74fde-6dd9-47ef-ac6a-878f0988646c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action" status: 202 len: 0 microversion: 2.1 time: 0.085136 Aug 29 06:15:57.368757 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4036/8081] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:15:57 2022] POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:15:57.378488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:57.379803 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:57.387693 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:57.388475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:57.388938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:57.389962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:57.390730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:57.391373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:57.623694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:57.636948 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2ede1e5c-4fae-4f98-a3fa-629fda6b17e0 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1681 microversion: 2.1 time: 0.263116 Aug 29 06:15:57.637829 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4046/8082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:57 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:15:58.663334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:15:58.664113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:15:58.672224 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:58.672731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:58.673163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:58.673881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:15:58.674366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:15:58.674756 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:15:59.117888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:15:59.126369 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-92e64017-5762-4708-9f9e-0eb40a15322c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1685 microversion: 2.1 time: 0.469513 Aug 29 06:15:59.126945 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4037/8083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:15:58 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1685 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:16:33.359114 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b484cf43-34f5-4916-a54e-d213262aca20 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:16:33.361338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b484cf43-34f5-4916-a54e-d213262aca20 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:16:33.364554 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 06:16:33.366281 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:16:33.366438 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:16:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action (ip 10.222.0.20) !!! Aug 29 06:16:33.368558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=14 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:16:33.370212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=40 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:16:33.382676 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b484cf43-34f5-4916-a54e-d213262aca20 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:33.383173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b484cf43-34f5-4916-a54e-d213262aca20 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:33.383613 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b484cf43-34f5-4916-a54e-d213262aca20 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:33.384363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b484cf43-34f5-4916-a54e-d213262aca20 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:33.384822 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b484cf43-34f5-4916-a54e-d213262aca20 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:33.385252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b484cf43-34f5-4916-a54e-d213262aca20 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:33.441349 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b484cf43-34f5-4916-a54e-d213262aca20 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action" status: 200 len: 62122 microversion: 2.1 time: 0.086077 Aug 29 06:16:33.442066 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4047/8084] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:16:33 2022] POST /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166/action => generated 62122 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:16:57.010261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:16:57.011030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:16:57.013666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-22c5c733-5a1b-467b-9917-f0ac46d167b4 req-b98c58a4-6035-485e-b961-92a502bf5151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc7d9e6-fe84-4d7a-9077-d09605bef166", "tag": "44080016-39b5-44df-b7d8-f12823b17a1a"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:16:57.014083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=16 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:16:57.014325 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:16:57.020449 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:16:57.021366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:16:57.021496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:57.021991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:57.022535 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:57.023364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:57.023895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:57.024389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:57.028667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-22c5c733-5a1b-467b-9917-f0ac46d167b4 req-b98c58a4-6035-485e-b961-92a502bf5151 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:57.029163 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-22c5c733-5a1b-467b-9917-f0ac46d167b4 req-b98c58a4-6035-485e-b961-92a502bf5151 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:57.029666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-22c5c733-5a1b-467b-9917-f0ac46d167b4 req-b98c58a4-6035-485e-b961-92a502bf5151 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:57.042979 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-22c5c733-5a1b-467b-9917-f0ac46d167b4 req-b98c58a4-6035-485e-b961-92a502bf5151 service nova] Creating event network-changed:44080016-39b5-44df-b7d8-f12823b17a1a for instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 on n-h1-854119-9 Aug 29 06:16:57.048403 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-22c5c733-5a1b-467b-9917-f0ac46d167b4 req-b98c58a4-6035-485e-b961-92a502bf5151 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039277 Aug 29 06:16:57.049163 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4048/8085] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:16:57.055450 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Going to try to terminate instance {{(pid=128872) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:16:57.148734 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4c8b2360-5a63-4240-bb4e-e5943aecc24c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 204 len: 0 microversion: 2.1 time: 0.142015 Aug 29 06:16:57.149388 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4038/8086] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:16:57 2022] DELETE /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:16:57.159609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:16:57.160369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:16:57.167570 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:57.168080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:57.168582 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:57.169291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:57.171395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:57.172753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:57.336405 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:16:57.344510 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a0ce24e7-5653-4e14-a517-25161c75cc5e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1691 microversion: 2.1 time: 0.189993 Aug 29 06:16:57.345419 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4049/8087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:16:57 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1691 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:16:58.367351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:16:58.367909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:16:58.375612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:58.376143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:58.376552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:58.377246 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:58.377691 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:58.378107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:58.587342 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:16:58.595695 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1e6d9c56-a10c-4820-b562-7329c466c8ff tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1691 microversion: 2.1 time: 0.232728 Aug 29 06:16:58.596269 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4039/8088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:16:58 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:16:59.619048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:16:59.620596 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:16:59.627668 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:59.628178 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:59.628626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:59.629358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:59.629812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:59.630242 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:59.651166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-027bbc61-8b3b-4883-918a-466364812607 req-e983ff5e-a3da-4aee-bea6-17b90ab42ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc7d9e6-fe84-4d7a-9077-d09605bef166", "name": "network-vif-deleted", "tag": "44080016-39b5-44df-b7d8-f12823b17a1a"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:16:59.662656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-027bbc61-8b3b-4883-918a-466364812607 req-e983ff5e-a3da-4aee-bea6-17b90ab42ab5 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:16:59.663170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-027bbc61-8b3b-4883-918a-466364812607 req-e983ff5e-a3da-4aee-bea6-17b90ab42ab5 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:16:59.663606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-027bbc61-8b3b-4883-918a-466364812607 req-e983ff5e-a3da-4aee-bea6-17b90ab42ab5 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:16:59.681404 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-027bbc61-8b3b-4883-918a-466364812607 req-e983ff5e-a3da-4aee-bea6-17b90ab42ab5 service nova] Creating event network-vif-deleted:44080016-39b5-44df-b7d8-f12823b17a1a for instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 on n-h1-854119-9 Aug 29 06:16:59.689381 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-027bbc61-8b3b-4883-918a-466364812607 req-e983ff5e-a3da-4aee-bea6-17b90ab42ab5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042033 Aug 29 06:16:59.690002 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4040/8089] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:16:59.713296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:16:59.721287 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-dc35441c-a727-4b55-a2bd-715f4072a19e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 200 len: 1504 microversion: 2.1 time: 0.106300 Aug 29 06:16:59.722120 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4050/8090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:16:59 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 1504 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:00.743380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:00.744085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 0fc7d9e6-fe84-4d7a-9077-d09605bef166] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:00.752413 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:00.752909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:00.753343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:00.754062 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:00.754517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:00.754935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:00.769616 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] HTTP exception thrown: Instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 could not be found. Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Request method failure captured: Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 HTTP/1.1 Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFdzcU6Ln1e76E-u6gunWc8awkLlGc3AGZ6HhYHY2LdaFQo88owNZziUF2A8_y_LJCRTMpWrsJgn6f-zILABBD2jfjtctmvqHnaa7Rr48Ij3-Sy92C0Q_XBFhpxZcORt5M_ml2OXzisM3BW7cEQ-tWSe85s2FojHOt7ycSgIn3YJMkQ Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1983828ca6b04d5eac60359468fbd523", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: a795ab5abec743aeadd1344e4b36273d Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 could not be found. Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '0fc7d9e6-fe84-4d7a-9077-d09605bef166'} Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 could not be found. Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 could not be found. Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:17:00.771468 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 could not be found. Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Returning 404 to user: Instance 0fc7d9e6-fe84-4d7a-9077-d09605bef166 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1178e0f6-0dbd-46e7-90f2-2c460bb646dc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166" status: 404 len: 111 microversion: 2.1 time: 0.033754 Aug 29 06:17:00.776758 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4041/8091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:00 2022] GET /compute/v2.1/servers/0fc7d9e6-fe84-4d7a-9077-d09605bef166 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:17:04.200553 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a2d1945b-18f3-4c33-a535-0cebd8675ec2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '.version_select at 0x7f1ab8625280>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:04.230487 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a2d1945b-18f3-4c33-a535-0cebd8675ec2 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1840482321" status: 202 len: 0 microversion: 2.1 time: 0.034110 Aug 29 06:17:04.231442 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4051/8092] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Aug 29 06:17:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1840482321 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:17:04.260807 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-46b7b3d0-8a1d-4a10-987d-e4c66d80d98c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: .version_select at 0x7f1ab817ab80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1605554015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUnVHvfYNPu+QowO4oNj0+ZZ9GRlmbyBC3oyWL1ADk9MjPYr+zepFln2kYKBioyVpIGZKV8sK/0Nh9N6weX+OBULwQV9/PYbJs0b4OgEmvxZc1NvN8xao9MkHS4IrpSYw=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:17:04.279197 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-46b7b3d0-8a1d-4a10-987d-e4c66d80d98c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:17:04.284357 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-46b7b3d0-8a1d-4a10-987d-e4c66d80d98c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:17:04.315266 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-46b7b3d0-8a1d-4a10-987d-e4c66d80d98c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058522 Aug 29 06:17:04.315873 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4042/8093] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 06:17:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:17:10.548757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1354812845", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "networks": [{"uuid": "a444212e-fa36-4171-8d13-20cac45c64b2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1605554015", "security_groups": [{"name": "tempest-secgroup-smoke-1604840081"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:17:10.578415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=14 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:17:10.711965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] validate_networks() for [('a444212e-fa36-4171-8d13-20cac45c64b2', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:17:11.270059 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:17:11.270544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:17:11.271875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:17:11.272323 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:17:11.273266 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:17:11.282477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:11.283234 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:11.283681 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:11.284552 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:11.285015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:11.285448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:11.306152 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:17:11.312454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Getting quotas for user a795ab5abec743aeadd1344e4b36273d and project 1983828ca6b04d5eac60359468fbd523. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:17:11.325572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:17:11.328584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:17:11.386360 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b6e1c5ac-906f-46c9-a00a-0947b3b40136 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842219 Aug 29 06:17:11.387397 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4052/8094] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:17:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 06:17:11.400220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bf46e1cc-d411-4caa-94a0-e91841d9ca25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:11.401498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bf46e1cc-d411-4caa-94a0-e91841d9ca25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:11.409048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:17:11.477208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bf46e1cc-d411-4caa-94a0-e91841d9ca25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:11.485036 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bf46e1cc-d411-4caa-94a0-e91841d9ca25 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1267 microversion: 2.1 time: 0.090812 Aug 29 06:17:11.486021 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4043/8095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:11 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:12.507458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:12.508067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:12.515830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:12.516404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:12.516922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:12.517985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:12.518452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:12.519192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:12.587921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:12.597424 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5c8b95b1-e840-4755-9f09-6f4302ce627d tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1319 microversion: 2.1 time: 0.094543 Aug 29 06:17:12.612991 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4053/8096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:12 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1319 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:13.620240 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:13.620772 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:13.630297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:13.631427 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:13.632108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:13.635205 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:13.637029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:13.639184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:13.919064 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:13.927724 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-21c97be1-0bd6-4796-97c1-a647cdaa6745 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1393 microversion: 2.1 time: 0.311750 Aug 29 06:17:13.928706 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4044/8097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:13 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1393 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:14.335718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-029b46d8-cd25-438b-8981-54ff7b113ccd req-3b66e3da-3306-4cd3-be09-05341873f7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d118f5-bb46-45a7-8a7d-ee8548f3ec3b", "tag": "04350af9-99a3-4d71-be84-acbfa57c8790"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:17:14.348070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-029b46d8-cd25-438b-8981-54ff7b113ccd req-3b66e3da-3306-4cd3-be09-05341873f7e7 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:14.348690 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-029b46d8-cd25-438b-8981-54ff7b113ccd req-3b66e3da-3306-4cd3-be09-05341873f7e7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:14.349200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-029b46d8-cd25-438b-8981-54ff7b113ccd req-3b66e3da-3306-4cd3-be09-05341873f7e7 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:14.365299 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-029b46d8-cd25-438b-8981-54ff7b113ccd req-3b66e3da-3306-4cd3-be09-05341873f7e7 service nova] Creating event network-changed:04350af9-99a3-4d71-be84-acbfa57c8790 for instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b on n-h2-854119-9 Aug 29 06:17:14.373575 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-029b46d8-cd25-438b-8981-54ff7b113ccd req-3b66e3da-3306-4cd3-be09-05341873f7e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041254 Aug 29 06:17:14.374682 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4054/8098] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:17:14.950104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:14.950690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:14.958861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:14.959364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:14.959795 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:14.960532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:14.960984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:14.961408 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:15.111499 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:15.120821 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-af20d41c-9b58-42e7-b5ce-7fb6e7693b68 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1393 microversion: 2.1 time: 0.174813 Aug 29 06:17:15.121721 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4045/8099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:14 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:16.143790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:16.144496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:16.151458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:16.151863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:16.152346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:16.153056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:16.153521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:16.153954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:16.291652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:16.299803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-25c0c40c-0011-4934-b97a-c4dd71914c93 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1393 microversion: 2.1 time: 0.161197 Aug 29 06:17:16.300420 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4055/8100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:16 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:17.321293 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:17.321903 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:17.329521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:17.329943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:17.330389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:17.331088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:17.331544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:17.331971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:17.471970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:17.480239 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2cc291f4-4523-452a-870f-b04a1fb4d6de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1393 microversion: 2.1 time: 0.163016 Aug 29 06:17:17.480788 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4046/8101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:17 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:18.501867 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:18.503142 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:18.510719 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:18.511224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:18.511911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:18.512652 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:18.513117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:18.513551 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:18.652925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:18.661459 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ea96eea8-aea5-4e2a-adeb-4e0c0a12d2c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1393 microversion: 2.1 time: 0.163654 Aug 29 06:17:18.675318 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4056/8102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:18 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:19.682923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:19.683540 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:19.690964 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:19.691461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:19.691893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:19.692629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:19.693083 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:19.693508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:19.830633 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:19.839008 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a229144-49ec-455f-a938-3b69a0591948 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1393 microversion: 2.1 time: 0.160167 Aug 29 06:17:19.839677 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4047/8103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:19 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:20.376030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-a9a68c7e-61e6-4106-b7b0-0d6fe7f0bb03 req-d0c93e95-b1f2-4e49-a6cd-121a9e2d3347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d118f5-bb46-45a7-8a7d-ee8548f3ec3b", "name": "network-vif-plugged", "status": "completed", "tag": "04350af9-99a3-4d71-be84-acbfa57c8790"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:17:20.385744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9a68c7e-61e6-4106-b7b0-0d6fe7f0bb03 req-d0c93e95-b1f2-4e49-a6cd-121a9e2d3347 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:20.386228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9a68c7e-61e6-4106-b7b0-0d6fe7f0bb03 req-d0c93e95-b1f2-4e49-a6cd-121a9e2d3347 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:20.386663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-a9a68c7e-61e6-4106-b7b0-0d6fe7f0bb03 req-d0c93e95-b1f2-4e49-a6cd-121a9e2d3347 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:20.397912 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-a9a68c7e-61e6-4106-b7b0-0d6fe7f0bb03 req-d0c93e95-b1f2-4e49-a6cd-121a9e2d3347 service nova] Creating event network-vif-plugged:04350af9-99a3-4d71-be84-acbfa57c8790 for instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b on n-h2-854119-9 Aug 29 06:17:20.403005 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-a9a68c7e-61e6-4106-b7b0-0d6fe7f0bb03 req-d0c93e95-b1f2-4e49-a6cd-121a9e2d3347 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155022 Aug 29 06:17:20.403780 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4057/8104] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:17:20.860370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:20.860939 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:20.868462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:20.868961 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:20.869405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:20.870095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:20.870554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:20.870985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:21.007170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:21.015460 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c5f811e0-8dba-4792-88e9-501ced2129f1 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1393 microversion: 2.1 time: 0.159225 Aug 29 06:17:21.016081 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4048/8105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:20 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:22.035504 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:17:22.036923 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:17:22.042069 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:22.042810 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:22.050024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:22.050515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:22.050957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:22.051658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:22.052111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:22.052559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:22.187755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:22.196252 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f136fad1-7026-48f5-a18d-d13a53d508f8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1565 microversion: 2.1 time: 0.162584 Aug 29 06:17:22.196916 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4058/8106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:22 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:22.217193 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:22.217944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:22.219871 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:17:22.227454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:22.228002 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:22.228551 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:22.229253 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:22.229707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:22.230130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:22.364880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:22.373014 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ba09c2b1-b6b0-48c7-bcd2-8ac8efdaae5b tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1565 microversion: 2.1 time: 0.159786 Aug 29 06:17:22.373597 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4049/8107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:22 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:24.358348 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:17:24.359211 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:24.359851 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8a6a591c-9d18-41af-90ba-3353ec8a4a12 req-dddc51cb-1f3c-4cab-a58c-5f7c3f82534f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d118f5-bb46-45a7-8a7d-ee8548f3ec3b", "tag": "04350af9-99a3-4d71-be84-acbfa57c8790"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:17:24.366549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:24.367145 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:24.367586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:24.368347 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:24.368809 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:24.369393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:24.378148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8a6a591c-9d18-41af-90ba-3353ec8a4a12 req-dddc51cb-1f3c-4cab-a58c-5f7c3f82534f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:24.378747 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8a6a591c-9d18-41af-90ba-3353ec8a4a12 req-dddc51cb-1f3c-4cab-a58c-5f7c3f82534f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:24.379244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8a6a591c-9d18-41af-90ba-3353ec8a4a12 req-dddc51cb-1f3c-4cab-a58c-5f7c3f82534f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:24.396555 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8a6a591c-9d18-41af-90ba-3353ec8a4a12 req-dddc51cb-1f3c-4cab-a58c-5f7c3f82534f service nova] Creating event network-changed:04350af9-99a3-4d71-be84-acbfa57c8790 for instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b on n-h2-854119-9 Aug 29 06:17:24.403386 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8a6a591c-9d18-41af-90ba-3353ec8a4a12 req-dddc51cb-1f3c-4cab-a58c-5f7c3f82534f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047350 Aug 29 06:17:24.408679 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4050/8108] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:17:24.605607 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:17:24.615673 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1e4780ac-f3ae-424f-a17d-5d7a8a6cd05a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1565 microversion: 2.1 time: 0.261456 Aug 29 06:17:24.616973 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4059/8109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:17:24 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1565 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:17:57.927905 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:17:57.928556 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:17:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action (ip 10.222.0.20) !!! Aug 29 06:17:57.929270 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:17:57.930073 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=38 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:17:57.935040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8e3daba9-9024-4126-bb79-b477254489fd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:17:57.937517 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8e3daba9-9024-4126-bb79-b477254489fd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:17:57.947391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e3daba9-9024-4126-bb79-b477254489fd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:57.947895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e3daba9-9024-4126-bb79-b477254489fd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:57.948370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e3daba9-9024-4126-bb79-b477254489fd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:57.949082 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e3daba9-9024-4126-bb79-b477254489fd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:17:57.949544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e3daba9-9024-4126-bb79-b477254489fd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:17:57.949972 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8e3daba9-9024-4126-bb79-b477254489fd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:17:58.013384 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8e3daba9-9024-4126-bb79-b477254489fd tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action" status: 200 len: 24548 microversion: 2.1 time: 0.087517 Aug 29 06:17:58.020828 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4051/8110] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:17:57 2022] POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action => generated 24548 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:18:37.099617 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 06:18:37.103448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:18:37.104255 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:37.106341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:18:37.106995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=36 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:18:37.115350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:37.115953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:37.116445 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:37.117158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:37.117626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:37.118273 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:37.146769 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lazy-loading 'flavor' on Instance uuid 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:18:37.223285 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d4da7606-61ff-4b3c-81c0-b7eddc44f329 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action" status: 202 len: 0 microversion: 2.1 time: 0.125557 Aug 29 06:18:37.228758 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4060/8111] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:18:37 2022] POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:18:37.235099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:37.235886 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:37.239117 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=4 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:18:37.239713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:18:37.247077 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:37.247743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:37.248547 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:37.250257 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:37.250753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:37.251771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:37.401502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:18:37.411233 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-205611fd-3bd0-40ff-ae46-303713951adc tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1691 microversion: 2.1 time: 0.180442 Aug 29 06:18:37.412204 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4052/8112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:37 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:18:38.434723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:38.435743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:38.446988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:38.447512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:38.447947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:38.448698 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:38.449201 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:38.449642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:38.456418 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50246. Aug 29 06:18:38.599720 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:18:38.608243 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-171106a8-a63a-4465-bb0f-2e920b5c86cb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1691 microversion: 2.1 time: 0.178093 Aug 29 06:18:38.609149 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4061/8113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:38 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:18:39.639358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:39.640070 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:39.646632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:39.647123 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:39.647561 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:39.648278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:39.648720 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:39.649133 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:39.788496 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:18:39.797608 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f0ac634c-9663-4648-917d-54e1fe94bb8a tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1674 microversion: 2.1 time: 0.162456 Aug 29 06:18:39.798199 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4053/8114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:39 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:18:40.916594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-404bb2f9-0b88-41fc-9660-436d010f4780 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:18:40.918852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-404bb2f9-0b88-41fc-9660-436d010f4780 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:40.926705 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-404bb2f9-0b88-41fc-9660-436d010f4780 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:40.927174 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-404bb2f9-0b88-41fc-9660-436d010f4780 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:40.927612 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-404bb2f9-0b88-41fc-9660-436d010f4780 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:40.928351 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-404bb2f9-0b88-41fc-9660-436d010f4780 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:40.928801 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-404bb2f9-0b88-41fc-9660-436d010f4780 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:40.929230 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-404bb2f9-0b88-41fc-9660-436d010f4780 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:40.985101 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-404bb2f9-0b88-41fc-9660-436d010f4780 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action" status: 200 len: 38420 microversion: 2.1 time: 0.072476 Aug 29 06:18:40.985792 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4062/8115] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:18:40 2022] POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action => generated 38420 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:18:40.998441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f6bca400-9ab6-49fb-9605-56ac7d627eda tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:18:40.999115 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f6bca400-9ab6-49fb-9605-56ac7d627eda tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:41.006436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bca400-9ab6-49fb-9605-56ac7d627eda tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:41.006925 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bca400-9ab6-49fb-9605-56ac7d627eda tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:41.007391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bca400-9ab6-49fb-9605-56ac7d627eda tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:41.008090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bca400-9ab6-49fb-9605-56ac7d627eda tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:41.008570 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bca400-9ab6-49fb-9605-56ac7d627eda tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:41.008991 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f6bca400-9ab6-49fb-9605-56ac7d627eda tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:41.099381 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f6bca400-9ab6-49fb-9605-56ac7d627eda tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action" status: 202 len: 0 microversion: 2.1 time: 0.104862 Aug 29 06:18:41.100314 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4054/8116] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:18:40 2022] POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:18:41.118865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:41.119695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:41.127844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:41.128363 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:41.128805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:41.129743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:41.130205 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:41.130623 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:41.376804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:18:41.385264 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f9bc949f-11c0-4078-b994-fa4cff79beeb tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1680 microversion: 2.1 time: 0.271375 Aug 29 06:18:41.385924 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4063/8117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:41 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:18:42.411105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:42.411950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:42.419738 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:42.420611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:42.421130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:42.421946 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:42.422619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:42.423593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:42.899008 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:18:42.907531 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-139e159e-5c62-46a1-a20d-71dd5e1307af tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1680 microversion: 2.1 time: 0.501576 Aug 29 06:18:42.908444 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4055/8118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:42 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1680 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:18:43.931320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:43.931972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:43.939875 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:43.940583 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:43.941056 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:43.941827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:43.942292 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:43.942727 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:44.086325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:18:44.094790 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7c68c462-21e9-4b91-934d-4e2a353d6c3c tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1683 microversion: 2.1 time: 0.167628 Aug 29 06:18:44.095390 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4064/8119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:43 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:18:44.189136 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0d849231-494a-4aca-b76a-aa69b00564de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:18:44.191453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0d849231-494a-4aca-b76a-aa69b00564de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:44.198542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d849231-494a-4aca-b76a-aa69b00564de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:44.199114 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d849231-494a-4aca-b76a-aa69b00564de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:44.199552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d849231-494a-4aca-b76a-aa69b00564de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:44.200268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d849231-494a-4aca-b76a-aa69b00564de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:44.200716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d849231-494a-4aca-b76a-aa69b00564de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:44.201130 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0d849231-494a-4aca-b76a-aa69b00564de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:44.260158 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0d849231-494a-4aca-b76a-aa69b00564de tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action" status: 200 len: 38420 microversion: 2.1 time: 0.074872 Aug 29 06:18:44.267979 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4056/8120] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:18:44 2022] POST /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b/action => generated 38420 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 06:18:45.301670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:45.302799 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:45.310416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:45.310959 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:45.311400 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:45.312512 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:45.313037 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:45.313615 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:45.340451 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b5d5719c-8535-4497-a13f-0175d7553939 req-31c1462c-94ca-48cb-8ac2-4425cd0ac7cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d118f5-bb46-45a7-8a7d-ee8548f3ec3b", "tag": "04350af9-99a3-4d71-be84-acbfa57c8790"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:18:45.357659 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b5d5719c-8535-4497-a13f-0175d7553939 req-31c1462c-94ca-48cb-8ac2-4425cd0ac7cc service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:45.358148 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b5d5719c-8535-4497-a13f-0175d7553939 req-31c1462c-94ca-48cb-8ac2-4425cd0ac7cc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:45.358593 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b5d5719c-8535-4497-a13f-0175d7553939 req-31c1462c-94ca-48cb-8ac2-4425cd0ac7cc service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:45.365590 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:18:45.376793 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b5d5719c-8535-4497-a13f-0175d7553939 req-31c1462c-94ca-48cb-8ac2-4425cd0ac7cc service nova] Creating event network-changed:04350af9-99a3-4d71-be84-acbfa57c8790 for instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b on n-h2-854119-9 Aug 29 06:18:45.386938 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b5d5719c-8535-4497-a13f-0175d7553939 req-31c1462c-94ca-48cb-8ac2-4425cd0ac7cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050166 Aug 29 06:18:45.394193 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4057/8121] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:18:45.460314 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cdfe2f67-9976-42cd-9299-cea29a3090c8 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 204 len: 0 microversion: 2.1 time: 0.162293 Aug 29 06:18:45.461273 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4065/8122] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:18:45 2022] DELETE /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:18:45.472209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:45.476861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:45.489893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:45.491343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:45.492010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:45.493317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:45.493835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:45.494317 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:45.640985 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:18:45.648996 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ac3bb788-adc1-4bb2-aef3-01d18790e47f tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1689 microversion: 2.1 time: 0.182490 Aug 29 06:18:45.649780 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4058/8123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:45 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:18:46.671788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:46.672558 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:46.679732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:46.680276 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:46.680736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:46.681457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:46.681927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:46.682367 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:46.915633 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:18:46.924739 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-60d360ce-9b77-4348-969c-dee3b588f6c4 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1689 microversion: 2.1 time: 0.257172 Aug 29 06:18:46.925584 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4066/8124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:46 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1689 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:18:47.837771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-b3d5d219-80c6-429c-9591-29a5225a1f0b req-9389072b-e6f9-4526-98d3-6e020d4d9fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d118f5-bb46-45a7-8a7d-ee8548f3ec3b", "name": "network-vif-deleted", "tag": "04350af9-99a3-4d71-be84-acbfa57c8790"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:18:47.849514 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b3d5d219-80c6-429c-9591-29a5225a1f0b req-9389072b-e6f9-4526-98d3-6e020d4d9fb4 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:47.850028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b3d5d219-80c6-429c-9591-29a5225a1f0b req-9389072b-e6f9-4526-98d3-6e020d4d9fb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:47.850454 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-b3d5d219-80c6-429c-9591-29a5225a1f0b req-9389072b-e6f9-4526-98d3-6e020d4d9fb4 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:47.862650 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-b3d5d219-80c6-429c-9591-29a5225a1f0b req-9389072b-e6f9-4526-98d3-6e020d4d9fb4 service nova] Creating event network-vif-deleted:04350af9-99a3-4d71-be84-acbfa57c8790 for instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b on n-h2-854119-9 Aug 29 06:18:47.867992 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-b3d5d219-80c6-429c-9591-29a5225a1f0b req-9389072b-e6f9-4526-98d3-6e020d4d9fb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033911 Aug 29 06:18:47.868632 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4059/8125] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:18:47.947200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:47.947846 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:47.955733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:47.956254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:47.956700 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:47.957406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:47.957865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:47.958293 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:47.993777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:47.994285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:47.994725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:47.995195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lazy-loading 'fault' on Instance uuid 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:18:48.047619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a795ab5abec743aeadd1344e4b36273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1983828ca6b04d5eac60359468fbd523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:18:48.056491 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-66398c83-14fa-44ab-aad0-ddc22a7abc0e tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 200 len: 1357 microversion: 2.1 time: 0.113731 Aug 29 06:18:48.057354 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4067/8126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:47 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 1357 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:18:49.080663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:49.081351 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] [instance: 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:18:49.088099 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:49.088628 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:49.089029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:49.089736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:18:49.090189 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:18:49.090585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:18:49.104633 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] HTTP exception thrown: Instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b could not be found. Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Request method failure captured: Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b HTTP/1.1 Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFdzcU6Ln1e76E-u6gunWc8awkLlGc3AGZ6HhYHY2LdaFQo88owNZziUF2A8_y_LJCRTMpWrsJgn6f-zILABBD2jfjtctmvqHnaa7Rr48Ij3-Sy92C0Q_XBFhpxZcORt5M_ml2OXzisM3BW7cEQ-tWSe85s2FojHOt7ycSgIn3YJMkQ Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1983828ca6b04d5eac60359468fbd523", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1983828ca6b04d5eac60359468fbd523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 1983828ca6b04d5eac60359468fbd523 Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-674820356 Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: a795ab5abec743aeadd1344e4b36273d Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestNetworkAdvancedServerOps-674820356-project Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b could not be found. Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '55d118f5-bb46-45a7-8a7d-ee8548f3ec3b'} Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b could not be found. Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b could not be found. Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:18:49.107055 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b could not be found. Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Returning 404 to user: Instance 55d118f5-bb46-45a7-8a7d-ee8548f3ec3b could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d6722ed3-78cd-4839-bc85-1617682fb7a3 tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b" status: 404 len: 111 microversion: 2.1 time: 0.034741 Aug 29 06:18:49.112580 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4060/8127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:18:49 2022] GET /compute/v2.1/servers/55d118f5-bb46-45a7-8a7d-ee8548f3ec3b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:18:52.384084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-637b9c9a-722c-4ed7-a749-dbe8e5c071be tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] Calling method '.version_select at 0x7f1ab97e4820>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:18:52.414204 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-637b9c9a-722c-4ed7-a749-dbe8e5c071be tempest-TestNetworkAdvancedServerOps-674820356 tempest-TestNetworkAdvancedServerOps-674820356-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1605554015" status: 202 len: 0 microversion: 2.1 time: 0.033950 Aug 29 06:18:52.415201 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4068/8128] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Aug 29 06:18:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1605554015 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:19:05.240231 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=18 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:19:05.241771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:19:05.488687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3e32eeb9-0caf-4ba3-88d4-345793979945 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Action: 'create', calling method: .version_select at 0x7f1ab8882160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1310783540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMt9d/1FGx/xUYh+dKPeAlynge42jM3pdjWB1GsxLawFrXrBQWH/4/1i3YC5+LF+W57q3Iae/JvOPntOZAUM0O9Y5NIrhjpNmJQq2piynX713rFwHyOiNrY+OS1XderZEg=="}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:19:05.506398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-3e32eeb9-0caf-4ba3-88d4-345793979945 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Getting quotas for project fdb09ba5bcfc4079b035a4cf4a96cace. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:19:05.514223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-3e32eeb9-0caf-4ba3-88d4-345793979945 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Getting quotas for user da85b6fdee584df18ba14a8ad8af7fea and project fdb09ba5bcfc4079b035a4cf4a96cace. Resources: {'key_pairs'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:19:05.544024 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3e32eeb9-0caf-4ba3-88d4-345793979945 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.309510 Aug 29 06:19:05.548815 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4061/8129] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 06:19:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:19:06.777358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-306256", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1310783540", "security_groups": [{"name": "tempest-secgroup-smoke-1192090259"}], "networks": [{"uuid": "48418bcd-f399-4227-a234-4eb4ddcf9858"}]}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:19:06.789684 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:19:06.790606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:19:06.903609 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.network.neutron [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] validate_networks() for [('48418bcd-f399-4227-a234-4eb4ddcf9858', None, None, None, None, None)] {{(pid=128871) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:19:07.307813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Flavor limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:19:07.308364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Image limits 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:19:07.308855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Flavor pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:19:07.309282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Image pref 0:0:0 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:19:07.309711 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.virt.hardware [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:19:07.320968 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:07.321473 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:07.321928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:07.322675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:07.323140 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:07.323667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:07.343317 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Getting quotas for project fdb09ba5bcfc4079b035a4cf4a96cace. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:19:07.349045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Getting quotas for user da85b6fdee584df18ba14a8ad8af7fea and project fdb09ba5bcfc4079b035a4cf4a96cace. Resources: {'ram', 'cores', 'instances'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:19:07.361936 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Going to run 1 instances... {{(pid=128871) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:19:07.364332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:19:07.411883 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3c697a5c-065f-4714-94ff-a385582eca8e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638745 Aug 29 06:19:07.412375 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4069/8130] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:19:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 06:19:07.429383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78d98626-37c1-4619-9a1b-f3a5db5e78d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:07.430096 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78d98626-37c1-4619-9a1b-f3a5db5e78d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:07.525776 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78d98626-37c1-4619-9a1b-f3a5db5e78d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:07.535569 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78d98626-37c1-4619-9a1b-f3a5db5e78d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1243 microversion: 2.1 time: 0.111159 Aug 29 06:19:07.540166 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4062/8131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:07 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1243 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:08.557007 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:08.558338 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:08.572328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:08.573674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:08.574406 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:08.575342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:08.576342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:08.576982 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:08.675637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:08.687848 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f480e62c-a1a6-491e-93e1-084a94255d9f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1295 microversion: 2.1 time: 0.135785 Aug 29 06:19:08.713101 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4070/8132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:08 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1295 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:09.712527 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:09.713251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:09.729830 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:09.730434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:09.730947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:09.731740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:09.732328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:09.732828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:10.039714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:10.053020 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-89485a12-c938-4c3c-b276-578fff79544e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1369 microversion: 2.1 time: 0.345478 Aug 29 06:19:10.053660 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4063/8133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:09 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1369 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:10.647118 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-06cba26f-0c9e-4457-a456-a6e4bf250963 req-af349d32-35ad-4483-9b73-33afa2517f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5608222f-5607-48be-b8c1-2dcd8ea8f176", "tag": "ad112d01-d2b8-4d86-a41f-3fa2fba93946"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:19:10.685387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-06cba26f-0c9e-4457-a456-a6e4bf250963 req-af349d32-35ad-4483-9b73-33afa2517f08 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:10.685908 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-06cba26f-0c9e-4457-a456-a6e4bf250963 req-af349d32-35ad-4483-9b73-33afa2517f08 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:10.686364 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-06cba26f-0c9e-4457-a456-a6e4bf250963 req-af349d32-35ad-4483-9b73-33afa2517f08 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:10.707529 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-06cba26f-0c9e-4457-a456-a6e4bf250963 req-af349d32-35ad-4483-9b73-33afa2517f08 service nova] Creating event network-changed:ad112d01-d2b8-4d86-a41f-3fa2fba93946 for instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 on n-h1-854119-9 Aug 29 06:19:10.712527 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-06cba26f-0c9e-4457-a456-a6e4bf250963 req-af349d32-35ad-4483-9b73-33afa2517f08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069069 Aug 29 06:19:10.713731 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4071/8134] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:19:11.074850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:11.075558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:11.083722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:11.084502 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:11.084954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:11.085666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:11.086121 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:11.086546 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:11.226828 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:11.234865 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5db9f5ec-9694-433f-8467-e0451734d006 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1369 microversion: 2.1 time: 0.164126 Aug 29 06:19:11.235445 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4064/8135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:11 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:12.257154 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:12.257877 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:12.265060 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:12.265560 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:12.266018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:12.266943 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:12.267382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:12.267832 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:12.464642 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:12.472662 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e52b106a-8fa5-4230-b564-cfeb8d2650ea tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1369 microversion: 2.1 time: 0.221062 Aug 29 06:19:12.473237 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4072/8136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:12 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:13.493874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:13.495292 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:13.506227 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:13.506733 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:13.507169 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:13.507880 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:13.508373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:13.508770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:13.709567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:13.717864 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-78ba9857-f104-468c-bbd0-b888b124d70e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1369 microversion: 2.1 time: 0.228249 Aug 29 06:19:13.718452 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4065/8137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:13 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1369 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:14.739490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:14.740223 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:14.747176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:14.747748 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:14.748287 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:14.749080 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:14.749608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:14.750101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:14.884686 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:14.893197 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0fe4332f-c578-4f87-be24-1964d7ce9370 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1369 microversion: 2.1 time: 0.157856 Aug 29 06:19:14.893861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4073/8138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:14 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:15.914374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:15.914938 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:15.922286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:15.923781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:15.923781 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:15.924106 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:15.924559 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:15.924977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:16.073167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:16.082085 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5d35be0f-2916-40c8-9499-0e35895f061b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1369 microversion: 2.1 time: 0.171628 Aug 29 06:19:16.100429 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-3ed4f233-119b-42f4-8820-4840afeae27b req-8aac1e66-1db4-4c96-916d-4a072cac7b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608222f-5607-48be-b8c1-2dcd8ea8f176", "name": "network-vif-plugged", "status": "completed", "tag": "ad112d01-d2b8-4d86-a41f-3fa2fba93946"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:19:16.107584 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4066/8139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:15 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1369 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:16.111346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ed4f233-119b-42f4-8820-4840afeae27b req-8aac1e66-1db4-4c96-916d-4a072cac7b5c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:16.111844 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ed4f233-119b-42f4-8820-4840afeae27b req-8aac1e66-1db4-4c96-916d-4a072cac7b5c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:16.112510 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-3ed4f233-119b-42f4-8820-4840afeae27b req-8aac1e66-1db4-4c96-916d-4a072cac7b5c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:16.124050 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-3ed4f233-119b-42f4-8820-4840afeae27b req-8aac1e66-1db4-4c96-916d-4a072cac7b5c service nova] Creating event network-vif-plugged:ad112d01-d2b8-4d86-a41f-3fa2fba93946 for instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 on n-h1-854119-9 Aug 29 06:19:16.129456 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-3ed4f233-119b-42f4-8820-4840afeae27b req-8aac1e66-1db4-4c96-916d-4a072cac7b5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 Aug 29 06:19:16.130434 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4074/8140] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:19:17.103321 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:17.103872 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:17.111100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:17.111585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:17.112013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:17.112737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:17.113183 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:17.113597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:17.251009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:17.259354 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a4ed0a33-f8c2-4064-9fc5-a3a8dd47850e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1369 microversion: 2.1 time: 0.160074 Aug 29 06:19:17.259898 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4067/8141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:17 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:18.279115 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:19:18.280013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:19:18.284637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:18.285372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:18.292785 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:18.293285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:18.293731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:18.294439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:18.294906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:18.295342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:18.434291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:18.442603 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-71b9cabc-2949-41fd-aefe-934ada2a4fd5 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1554 microversion: 2.1 time: 0.165364 Aug 29 06:19:18.443200 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4075/8142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:18 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:18.463221 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:19:18.463908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:19:18.465913 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:19:18.472675 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:18.473383 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:18.473887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:18.474649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:18.475166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:18.475663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:18.613061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:19:18.623289 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-55c40cd1-d486-430b-9006-0a00115dc3bb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1554 microversion: 2.1 time: 0.164017 Aug 29 06:19:18.623890 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4068/8143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:19:18 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:19:20.960774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-8c92b6e7-925a-4753-9b87-cbaec6642233 req-3157d5f8-50d0-4fe6-9ea5-92c4d9024d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5608222f-5607-48be-b8c1-2dcd8ea8f176", "tag": "ad112d01-d2b8-4d86-a41f-3fa2fba93946"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:19:20.972001 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8c92b6e7-925a-4753-9b87-cbaec6642233 req-3157d5f8-50d0-4fe6-9ea5-92c4d9024d2c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:19:20.972527 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8c92b6e7-925a-4753-9b87-cbaec6642233 req-3157d5f8-50d0-4fe6-9ea5-92c4d9024d2c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:19:20.972965 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-8c92b6e7-925a-4753-9b87-cbaec6642233 req-3157d5f8-50d0-4fe6-9ea5-92c4d9024d2c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:19:20.985382 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-8c92b6e7-925a-4753-9b87-cbaec6642233 req-3157d5f8-50d0-4fe6-9ea5-92c4d9024d2c service nova] Creating event network-changed:ad112d01-d2b8-4d86-a41f-3fa2fba93946 for instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 on n-h1-854119-9 Aug 29 06:19:20.990886 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-8c92b6e7-925a-4753-9b87-cbaec6642233 req-3157d5f8-50d0-4fe6-9ea5-92c4d9024d2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108348 Aug 29 06:19:20.991559 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4076/8144] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:21:47.687435 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 06:21:47.688551 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0fdfc1a5-fcdd-4106-99be-9e46d6a37d4e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 06:21:47.689218 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:21:47.690203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=36 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:21:47.690941 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:21:47.691088 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176/action (ip 10.222.0.20) !!! Aug 29 06:21:47.692289 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:21:47.692442 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176/action (ip 10.222.0.20) !!! Aug 29 06:21:47.693860 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:21:47.694037 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176/action (ip 10.222.0.20) !!! Aug 29 06:21:47.698374 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:21:47.698912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:47.710829 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:47.711601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:47.712340 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:47.713268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:47.713751 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:47.714171 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:47.742425 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lazy-loading 'flavor' on Instance uuid 5608222f-5607-48be-b8c1-2dcd8ea8f176 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:21:47.944326 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-56b9eae8-3726-445d-9ba0-cd2f267a9c02 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "POST /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176/action" status: 202 len: 0 microversion: 2.1 time: 0.258628 Aug 29 06:21:47.944935 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4069/8145] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:21:47 2022] POST /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:21:47.951618 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:21:47.952558 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:21:47.953237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:21:47.954496 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=32 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:21:47.955501 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:21:47.955622 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 (ip 10.222.0.20) !!! Aug 29 06:21:47.957308 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:21:47.957308 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 (ip 10.222.0.20) !!! Aug 29 06:21:47.958285 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:21:47.958499 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 (ip 10.222.0.20) !!! Aug 29 06:21:47.965882 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:47.966636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:47.979262 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:47.979757 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:47.980847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:47.981008 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:47.981377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:47.981804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:48.125556 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:48.133665 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-53d712bf-15f8-4197-8450-a2d7f027e673 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.184007 Aug 29 06:21:48.134273 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4077/8146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:47 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:49.159650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:49.160261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:49.173088 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] [0fdfc1a5-fcdd-4106-99be-9e46d6a37d4e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50534. Aug 29 06:21:49.178383 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50532. Aug 29 06:21:49.181084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:49.181634 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:49.182065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:49.182754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:49.183204 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:49.183618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:49.331010 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:49.339330 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-621b485c-d0b9-4d24-8449-efe1a41ec7d2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.187888 Aug 29 06:21:49.339856 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4070/8147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:49 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:50.361265 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:50.361888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:50.380101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:50.380620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:50.381062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:50.381766 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:50.382224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:50.382655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:50.383277 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50538. Aug 29 06:21:50.387689 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50540. Aug 29 06:21:50.519739 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:50.527730 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3a3e216f-92ce-4e79-9a99-969fba8a95cd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.170565 Aug 29 06:21:50.528368 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4078/8148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:50 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:51.549671 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:51.550365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:51.557853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:51.558341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:51.558763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:51.559478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:51.559927 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:51.560505 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:51.703726 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:51.712018 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-41aaa942-23a5-4405-9eed-0df03bcc4704 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.167172 Aug 29 06:21:51.712751 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4071/8149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:51 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:52.733023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:52.733746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:52.741339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:52.741854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:52.742297 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:52.743021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:52.743483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:52.743918 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:52.883988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:52.892904 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6f025361-9930-470b-943c-c70efcd2dc0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.163771 Aug 29 06:21:52.893715 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4079/8150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:52 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:53.914902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:53.915627 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:53.923199 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:53.923696 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:53.924108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:53.924918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:53.925375 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:53.925808 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:54.067530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:54.075700 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bfdd0e33-5f66-4dd1-a41f-eb5b2c67f84b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.164983 Aug 29 06:21:54.076314 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4072/8151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:53 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:55.097733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:55.098290 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:55.105714 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:55.106215 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:55.106664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:55.107377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:55.107851 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:55.108325 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:55.244827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:55.253131 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-282f3600-86be-4389-a64c-7cc38f3a9d58 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.159510 Aug 29 06:21:55.253724 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4080/8152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:55 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:56.277576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:56.278192 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:56.285522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:56.286021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:56.286465 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:56.287175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:56.287626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:56.288051 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:56.424611 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:56.433093 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1bed3669-55e2-4b16-8d3f-f87b6fe5609f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.159515 Aug 29 06:21:56.433823 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4073/8153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:56 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:57.457278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:57.457869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:57.465459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:57.465964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:57.466415 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:57.467135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:57.467605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:57.468043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:57.611439 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:57.620258 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c694dc6b-4754-4a74-ad43-25b13f4f2744 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.167264 Aug 29 06:21:57.620858 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4081/8154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:57 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:58.642649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:58.643581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:58.651108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:58.651599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:58.652033 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:58.652770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:58.653222 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:58.653649 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:58.794119 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:58.802451 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-849c6138-7d72-45b4-8efd-d4189c8cbee8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.163798 Aug 29 06:21:58.803061 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4074/8155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:58 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:21:59.825067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:21:59.825620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:21:59.833390 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:59.833889 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:59.834332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:59.835041 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:21:59.835505 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:21:59.835938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:21:59.976557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:21:59.986781 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ad7225c-aa20-4262-86cc-2ca6887e3842 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1700 microversion: 2.1 time: 0.165700 Aug 29 06:21:59.989461 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4082/8156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:21:59 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1700 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:01.010887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:01.011490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:01.019663 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:01.020150 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:01.020613 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:01.021314 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:01.021757 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:01.022307 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:01.161124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:01.169923 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-81eec3ad-7dc3-4dca-84d2-9bc6baecc0d9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1700 microversion: 2.1 time: 0.163000 Aug 29 06:22:01.170714 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4075/8157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:01 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1700 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:02.191171 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:02.191772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:02.199362 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:02.199898 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:02.200387 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:02.201117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:02.201782 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:02.202268 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:02.349708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:02.358957 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0b52579f-8e1f-4ecd-82de-82659a58e752 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1700 microversion: 2.1 time: 0.171806 Aug 29 06:22:02.359539 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4083/8158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:02 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1700 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:03.380954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:03.381585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:03.389283 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:03.389798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:03.390234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:03.390952 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:03.391446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:03.391870 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:03.539988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:03.549712 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-a2d0a7b9-a9c7-41c2-961b-de86f32c0c55 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1700 microversion: 2.1 time: 0.172736 Aug 29 06:22:03.550516 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4076/8159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:03 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1700 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:04.571190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:04.571834 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:04.579708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:04.580243 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:04.580688 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:04.581434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:04.581906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:04.582341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:04.718706 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:04.727023 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1edf0702-304f-49a9-a1d3-e12a20457491 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1700 microversion: 2.1 time: 0.159769 Aug 29 06:22:04.727708 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4084/8160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:04 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:04.950727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0773b2df-b0bd-4ca1-bfe0-7a3c18eecd55 req-6deb124b-3e44-4d89-ba86-28a0a6f9423c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608222f-5607-48be-b8c1-2dcd8ea8f176", "name": "network-vif-plugged", "status": "completed", "tag": "ad112d01-d2b8-4d86-a41f-3fa2fba93946"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:22:04.966664 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0773b2df-b0bd-4ca1-bfe0-7a3c18eecd55 req-6deb124b-3e44-4d89-ba86-28a0a6f9423c service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:04.967134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0773b2df-b0bd-4ca1-bfe0-7a3c18eecd55 req-6deb124b-3e44-4d89-ba86-28a0a6f9423c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:04.967581 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0773b2df-b0bd-4ca1-bfe0-7a3c18eecd55 req-6deb124b-3e44-4d89-ba86-28a0a6f9423c service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:04.981231 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0773b2df-b0bd-4ca1-bfe0-7a3c18eecd55 req-6deb124b-3e44-4d89-ba86-28a0a6f9423c service nova] Creating event network-vif-plugged:ad112d01-d2b8-4d86-a41f-3fa2fba93946 for instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 on n-h1-854119-9 Aug 29 06:22:04.987810 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0773b2df-b0bd-4ca1-bfe0-7a3c18eecd55 req-6deb124b-3e44-4d89-ba86-28a0a6f9423c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041536 Aug 29 06:22:04.989195 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4077/8161] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:22:05.749862 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:05.751212 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:05.761282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:05.762153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:05.762880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:05.763995 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:05.764587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:05.765245 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:05.950743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:05.962628 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b273f0be-1fd5-4719-bb35-eb38621b39e6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1695 microversion: 2.1 time: 0.217693 Aug 29 06:22:05.963249 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4085/8162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:05 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1695 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:06.989798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:06.991309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:07.001619 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:07.002571 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:07.003276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:07.004255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:07.006859 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:07.007381 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:07.213370 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:07.222805 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-4212e532-6128-428e-b09f-fd2bb6f689f8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1695 microversion: 2.1 time: 0.242868 Aug 29 06:22:07.223500 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4078/8163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:06 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1695 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:08.250501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:08.251150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:08.264312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:08.264824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:08.265285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:08.265994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:08.266457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:08.266897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:08.490124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:08.503719 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e52b3907-7703-4c54-bed0-6d955d1bc968 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1695 microversion: 2.1 time: 0.256569 Aug 29 06:22:08.504558 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4086/8164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:08 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1695 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:09.526463 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:09.527069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:09.547215 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:09.548030 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:09.548680 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:09.549667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:09.552182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:09.554308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:09.744020 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:09.758545 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c85f699b-ff18-468d-94ba-80b25c659fcd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1695 microversion: 2.1 time: 0.235302 Aug 29 06:22:09.759892 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4079/8165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:09 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1695 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:10.791603 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:10.795193 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:10.808158 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:10.808666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:10.809120 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:10.809828 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:10.810418 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:10.811470 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:10.974945 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:10.984242 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5f5911d2-5a02-484e-907b-14a080b59f0a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1695 microversion: 2.1 time: 0.198999 Aug 29 06:22:10.985444 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4087/8166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:10 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:12.007384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:12.008047 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:12.020944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:12.023389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:12.024262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:12.026040 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:12.027034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:12.027034 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:12.208021 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:12.216658 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-866bbca0-07e5-4c80-a5bd-343e336d6dd1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1695 microversion: 2.1 time: 0.213827 Aug 29 06:22:12.231768 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4080/8167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:12 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1695 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:22:13.239619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:13.241841 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:13.252113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:13.253064 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:13.253763 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:13.254735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:13.255435 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:13.256314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:13.413655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:13.423431 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3e7e5771-d4dc-44c4-adb9-2aaced3ed6cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1695 microversion: 2.1 time: 0.188093 Aug 29 06:22:13.439721 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4088/8168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:13 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1695 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:14.448956 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:14.449848 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:14.461700 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:14.462208 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:14.462653 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:14.467837 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:14.468355 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:14.468793 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:14.634103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:14.643857 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f9f0d6e3-ba81-4ee4-aa66-8d8d29150c92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1695 microversion: 2.1 time: 0.199201 Aug 29 06:22:14.658334 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4081/8169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:14 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:15.666619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:15.667417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:15.675021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:15.675515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:15.675955 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:15.676702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:15.677157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:15.677587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:15.829738 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:15.843214 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-24b4d95b-33e0-4590-ae1f-7c074a2bb10a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1695 microversion: 2.1 time: 0.180685 Aug 29 06:22:15.844149 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4089/8170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:15 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:16.867373 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:16.867979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:16.877636 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:16.878124 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:16.878558 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:16.879310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:16.879766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:16.880229 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:17.027390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:17.035873 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06608c7e-9918-4f3c-b524-24db40fcce79 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1677 microversion: 2.1 time: 0.172567 Aug 29 06:22:17.036488 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4082/8171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:16 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:18.058765 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:18.059382 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:18.062423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=27 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:22:18.068919 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:18.069428 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:18.069901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:18.070632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:18.071168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:18.071648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:18.074808 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=79 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:22:18.223176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:18.231199 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-97ea172a-19fc-4568-8c4f-a407566813e4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1677 microversion: 2.1 time: 0.177342 Aug 29 06:22:18.231842 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4090/8172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:18 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:19.254006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:19.254697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:19.258601 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=29 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:22:19.263184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:19.263687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:19.264185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:19.264909 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:19.265388 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:19.265819 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:19.269262 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:22:19.418706 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:19.428628 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e06743ab-e624-44de-8711-cba3c87ff5fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1620 microversion: 2.1 time: 0.179995 Aug 29 06:22:19.429256 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4083/8173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:19 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1620 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:19.450873 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:22:19.451511 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:19.459249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:19.459753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:19.460232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:19.460949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:19.461417 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:19.461853 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:19.554491 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128871) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 06:22:19.629416 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f0e306fc-30fc-43ff-814a-e06c48e920da tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "POST /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176/action" status: 202 len: 0 microversion: 2.1 time: 0.182588 Aug 29 06:22:19.630224 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4091/8174] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:22:19 2022] POST /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 06:22:19.638687 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:19.639618 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:19.645847 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:19.646536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:19.646753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:19.647670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:19.648162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:19.648574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:19.798237 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:19.807207 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-411f5846-6869-42d9-a31f-acc83c5f7603 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1628 microversion: 2.1 time: 0.172363 Aug 29 06:22:19.812231 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4084/8175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:19 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1628 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:20.831896 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:20.832694 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:20.841950 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:20.842566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:20.843061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:20.843730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:20.844244 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:20.844662 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:21.015768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:21.027916 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f99d75b3-18b9-497a-8d02-17706f0d5021 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.201177 Aug 29 06:22:21.029255 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4092/8176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:20 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:21.034821 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c1c8f749-a878-45ae-bd7a-0699d795bf16 req-a053fc04-ec99-48d2-a975-2694c6506140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608222f-5607-48be-b8c1-2dcd8ea8f176", "name": "network-vif-unplugged", "status": "completed", "tag": "ad112d01-d2b8-4d86-a41f-3fa2fba93946"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:22:21.046380 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c1c8f749-a878-45ae-bd7a-0699d795bf16 req-a053fc04-ec99-48d2-a975-2694c6506140 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:21.048598 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c1c8f749-a878-45ae-bd7a-0699d795bf16 req-a053fc04-ec99-48d2-a975-2694c6506140 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:21.049127 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c1c8f749-a878-45ae-bd7a-0699d795bf16 req-a053fc04-ec99-48d2-a975-2694c6506140 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:21.062643 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c1c8f749-a878-45ae-bd7a-0699d795bf16 req-a053fc04-ec99-48d2-a975-2694c6506140 service nova] Creating event network-vif-unplugged:ad112d01-d2b8-4d86-a41f-3fa2fba93946 for instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 on n-h2-854119-9 Aug 29 06:22:21.068088 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c1c8f749-a878-45ae-bd7a-0699d795bf16 req-a053fc04-ec99-48d2-a975-2694c6506140 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116522 Aug 29 06:22:21.068805 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4085/8177] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:22:22.052625 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:22.053220 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:22.060911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:22.061404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:22.062048 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:22.063150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:22.063593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:22.064232 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:22.204648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:22.214138 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-86bf6d93-8b81-45b4-9296-29f0729d0a00 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.165411 Aug 29 06:22:22.214880 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4093/8178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:22 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:22.376438 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-509b6382-0842-4cf5-ae7a-3c422f888573 req-cd7f6836-1bd8-4ff6-aabd-909002963494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5608222f-5607-48be-b8c1-2dcd8ea8f176", "tag": "ad112d01-d2b8-4d86-a41f-3fa2fba93946"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:22:22.387835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-509b6382-0842-4cf5-ae7a-3c422f888573 req-cd7f6836-1bd8-4ff6-aabd-909002963494 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:22.388490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-509b6382-0842-4cf5-ae7a-3c422f888573 req-cd7f6836-1bd8-4ff6-aabd-909002963494 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:22.389048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-509b6382-0842-4cf5-ae7a-3c422f888573 req-cd7f6836-1bd8-4ff6-aabd-909002963494 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:22.402148 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-509b6382-0842-4cf5-ae7a-3c422f888573 req-cd7f6836-1bd8-4ff6-aabd-909002963494 service nova] Creating event network-changed:ad112d01-d2b8-4d86-a41f-3fa2fba93946 for instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 on n-h2-854119-9 Aug 29 06:22:22.409996 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-509b6382-0842-4cf5-ae7a-3c422f888573 req-cd7f6836-1bd8-4ff6-aabd-909002963494 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103071 Aug 29 06:22:22.410919 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4086/8179] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:22:23.237500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:23.238947 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:23.251332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:23.252870 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:23.254408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:23.255732 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:23.256723 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:23.258869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:23.520581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:23.532694 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-98b61bc2-6d7e-4d8d-80ba-d17c7bb40735 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.300311 Aug 29 06:22:23.533942 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4094/8180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:23 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:24.557151 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:24.558640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:24.565878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:24.566650 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:24.567274 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:24.568196 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:24.568814 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:24.569409 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:24.789641 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:24.804718 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2b5538e0-de46-49d4-bfd9-c6fe4df6a49f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.254134 Aug 29 06:22:24.805557 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4087/8181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:24 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:25.826777 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:25.827536 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:25.835861 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:25.836858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:25.837572 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:25.838564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:25.839256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:25.839927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:26.041013 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:26.050717 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-4cb6e6eb-6dbf-4f05-b22d-3825f1c6a33a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.227838 Aug 29 06:22:26.065241 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4095/8182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:25 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:27.073131 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:27.073727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:27.081544 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:27.082036 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:27.082480 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:27.083203 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:27.083908 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:27.084078 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:27.299780 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:27.308944 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-79e81d16-ec31-4dd3-88a9-23280dfd3efb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.239754 Aug 29 06:22:27.311940 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4088/8183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:27 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:28.333599 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:28.334269 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:28.348994 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:28.349507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:28.349956 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:28.350689 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:28.351157 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:28.351594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:28.572606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:28.581569 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7eb4a038-d4e7-4907-9333-25e21dd790a9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.253132 Aug 29 06:22:28.582496 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4096/8184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:28 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:29.609574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:29.610789 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:29.621783 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:29.622567 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:29.623308 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:29.624562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:29.625447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:29.626201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:29.800731 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:29.811285 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-0843a8b0-45c1-45c9-932c-4a8ccdb80957 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.207818 Aug 29 06:22:29.820856 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4089/8185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:29 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:30.832436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:30.833105 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:30.841331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:30.841838 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:30.842286 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:30.843043 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:30.843517 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:30.844014 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:30.998744 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:31.007146 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-09642a54-912d-4dea-825c-aefe5cfd61c7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.179187 Aug 29 06:22:31.007745 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4097/8186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:30 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:32.031686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:32.032698 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:32.040498 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:32.041003 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:32.041447 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:32.042194 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:32.042647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:32.043075 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:32.224665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:32.235035 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa2e1851-becf-4078-aec5-b6b904e9e676 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.208311 Aug 29 06:22:32.235929 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4090/8187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:32 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:33.257813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:33.258611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:33.266272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:33.266783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:33.267225 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:33.267960 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:33.268452 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:33.268924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:33.418306 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:33.431369 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aa0a22a1-10cf-4d77-bc16-054ff4f7fa8c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.177791 Aug 29 06:22:33.431958 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4098/8188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:33 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:34.454958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:34.455728 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:34.464101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:34.464639 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:34.465107 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:34.465884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:34.466339 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:34.466801 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:34.615109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:34.623551 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-81994260-ddec-4cb5-8a9f-1fd877eb4b61 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.173738 Aug 29 06:22:34.624208 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4091/8189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:34 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:35.656398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:35.657730 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:35.665360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:35.665992 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:35.666651 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:35.668011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:35.668973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:35.669608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:35.903880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:35.923436 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8140dbfb-e4d4-4c92-91ff-984df65840aa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.275828 Aug 29 06:22:35.937002 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4099/8190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:35 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:36.948141 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:36.948843 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:36.957707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:36.958329 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:36.958841 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:36.959676 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:36.960252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:36.960732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:37.129337 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:37.139432 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-58b5766e-5dad-4502-bc5a-3e02e94ef6bf tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.196057 Aug 29 06:22:37.140667 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4092/8191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:36 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:37.655586 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-c1ef7a19-1228-44ad-8e38-7526f7d44430 req-590761fc-ab2e-4c62-94c9-0bc54edfa09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608222f-5607-48be-b8c1-2dcd8ea8f176", "name": "network-vif-plugged", "status": "completed", "tag": "ad112d01-d2b8-4d86-a41f-3fa2fba93946"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:22:37.667224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c1ef7a19-1228-44ad-8e38-7526f7d44430 req-590761fc-ab2e-4c62-94c9-0bc54edfa09f service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:37.668111 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c1ef7a19-1228-44ad-8e38-7526f7d44430 req-590761fc-ab2e-4c62-94c9-0bc54edfa09f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:37.668829 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-c1ef7a19-1228-44ad-8e38-7526f7d44430 req-590761fc-ab2e-4c62-94c9-0bc54edfa09f service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:37.685809 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-c1ef7a19-1228-44ad-8e38-7526f7d44430 req-590761fc-ab2e-4c62-94c9-0bc54edfa09f service nova] Creating event network-vif-plugged:ad112d01-d2b8-4d86-a41f-3fa2fba93946 for instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 on n-h2-854119-9 Aug 29 06:22:37.699579 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-c1ef7a19-1228-44ad-8e38-7526f7d44430 req-590761fc-ab2e-4c62-94c9-0bc54edfa09f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047312 Aug 29 06:22:37.700996 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4100/8192] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:22:38.162398 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:38.164015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:38.172874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:38.173371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:38.183670 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:38.184709 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:38.185328 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:38.185689 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:38.344271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:38.353431 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-28266e41-a279-4edd-a804-48ab65e29b0c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.195126 Aug 29 06:22:38.354086 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4093/8193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:38 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:39.380172 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:39.380957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:39.390125 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:39.391058 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:39.398028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:39.398848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:39.399422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:39.399904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:39.587109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:39.596240 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e50c18c7-f455-4f64-8758-73ace763a039 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1686 microversion: 2.1 time: 0.222678 Aug 29 06:22:39.596783 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4101/8194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:39 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1686 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:22:40.624509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:22:40.625145 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:22:40.632904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:40.633536 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:40.633999 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:40.634736 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:22:40.635207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:22:40.635629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:22:40.781816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:22:40.790972 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa413a51-5359-403d-9d53-4a307acfa84e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1673 microversion: 2.1 time: 0.170382 Aug 29 06:22:40.791599 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4094/8195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:22:40 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:24:27.484078 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:24:27.484887 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:24:27.495850 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=23 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:24:27.497959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=63 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:24:27.500975 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:27.501476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:27.513802 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:27.514605 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:27.515312 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:27.516156 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:27.516708 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:27.517236 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:27.548906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:24:27.609954 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-5e799d5a-c5fa-4c81-82ec-7fc8190decea req-23dfd135-f275-41c5-8b52-40a457aafa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5608222f-5607-48be-b8c1-2dcd8ea8f176", "tag": "ad112d01-d2b8-4d86-a41f-3fa2fba93946"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:24:27.625968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5e799d5a-c5fa-4c81-82ec-7fc8190decea req-23dfd135-f275-41c5-8b52-40a457aafa17 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:27.627922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5e799d5a-c5fa-4c81-82ec-7fc8190decea req-23dfd135-f275-41c5-8b52-40a457aafa17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:27.628968 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-5e799d5a-c5fa-4c81-82ec-7fc8190decea req-23dfd135-f275-41c5-8b52-40a457aafa17 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:27.666197 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-5e799d5a-c5fa-4c81-82ec-7fc8190decea req-23dfd135-f275-41c5-8b52-40a457aafa17 service nova] Creating event network-changed:ad112d01-d2b8-4d86-a41f-3fa2fba93946 for instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 on n-h2-854119-9 Aug 29 06:24:27.671087 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ecc30149-80c5-4332-8ee8-7ab8d2b270e1 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 204 len: 0 microversion: 2.1 time: 0.188830 Aug 29 06:24:27.672173 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4102/8196] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:24:27 2022] DELETE /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:24:27.673995 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-5e799d5a-c5fa-4c81-82ec-7fc8190decea req-23dfd135-f275-41c5-8b52-40a457aafa17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186888 Aug 29 06:24:27.674707 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4095/8197] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:24:27.681998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:27.682886 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:27.689482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:27.689990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:27.690543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:27.691464 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:27.692167 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:27.692660 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:27.883112 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:24:27.892087 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8d6b8587-6c65-4115-a031-1543813de048 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.214439 Aug 29 06:24:27.892924 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4103/8198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:27 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:24:28.916832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:28.917542 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:28.924264 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:28.924763 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:28.925220 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:28.925935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:28.926390 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:28.926823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:29.116422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:24:29.125532 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2780852f-8887-48ec-90c1-84c4518d9ec7 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1679 microversion: 2.1 time: 0.214532 Aug 29 06:24:29.126284 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4096/8199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:28 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:24:29.699050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-6f08ed22-e2e3-4fc7-bdce-ad236b1e4f99 req-da8d2f52-918b-4663-9e90-110819598170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608222f-5607-48be-b8c1-2dcd8ea8f176", "name": "network-vif-deleted", "tag": "ad112d01-d2b8-4d86-a41f-3fa2fba93946"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:24:29.718469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6f08ed22-e2e3-4fc7-bdce-ad236b1e4f99 req-da8d2f52-918b-4663-9e90-110819598170 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:29.718969 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6f08ed22-e2e3-4fc7-bdce-ad236b1e4f99 req-da8d2f52-918b-4663-9e90-110819598170 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:29.719411 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-6f08ed22-e2e3-4fc7-bdce-ad236b1e4f99 req-da8d2f52-918b-4663-9e90-110819598170 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:29.731942 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-6f08ed22-e2e3-4fc7-bdce-ad236b1e4f99 req-da8d2f52-918b-4663-9e90-110819598170 service nova] Creating event network-vif-deleted:ad112d01-d2b8-4d86-a41f-3fa2fba93946 for instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 on n-h2-854119-9 Aug 29 06:24:29.737958 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-6f08ed22-e2e3-4fc7-bdce-ad236b1e4f99 req-da8d2f52-918b-4663-9e90-110819598170 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042690 Aug 29 06:24:29.738947 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4104/8200] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:24:30.151018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:30.156875 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:30.165862 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:30.166766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:30.167391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:30.168319 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:30.168930 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:30.169431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:30.217803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:30.218697 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:30.219378 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:30.219835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.objects.instance [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lazy-loading 'fault' on Instance uuid 5608222f-5607-48be-b8c1-2dcd8ea8f176 {{(pid=128872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:24:30.269120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:24:30.288730 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5e9a4c0a-29f9-4491-843e-24f65cbbfa47 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 200 len: 1333 microversion: 2.1 time: 0.145432 Aug 29 06:24:30.289333 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4097/8201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:30 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 1333 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:24:31.326805 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:31.327531 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: 5608222f-5607-48be-b8c1-2dcd8ea8f176] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:31.334573 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:31.335061 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:31.335498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:31.336199 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:31.336717 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:31.337144 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:31.352054 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] HTTP exception thrown: Instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 could not be found. Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Request method failure captured: Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 HTTP/1.1 Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFpTXNcYIDah-8BxRnjpEe6-CtZmE9a1yAoP1O2qExzFxJTAm7b-Ga0rmcMrWxWbh3Lmahx8MlEdKM2-mxKZF9eNCK2Eppi_4kJmxD8ktw1jm8Cwnw4iIIebNewguuA-eJ8XK5hqtWZzwnmSiJyu6hHLxCNHdKUEwgWZrJX2shPdomo Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fdb09ba5bcfc4079b035a4cf4a96cace Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestShelveInstance-2012211595 Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdb09ba5bcfc4079b035a4cf4a96cace"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fdb09ba5bcfc4079b035a4cf4a96cace"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fdb09ba5bcfc4079b035a4cf4a96cace", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdb09ba5bcfc4079b035a4cf4a96cace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestShelveInstance-2012211595 Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fdb09ba5bcfc4079b035a4cf4a96cace Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestShelveInstance-2012211595 Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestShelveInstance-2012211595-project Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da85b6fdee584df18ba14a8ad8af7fea Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestShelveInstance-2012211595-project Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 could not be found. Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '5608222f-5607-48be-b8c1-2dcd8ea8f176'} Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 could not be found. Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 could not be found. Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:24:31.352824 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 could not be found. Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Returning 404 to user: Instance 5608222f-5607-48be-b8c1-2dcd8ea8f176 could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b80108e8-2513-4315-a075-06c7fb4b0d38 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176" status: 404 len: 111 microversion: 2.1 time: 0.032795 Aug 29 06:24:31.359147 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4105/8202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:31 2022] GET /compute/v2.1/servers/5608222f-5607-48be-b8c1-2dcd8ea8f176 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:24:31.534360 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-400541c2-d886-4d96-9f67-af5421d0ba19 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '.version_select at 0x7f1ab8a1f8b0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:31.585203 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-400541c2-d886-4d96-9f67-af5421d0ba19 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1310783540" status: 202 len: 0 microversion: 2.1 time: 0.054467 Aug 29 06:24:31.585713 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4098/8203] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Aug 29 06:24:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1310783540 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:24:31.610944 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c2d836c2-755c-4f2b-b3ca-ef1422efa2b4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Action: 'create', calling method: .version_select at 0x7f1aba3fc4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-662054780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBpdkNf0xDXXnZkEsb53ZaGKX0aqOxmI2+Qbltg6LhEumZ+lE/WO+u8MG7heyekwKJnmbaLyxdf0QDx9oAmcLQoyZ0lQ2b83ttNBP2t3TMRHIDJiuyncZ5kdmeMeLZ2Cw=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:24:31.645320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c2d836c2-755c-4f2b-b3ca-ef1422efa2b4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Getting quotas for project fdb09ba5bcfc4079b035a4cf4a96cace. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:24:31.645320 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c2d836c2-755c-4f2b-b3ca-ef1422efa2b4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Getting quotas for user da85b6fdee584df18ba14a8ad8af7fea and project fdb09ba5bcfc4079b035a4cf4a96cace. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:24:31.665777 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c2d836c2-755c-4f2b-b3ca-ef1422efa2b4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.058829 Aug 29 06:24:31.666733 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4106/8204] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 06:24:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:24:51.409238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=16 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:24:51.410028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:24:51.418979 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2035570982", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-662054780", "security_groups": [{"name": "tempest-secgroup-smoke-92218328"}], "networks": [{"uuid": "48418bcd-f399-4227-a234-4eb4ddcf9858"}], "block_device_mapping_v2": [{"uuid": "5f6576f1-c901-4b0a-959f-d39b27f4bcbc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:24:51.553248 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] validate_networks() for [('48418bcd-f399-4227-a234-4eb4ddcf9858', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:24:52.052753 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:24:52.053186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:24:52.053668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:24:52.054084 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:24:52.054497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:24:52.065640 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:52.066129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:52.066572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:52.067368 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:52.068255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:52.068833 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:52.097358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Getting quotas for project fdb09ba5bcfc4079b035a4cf4a96cace. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:24:52.104616 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Getting quotas for user da85b6fdee584df18ba14a8ad8af7fea and project fdb09ba5bcfc4079b035a4cf4a96cace. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:24:52.188666 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:24:52.191170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f6576f1-c901-4b0a-959f-d39b27f4bcbc',volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:24:52.344001 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [05f2c482-1823-4261-9371-881ccd7ed857] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:24:53.352620 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [05f2c482-1823-4261-9371-881ccd7ed857] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51006. Aug 29 06:24:53.357293 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-880e3b8d-27e0-452b-a718-5df45b8e2090 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.949856 Aug 29 06:24:53.358230 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4099/8205] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:24:51 2022] POST /compute/v2.1/servers => generated 404 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 06:24:53.367893 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:24:53.370075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:24:53.370958 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:24:53.375592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1c7c8b0a-3f22-472c-a904-e62dde97176a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:53.376747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1c7c8b0a-3f22-472c-a904-e62dde97176a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:53.445954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1c7c8b0a-3f22-472c-a904-e62dde97176a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:24:53.457376 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1c7c8b0a-3f22-472c-a904-e62dde97176a tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1088 microversion: 2.1 time: 0.091602 Aug 29 06:24:53.458608 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4107/8206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:53 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1088 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:24:54.480365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:54.480962 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:54.487350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:54.487823 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:54.488311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:54.489007 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:54.489486 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:54.489900 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:54.564869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:24:54.574328 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-84e64cbe-f1bf-44e9-ba25-ac31ceffd7de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1186 microversion: 2.1 time: 0.098928 Aug 29 06:24:54.598652 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4100/8207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:54 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1186 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:24:55.606963 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:55.607594 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:55.619500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:55.620009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:55.620495 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:55.621214 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:55.621678 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:55.622119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:55.973023 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:24:55.982200 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2be1bb88-e706-47c6-80b9-7cd8bc9df592 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1270 microversion: 2.1 time: 0.378745 Aug 29 06:24:55.983115 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4108/8208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:55 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1270 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:24:56.231305 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-ab12439d-a835-436c-b141-29cf736bb754 req-f491e986-1366-4330-86e6-5bc082cf42c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9534748-fc92-4c24-a65c-ae57474a68ab", "tag": "f3ec7aae-1334-4a12-b220-52d17bec51a5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:24:56.275771 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ab12439d-a835-436c-b141-29cf736bb754 req-f491e986-1366-4330-86e6-5bc082cf42c3 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:56.277109 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ab12439d-a835-436c-b141-29cf736bb754 req-f491e986-1366-4330-86e6-5bc082cf42c3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:56.277877 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-ab12439d-a835-436c-b141-29cf736bb754 req-f491e986-1366-4330-86e6-5bc082cf42c3 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:56.325013 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-ab12439d-a835-436c-b141-29cf736bb754 req-f491e986-1366-4330-86e6-5bc082cf42c3 service nova] Creating event network-changed:f3ec7aae-1334-4a12-b220-52d17bec51a5 for instance d9534748-fc92-4c24-a65c-ae57474a68ab on n-h1-854119-9 Aug 29 06:24:56.331593 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-ab12439d-a835-436c-b141-29cf736bb754 req-f491e986-1366-4330-86e6-5bc082cf42c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104251 Aug 29 06:24:56.332885 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4101/8209] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:24:57.006098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:57.007818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:57.018357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:57.019687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:57.020528 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:57.021487 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:57.022224 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:57.022888 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:57.297093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:24:57.310740 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-236d0c5a-2891-43a9-96f6-558a37d926ec tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1270 microversion: 2.1 time: 0.308812 Aug 29 06:24:57.321790 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4109/8210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:57 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1270 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:24:58.336876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:58.337681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:58.345955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:58.345955 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:58.347575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:58.347575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:58.347575 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:58.347869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:58.518354 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:24:58.530140 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1854f508-8736-45d7-90b8-2d70c4535458 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1270 microversion: 2.1 time: 0.197719 Aug 29 06:24:58.531517 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4102/8211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:58 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:24:59.552854 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:24:59.555569 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:24:59.562899 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:59.563476 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:59.563952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:59.564653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:24:59.565110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:24:59.565537 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:24:59.725017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:24:59.733448 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bd641b26-2fd6-415f-85b7-124baa83c868 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1270 microversion: 2.1 time: 0.186185 Aug 29 06:24:59.734082 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4110/8212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:24:59 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:00.755595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:00.756267 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:00.764187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:00.764681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:00.765326 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:00.766044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:00.766508 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:00.766918 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:00.903982 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:00.912538 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1ef06b84-b1d7-4a94-a882-3527d288a3bc tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.161038 Aug 29 06:25:00.913318 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4103/8213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:00 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:01.936733 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:01.937345 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:01.944133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:01.944645 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:01.945084 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:01.945804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:01.946264 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:01.946691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:02.103904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:02.112433 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d5ee56a7-d1ee-408d-819c-f4a7c6255dde tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.182135 Aug 29 06:25:02.113125 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4111/8214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:01 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:03.147646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:03.148534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:03.151914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:25:03.152683 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:25:03.159265 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:03.159748 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:03.160310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:03.161011 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:03.161464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:03.161867 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:03.300994 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:03.309283 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6d7aa84f-b707-4002-b796-21b82dcedbad tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.166036 Aug 29 06:25:03.309911 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4104/8215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:03 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:04.331489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:04.332100 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:04.336335 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:25:04.340392 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:04.340901 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:04.341350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:04.342076 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:04.342542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:04.342977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:04.480046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:04.490352 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-021d7fb1-584d-453c-a659-0412b05d731b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.163150 Aug 29 06:25:04.490954 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4112/8216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:04 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:05.511180 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:05.511754 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:05.519382 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:05.519876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:05.520350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:05.521061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:05.521520 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:05.521947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:05.673303 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:05.681493 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-adee48b9-b6e5-4743-86cd-f0a2fd2f5429 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.174308 Aug 29 06:25:05.682085 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4105/8217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:05 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:06.703000 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:06.703584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:06.711366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:06.711865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:06.712471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:06.713191 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:06.713646 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:06.714079 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:06.848009 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:06.856490 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-50719e59-bf0b-43f7-a184-4196f9b3a5e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.157430 Aug 29 06:25:06.857040 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4113/8218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:06 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:07.877714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:07.878456 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:07.886157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:07.886725 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:07.887234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:07.887940 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:07.888457 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:07.888884 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:08.026642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:08.034633 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-c3a0218a-3879-4a3a-9129-0ce490d03baa tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.160885 Aug 29 06:25:08.035187 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4106/8219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:07 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:09.056028 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:09.056752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:09.064219 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:09.064695 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:09.065124 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:09.065825 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:09.066285 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:09.066718 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:09.203608 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:09.212321 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-afcae76d-4cad-49e4-a8e5-656d909be362 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.160397 Aug 29 06:25:09.212983 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4114/8220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:09 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:10.235281 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:10.236016 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:10.243367 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:10.244071 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:10.244762 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:10.245574 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:10.246027 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:10.246592 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:10.386187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:10.394920 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-2943d0ad-d427-40ff-a30a-42c29de37bd4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.164073 Aug 29 06:25:10.395513 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4107/8221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:10 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:11.415976 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:11.416631 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:11.423845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:11.424384 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:11.424833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:11.425539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:11.426004 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:11.426440 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:11.567637 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:11.575851 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-810a02af-0789-4581-bcf3-e5ea9d493381 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.164006 Aug 29 06:25:11.576551 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4115/8222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:11 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:11.856893 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-8b449b46-9c5f-4cdc-acc7-d783faac2470 req-846e1ae7-eb27-4418-b43c-f4918b8a7a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9534748-fc92-4c24-a65c-ae57474a68ab", "name": "network-vif-plugged", "status": "completed", "tag": "f3ec7aae-1334-4a12-b220-52d17bec51a5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:25:11.867966 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b449b46-9c5f-4cdc-acc7-d783faac2470 req-846e1ae7-eb27-4418-b43c-f4918b8a7a0b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:11.868600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b449b46-9c5f-4cdc-acc7-d783faac2470 req-846e1ae7-eb27-4418-b43c-f4918b8a7a0b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:11.869094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-8b449b46-9c5f-4cdc-acc7-d783faac2470 req-846e1ae7-eb27-4418-b43c-f4918b8a7a0b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:11.883704 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-8b449b46-9c5f-4cdc-acc7-d783faac2470 req-846e1ae7-eb27-4418-b43c-f4918b8a7a0b service nova] Creating event network-vif-plugged:f3ec7aae-1334-4a12-b220-52d17bec51a5 for instance d9534748-fc92-4c24-a65c-ae57474a68ab on n-h1-854119-9 Aug 29 06:25:11.889044 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-8b449b46-9c5f-4cdc-acc7-d783faac2470 req-846e1ae7-eb27-4418-b43c-f4918b8a7a0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036089 Aug 29 06:25:11.889711 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4108/8223] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:25:12.597588 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:12.598209 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:12.605424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:12.605930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:12.606380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:12.607176 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:12.607641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:12.608077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:12.754291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:12.762392 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6751a101-53a1-48ae-b8e0-d4503954b4cb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1258 microversion: 2.1 time: 0.168713 Aug 29 06:25:12.762985 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4116/8224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:12 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:13.785088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:13.785743 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:13.792988 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:13.793391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:13.793822 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:13.794519 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:13.794947 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:13.795364 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:13.938572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:13.947171 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa1e0485-d1dc-4c80-9a8d-85a5c6b03412 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1443 microversion: 2.1 time: 0.167408 Aug 29 06:25:13.947914 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4109/8225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:13 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1443 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:13.967977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:25:13.968636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:25:13.975683 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:13.976210 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:13.976658 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:13.977383 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:13.977845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:13.978327 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:14.129571 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:25:14.138315 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-45571732-620d-4de9-bcac-baee35d7db75 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1443 microversion: 2.1 time: 0.174206 Aug 29 06:25:14.139208 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4117/8226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:25:13 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:25:16.272018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-015a67b1-01b5-4ca7-bd3a-1fc68f10be88 req-01c4e709-69d0-4dfe-a8d6-696124b35145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9534748-fc92-4c24-a65c-ae57474a68ab", "tag": "f3ec7aae-1334-4a12-b220-52d17bec51a5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:25:16.283922 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-015a67b1-01b5-4ca7-bd3a-1fc68f10be88 req-01c4e709-69d0-4dfe-a8d6-696124b35145 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:25:16.284474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-015a67b1-01b5-4ca7-bd3a-1fc68f10be88 req-01c4e709-69d0-4dfe-a8d6-696124b35145 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:25:16.285017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-015a67b1-01b5-4ca7-bd3a-1fc68f10be88 req-01c4e709-69d0-4dfe-a8d6-696124b35145 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:25:16.297408 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-015a67b1-01b5-4ca7-bd3a-1fc68f10be88 req-01c4e709-69d0-4dfe-a8d6-696124b35145 service nova] Creating event network-changed:f3ec7aae-1334-4a12-b220-52d17bec51a5 for instance d9534748-fc92-4c24-a65c-ae57474a68ab on n-h1-854119-9 Aug 29 06:25:16.302907 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-015a67b1-01b5-4ca7-bd3a-1fc68f10be88 req-01c4e709-69d0-4dfe-a8d6-696124b35145 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034847 Aug 29 06:25:16.303876 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4110/8227] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:27:15.746536 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 06:27:15.748002 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 06:27:15.754819 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:27:15.755922 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:15.758737 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=24 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:27:15.759434 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=60 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:27:15.760496 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:27:15.761015 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab/action (ip 10.222.0.20) !!! Aug 29 06:27:15.763466 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:27:15.763671 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab/action (ip 10.222.0.20) !!! Aug 29 06:27:15.764734 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:27:15.764973 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab/action (ip 10.222.0.20) !!! Aug 29 06:27:15.780813 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:15.781416 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:15.781998 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:15.782666 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:15.783192 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:15.783713 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:15.819103 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.objects.instance [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lazy-loading 'flavor' on Instance uuid d9534748-fc92-4c24-a65c-ae57474a68ab {{(pid=128871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 29 06:27:15.911435 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-06f89d6f-af09-456f-80f5-19f8328b54f3 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "POST /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab/action" status: 202 len: 0 microversion: 2.1 time: 0.166714 Aug 29 06:27:15.912401 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4118/8228] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:27:15 2022] POST /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:27:15.925565 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:27:15.927001 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0fdfc1a5-fcdd-4106-99be-9e46d6a37d4e] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:27:15.928092 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:27:15.929511 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=56 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:27:15.932103 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:27:15.932359 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab (ip 10.222.0.20) !!! Aug 29 06:27:15.952060 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:15.953701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:15.967672 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:15.968052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:15.968864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:15.969723 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:15.970523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:15.970944 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:16.171932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:16.181784 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1a61c5ea-59ed-4bb7-817d-e61e925e92eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.263811 Aug 29 06:27:16.182527 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4111/8229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:15 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:17.216559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:17.217540 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:17.233477 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:17.234354 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:17.235067 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:17.236436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:17.236985 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:17.238653 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:17.252823 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51156. Aug 29 06:27:17.253658 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51154. Aug 29 06:27:17.474394 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:17.486078 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-96587a3a-cf1f-4b9a-94ac-83306e7b804f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.282595 Aug 29 06:27:17.487075 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4119/8230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:17 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:18.510749 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:18.511538 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:18.520853 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:18.521343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:18.521775 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:18.522533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:18.523207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:18.523533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:18.548167 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] [0fdfc1a5-fcdd-4106-99be-9e46d6a37d4e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51162. Aug 29 06:27:18.551772 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51160. Aug 29 06:27:18.677015 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:18.685942 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b6b39042-b4b9-4c62-9584-57115cb1218f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.179349 Aug 29 06:27:18.686562 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4112/8231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:18 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:19.713333 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:19.714311 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:19.724598 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:19.725543 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:19.725911 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:19.726664 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:19.727370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:19.727812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:19.889033 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:19.899218 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6bdd7daf-8331-4a9c-9135-7a33e55256eb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.192657 Aug 29 06:27:19.900155 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4120/8232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:19 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:20.924000 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:20.925093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:20.933864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:20.934556 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:20.935074 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:20.936200 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:20.936334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:20.936931 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:21.108981 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:21.123957 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-08e1abb5-b9d5-469d-8325-f9ed3da46eff tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.204047 Aug 29 06:27:21.125285 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4113/8233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:20 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:22.151775 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:22.152641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:22.169050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:22.169643 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:22.170117 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:22.170847 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:22.171302 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:22.171731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:22.337271 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:22.347099 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-78c95a29-e60b-4829-8f21-8e168962df18 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.199368 Aug 29 06:27:22.348409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4121/8234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:22 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:23.371817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:23.371817 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:23.386164 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:23.386788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:23.389268 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:23.391086 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:23.394605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:23.395318 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:23.572526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:23.581539 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d9a7406d-2339-437c-9caf-d31f4248bc92 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.215958 Aug 29 06:27:23.582151 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4114/8235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:23 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:24.603798 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:24.607661 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:24.616564 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:24.617567 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:24.618086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:24.618858 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:24.619315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:24.619747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:24.770935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:24.787551 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0129375a-610d-4d1c-b1d3-04654eb2e6fb tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.187706 Aug 29 06:27:24.788339 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4122/8236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:24 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:25.811987 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:25.813437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:25.824967 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:25.825644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:25.826101 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:25.827673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:25.828157 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:25.828597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:26.016166 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:26.028676 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-3f3cc3c4-a89e-4f8b-b7b5-2846889983e9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.220340 Aug 29 06:27:26.048497 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4115/8237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:25 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:27.063442 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:27.064404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:27.078869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:27.079710 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:27.080180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:27.080917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:27.081380 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:27.081811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:27.272467 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:27.286512 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8ccd3826-0573-4121-8559-9c18f3cac1c2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.230160 Aug 29 06:27:27.287980 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4123/8238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:27 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:28.311750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:28.312604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:28.320138 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:28.320838 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:28.321331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:28.321892 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:28.322311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:28.322764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:28.490849 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:28.502500 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8952dab8-fbd6-42b0-9148-4914ed41201b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.194530 Aug 29 06:27:28.503386 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4116/8239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:28 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:29.529824 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:29.531587 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:29.543395 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:29.544957 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:29.545580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:29.546550 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:29.547669 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:29.548454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:29.755972 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:29.767156 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-385b7a06-48b8-43b4-adf9-6b618eefc2d8 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.244271 Aug 29 06:27:29.768607 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4124/8240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:29 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:30.788638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:30.789285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:30.805249 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:30.805714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:30.806156 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:30.806864 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:30.807312 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:30.807713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:30.950481 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:30.958828 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-386ac4ad-385a-4d97-ad9a-d9ccc8d7edba tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.174110 Aug 29 06:27:30.959407 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4117/8241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:30 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:31.980790 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:31.981356 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:31.988925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:31.989414 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:31.989856 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:31.990600 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:31.991081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:31.991489 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:32.129254 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:32.137741 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-03ea4c19-e941-4cd6-bbbd-77ac20518ef6 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1509 microversion: 2.1 time: 0.161033 Aug 29 06:27:32.138329 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4125/8242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:31 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:32.160044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:27:32.160777 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:32.168245 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:32.169369 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:32.169811 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:32.170522 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:32.170971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:32.171494 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:32.228014 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128872) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 06:27:32.321362 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7e9926e-f191-4cba-90ee-7fd0c023e780 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "POST /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab/action" status: 202 len: 0 microversion: 2.1 time: 0.165338 Aug 29 06:27:32.325231 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4118/8243] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:27:32 2022] POST /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:27:32.335346 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:32.343850 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:32.358920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:32.359521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:32.365104 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:32.366162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:32.366812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:32.368729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:32.537667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-4f159cba-18f2-4a17-9602-29777277964d req-6b6f6c29-aa56-4b0f-9e63-a0a8bb7aa847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9534748-fc92-4c24-a65c-ae57474a68ab", "name": "network-vif-unplugged", "status": "completed", "tag": "f3ec7aae-1334-4a12-b220-52d17bec51a5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:27:32.576334 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:32.577788 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4f159cba-18f2-4a17-9602-29777277964d req-6b6f6c29-aa56-4b0f-9e63-a0a8bb7aa847 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:32.578621 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4f159cba-18f2-4a17-9602-29777277964d req-6b6f6c29-aa56-4b0f-9e63-a0a8bb7aa847 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:32.580707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-4f159cba-18f2-4a17-9602-29777277964d req-6b6f6c29-aa56-4b0f-9e63-a0a8bb7aa847 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:32.587654 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d7b22815-b347-4bd9-94b3-01cee413e3fe tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1517 microversion: 2.1 time: 0.256293 Aug 29 06:27:32.588850 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4126/8244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:32 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:32.600607 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.compute.server_external_events [req-4f159cba-18f2-4a17-9602-29777277964d req-6b6f6c29-aa56-4b0f-9e63-a0a8bb7aa847 service nova] Unable to find a host for instance d9534748-fc92-4c24-a65c-ae57474a68ab. Dropping event network-vif-unplugged {{(pid=128872) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 06:27:32.600607 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-4f159cba-18f2-4a17-9602-29777277964d req-6b6f6c29-aa56-4b0f-9e63-a0a8bb7aa847 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.215791 Aug 29 06:27:32.600975 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4119/8245] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 217 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 06:27:33.615232 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:33.617046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:33.626028 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:33.626526 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:33.626959 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:33.627673 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:33.628149 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:33.628572 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:33.771255 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:33.780977 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-53a8990b-9f44-4c94-99f0-c51bde3c4889 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1519 microversion: 2.1 time: 0.173345 Aug 29 06:27:33.782160 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4120/8246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:33 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:34.809640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:34.811057 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:34.823240 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:34.824289 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:34.825207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:34.826507 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:34.827402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:34.828283 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:34.991492 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:35.000640 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-579a50b7-d893-46d1-b9d1-17c3ca540a8d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1519 microversion: 2.1 time: 0.198008 Aug 29 06:27:35.001597 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4127/8247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:34 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:36.023583 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:36.024359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:36.031669 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:36.032162 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:36.032605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:36.033310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:36.033760 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:36.034178 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:36.180405 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:36.189504 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-6a260d91-c4cc-49a3-b5a8-5e8a8fa4f678 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1519 microversion: 2.1 time: 0.171129 Aug 29 06:27:36.190088 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4121/8248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:36 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:37.213095 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:37.214670 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:37.222186 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:37.223077 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:37.223772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:37.225044 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:37.225784 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:37.226501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:37.389398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:37.399735 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-49ce59ea-bbe2-4175-abbe-8854b7688abd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1519 microversion: 2.1 time: 0.191581 Aug 29 06:27:37.412981 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4128/8249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:37 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:38.424755 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:38.426244 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:38.436009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:38.437211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:38.437521 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:38.438297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:38.439088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:38.439912 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:38.607069 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:38.616638 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e97d9a74-1c4a-4645-8e1e-ecf473a3696f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1519 microversion: 2.1 time: 0.197436 Aug 29 06:27:38.617271 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4122/8250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:38 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:39.638827 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:39.639458 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:39.646772 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:39.647350 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:39.647869 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:39.649267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:39.650068 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:39.651045 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:39.967469 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:39.978003 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-26cefe76-e751-4bad-bdcf-dad6017f1351 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.343465 Aug 29 06:27:39.979019 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4129/8251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:39 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:40.193998 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-db4466fa-4948-42bc-b8b4-d392b0beabea req-ce352e6c-280d-4443-b2c9-63c52d68d608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9534748-fc92-4c24-a65c-ae57474a68ab", "tag": "f3ec7aae-1334-4a12-b220-52d17bec51a5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:27:40.208223 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-db4466fa-4948-42bc-b8b4-d392b0beabea req-ce352e6c-280d-4443-b2c9-63c52d68d608 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:40.208874 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-db4466fa-4948-42bc-b8b4-d392b0beabea req-ce352e6c-280d-4443-b2c9-63c52d68d608 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:40.209523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-db4466fa-4948-42bc-b8b4-d392b0beabea req-ce352e6c-280d-4443-b2c9-63c52d68d608 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:40.222270 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-db4466fa-4948-42bc-b8b4-d392b0beabea req-ce352e6c-280d-4443-b2c9-63c52d68d608 service nova] Creating event network-changed:f3ec7aae-1334-4a12-b220-52d17bec51a5 for instance d9534748-fc92-4c24-a65c-ae57474a68ab on n-h2-854119-9 Aug 29 06:27:40.228714 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-db4466fa-4948-42bc-b8b4-d392b0beabea req-ce352e6c-280d-4443-b2c9-63c52d68d608 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038680 Aug 29 06:27:40.229373 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4123/8252] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:27:41.007475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:41.008833 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:41.020656 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:41.021425 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:41.022182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:41.023398 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:41.023986 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:41.024457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:41.162788 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:41.170982 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-b40082c5-0337-4d13-8517-ea0ebc7bbe6f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.169991 Aug 29 06:27:41.171785 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4130/8253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:40 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:42.198470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:42.198470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:42.207629 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:42.208212 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:42.208712 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:42.209533 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:42.210261 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:42.210493 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:42.443604 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:42.452599 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bc5eabc8-43a8-43b2-ad36-c4c47700e091 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.263386 Aug 29 06:27:42.453202 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4124/8254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:42 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:43.478299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:43.479133 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:43.487024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:43.487534 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:43.488024 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:43.488753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:43.489228 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:43.489673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:43.627585 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:43.636095 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f4af2c3c-1c02-4d17-a861-0782be2b844e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.165632 Aug 29 06:27:43.636740 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4131/8255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:43 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:44.658105 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:44.658752 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:44.667702 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:44.668238 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:44.668707 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:44.669524 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:44.669986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:44.670401 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:44.809904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:44.818165 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-cc53dddb-0b70-43c5-98af-488be551f94b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.164023 Aug 29 06:27:44.818763 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4125/8256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:44 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:45.839940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:45.840566 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:45.843410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=33 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:27:45.848930 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:45.849437 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:45.849928 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:45.850611 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:45.851101 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:45.851579 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:45.854628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:27:45.997256 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:46.005942 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-0267631f-d769-42b1-b67b-02d7346b3a2f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.170002 Aug 29 06:27:46.006643 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4132/8257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:45 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:47.027402 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:47.027970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:47.031001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:27:47.047576 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:47.048063 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:47.049441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:47.050186 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:47.050646 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:47.051080 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:47.054617 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:27:47.196065 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:47.204566 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-61f0b91f-feb2-4eee-a53a-47352a178ef2 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.180973 Aug 29 06:27:47.205151 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4126/8258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:47 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:48.226337 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:48.227386 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:48.233791 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:48.234295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:48.234743 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:48.235457 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:48.235924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:48.236393 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:48.369166 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:48.377494 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-9b080b3a-f062-4e54-bf5b-6d8d6d26bf89 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.155198 Aug 29 06:27:48.391660 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4133/8259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:48 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:49.400104 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:49.400971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:49.407950 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:49.408506 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:49.408977 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:49.409681 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:49.410143 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:49.410550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:49.552001 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:49.561567 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-bbf5ad0e-aba7-4ec3-9d46-bf5573e49fbd tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.165844 Aug 29 06:27:49.562178 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4127/8260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:49 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:50.583500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:50.584173 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:50.591949 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:50.592508 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:50.592924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:50.593640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:50.594098 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:50.594525 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:50.733190 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:50.741844 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-d86256a5-b4e1-4810-b4c6-364dc438ec1c tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.162454 Aug 29 06:27:50.742427 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4134/8261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:50 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:51.763341 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:51.763876 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:51.771044 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:51.771534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:51.771963 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:51.772686 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:51.773170 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:51.773730 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:51.923225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:51.932105 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-e7103fa4-e714-469b-a8b3-09f8dc99e729 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.172740 Aug 29 06:27:51.933244 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4128/8262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:51 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:52.953977 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:52.955110 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:52.962756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:52.963275 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:52.963753 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:52.964482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:52.964974 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:52.965407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:53.106436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:53.115362 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ac310a9b-e3d7-4be8-a0e9-4463c041fb6d tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.165412 Aug 29 06:27:53.115949 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4135/8263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:52 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:53.441213 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-f3715ee6-a823-4f13-90cd-a0d1c2a248b4 req-1eb6fe0b-ec37-4467-ab8c-d3892a3ba715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9534748-fc92-4c24-a65c-ae57474a68ab", "name": "network-vif-plugged", "status": "completed", "tag": "f3ec7aae-1334-4a12-b220-52d17bec51a5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:27:53.454088 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f3715ee6-a823-4f13-90cd-a0d1c2a248b4 req-1eb6fe0b-ec37-4467-ab8c-d3892a3ba715 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:53.454971 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f3715ee6-a823-4f13-90cd-a0d1c2a248b4 req-1eb6fe0b-ec37-4467-ab8c-d3892a3ba715 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:53.455468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-f3715ee6-a823-4f13-90cd-a0d1c2a248b4 req-1eb6fe0b-ec37-4467-ab8c-d3892a3ba715 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:53.468318 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-f3715ee6-a823-4f13-90cd-a0d1c2a248b4 req-1eb6fe0b-ec37-4467-ab8c-d3892a3ba715 service nova] Creating event network-vif-plugged:f3ec7aae-1334-4a12-b220-52d17bec51a5 for instance d9534748-fc92-4c24-a65c-ae57474a68ab on n-h2-854119-9 Aug 29 06:27:53.473779 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-f3715ee6-a823-4f13-90cd-a0d1c2a248b4 req-1eb6fe0b-ec37-4467-ab8c-d3892a3ba715 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036952 Aug 29 06:27:53.474775 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4129/8264] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:27:54.136933 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:54.137549 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:54.144938 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:54.145436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:54.145881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:54.146584 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:54.147179 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:54.147620 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:54.295272 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:54.303885 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5eb9fe84-77bd-4bae-b968-77925f8afad9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1575 microversion: 2.1 time: 0.170880 Aug 29 06:27:54.304500 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4136/8265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:54 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:27:55.327557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:27:55.328291 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:27:55.335478 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:55.335974 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:55.336509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:55.337217 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:27:55.337667 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:27:55.338085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:27:55.523934 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:27:55.532331 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-05d6be01-219b-4e05-a2a6-ffce6a13a10b tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1562 microversion: 2.1 time: 0.210133 Aug 29 06:27:55.532919 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4130/8266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:27:55 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1562 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:15.000555 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=9 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:29:15.001285 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=25 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:29:15.004621 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:15.006183 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:15.008990 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=9 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:29:15.012774 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=29 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:29:15.014986 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-37024a91-6806-48ae-bcc7-cf08dc35dd7a req-fe2261d7-e884-4f53-bfa2-5b38d756e179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9534748-fc92-4c24-a65c-ae57474a68ab", "tag": "f3ec7aae-1334-4a12-b220-52d17bec51a5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:29:15.031261 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:15.031776 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:15.032291 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:15.033070 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:15.033544 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:15.033993 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:15.041214 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-37024a91-6806-48ae-bcc7-cf08dc35dd7a req-fe2261d7-e884-4f53-bfa2-5b38d756e179 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:15.042089 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-37024a91-6806-48ae-bcc7-cf08dc35dd7a req-fe2261d7-e884-4f53-bfa2-5b38d756e179 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:15.042534 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-37024a91-6806-48ae-bcc7-cf08dc35dd7a req-fe2261d7-e884-4f53-bfa2-5b38d756e179 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:15.065715 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-37024a91-6806-48ae-bcc7-cf08dc35dd7a req-fe2261d7-e884-4f53-bfa2-5b38d756e179 service nova] Creating event network-changed:f3ec7aae-1334-4a12-b220-52d17bec51a5 for instance d9534748-fc92-4c24-a65c-ae57474a68ab on n-h2-854119-9 Aug 29 06:29:15.074564 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-37024a91-6806-48ae-bcc7-cf08dc35dd7a req-fe2261d7-e884-4f53-bfa2-5b38d756e179 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075306 Aug 29 06:29:15.076811 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4131/8267] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:29:15.078991 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:29:15.197415 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-3c57d9e4-e064-4198-80ef-84c76e02e902 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 204 len: 0 microversion: 2.1 time: 0.204793 Aug 29 06:29:15.200440 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4137/8268] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:29:14 2022] DELETE /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:29:15.214201 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:15.215809 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:15.223703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:15.224585 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:15.225311 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:15.226211 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:15.226888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:15.227459 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:15.390415 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:15.400430 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-02f83a42-ef01-469d-bffa-6387a389f6de tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.194298 Aug 29 06:29:15.401041 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4132/8269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:15 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:16.428341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:16.428341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:16.433804 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:16.434370 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:16.434845 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:16.438735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:16.438735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:16.438735 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:16.658725 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:16.668793 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-56594d7d-c552-460d-8179-f22379e906d4 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1568 microversion: 2.1 time: 0.249214 Aug 29 06:29:16.669409 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4138/8270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:16 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:17.705640 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:17.706675 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:17.715237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:17.716153 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:17.716988 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:17.718562 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:17.719421 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:17.719964 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:17.812050 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:17.824167 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d6372f0-fde0-457c-aaa6-b803c3d15ef9 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1383 microversion: 2.1 time: 0.125649 Aug 29 06:29:17.825328 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4139/8271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:17 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1383 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:17.945436 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-9e918d70-59c0-4f38-baa9-685ad731dbc2 req-57cedff9-72ff-4a36-8e0b-81a675fe5b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9534748-fc92-4c24-a65c-ae57474a68ab", "name": "network-vif-deleted", "tag": "f3ec7aae-1334-4a12-b220-52d17bec51a5"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:29:17.959656 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9e918d70-59c0-4f38-baa9-685ad731dbc2 req-57cedff9-72ff-4a36-8e0b-81a675fe5b5a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:17.960620 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9e918d70-59c0-4f38-baa9-685ad731dbc2 req-57cedff9-72ff-4a36-8e0b-81a675fe5b5a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:17.961241 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-9e918d70-59c0-4f38-baa9-685ad731dbc2 req-57cedff9-72ff-4a36-8e0b-81a675fe5b5a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:17.976924 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-9e918d70-59c0-4f38-baa9-685ad731dbc2 req-57cedff9-72ff-4a36-8e0b-81a675fe5b5a service nova] Creating event network-vif-deleted:f3ec7aae-1334-4a12-b220-52d17bec51a5 for instance d9534748-fc92-4c24-a65c-ae57474a68ab on n-h2-854119-9 Aug 29 06:29:17.986156 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-9e918d70-59c0-4f38-baa9-685ad731dbc2 req-57cedff9-72ff-4a36-8e0b-81a675fe5b5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291633 Aug 29 06:29:17.987870 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4133/8272] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:29:18.846764 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:18.848249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:18.861251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:18.862233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:18.863119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:18.864422 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:18.865148 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:18.866407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:18.986729 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:18.998430 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-69f9bc79-5f53-4371-9869-499581f27687 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1219 microversion: 2.1 time: 0.155721 Aug 29 06:29:18.999050 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4140/8273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:18 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:20.038422 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:20.039647 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:20.049766 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:20.050596 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:20.051159 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:20.052048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:20.052632 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:20.053225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:20.136251 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:20.150756 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-dfbc3f9f-abdc-40e7-a3d2-589859694680 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1219 microversion: 2.1 time: 0.121345 Aug 29 06:29:20.151728 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4134/8274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:20 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:21.186249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:21.187358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:21.201096 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:21.202483 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:21.203318 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:21.205017 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:21.205916 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:21.206691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:21.313754 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:21.330205 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-08d38847-e2b7-4dc4-a779-36dd2671114e tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1219 microversion: 2.1 time: 0.150630 Aug 29 06:29:21.331289 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4141/8275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:21 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:29:22.360022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:22.360935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:22.369905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:22.370426 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:22.371094 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:22.371803 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:22.372286 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:22.372715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:22.446989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da85b6fdee584df18ba14a8ad8af7fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb09ba5bcfc4079b035a4cf4a96cace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:22.460080 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-aa04d738-6bfe-43ad-adc8-aaef2f778a8f tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 200 len: 1219 microversion: 2.1 time: 0.104839 Aug 29 06:29:22.476228 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4135/8276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:22 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:29:23.494046 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:23.496574 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] [instance: d9534748-fc92-4c24-a65c-ae57474a68ab] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:23.508655 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:23.510011 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:23.510852 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:23.512303 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:23.513423 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:23.514308 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:23.531338 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] HTTP exception thrown: Instance d9534748-fc92-4c24-a65c-ae57474a68ab could not be found. Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Request method failure captured: Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab HTTP/1.1 Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFpTXNcYIDah-8BxRnjpEe6-CtZmE9a1yAoP1O2qExzFxJTAm7b-Ga0rmcMrWxWbh3Lmahx8MlEdKM2-mxKZF9eNCK2Eppi_4kJmxD8ktw1jm8Cwnw4iIIebNewguuA-eJ8XK5hqtWZzwnmSiJyu6hHLxCNHdKUEwgWZrJX2shPdomo Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: fdb09ba5bcfc4079b035a4cf4a96cace Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestShelveInstance-2012211595 Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdb09ba5bcfc4079b035a4cf4a96cace"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fdb09ba5bcfc4079b035a4cf4a96cace"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fdb09ba5bcfc4079b035a4cf4a96cace", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdb09ba5bcfc4079b035a4cf4a96cace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestShelveInstance-2012211595 Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: fdb09ba5bcfc4079b035a4cf4a96cace Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestShelveInstance-2012211595 Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestShelveInstance-2012211595-project Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: da85b6fdee584df18ba14a8ad8af7fea Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestShelveInstance-2012211595-project Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance d9534748-fc92-4c24-a65c-ae57474a68ab could not be found. Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': 'd9534748-fc92-4c24-a65c-ae57474a68ab'} Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9534748-fc92-4c24-a65c-ae57474a68ab could not be found. Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9534748-fc92-4c24-a65c-ae57474a68ab could not be found. Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:29:23.533501 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:29:23.539563 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:29:23.539563 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:29:23.539563 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:29:23.539563 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:29:23.539563 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:29:23.539563 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9534748-fc92-4c24-a65c-ae57474a68ab could not be found. Aug 29 06:29:23.539563 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:29:23.541182 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Returning 404 to user: Instance d9534748-fc92-4c24-a65c-ae57474a68ab could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:29:23.542095 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-5bd0a0a8-caa6-4b16-85a7-fda595b61046 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab" status: 404 len: 111 microversion: 2.1 time: 0.055629 Aug 29 06:29:23.542685 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4142/8277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:23 2022] GET /compute/v2.1/servers/d9534748-fc92-4c24-a65c-ae57474a68ab => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:29:23.799932 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-75fbff2a-c653-4c56-9c26-626f2a17be93 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] Calling method '.version_select at 0x7f1ab8a40ca0>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:23.858484 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-75fbff2a-c653-4c56-9c26-626f2a17be93 tempest-TestShelveInstance-2012211595 tempest-TestShelveInstance-2012211595-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-662054780" status: 202 len: 0 microversion: 2.1 time: 0.070467 Aug 29 06:29:23.859601 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4136/8278] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 29 06:29:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-662054780 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 06:29:49.185090 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:29:49.186716 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:29:49.450490 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c5903cc2-0885-488b-8a85-223f46af2700 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Action: 'create', calling method: .version_select at 0x7f1ab97575e0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1490772261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhFFQWC+F+JU77HMwD2fk7nOIkarfHzv2Oq3/TwNQRXnhnTEF29/NMjmrwTiAJbQ7+pzeHvITgQs47SUwvcujnwsD5KkqNpjBfJ08NfDmTwFLWj/YoAOyatQSJUpSXdYw=="}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:29:49.485109 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c5903cc2-0885-488b-8a85-223f46af2700 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Getting quotas for project 9cf9ec06a9a94660bdc3a9c74d677e35. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:29:49.490952 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.quota [None req-c5903cc2-0885-488b-8a85-223f46af2700 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Getting quotas for user 6aa2d8e354f8487d95b6bb74a5d4a8c3 and project 9cf9ec06a9a94660bdc3a9c74d677e35. Resources: {'key_pairs'} {{(pid=128871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:29:49.526547 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c5903cc2-0885-488b-8a85-223f46af2700 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.343493 Aug 29 06:29:49.532753 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4143/8279] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 29 06:29:49 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:29:51.046512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=22 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:29:51.048061 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:29:51.055554 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1842844615", "imageRef": "6e3fd38c-90a0-4677-991e-152affedd0a1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1490772261", "security_groups": [{"name": "tempest-secgroup-smoke-1663250048"}], "networks": [{"uuid": "c015594a-4a8e-4de2-bf6e-a230c93a96ee"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:29:51.368831 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] validate_networks() for [('c015594a-4a8e-4de2-bf6e-a230c93a96ee', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:29:51.818470 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:29:51.818896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:29:51.819371 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:29:51.819779 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:29:51.820226 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:29:51.832690 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:51.833888 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:51.834703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:51.836209 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:51.837037 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:51.837790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:51.858740 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Getting quotas for project 9cf9ec06a9a94660bdc3a9c74d677e35. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:29:51.865210 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Getting quotas for user 6aa2d8e354f8487d95b6bb74a5d4a8c3 and project 9cf9ec06a9a94660bdc3a9c74d677e35. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:29:51.887081 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:29:51.898134 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e3fd38c-90a0-4677-991e-152affedd0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:29:51.966987 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5f12bdac-9c5a-430f-ba51-8ed7a2f59a2a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.922305 Aug 29 06:29:51.976181 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4137/8280] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:29:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 06:29:51.989135 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-6d22089f-036b-43bd-9e44-1b6c4914072c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:51.991961 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-6d22089f-036b-43bd-9e44-1b6c4914072c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:52.265731 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-6d22089f-036b-43bd-9e44-1b6c4914072c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:52.275499 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-6d22089f-036b-43bd-9e44-1b6c4914072c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1249 microversion: 2.1 time: 0.297201 Aug 29 06:29:52.285543 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4144/8281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:51 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1249 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:53.312356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:53.312958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:53.324418 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:53.325384 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:53.328168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:53.330359 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:53.331694 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:53.333100 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:53.409722 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:53.419473 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fb2c28a8-2fc3-488f-8ea1-9c36ad3fb1d9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1301 microversion: 2.1 time: 0.113086 Aug 29 06:29:53.435829 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4138/8282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:53 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:54.446872 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:54.453326 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:54.473018 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:54.473842 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:54.475065 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:54.476378 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:54.477532 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:54.478604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:54.801249 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:54.812301 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a910ffe7-0421-41ef-9954-ecd9fb69fa5b tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1375 microversion: 2.1 time: 0.372949 Aug 29 06:29:54.828322 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4145/8283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:54 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1375 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:55.397365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-1aebaa47-7a79-46f1-99f5-0bf827194d81 req-10dbefd3-1ae0-4293-8b01-cf2d78194689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abfde48-7b90-4ce2-b1cd-07d9f93431cb", "tag": "19aecc61-15e0-488b-892f-9e26da87206e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:29:55.416713 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1aebaa47-7a79-46f1-99f5-0bf827194d81 req-10dbefd3-1ae0-4293-8b01-cf2d78194689 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:55.417187 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1aebaa47-7a79-46f1-99f5-0bf827194d81 req-10dbefd3-1ae0-4293-8b01-cf2d78194689 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:55.417799 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-1aebaa47-7a79-46f1-99f5-0bf827194d81 req-10dbefd3-1ae0-4293-8b01-cf2d78194689 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:55.429902 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-1aebaa47-7a79-46f1-99f5-0bf827194d81 req-10dbefd3-1ae0-4293-8b01-cf2d78194689 service nova] Creating event network-changed:19aecc61-15e0-488b-892f-9e26da87206e for instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb on n-h1-854119-9 Aug 29 06:29:55.435253 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-1aebaa47-7a79-46f1-99f5-0bf827194d81 req-10dbefd3-1ae0-4293-8b01-cf2d78194689 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142861 Aug 29 06:29:55.436188 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4139/8284] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:29:55.835295 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:55.835989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:55.843906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:55.844709 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:55.845328 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:55.846054 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:55.846515 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:55.846951 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:55.987113 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:55.996476 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c00ff8f5-052b-4e07-b481-11b1505e2000 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1375 microversion: 2.1 time: 0.165728 Aug 29 06:29:55.997058 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4146/8285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:55 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:57.019477 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:57.020298 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:57.027397 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:57.027881 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:57.028352 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:57.029048 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:57.029497 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:57.029914 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:57.188437 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:57.196371 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-df6a7ecc-41e1-4fe4-8cb8-9e35f32828c9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1375 microversion: 2.1 time: 0.181985 Aug 29 06:29:57.196962 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4140/8286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:57 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:58.218667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:58.219471 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:58.226752 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:58.227237 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:58.227702 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:58.228447 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:58.228917 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:58.229374 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:58.457407 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:58.466374 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-fa813ae3-a895-49b0-ae90-b232fe239ae9 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1375 microversion: 2.1 time: 0.251863 Aug 29 06:29:58.467066 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4147/8287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:58 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1375 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:29:59.490300 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:29:59.491175 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:29:59.498528 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:59.499009 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:59.499443 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:59.500168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:29:59.500644 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:29:59.501234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:29:59.660941 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:29:59.679911 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-272df245-47d7-4d08-b09c-c16ef75b126a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1375 microversion: 2.1 time: 0.195071 Aug 29 06:29:59.693091 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4141/8288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:29:59 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1375 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:30:00.703806 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:30:00.704794 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:30:00.713878 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:00.714648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:00.715341 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:00.716279 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:00.716871 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:00.717408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:00.888542 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:30:00.901080 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-98bd6c80-e217-428b-9ac0-f30e12502f48 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1375 microversion: 2.1 time: 0.201102 Aug 29 06:30:00.901683 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4148/8289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:30:00 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1375 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:30:01.143509 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-c16c3e28-44a9-4ffc-ab2b-60389b9e5674 req-b47daa10-a626-494a-ad2f-9ffd9d9e713e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abfde48-7b90-4ce2-b1cd-07d9f93431cb", "name": "network-vif-plugged", "status": "completed", "tag": "19aecc61-15e0-488b-892f-9e26da87206e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:30:01.157334 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c16c3e28-44a9-4ffc-ab2b-60389b9e5674 req-b47daa10-a626-494a-ad2f-9ffd9d9e713e service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:01.158103 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c16c3e28-44a9-4ffc-ab2b-60389b9e5674 req-b47daa10-a626-494a-ad2f-9ffd9d9e713e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:01.158638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-c16c3e28-44a9-4ffc-ab2b-60389b9e5674 req-b47daa10-a626-494a-ad2f-9ffd9d9e713e service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:01.174789 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-c16c3e28-44a9-4ffc-ab2b-60389b9e5674 req-b47daa10-a626-494a-ad2f-9ffd9d9e713e service nova] Creating event network-vif-plugged:19aecc61-15e0-488b-892f-9e26da87206e for instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb on n-h1-854119-9 Aug 29 06:30:01.181369 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-c16c3e28-44a9-4ffc-ab2b-60389b9e5674 req-b47daa10-a626-494a-ad2f-9ffd9d9e713e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041681 Aug 29 06:30:01.182324 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4142/8290] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:30:01.923003 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:30:01.923673 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:30:01.931168 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:01.931672 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:01.932108 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:01.932848 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:01.933316 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:01.933745 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:02.074129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:30:02.082520 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2e33b473-f03e-4bf7-aabb-9efc5c92fb21 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1375 microversion: 2.1 time: 0.163464 Aug 29 06:30:02.083122 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4149/8291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:30:01 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:30:03.102446 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:30:03.103331 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=6 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:30:03.108839 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:30:03.109587 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:30:03.119984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:03.119984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:03.119984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:03.119984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:03.119984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:03.119984 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:03.290468 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:30:03.299654 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b02b25c0-461d-4def-aae1-07e6c672befe tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1375 microversion: 2.1 time: 0.198041 Aug 29 06:30:03.300613 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4143/8292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:30:03 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:30:04.322162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:30:04.323921 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:30:04.326088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=6 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:30:04.335042 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:04.336448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:04.336448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:04.336812 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:04.337248 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:04.337671 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:04.483482 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:30:04.491519 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-976bb28d-5cf0-4bba-841a-0768e3d65d3f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1560 microversion: 2.1 time: 0.173404 Aug 29 06:30:04.492101 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4150/8293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:30:04 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:30:04.512868 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:30:04.513735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:30:04.521182 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:04.521826 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:04.522271 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:04.523770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:04.523770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:04.524018 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:04.662943 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:30:04.671247 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae17c6dc-7361-40cd-a795-d418c480434e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1560 microversion: 2.1 time: 0.162895 Aug 29 06:30:04.671874 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4144/8294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:30:04 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:30:06.403332 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-38e8f16b-6ae6-4c5d-8b56-46047ac35819 req-9065b81b-77a9-4734-b0bb-814dff5bc8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abfde48-7b90-4ce2-b1cd-07d9f93431cb", "tag": "19aecc61-15e0-488b-892f-9e26da87206e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:30:06.415836 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-38e8f16b-6ae6-4c5d-8b56-46047ac35819 req-9065b81b-77a9-4734-b0bb-814dff5bc8f2 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:30:06.416373 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-38e8f16b-6ae6-4c5d-8b56-46047ac35819 req-9065b81b-77a9-4734-b0bb-814dff5bc8f2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:30:06.416815 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-38e8f16b-6ae6-4c5d-8b56-46047ac35819 req-9065b81b-77a9-4734-b0bb-814dff5bc8f2 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:30:06.430443 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-38e8f16b-6ae6-4c5d-8b56-46047ac35819 req-9065b81b-77a9-4734-b0bb-814dff5bc8f2 service nova] Creating event network-changed:19aecc61-15e0-488b-892f-9e26da87206e for instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb on n-h1-854119-9 Aug 29 06:30:06.436422 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-38e8f16b-6ae6-4c5d-8b56-46047ac35819 req-9065b81b-77a9-4734-b0bb-814dff5bc8f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037897 Aug 29 06:30:06.437161 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4151/8295] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:32:55.924752 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 06:32:55.926258 n-d-854119-9 devstack@n-api.service[128872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0fdfc1a5-fcdd-4106-99be-9e46d6a37d4e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 06:32:55.927597 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:32:55.928750 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=36 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:32:55.930008 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:32:55.930176 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:32:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb/action (ip 10.222.0.20) !!! Aug 29 06:32:55.933420 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:32:55.933630 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:32:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb/action (ip 10.222.0.20) !!! Aug 29 06:32:55.935372 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:32:55.935602 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:32:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb/action (ip 10.222.0.20) !!! Aug 29 06:32:55.951280 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ed857de2-9dd4-4b17-bde1-bad0016aae25 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1358762367"}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:32:55.953661 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ed857de2-9dd4-4b17-bde1-bad0016aae25 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:32:55.972453 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed857de2-9dd4-4b17-bde1-bad0016aae25 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:32:55.972958 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed857de2-9dd4-4b17-bde1-bad0016aae25 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:32:55.973902 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed857de2-9dd4-4b17-bde1-bad0016aae25 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:32:55.974184 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed857de2-9dd4-4b17-bde1-bad0016aae25 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:32:55.974652 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed857de2-9dd4-4b17-bde1-bad0016aae25 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:32:55.975085 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-ed857de2-9dd4-4b17-bde1-bad0016aae25 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:32:56.237578 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ed857de2-9dd4-4b17-bde1-bad0016aae25 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "POST /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb/action" status: 202 len: 0 microversion: 2.1 time: 0.315584 Aug 29 06:32:56.239761 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4145/8296] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:32:55 2022] POST /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 06:33:05.974293 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:33:05.975766 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:33:05.976630 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:05.977622 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=38 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:05.978635 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 06:33:05.979012 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Aug 29 06:33:05.980382 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:33:05.980754 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Aug 29 06:33:05.982520 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:33:05.982723 n-d-854119-9 devstack@n-api.service[128871]: Mon Aug 29 06:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Aug 29 06:33:06.098267 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-80d1d679-446d-471d-85b2-9ceb300ba89e req-ad3ce36b-04c1-4879-bd76-23a365a8c1cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abfde48-7b90-4ce2-b1cd-07d9f93431cb", "name": "network-vif-plugged", "status": "completed", "tag": "19aecc61-15e0-488b-892f-9e26da87206e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:33:06.110170 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-80d1d679-446d-471d-85b2-9ceb300ba89e req-ad3ce36b-04c1-4879-bd76-23a365a8c1cb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:06.110927 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-80d1d679-446d-471d-85b2-9ceb300ba89e req-ad3ce36b-04c1-4879-bd76-23a365a8c1cb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:06.111498 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-80d1d679-446d-471d-85b2-9ceb300ba89e req-ad3ce36b-04c1-4879-bd76-23a365a8c1cb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:06.124361 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-80d1d679-446d-471d-85b2-9ceb300ba89e req-ad3ce36b-04c1-4879-bd76-23a365a8c1cb service nova] Creating event network-vif-plugged:19aecc61-15e0-488b-892f-9e26da87206e for instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb on n-h1-854119-9 Aug 29 06:33:06.131313 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-80d1d679-446d-471d-85b2-9ceb300ba89e req-ad3ce36b-04c1-4879-bd76-23a365a8c1cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158647 Aug 29 06:33:06.131880 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4152/8297] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:33:21.214926 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:21.215770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:21.220349 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-756473851", "imageRef": "e607aaf1-9910-4d7e-ab1f-be11576bb189", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1490772261", "security_groups": [{"name": "tempest-secgroup-smoke-1663250048"}], "networks": [{"uuid": "c015594a-4a8e-4de2-bf6e-a230c93a96ee"}]}} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:33:21.248299 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] [0fdfc1a5-fcdd-4106-99be-9e46d6a37d4e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51752. Aug 29 06:33:21.249293 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] [aff636fb-bfa8-4b47-8e67-f6adbe184cfe] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51750. Aug 29 06:33:21.354626 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.network.neutron [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] validate_networks() for [('c015594a-4a8e-4de2-bf6e-a230c93a96ee', None, None, None, None, None)] {{(pid=128872) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 29 06:33:21.892052 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Flavor limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 06:33:21.892548 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Image limits 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 06:33:21.893022 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Flavor pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 06:33:21.893428 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Image pref 0:0:0 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 06:33:21.893835 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.virt.hardware [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 06:33:21.914400 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:21.915116 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:21.915566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:21.916431 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:21.917006 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:21.917557 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:21.936490 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Getting quotas for project 9cf9ec06a9a94660bdc3a9c74d677e35. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 06:33:21.943155 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.quota [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Getting quotas for user 6aa2d8e354f8487d95b6bb74a5d4a8c3 and project 9cf9ec06a9a94660bdc3a9c74d677e35. Resources: {'ram', 'cores', 'instances'} {{(pid=128872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 06:33:21.962937 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Going to run 1 instances... {{(pid=128872) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 06:33:21.966279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e607aaf1-9910-4d7e-ab1f-be11576bb189',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 06:33:22.023336 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-582f71f5-c8ed-4086-9260-cfd84694c086 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810501 Aug 29 06:33:22.024059 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4146/8298] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 29 06:33:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 06:33:22.033939 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:22.038724 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:22.045639 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-7119d9c9-1bc0-4ccc-9f91-c56dbdabb5b7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:22.047129 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-7119d9c9-1bc0-4ccc-9f91-c56dbdabb5b7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:22.063259 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51768. Aug 29 06:33:22.065421 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51766. Aug 29 06:33:22.116357 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-7119d9c9-1bc0-4ccc-9f91-c56dbdabb5b7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:22.126666 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-7119d9c9-1bc0-4ccc-9f91-c56dbdabb5b7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1248 microversion: 2.1 time: 0.094594 Aug 29 06:33:22.127631 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4153/8299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:22 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1248 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:23.158523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-ae15882a-7516-422b-831b-b9175b80e4bf tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:23.159458 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-ae15882a-7516-422b-831b-b9175b80e4bf tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:23.227056 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-ae15882a-7516-422b-831b-b9175b80e4bf tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:23.237225 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-ae15882a-7516-422b-831b-b9175b80e4bf tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1248 microversion: 2.1 time: 0.082650 Aug 29 06:33:23.238236 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4147/8300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:23 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:24.257310 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2df052fa-5c15-4d38-a91f-ddd4dd0e6711 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:24.258360 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2df052fa-5c15-4d38-a91f-ddd4dd0e6711 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:24.330241 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-2df052fa-5c15-4d38-a91f-ddd4dd0e6711 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:24.338803 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2df052fa-5c15-4d38-a91f-ddd4dd0e6711 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1248 microversion: 2.1 time: 0.085346 Aug 29 06:33:24.339410 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4154/8301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:24 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:25.362552 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-d6c736d7-38f7-42d3-a9aa-3fada4c6f0ae tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:25.363310 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-d6c736d7-38f7-42d3-a9aa-3fada4c6f0ae tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:25.422167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-d6c736d7-38f7-42d3-a9aa-3fada4c6f0ae tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:25.429960 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-d6c736d7-38f7-42d3-a9aa-3fada4c6f0ae tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1248 microversion: 2.1 time: 0.071992 Aug 29 06:33:25.450780 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4148/8302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:25 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:25.978075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-fe35ed01-8788-46ff-9a7f-3156f714ffb5 req-bb668985-3ef8-470e-aa51-6e11e709d7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abfde48-7b90-4ce2-b1cd-07d9f93431cb", "name": "network-vif-unplugged", "status": "completed", "tag": "19aecc61-15e0-488b-892f-9e26da87206e"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:33:25.995299 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fe35ed01-8788-46ff-9a7f-3156f714ffb5 req-bb668985-3ef8-470e-aa51-6e11e709d7d1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:25.996195 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fe35ed01-8788-46ff-9a7f-3156f714ffb5 req-bb668985-3ef8-470e-aa51-6e11e709d7d1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:25.997404 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-fe35ed01-8788-46ff-9a7f-3156f714ffb5 req-bb668985-3ef8-470e-aa51-6e11e709d7d1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:26.011568 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-fe35ed01-8788-46ff-9a7f-3156f714ffb5 req-bb668985-3ef8-470e-aa51-6e11e709d7d1 service nova] Creating event network-vif-unplugged:19aecc61-15e0-488b-892f-9e26da87206e for instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb on n-h1-854119-9 Aug 29 06:33:26.017320 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-fe35ed01-8788-46ff-9a7f-3156f714ffb5 req-bb668985-3ef8-470e-aa51-6e11e709d7d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043098 Aug 29 06:33:26.018216 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4155/8303] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:33:26.458599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:26.459181 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:26.468657 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:26.469356 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:26.469832 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:26.470715 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:26.471172 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:26.471595 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:26.541513 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:26.550564 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5fcb1862-38b5-4c17-8b86-0574fa5e0811 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1252 microversion: 2.1 time: 0.096483 Aug 29 06:33:26.551294 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4149/8304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:26 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1252 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:27.574657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:27.575307 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:27.582559 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:27.583342 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:27.583880 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:27.589941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:27.590796 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:27.591461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:27.701319 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:27.719234 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-aaabe19c-08bd-4b46-99a4-c56440e88554 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1318 microversion: 2.1 time: 0.149567 Aug 29 06:33:27.720050 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4156/8305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:27 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:28.743485 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:28.744277 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:28.770179 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:28.781391 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:28.782358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:28.783589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:28.784550 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:28.785416 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:29.251188 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:29.267365 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-7cbdac60-050a-4f55-8766-4fa693521d67 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.529864 Aug 29 06:33:29.270027 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4150/8306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:28 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:30.245866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [req-593a4c34-e308-478b-a376-9df2a85566a8 req-e8205e57-2a27-4748-87c7-08f0ead68a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350", "tag": "d54c745d-5f98-413e-a12b-6039c27612e8"}]} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:33:30.276674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-593a4c34-e308-478b-a376-9df2a85566a8 req-e8205e57-2a27-4748-87c7-08f0ead68a23 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:30.277627 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-593a4c34-e308-478b-a376-9df2a85566a8 req-e8205e57-2a27-4748-87c7-08f0ead68a23 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:30.278408 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [req-593a4c34-e308-478b-a376-9df2a85566a8 req-e8205e57-2a27-4748-87c7-08f0ead68a23 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:30.296679 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:30.298225 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:30.314108 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.compute.server_external_events [req-593a4c34-e308-478b-a376-9df2a85566a8 req-e8205e57-2a27-4748-87c7-08f0ead68a23 service nova] Creating event network-changed:d54c745d-5f98-413e-a12b-6039c27612e8 for instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 on n-h2-854119-9 Aug 29 06:33:30.316029 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:30.316924 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:30.317855 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:30.319714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:30.321059 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:30.328327 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:30.339850 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [req-593a4c34-e308-478b-a376-9df2a85566a8 req-e8205e57-2a27-4748-87c7-08f0ead68a23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097367 Aug 29 06:33:30.342624 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4157/8307] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:33:30.626167 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:30.645394 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa71e0ec-a69c-4e71-8fe0-f60dbd09e0ca tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.352679 Aug 29 06:33:30.646316 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4151/8308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:30 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:31.670619 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:31.672253 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:31.684980 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:31.686677 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:31.688358 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:31.691030 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:31.692233 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:31.693062 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:31.946721 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:31.959901 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-559b5413-88a1-42dd-9f96-9f8150ecc4b8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.295949 Aug 29 06:33:31.974787 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4158/8309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:31 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:32.989889 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:32.990846 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:32.993562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:33.013816 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:33.014362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:33.014764 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:33.015464 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:33.016350 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:33.016784 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:33.280612 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:33.302067 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-5c876d23-eb4f-49d3-8785-f36c0751835d tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.316387 Aug 29 06:33:33.319180 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4152/8310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:32 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:34.338478 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:34.340663 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:34.352500 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell0:SELECT=4 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:34.358026 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:34.359539 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:34.360768 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:34.362460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:34.363641 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:34.364734 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:34.728106 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:34.746319 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-a14e2eef-5276-4d42-be4a-59dbee157df7 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.415162 Aug 29 06:33:34.747754 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4159/8311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:34 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:35.786995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:35.799050 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:35.803098 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell0:SELECT=10 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:35.811735 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:35.812665 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:35.813365 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:35.814530 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:35.815343 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:35.816090 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:36.105887 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:36.118338 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-b99d197f-5878-4984-b5f1-e40b33966486 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.337886 Aug 29 06:33:36.127161 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4153/8312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:35 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:37.153119 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:37.154410 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:37.166932 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:37.167926 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:37.168783 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:37.170340 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:37.171251 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:37.172377 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:37.373252 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:37.385490 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1abc0e1b-d62c-4dd3-a486-e840655d3657 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.240393 Aug 29 06:33:37.386353 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4160/8313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:37 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:38.409668 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:38.410737 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:38.422441 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:38.423252 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:38.423957 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:38.425012 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:38.425716 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:38.426185 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:38.620302 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:38.630261 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-fa7211c4-6a82-462d-9c2b-15e3bb090888 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.227215 Aug 29 06:33:38.631052 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4154/8314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:38 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:39.659835 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:39.660650 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:39.668907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:39.669409 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:39.669881 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:39.670606 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:39.671093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:39.671747 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:39.844941 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:39.856619 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-acb418ec-8373-4c85-bd40-c9a54d51ec0c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.202970 Aug 29 06:33:39.857214 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4161/8315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:39 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:33:40.878017 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:40.878622 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:40.888297 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:40.889727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:40.889727 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:40.890790 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:40.891591 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:40.892263 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:41.072786 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:41.083042 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8856c162-97fe-4bea-a5ee-5bde0ff98cfb tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.209244 Aug 29 06:33:41.083848 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4155/8316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:40 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:42.107493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:42.107493 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:42.114094 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:42.114736 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:42.115282 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:42.116278 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:42.116823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:42.117331 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:42.284626 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:42.298472 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-1ec17de2-7bf3-4506-b938-c8ff6df4b213 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.196336 Aug 29 06:33:42.299861 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4162/8317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:42 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:33:43.323769 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:43.324600 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:43.333389 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:43.333970 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:43.334461 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:43.335589 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:43.336379 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:43.337095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:43.524553 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:43.537834 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-47d1d76c-4ad4-42fb-9e4f-7f7859781100 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.218998 Aug 29 06:33:43.538722 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4156/8318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:43 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:33:44.560524 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:44.561180 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:44.574207 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:44.576314 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:44.582973 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:44.583837 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:44.584366 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:44.584843 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:44.759756 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:44.769797 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-bc847163-0f5a-4a80-ba68-af46c0272644 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.213051 Aug 29 06:33:44.770423 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4163/8319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:44 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:45.792562 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:45.794168 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:45.804512 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:45.805111 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:45.805732 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:45.806684 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:45.807362 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:45.807935 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:45.987434 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:46.022528 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-06faba3d-4855-41aa-aafa-7dfebe64e794 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.234806 Aug 29 06:33:46.025293 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4157/8320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:45 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:33:47.043438 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:47.044081 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:47.053906 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:47.054454 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:47.054904 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:47.055636 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:47.056086 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:47.056557 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:47.247372 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:47.261058 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ad6c8e29-0b99-4c7c-af07-4c24ccaf572a tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.221477 Aug 29 06:33:47.262405 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4164/8321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:47 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:47.287113 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-841059e6-19bd-4fb3-b566-93d6ff9a87c7 req-31188e3f-7045-4aef-b97a-21bf9745c23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350", "name": "network-vif-plugged", "status": "completed", "tag": "d54c745d-5f98-413e-a12b-6039c27612e8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:33:47.309095 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-841059e6-19bd-4fb3-b566-93d6ff9a87c7 req-31188e3f-7045-4aef-b97a-21bf9745c23b service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:47.309579 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-841059e6-19bd-4fb3-b566-93d6ff9a87c7 req-31188e3f-7045-4aef-b97a-21bf9745c23b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:47.310013 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-841059e6-19bd-4fb3-b566-93d6ff9a87c7 req-31188e3f-7045-4aef-b97a-21bf9745c23b service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:47.329478 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-841059e6-19bd-4fb3-b566-93d6ff9a87c7 req-31188e3f-7045-4aef-b97a-21bf9745c23b service nova] Creating event network-vif-plugged:d54c745d-5f98-413e-a12b-6039c27612e8 for instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 on n-h2-854119-9 Aug 29 06:33:47.341698 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-841059e6-19bd-4fb3-b566-93d6ff9a87c7 req-31188e3f-7045-4aef-b97a-21bf9745c23b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059251 Aug 29 06:33:47.342643 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4158/8322] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 06:33:48.290488 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:48.291648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:48.303818 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:48.304459 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:48.304907 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:48.305632 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:48.306093 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:48.306521 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:48.452855 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:48.461350 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-f91e83a5-afe8-448a-9904-f3e65b9123d8 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1374 microversion: 2.1 time: 0.178371 Aug 29 06:33:48.461940 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4165/8323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:48 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:49.491599 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:49.493309 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:49.500945 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:49.501462 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:49.501896 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:49.502605 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:49.503054 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:49.503474 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:49.674158 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:49.682497 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-98b2d8ee-7776-47c0-9fcb-5d2fc1732f3e tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1558 microversion: 2.1 time: 0.196422 Aug 29 06:33:49.683087 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4159/8324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:49 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:49.704436 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:33:49.705371 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:33:49.712814 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:49.713315 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:49.713755 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:49.714461 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:49.714924 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:49.715339 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:49.907475 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:33:49.928035 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-83fa7102-34e1-4f7c-ad80-d5e066e46cc5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1558 microversion: 2.1 time: 0.227712 Aug 29 06:33:49.929008 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4166/8325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:33:49 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:33:52.307923 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-0217bd96-016a-46f0-ab2a-519edf5ae761 req-155109a6-9db6-4ccd-a41e-38c459c76792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350", "tag": "d54c745d-5f98-413e-a12b-6039c27612e8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:33:52.320163 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:52.329624 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0217bd96-016a-46f0-ab2a-519edf5ae761 req-155109a6-9db6-4ccd-a41e-38c459c76792 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:33:52.330120 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0217bd96-016a-46f0-ab2a-519edf5ae761 req-155109a6-9db6-4ccd-a41e-38c459c76792 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:33:52.330869 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-0217bd96-016a-46f0-ab2a-519edf5ae761 req-155109a6-9db6-4ccd-a41e-38c459c76792 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:33:52.338852 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=65 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:33:52.353885 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-0217bd96-016a-46f0-ab2a-519edf5ae761 req-155109a6-9db6-4ccd-a41e-38c459c76792 service nova] Creating event network-changed:d54c745d-5f98-413e-a12b-6039c27612e8 for instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 on n-h2-854119-9 Aug 29 06:33:52.361398 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-0217bd96-016a-46f0-ab2a-519edf5ae761 req-155109a6-9db6-4ccd-a41e-38c459c76792 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059463 Aug 29 06:33:52.362870 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4160/8326] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:36:03.284925 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=32 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:36:03.285691 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=64 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:36:03.359940 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-ef132575-99a2-4c7b-9c0a-872b2aa7ea39 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-243726836"}} {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:36:03.362514 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-ef132575-99a2-4c7b-9c0a-872b2aa7ea39 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:03.368865 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef132575-99a2-4c7b-9c0a-872b2aa7ea39 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:03.369365 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef132575-99a2-4c7b-9c0a-872b2aa7ea39 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:03.369811 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef132575-99a2-4c7b-9c0a-872b2aa7ea39 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:03.370522 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef132575-99a2-4c7b-9c0a-872b2aa7ea39 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:03.370989 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef132575-99a2-4c7b-9c0a-872b2aa7ea39 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:03.371424 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-ef132575-99a2-4c7b-9c0a-872b2aa7ea39 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:03.632452 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-ef132575-99a2-4c7b-9c0a-872b2aa7ea39 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "POST /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350/action" status: 202 len: 0 microversion: 2.1 time: 0.349598 Aug 29 06:36:03.633102 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4167/8327] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 29 06:36:03 2022] POST /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 06:36:11.817905 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:36:11.819259 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=1 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:36:11.821668 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:36:11.821939 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Aug 29 06:36:11.824933 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:36:11.825183 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Aug 29 06:36:11.827324 n-d-854119-9 devstack@n-api.service[128872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 06:36:11.827519 n-d-854119-9 devstack@n-api.service[128872]: Mon Aug 29 06:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Aug 29 06:36:11.841216 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-718143cb-b95d-4c02-8d43-1045819e0ad7 req-168d5d0a-f3cd-4b33-b2fb-0e2fe87bcefb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350", "name": "network-vif-plugged", "status": "completed", "tag": "d54c745d-5f98-413e-a12b-6039c27612e8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:36:11.874701 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-718143cb-b95d-4c02-8d43-1045819e0ad7 req-168d5d0a-f3cd-4b33-b2fb-0e2fe87bcefb service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:11.875492 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-718143cb-b95d-4c02-8d43-1045819e0ad7 req-168d5d0a-f3cd-4b33-b2fb-0e2fe87bcefb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:11.876279 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-718143cb-b95d-4c02-8d43-1045819e0ad7 req-168d5d0a-f3cd-4b33-b2fb-0e2fe87bcefb service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:11.900385 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-718143cb-b95d-4c02-8d43-1045819e0ad7 req-168d5d0a-f3cd-4b33-b2fb-0e2fe87bcefb service nova] Creating event network-vif-plugged:d54c745d-5f98-413e-a12b-6039c27612e8 for instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 on n-h2-854119-9 Aug 29 06:36:11.911225 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-718143cb-b95d-4c02-8d43-1045819e0ad7 req-168d5d0a-f3cd-4b33-b2fb-0e2fe87bcefb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094832 Aug 29 06:36:11.911225 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4161/8328] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:36:24.090675 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:36:24.091743 n-d-854119-9 devstack@n-api.service[128871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 06:36:24.092401 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_api:SELECT=2 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:36:24.093523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG dbcounter [-] [128871] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:36:24.097250 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_api:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:36:24.097995 n-d-854119-9 devstack@n-api.service[128872]: DEBUG dbcounter [-] [128872] Writing DB stats nova_cell1:SELECT=2 {{(pid=128872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 06:36:24.101592 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:24.102369 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:24.110577 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:24.111448 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:24.112330 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:24.113450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:24.113771 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:24.114648 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:24.155366 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-84160e5f-b625-4ea0-91bf-77fca0522da3 req-22c28e46-5945-40de-993f-9b478eb8a093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350", "tag": "d54c745d-5f98-413e-a12b-6039c27612e8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:36:24.161910 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:36:24.166242 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-84160e5f-b625-4ea0-91bf-77fca0522da3 req-22c28e46-5945-40de-993f-9b478eb8a093 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:24.166729 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-84160e5f-b625-4ea0-91bf-77fca0522da3 req-22c28e46-5945-40de-993f-9b478eb8a093 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:24.167276 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-84160e5f-b625-4ea0-91bf-77fca0522da3 req-22c28e46-5945-40de-993f-9b478eb8a093 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:24.180927 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-84160e5f-b625-4ea0-91bf-77fca0522da3 req-22c28e46-5945-40de-993f-9b478eb8a093 service nova] Creating event network-changed:d54c745d-5f98-413e-a12b-6039c27612e8 for instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 on n-h2-854119-9 Aug 29 06:36:24.187183 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-84160e5f-b625-4ea0-91bf-77fca0522da3 req-22c28e46-5945-40de-993f-9b478eb8a093 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095430 Aug 29 06:36:24.187951 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4162/8329] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:36:24.271646 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-2aff1987-eb24-405b-8a7b-6ed62b2442a0 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 204 len: 0 microversion: 2.1 time: 0.182232 Aug 29 06:36:24.272854 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4168/8330] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:36:24 2022] DELETE /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:36:24.283794 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:24.284920 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:24.295895 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:24.296432 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:24.296861 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:24.297820 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:24.298278 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:24.298710 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:24.508642 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:36:24.518570 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-f858b681-434d-4e49-8bfe-a977484a0a55 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1683 microversion: 2.1 time: 0.240028 Aug 29 06:36:24.519256 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4163/8331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:36:24 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1683 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:36:25.541197 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:25.541897 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:25.551075 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:25.551580 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:25.552019 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:25.552797 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:25.553260 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:25.553692 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:25.576507 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd373edf-ca58-461b-9e1b-fe6b122bf43b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52140. Aug 29 06:36:25.577215 n-d-854119-9 devstack@n-api.service[128871]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8824b28-96f0-4141-8fd9-d8165efabd18] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52138. Aug 29 06:36:25.714402 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:36:25.723474 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-8e6dae61-690d-4eaf-9560-47401282a55f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1683 microversion: 2.1 time: 0.186604 Aug 29 06:36:25.724059 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4169/8332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:36:25 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:36:26.728714 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-bf970b40-e1fb-4088-8611-fb6e052afe22 req-cdf57d2e-9baf-4ee1-94fa-aa12922fafc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350", "name": "network-vif-deleted", "tag": "d54c745d-5f98-413e-a12b-6039c27612e8"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:36:26.741532 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bf970b40-e1fb-4088-8611-fb6e052afe22 req-cdf57d2e-9baf-4ee1-94fa-aa12922fafc1 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:26.742606 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bf970b40-e1fb-4088-8611-fb6e052afe22 req-cdf57d2e-9baf-4ee1-94fa-aa12922fafc1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:26.743129 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-bf970b40-e1fb-4088-8611-fb6e052afe22 req-cdf57d2e-9baf-4ee1-94fa-aa12922fafc1 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:26.749296 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:26.750198 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:26.762218 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:26.763177 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:26.763866 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:26.765150 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:26.765984 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:26.766746 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:26.768274 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-bf970b40-e1fb-4088-8611-fb6e052afe22 req-cdf57d2e-9baf-4ee1-94fa-aa12922fafc1 service nova] Creating event network-vif-deleted:d54c745d-5f98-413e-a12b-6039c27612e8 for instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 on n-h2-854119-9 Aug 29 06:36:26.775868 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-bf970b40-e1fb-4088-8611-fb6e052afe22 req-cdf57d2e-9baf-4ee1-94fa-aa12922fafc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050600 Aug 29 06:36:26.779018 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4164/8333] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:36:26.851375 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:36:26.860476 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-cc2bf225-2aea-444d-bb8b-d5c0c707e353 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 200 len: 1333 microversion: 2.1 time: 0.117004 Aug 29 06:36:26.861063 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4170/8334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:36:26 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 06:36:27.882770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:27.883469 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:27.891638 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:27.892358 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:27.892906 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:27.893770 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:27.894361 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:27.894878 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:27.911151 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.wsgi [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] HTTP exception thrown: Instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 could not be found. Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Request method failure captured: Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: request: GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 HTTP/1.1 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: Accept: application/json Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: Accept-Encoding: identity Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: Connection: close Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: Content-Length: 0 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: Content-Type: application/json Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: Host: 10.222.0.20 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: Openstack-System-Scope: None Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: User-Agent: python-urllib3/1.26.12 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Auth-Token: gAAAAABjDFzVfoMYXhZX_40kgCglrzWVetPaMjUxfS-y--ox5QVOIQmOMuw9OsNVPT9a18tGXTo_XDh1ecpWR4n_LJmwSR8hebXhcoVpO9bI0HUCeAx7cFsxNW2C6zmg8N98ytxDivVd9v_mMCNdV3Nuo4z-4UkJLxQn5SJnn5iUOUf3j7ECIs4 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Id: None Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Domain-Name: None Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Identity-Status: Confirmed Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Is-Admin-Project: True Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Id: default Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Domain-Name: Default Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Id: 9cf9ec06a9a94660bdc3a9c74d677e35 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Project-Name: tempest-TestSnapshotPattern-1364561117 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Role: member,reader Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Roles: member,reader Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cf9ec06a9a94660bdc3a9c74d677e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9cf9ec06a9a94660bdc3a9c74d677e35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9cf9ec06a9a94660bdc3a9c74d677e35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cf9ec06a9a94660bdc3a9c74d677e35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant: tempest-TestSnapshotPattern-1364561117 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Id: 9cf9ec06a9a94660bdc3a9c74d677e35 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-Tenant-Name: tempest-TestSnapshotPattern-1364561117 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-User: tempest-TestSnapshotPattern-1364561117-project Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Id: default Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-User-Domain-Name: Default Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-User-Id: 6aa2d8e354f8487d95b6bb74a5d4a8c3 Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: X-User-Name: tempest-TestSnapshotPattern-1364561117-project Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: method: > Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: exception: Instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 could not be found. Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: action_args: {'id': '2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350'} Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 could not be found. Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 could not be found. Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:36:27.912904 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 could not be found. Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: ERROR nova.api.openstack.wsgi Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Returning 404 to user: Instance 2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 could not be found. {{(pid=128872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-51cf58b6-e648-4ebf-9cc1-89088d3ee7d5 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350" status: 404 len: 111 microversion: 2.1 time: 0.035999 Aug 29 06:36:27.922230 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4165/8335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:36:27 2022] GET /compute/v2.1/servers/2f08c9f8-9e58-4fb1-8ffc-5b36c8de8350 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:36:29.511200 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:29.512088 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:29.523920 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:29.524667 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:29.525460 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:29.526628 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:29.527247 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:29.528593 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:29.573015 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Going to try to terminate instance {{(pid=128871) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 06:36:29.590046 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-7c59ea64-c5fe-48d6-acb7-17e4fa27ff64 req-64bacd58-8a3b-4662-b1ea-c6adec416a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abfde48-7b90-4ce2-b1cd-07d9f93431cb", "tag": "19aecc61-15e0-488b-892f-9e26da87206e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:36:29.601523 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7c59ea64-c5fe-48d6-acb7-17e4fa27ff64 req-64bacd58-8a3b-4662-b1ea-c6adec416a2a service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:29.602348 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7c59ea64-c5fe-48d6-acb7-17e4fa27ff64 req-64bacd58-8a3b-4662-b1ea-c6adec416a2a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:29.602989 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-7c59ea64-c5fe-48d6-acb7-17e4fa27ff64 req-64bacd58-8a3b-4662-b1ea-c6adec416a2a service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:29.614869 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-7c59ea64-c5fe-48d6-acb7-17e4fa27ff64 req-64bacd58-8a3b-4662-b1ea-c6adec416a2a service nova] Creating event network-changed:19aecc61-15e0-488b-892f-9e26da87206e for instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb on n-h1-854119-9 Aug 29 06:36:29.621035 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-7c59ea64-c5fe-48d6-acb7-17e4fa27ff64 req-64bacd58-8a3b-4662-b1ea-c6adec416a2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115201 Aug 29 06:36:29.621913 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4166/8336] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:36:29.725880 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-c74c517f-2285-4d8c-a06a-9bd2915561a2 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 204 len: 0 microversion: 2.1 time: 0.220599 Aug 29 06:36:29.726711 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4171/8337] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 29 06:36:29 2022] DELETE /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 06:36:29.747031 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:29.748387 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.compute.api [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128872) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:29.758066 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:29.758703 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:29.759234 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:29.760207 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:29.760857 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:29.761396 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:29.963093 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.policy [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128872) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:36:29.972831 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-8757160b-1379-4ca0-894e-a314b313e93f tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1685 microversion: 2.1 time: 0.233884 Aug 29 06:36:29.973441 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4167/8338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:36:29 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1685 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:36:30.998687 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:31.000082 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:31.011953 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:31.012830 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:31.013657 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:31.014954 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:31.015823 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:31.016581 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:31.250450 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.policy [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa2d8e354f8487d95b6bb74a5d4a8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9ec06a9a94660bdc3a9c74d677e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128871) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 06:36:31.266637 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-e077a17d-9821-4fdc-8ff1-b324756567d6 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 200 len: 1566 microversion: 2.1 time: 0.273881 Aug 29 06:36:31.267730 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4172/8339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:36:30 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 1566 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 06:36:31.489566 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [req-41c302c5-f617-4366-8b8d-6525d184bb94 req-0594bd23-a470-493e-a74c-f28111770189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abfde48-7b90-4ce2-b1cd-07d9f93431cb", "name": "network-vif-deleted", "tag": "19aecc61-15e0-488b-892f-9e26da87206e"}]} {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 06:36:31.502798 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-41c302c5-f617-4366-8b8d-6525d184bb94 req-0594bd23-a470-493e-a74c-f28111770189 service nova] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:31.503590 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-41c302c5-f617-4366-8b8d-6525d184bb94 req-0594bd23-a470-493e-a74c-f28111770189 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:31.503996 n-d-854119-9 devstack@n-api.service[128872]: DEBUG oslo_concurrency.lockutils [req-41c302c5-f617-4366-8b8d-6525d184bb94 req-0594bd23-a470-493e-a74c-f28111770189 service nova] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:31.518008 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.compute.server_external_events [req-41c302c5-f617-4366-8b8d-6525d184bb94 req-0594bd23-a470-493e-a74c-f28111770189 service nova] Creating event network-vif-deleted:19aecc61-15e0-488b-892f-9e26da87206e for instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb on n-h1-854119-9 Aug 29 06:36:31.523365 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [req-41c302c5-f617-4366-8b8d-6525d184bb94 req-0594bd23-a470-493e-a74c-f28111770189 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038253 Aug 29 06:36:31.524699 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4168/8340] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 29 06:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 06:36:32.302329 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '>' {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:32.302935 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.compute.api [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] [instance: 2abfde48-7b90-4ce2-b1cd-07d9f93431cb] Fetching instance by UUID {{(pid=128871) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 06:36:32.310021 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:32.310516 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:32.310962 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:32.311674 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Acquiring lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 06:36:32.312162 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 06:36:32.312604 n-d-854119-9 devstack@n-api.service[128871]: DEBUG oslo_concurrency.lockutils [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Lock "a8d62b60-367a-461c-bbae-c4c805cb73c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 06:36:32.326821 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.wsgi [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] HTTP exception thrown: Instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb could not be found. Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Request method failure captured: Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: request: GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb HTTP/1.1 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: Accept: application/json Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: Accept-Encoding: identity Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: Connection: close Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: Content-Length: 0 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: Content-Type: application/json Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: Host: 10.222.0.20 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: Openstack-System-Scope: None Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: User-Agent: python-urllib3/1.26.12 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Auth-Token: gAAAAABjDFzVfoMYXhZX_40kgCglrzWVetPaMjUxfS-y--ox5QVOIQmOMuw9OsNVPT9a18tGXTo_XDh1ecpWR4n_LJmwSR8hebXhcoVpO9bI0HUCeAx7cFsxNW2C6zmg8N98ytxDivVd9v_mMCNdV3Nuo4z-4UkJLxQn5SJnn5iUOUf3j7ECIs4 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Id: None Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Domain-Name: None Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Identity-Status: Confirmed Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Is-Admin-Project: True Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Id: default Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Domain-Name: Default Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Id: 9cf9ec06a9a94660bdc3a9c74d677e35 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Project-Name: tempest-TestSnapshotPattern-1364561117 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Role: member,reader Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Roles: member,reader Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cf9ec06a9a94660bdc3a9c74d677e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9cf9ec06a9a94660bdc3a9c74d677e35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9cf9ec06a9a94660bdc3a9c74d677e35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cf9ec06a9a94660bdc3a9c74d677e35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant: tempest-TestSnapshotPattern-1364561117 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Id: 9cf9ec06a9a94660bdc3a9c74d677e35 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-Tenant-Name: tempest-TestSnapshotPattern-1364561117 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-User: tempest-TestSnapshotPattern-1364561117-project Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Id: default Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-User-Domain-Name: Default Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-User-Id: 6aa2d8e354f8487d95b6bb74a5d4a8c3 Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: X-User-Name: tempest-TestSnapshotPattern-1364561117-project Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: method: > Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: exception: Instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb could not be found. Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: action_args: {'id': '2abfde48-7b90-4ce2-b1cd-07d9f93431cb'} Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: {{(pid=128871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb could not be found. Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb could not be found. Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 06:36:32.328523 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb could not be found. Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: ERROR nova.api.openstack.wsgi Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: DEBUG nova.api.openstack.wsgi [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Returning 404 to user: Instance 2abfde48-7b90-4ce2-b1cd-07d9f93431cb could not be found. {{(pid=128871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: INFO nova.api.openstack.requestlog [None req-850b0068-6484-409b-b369-24d8f46a913c tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb" status: 404 len: 111 microversion: 2.1 time: 0.035943 Aug 29 06:36:32.334863 n-d-854119-9 devstack@n-api.service[128871]: [pid: 128871|app: 0|req: 4173/8341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 29 06:36:32 2022] GET /compute/v2.1/servers/2abfde48-7b90-4ce2-b1cd-07d9f93431cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 06:36:32.548108 n-d-854119-9 devstack@n-api.service[128872]: DEBUG nova.api.openstack.wsgi [None req-1aa5ad5c-9f71-48dc-8d24-a32b739c2576 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] Calling method '.version_select at 0x7f1ab8b2d160>' {{(pid=128872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 06:36:32.581813 n-d-854119-9 devstack@n-api.service[128872]: INFO nova.api.openstack.requestlog [None req-1aa5ad5c-9f71-48dc-8d24-a32b739c2576 tempest-TestSnapshotPattern-1364561117 tempest-TestSnapshotPattern-1364561117-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1490772261" status: 202 len: 0 microversion: 2.1 time: 0.043901 Aug 29 06:36:32.582535 n-d-854119-9 devstack@n-api.service[128872]: [pid: 128872|app: 0|req: 4169/8342] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Aug 29 06:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1490772261 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)